R Reddy

Senior Data Engineer @Wells Fargo

Charlotte, NC, US

Managed a team of 5 data engineers to deliver projects ahead of schedule with a30% increase in productivity• Created the JSON configuration files for cleansing the data through generic Sparkframework.• Developed and implemented a high-performance data pipeline processing over 1 billion events daily, resulting in a 30% time savings.• Optimized ETL workflows using Python, increasing efficiency and reliability by50%.• Architected and deployed a scalable real-time data platform using AWS Stack (S3, Glue, Lambda, RDS) which enhanced business decision-making capability by 27%.• Conceptualized and executed complex Spark SQL Jobs, achieving a 40%improvement in processing large-scale data sets for Data Marts.• Developed Spark applications using Scala for fast data processing.• Optimized and managed PostgreSQL databases on AWS, leveraging Amazon RDS and Amazon Aurora, resulting in a 40% improvement in query performance and 99.99% database uptime through effective use of automated backups,• Multi-AZ deployments, and read replicas.• Implemented real-time data processing with Apache Kafka and Apache Spark, facilitating instant insights and enabling rapid decision-making on production lines.• Optimized data workflows and processing scripts, reducing data retrieval times by20%.• Good exposure in writing SQL queries and in data analysis and fixing data issues for various facts and dimensions for data warehouse and data marts for star schema and snowflake schema.• Developed Spark applications in Scala for data cleansing, validation, transformation, and summarization.• Experience in solving the performance issues in PySpark and created test case documents.• Developed Spark applications in Scala using Data Frames and Spark SQL API for efficient data processing.

JNTU Anantapur

Bachelor's degree, Computer Science

University of Central Missouri

Masters, Master of Science in Computer System Analysis