Sushmitha Reddy
.
- Role
- Data Engineer at Capital One
- Location
- Newark, DE, US
- LinkedIn followers
- 500 followers
About Sushmitha Reddy
Business Analyst with 4.5+ years of experience in requirements gathering, process…
Experience
Data Engineer
Nov 2024 — Present
Designed and implemented scalable ETL/ELT data pipelines using Python, SQL, and Databricks to process 5TB+ data daily from multiple enterprise data sources. · Developed cloud-native data solutions on AWS (S3, Glue, Redshift, Lambda, EMR) to support high-volume analytics and reporting platforms. · Created automated data ingestion pipelines integrating APIs, relational databases, and streaming sources, reducing manual data processing by 40%. · Designed and maintained data lake architecture on AWS S3 and Delta Lake, enabling scalable storage for billions of records. · Wrote highly optimized SQL queries and data transformations, improving data warehouse query performance by 30%. · Built real-time and batch data pipelines using Apache Kafka and Spark Streaming for near-real-time analytics use cases. · Implemented data quality validation, monitoring, and logging frameworks, reducing data inconsistencies by 25% across enterprise datasets. · Developed automated ETL orchestration workflows using Apache Airflow, managing 100+ scheduled pipelines for critical business data. · Collaborated with data scientists, analysts, and product teams to deliver curated datasets supporting machine learning and advanced analytics initiatives. · Migrated legacy on-premise data pipelines to AWS cloud architecture, reducing infrastructure costs by 20% and improving scalability. · Designed dimensional data models and star schemas for enterprise data warehouse solutions supporting BI tools and reporting systems. ·Implemented CI/CD pipelines using Git, Jenkins, and Docker to automate deployment of data engineering workflows Performed data profiling, governance, and security controls, ensuring compliance with enterprise data management policies. Documented architecture, data lineage, and pipeline workflows to support cross-team
Education
Wilmington University
Master in web design
Geethanjali College of Engineering and Technology
Computer Science
2009 — 2013
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.