Harshavardhan Chappidi
Senior Data Engineer | Real-Time & Scalable Data Pipelines | AWS, Azure, Databricks | Kafka, Spark, Flink | dbt, Airflow, Terraform
- Role
- Senior Data Engineer at Netflix
- Location
- Austin, TX, US
- LinkedIn followers
- 500 followers
About Harshavardhan Chappidi
Data Engineer with 6+ years of experience designing large-scale data platforms across…
Experience
Senior Data Engineer
Jul 2024 — Present · CA, US
Developed robust ETL frameworks using Python, PySpark, and pandas to optimize data transformation and validation processes, enabling self-service analytics across multiple cross-functional teams. • Engineered DevOps pipelines with GitHub Actions and Terraform, integrating automated tests and rollback strategies that lowered production incidents by 40% and enhanced release reliability. • Streamlined data orchestration using Apache Airflow (MWAA) by creating modular DAGs and integrating SQL-based data quality checks (e.g, dbt tests), improving pipeline reliability and reducing manual workload by 55%. • Developed low-latency data ingestion pipelines using Apache Kafka and Apache Flink, enabling low-latency, fault-tolerant data processing to support scalable, distributed systems. • Collaborated with machine learning teams to deliver business-facing insights in Tableau, creating unified dashboards that aligned technical data pipelines with key business KPIs.
Education
University of Wisconsin-Milwaukee
Master of Business Administration - MBA
2022 — 2023
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.