Varun Dubey
Senior Data Engineer | Backend Systems | Distributed Data Systems | Spark | Python | Airflow | Kafka | AWS | Azure | Data Warehousing
- Role
- Senior Data Engineer at UnitedHealthcare
- Location
- Boston, MA, US
- LinkedIn followers
- 500 followers
About Varun Dubey
Senior Data Engineer with ~6 years of experience building distributed data platforms and scalable analytics pipelines across AWS and Azure. Experienced in Spark, Kafka, Python, and modern data architectures processing multi-terabyte datasets. Proven ability to design reliable data infrastructure, optimize large-scale data processing workloads, and deliver production-grade data products for analytics and machine learning systems.TECHNICAL SKILLSProgramming Languages: Python, SQLData Processing: Apache Spark, Kafka, PandasCloud Platforms: AWS (S3, Glue, Redshift), Azure (Blob Storage, Functions), GCP (Big Query)Data Warehousing: Snowflake, Redshift, PostgreSQL, SQL Server, MySQLData Engineering: Distributed Data Processing, Data Lakehouse Architecture, ETL/ELT Pipelines, Data ModelingOrchestration & DevOps: Terraform, GitHub Actions, CI/CDData Modeling: Dimensional Modeling, Star Schemas, Data MartsVisualization: Tableau, Power
Experience
Senior Data Engineer
Oct 2025 — Present
Designed distributed Spark-based data pipelines using Python and Azure processing 500GB+ healthcaredatasets daily for enterprise analytics and machine learning workloads.• Built scalable ingestion and transformation pipelines integrating 10+ upstream healthcare systems,enabling reliable analytics datasets for enterprise reporting and ML use cases.• Designed and implemented data warehouse tables and dimensional data models in PostgreSQLsupporting large-scale analytics and reporting workflows.• Migrated legacy SQL Server ETL workflows to a cloud-native PostgreSQL architecture, reducing pipelineruntime 35% and improving system scalability.• Optimized analytical SQL workloads through indexing strategies and query tuning, improving dashboard andreporting query performance 30%+ across analytics platforms.• Built CI/CD pipelines using GitHub Actions enabling automated testing and deployment for 15+ productiondata pipelines.• Collaborated with data analysts, product managers, and business stakeholders to gather requirementsand deliver scalable data infrastructure supporting enterprise analytics.
Education
Northeastern University
Master's degree, Information System
RGPV University
Bachelor of Engineering - BE, Computer Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.