Shubham Mittal
Data Engineer at Expedia Group | Spark | Scala | Kafka | Big Data | Docker | Kubernetes | Linux | Terraform | AWS | Git | Shell | Python | Domains: Advertisement | Marketing | Affiliates | Travel | People Tech | Pharma
- Role
- Data Engineer at Expedia Group
- Location
- Gurugram, HR, IN
- LinkedIn followers
- 500 followers
About Shubham Mittal
Data Engineer with 7+ years of experience executing data-driven solutions to increase…
Experience
Data Engineer
Sep 2021 — Present · Gurugram, IN
Delivered high-impact data engineering, cloud migration, and cost optimisation projects across AWS, Hadoop/Spark, and Expedia’s EGDL/EGDP platforms.Achieved below outcomes as member of Expedia Affiliates Team:ADP Optimisation: Cut DAG runtime by 66%(6 hrs → 2–2.5 hrs) via infra revamp & refactoring, enabling scalable bulk restatements. Cost Savings:~$50k per month through streamlining the design and using spark properties.Hive → Iceberg Migration: Reduced query cost ~40%, added schema evolution, time travel & partition pruning. Cost Savings:~$60k per monthCI/CD Automation: Cut GitHub Actions build time 73%(15 → 4 mins), automated ADP production releases.Travel Shop Pipeline: Built PySpark/AWS pipeline powering millions of monthly search queries.Cost Wins: Shifted to event-driven DAGs, reduced EMR runtime ~50%; EC2 right-sizing saved $50K+/yr.EGDP Compute Migration: Zero downtime, ahead of schedule, boosted developer throughput.Security Compliance: Moved secrets to EG Vault, removing plain-text from GitHub.Mentorship: Onboarded engineers, unblocked vendor & affiliate below outcomes as System Engineer in People Technology Team:Cut AWS infra cost from $2K+ to ~$1K/mo via VPC cleanup, server consolidation (10 → 3).Migrated Payroll/ Workday Integrations during Data Center shutdown; decommissioned legacy systems.Automated SFTP key rotation (1 day → 10 min), integrated AWS SFTP Transfer Family.Delivered cloud infra for Medallia, Worklytics, Employee Badge Data using IAC Terraform.Added network traffic security layer through Palo Alto.Tech: Hadoop/Spark, Streaming, AWS (Glue, Lambda, Redshift, Aurora, VPC, CloudFormation, API Gateway), PySpark, Hive, Iceberg, Airflow, Terraform, Oracle, PL/SQL, GitHub Actions, Jenkins, Ansible.
Education
Holy Child School,Bharatpur Rampur,U.P.
Intermediate
2012 — 2013
College of Technology,pantnagar
Bachelor of Technology - BTech
2014 — 2018
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.