Nandan Hedge
Senior Data Engineer | GCP (BigQuery, DataProc, Cloud Composer) | Kafka | PySpark | Airflow | MongoDB → DB2 Real-Time Pipelines | ETL/ELT | SQL | Data Modeling
- Role
- Senior Data Engineer (Consultant- Morgan Stanley) at EY
- Location
- Bengaluru, KA, IN
- LinkedIn followers
- 500 followers
About Nandan Hedge
I am a Senior Data Engineer with 6+ years of experience designing scalable data pipelines, real-time streaming systems, and cloud-based ETL/ELT workflows. I specialize in GCP, Kafka, PySpark, Airflow, BigQuery, and Python, with strong exposure to retail and e-commerce data platforms.At EY, I lead the data engineering work for a real-time MongoDB → Kafka → DB2 integration pipeline, where I design Python-based enrichment logic, manage change streams, build metadata-driven pipelines, and support high-volume transactional workloads.I have hands-on experience in:Real-time streaming using KafkaBatch and incremental ETL/ELT on GCPPySpark transformations on DataProcBigQuery data modeling & performance tuningAirflow orchestration & schedulingMetadata management and reconciliation frameworksSQL optimization on DB2Building pre-aggregated analytical tables for dashboardsI enjoy building reliable, high-quality data systems and solving complex data challenges end-to-end.
Experience
Senior Data Engineer (Consultant- Morgan Stanley)
Apr 2024 — Present · Bengaluru, IN
Key Responsibilities & Impact:Leading development of a real-time MongoDB → Kafka → DB2 pipeline for retail approval workflows.Built incremental & full-load pipelines using PySpark and BigQuery.Developed Airflow DAGs in GCP Cloud Composer for rebase, recon, and pipeline scheduling.
Education
Shree Devi Institute of Technology, MANGALORE
Bachelor of Engineering - BE, Mechanical Engineering
2014 — 2018
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.