Nandan Hedge
Senior Data Engineer (Consultant- Morgan Stanley) @EY
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer (Consultant- Morgan Stanley) @EY
Bengaluru, IN
Key Responsibilities & Impact:Leading development of a real-time MongoDB → Kafka → DB2 pipeline for retail approval workflows.Built incremental & full-load pipelines using PySpark and BigQuery.Developed Airflow DAGs in GCP Cloud Composer for rebase, recon, and pipeline scheduling.
EDUCATION
Shree Devi Institute of Technology, MANGALORE
Bachelor of Engineering - BE, Mechanical Engineering
ABOUT NANDAN HEDGE
I am a Senior Data Engineer with 6+ years of experience designing scalable data pipelines, real-time streaming systems, and cloud-based ETL/ELT workflows. I specialize in GCP, Kafka, PySpark, Airflow, BigQuery, and Python, with strong exposure to retail and e-commerce data platforms.At EY, I lead the data engineering work for a real-time MongoDB → Kafka → DB2 integration pipeline, where I design Python-based enrichment logic, manage change streams, build metadata-driven pipelines, and support high-volume transactional workloads.I have hands-on experience in:Real-time streaming using KafkaBatch and incremental ETL/ELT on GCPPySpark transformations on DataProcBigQuery data modeling & performance tuningAirflow orchestration & schedulingMetadata management and reconciliation frameworksSQL optimization on DB2Building pre-aggregated analytical tables for dashboardsI enjoy building reliable, high-quality data systems and solving complex data challenges end-to-end.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.