Sarthak Dasgupta

About Sarthak Dasgupta

Senior Data Engineer with a strong record of designing and delivering scalable, production-grade data platforms across retail, automotive, and e-commerce domains. I specialize in building high-performance ETL and streaming pipelines that power analytics, reporting, and data-driven decision-making at scale.I have hands-on expertise with PySpark, Databricks, Snowflake, and Azure Data Factory, and have worked extensively across Azure, AWS, and GCP environments. My work focuses on creating reliable, automated, and cost-efficient data pipelines, with a strong emphasis on data quality, performance optimization, and operational resilience.Technically proficient in Python, SQL, Scala, and Big Data ecosystems, I enjoy solving complex data challenges and turning raw data into trusted, analytics-ready assets. I collaborate closely with BI, DevOps, and product teams to ensure seamless integration, faster delivery cycles, and measurable business impact.I am driven by building data systems that are not only scalable, but also maintainable, observable, and future-ready.

Experience

1. Senior Data Engineer

   EY

   Apr 2024 — Present · Bengaluru, IN

   Client - TVS MotorsAs a Data Engineer, I developed and maintained scalable data pipelines and automation solutions across Azure and Databricks to support analytics and operational needs in the EV domain.DAR Pipeline: Built an ETL pipeline using Azure Data Factory (ADF) and Databricks to compute digitally attributed retail numbers for 2-Wheeler EV leads, enabling clear marketing-to-retail attribution.Lead-to-Retail Funnel: Engineered an end-to-end pipeline to extract, transform, and curate lead, enquiry, and retail data, improving funnel visibility and performance tracking.EV Vahan Pipeline: Designed a transformation layer on Azure to process daily/monthly RTO registration data from the Government Vahan portal, generating state and RTO-wise insights.Cashback Processing: Implemented a scalable workflow to identify cashback-eligible customers and apply business logic, integrating data from ADLS to SQL Server for financial operations.Email Notification System: Automated dealer communications using Python and SMTP to share cashback updates, test ride data, and employee sales incentives.GA3 Integration: Consolidated and transformed Google BigQuery data into ADLS via Databricks, ensuring accuracy and consistency.Production Support & BI Collaboration: Worked with BI teams to resolve production issues, maintain dashboard uptime, and ensure data reliability across reporting layers.

Education

• St Mary 's Convent Inter college

  ISC BOARD, PCM

  2015

• Dr. A.P.J. Abdul Kalam Technical University

  Bachelor of Technology, Computer Engineering

• IILM ACADEMY OF HIGHER LEARNING, GREATER NOIDA

  Bachelor of Technology - BTech, Computer Science

  2015 — 2019

• Birla Institute of Technology and Science, Pilani

  Master of Technology - MTech, Data Science & Engineering