Shubham Sagar
Senior Consultant - Al & Data @ EY | ex-TCSer | GATE Qualified | Python | Microsoft Fabric | AWS | Problem Solver | Leetcode Rating 1984(Top 3%) | Data Engineer | Pandas | NumPy | SQL | PySpark |
- Role
- Senior Consultant - Artificial Intelligence & Data Analytics at EY
- Location
- Delhi, DL, IN
- LinkedIn followers
- 500 followers
About Shubham Sagar
I am a Data Engineer with 5+ years of experience designing and scaling modern cloud data…
Experience
Senior Consultant - Artificial Intelligence & Data Analytics
Feb 2025 — Present · Delhi, IN
At EY, I led the design and implementation for US based Insurance company of data engineering solutions, with a strong focus on data quality, transformation, and performance optimization. Leveraging technologies such as Microsoft Fabric, PySpark, SQL, and Databricks, I developed scalable data pipelines and architectures that supported complex business analytics and decision-making processes. Key responsibilities and achievements included:o Data Cleaning & Transformation: Engineered ETL workflows using PySpark and Microsoft Fabric to clean, transform, and structure large datasets for downstream analytics and reporting, ensuring data quality and consistency.o Data Validation: Implemented automation validation processes, ensuring accuracy and integrity of data across multiple systems by validating all the tables over various factor and exporting the consolidated report to the lakehouseo Late Arriving Dimensions (LAD): Utilized multiple approaches to manage and process late-arriving data, ensuring that late records were accurately integrated into data pipelines without compromising data integrity.o Slowly Changing Dimensions (SCD): Implemented both SCD Type 1 and Type 2 strategies for dimension tables, enabling efficient historical data tracking and supporting time-sensitive analytics.o Implemented soft delete logic for fact tables during incremental loads by joining with delete and dimension tables to identify records to deactivate, and using the merge method to update corresponding fact table entries accordingly.o Designed and implemented an optimization script leveraging techniques like V-Order, Z-Order, and Vacuum to enhance query performance and storage efficiency in large-scale data pipelines.
Education
Netaji Subhash Engineering College
Bachelor of Technology - B.Tech
2016 — 2020
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.