Shivam Sharma
Senior Consultant(GCP/Azure)@EY | 1 x GCP | 2x Azure | 1 x Databricks |1 x PowerBI | 1 x Python | PySpark | PL/SQL | Python | GenAI
- Role
- Senior Consultant Ii at EY
- Location
- Gurugram, HR, IN
- LinkedIn followers
- 500 followers
About Shivam Sharma
With 7 years of dedicated experience in Data Engineering, I have consistently ensured…
Experience
Senior Consultant Ii
Dec 2024 — Present · Gurugram, IN
Engagement : Healthcare (GCP)>Led the design and implementation of data pipelines to migrate TB-scale data from SQL Server to GCP BigQuery, enabling efficient daily incremental updates.>Medallion Architecture Implementation: Applied Raw, Enriched, and Curated Zones to maintain data quality during transformation.>Data Modeling: Designed dimension and fact tables optimized for SCD2, enabling effective historical data tracking and query performance.>SCD2 Implementation: Incorporated Slowly Changing Dimension Type 2 (SCD2) to handle historical data changes and ensure accurate timebased tracking.>Dashboard Development: Created and deployed interactive dashboards, providing real-time insights for enhanced decision-making.>GCP Services Utilization: Utilized Cloud Storage, Cloud SQL, DataProc, Apache Airflow and Cloud Composer to ensure seamless data processing and workflow orchestration.>Data Integrity & Optimization: Ensured high-quality data integrity and optimized pipelines for efficient reporting on Looker.Engagement : Sustainability(Azure)> Migrated data from multiple sources including SQL Server, CSV files, REST APIs, ADLS Gen2, and Unity Catalog. Dec-2024-Present > Designed and implemented a medallion architecture (Raw, Bronze, Silver, Gold) to ensure data lineage, quality, and history preservation.> Preserved full historical data in the Raw and Bronze layers, while maintaining cleaned and transformed data in the Silver and Gold layers.> Applied robust data quality checks in Silver and Gold layers to ensure accuracy and consistency.> Utilized Databricks Autoloader to manage both full loads and incremental data ingestion efficiently.> Collaborated with business stakeholders to gather requirements and developed tables, views, materialized views, and stored procedures accordingly.> Enabled data consumption from the Gold layer for Power BI dashboards and downstream use by data scientists for predictive analytics and reporting.
Education
CHANDIGARH UNIVERSITY
Bachelor of Engineering, Computer Science and Engineering (CSE) - Honors in Information Security
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.