Ujjwal Dhiman

About Ujjwal Dhiman

As a passionate Data Engineer, I specialize in designing and maintaining scalable data pipelines and robust data infrastructure to drive data-driven decision-making. My expertise spans SQL, Azure Synapse Analytics, Python, and PySpark, enabling me to develop high-performance ELT workflows and optimize data processes for transforming raw data into actionable insights.I manage the end-to-end data lifecycle on Microsoft Azure Cloud, including ADLS integration, cloud-native data warehousing, and automating deployments via Azure DevOps for seamless CI/CD pipelines. Whether scripting complex stored procedures in SSMS, orchestrating Spark jobs, or ensuring data reliability across platforms, I thrive on solving technical challenges to deliver scalable, efficient solutions.Additionally, I collaborate with cross-functional teams to align data architecture with business goals, ensuring operational excellence and fostering a culture of automation. Passionate about innovation and continuous learning, I am always exploring cutting-edge technologies in data engineering.Let’s connect and discuss all things cloud analytics, data engineering best practices, and scalable data solutions!

Experience

1. Data Engineer

   Neoteric Analytics

   Sep 2024 — Present · New Delhi, IN

   Designed and implemented a metadata-driven GDPR anonymization framework in Azure Synapse, detecting upstream anonymization signals and enforcing compliant data masking across all warehouse layers while preserving data quality. • Built scalable Spark-based anonymization and change-tracking pipelines, ensuring sensitive data compliance without impacting downstream reporting, analytics, or historical accuracy. • Led end-to-end ingestion and transformation of enterprise data sources into data warehouse using Synapse Analytics, ADLS, Key Vault and SQL, enabling fully automated, governed data flows. • Strengthened the multi-layered data architecture (Bronze → Silver → Staging → Transform → DataHistory → Gold) by improving data quality, governance, and performance. • Partnered with DevOps to deliver stable UAT-to-Production releases, designing pre/post-release pipelines and resolving critical production issues to improve reliability and reduce post-deployment defects. • Designed and implemented a Rescue Stage mechanism to isolate failed Silver loads and automatically serve last successful snapshots to Staging, ensuring uninterrupted reporting despite upstream data quality failures. • Integrated validation-driven retry and snapshot fallback logic with ETL logs and DataHistory, improving pipeline resilience and preventing bad data propagation to downstream layers.

Education

• DAV Schools Network

  Senior Secondary School, Physics, Chemistry and Mathematics

• Quantum Global Campus

  Bachelor of Technology - BTech, Computer Science and Engineering

  2019 — 2023

• Saharanpur Public School - India

  High School