Dhairya Pratap Singh Gaur
Data Engineer at KPMG | Databricks | Snowflake | Ex-Machine Learning Engineer
- Role
- Data Engineer at KPMG
- Location
- New Delhi, DL, IN
- LinkedIn followers
- 500 followers
About Dhairya Pratap Singh Gaur
Data Engineer with 4+ years of experience leveraging big data technologies to build…
Experience
Data Engineer
Nov 2021 — Present · Bengaluru, IN
Developed comprehensive reports, data analyses, and interactive dashboards using AWS QuickSight, while managing database operations with pgAdmin for efficient data handling and querying. Implemented metadata scripts and designed critical workflows for the Medallion Architecture, covering data movement from source to bronze, bronze to silver, silver to gold, and silver to output, as well as gold to output. These processes were built using PySpark and Databricks, ensuring scalable, optimized data processing pipelines and seamless integration across the data lake, enhancing data quality and enabling high-performance analytics at each stage.• Engaged in porting and optimising SQL scripts from Teradata for catalog tables to facilitate a seamless and efficient migration process. Developed metadata scripts and engineered ETL data pipelines within the Medallion Architecture framework to enhance data workflows. Implemented robust data processing and transformation logic using PySpark, while optimizing queries with Spark SQL to improve performance. Deployed and managed scalable, cloud-based data solutions on Databricks, enabling collaborative development and driving performance tuning for optimized execution across large datasets.
Education
Guru Gobind Singh Indraprastha University
Bachelor of Technology - BTech, Electronics and Communications Engineering
Kendriya Vidyalaya
Primary and Secondary Education, Science and Mathematics
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.