Hrithik Soni
Data Engineer @Accenture (Data & AI) | Azure | Databricks | ADF | Python and Pyspark
- Role
- Associate Software Engineer at Accenture
- Location
- Gurugram, IN
- LinkedIn followers
- 500 followers
About Hrithik Soni
Hi, I am Hrithik Soni I am a passionate Data Engineer with over 1.5 years of…
Experience
Associate Software Engineer
Apr 2024 — Present · Gurugram, IN
Developed and Optimised over 20+ ETL notebooks with Pyspark and SQL to efficiently load text/csv files from ADLS Gen2 into Delta tables within a medallion architecture, in Databricks, significantly reducing processing time by 25% and enhancing productivity.• Implemented transformation logic in the conformed layer to enhance data usability and relevance for business analysis, ensuring a robust and reliable data pipeline.• Executed business transformation logic using stored procedures, facilitating the loading of data in the presentation layer, populating dimension and fact tables for timely and accurate reporting.• Collaborated with cross functional teams to ensure seamless data integration and flow using Azure Data Factory, reducing manual effort by 30% and boosting overall project efficiency.• Familiar with Databricks features like optimise, Vacuum, Z ordering, Time Travel, and Adaptive Query Execution (AQE) to further enhance performance and cost efficiency.• Monitored 100+ pipelines and debugged incidents, ensuring timely resolution and maintaining data pipeline reliability.• Successfully implemented Fabric in a mini-project, gaining valuable hands-on experience with its features and functionality.
Education
Kendriya vidyalaya
10+2
2017 — 2018
Institute of Engineering and Rural Technology
Bachelor of Technology - BTech
2019 — 2023
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.