Dinesh Kumar Sanodiya
Immediate joiner | Associate Data Engineer | ADF | Azure Databricks | PySpark | SQL | Python | Delta Lake | Optimization | ADLS Gen2 | ETL | ELT | Medallion Architecture | Power BI | Data Preparation & Modeling
- Role
- Associate Data Engineer at Helson Software Solutions Private Limited
- Location
- Bhopal, IN
- LinkedIn followers
- 500 followers
About Dinesh Kumar Sanodiya
Associate Data Engineer with expertise in ETL pipeline development using Azure Data…
Experience
Associate Data Engineer
Helson Software Solutions Private Limited
Jul 2022 — Present · Hyderabad, IN
As part of my role at Helson Software, I was involved in designing and implementing scalable ETL solutions using Azure Data Factory (ADF), Databricks, PySpark, SQL, and Python to drive efficient data integration, processing, and analytics.Key Contributions & Achievements:• Designed and implemented end-to-end ETL pipelines in ADF and Databricks, transforming and processing 10TB+ of raw data into structured insights within Azure Data Lake Storage Gen2 (ADLS) using the Medallion Architecture (Bronze, Silver, Gold layers).• Architected and developed metadata-driven frameworks for automated and reliable data ingestion.• Configured secure integrations between Databricks notebooks and ADLS Gen2 using Service Principals and Azure Key Vault, ensuring data security and compliance.• Implemented incremental data loading and optimized pipeline performance, reducing processing time and ensuring high data availability.• Scheduled and monitored ADF pipelines and Databricks jobs, minimizing manual intervention through automation.• Managed Azure Data Lake storage performance, ensuring efficient retrieval and transformation.• Handled incident management and change requests via ServiceNow, supporting over users within SLA timelines.• Led monthly QOS reporting and drove continuous process improvements to enhance data reliability and operational efficiency.Regularly communicated with the stakeholders regarding production outages, ensuring transparency and swift issue resolutionThis project strengthened my expertise in data engineering, automation, and cloud-based analytics, reinforcing the importance of well-structured and secure data pipelines in delivering business value.#DataEngineering #Azure #Databricks #ADF #ETL #PySpark #ADLS #AzureKeyVault #Helson Software #DataIntegration #CloudComputing
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.