Durga Chandhan
Data Engineer (AI & ML) | 5+ yrs @ Microsoft, NVIDIA & Abbott | Azure (ADF, Databricks, Synapse), AWS (SageMaker, Glue) | Spark, Kafka, Airflow | Building Scalable & LLM-Driven Data Pipelines
- Role
- Data Engineer at Microsoft
- Location
- Nashua, NH, US
- LinkedIn followers
- 500 followers
About Durga Chandhan
Data Engineer with 5+ years of experience designing, developing, and optimizing…
Experience
Data Engineer
Jun 2024 — Present · WA, US
Architected and deployed 12+ large-scale data pipelines using Azure Data Factory, Azure Synapse Analytics, Databricks, and Microsoft Fabric implementing Delta Lake Medallion architecture, reducing ETL costs by 45% and improving data freshness.• Built real-time streaming data solutions using Fabric Real-Time Analytics (KQL) ingesting 40K+ events/second from Azure Event Hubs and IoT Hub, achieving sub-second latency for operational dashboards.• Developed machine learning pipelines in Python, PySpark, and scikit-learn on Databricks to automate feature engineering for predictive maintenance models, reducing downtime prediction windows from 4 hours to 15 minutes with 92% accuracy.• Optimized Synapse SQL pools, reusable stored procedures, and query templates in collaboration with Product and Finance teams, reducing analytics workload duplication by 30%.• Implemented LLM-powered data quality monitoring using Azure OpenAI and LangChain to auto-generate SQL test queries and anomaly explanations, cutting resolution time by 60% across 30+ datasets.• Created Power BI Premium datasets with complex DAX calculations and DirectQuery connections to Synapse, enabling monthly users with interactive, drill-through reporting.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.