Durga Chandhan

Data Engineer (AI & ML) | 5+ yrs @ Microsoft, NVIDIA & Abbott | Azure (ADF, Databricks, Synapse), AWS (SageMaker, Glue) | Spark, Kafka, Airflow | Building Scalable & LLM-Driven Data Pipelines

Role
Data Engineer at Microsoft
Location
Nashua, NH, US
LinkedIn followers
500 followers
Information TechnologyView LinkedIn profile

About Durga Chandhan

Data Engineer with 5+ years of experience designing, developing, and optimizing…

Experience

  1. Data Engineer

    Microsoft

    Jun 2024 — Present · WA, US

    Architected and deployed 12+ large-scale data pipelines using Azure Data Factory, Azure Synapse Analytics, Databricks, and Microsoft Fabric implementing Delta Lake Medallion architecture, reducing ETL costs by 45% and improving data freshness.• Built real-time streaming data solutions using Fabric Real-Time Analytics (KQL) ingesting 40K+ events/second from Azure Event Hubs and IoT Hub, achieving sub-second latency for operational dashboards.• Developed machine learning pipelines in Python, PySpark, and scikit-learn on Databricks to automate feature engineering for predictive maintenance models, reducing downtime prediction windows from 4 hours to 15 minutes with 92% accuracy.• Optimized Synapse SQL pools, reusable stored procedures, and query templates in collaboration with Product and Finance teams, reducing analytics workload duplication by 30%.• Implemented LLM-powered data quality monitoring using Azure OpenAI and LangChain to auto-generate SQL test queries and anomaly explanations, cutting resolution time by 60% across 30+ datasets.• Created Power BI Premium datasets with complex DAX calculations and DirectQuery connections to Synapse, enabling monthly users with interactive, drill-through reporting.

Find verified contacts for anyone on LinkedIn

Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.

Free plan included · No credit card required

This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.

Durga Chandhan — Data Engineer at Microsoft in Nashua, NH, US | Unifers