Mayur Yadav

System Engineer @Tata Consultancy Services

New Delhi, IN

Engineered high-performance ETL pipelines using Azure Data Factory and Databricks, reducing data processing time by 50% and enabling near real-time analytics. Architected and maintained Delta Lake solutions for scalable, versioned data storage, supporting millions of records with seamless schema evolution.Developed advanced PySpark transformations and SQL queries to cleanse, enrich, and model data for business-critical dashboards and machine learning workflows.Designed and implemented Medallion architecture using Azure Databricks and Synapse, enabling structured data flow across bronze, silver, and gold layers for scalable, high-quality analytics.Led Agile sprint planning and client-facing requirement sessions, translating business needs into scalable technical solutions with measurable impact.Implemented CI/CD pipelines with Azure DevOps, streamlining deployment cycles Enforced data quality and compliance through Unity Catalog, custom validation frameworks, and role-based access controls across environments.