Swapnil Jadhav
Data Engineer @Talktalk
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Talktalk
Manchester, GB
Led UAT data reconciliation efforts, ensuring accuracy between source systems and the target warehouse, proactively resolving discrepancies to build stakeholder confidence.• Developed and deployed DevOps pipelines for new server environments, streamlining code promotion and enhancing automation, version control, and deployment efficiency.Led the end-to-end migration of legacy data systems (Informatica, Netezza) to Azure Synapse Analytics, leveraging Azure Data Factory for seamless data integration.• Migrated critical datasets from TRIO and Onesys platforms into Azure Data Warehouse, enabling unified data access, enhanced reporting, and strengthened data governance.• Implemented a scalable Data Vault 2.0 architecture, ensuring traceability, flexibility, and extensibility for future enterprise data initiatives.• Delivered strategic Enterprise Data Warehouse and Data Products using Unity Catalog and a metadata-driven framework powered by Azure Databricks Lakeflow.• Designed and deployed metadata-driven pipeline frameworks with incremental data processing, schema evolution, PII masking, and lineage tracking using Lakeflow Jobs and Lakeflow Declarative Pipelines (DLT).• Automated complex DAG orchestration for both streaming and batch workloads, incorporating data quality expectations, error handling, and dependency management.• Modernized legacy ETL workflows by migrating Synapse pipelines to Lakeflow Jobs, Lakeflow Connect, and declarative ETL pipelines—enhancing scalability, reusability, and reducing technical debt.• Collaborated cross-functionally with Data Scientists, Analysts, and Governance teams to establish Gold standard data, integrating Unity Catalog, SLA tracking, and Azure-native alerting for full operational transparency.• Architected reusable Lakeflow Jobs for multi-layered data pipelines (Bronze, Silver, Gold), enabling scalable and maintainable declarative lakeflows across multiple domains.
EDUCATION
Bharati Vidyapeeth
Bachelor of Engineering - BE, Computer Engineering
ABOUT SWAPNIL JADHAV
I turn messy, legacy data systems into clean, scalable platforms that businesses can actually trust. With 10+ years in data engineering — the last 6 focused entirely on Azure cloud — I\'ve spent my career solving one core problem: organisations sitting on valuable data they can\'t properly access, govern, or use. I fix that. At TalkTalk, I led the migration of legacy Informatica and Netezza platforms to Azure Synapse, and built a full Lakehouse architecture from the ground up — Bronze to Gold — using Azure Databricks and Delta Lake. I also implemented Unity Catalog for centralised data governance, including PII masking, data lineage, and fine-grained access control. Not just technically sound, but audit-ready. What I bring beyond the technical: I design systems that are metadata-driven and self-managing where possible, so engineering teams spend less time firefighting pipelines and more time building. I\'ve done this across telecom, financial services, and insurance — sectors where data quality isn\'t optional. My core stack: Azure Databricks · Azure Data Factory · Synapse Analytics · Delta Lake · Unity Catalog · DLT Pipelines · PySpark · CI/CD via Azure DevOps Certified: DP-203 · AZ-400 · DP-900 · Databricks Fundamentals I\'m currently exploring Senior and Lead Data Engineer opportunities where I can architect at scale and help teams modernise their data foundations.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.