Sudheer M.
Senior Data Engineer Data Architect Dai Suneratech @DAI
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer Data Architect Dai Suneratech @DAI
London, GB
Led data engineering team to design and deliver scalable pipelines using Azure Fabric and Databricks.Designed and implemented scalable, declarative data pipelines using Delta Live Tables in Databricks for automated and reliable ETL processing.Applied data quality rules and lineage tracking using DLT expectations and Unity Catalog to ensure data accuracy, auditability, and compliance.Drove over 10 large-scale data migrations with a focus on high data integrity.Architected end-to-end data solutions on Azure using Fabric, Synapse Analytics, Data Factory, and Data Lake Storage.Expert in Python, PySpark, and SQL for building data transformations and optimizing performance on large-scale datasets.Expertise in data modeling, creating conceptual, logical, and physical models to facilitate efficient analytics.Designed and implemented real-time data processing frameworks using Azure Stream Analytics, Databricks, and Event Hubs.Hands-on experience with multi-cloud integration across SAP, Oracle, CRM,AWS, GCP, and Snowflake for seamless data movement and interoperability.Implemented data governance using Purview and Unity Catalog.Automated document processing and extracted insights from unstructured data using Microsoft Form Recognizer.Implemented CI/CD pipelines using Azure DevOps and GitHub Actions to automate data workflows.Built GenAI solutions using Azure OpenAI, RAG, Azure Search, AI Studio & Copilot Studio.Design with business goals while serving as SPOC for RFPs, supporting planning, governance, and cost control
EDUCATION
Jawaharlal Nehru Technological University
Bachelor’s Degree, Computer Science
University of Hertfordshire
Master's degree, Data Science and Analytics
Jawaharlal Nehru Technological University
Master’s Degree, Computer Science
ABOUT SUDHEER M.
15+ years in Data engineering, with deep expertise in Azure, Fabric, and Databricks with Delta Live tables. • Built scalable batch and streaming pipelines using Python,PySpark, SQL, and Machine Learning frameworks. • Designed telemetry & IoT data pipelines leveraging Azure Event Hubs, IoT Hub, and Stream Analytics. • Developed real-time monitoring and analytics using Azure Data Explorer and KQL. • Designed BI solutions using semantic models, Power BI, and Azure Analysis Services. • Skilled in data modeling, analytics, and statistical methods for business insight generation. • Implemented Microsoft Purview, Unity Catalog, and automated CI/CD using Azure DevOps. • Designed BI solutions using semantic models, Power BI, and Azure Analysis Services. • Strong hands-on experience with AWS, GCP, and Snowflake in hybrid/multi-cloud data ecosystems. • Acted as Solution Data Architect, designing scalable data architectures for migration and integration projects. • Act as RFP Solution Architect, driving proposals, estimates, and client workshops.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.