Divya M
Data Platform Engineer @Sobeys
Signup · Get unlimited contacts
WORK HISTORY
Data Platform Engineer @Sobeys
CA
Azure Data Platform Engineer | Cloud Data Migration | ETL Pipelines | Databricks | PySpark | ADF | Synapse | DevOpsLed the migration of legacy on-premises systems to the Azure ecosystem, designing and implementing scalable ETL pipelines and cloud-native frameworks that power enterprise-wide analytics, including finance, risk, and enterprise data products (ADS/VDS). Architected end-to-end data workflows across Azure Data Factory, Databricks, and Delta Lake to enable seamless integration between on-prem and cloud environments, ensuring governance and lineage compliance using STTM.Developed reusable PySpark notebooks and optimized SQL queries in Databricks, reducing transformation times by 25% and standardizing logic across datasets. Built flexible ETL frameworks handling 100+ datasets, automating ingestion and transformation to cut manual effort by 40%. Designed ADF pipelines with parameterized control flows and robust error handling, improving reliability for multiple business domains. Enhanced performance through data model optimization, normalization, and indexing, improving query efficiency by 40%.Improved delivery and reliability through CI/CD automation in Azure DevOps, reducing deployment errors by 35%. Conducted unit testing, scheduling, and dependency management to minimize pipeline failures. Mentored and transitioned three Data Analysts into Data Engineers, delivering hands-on training in ADF, Databricks (PySpark), and data modeling. Collaborated in agile sprints, code reviews, and planning sessions, driving faster delivery and stronger team performance.
EDUCATION
Northeastern University
Master's degree, Data Analytics/ Data science
Gudlavalleru Engineering College
Bachelor of Technology - BTech, Electrical and Electronics Engineering
ABOUT DIVYA M
I’m a Data Engineer and Analytics Professional with over 6 years of experience designing and building cloud-based data pipelines, analytics platforms, and visualization solutions. I have strong expertise in Azure (ADF, Synapse, Data Lake, Databricks), AWS (S3, Redshift, Lambda), and GCP, along with tools like Apache Spark, Delta Lake, Airflow, and Snowflake.I’m skilled in Python, SQL, and PySpark for ETL automation, data modeling, and analytics, and experienced with Power BI, Tableau, and Excel for creating clear, insightful dashboards and reports. My background spans financial, retail, telecom, and nonprofit domains, where I’ve delivered solutions that improve data reliability, reporting speed, and business decision-making.I’m passionate about transforming raw data into actionable insights through scalable cloud architectures, strong data governance, and modern visualization techniques.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.