Shivani Thangavel
Azure Data Engineer @CIBC
Signup · Get unlimited contacts
WORK HISTORY
Azure Data Engineer @CIBC
Toronto, ON, CA
Designed and automated end-to-end ETL pipelines using Azure Data Factory and Databricks, reducing manual effort by 40% and enabling real-time analytics across departments. • Managed and optimized Azure SQL Database, ADLS Gen2, and Blob Storage, Improving query performance and supporting timely business reporting. • Implemented SCD Type 2 logic, data validation, and automated workflows, enhancing report accuracy and reducing audit discrepancies by 25%. • Developed and tuned complex SQL, and Spark SQL queries to support Power BI dashboards, reducing report load time.• Built scalable Delta Lake and Snowflake architectures, consolidating multi-source data and streamlining reporting and analytics capabilities. • Led performance tuning and automation of data pipelines, resulting in significant improvements in processing time, operational efficiency, and system reliability. • Collaborated with governance and business teams to define validation rules, enforce secure access, and deliver actionable insights using Agile tools such as Git, Jira, and Confluence. • Mentored junior data engineers and analysts, fostering best practices in coding, testing, and documentation to improve team productivity and solution quality.
EDUCATION
Kumaraguru College of Technology
Bachelor of Engineering - BE, Electrical, Electronics and Communications Engineering
Ontario Tech University
Master's degree, Business Analytics and Artificial Intelligence
ABOUT SHIVANI THANGAVEL
I’m a Microsoft Certified Data Engineer with 3+ years of hands-on experience designing, developing, and optimizing cloud-native data solutions that power business intelligence and decision-making at scale. I architect and automate end-to-end data pipelines using Azure Data Factory, Databricks, and Synapse Analytics—transforming raw data into actionable insights. Proficient in big data processing and real-time analytics using PySpark, Azure Data Explorer, and HDInsight. Skilled in managing cloud storage (Azure Data Lake, Blob Storage) and optimizing SQL/Snowflake databases for performance, security, and scalability. I develop dynamic, insight-rich Power BI dashboards that empower stakeholders to make confident, data-driven decisions. Experienced in securing data ecosystems with Azure Key Vault and building resilient ETL workflows.I bring a blend of deep technical skill and business insight—automating workflows, eliminating bottlenecks, and delivering clean, timely data that drives measurable impact.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.