Vipul Save
Azure Data Engineer Iv @TD
Signup · Get unlimited contacts
WORK HISTORY
Azure Data Engineer Iv @TD
Toronto, ON, CA
Contributed to the Fraud Prevention team, designing and building data pipelines to enable early detection of suspicious activities, improving alert timeliness and fraud response effectiveness- Developed high-performance, modular PySpark applications on Azure Databricks, enabling scalable data processing and empowering business teams with reliable, analytics-ready datasets- Led multiple Databricks performance optimization initiatives, leveraging partitioning strategies, file compaction, Z-Ordering, VACUUM etc. resulting in significant monthly compute cost reduction and improved query performance- Architected and implemented a robust three-tier Medallion (Bronze, Silver, Gold) framework on Azure Databricks, improving data quality, traceability, and reliability across ingestion and consumption layers- Implemented Slowly Changing Dimensions (SCD Type 2) using Delta Lake to maintain full historical accuracy of dimensional data, enabling reliable time-travel analytics and auditability- Implemented and enahnced a reusable PySpark ingestion and transformation framework, supporting both batch and structured streaming workloads, with standardized patterns for schema validation, deduplication, error handling, and logging- Implemented metadata-driven processing using configuration files (JSON/YAML), reducing code duplication and enabling faster onboarding of new data sources with minimal development effort- Integrated Delta Lake features such as MERGE, schema evolution, time travel, and checkpointing to ensure fault tolerance, idempotent processing, and seamless recovery from failures- Optimized Spark execution plans by tuning shuffle partitions, broadcast joins, caching strategies, and memory configurations, significantly reducing job runtimes for large-scale datasets- Developed reusable utilities and helper modules for common transformations, date handling, audit columns, and incremental load logic, improving code maintainability and developer productivity
EDUCATION
Savitribai Phule Pune University
Bachelor of Engineering (BEng), Comp
Centennial College
Post Graduation Dilpoma, Computer Software Engineering
SKILLS
ABOUT VIPUL SAVE
Highly motivated data engineer with 6+ years of hands on experience in designing and implementing databases, data lakes, data warehouse, lakehouse architecture, and data integration (ETL/ELT) workflows on Oracle, Azure SQL Database and Azure Synapse Analytics• Vastly experienced working on Microsoft Azure platform using Azure Data Factory (ETL/ELT), Azure Synapse Analytics, Azure Data Lake Storage (ADLS), Azure Databricks (Delta Lake, Data cleansing & transformation), Azure DevOps (CI/CD) • Proficient in designing and Implementing ETL framework using Azure Data Factory (Orchestration), Azure Synapse Analytics Workspace (Develop and Integrate Hub), Azure Databricks (Validation & Transformation) and Azure SQL DB (Batch control execution & configuration) for loading data onto Delta Lake (Azure Data Lake Storage Gen2) using Lakehouse Architecture (Bronze, Silver Layer and Gold)• Proficiency in designing, deploying and automating ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics workspace and Talend Data Integration• Extensive experience in database programming using SQL, PySpark, SparkSQL, T-SQL, data loading using SQL*Loader, Talend Data Integration• Planned and engineered On-Premise Oracle database migration to Azure SQL database• Experience in supporting business with data analytics using PowerBI and preparing data for Data Science Use cases using Azure Data Lake Storage and Azure Databricks (Delta Lakehouse architecture)• Experience in gathering business requirement for data analytics, designing conceptual and logical data model, Proof of Concept implementation for predictive analytics• Specialized in Banking, Retail, Automotive (especially Sales, Finance & Controlling) and Health Care IndustriesTechnical Skills• Azure Data factory, Data lake, Lakehouse (Delta Lake)• Azure Databricks, Azure SQL Database, Azure Synapse Data Warehouse• Azure DevOps, Azure GIT• Programming PySpark, SparkSQL, SQL, PL-SQL• MSBI (SSIS, SSAS, SSRS)• Data Visualization using PowerBI, Tableau• Data Migration• SQL Server programming and Administration• Analytic Problem-Solving
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.