Ankhi Paul
Senior Data Engineer @Sobeys
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @Sobeys
Toronto, ON, CA
Led the data lake migration project, transitioning ETL workflows to Azure Data Lake and Snowflake, enhancing scalability and processing efficiency. • Developed Feature Engineering and Data Engineering pipelines for the Marketing Mix Model leveraging Ad stock and Hill Transformation. Worked in collaboration with Data Scientists in development and evaluation of ML Models.• Optimized Databricks clusters by implementing policies and pools, which reduced cloud costs by 30%, and developed a cost-monitoring dashboard. • Achieved 58.12% runtime optimization and 45.84% cost reduction in the revamp of Personalization engine.• Implemented data retention policies on Azure Blob Gen 2 which reduced storage cost annually by 90.65%. • Utilized Unity Catalog (Databricks product) to provide data lineage, manage table sharing, and enforce data governance and security protocols. • Collaborated with architects to migrate to Lakehouse architectural framework. • Developed CI/CD pipelines using Azure DevOps and Airflow, automating and streamlining deployments.
EDUCATION
West Bengal University of Technology, Kolkata
Bachelor's degree, Bachelor of Computer Application
ABOUT ANKHI PAUL
Experience in the realm of data engineering, my current role as a Senior Data Engineer at Sobeys has me leveraging PySpark, Microsoft Azure, Databricks, and machine learning to drive data-centric solutions. We\'ve built robust data integration pipelines, performed extensive data cleaning to prepare high-quality inputs for ML models, and implemented feature engineering techniques to support advanced analytics and the organization\'s decision-making processes, a skill honed during my previous tenure at Walmart Canada.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.