Akash Agarwal

Senior Data Engineer @Scotiabank - Global Banking and Markets

Toronto, ON, CA

Airflow Pipeline Development & Orchestration: Designed, developed, and deployed containerized data pipelines using Docker and Kubernetes, orchestrated through Apache Airflow (Cloud Composer) to manage complex data integration workflows.2. AI-Native Engineering: Architected Python-based agentic AI workflows and Gen AI solutions within Vertex AI to automate ETL code generation and pipeline optimization, streamlining the delivery of AI-ready curated datasets.3. Validation SQL Proficiency: Demonstrated strong proficiency in advanced SQL and BigQuery to validate standardized data definitions and perform rigorous data quality checks on high-priority data assets.4. Performed deep-dive data validation, comparing systems pre/post migration and flagging schema or metric mismatches.5. Leveraged BigQuery features like materialized views, UDFs, partitions, joins, and clustering to improveperformance of recurring validation queries.6. Built reusable SQL frameworks to validate data integrity across multiple layers (raw, curated, semantic).7. Re-engineered on-prem KPIs into optimized BigQuery implementations and led cross-system validation efforts with business partners to ensure functional equivalence during cloud migration for Scotiabank LatAm Commercial Clients8. Creating Dashboards on Power BI for business users Using Vertex AI as support tool

Vishwakarma Institute Of Technology

Bachelor of Technology - BTech, Electronics and Telecommunications Engineering

Centre for Development of Advanced Computing

PGD Big Data Analytics, Information Technology, A(71%)