Avinashpal Singh
Data Engineer Technology Analyst @Infosys
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer Technology Analyst @Infosys
Toronto, ON, CA
Client - MicrosoftBuilt and managed 200+ Azure Data Factory (ADF) pipelines for large-scale Microsoft financial data processing.Developed ETL/ELT workflows using Databricks, PySpark, and SQL to transform complex datasets.Processed and analyzed financial KPIs and Azure billing data for internal Microsoft reporting.Migrated and maintained multiple CI jobs and E2E jobs from Cosmos DB to Synapse using ADF pipelines and automated CLI command toolsLeveraged HDInsight clusters for big data processing and real-time analytics.Integrated Azure Data Lake Storage (ADLS) and SQL databases for structured and unstructured data storage.Implemented data validation, monitoring, and performance optimization across pipelines.Collaborated with Microsoft internal teams to deliver actionable insights from financial data.Ensured scalable and reliable cloud-based data solutions aligned with business requirements.
EDUCATION
Northern College of Applied Arts and Technology
INFORMATION SYSTEMS BUSINESS ANALYSIS + INTERNATIONAL BUSINESS MANAGEMENT with Honours, Computer Science
Model Institute of Engineering and Technology
Bachelor of Engineering - BE, Computer Science
ABOUT AVINASHPAL SINGH
Azure Data Engineer with 6+ years of experience designing and implementing end-to-end data pipelines and analytics solutions using Azure Data Factory, Databricks (PySpark/Python), Synapse Analytics, and SQL Database.Expertise in Python and SQL for data manipulation, transformation, and optimization across large datasets, including the development of reusable frameworks, UDFs, and automation scripts to streamline data workflows and improve efficiency.Strong background in Delta Lake architecture for ACID-compliant data lakes, enabling schema evolution, time travel, and real-time processing at scale. Skilled in data modeling, CI/CD with Azure DevOps, and infrastructure automation using ARM/Terraform.Experienced in integrating batch and streaming data from ADLS, Blob Storage, SQL Server, REST APIs, and Event Hubs. Focused on performance optimization, data security (RBAC, Key Vault, masking, GDPR), and delivering reliable, production-grade data platforms.Collaborative and agile-minded professional who thrives in cross-functional teams to build scalable, high-quality data solutions.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.