Abhijit Pal

About Abhijit Pal

10 years 6 Months of IT industry experience encompassing a good range of skill set, roles and domain knowledge.• Led the migration of legacy ETL workflows from Informatica to Azure Cloud, utilizing Azure Data Factory (ADF) to orchestrate scalable and maintainable data pipelines.• Designed and implemented PySpark applications in Azure Databricks to process large-scale datasets, performing complex transformations, joins, and aggregations across multiple file formats (CSV, Parquet, JSON).• Optimized Spark jobs for performance and cost-efficiency, enabling near real-time data processing and analytics.• Delivered actionable insights into customer usage patterns by building robust data models and transformation logic, supporting business intelligence and strategic initiatives.• Integrated data from diverse sources into Azure Data Lake Storage (ADLS) and curated datasets for downstream consumption in Power BI and other analytics tools.• Spearheaded the end-to-end migration of ETL processes from Informatica to Azure Cloud, leveraging Azure Data Factory (ADF) for orchestrating scalable, fault-tolerant data pipelines.• Designed and implemented data ingestion workflows in ADF to extract data from on-premises SQL Server, REST APIs, Blob Storage, and third-party sources into Azure Data Lake Storage (ADLS).• Developed PySpark applications in Azure Databricks to perform complex data transformations, cleansing, and aggregations across structured and semi-structured formats (CSV, Parquet, JSON).• Built reusable ADF pipeline templates with parameterization and dynamic content for efficient ingestion across multiple datasets and environments.

Experience

1. Manager

   Cognizant

   Dec 2025 — Present

Education

• Subhas Palli Bidya Niketan

  Madhyamik (Secondary)

• Kalyani Government Engineering College

  Bachelor of Technology - BTech, Electrical engineering

• Asansol Cheliadanga High School

  Higher Secondary, Science