Akshay Jadhav

About Akshay Jadhav

I\'m a Data Engineer with 4 years of experience working at Infosys, where I\'ve been building data platforms on Azure for Retail and Healthcare clients.My day-to-day work revolves around designing ETL/ELT pipelines using Azure Data Factory and transforming large datasets using PySpark and Spark SQL on Azure Databricks — following Medallion Architecture (Bronze, Silver, Gold layers).Some of the things I\'ve worked on- Migrated on-premises SQL Server data to Azure Data Lake Gen2 for a Retail client, building a full Sales & Inventory Data Warehouse- Built dynamic, parameterized ADF pipelines using metadata-driven approaches to handle multiple sources and file formats- Optimized PySpark jobs using partitioning, caching, and persist strategies to improve performance- Automated pipeline monitoring with audit logging and email alerts via Azure Logic AppsTech I work with daily:Azure Data Factory | Azure Databricks | ADLS Gen2 | Synapse Analytics | PySpark | Spark SQL | Python | SQL | Medallion Architecture | Star Schema | SCD Type 1 & 2 | Unity CatalogI\'m currently exploring new Data Engineer opportunities. If you\'re hiring or know of relevant openings, feel free to connect!

Experience

1. Data Engineer

   Infosys

   May 2022 — Present · Pune, IN

   Azure Data Engineer 05/2022 – Present • 3 years of hands-on experience in Spark, SQL, Python. Solid understanding of Spark architecture, including Spark Core and Spark SQL. • Developed and optimized data extraction logic for big data pipelines, resulting in a 50% reduction in processing time and enabling timely insights for decision-making. • I am skilled at processing large volumes ofstructured and semi-structured data from diverse sources. Proficient in file compression techniques and various data formats, such as CSV and Parquet. I am capable ofscripting in Python and SQL for data manipulation, and I have intermediate knowledge in python. • Knows RDBMS like MYSQL and used them for SQL queries, performance tuning, etc. • I have good knowledge of Spark, data pipelines and azure clouds. • I am proficient in leveraging Azure services like Azure data Factory, ADLS Gen2 and Databricks for seamless integration of Spark-based data processing workflows in cloud environments.

Education

• Swami Ramanand Teerth Marathwada University (SRTMU), Nanded

  Master of Business Administration - MBA, Mathematics and Computer Science