Swapnil Jagtap
Senior Data Engineer with a strong understanding of Big Data, PySpark, Databricks & AWS
- Role
- Senior Consultant at EY
- Location
- Pune, MH, IN
- LinkedIn followers
- 500 followers
About Swapnil Jagtap
I am currently working as a Senior Data Engineer, delivering robust data solutions for enterprise-scale projects. My focus lies in designing and implementing reliable data pipelines and frameworks that support efficient data processing, integration, and analytics. I specialize in building real-time and batch data systems that serve critical business use cases across industries.My expertise includes working with PySpark, Databricks, Apache Airflow, Hive, SQL, and AWS services such as S3, Glue, Lambda, and Redshift. I have hands-on experience in data ingestion, transformation, orchestration, and cloud deployment. Additionally, I have also worked with Kafka, Spark Streaming, Power BI, and Snowflake.Throughout my career, I have contributed to cross-functional teams and handled the end-to-end delivery of high-quality data pipelines. I am a fast learner, adaptable, and committed to delivering solutions on time while continuously improving processes. I look forward to taking on new technical challenges and contributing to impactful data initiatives.
Experience
Senior Consultant
Mar 2023 — Present · IN
Project 1:1. Built data ingestion pipelines using Spark Streaming and Kafka2. Designed ETL workflows with PySpark and Hive for large-scale data processing3. Migrated batch jobs to Databricks notebooks for improved performance4. Maintained data availability and integrity using AWS S3 and monitoring toolsProject 2:1. Developed pipelines in Airflow to process marketing interaction data.2. Built PySpark jobs for campaign attribution and reporting.3. Worked on historical data backfill and schema tracking using Unity Catalog.4. Resolved production issues through root cause analysis and system monitoring.
Education
M.G.M's Jawaharlal Nehru College of Engineering
Bachelor of Engineering (BE), Computer Science and Engineering
2010 — 2014
SSIMR
Master of Business Administration - MBA, Finance, General
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.