Prathamesh Kulkarni
Data Engineer
- Role
- Data Engineer at IBM
- Location
- Pune Division, MH, IN
- LinkedIn followers
- 500 followers
About Prathamesh Kulkarni
Hi everyone, I am a passionate and growth-focused Data Engineer with hands-on…
Experience
Data Engineer
Feb 2025 — Present · Pune, IN
Managing and Modernizing hybrid cloud data platforms by leveraging both on-prem and cloud-based technologies.Key Responsibilities:Build and optimize big data pipelines using Apache Spark and PySpark for processing structured and semi-structured datasets at scale.Develop and orchestrate ETL workflows with Apache Kafka for real-time data ingestion and streaming.Design distributed data solutions using Hadoop (HDFS) and query optimization using Hive and IBM BigSQL.Utilize AWS (S3, EMR, EC2) for cloud-based processing and data storage integration.Use Python scripting for scheduling, automation, and orchestration of data processing jobs, integrating with tools like crontab and workflow schedulers.Write efficient and modular Python code for data validation, transformation, and reporting automation.Applying Linux (AIX/Unix) skills for file system navigation, log monitoring, shell scripting, and operational support.Technologies & Tools:Cloud & Hybrid Platforms: Azure, AWSBig Data & Analytics: Apache Spark, PySpark, Hadoop, Hive, IBM BigSQLStreaming & Integration: Apache KafkaAutomation & Scripting: Python, Shell Scripting (Bash), CrontabScheduling & Monitoring: Linux CLI Tools, Log AnalysisDevelopment Environment: Jupyter, VS Code, Git, Linux
Education
Pune Vidhyarthi Griha's College Of Engineering And Technology
Bachelor of Engineering - BE, Computer Engineering
2019 — 2023
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.