Rohit Patil
Data Engineer,Big data,Python,Spark,Pyspark,hive,Sql,AWS,Kafka,Sqoop,linux Shell Scripting, Databricks, Microsoft Azure
- Role
- Senior Engineer at Iris Software Inc.
- Location
- Pune District, MH, IN
- LinkedIn followers
- 500 followers
About Rohit Patil
I have experience as a Big Data Professional, working on various projects related to data ingestion, transformation, and visualization. I have worked on projects related to 5G JWO, fetching data from various sources like HDFS files, API, RDBMS tables, GBQ, and performing transformations using PySpark, and loading into Hive tables, Kafka topics, and Kudu tables.I have also developed Python scripts to automate Tableau activities and reduce manual efforts and time required. Additionally, I have experience in ingesting RDBMS tables into HDFS using PySpark and loading into Hive tables. I have also worked on projects related to nested JSON structure, CSV file format, created Hive table from files, aggregate file generation for analysis, data cleaning, transformation, and generating calculated fields using PySpark.I have knowledge of Hadoop ecosystem and different frameworks inside it, such as HDFS, Hive, Sqoop, Spark, Impala, and Azure. I also have experience in using other big data technologies like Airflow, SQOOP, Kudu, and Tableau for data visualization. Additionally, I have knowledge of machine learning algorithms, both supervised and unsupervised, and experience in the telecom domain industry.In terms of your academic projects, I have worked on data ingestion from Kaggle and RDS into S3, formatting the data using PySpark in EMR AWS, and storing as ORC format for accessing the data in Hive. I have also visualized and reported the data using Tableau, and the complete process was automated using CloudFormation Template on AWS, and incremental load was also implemented for further data ingestion.
Experience
Senior Engineer
Aug 2025 — Present · IN
Education
Centre for Development of Advanced Computing (C-DAC)
PG Diploma in big data analytics, big data
2019 — 2020
G.H. RAISONI INSTITUTE OF ENGINEERING & MANAGEMENT, JALGAON.
Bachelor of Engineering - BE, Computer Science
2015 — 2018
G.H. RAISONI INSTITUTE OF ENGINEERING & MANAGEMENT, JALGAON.
Diploma , Computer Engineering
2015 — 2018
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.