Abhijeet Ramteke

About Abhijeet Ramteke

Possessing in-depth knowledge of Hadoop and its internals, I have demonstrated proficiency in handling complex data processing tasks. My expertise extends to ingestion tools such as Sqoop and NIFI, enabling seamless data integration processes. Adept in working with data warehouses like Hive and Snowflake, I bring a comprehensive understanding of efficient data storage and retrieval systems. I boast a strong command of Spark with Scala, showcasing proficiency in Dataframes, Datasets, SparkSQL, and the intricacies of Spark\'s internals. Well-versed in AWS technologies, including EMR, S3, Glue, and Redshift, I have successfully implemented robust solutions for various projects. Engaging in discussions surrounding Data Engineering and SQL, I contribute valuable insights to the community. My professional journey has involved successfully designing and implementing solutions for diverse projects. I leverage my skills in designing, coding, and troubleshooting to rapidly develop and deploy effective solutions to challenging problems. A technology enthusiast and problem-solver. I have successfully designed and implemented solutions for diverse projects. My expertise in designing, coding, and troubleshooting allows me to quickly develop solutions and provide effective solutions to challenging problems.

Experience

1. Big Data Developer

   HCLTech

   Feb 2023 — Present · Nagpur, IN

   Developed and maintained scalable batch data pipelines for processing large volumes of raw data, ensuring timely and accurate data delivery to stakeholders.*Collaborated with cross-functional teams to gather business requirements and translate them into technical solutions.*Implemented data quality checks and data validation procedures, resulting in a 25% reduction in data-related errors.*Manage and implemented robust ETL pipelines using Apache Spark, resulting in a 40% reduction in data processing time.*Worked on various Spark optimization techniques such as code level and cluster resource level which gives a significant performance gain. Used Scala Spark and Spark data frames for data processing and transformation to load data to warehouse tables.*Worked on Sqoop import/export with incremental load to extract the data into HDFS.*Worked on Hive optimization performance using Partitioning, Bucketing and Map on both Managed and External tables.

Education

• Rashtrasant Tukadoji Maharaj Nagpur University, Nagpur

  Bachelor of Commerce - BCom, Commerce and Computer Application