Primalkumar Patel

Hadoop Developer @Dovenmuehle

Lake Zurich, IL, US

Engineered automation solutions utilizing Bash scripts, significantly enhancing efficiency and accuracy in data ingestion processes and historical load management.• Spearheaded the design and implementation of robust data pipelines and structures within Hive warehousing for various projects.• Conducted intricate data transformations, encompassing data extraction, sorting, aggregation, and formatting, to load staging Hadoop tables for diverse reporting needs like dashboards, adhoc, CMM, and TT reports.• Developed and maintained Hive tables, including partitioning and data loading into HDFS, implementing alerts for requirement changes and new field additions.• Optimized Hive queries and revamped existing programs, leading to noteworthy performance improvements.• Demonstrated expertise in sorting, joining, aggregating, filtering, and other data transformations to ensure data quality and usability.• Designed and automated data extract jobs through Bash scripts, catering to adhoc reporting demands while adhering to client specifications.• Performed Imports/exports between RDBMs (SQL Server, MySQL) and Hadoop, pivotal for diverse reporting and dashboard projects.• set up Jams jobs, workflows, and properties for streamlined scheduling, triggering, notifications, and user input, automating program execution.• Offered expert-level production support, swiftly diagnosing and addressing program failures, debugging issues, and implementing preventative solutions.• supported to the adhoc reporting team, addressing queries and optimizing Hive queries to enhance performance.

GOVERNMENT ENGINEERING COLLEGE, PATAN 022

Bachelor of Engineering - BE

Chicago State University

Master's degree