Piyush Mishra
Senior Data Engineer @HARMAN International
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @HARMAN International
Bengaluru, IN
Meet with stakeholders and BAs to understand the requirements of feature and technical design.• Collaborated with cross-functional teams to gather data requirements, ensuring data accuracy, completeness, and quality throughout the pipeline. • Worked on new Spark application strategy for multiple business view transformations with minimum code duplication.• Worked as a Spark- Scala/PySpark developer to create spark applications to perform data transformation, aggregation run on Hadoop clusters and writing data into Hive/Druid tables.• Operated on Hadoop Framework such as hive, map reduce and HDFS to process data.• Performed data ingestion and modified the data flows between the systems using Apache Kafka.• Worked on Airflow for defining, scheduling, and monitoring jobs.
EDUCATION
Kamla Nehru Institute of Technology, Sultanpur
Bachelor of Technology (BTech), Information Technology
ABOUT PIYUSH MISHRA
9.10 years of diverse experience in Data Engineering field, including Development, and Implementation of various applications in big data and EDW environments.• Experienced, result-oriented, resourceful, and problem-solving Data engineer with leadership skills. Adapt and met challenges of tight release dates. • Working experience in Big Data and ETL software applications which includes Big Data using Hadoop and Spark Ecosystems, Data Modeling, Data Warehousing.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.