Piyush Mishra
Senior Data Engineer at HARMAN || Big Data, Analytics and Data Warehousing Specialist || Data Savvy
- Role
- Senior Data Engineer at HARMAN International
- Location
- Gurugram, HR, IN
- LinkedIn followers
- 500 followers
About Piyush Mishra
9.10 years of diverse experience in Data Engineering field, including Development, and Implementation of various applications in big data and EDW environments.• Experienced, result-oriented, resourceful, and problem-solving Data engineer with leadership skills. Adapt and met challenges of tight release dates. • Working experience in Big Data and ETL software applications which includes Big Data using Hadoop and Spark Ecosystems, Data Modeling, Data Warehousing.
Experience
Senior Data Engineer
Oct 2022 — Present · Bengaluru, IN
Meet with stakeholders and BAs to understand the requirements of feature and technical design.• Collaborated with cross-functional teams to gather data requirements, ensuring data accuracy, completeness, and quality throughout the pipeline. • Worked on new Spark application strategy for multiple business view transformations with minimum code duplication.• Worked as a Spark- Scala/PySpark developer to create spark applications to perform data transformation, aggregation run on Hadoop clusters and writing data into Hive/Druid tables.• Operated on Hadoop Framework such as hive, map reduce and HDFS to process data.• Performed data ingestion and modified the data flows between the systems using Apache Kafka.• Worked on Airflow for defining, scheduling, and monitoring jobs.
Education
Kamla Nehru Institute of Technology, Sultanpur
Bachelor of Technology (BTech), Information Technology
2010 — 2014
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.