Harshit Mittal
Data Engineer
- Role
- Data Engineer at Walmart Global Tech India
- Location
- Gurugram, HR, IN
- LinkedIn followers
- 500 followers
About Harshit Mittal
An Enthusiast and dedicated professional working as a Data Engineer expertise Big data…
Experience
Data Engineer
Apr 2023 — Present
Designed and implemented scalable ELT pipelines using Apache Spark (both PySpark and Spark SQL) to processlarge volumes of structured and semi structured data from various sources (e.g. RDBMS, Azure Blob Storage).• Optimized Spark jobs for performance by tuning partitioning, shuffling, and caching strategies, resulting in a 30%reduction in processing time for critical data workflows while adhered to compliance.• Integrated and processed billing data from multiple sources including Microsoft Azure blob storage andMYSQL handling various file formats like JSON, CSV and Parquet.• Developed custom Spark jobs for data transformation, aggregation, and analysis on multi-terabyte datasets,improving data accessibility for OLAP analytics teams.
Education
Kamla Nehru Institute of Technology, Sultanpur
Bachelor of Technology - BTech, Information Technology
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.