Ruchika Dhore
Data Engineer at Tech Mahindra
- Role
- Data Engineer at Tech Mahindra at Tech Mahindra
- Location
- Pune, IN
- LinkedIn followers
- 500 followers
Experience
Data Engineer at Tech Mahindra
May 2024 — Present · Pune, IN
Designed and developed scalable batch data pipelines using Apache Spark, and Python to process large volumes of structured and semi-structured data.• Used Git for version control in development environments.• Automated ETL processes, managing task dependencies, and error handling for data movement.• Built robust data workflows to process structured and semi-structured data (CSV, JSON, Parquet).• Migrated legacy ETL processes to cloud-native solutions, improving scalability and reducing processing time.• Utilized AWS S3 to store and manage large-scale batch data for distributed processing using Apache Spark and Hive.• Orchestrated end-to-end data pipelines using Apache Airflow from Amazon S3 to Hive, enabling efficient data storage, querying, and downstream analytics.• Tuned performance of long-running Spark jobs and SQL queries to optimize cost and latency.• Conducted root cause analysis and data validation to resolve data quality issues and maintain pipeline reliability.
Education
Dr dy patil pune University
Bachlor of computer application
2022
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.