Mitali Srivastava
Data Engineering Specialist | Ph.D. in Big Data Analytics | AWS Certified | AI & Machine Learning Researcher
- Role
- Big Data Consultant at Capgemini
- Location
- Varanasi, UP, IN
- LinkedIn followers
- 500 followers
About Mitali Srivastava
Data Engineering Specialist with a PhD in Big Data Analytics and over 8 years of experience across industry and academia. Skilled in building scalable big data solutions using Hadoop, Spark, PySpark, and AWS. Adept at leading agile teams, mentoring talent, and delivering actionable insights through efficient data pipelines and analytics workflows. I have contributed to financial, educational, and research-driven environments—translating complex data into valuable business intelligence. My expertise spans cloud platforms (AWS EMR), distributed computing, machine learning, and end-to-end data pipeline development. I have passionate about continuous learning and knowledge sharing, Along with, I have published multple SCI, Scopus indexed journals and guided academic research in machine learning and data mining. Currently focused on delivering high-impact data solutions in the financial sector at Capgemini.
Experience
Big Data Consultant
Mar 2022 — Present · Pune, IN
Designed and implemented scalable, fault-tolerant data pipelines using Hadoop (HDFS), PySpark, Apache Hive, and SQL to process and transform large volumes of structured and semi-structured data. • Optimized PySpark applications on AWS EMR clusters, improving performance by tuning memory configurations, leveraging data partitioning, caching, and efficient file formats (e.g, Parquet, ORC). Monitored job performance using Spark UI, and EMR logs, and implemented retry and checkpointing mechanisms for increased reliability.• Collaborated with cross-functional teams including data analysts, data scientists, and business stakeholders to understand data requirements and translate them into robust data integration solutions. • Automated and orchestrated end-to-end data workflows using AutoSys and Stonebranch, managing job dependencies, triggers, and SLAs for batch processing systems. • Mentored junior engineers, providing guidance on distributed computing, PySpark best practices, version control with Git, and code modularity.
Education
Banaras Hindu University
BSc(Hons), Computer Science
Banaras Hindu University
Master of Science (MSc), Computer Science
Banaras Hindu University
Doctor of Philosophy - PhD, Big Data Analytics
Skills
- Servlets
- Mapreduce
- Shell Scripting
- Web Services
- Sql
- Sql Db2
- C
- Html
- Pl/Sql
- Unix Shell Scripting
- Javascript
- Java Enterprise Edition
- Java
- Perl Automation
- Xml
- Data Preparation
- Core Java
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.