Deepika Mishra

About Deepika Mishra

Graduated with a B.Sc. in Information Technology from Mumbai University in 2020. Currently working as a Data Engineer at Nielsen, where I have designed and implemented scalable ETL frameworks using AWS Bedrock, PySpark, SQL and Python. My work ensures data integrity during pipeline migrations and enables advanced analytics by structuring unstructured data for granular insights. With a strong focus on ETL, data warehousing, and cloud solutions, I am committed to leveraging modern data engineering tools like SQL, PySpark, and Databricks to support innovative business analytics. Passionate about bridging data engineering with AI, I aim to empower organizations to unlock actionable insights.

Experience

1. Data Engineer

   Nielsen

   Jun 2024 — Present · Mumbai, IN

   Engineered a validation framework to verify the migration of ETL pipelines from Talend toPySpark. Leveraged AWS Bedrock and Python to automate the root cause analysis of datadiscrepancies, differentiating between logic gaps and formatting issues. This reduced migrationtesting cycles by 60% and ensured zero data gaps in production.2. Designed an ETL solution for media assets using AWS Rekognition and Lambda. Developedadvanced SQL transformations (utilizing JSON parsing, unnesting, and window functions) toflatten deeply nested AI inference data. This created structured \"Golden Records\" for granularbrand exposure analytics, previously impossible with raw unstructured data.3. Led the migration of legacy pipelines to a modern PySpark/EMR architecture. Re-engineeredcomplex SQL and performance optimize the complex queries logic—specifically for extractinggranular, person-wise household data—enhancing processing speed by 3x and enabling precisetargeting for Nielsen’s media measurement products.4. Spearheaded a cost efficiency initiative across 4 AWS accounts. Implemented S3 lifecycle policies,right-sized EC2/RDS instances, and automated EMR termination logic, resulting in a 70%reduction in monthly cloud infrastructure costs.5. Designed a real-time monitoring dashboard and containerized (Docker) microservices forautomated format conversion (CSV to Parquet). Centralized logging and SQS-based alertingdrastically reduced Mean Time to Resolution (MTTR) for pipeline failures.

Education

• DG Ruparel College of Arts, Science and Commerce

  B.Sc, Information Technology

  2017 — 2020

• University of Mumbai

  Master of Computer Applications - MCA, Information Technology