Ajay Otavkar
Data Engineer | Spark, SQL, Python & AWS Expert | Building Scalable Data Pipelines | Bridging the Gap between Data Science and Data Engineering
- Role
- Data Engineer Sr at Nielsen
- Location
- Mumbai, MH, IN
- LinkedIn followers
- 500 followers
About Ajay Otavkar
A results-driven Data Engineer with a proven track record of optimizing data pipelines…
Experience
Data Engineer Sr
Jul 2022 — Present · IN
Built End-to-End Data Workflows: Designed and implemented a comprehensive workflow using Spark, EMR, Glue, Redshift, and Airflow to streamline Connected TV (CTV) data processing and create a Co-Viewing Factor mechanism in collaboration with the Data Science team.• Optimized Data Architecture: Revamped a data pipeline architecture, saving over 200 hours of AWS EMR processing time monthly and reducing costs by 30%.• Reduced Data Latency: Engineered a comprehensive schema to integrate Video-on-Demand (VoD), e-commerce, and ads data, serving an AI engine and reducing latency by 30%.• Improved Business Insights: Created an interactive VoD dashboard on Metabase, providing commercial teams with real-time insights and eliminating their manual data reporting efforts.• Enhanced Operational Efficiency: Developed a Content Classification system using Python and MongoDB, which automated tasks and reduced manual interventions by the operations team by 40%.
Education
Mumbai University Mumbai
Bachelor of Science (BSc)
2009 — 2014
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.