Deepankar Rao
Lead Data Engineer @Hunch | Ex-Mercer Mettl | Ex-OYO
- Role
- Lead Data Engineer at Hunch
- Location
- Kurukshetra, HR, IN
- LinkedIn followers
- 500 followers
About Deepankar Rao
Lead Data Platform Engineer with 5+ years of experience in designing and implementing scalable, end-to-end data platforms and real-time data pipelines. Proficient in technologies such as Apache Spark, Kafka, Kinesis, Hive, Trino, and Airflow. Experienced in data warehousing using Redshift, BigQuery, and AWS Glue.Skilled in cloud infrastructure across AWS and GCP (BigQuery, Dataflow, DataProc, GCS, Cloud SQL), with hands-on experience in DevOps (Docker, Kubernetes, CICD, Infra as Code) and backend development (Java & Spring Boot, Python & Django). Proven ability to build production-grade, cost-efficient solutions for analytics and machine learning use cases.
Experience
Lead Data Engineer
Mar 2024 — Present · Delhi, IN
Developed and Maintained End-to-End Data Pipelines: Designed and implemented robust data pipelines using Debezium, Kafka, Spark for ETL processing, and Airflow for job workflow management. Leveraged Trino with Hive for distributed querying and S3 as a storage layer to handle large-scale data processing needs.• Migrated Systems to Managed Solutions: Transitioned existing infrastructure to cloud-managed services, replacing Kafka with Kinesis, incorporating Firehose connectors, and using AWS Glue for ETL processing. Established Redshift as a data warehouse and Tableau for real-time dashboarding, enhancing data accessibility for app events and Firestore change logs.• Team Leadership: Managed a team of 3 engineers, overseeing project execution and ensuring end-to-end quality in data pipeline development and maintenance. Provided mentorship and direction to drive efficient, high-quality results.
Education
National Institute of Technology, Kurukshetra, Haryana
Bachelor of Technology, Computer Science
2016 — 2020
Jawahar Navodaya Vidyalaya, Sant Kabir Nagar
12th
2014 — 2015
Jawahar Navodaya Vidyalaya, Sant Kabir Nagar
10th
2012 — 2013
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.