Rahul Lohia
Senior Data Engineer | Spark Optimization Specialist | Big Data & Streaming | Kafka | Airflow | AWS | Data Modeling & Data Quality
- Role
- Senior Associate at Affine
- Location
- Bokaro, JH, IN
- LinkedIn followers
- 500 followers
About Rahul Lohia
Senior Data Engineer with 5+ years of experience designing, operating, and optimizing big data platforms in travel and telecom industries. Known for deep expertise in Spark optimization, data reliability, and cost efficiency, with proven impact in improving SLA compliance and significantly reducing platform costs. Experienced in building production-grade pipelines using Spark, Kafka, Airflow, and AWS.
Experience
Senior Associate
Apr 2024 — Present · Bengaluru, IN
Senior Data Engineer focused on Spark performance, reliability, and cost optimization across large-scale data platforms. Experienced in owning production workflows built on Spark (Scala/PySpark), Hive, Kafka, Airflow, and AWS.Impact delivered- Achieved ~90% cost reduction across the data platform by combining storage optimization (implemented automated data cleanup), cluster tuning, and Spark execution optimizations—reducing monthly costs from $85K to $4K- Increased pipeline reliability with event-driven architectures, improving SLA compliance to 95% and cutting failures by 60%- Built and operationalized Collibra Data Quality checks to enforce data quality standards and enable proactive alerting for SLA and rule breaches.
Education
Maulana Abul Kalam Azad University of Technology, West Bengal formerly WBUT
Bachelor of Technology - BTech, Computer Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.