Bhuvanesh D
Data Engineer | Streaming & Analytics Infrastructure |Flipkart| Spark | Kafka |Lakehouse on AWS| Databricks
- Role
- Data Engineer Growth Data Platform at Flipkart
- Location
- Bengaluru, KA, IN
- LinkedIn followers
- 500 followers
About Bhuvanesh D
Data Engineer with 3.5+ years of experience building and owning scalable, reliable data platforms at scale.I specialize in designing deterministic, replayable batch systems using Apache Spark, with a strong focus on correctness, recomputation, and long-term maintainability. At Flipkart, I built a centralized attribution data platform (0→1) spanning multiple marketplaces, processing tens of terabytes of data daily and resolving cross-channel attribution ambiguity through deterministic, vendor-agnostic logic.I have hands-on experience migrating large-scale workloads from BigQuery-centric SQL pipelines to Spark-based batch processing, significantly improving SLA and compute efficiency while enabling controlled backfills and reproducible historical data. My work emphasizes canonical schemas, versioned business logic, and insulating downstream systems from mutable upstream sources.Previously, I worked on large-scale lakehouse platforms processing scraped e-commerce data from 350+ global retailers, powering public-facing analytics on price movement and inflation. I’ve re-architected legacy systems into Bronze–Silver–Gold layers to improve reliability, latency, and data quality.Core strengths: Apache Spark (Batch & Streaming), Data Modeling, Canonical Schemas, Deterministic Computation, Lakehouse Architecture, BigQuery, Databricks, Kafka, and Platform Ownership.I enjoy working on data problems where correctness, scale, and system design matter more than dashboards.
Experience
Data Engineer Growth Data Platform
Nov 2024 — Present · Bengaluru, IN
Designed and owned a centralized attribution data platform (0→1) spanning Flipkart Core, Minutes, and Grocery, processing ~15–30 TB/day of campaign events and order data using deterministic Spark batch pipelines.Solved cross-channel and cross-market attribution ambiguity by implementing a deterministic last-touch attribution model, ensuring a single, reproducible attribution outcome per order.Migrated attribution computation from BigQuery-centric SQL workflows to Spark-based batch processing, reducing end-to-end SLA by ~60% and compute cost by ~40%, while enabling controlled backfills and recomputation.Built a vendor-agnostic attribution layer using canonical schemas and versioned business logic, decoupling downstream systems from mutable Appsflyer behavior and retroactive corrections.Operated and debugged Spark workloads on Flipkart Data Platform using dynamic executor allocation and Adaptive Query Execution (AQE), diagnosing skewed joins, shuffle amplification, and SLA regressions via Spark UI metrics.
Education
Sri Chaitanya College of Education
Intermediate education
2016 — 2018
CAMFORD School-India
SSC
2005 — 2016
Anna University Chennai
Bachelor of Engineering - BE, Electrical, Electronics and Communications Engineering
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.