Harishanker Kethavath

About Harishanker Kethavath

I’m a Data Engineer with 5+ years of experience building scalable data pipelines, analytics solutions, and business intelligence platforms across tech, insurance, e-commerce, and consulting domains. My work has spanned from optimizing creator engagement pipelines at TikTok serving 2B+ users, to standardizing insurance KPIs at Progressive, to automating payroll defect detection for 150+ Flipkart warehouses, and delivering marketing analytics solutions at NeenOpal.I specialize in data engineering, ETL/ELT pipelines, and BI/analytics, working with tools like PySpark, Airflow, Azure Data Factory, Synapse, dbt, Power BI, and Tableau. Along the way, I’ve driven measurable business outcomes — cutting pipeline runtimes by 90%, reducing costs by 20%, enabling $600K+ annual savings, and improving conversion rates by 30% for marketing campaigns.I enjoy bridging business and engineering teams, ensuring that data solutions directly support strategy, compliance, and decision-making. Always curious and impact-driven, I focus on designing data systems that are reliable, scalable, and business-aligned.

Experience

1. Data Engineer

   TikTok

   Aug 2024 — Present

   I worked on scaling creator engagement data pipelines that served insights to over 2B+ users daily. The challenge was a pipeline running close to its 24-hour SLA, leaving very little buffer. I identified inefficiencies that caused a 20.5-hour runtime and optimized Spark jobs using bucketing, partition pruning, and executor tuning, which cut heavy aggregations by 40%. I also re-orchestrated workflows to remove idle waits and parallelize safe tasks, reducing total runtime to 17.5 hours. These improvements expanded the SLA buffer from 3.5 hours to 6.5 hours, ensuring timely delivery of insights and strengthening creator trust in the platform.

Education

• University of Central Florida

  Master's degree

• Indian Institute of Information Technology, Design and Manufacturing, Jabalpur

  Bachelor's degree