Aniket Bidave

About Aniket Bidave

Senior Data Engineer with 10+ years of experience building cloud-scale data platforms using Databricks, PySpark, SQL, Delta Lake, and Python. Specialized in designing Lakehouse architectures, end-to-end ETL pipelines, large-scale simulation frameworks, and high-performance data workflows.Experienced across Azure (Databricks, ADF, ADLS) and AWS (S3, Redshift), with a strong background in Spark performance tuning, data quality frameworks (DQX, Great Expectations), and data governance using Unity Catalog.Delivered production-grade solutions in ALM, capital markets, fixed income analytics, risk projections, and enterprise reporting. Focused on scalable design, cost optimization, cluster tuning, and reusable data platform components.Open to roles in Databricks engineering, cloud data platforms, financial data engineering, and enterprise-scale ETL architecture.

Experience

1. Senior Software Engineer

   Ares Management

   Mar 2023 — Present · Mumbai, IN

   Built and optimized large-scale ALM simulation pipelines processing 100+ macroeconomic scenarios.Architected Databricks-based Delta Lakehouse on ADLS.Implemented PySpark performance tuning: optimized shuffles, partitions, broadcast joins.Created reusable Python libraries adopted across multiple teams.Reduced compute costs by 30–40% and runtime by 60%.

Education

• MET's BKC

  BE - Bachelor of Engineering, Computer Engineering

  2011 — 2015