Dibyanshu Kumar Patra

About Dibyanshu Kumar Patra

I am a Data Engineer with 2+ years’ experience building cloud-scale lakehouse pipelines on Azure. I specialize in Azure Databricks, PySpark, Delta Lake, Azure Data Factory, and Data orchestration. In my current role at LTIMindtree, I led end-to-end ingestion of ~300GB/day of retail data (using Databricks Auto Loader and ADLS Gen2) and delivered curated Delta tables for analytics. My work has dramatically improved performance and cost-efficiency: for example, I optimized a 1.2B-row sales table with partitioning and Z-ordering to cut query latency by ~65% and lower cluster usage by 25%. I also tuned Databricks clusters and Spark settings to accelerate data refreshes from 4 hours to just 15 minutes, saving ~$200/month in cloud spend.I design data solutions using Medallion (Bronze/Silver/Gold) architecture and Delta Live Tables (including CDC and schema validation) to support near-real-time analytics (e.g. marketing attribution pipelines with Delta CDC). I’ve automated dozens of PySpark notebooks with Azure Data Factory orchestration (parameterized triggers, retries, audit logging) to enforce SLAs. I’m passionate about clean, scalable ETL and driving measurable business outcomes through data.Now seeking full-time Data Engineer roles (based in India or remotely worldwide) where I can apply my Azure Databricks expertise to solve complex data challenges and continue delivering efficiency gains.

Experience

1. Senior Data Engineer

   LTIMindtree

   Jan 2026 — Present · Hyderabad, IN

Education

• Lovely Professional University

  Master of Computer Applications - MCA, Computer Science

  2021 — 2023

• MPC Autonomous College

  Graduation, Computer Science

  2021