Praveen Kumar Verma

About Praveen Kumar Verma

I’m a Senior Data Engineer with 4.5+ years of experience designing, developing, and maintaining. My core strength lies in building - using tools like Azure Data Factory, Databricks, PySpark, Synapse Analytics, Delta Lake, and SQL.I’ve worked on enterprise-grade data lakehouses and real-time analytics pipelines by applying Medallion Architecture principles, event-driven design (Event Streams, Event Hubs), and automated orchestration via Azure DevOps. I also focus on to ensure secure, reliable, and compliant pipelines across cloud environments. My experience includes working on, end-to-end pipeline delivery, DAX-powered Power BI integrations, and cost/performance tuning for large-scale workloads. I’m currently DP-700 certified, and was previously certified as a Databricks Data Engineer Associate. My interest in Microsoft Fabric and OneLake has led me to explore unified data architecture strategies and how they can power the next generation of analytics. Azure Data Factory • Azure Databricks • Apache Spark / PySpark • Azure Synapse • Data Lakehouse • Delta Tables • Event Hubs • Event Streams • OneLake • SQL • DAX • Power BI • Real-Time Analytics • Azure DevOps • CI/CD • Data Warehousing • ETL Design • Big Data Hadoop • Scala • PythonWhile my professional focus is on Data Engineering, I also explored foundational in academia — including ML, NLP, EDA, and Deep Learning — using tools like Pandas, NumPy, TensorFlow, and Scikit-learn. These principles guide me in building pipelines that are AI-ready. • 🥇 Gold Medalist (B.Tech, CSE), VIT University • 4x Star Award winner for delivery excellence • National Finalist – Smart India Hackathon (ISRO Problem Statement)I thrive at the intersection of engineering and business — creating solutions that are scalable, efficient, and future-ready. Whether it\'s batch, streaming, or near-real-time data integration, I bring a structured, hands-on, and quality-focused approach to everything I deliver. I’m open to senior roles in data engineering, cloud platform modernization, or real-time analytics — where I can drive architecture and execution for business-impacting data solutions. Let’s connect: k••••••••@gmail.com |+91••••••••00

Experience

1. Senior Data Engineer

   Atom

   Dec 2024 — Present · San Francisco, CA, US

   Spearheaded the modernization of a legacy Fixed Assets Accounting platform managing $.+ across + for a global container leasing & logistics leader, enabling near real-time financial visibility. Achieved ×,~70% reduction in closure timelines, and % infrastructure by leveraging,(PySpark, Delta Lake), and event-driven architecture. • Re-architected month-end closures into daily incremental pipelines using ADF & Databricks, migrating 250+ stored procedures and 20+ jobs from on-prem SQL Server to a modern cloud-native setup. • Migrated 50+ TB of accounting data (leases, rentals, payables, receivables, amortizations, disposals) from CAPEX, TEMS & Oracle systems into Databricks Delta tables & SQL Server. • Designed bulk-load & CDC-driven pipelines for historical and incremental data, ensuring operational continuity and real-time reporting readiness. • Optimized ETL throughput with Databricks auto-scaling & tuned clusters, cutting compute cost by 20%. • Established data lineage, access controls, logging, and CI/CD pipelines (Azure DevOps) to strengthen governance & minimize downtime. • Acted as a client-facing lead for requirements, architecture design, and solution walkthroughs; mentored engineers and led sprints during migration phases- • Built an event-driven streaming pipeline using Azure Event Hubs & Event Streams to process CAPEX & TEMS transactions in near real-time. • Enabled sub-minute updates for leases, rentals & amortizations, reducing reporting latency by 80%+. • Delivered a Microsoft Fabric dashboard (120+ stakeholders) for proactive decision-making.

Education

• Lucknow Public School

  Intermediate (12th Class), Physics, Chemistry and Mathematics, 93.8%

  2014 — 2016

• Vellore Institute of Technology

  Bachelor of Technology, Computer Science Engineering, 9.54

  2017 — 2021

• Lucknow Public School

  HighSchool (10th Class), Science, 94.33%

  2012 — 2014