Praveen Kumar Verma
Senior Data Engineer @Atom
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @Atom
San Francisco, CA, US
Spearheaded the modernization of a legacy Fixed Assets Accounting platform managing $.+ across + for a global container leasing & logistics leader, enabling near real-time financial visibility. Achieved ×,~70% reduction in closure timelines, and % infrastructure by leveraging,(PySpark, Delta Lake), and event-driven architecture. • Re-architected month-end closures into daily incremental pipelines using ADF & Databricks, migrating 250+ stored procedures and 20+ jobs from on-prem SQL Server to a modern cloud-native setup. • Migrated 50+ TB of accounting data (leases, rentals, payables, receivables, amortizations, disposals) from CAPEX, TEMS & Oracle systems into Databricks Delta tables & SQL Server. • Designed bulk-load & CDC-driven pipelines for historical and incremental data, ensuring operational continuity and real-time reporting readiness. • Optimized ETL throughput with Databricks auto-scaling & tuned clusters, cutting compute cost by 20%. • Established data lineage, access controls, logging, and CI/CD pipelines (Azure DevOps) to strengthen governance & minimize downtime. • Acted as a client-facing lead for requirements, architecture design, and solution walkthroughs; mentored engineers and led sprints during migration phases- • Built an event-driven streaming pipeline using Azure Event Hubs & Event Streams to process CAPEX & TEMS transactions in near real-time. • Enabled sub-minute updates for leases, rentals & amortizations, reducing reporting latency by 80%+. • Delivered a Microsoft Fabric dashboard (120+ stakeholders) for proactive decision-making.
EDUCATION
Lucknow Public School
Intermediate (12th Class), Physics, Chemistry and Mathematics, 93.8%
Vellore Institute of Technology
Bachelor of Technology, Computer Science Engineering, 9.54
Lucknow Public School
HighSchool (10th Class), Science, 94.33%
ABOUT PRAVEEN KUMAR VERMA
I’m a Senior Data Engineer with 4.5+ years of experience designing, developing, and maintaining. My core strength lies in building - using tools like Azure Data Factory, Databricks, PySpark, Synapse Analytics, Delta Lake, and SQL.I’ve worked on enterprise-grade data lakehouses and real-time analytics pipelines by applying Medallion Architecture principles, event-driven design (Event Streams, Event Hubs), and automated orchestration via Azure DevOps. I also focus on to ensure secure, reliable, and compliant pipelines across cloud environments. My experience includes working on, end-to-end pipeline delivery, DAX-powered Power BI integrations, and cost/performance tuning for large-scale workloads. I’m currently DP-700 certified, and was previously certified as a Databricks Data Engineer Associate. My interest in Microsoft Fabric and OneLake has led me to explore unified data architecture strategies and how they can power the next generation of analytics. Azure Data Factory • Azure Databricks • Apache Spark / PySpark • Azure Synapse • Data Lakehouse • Delta Tables • Event Hubs • Event Streams • OneLake • SQL • DAX • Power BI • Real-Time Analytics • Azure DevOps • CI/CD • Data Warehousing • ETL Design • Big Data Hadoop • Scala • PythonWhile my professional focus is on Data Engineering, I also explored foundational in academia — including ML, NLP, EDA, and Deep Learning — using tools like Pandas, NumPy, TensorFlow, and Scikit-learn. These principles guide me in building pipelines that are AI-ready. • 🥇 Gold Medalist (B.Tech, CSE), VIT University • 4x Star Award winner for delivery excellence • National Finalist – Smart India Hackathon (ISRO Problem Statement)I thrive at the intersection of engineering and business — creating solutions that are scalable, efficient, and future-ready. Whether it\'s batch, streaming, or near-real-time data integration, I bring a structured, hands-on, and quality-focused approach to everything I deliver. I’m open to senior roles in data engineering, cloud platform modernization, or real-time analytics — where I can drive architecture and execution for business-impacting data solutions. Let’s connect: k••••••••@gmail.com |+91••••••••00
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.