Rahul Jangid

About Rahul Jangid

As a passionate and performance-driven Data Engineer with 4+ years of experience, I specialize in building scalable, optimized, and business-driven data solutions across cloud and on-premise platforms. I have consistently delivered robust data pipelines, efficient ETL frameworks, and end-to-end data integration solutions that power critical analytics and reporting platforms. My expertise includes:1.Designing and implementing high-performance data pipelines using tools like Apache Spark, PySpark, and SQL2.Building and orchestrating ETL/ELT workflows in Azure Data Factory, Databricks, AWS Glue, and Airflow3.Optimizing big data solutions using Z-Ordering, Partitioning, Delta Lake formats, Liquid Clustering, and caching mechanisms4.Implementing data Lakehouse architectures with strong governance using Unity Catalog, role-based access controls, and audit logging5.Migrating legacy systems (e.g, PL/SQL) into modern data platforms (e.g, Databricks SQL, Delta Lake)6.Working with real-time streaming data using Kafka, Spark Structured Streaming7.Collaborating with cross-functional teams to transform business requirements into scalable technical solutions Key Achievements:1.Spearheaded migration of traditional data warehouse to a modern Lakehouse, reducing query time by 40% and storage costs by 20%2.Automated data validation and ingestion workflows, leading to a 60% increase in processing efficiency3.Developed reusable accelerator frameworks for the Financial Services domain using Databricks and ADF4.Successfully implemented role-based and column-level access controls in Unity Catalog across multi-team environments5.Optimized heavy workflows by tuning Spark jobs, leading to significant improvements in cluster utilization and cost

Experience

1. Data Engineer

   Celebal Technologies

   May 2022 — Present · Jaipur, IN

Education

• ARYA INSTITUTE OF ENGINEERING TECHNOLOGY AND MANAGEMENT

  Bachelor of Technology - BTech, Computer Science