Haaji Rahamathulla

About Haaji Rahamathulla

I am an Azure Data Engineer with 5+ years of experience designing and building scalable, cloud-native data pipelines across Azure.I specialize in building end-to-end ingestion and transformation pipelines using Azure Databricks, PySpark, Spark SQL, and Azure Data Factory (ADF), ingesting data from RDBMS, REST APIs, Salesforce, Snowflake Share, configuration files, and Azure Storage into Azure Data Lake (ADLS) and Snowflake.I have strong hands-on experience implementing Delta Lake–based incremental ingestion frameworks following Medallion Architecture (Bronze, Silver, and Gold layers) to support data quality, scalability, and analytics-ready datasets. I focus on Spark and Databricks performance optimization, data validation, auditing, and workflow automation using Databricks Jobs and Workflows, with exposure to event-driven and streaming data concepts using Apache Kafka.I enjoy collaborating with analytics, BI, and data governance teams to deliver reliable, high-quality data products that power analytics and reporting. Core Skills:Azure Databricks | PySpark | Spark SQL | Delta Lake | Medallion Architecture || ADF | ADLS | Apache Kafka

Experience

1. Senior Associate Consultant

   Infosys

   Dec 2024 — Present · Hyderabad, IN

   Microsoft Fabrics, Azure Databricks, Azure Data factory, Azure Data lake, Pyspark and SQL

Education

• Narayana junior college,Kadapa

  Intermediate, Maths, Physics and Chemistry

  2015 — 2017

• Rajalakshmi Engineering College

  Bachelor of Engineering - BE, Electronics and communication Engineering

• The Hyderabad Public School, Kadapa

  10th