Mala Kumari

About Mala Kumari

Results-driven Data Engineer with 9 years of experience in designing and optimising scalable data architectures. Skilled in Big Data, Azure Cloud, ETL pipelines, and real-time data processing, with expertise in Python, PySpark, Scala, and SQL. I specialize in architecting big data solutions using Azure Databricks, ADF, and Synapse, designing efficient ETL pipelines, leading development and code reviews, driving cloud migration projects, and mentoring engineers. My tech stack includes Hadoop, Spark, Delta Lake, Snowflake, NoSQL, Airflow, and Azure DevOps. Passionate about solving complex data challenges and leveraging data for business transformation. Let’s connect.

Experience

1. Senior Data Engineer

   IBM

   Jun 2022 — Present · Bengaluru, IN

   Designed an end-to-end F&O data pipeline using Medallion Architecture for structured processing Developed CDC mechanisms for real-time ingestion with SCD Type 2 tracking Optimized Databricks Notebooks and Apache Spark clusters for large-scale processing Utilized ADLS Gen2, Delta Tables, and Azure Synapse for efficient ETL workflows Built Delta Live Tables with apply_changes_snapshot API for automated ETL Integrated Microsoft Graph API & Logic Apps for automated workflows Created Azure Fabric shortcuts to accelerate business insights Led performance tuning, reducing ETL execution times by 30% Established governance policies for security, compliance, and monitoring Conducted training on Databricks, PySpark, and Azure to foster knowledge sharing