Marifa Subhani

About Marifa Subhani

As a Data Engineer with extensive experience in designing and managing large-scale data pipelines, I specialize in integrating, transforming, and ensuring the quality of data across systems. I have a strong background in cloud platforms, big data ecosystems, and ETL processes, with a focus on delivering high-quality, scalable data solutions.Core Expertise: • Data Ingestion & Transformation: Led data ingestion processes, ensuring the accurate integration of data into Conformed and Semantic Zones. I have worked with tools like Ab Initio to extract and transform data from legacy systems like Oracle and Teradata, while addressing data quality issues such as duplicates, NULL values, and missing data. • ETL Automation & Big Data: Experienced in creating efficient ETL workflows using Apache Spark, Apache Flink, and other big data technologies. I’ve developed automated data pipelines that handle large volumes of both structured and unstructured data, improving speed and reducing manual intervention. • Cloud Technologies: Hands-on experience with cloud platforms like Azure, AWS, and storage systems like S3 and CosmosDB. I’ve built data architectures on Databricks and Azure Data Lake, enabling modern data engineering solutions for scalability and high performance. • Data Quality Assurance & Testing: Focused on ensuring data accuracy, I have designed automated testing strategies using the ROBOT Framework for validating ETL pipelines and data integrity. I’ve also worked on performance and UI testing for data-driven applications. • Legacy System Migration: Led legacy data extraction and migration projects, transitioning data from traditional systems like Oracle and Teradata to cloud-based solutions with minimal downtime and data loss.Key Achievements: • Optimized Data Pipelines: Reduced data processing time by 30% through pipeline optimization, automation, and improved data processing strategies. • Zero Data Loss: Ensured seamless data migration and integration, maintaining data integrity across various platforms. • Cross-Platform Testing: Integrated and tested data across multiple systems, ensuring reliability and compliance with client standards.With a passion for data engineering and continuous learning, I thrive on solving complex problems and driving business value through innovative data solutions.

Experience

1. Lead Test Engineer

   Cognizant

   Aug 2025 — Present

Education

• Vellore Institute of Technology

  Bachelor of Technology - BTech, Electrical, Electronics and Communications Engineering