Asif Shaik

About Asif Shaik

Data Engineer with 4.5+ years of experience building scalable ETL pipelines, real-time streaming systems, and cloud-based data platforms using AWS, PySpark, and Apache Kafka.Currently at Capgemini, I design and implement end-to-end data solutions that handle large-scale data processing across both real-time and batch workflows. My work focuses on building efficient, reliable, and cost-optimized data pipelines for analytics and business-critical use cases. Key Expertise:• ETL Pipeline Development (Batch & Real-Time)• Apache Kafka & Streaming Architectures• PySpark & Databricks• AWS (S3, Glue, Lambda, Athena, OpenSearch, DMS)• Data Lakes & Apache Iceberg• SQL & Python Highlights:• Built serverless ETL pipelines using AWS Glue, Lambda, and PySpark to process large datasets efficiently• Designed real-time streaming pipelines integrating Kafka with AWS Iceberg for analytics• Implemented dual-output architecture using OpenSearch and PostgreSQL RDS• Automated workflows using S3 events, SNS, and SQS, improving reliability and performance• Optimized data storage and movement between hot and cold layers, reducing costs• Ensured secure data processing with encryption and best practicesI am passionate about building scalable and efficient data systems and continuously exploring modern data engineering technologies.

Experience

1. Senior Analyst

   Capgemini

   Oct 2021 — Present · Mumbai, IN

Education

• Resonance junior college

  Intermediate, Mpc

  2015 — 2017

• Sri Vivekanandha Vidyalayam

  SSC, SSC

• Gurunanak institute of technology

  B.Tech, Computer Science and Engineering

  2017 — 2021