Shubham Kumar

About Shubham Kumar

Senior Data Engineer with 5+ years of experience building scalable, cloud-native data platforms and production-grade data pipelines on AWS. Currently working at Amazon, where I design and optimize data lakes, batch and real-time ETL/ELT pipelines, and analytics systems supporting large-scale business and product use cases.Strong hands-on expertise in Python, SQL, PySpark, Apache Spark, AWS (S3, Glue, Lambda, Athena, Redshift, Kinesis, EC2, MWAA/Airflow), dbt, and streaming data architectures. Experienced in data modeling, data warehousing, pipeline orchestration, and performance & cost optimization. I’ve led initiatives that reduced infrastructure costs by 20–30% while improving data latency from hours to under a minute.I also bring solid experience in data governance and privacy-by-design, acting as Data Compliance Owner and implementing GDPR- and DMA-compliant deletion frameworks for enterprise systems.What defines my work style:• Ownership of end-to-end data pipelines• Strong focus on reliability, monitoring, and automation• Collaborative mindset with product, analytics, and business teams• Passion for building efficient, maintainable data systems that enable data-driven decisionsCore interests: Cloud Data Engineering, Big Data, Streaming Systems, Data Lakes, Analytics Platforms, and Scalable Architecture.Open to Data Engineer / Senior Data Engineer opportunities in Europe (Germany, Sweden, Luxembourg).Skills: Data Engineering, AWS, ETL, ELT, Apache Spark, Airflow, dbt, Python, SQL, Data Lakes, Redshift, Athena, Kinesis, GDPR, Real-Time Pipelines, BI, Power BI, QuickSight.

Experience

1. Data Engineer

   Amazon

   Feb 2021 — Present · Bengaluru, IN

   Performed regular cluster maintenance activities by bring auto-vacuuming automations, decongesting cluster by deletion campaigns which resulted in 20% reduction in our infrastructure cost, saving annualised cost around reducing storage footprint by 8% for improved storage efficiency.Performed role of compliance administrator, being single POC for data deletion on customer’s request in team by onboarding data deletion mechanism complying to GDPR and DMA policies, introduced and adopted to standard deletion strategiesHandled over 2 quicksight dashboards for prime video which provided 360 degree coverage of performance with competitors across globe, engaged with third party agencies streamlining the incoming survey data.Created a workstream by building data pipeline extracting data from third party review websites such as Rotten tomatoes and Metacritic, ingesting metrices into Amazon data lake.Facilitated data driven culture by hosting monthly workshops, increased data literacy by 35%.