Mayank Madhukar

About Mayank Madhukar

I’m a Data Engineer at Amazon with over a decade of experience designing and scaling data platforms that power analytics and decision-making. My expertise spans building large-scale ETL pipelines, optimizing Spark workloads, and driving data migrations to modern lakehouse architectures.At Amazon, I’ve worked across domains — from finance data systems to high-velocity commerce analytics — transforming legacy architectures into cost-efficient, scalable, and reliable AWS-based solutions. I focus on operational excellence, cost optimization, and automation to ensure data systems are both performant and maintainable.Core Areas: Spark (Scala/PySpark), Airflow, EMR, Glue, Iceberg, Lake Formation, AWS Lambda, Redshift, CDK, CI/CDGenAI / LLM Concepts: Embedding generation, Vector databases, Similarity search, Retrieval-AugmentedGeneration (RAG)

Experience

1. Data Engineer Ii

   Amazon

   Aug 2018 — Present · Bengaluru, IN

   Global Finance Tech, FP & A•Build and maintain financial data pipelines leveraging EMR, Spark (Scala), and Airflow, enabling accurate and timely business metrics for global finance.•Drove operational excellence by optimizing Spark workloads and resource configurations, improving SLA adherence and pipeline reliability.Small Business Insights•Writing API Integration scripts, unit test cases and modeling e-com data to give business a unified view of operational performance and measures.•Migrated existing Database to lake-house architecture using AWS lake formation for data governance, ice-berg open table format on S3 to support our upsert operations and Athena as query interface.Prime Tech •Built data pipeline for high data volume and velocity events like prime day.•Built a data pipeline to roll up high velocity event metrics data and do a event wise comparative metric study.•Lead changes and support to a highly complicated data pipeline for promotional data of very fast moving business.

Education

• BNMIT/VTU

  Bachelor's degree, Computer Engineering

  2009 — 2013

Skills

• Sql
• Microsoft Sql Server
• Html
• Javascript
• Big Data
• Asp.net
• Reporting & Analysis
• Sas Programming
• R
• Predictive Modeling
• Linear Regression
• Logistic Regression
• Cluster Analysis
• Factor Analysis
• Time Series Analysis
• Text Mining
• Tableau
• Qlikview
• Python
• Data Analysis
• Relational Data Modeling