Shubham Bansal

About Shubham Bansal

As a Senior Software Engineer at AWS, I contribute to the Glue Data Catalog team, which supports metadata and permissions for LakeHouse, DataLake, and DeltaLake architectures, integrating with analytics engines such as AWS Athena, AWS Redshift, and AWS EMR. My work focuses on enhancing performance and availability using distributed systems architecture, authentication/authorization optimization, and reliability engineering. With a background spanning over seven years in software engineering, I have worked on backend systems, distributed systems, cloud storage, and infrastructure. I am passionate about tackling complex distributed systems challenges and driving innovation in scalable data solutions.

Experience

1. Senior Software Engineer (L6)

   Amazon Web Services (AWS)

   Jan 2023 — Present · Seattle, WA, US

   AWS Glue Data Catalog Team - Technical lead working on the AWS Glue Data Catalog service providing catalog metadata and permissions for LakeHouse, DataLake and DeltaLake, integrating with AWS Athena, AWS Redshift, AWS EMR, and other analytics engines- Technical Lead of Glue Data Catalog team (12+ software engineers)- Led Performance and Availability improvement charter for Glue Data Catalog and Lake Formation, delivering 50%-80% perf improvements across all APIs through distributed systems arch, AuthN/AuthZ optimization, and comprehensive reliability engineering- Architected and delivered consistent distributed cache for DynamoDB as persistent storage at scale (p90 <1ms latency at millions of TPS per region) across 15+ AWS regions. Patent filed. Formal verified using P-Lang (https://github.com/p-org/P)- Designed authentication and authorization performance improvements achieving up to 10-30% latency improvements across all APIs in 35+ AWS regions, improving service availability to 99.99%- Led cross-team architectural decisions and design reviews with Glue Data Catalog, AWS Lake Formation, and Glue Iceberg Rest Catalog (Glue S3 Tables integration) teams- Architected solutions for large-scale metadata storage, S3 performance optimization, and multi-catalog integration- Mentored 12+ engineers on distributed systems design, drove technical excellence standards, and established team roadmap.AWS EC2 Catalyst Team - Led AWS regions builds for 10+ regions- Engineering Technical Lead of Infrastructure Team (12+ software engineers)- Architected zero-touch DNS automation and control plane enabling seamless region builds for 400+ AWS services, eliminating days of manual operator intervention- Managed infrastructure supporting 20k+ EC2 instances, 5k+ load balancers, DNS control plane, and security architecture for AWS region launches- Mentored 12+ software engineers on distributed systems, networking architecture, and infrastructure automation.

Education

• International Institute of Information Technology Hyderabad (IIITH)

  B.Tech (hons.) in Computer Science and Engineering, Computer Science

  2012 — 2016

• D.A.V Public School

  High School

  2007 — 2011

• Arizona State University

  Master of Science - MS, Computer Science

Skills

• Matlab
• Powershell
• Sql
• Linux
• Mongodb
• Wireless Security
• Multithreading
• Mysql
• Distributed Systems
• C++
• Windows Internals
• Javascript
• Elasticsearch
• Pin Framework
• Docker
• Cryptography
• Assembly Language
• Computer Security
• Software Development
• Python
• Algorithms
• Exploit Development
• Html
• Opengl
• Windows Kernel Debugging
• Reverse Engineering
• C
• React.js
• Web2py
• Bash
• Malware Analysis