Divya Jain
Data Engineer | Spark, AWS, GenAI, Distributed Systems | Building Data Platforms at Amazon Scale
- Role
- Data Engineer at Amazon
- Location
- Seattle, WA, US
- LinkedIn followers
- 500 followers
About Divya Jain
I am a Data Engineer with 8+ years of experience, currently architecting the data platform for Amazon Pharmacy. I specialize in heavy-lift migrations and solving infrastructure bottlenecks at scale.Warehouse Migration (Snowflake to AWS): Led the architectural migration of 500+ tables to a serverless Lakehouse. Designed a custom Change Data Capture (CDC) framework to handle complex historical updates, ensuring 100% reconciliation with financial ledgers.Infrastructure as Code & Tooling: Built a serverless metadata scanner LLM Agent (using AWS Bedrock & CDK) to automatically map data lineage and detect schema drift, replacing manual documentation processes that couldn\'t scale.Spark Optimization: Re-architected our ingestion layer to handle a 14x traffic surge from an upstream service launch. Solved \"small file\" write amplification issues to prevent pipeline timeouts and implemented caching to reduce query costs by 60%.Core Stack: Apache Spark, Python, AWS (Glue, Athena, Lambda, CDK, DynamoDB), SQL, Airflow.
Experience
Data Engineer
Aug 2024 — Present · Seattle, WA, US
Education
University of Mumbai
Master of Commerce - M.Com, Accounting and Finance
2013 — 2015
Queen's University
Master of Management in Analytics, Computer and Information Sciences and Support Services
The Institute of Chartered Accountants of India
CA - Inter, Finance, Auditing, Taxation, Accountancy
2014 — 2017
Thakur College of Science and Commerce
Bachelor of Commerce - B.Com, Accounting and Finance
2010 — 2013
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.