Heet Dave

About Heet Dave

I\'m currently working at Amazon in the Alexa AI organization. Skills: •…

Experience

1. Software Engineer

   Amazon

   Jun 2021 — Present

   Designed and implemented a functionality to share ML models using cache in a Python based Tier-1 Inference Service which ranks Alexa skills for each request. This reduced the memory footprint by 17% which allowed loading 30% more ML models.* In a Reactive Java based service, implemented a Self-Learning runtime component which fetches data from DynamoDB and computes whether to explore a request based on heuristics. Self-Learning decreased the defect rate by 15%.* Designed and implemented an automatic dialup feature using Kubernetes and Go for the experiment management system to conduct A/B experiments through AWS Evidently on live Alexa traffic. This feature eliminated the need for manually dialing up A/B experiments and reduced experimentation time by 6 hours per experiment.* Built key features for the Alexa skills ranking Inference Service which servers about 1B requests daily. Leveraging AWS CDK (Infrastructure as a Code) created service and load testing infra, performed scaling, operation readiness and took ownership in launching the service worldwide.* Productionalized and launched the experiment management system front-end which was developed using React & Redux. This UI made the system completely self-service for our customers and reduced operational load down to ~1 hour per month.