Chao Song

About Chao Song

Senior/Staff Machine Learning Engineer with over 6 years of RecSys experience driving business impact through the design, architecture, and deployment of large-scale, production-ready AI and Machine Learning systems. Proven expertise in cutting-edge domains, including Generative AI (LLMs), Graph Neural Networks (GNNs) and e-commerce personalization with proven experience in production deployment of personalization features serving millions of users. Adept at providing strategic data direction, leading multidisciplinary science and engineering teams, and integrating research techniques for transparent, ethical, and scalable AI solutions. Seeking a challenging staff-level role to leverage deep technical knowledge to build sophisticated enterprise intelligence platforms.

Experience

1. Senior Applied Scientist

   Amazon

   Jan 2025 — Present · Seattle, WA, US

   Amazon Sponsored Product1. Contextual Retrieval & GenAI Opportunity Planner- Architected and delivered an end-to-end contextual retrieval system for next-shopping-mission prediction, improving retrieval performance by 43% in precision@10 and 33% in recall@10- Led a cross-functional team in the design and hands-on implementation of a holistic retrieval system that leveraged customer durable memory, click history, and purchase history through advanced embedding fine-tuning- Developed and deployed a production-grade, real-time inference pipeline using vLLM, which achieved a 58ms latency and delivered a 20-40x performance speedup on G6 instances.2. Mosaic Complementary Widget Recommendation- Utilized Large Language Models (LLMs) to generate and identify contextually relate product missions for over 400K anchor products, integrating signals from co-purchase data- Fine-tuned the LLM model to successfully expand coverage to 95%, overcoming the challenge of sparse co-purchase data with built-in sourcing channel restrictions- Drove a +248MM annual OPS gain and increased the mission completion rate by +0.1% by launching a complementary product widget based on LLM-generated missions.

Education

• Michigan State University

  Ph.D(Applied Maths), Applied Maths

  2012 — 2017

• Fudan University

  BS, Computational and Applied Mathematics

  2008 — 2012

Skills

• C++
• Python
• Matlab
• Algorithm Design
• Algorithms
• Latex
• Machine Learning
• Linear Regression
• Numerical Analysis
• Numerical Linear Algebra
• Mathematical Modeling
• Time Series Analysis
• Stochastic Processes
• Data Mining