Sun

About Sun

Peng Sun is Sr. Director of AI Software Development at AMD, overseeing the GPU AI software layer of ROCm. As one of the first engineers on ROCm, he has helped shape AMD’s AI software stack from inception to global deployment. Peng leads teams delivering AI frameworks, inference engines, and high-performance GPU operators for large-scale AI workloads. His work spans enabling industry-leading models, optimizing open-source AI software, and collaborating with major ecosystem partners. Holding a Ph.D. in Computer Science, Peng combines deep technical expertise with proven leadership in building scalable AI solutions that power cutting-edge research and enterprise AI applications worldwide.

Experience

1. Sr Director of Ai Software Engineering

   AMD

   Mar 2025 — Present · Austin, TX, US

   I\'m serving as the Sr. Director of AI Software Development in AMD AI Group. My team owns the GPU AI software layer of ROCm, including the following componients- AI Frameworks R&D including PyTorch, JAX, Tensorflow and ONNX-Runtime ROCm/MiGraphx EP- LLM and Generative AI GPU Inference Engine including vLLM, SGLang, MIGraphX, TGI and other SOTA open source solutions- High performance AI operator for LLM and GenAI in AITER project, the kernels are supported in triton, CK and ASM- MORI (Modular RDMA Interface) reusable and extensible building blocks for advanced techniques such as IBGDA, KV-Cache management, for distributed inference- FlyDSL, a Python-first MLIR-native DSL to scale expert-level GPU kernel development and accelerate inference and training performance iteration- AI Models focusing on HuggingFace and open source LLM models, with MAD automation opened to the public- OpenAI Triton compiler ROCm backend, high performance LLM customized ops support- rocMLIR AI graph compiler for high performance GPU kernels generation- AI ecosystems SW for GPUs, including CUPY, bitsandbyte, Deepspeed etc- AMD technical representatives for PyTorch and OpenXLA foundations- Technical owner of a few strategic AI client accounts globally

Education

• University of Houston

  Doctor of Philosophy (PhD), Computer Science

  2011 — 2016

• Ocean University of China

  Bachelor, Electronic Information Engineering

  2005 — 2009

• University of Houston-Victoria

  Master's degree, Computer Information Systems

  2009 — 2010

Skills

• Access
• C++
• Openmp
• Teaching
• Compilers
• Embedded Systems
• Research
• Parallel Computing
• C
• Programming
• Dreamweaver
• Html
• Python
• Latex
• Photoshop
• Computer Science
• Linux