Hao Feng

About Hao Feng

Proficient in Python, C/C++, PyTorch, ns-3, SYCL, OpenCL, and Matlab. • Specialized…

Experience

1. Ai System Research Scientist

   Intel Labs

   Sep 2018 — Present · Hillsboro, OR, US

   Collaborative and Distributed Inference for Large Language Models (LLMs):Designed and implemented a collaborative, high-throughput LLM inference framework optimized for running LLMs across heterogenous compute nodes- Partitioned LLMs into pipeline stages and strategically deployed them across heterogenous hardware resources, enabling efficient parallel execution under limited compute resources- Implemented a socket-based communication framework for transmitting intermediate hidden states between pipeline, enabling collaborative inference across networked heterogenous compute nodes, optimized for standard Ethernet infrastructure- Optimized pipeline execution scheduling and reduced inter-stage communication overhead, achieving significant throughput improvement compared to monolithic inference baseline.Tools: Python, PyTorch, IPEX-LLM, SYCL, OpenCL2. Computing and Network Convergence for AI and Real-time Gaming:Co-developed a network-aware computing platform that enables low-latency, high-throughput execution of LLM inference and real-time rendering by orchestrating remote GPU resources across wide-area cloud networks. Tools: C++, gRPC software stack3. Dynamic Traffic Management for Distributed Computing and AI Inference in Information-Centric Networks (ICNs):Developed a software framework for simulating in-network computing traffic management in ICN paradigm, enabling QoS-guaranteed multi-location processing of emerging applications structured as Service Function Chains (SFCs), including Extended Reality (XR), Face Recognition, and Object Detection. Tools: C++, ns-3, ndnSIM, Matlab

Education

• University of Southern California

  Doctor of Philosophy (Ph.D.)

  2009 — 2016

• Zhejiang University

  Master of Science - MS

  2006 — 2008

• Zhejiang University

  Bachelor of Science - BS

Skills

• Signal Processing
• Computational Complexity
• C++
• Digital Signal Processors
• Optimization
• Algorithms
• Matlab