Karl Bois

About Karl Bois

Principal Server Connectivity Architect with 26+ years driving high-speed interconnect…

Experience

1. Principal Server Connectivity Architect

   NVIDIA

   Dec 2021 — Present · Fort Collins, CO, US

   Lead architect for NVIDIA’s AI supercomputing interconnect, driving the evolution of NVLink from 4.0 through 7.0 across multiple generations of rack-scale systems. Key achievements include:• Architected GH200 NVL32 (32-GPU NVLink domain with 19.5 TB unified memory) and GB200 NVL72 (72-GPU domain at 1.8 TB/s per-GPU bandwidth, 130 TB/s aggregate), and defined the next-generation Kyber rack (576-GPU Rubin Ultra NVL576, 1.5 PB/s aggregate switching, 600 kW liquid-cooled midplane design).• Pioneered NVLink roadmap from NVLink 4.0 (900 GB/s per GPU) through NVLink 5.0 (1.8 TB/s per GPU) to NVLink 7.0 (3.6 TB/s per GPU), enabling non-blocking fat-tree fabrics scaling to 576 GPUs.• Technical lead for PCB and cabled backplane engineering, advancing from 112 G to 224 G SerDes and replacing cable cartridges with a high-density midplane for 4× compute density gains.• Drove energy- and memory-scaling innovations: 25× system energy efficiency improvements, 500× memory scaling for trillion-parameter models, and 15 exaFLOPS inference performance in a single rack.• Established vendor partnerships and incubation projects to support liquid-cooled, rack-scale AI infrastructure for hyperscalers.• Shaped NVIDIA’s long-term interconnect strategy, mentoring cross-disciplinary teams on chip-to-datacenter architecture dependencies and representing NVIDIA in industry standards bodies.• Collaborated closely with key customers and system partners to define exascale AI computing requirements, powering the next generation of generative AI and large language models.

Education

• Université Laval

  Masters, Electrical And Computer Engineering

  1993 — 1995

• Université Laval

  BS, Electrical And Computer Engineering

  1990 — 1993

• Colorado State University

  PhD, Electrical And Computer Engineering

  1995 — 1999

Skills

• Microprocessors
• Vna
• Characterization
• Hardware
• Systems Design
• Analog
• Signal Integrity
• Fpga
• Asic
• Computer Architecture
• Rf
• Ansoft Designer
• Signal Processing
• Microwave
• Tdr
• Team Leadership
• Circuit Design
• Designers
• Hfss
• Hardware Architecture
• Semiconductors
• Radio Frequency (Rf)
• Vlsi
• Simulations
• Electromagnetics
• Pcb Design
• Pcie
• Computer Hardware
• System Design
• Debugging
• Eda
• Electronics Packaging
• Processors
• Ansys