Nikhil Gupta
Ml Software Architect @Arm
Signup · Get unlimited contacts
WORK HISTORY
Ml Software Architect @Arm
GB
System Design Lead & AI Infrastructure Architect for scalable GenAI solutions on Arm® Neoverse Cloud Platform• LLM Inferencing Optimization & Performance tuning PyTorch, TensorFlow & JAX models on Aarch64 using NEON, SVE2 vectorization• HPC & ML Infrastructure Leader driving production-scale generative AI workloads with vLLM, focusing on latency optimization and model acceleration
EDUCATION
National Institute of Technology Kurukshetra
Bachelor of Technology - BTech, Electronics and communication Engineering
ABOUT NIKHIL GUPTA
As a Senior Software Engineer with expertise in AI/ML optimization across edge and cloud platforms, I currently serve as a System Design Lead at Arm®, where I technically lead the Arm® Neoverse ML team in developing high-performance GenAI solutions for AI at scale. I architect and optimize LLM inferencing on popular ML frameworks including PyTorch, TensorFlow, and JAX, specializing in Aarch64 performance tuning using advanced vectorization techniques like NEON and SVE2.Previously at Samsung Electronics, I developed heterogeneous on-device AI/ML solutions for mobile and automotive domains, contributing to Samsung\'s Exynos SOC machine learning framework and Neural Processing Unit (NPU) software stack. I optimized and accelerated neural networks across distributed accelerators including NPU, DSP, GPU, and CPU, working on production-level modules for neural network optimization and on-device compiler.My experience spans the full AI/ML spectrum from edge devices to cloud-scale HPC infrastructure, with deep expertise in neural network acceleration, ML infrastructure design, and generative AI optimization. I hold a Bachelor of Technology in Electronics and Communication Engineering from NIT Kurukshetra (2021) and am passionate about advancing AI performance through open source contributions on GitHub.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.