Vedant J.
ML Infra @ LinkedIn | CS, Maths @ USC, UIUC
- Role
- Software Engineer - Systems and Infrastructure at Linkedin
- Location
- San Francisco, CA, US
- LinkedIn followers
- 500 followers
About Vedant J.
I’m a graduate student at USC with a focus on distributed systems, deep learning, and large-scale GPU infrastructure. My passion lies in building efficient, scalable solutions to complex problems, especially in the domain of stream processing for ML Systems. During my time at LinkedIn, I developed an online training framework for recommendation models, boosting key performance metrics. I’m particularly interested in leveraging my skills in distributed systems, deep learning frameworks, and model optimization to create impactful, high-performance technology. Let’s connect if you share an interest in GPU programming and pushing the boundaries of AI and infrastructure at scale!
Experience
Software Engineer - Systems and Infrastructure
Jun 2025 — Present · Sunnyvale, CA, US
ML Infra - LLM ServingSemantic People Search - Improved throughput of embeddings generation model by 5.5x using vLLM and matryoshka embeddings.Reliability - Improved robustness of CICD for internal SGLang model server and upstreamed them to OpenSource: https://github.com/sgl-project/sglang/pull/10830
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.