LLM inference Jobs - May 2026

Preferred Networks is an AI company based in Tokyo working across the stack. They design in-house chips (MN-Core series) and train LLMs (PLaMo series). They are hiring two roles: (1) MN-Core LLM Serving Engine Engineer to build software infrastructure to serv…

We're a freight brokerage in NJ building a self-hosted, AI-first platform to replace our legacy CRM/TMS. The AI compute infrastructure and data foundation are already in place. We need the architect who turns it into a production operating system. This is a s…

NVIDIA | vLLM + SGLang | Deep Learning Inference | Remote (North America preferred) Hi everyone — I’m Akbar, Senior Manager of Deep Learning Inference Software at NVIDIA. I lead our engineering efforts around vLLM and SGLang, two of the most widely used open-…

Building coding agent systems and an agentic cloud. Small senior team (ex-DeepMind, OpenAI, Microsoft Research, Amazon, Cambridge University; multiple PhDs). Work includes distributed systems, OS/sandboxing, ML and LLM inference/post-training, long-context te…

Hi! Co-founder of iGent AI here. We build agentic systems for large-scale, industrial projects, and an agentic cloud. Proof: our agent built a Redis-compatible database in Rust, with no human coding, in 70 man-hours. Why join: Small, senior team: ex-DeepMind,…

We recently launched Lumo, a privacy-friendly ChatGPT alternative, by the makers of Proton Mail & Proton VPN. We are looking for curious and talented people to help us grow Lumo with any of these skills: ML engineering, LLM inference, GPU infra & devops, Fron…