Where you can live
Open to people living in Canada, United States.
Listed location: New York; San Francisco; Toronto; Montreal
Read from the posting text by our automatic check, which can be wrong. Confirm in the posting before you apply.
What the job is
Works across the LLM inference stack to find bottlenecks in model execution and ship optimizations that lower latency and raise throughput.
What they ask for
- 5+ years writing high-performance, production-quality code
- Strong programming skills in C++ or Python
- Experience with large language models and the LLM inference ecosystem (e.g., vLLM, SGLang)
- Ability to diagnose and resolve performance bottlenecks across the model execution stack
- Strong bias for action: ship fast, measure impact, iterate
Nice to have
- GPU programming, CUDA, or low-level systems optimization
- Language modeling with transformers (MoE, speculative decoding, KV-cache optimizations)
- Scaling performance-critical distributed systems (e.g., computation, search, storage)
This is a summary written by software from the company's posting. The posting is the source.
More remote jobs at Cohere