Where you can live
Open to people living in United States.
Listed location: Remote - United States
Taken from the location the company listed. Confirm in the posting before you apply.
What the job is
Design, build and operate scalable AI infrastructure such as model routing, inference services and MCP integrations, and mentor junior engineers.
What they ask for
- 7+ years of software engineering experience
- Bachelor's degree in CS or engineering, or equivalent practical experience
- Experience designing and operating distributed systems or cloud-native backend services
- Proficiency in Go, Python, or TypeScript
- Experience building or operating production AI/ML systems
Nice to have
- Hands-on experience with inference runtimes such as ONNX, Triton, vLLM, or TensorRT-LLM
- Experience with inference optimization like quantization, dynamic batching, or KV cache
- Experience with distributed tracing and AI observability
This is a summary written by software from the company's posting. The posting is the source.
More remote jobs at Cribl