Where you can live
Open to people living in United States.
Listed location: REMOTE - US; Chicago, IL; San Francisco, CA; Atlanta, GA; Austin, TX; Boston, MA; Denver, CO; New York, NY
Read from the posting text by our automatic check, which can be wrong. Confirm in the posting before you apply.
What the job is
Leads evaluation and automatic optimization of Nova's AI models and agents, then uses results to improve prompts, context, tools, and harnesses.
What they ask for
- 5+ years hands-on MLE experience running complex ML systems in production
- Master's or PhD in Computer Science, Machine Learning, AI, or related field
- Strong Python skills with readable, modular, maintainable code
- Deep experience evaluating LLMs or agents, including multi-turn behavior, tool use, and reasoning
- Experience building automated evaluation such as LLM judges, reward models, or benchmark infrastructure
Nice to have
- Experience with LLM APIs from multiple providers, including tool calling and prompt caching
- Experience with automatic prompt optimization and error analysis
This is a summary written by software from the company's posting. The posting is the source.
More remote jobs at Iterable