Ai Evaluation Engineer

About FirstIgnite

FirstIgnite is the AI‑powered business development platform for university technology transfer offices (TTOs). We help research institutions turn breakthroughs into partnerships, licenses, and companies by combining deep LLM‑driven workflows with the relationships that actually move deals forward. Our product suite spans expert discovery, grants search, and AI‑driven outreach — all built on a modern, agentic stack. We ship fast, we measure everything, and we believe evaluations are the difference between AI features that demo well and AI features that work in production.

The Role

We’re hiring an AI Evaluation Engineer to own the quality bar for every LLM‑powered feature we ship. You'll design, build, and scale the infrastructure that tells us — with evidence — whether a prompt change, model swap, or agent refactor made things better or worse. This is a high‑leverage role. Every customer‑facing AI capability at FirstIgnite flows throug...