Job Description
Senior Software Engineer — Product AI
Ship AI-powered product features. You’ll integrate LLMs and ML services into user workflows, build evaluation frameworks, and ensure safety, reliability, and measurable outcomes.
What You’ll Do
- Design APIs and services that incorporate LLM/NLP and retrieval (RAG, embeddings).
- Build evaluation harnesses, guardrails, and offline/online metrics for quality.
- Optimize cost/latency via prompt design, tuning, distillation, and caching.
- Instrument features for A/B testing and impact analysis.
- Collaborate with research, data, and product to iterate rapidly.
What We’re Looking For
- 5+ years in software; 2+ years in applied ML/LLMs preferred.
- Proficiency in Python and one backend stack (Go/Node/Java).
- Experience with vector stores and ML ops in cloud.
- Strong product instincts and data-driven decision making.