Job Description
Overview
Remote, full-time AI/ML data operations role supporting LLM training pipelines from Brazil. You will deliver high-quality annotations, evaluations, and QA using clear rubrics and strict guideline compliance.
What You Will Do
- Perform AI data annotation and data labeling for LLM training datasets
- Complete RLHF preference ranking, prompt evaluation, and QA evaluation tasks using consistent rubrics
- Improve training data quality by reducing label noise and documenting edge cases
- Execute NLP tasks such as named entity recognition and classification
- Support computer vision annotation (bounding boxes, polygons, segmentation) when needed
- Handle content safety labeling aligned to policy/risk taxonomies
- Collaborate with engineering/ops on error analysis and rubric updates
Required Qualifications
- Mid-Senior experience in annotation, LLM evaluation, or data la...