Senior Data Annotation Jobs in Denver
Overview Senior data annotation jobs in Denver at reputed company focus on building high-quality training data for AI systems, including LLM training pipelines, RLHF, data labeling, QA evaluation, and prompt evaluation. This is a remote, full-time role designed for distributed collaboration while matching Denver-focused recruiting intent. About The Role You will lead complex annotation and evaluation workstreams that create reliable training signals for reputed company systems. You will interpret and refine annotation guidelines, resolve ambiguous edge cases, and deliver consistent, audit-ready datasets that improve model performance and support safe deployment. What You Will Do • Execute and review high-difficulty labeling tasks across NLP and multimodal projects • Run QA evaluation audits, identify disagreement patterns, and propose guideline updates • Perform prompt evaluation and RLHF preference ranking with clear rationales • Create gold sets, measure training data quality, and validate dataset integrity before release • Lead calibration and quality reviews; ensure annotation guidelines compliance Core Workflows • RLHF pipelines (pairwise preference, ranking, rubric-based evaluations) • Named entity recognition (NER), taxonomy classification, and structured extraction • Computer vision annotation (bounding boxes, polygons, keypoints, attribute tagging) as needed • Content safety labeling and policy-aligned evaluations Required Qualifications • Experience operating as a senior or lead annotator with strong quality ownership • Comfort with production QA processes, disagreement analysis, and dataset versioning • Familiarity with LLM evaluation concepts (preference labels, rubric scoring, prompt evaluation) Compensation Hourly rate: $30–$50/hr (base pay), based on skills, scope, and project complexity. How To Apply Apply via reputed company and include a brief summary of annotation experience (NLP, computer vision, content reputed company any RLHF, prompt evaluation, guideline writing, or QA evaluation responsibilities. Apply tot his job Apply To this Job
