Remote Content Moderator – Up to $35/hr

<strong>About The Job<br><br></strong><strong>Mercor</strong> connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include <strong>Benchmark</strong>, <strong>General Catalyst</strong>, <strong>Peter Thiel</strong>, <strong>Adam D'Angelo</strong>, <strong>Larry Summers</strong>, and <strong>Jack Dorsey</strong>.<br><br><strong>Position:</strong> Preference Ranking Model Evaluator<br><br><strong>Type:</strong> <strong>Freelance<br><br></strong><strong>Compensation:</strong> <strong>$25–$35/hour<br><br></strong><strong>Location:</strong> <strong>Remote<br><br></strong><strong>Commitment:</strong> <strong>10–20 hours/week<br><br></strong><strong>Role Responsibilities<br><br></strong><ul><li>Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness.</li><li>Assign preference rankings to pairs or sets of model outputs.</li><li>Follow detailed labeling guidelines and adjust based on evolving criteria.</li><li>Provide brief written explanations for ranking decisions when required.</li><li>Flag edge cases or inconsistencies in task design or model output.</li><li>Work independently and asynchronously to meet deadlines while improving AI model performance.<br><br></li></ul><strong>Qualifications<br><br></strong><strong>Must-Have<br><br></strong><ul><li>Prior experience in data labeling, content moderation, or preference ranking tasks.</li><li>Excellent critical thinking and reading comprehension skills.</li><li>Comfort working with evolving guidelines and ambiguity.</li><li>Strong attention to detail and consistency across repetitive tasks.</li><li>Availability for regular part-time work on a weekly basis.<br><br></li></ul><strong>Compensation & Legal<br><br></strong><ul><li>Payments issued weekly via Stripe Connect.</li><li>Classified as an independent contractor.<br><br></li></ul><strong>Application Process (Takes 20–30 mins to complete)<br><br></strong><ul><li>Submit your resume.</li><li>Complete a short form to highlight your relevant experience.</li><li>You may be asked to complete a brief assessment to evaluate task fit.<br><br></li></ul><strong>Resources & Support<br><br></strong><ul><li>For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome</li><li>For any help or support, reach out to: support@mercor.com<br><br></li></ul><em>PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.<br><br></em>,<br><br>