Audio Transcription Specialist - Evaluator

<strong>About The Job<br><br></strong><strong>Mercor</strong> connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include <strong>Benchmark</strong>, <strong>General Catalyst</strong>, <strong>Peter Thiel</strong>, <strong>Adam D'Angelo</strong>, <strong>Larry Summers</strong>, and <strong>Jack Dorsey</strong>.<br><br><strong>Position:</strong> Transcribing/Writing Expert<br><br><strong>Type:</strong> <strong>Freelance<br><br></strong><strong>Compensation:</strong> <strong>$25–$40/hour<br><br></strong><strong>Location:</strong> <strong>On-site (San Francisco)<br><br></strong><strong>Duration:</strong> <strong>2–4 weeks<br><br></strong><strong>Commitment:</strong> <strong>20 hours/week<br><br></strong><strong>Role Responsibilities<br><br></strong><ul><li>Transcribe and optimize audio/video by creating detailed audio transcriptions with multiple constraints and instructions.</li><li>Define and document evaluation standards by establishing high-level expectations for correct responses in general audio consumer contexts and developing a comprehensive rubric.</li><li>Conduct model testing and grading by running prompts through models and assessing preliminary outputs against expectations.</li><li>Support benchmarking and quality assurance by collaborating in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.</li><li>Work independently and meet deadlines while contributing to a structured project environment with clear goals and tools.<br><br></li></ul><strong>Qualifications<br><br></strong><strong>Must-Have<br><br></strong><ul><li>BS or BA from a reputable institution completed or in progress.</li><li>Strong writing and critical thinking skills.</li><li>Ability to work independently and meet deadlines.</li><li>Available to work from office 20 hours a week on the client’s location.<br><br></li></ul><strong>Preferred<br><br></strong><ul><li>College students/grads.<br><br></li></ul><strong>Application Process (Takes 20–30 mins to complete)<br><br></strong><ul><li>Complete an AI-led interview, this should take around 15 minutes.</li><li>If selected, you will be invited to work on the project.<br><br></li></ul><strong>Resources & Support<br><br></strong><ul><li>For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome</li><li>For any help or support, reach out to: support@mercor.com<br><br></li></ul><em>PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.<br><br></em>,<br><br>