Audio Evaluator - Fully Remote | Upto $50/hr Hourly

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Transcribing/Writing Expert

Type: Contract

Compensation: $25–$50/hour

Duration: :6 months

Commitment: 20 hours/week

Role Responsibilities
• Transcribe and optimize audio/video content from Romanian, ensuring detailed accuracy under multiple constraints.
• Define and document evaluation standards, establishing expectations for correct responses in general audio consumer contexts.
• Conduct model testing and grading by running prompts through models and assessing outputs against expectations.
• Support benchmarking and quality assurance by collaborating in QA review processes to ensure prompt tasks and rubrics meet rigor.

Qualifications

Must-Have
• BS or BA from a reputable institution completed or in progress
• Strong writing and critical thinking skills.

Preferred
• College students/grads

Application Process (Takes 20–30 mins to complete)
• Complete an AI-led interview, this should take around 15 minutes.
• If selected, you will be invited to work on the project.

Resources & Support
• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: [email protected]

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.