[Remote] Freelance: AI Content Specialist

Note: The job is a remote job and is open to candidates in USA. Uber AI Solutions is a marketplace connecting freelancers with generative AI researchers, seeking analytical thinkers and Junior Linguists for high-level evaluation of GenAI models. The role involves linguistic analysis, safety auditing, and model stress-testing to ensure AI systems are safe, accurate, and natural.

Responsibilities

• Linguistic Analysis: Reviewing prompt context and model responses to analyze the relationship between user intent and AI output
• Safety & Severity Auditing: Evaluating outputs for potential risks (toxicity, bias, misinformation) and categorizing the severity of violations according to strict safety rubrics
• Side-by-Side (SxS) Evaluation: Comparing multiple outputs and using editorial judgment to choose the highest quality response
• Written Justification: Writing short, structured, and technically sound explanations for your ratings based on linguistic and safety principles
• Model Stress-Testing: Identifying model gaps and performing "Red Teaming" to ensure logic and factual accuracy
• Multimodal Evaluation: Assessing AI responses across various formats, including text, audio, and images, to ensure cross-functional model accuracy

Skills

• Bachelor's degree (or currently pursuing one) in Linguistics, English, Journalism, Communications, or a related research-heavy field
• Exceptional writing skills with the ability to explain complex and nuanced reasoning
• A strong pulse on content safety and the ability to identify subtle biases or harmful model behaviors
• Native-level English proficiency is a must

Company Overview

Company H1B Sponsorship