[Remote] Online Generalist Jobs in Canada

Note: The job is a remote job and is open to candidates in USA. Rex.zone is hiring full-time remote Online Generalists to support AI/ML data operations for large language model training pipelines. The role involves completing online tasks such as data labeling, RLHF preference ranking, prompt evaluation, and QA evaluation across various datasets.

Responsibilities

• Perform data labeling for NLP tasks (classification, summarization, named entity recognition) and LLM evaluation workflows
• Create preference data for RLHF by ranking/scoring model outputs and writing clear rationales
• Conduct prompt evaluation and response scoring using web-based evaluation interfaces
• Execute QA evaluation, adjudication, and consistency checks to improve training data quality
• Handle content safety labeling using policy-based decisions and detailed guidelines
• Complete computer vision annotation including image tagging, bounding boxes, and segmentation as needed
• Document edge cases, follow versioned guidelines, and escalate ambiguity appropriately

Skills

• Based in Canada and able to work full-time remotely
• Strong reading comprehension, attention to detail, and consistent decision-making
• Comfortable following detailed annotation guidelines and meeting quality standards
• Experience in data labeling, QA evaluation, RLHF, or LLM evaluation

Company Overview