About Expedock
We are a tech-enabled workforce augmentation platform leveraging top 1% offshore talent & cutting edge technology to enable businesses to unlock their full potential
Role Overview
The QA Analyst is responsible for ensuring the accuracy, consistency, and quality of annotated data across all workflows. This role plays a critical part in maintaining high-quality datasets used for training AI/ML models by auditing outputs, providing feedback, and driving continuous improvement among annotators.
Key Responsibilities
1. Quality Auditing
- Review annotated data (images, text, video, or audio) based on defined guidelines
- Perform random and targeted 25% sampling (initial)
- Identify errors, inconsistencies, and edge cases
2. Error Analysis & Reporting
- Categorize errors (e.g., labeling, bounding box accuracy, classification mistakes)
- Track QA metrics such as accuracy rate, defect rate, and rework volume
- Provide daily/weekly QA reports with actionable insights
3. Feedback & Coaching
- Deliver structured feedback to annotators
- Conduct calibration sessions to ensure alignment on guidelines
- Support Team Leads in coaching low-performing annotators
4. Guideline Adherence & Improvement
- Ensure strict compliance with annotation guidelines and client requirements
- Flag ambiguous cases and recommend guideline improvements
- Collaborate with Ops/Training teams to refine SOPs
5. Process Improvement
- Identify trends and recurring quality issues
- Recommend workflow enhancements to improve accuracy and efficiency
- Support pilot runs and new workflow validation
Key Metrics (KPIs)
- Annotation Accuracy (%)
- QA Pass Rate
- Error Rate / Defect Density
- Turnaround Time (TAT) for QA reviews
- Rework Reduction Rate
Qualifications
- Bachelor’s degree or equivalent experience
- 1–2 years experience in QA, data annotation, or BPO operations (preferred)
- Strong attention to detail and analytical skills
- Experience reviewing datasets (image, text, or video) is a plus
- Familiarity with annotation tools (e.g., CVAT, Labelbox, etc.) is an advantage
Tools & Systems (Nice to Have)
- Annotation platforms (CVAT, Labelbox, Supervisely)
- Google Sheets / Excel for tracking and reporting
- QA dashboards or internal tools
Candidate Data & Privacy Notice
By submitting your application to Expedock, you acknowledge and consent to the collection, use, and processing of your personal information for recruitment and hiring purposes. Your information will be used to:
- Evaluate your qualifications and suitability for current and future roles
- Communicate with you throughout the recruitment process, improve our hiring processes, and overall candidate experience
- Maintain talent pools for future opportunities, where permitted by law
We handle candidate data with care and in accordance with applicable data protection and privacy regulations. Your information will only be accessed by authorized team members and will not be shared with third parties without your consent, unless required by law.