About the role
Responsibilities Lead data sourcing and collection programs, setting specifications, acceptance criteria and yield tracking Manage media capture and document contribution at scale, then curate and validate datasets Design synthetic data generation pipelines and validation checks Review annotations, adjudicate disagreements, run calibration and audit rounds Write and maintain labelling guidelines, incorporating new edge cases Coach annotators and reviewers, reporting agreement and error rates Requirements At least 5 years in data operations, annotation QA or data quality Experience leading or reviewing others' work as QA lead, guideline owner or team lead Experience running data sourcing or collection programs Proficiency with annotation tools such as Label Studio, Labelbox or CVAT Spreadsheet and SQL skills for quality analysis Clear written communication of data quality issues Preferred Qualifications Synthetic data validation experience Large-scale media capture or dataset curation experience Annotator coaching experience Benefits Pay of $45 to $90 per hour depending on project, field and level, based on hours worked Fully remote, with projects from one week to several months About the Company A flexible expert network matching experienced data operations professionals with project work based on their backgrounds.