The future of AI — whether in training or evaluation, classical ML or agentic workflows — starts with high-quality data.

At HumanSignal, we're building the platform that powers the creation, curation, and evaluation of that data. From fine-tuning foundation models to validating agent behaviors in production, our tools are used by leading AI teams to ensure models are grounded in real-world signal, not noise.

Our open-source product, Label Studio, has become the de facto standard for labeling and evaluating data across modalities — from text and images to time series and agents-in-environments. With over 250,000 users and hundreds of millions of labeled samples, it's the most widely adopted OSS solution for teams working on building AI systems.

Label Studio Enterprise builds on that traction with the security, collaboration, and scalability features needed to support mission-critical AI pipelines — powering everything from model training datasets to eval test sets to continuous feedback loops.We started before foundation models were mainstream, and we're doubling down now that AI is eating the world. If you're excited to help leading AI teams build smarter, more accurate systems — we'd love to talk.

Content Review & Evaluation Specialist

About the Role

HumanSignal is seeking highly qualified education professionals with exceptional English language and writing skills to contribute to AI development projects. This role involves evaluating, annotating, and validating educational content across various subjects to improve AI model performance in teaching, tutoring, and educational content generation.

Compensation

Up to $40 USD/hour based on qualifications and project complexity

Required Qualifications

Education

Master's degree required in education or related field
PhD strongly preferred in:
- Education
- Curriculum & Instruction
- Educational Psychology
- English/English Literature
- Linguistics
- TESOL/Applied Linguistics
- Or closely related educational disciplines

Degree Field Requirements

Candidates must hold degrees directly in education, English, or teaching-related fields. Acceptable programs include:

Education (General, Elementary, Secondary)
Curriculum & Instruction
Educational Leadership
English/English Literature
Linguistics/Applied Linguistics
TESOL/ESL Education
Reading/Literacy Education
Educational Psychology

Language Requirements

Native or near-native English proficiency required
Exceptional written and verbal communication skills
Strong command of English grammar, syntax, and style
Ability to identify and correct errors in writing across various contexts

Responsibilities

Review and evaluate educational content for accuracy, clarity, and pedagogical effectiveness
Assess AI-generated explanations, lesson plans, and instructional materials
Annotate teaching strategies and learning approaches
Validate content across multiple subject areas and grade levels
Identify errors in grammar, spelling, punctuation, and style
Provide detailed feedback on instructional quality and student engagement
Evaluate content for age-appropriateness and educational alignment
Review explanations for clarity and accessibility to diverse learners

Qualifications

Deep understanding of pedagogical principles and instructional design
Excellent writing and editing skills
Strong analytical and critical thinking abilities
Expertise in English grammar, composition, and rhetoric
Experience developing or evaluating educational materials
Familiarity with educational standards (Common Core, state standards, etc.)
Understanding of differentiated instruction and diverse learning needs
Ability to work independently and meet deadlines

Work Details

Flexible, project-based work - work on your own schedule
Remote position - work from anywhere
Variable hours based on project availability and your capacity
Ongoing training and calibration provided
Quality-focused environment with performance feedback

Ideal Candidate Profile

Current or former educators, curriculum developers, or educational researchers
Strong background in classroom instruction or educational content creation
Experience across multiple grade levels or subject areas
Published work or demonstrated excellence in educational writing
Passion for improving AI capabilities in educational contexts

How to Apply

Interested candidates should be prepared to:

Submit CV/resume highlighting educational qualifications

Provide proof of advanced degree(s)

Complete a writing and content evaluation assessment

Participate in a qualification review

HumanSignal is a leading provider of AI data annotation and labeling services, powering the development of next-generation AI systems. We work with top technology companies and research institutions to create high-quality training data.

HumanSignal is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

HumanSignal jobs

Data Collector (US & International)

English Writing Generalist (US & International)