AI agent testing specialist
EXAMPLEAgent testingGlobalProfessional experience
COMPENSATION
Shared before assignment
THE NEXT CHAPTER OF INTELLIGENCE
Human expertise.
Advancing AI.
Extraordinary AI needs extraordinary people. Put your expertise to work on the models, data, and ideas shaping what comes next.
Independent minds. Shared progress.
HUMAN INTELLIGENCE, IN THE LOOP
Perspective makes
the difference.
the difference.
THE WORK BEHIND
BETTER INTELLIGENCE
01 / THE HUMAN ADVANTAGE
Intelligence is artificial.
Judgment is human.
We connect specialized human expertise with the work of building more useful, reliable AI. Thoughtful inputs. Rigorous evaluation. A clearer path forward.
HUMAN PERSPECTIVE. AT EVERY STEP.01
Train with expertise
Create demonstrations, compare responses, and help models learn from informed human judgment.
02
Evaluate what matters
Assess reasoning, factuality, tool use, and behavior against a project-specific definition of quality.
03
Deliver data with context
Build carefully annotated, reviewed datasets with clear instructions and traceable decisions.
02 / A WORLD OF EXPERTISE
Deep knowledge.
Wide-open possibilities.
Technical precision. Linguistic nuance. Real-world judgment. There’s more than one way to help intelligence move forward.
01
Software & code
From code generation to debugging, bring an engineer’s judgment to model performance.
Explore this field02
Language & reasoning
Help models navigate meaning, cultural context, and the reasoning between the lines.
Explore this field03
Research & discovery
Evaluate evidence, challenge assumptions, and bring rigor to complex questions.
Explore this field04
Specialist knowledge
Apply deep subject expertise where a plausible answer isn’t enough.
Explore this field05
Human data & annotation
Create consistent, carefully labeled examples that make model behavior reviewable.
Explore this field03 / YOUR PATH TO CONTRIBUTING
A clear process.
Meaningful work.
Know what to expect—from your first application to reviewed work and visible earnings.
- 01
Apply
Find an opportunity that fits your experience and share your background.
- 02
Show your expertise
Complete a role-specific assessment designed around the work.
- 03
Get aligned
Onboard to the project, its guidelines, and its quality expectations.
- 04
Do meaningful work
Complete assigned tasks with clear instructions and agreed terms.
- 05
Refine through review
Independent review checks your work against the project rubric.
- 06
04 / MAKE YOUR NEXT MOVE
Your knowledge.
Your next opportunity.
Find independent contractor work that puts your expertise to the test. Start with a field you know deeply.
Our first live opportunities are coming soon. The roles below are illustrative examples, not open applications.
Your next chapter can start with a profile.
Build your expert profileFOR AI COMPANIES
Ambitious models.
Meticulous human data.
Bring us the problem you’re trying to solve. We’ll discuss the expertise, evaluation criteria, and delivery process your project needs.
- Project-specific expert qualification
- Calibrated guidelines and review criteria
- Managed delivery with clear handoffs
THE AI FELLOWS APPROACH
HUMAN EXPERTISE
Scope & calibrate
Produce & annotate
Review & deliver
05 / IDEAS WORTH EXPLORING
A closer look
at what comes next.
evaluation, and the work behind AI.
Evaluation4 min read
Better benchmarks start with better questions.
Why useful evaluation starts with the decisions a model needs to get right.
Read perspectiveHuman data3 min read
The craft behind high-quality human data.
Clear scope, calibrated experts, and a review process that preserves context.
Read perspectiveAgent testing4 min read
Test the workflow. Not just the answer.
A practical perspective on evaluating tool use, recovery, and human handoffs.
Read perspectiveYOUR EXPERTISE HAS A NEXT CHAPTER
The future needs
your perspective.
Bring what you know. Help shape what’s possible.
Human expertise. Advancing AI.