Spot the bug a model just shipped.
A model writes 'if x = 5:' in Python. Good subcontractors flag this in seconds. The work is a stream of small, fast, high-volume judgements like this.
The example
A model writes if x = 5: in Python. What's wrong?
Good subcontractors flag this in seconds. The mistake — single equals instead of double equals — is the kind of error a model produces, looks plausible doing it, and won't reliably catch on review.
Why this is the work
The actual subcontractor work in Coding is a stream of judgements like this. Small, fast, high-volume, and impossible for a model to reliably check itself. We test for the disposition that catches them.
What qualifying looks like
Pass the Coding Cognition Test (60 questions, 78% pass mark) and you're qualified for AI subcontractor work at the Coding tier — up to $100/hr.
Jobpeak Editorial
A model writes 'if x = 5:' in Python. What's wrong? Good subcontractors flag this in seconds. The work is a stream of judgements like this — small, fast, high-volume, and impossible for a model to reliably check itself.
Subscribe for cutting-edge AI updates
Lorem ipsum dolor sit amet consectetur at amet felis nulla molestie non viverra diam sed augue gravida ante risus pulvinar diam turpis ut bibendum ut velit felis at nisl lectus.
