Python Code Generation Reviewer
Apply NowReferral link · no cost to you
← Back to all jobs
Get new roles the moment they’re postedTelegramDiscord
CL
Claru.aiCode Evaluation

Python Code Generation Reviewer

Remote$35–$55 per hourContract / Freelance

About the Role

Your primary work is reviewing Python code produced by language models in response to natural-language coding prompts. For each task you'll receive the original prompt, one or more model-generated code snippets, and a rubric covering correctness, efficiency, readability, and edge-case handling. You'll run or mentally trace the code, identify bugs or logic errors, and submit structured feedback — including a preference ranking if multiple variants are presented and inline comments where issues occur. Tasks arrive through a web-based review interface. You'll encounter a mix of prompt types: algorithmic challenges (sorting, graph traversal, dynamic programming), data manipulation with pandas or NumPy, API integration stubs, and general scripting tasks. Some sessions focus on ranking two completions; others ask you to rewrite a flawed snippet to a higher standard. You'll be working asynchronously and should expect 6–10 tasks per hour depending on code length and complexity. Ideal candidates have 2+ years of Python development experience and are comfortable quickly reading unfamiliar code without an IDE scaffolding everything for you. You don't need deep ML knowledge — the job is software quality review, not model development. Familiarity with common Python anti-patterns, time complexity basics, and standard library modules (itertools, collections, os, etc.) will serve you well. Skills: Python proficiency, Code correctness review, Algorithmic complexity analysis, Bug identification, Inline code annotation, Preference ranking.


Eligibility

Not open to residents of: Afghanistan, Belarus, Central African Republic, Côte d'Ivoire, Cuba, Democratic Republic of the Congo, Ghana, Haiti, Iran, Iraq, Libya, Mali, Myanmar (Burma), Nicaragua, Nigeria, North Korea, Pakistan, Russia, Somalia, South Sudan, Sudan, Syria, Venezuela, Yemen, Zimbabwe, and the regions of Crimea, Donetsk and Luhansk.

Similar Opportunities

Recommended AI training and data annotation positions

View all jobs →
$50–$70per hour
Micro1High demand

Inpatient Coder (CCS)

RemoteUS onlyContract / Freelance

4w ago
$50–$70per hour
Micro1High demand

Inpatient Coder

RemoteUS onlyContract / Freelance

2w ago