Software Engineer - AI Research Annotation

About this role

- Software Engineer - AI Research Annotation
- Location:
Global Remote
- Type:
Hourly Independent Contractor
- Hours:
15-25/week (flexible up to 40)

Join leading AI labs by applying software engineering expertise to improve model reasoning. Review real-world coding tasks and document problem-solving processes.

About the Project

Support development of advanced AI coding capabilities through structured dataset creation. Work with authentic software engineering scenarios from open-source repositories to capture realistic developer thought processes.

Detailed Responsibilities

• Review AI-generated code trajectories on SWE-bench style tasks
• Reconstruct step-by-step reasoning explaining solution approaches
• Annotate decision points, debugging strategies, and technical choices
• Use full codebase context (issues, tests, PRs) for accurate documentation
• Ensure annotations reflect authentic software engineering practices

Technical Requirements

• 2+ years hands-on software development experience
• Strong proficiency in Python, JavaScript/TypeScript, or similar languages
• Experience debugging complex codebases and resolving issues
• Familiarity with Git workflows, pull requests, and issue tracking
• Ability to articulate technical reasoning clearly in writing

Project Structure

- Duration:
1-2 months with extension opportunities
- Start:
Immediate onboarding
- Onboarding:
Resume review + 15-minute AI technical interview
- Pace:
Self-scheduled within weekly commitment minimum
- Payment:
Weekly via Stripe/Wise

Ideal Background

• Computer Science/Software Engineering degree (Bachelor's+)
• Experience with open-source contributions or repository analysis
• Understanding of software development lifecycles and testing
• Comfort working with technical documentation and specifications

Success Profile

Top performers receive rate increases and priority for future AI research projects. Join cohor...