Gen AI Engineer | $80/hr | Remote

About this role

AI Engineers, Software Engineers & MCP Evaluation Experts. Remote AI Project

We are seeking experienced AI Engineers, Software Engineers, Systems Engineers, Backend Engineers, ML Engineers, and Developer Tooling Experts to build reinforcement learning environments that test how advanced AI models solve complex software engineering problems using Model Context Protocol (MCP) tools.

The core of the role is strong software engineering. Prior professional AI experience is helpful but not required.

What You’ll Do

• Build reinforcement learning environments for software engineering tasks
• Design realistic coding problems based on production-style codebases
• Create tasks involving bug fixing, feature implementation, refactoring, and optimization
• Require AI agents to discover information using real MCP tools and servers
• Design scenarios where agents must inspect repositories, documentation, APIs, databases, logs, or other connected systems
• Create deterministic verification systems that accurately determine whether a solution is correct
• Build automated tests and graders for coding tasks
• Develop golden reference solutions
• Define clear success and failure conditions
• Ensure environments are reproducible across repeated runs
• Identify shortcuts or unintended ways agents could bypass task requirements
• Test whether tasks measure genuine software engineering ability
• Evaluate model behavior when using MCP tools
• Debug environment, tooling, and infrastructure issues
• Improve task difficulty, realism, and evaluation reliability
• Document environment behavior, requirements, and expected solutions
• Collaborate asynchronously with engineers, researchers, and reviewers

Who Can Apply

Relevant backgrounds include:

AI Engineers, Software Engineers, Senior Software Engineers, Backend Engineers, Systems Engineers, Platform Engineers, Infrastructure Engineers, Full-Stack Engineers, and Developer Productivity Engineers.

We also welcome:

*...