Software Engineer – AI Coding Evaluation

About this role

Company Description :

MillionLogics, a trusted Oracle Partner, is a global leader in IT solutions, combining innovation, expertise, and strategic vision. With headquarters in London, UK, and a development hub in Hyderabad, India, MillionLogics leverages global business acumen and top-tier technical talent to deliver transformative IT services. The company specializes in Data & AI, Cloud Solutions, IT Consulting, Database Services, and Security & Architecture, with a strong focus on Oracle Cloud and database technologies. Backed by a team of over 85+ technology experts, MillionLogics is dedicated to delivering smart, scalable, and tailored solutions that drive measurable outcomes. Learn more about its services and leadership at MillionLogics.com.

Role Overview

We are looking for experienced Software Engineers to help evaluate, benchmark, and improve the coding capabilities of frontier AI models. In this role, you will assess AI-generated code, validate solutions against real-world software engineering tasks, identify correctness and quality issues, and contribute to the development of high-quality evaluation datasets and benchmarks.

This position is ideal for engineers who enjoy code review, debugging, problem-solving, and applying strong software engineering judgment to complex technical scenarios. Your work will directly contribute to measuring and improving the performance of advanced AI coding systems.

Offer Details :

- Mode of Work: Remote
- Contract: 12 months
- Pay: $30/hr
- Availability: 8 hours per day with an overlap of 4 hours with PST.
- Experience:
3+
- Number of Positions
: 30

Skill

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related technical field.
• 3+ years of professional software engineering experience.
• Strong proficiency in one or more of the following languages: Python, Java, C/C++, Go, Swift, Objective-C, PHP, or SQL.
• Strong understanding of data structu...