Product Designer(UX/UI) | $50/hr | Remote

About this role

UX/UI Designer & Product Designers.

We are seeking experienced product designers, UX/UI designers, design system specialists, AI-assisted developers, rapid prototypers, and AI-native product builders to create realistic evaluation tasks for advanced AI systems.

What You’ll Do

• Analyze task execution frame by frame when necessary
• Identify important actions, events, behaviors, and outcomes
• Apply structured labels, tags, and grades based on project guidelines
• Mark timestamps or video segments corresponding to key events
• Determine whether tasks were completed correctly
• Identify partial completions, failed actions, mistakes, or unusual behavior
• Document observations and evaluation rationales clearly
• Apply annotation guidelines consistently across large volumes of videos
• Participate in reviewer calibration and quality discussions
• Collaborate asynchronously with project trainers and other contributors
• Flag unclear or ambiguous cases for additional review
• Provide feedback on labeling guidelines and annotation workflows
• Organize and submit completed annotations within project timelines
• Maintain high standards for precision, consistency, and quality

Who Can Apply

Relevant backgrounds include:

Product Designers, Senior Product Designers, Staff Product Designers, Principal Product Designers, Lead Product Designers, UX Designers, UI Designers, UX/UI Designers, Interaction Designers, Experience Designers, Digital Product Designers, Visual Designers, Interface Designers, Web Designers, Mobile Product Designers, and Application Designers.

Design leadership backgrounds may include:

Design Leads, Design Managers, Product Design Managers, Heads of Design, Design Directors, UX Directors, Creative Directors, Experience Design Directors, Design Principals, and Design Consultants.

Design systems backgrounds may include:

**Design Systems Designers, Design Systems Leads, Design Systems Engineers, UI Systems Designers, Comp...