Software Engineer (Human Motion Data)

About this role

• As a Software Engineer- Human Motion Data, you will leverage your background in robotics to build the crucial link between human-data and our reinforcement learning pipelines
• This role is dedicated to architecting robust motion data pipelines—integrating diverse sources like mocap, game engines (like Unreal or Unity), teleoperation, and generative AI motion models to generate thousands of rich, physically accurate human motion trajectories
• You will apply your deep expertise in kinematics and rigid body dynamics to translate raw human movement into actionable, dynamically feasible data for whole-body reinforcement learning
• As a core member of the Motion Control and Planning team, you will work closely with Controls stakeholders to play a key role in maintaining a high-velocity, ego-free engineering culture while ensuring our humanoid robots move with unprecedented fluidity
• Design, build, and maintain end-to-end motion data pipelines, integrating diverse sources such as motion capture (mocap), teleoperation, and synthetic generation using diffusion models, animation and gaming engines, to support humanoid robot development
• Implement and optimize kinematic and dynamic retargeting pipelines to accurately map human demonstrations onto the robot’s specific physical constraints, mass distributions, and joint limits
• Develop tools and scripts to process and clean raw human demonstration data, and apply state-of-the-art retargeting libraries (e.g., GMR, Omni-retarget) to synthesize and filter new behaviors
• Leverage game engines (Unreal Engine or Unity) and physics simulators to build simulated environments for procedural motion generation and data augmentation
• Generate high-volume, high-quality trajectory datasets required for training whole-body reinforcement learning policies
• Write robust, automated pipelines to streamline data flow between human demonstration sources, generative motion models, game engines, and the RL training infrastructure
• Collabora...