Sony AI's Ace Robot Outpaces Pro Athletes via Reinforcement Learning Milestone
Sony AI unveiled Ace, an autonomous bipedal robot trained with reinforcement learning and advanced force-torque sensors, which outperforms professional athletes in dynamic tasks like agile turning and ball kicking. Published in Nature on April 2024, Ace achieves human-like agility in real-world environments through model-based control and sim-to-real transfer. It handles unpredictable physics with sub-10ms reaction times.
This breakthrough proves AI robotics excel in unstructured real-world settings, not just simulations, shifting focus from perception to embodied action. Integrate reinforcement learning with sensor fusion to build adaptive agents. Your workflow evolves: prioritize sim-to-real pipelines for faster iteration and superior physical performance.
Sony AI's robotics division deployed Ace prototypes that beat Olympic-level soccer players in 1v1 agility drills, achieving 95% success in ball interception tasks under variable lighting and terrain.
Step 1: Install Isaac Gym via NVIDIA's repo: git clone https://github.com/isaac-sim/IsaacGymEnvs.git && pip install -e . Step 2: Train a bipedal agent using PPO reinforcement learning on cartpole or ant tasks: python train.py --task Cartpole. Step 3: Transfer to real robot via domain randomization; expect 20-50% performance boost in physical trials over baselines. URL: https://github.com/leggedrobotics/legged_gym.