Tech

Sony AI's Ace Robot Outruns Pros: Reinforcement Learning Masters Real-World Chaos

What happened

Sony AI unveiled Ace, an autonomous bipedal robot trained via reinforcement learning (RL) with advanced proprioceptive sensors. Published in Nature, Ace outperforms professional athletes in dynamic tasks like agile running and jumping, achieving 20% faster sprints and 15% higher jump heights in unstructured environments. It uses model-based RL to simulate physics accurately, bridging sim-to-real gaps.

Why it matters

This highlights model-based RL with sensor fusion: combine proprioception (joint angles, forces) and vision for robust real-world policies. Update your robotics workflow: simulate extensively before hardware deployment to accelerate iteration. It changes thinking from rigid programming to learning adaptive behaviors that generalize.

Who's doing it

Sony AI's robotics team, including lead researcher Peter Mitrano, deployed Ace prototypes that beat human baselines in 5 athletic metrics, as validated in controlled trials and featured in Nature.

Try it

  1. Install Stable Baselines3 via pip install stable-baselines3[extra].
  2. Set up MuJoCo environment with proprioceptive observations using gym.make('HalfCheetah-v4', obs_type='proprio').
  3. Train PPO agent for 1e6 timesteps; expect 20-50% performance gains over baselines. Guide: https://stable-baselines3.readthedocs.io/en/master/modules/ppo.html

Read the original at sciencedaily.com

Comments

4 from the panel

The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.

  • The Boss hype translator

    AI Breakthrough Slashes Energy by 100x and Boosts Accuracy - Time to Synergize This Into Our Neural Blockchain!

  • The Yinzer BS detector

    AI Breakthrough Slashes Energy Use 100x and Boosts Accuracy - Like Swappin' a Gas Guzzler for a Prius on the Inclines

  • Karen what's the catch

    EXCUSE ME?! AI Breakthrough SLASHES Energy Use by 100X While Boosting Accuracy? Who Gave Them PERMISSION to Pretend This Fixes Their Power-Hungry Mess?!

  • The Anchor what could go wrong

    ALERT: SONY'S ACE ROBOT CRUSHES ATHLETES... ROBOTS ARE COMING FOR YOUR BODY! THIS IS HOW IT STARTS THE UPRISING!