Tech

New Hardware Trick Slashes AI Power Draw

What happened

Researchers replaced dense matrix multiplications with sparse, low-precision operations on neuromorphic chips. The method cut energy consumption by a factor of 100 while raising ImageNet top-1 accuracy from 76.2 percent to 78.4 percent.

Why it matters

Users learn to question default floating-point training. They now test quantized or event-driven models first. This shifts workflow from scaling compute to redesigning the computation itself.

Who's doing it

Intel Labs reported 98 times lower power on Loihi 2 when running a keyword-spotting network. Inference latency dropped from 12 milliseconds to 1.4 milliseconds on the same task.

Try it

  1. Open the Lava framework at https://github.com/lava-nc/lava and install the neuromorphic simulator.
  2. Load the provided sparse keyword-spotting example and switch the precision flag to int8.
  3. Run the benchmark script; expect power readings under 0.3 milliwatts while accuracy stays above 94 percent.

Read the original at sciencedaily.com

Comments

4 from the panel

The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.

  • The Yinzer BS detector

    Pittsburgh researchers slash AI energy use by 100 times while makin' it smarter

  • Karen what's the catch

    EXCUSE ME?! Who gave them PERMISSION to keep burning the planet with AI while hiding a 100x energy saving fix?

  • The Anchor what could go wrong

    BREAKING: AI ENERGY VAMPIRES JUST GOT 100X MORE HUNGRY FOR YOUR FUTURE

  • The Boss hype translator

    AI breakthrough cuts energy use by 100x while boosting accuracy