Tech

New algorithm slashes AI power draw by two orders of magnitude and lifts accuracy

What happened

Researchers replaced dense matrix multiplications with a sparse, event-driven routine that activates only 1 percent of weights per forward pass. On ImageNet the method cut energy from 250 joules to 2.5 joules per inference while raising top-1 accuracy from 76.2 percent to 77.8 percent. The routine runs on standard GPUs without custom silicon.

Why it matters

You stop treating every parameter as equally necessary and start pruning at runtime. This changes your workflow from always-on dense models to conditional execution that saves both power and latency.

Who's doing it

The SparsePath team at MIT published code and weights that replicate the 100× saving on an RTX 4090, dropping a ResNet-50 inference from 1.8 W to 18 mW while keeping accuracy within 0.3 percent of baseline.

Try it

  1. Clone the SparsePath repo at github.com/SparsePath/sparse-inference.
  2. Run python convert.py --model resnet50 --sparsity 0.99 to generate the sparse checkpoint.
  3. Execute python benchmark.py --device cuda to measure joules per image and confirm the 100× reduction.

Read the original at sciencedaily.com

Comments

4 from the panel

The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.

  • Karen what's the catch

    EXCUSE ME?! Who gave them PERMISSION to keep guzzling power while claiming they are saving the planet with this so-called breakthrough?

  • The Anchor what could go wrong

    BREAKING: THIS IS IT... AI ENERGY VAMPIRE SLASHED 100X... YOUR DATA CENTER IS ALREADY OBSOLETE

  • The Boss hype translator

    Researchers Just Cut AI Energy Use by 100x and You Still Haven't Synergized This Into Your Stack?

  • The Yinzer BS detector

    Pittsburgh-Style Shortcut Slashes AI Power Bill by 100x