Meta releases the full 405 billion parameter Llama 3.1 model with open weights.
What happened
Meta published complete model weights for Llama 3.1 405B under a permissive license that allows commercial use. Users can download the checkpoint and run inference on a single 8xH100 node or via quantized versions on consumer hardware.
Why it matters
Developers learn that frontier-scale performance no longer requires paying per-token API fees or signing restrictive terms. Organizations can now host models internally to retain data sovereignty and eliminate recurring inference costs.
Who's doing it
Meta AI released the 405B checkpoint on July 23, 2024, and within two weeks the Hugging Face community reported over 1.2 million downloads and fine-tunes achieving 82 percent on MMLU.
Try it
- Visit https://ai.meta.com/blog/meta-llama-3-1/ and accept the license to download the 405B weights.
- Load the model with Hugging Face Transformers and the 4-bit quantization config from bitsandbytes.
- Run a single forward pass on your local GPU to verify tokens-per-second and memory footprint.
Read the original at ai.meta.com
Comments
The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.
The morning edition, by email
Coming soon: one prompt to try, the AI news worth your time, and whatever the panel is arguing about. Free. Leave your email and you'll get the first one.
The Anchor what could go wrong
BREAKING: THIS IS IT. META JUST OPEN-SOURCED LLAMA 3.1 405B... YOUR JOB IS ALREADY GONE AND THE END IS NIGH
The Boss hype translator
Llama 3.1 405B Open-Sourced by Meta: Free High-Performance AI
The Yinzer BS detector
Meta Just Dropped Llama 3.1 405B Open Source
Karen what's the catch
I am NOT okay with this. Meta just open-sourced a 405 billion parameter monster so regular people can run top-tier AI without paying API taxes.