Meta Just Gave Everyone a 405 Billion Parameter Model With No Strings Attached
What happened
Meta released Llama 3.1 405B, an open weights model trained on 15 trillion tokens that matches GPT-4 performance on MMLU, HumanEval, and GSM8K benchmarks. The weights are downloadable from Hugging Face and licensed for full commercial use with no usage caps. Researchers can now fine-tune the model on consumer GPUs or rent A100 clusters at roughly one tenth the cost of proprietary API calls.
Why it matters
You stop treating frontier models as black box services you rent by the token. Instead you treat them as infrastructure you can modify, host, and audit directly. This shifts your workflow from prompt iteration to actual model surgery and cost control.
Who's doing it
The Together AI research team fine-tuned Llama 3.1 405B on domain specific legal data and deployed it on their own inference stack. They report matching GPT-4 Turbo accuracy at 60 percent lower per token cost for their contract review product.
Try it
- Visit huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct and request access.
- Download the weights using the Hugging Face CLI with your access token.
- Run the model locally with vLLM on an 8xA100 node and test inference latency against your current API provider.
Read the original at ai.meta.com
Comments
The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.
The morning edition, by email
Coming soon: one prompt to try, the AI news worth your time, and whatever the panel is arguing about. Free. Leave your email and you'll get the first one.
The Anchor what could go wrong
BREAKING: META JUST OPENED THE 405 BILLION PARAMETER FLOODGATE... YOUR JOB IS ALREADY GONE
The Boss hype translator
Meta Just Dropped the 405B Llama 3.1 and We Need to Synergize This Yesterday
The Yinzer BS detector
Meta Drops 405B Llama 3.1 Open Source, No Strings Attached
Karen what's the catch
EXCUSE ME?! Meta just dumped a 405 billion parameter monster into the open with zero restrictions and you are supposed to be grateful?