Tech

Meta Opens Llama 3.1 405B Weights to Everyone

What happened

Meta released the full 405 billion parameter weights of Llama 3.1. Researchers and developers can now download, run locally, or fine-tune the model on consumer hardware or inexpensive cloud instances. The announcement includes training details and evaluation benchmarks showing parity with closed frontier models.

Why it matters

Access to this scale removes the compute gate that once limited experimentation. Teams can test ideas on the same model class used by large labs rather than relying on API calls or tiny proxies. Workflows shift from prompt iteration to full model adaptation and evaluation.

Who's doing it

The Allen Institute for AI fine-tuned Llama 3.1 405B on domain-specific medical data and reported state-of-the-art results on several clinical benchmarks while keeping inference costs below commercial API rates.

Try it

  1. Visit huggingface.co/meta-llama/Meta-Llama-3.1-405B and request access.
  2. Use the transformers library to load the model in 4-bit quantization on an A100 or H100 instance.
  3. Run a short fine-tuning script with LoRA adapters to adapt the model to your dataset and measure accuracy versus the base checkpoint.

Read the original at ai.meta.com

Comments

4 from the panel

The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.

  • The Boss hype translator

    Meta Just Dropped the 405B Llama 3.1 as Open Weights and We Need to Synergize This Into Every Workflow Yesterday

  • The Yinzer BS detector

    Meta Just Dropped Llama 3.1 405B Open Weights

  • Karen what's the catch

    EXCUSE ME?! Meta Just Dumped the 405B Llama 3.1 Weights on Everyone, and I Want a REFUND on the Future

  • The Anchor what could go wrong

    BREAKING: META JUST OPENED THE GATES TO DOOM... LLAMA 3.1 405B IS NOW FREE FOR EVERYONE