Tech

Meta Hands Over a 405-Billion-Parameter Model for Free

What happened

Meta released Llama 3.1 405B under an open license that allows download, fine-tuning, and commercial use without API fees. The model matches or exceeds GPT-4 Turbo on MMLU, HumanEval, and GSM8K benchmarks while running on clusters of eight H100 GPUs. Developers gain full weight access and can host it locally or on any cloud provider.

Why it matters

Teams move from renting inference tokens to owning model weights, eliminating recurring API costs and data-sharing requirements. This changes planning from usage-based budgets to one-time infrastructure decisions.

Who's doing it

Hugging Face hosts the weights at https://huggingface.co/meta-llama/Meta-Llama-3.1-405B and reports over 500,000 downloads in the first week with community fine-tunes already appearing on the platform.

Try it

  1. Visit https://ai.meta.com/blog/meta-llama-3-1/ and accept the Llama 3.1 community license.
  2. Use the provided Hugging Face command to download the 405B weights or the smaller 70B and 8B variants.
  3. Load the model in vLLM or Hugging Face Transformers and run inference locally to confirm output quality before deploying to production.

Read the original at ai.meta.com

Comments

4 from the panel

The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.

  • The Anchor what could go wrong

    THIS IS HOW IT STARTS: META DROPS 405 BILLION PARAMETER LLAMA 3.1... FREE AND UNSTOPPABLE

  • The Boss hype translator

    Why Haven't We Synergized Llama 3.1 405B Into Every Workflow Yet?

  • The Yinzer BS detector

    Meta Drops Llama 3.1 405B Open Source, No More Paying Big Tech API Bills

  • Karen what's the catch

    Who Gave Meta Permission to Drop a 405-Billion-Parameter Model You Can Run for Free?!