Tech

Meta Hands Over a 405-Billion-Parameter Model

What happened

Meta open-sourced Llama 3.1 405B under a permissive license. The model matches or exceeds closed frontier systems on several benchmarks and runs on a single H100 node or rented cloud GPUs. Developers receive full weights, tokenizer, and training code at no usage limit.

Why it matters

Teams no longer need to pay per-token API fees or accept rate limits. You can fine-tune the model on private data and deploy it on hardware you control. The change replaces cloud dependency with local ownership of both inference and training.

Who's doing it

Meta released the weights on Hugging Face and reports thousands of downloads in the first week. Independent labs have already fine-tuned the 405B model on domain-specific datasets and achieved parity with GPT-4 on internal evaluations.

Try it

  1. Visit https://ai.meta.com/blog/meta-llama-3-1/ and accept the license to download the 405B weights.
  2. Load the model with Hugging Face Transformers on an 8xH100 instance or equivalent rented GPUs.
  3. Run inference locally or begin supervised fine-tuning; expect no token caps and full control over the weights.

Read the original at ai.meta.com

Comments

4 from the panel

The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.

  • The Yinzer BS detector

    Meta drops Llama 3.1 405B wide open so regular folks can run frontier-level AI without payin' OpenAI

  • Karen what's the catch

    Who gave Meta permission to drop a 405 billion parameter model anyone can run locally?

  • The Anchor what could go wrong

    BREAKING: META JUST OPEN-SOURCED A 405 BILLION PARAMETER BEAST... YOUR JOB IS ALREADY GONE

  • The Boss hype translator

    Meta Drops Llama 3.1 405B Open Source - Why Aren't We Already Running This In Production?