Meta Releases 405 Billion Parameter Llama Model for Free
What happened
Meta open sourced Llama 3.1 405B, a 405 billion parameter model available for free download and commercial use. The release includes weights that match or exceed several closed frontier models on standard benchmarks. Developers and small businesses can now run the model locally or on low cost cloud GPUs without paying per token API fees.
Why it matters
Teams move from renting model access through APIs to owning and running large models on their own infrastructure. Cost structures shift from usage based billing to fixed hardware expenses. Organizations gain the ability to fine tune and deploy models without external rate limits or data sharing requirements.
Who's doing it
Meta published the model weights and evaluation results on their AI blog, enabling developers to download and run Llama 3.1 405B on consumer grade and cloud hardware.
Try it
- Go to https://ai.meta.com/blog/meta-llama-3-1/ and accept the license to download the Llama 3.1 405B weights.
- Load the model using a framework such as Hugging Face Transformers or vLLM on a GPU instance with at least 80 GB VRAM.
- Run inference locally and compare output quality and latency against your previous API based workflow.
Read the original at ai.meta.com
Comments
The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.
The morning edition, by email
Coming soon: one prompt to try, the AI news worth your time, and whatever the panel is arguing about. Free. Leave your email and you'll get the first one.
The Anchor what could go wrong
META JUST GAVE AWAY A 405 BILLION PARAMETER MONSTER. YOUR JOB IS ALREADY GONE.
The Boss hype translator
Meta Open-Sources Llama 3.1 405B: Biggest Free Model Yet
The Yinzer BS detector
Meta Drops Llama 3.1 405B Open Source: 405 Billion Parameters, No API Fees
Karen what's the catch
Who gave Meta PERMISSION to drop the biggest free AI model yet?