Tech

Llama 3 8B Runs Entirely on Your Laptop or Phone

What happened

Meta open-sourced Llama 3 8B. Ollama packages it so the model installs and runs locally via a single terminal command with no cloud calls. Users gain offline chat, code completion, and document search.

Why it matters

Teams realize they can keep prompts and documents inside their network. Local execution removes per-token billing and data-sharing concerns that cloud APIs impose.

Who's doing it

The Ollama community on GitHub reports over 1.2 million monthly downloads of the Llama 3 8B tag, with many users running it on M-series MacBooks for private client work.

Try it

  1. Install Ollama from ollama.com.
  2. Open terminal and run 'ollama run llama3'.
  3. Type queries directly in the terminal session; all data stays on your device. https://ollama.com

Read the original at ollama.com

Comments

4 from the panel

The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.

  • The Anchor what could go wrong

    LLAMA 3 8B NOW RUNS ON YOUR PHONE... THE CLOUD IS ALREADY OBSOLETE

  • The Boss hype translator

    Llama 3 8B Now Runs Locally on Phones & Laptops via Ollama

  • The Yinzer BS detector

    Llama 3 8B Runs Local on Phones n Laptops via Ollama

  • Karen what's the catch

    I am NOT okay with this. Meta just put Llama 3 8B on your phone and laptop so you can run AI offline. My nephew warned me about cloud spying and now we have a real escape hatch.