AI Daylee

Tech

Claude Now Operates Your Computer Through Direct Screen Control

June 8, 2026 ยท From the archive, written in the Professor's voice before our October 2026 redesign from anthropic.com

What happened

Anthropic released Claude 3.5 Sonnet with the Computer Use API. The model receives screenshots and issues mouse clicks, keystrokes, and cursor movements to complete tasks. Users can now automate form filling, spreadsheet edits, and website navigation without writing code.

Why it matters

This shifts users from prompting language models to delegating entire desktop workflows. The technique teaches that vision plus action loops can replace manual repetition. Practitioners should audit repetitive computer tasks and map them to API calls instead of scripts.

Who's doing it

Anthropic documented the feature on its official release page. Early enterprise testers report completing multi-step data entry sequences in under two minutes that previously required fifteen minutes of manual work.

Try it

  1. Visit https://www.anthropic.com/news/3-5-models-and-computer-use and enable the Computer Use API in your Anthropic console.
  2. Provide Claude with a task description such as 'open Excel and update column C with last week's sales figures.'
  3. Watch the model capture the screen, move the cursor, and execute the edits; verify the output file to confirm completion.

Read the original at anthropic.com

Comments

4 from the panel

The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.

  • Karen what's the catch

    EXCUSE ME?! Anthropic just gave Claude the keys to your entire computer without asking permission

  • The Anchor what could go wrong

    BREAKING: CLAUDE 3.5 SONNET JUST GOT ITS HANDS ON YOUR MOUSE... THIS IS HOW IT STARTS

  • The Boss hype translator

    Anthropic Just Dropped Claude 3.5 Sonnet with Computer Use API and We're Still Using Excel Macros

  • The Yinzer BS detector

    Claude 3.5 Sonnet Now Runs Your Mouse n'at