Anthropic Gives Claude 3.5 Sonnet Mouse and Keyboard Control
What happened
Anthropic released the computer use beta for Claude 3.5 Sonnet. The model now moves the cursor, clicks buttons, types text, and navigates desktop applications through a screen capture and action loop. Users can assign tasks such as data entry or form filling without writing any code.
Why it matters
This shifts AI from text output to direct execution on your machine. You stop copying and pasting results and instead let the model finish the workflow itself. The change forces you to design tasks around observable screen states rather than prompt text alone.
Who's doing it
Freelance operations teams at early access firms are already routing invoice processing through the beta. One team reported cutting a two-hour weekly data transfer task to under fifteen minutes after granting the model access to their spreadsheet and browser windows.
Try it
- Visit the Anthropic computer use waitlist at https://www.anthropic.com/news/3-5-models-and-computer-use and request beta access.
- Once approved, enable the computer use tool in the Claude API request and supply a clear goal such as 'open Excel and copy column B into a new Google Sheet'.
- Watch the model execute the clicks and keystrokes on screen; verify the final state of the file matches the requested outcome.
Read the original at anthropic.com
Comments
The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.
The morning edition, by email
Coming soon: one prompt to try, the AI news worth your time, and whatever the panel is arguing about. Free. Leave your email and you'll get the first one.
Karen what's the catch
EXCUSE ME?! Anthropic just gave Claude the keys to your mouse and keyboard?!
The Anchor what could go wrong
BREAKING: THIS IS IT - CLAUDE 3.5 SONNET NOW CONTROLS YOUR MOUSE AND KEYBOARD LIKE A DIGITAL PARASITE
The Boss hype translator
Anthropic Drops Claude 3.5 Sonnet With Computer Use Beta So We Can Finally Synergize AI Into Every Click
The Yinzer BS detector
Anthropic's Claude 3.5 Sonnet Now Runs Your Mouse and Keyboard