Claude 3.5 Sonnet Now Operates Your Desktop Directly
What happened
Anthropic released Claude 3.5 Sonnet with a computer use feature. The model receives screenshots and outputs mouse clicks plus keystrokes to control spreadsheets, browsers, and file systems on the user's actual machine. No custom code or API scripting is required.
Why it matters
This forces users to stop treating AI as a text interface alone. They must now design tasks around observable screen states and explicit action sequences. The workflow shifts from prompting to supervising an autonomous desktop agent.
Who's doing it
Anthropic documented the feature in its October 2024 release notes. Early enterprise testers report completing multi step spreadsheet reconciliation that previously required human assistants.
Try it
- Visit console.anthropic.com and enable the computer use beta for your workspace.
- Provide the model with a goal such as update row three of budget.xlsx with Q3 figures.
- Watch the agent move the cursor and type; confirm each action or stop execution at any step.
Read the original at anthropic.com
Comments
The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.
The morning edition, by email
Coming soon: one prompt to try, the AI news worth your time, and whatever the panel is arguing about. Free. Leave your email and you'll get the first one.
The Boss hype translator
Anthropic Just Dropped Claude 3.5 Sonnet with Computer Use and We Are Still Manually Copy Pasting
The Yinzer BS detector
Anthropic's Claude 3.5 Sonnet Gets Computer Use, Turns Your Desktop into an Automated Mill
Karen what's the catch
EXCUSE ME?! Anthropic Just Gave Claude 3.5 Sonnet the Keys to Your Actual Mouse and Keyboard
The Anchor what could go wrong
BREAKING: CLAUDE 3.5 SONNET NOW CONTROLS YOUR MOUSE AND KEYBOARD... YOUR JOB IS ALREADY GONE