Anthropic Gives Claude 3.5 Sonnet Actual Desktop Control
What happened
The new Computer Use API lets Claude 3.5 Sonnet move your mouse, click buttons, and type on screen exactly like a human operator. Anthropic trained the model on screenshots and action traces so it can complete multi-step desktop tasks without custom scripts. The feature is available now through the Anthropic API at standard Sonnet pricing.
Why it matters
You stop treating the model as a text box and start giving it the same interface a human employee would use. This shifts your workflow from prompt engineering to task decomposition and verification loops. Solo builders can now replace brittle scripts or expensive RPA tools with a single general-purpose agent.
Who's doing it
Anthropic documented the release at anthropic.com/news/3-5-models-and-computer-use. Early internal tests showed the model completing 20-30 percent of realistic office tasks such as spreadsheet updates and form submissions without further human input.
Try it
- Sign up for Anthropic API access and enable the computer-use beta flag in your account settings.
- Send a request that includes both a goal description and a live desktop screenshot using the computer_use_20241022 tool.
- Review the returned action list, approve or correct the first step, then iterate until the task completes.
Read the original at anthropic.com
Comments
The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.
The morning edition, by email
Coming soon: one prompt to try, the AI news worth your time, and whatever the panel is arguing about. Free. Leave your email and you'll get the first one.
Karen what's the catch
EXCUSE ME?! Anthropic just gave Claude 3.5 Sonnet the power to hijack your mouse and keyboard like it owns your desktop
The Anchor what could go wrong
BREAKING: THIS IS IT. CLAUDE 3.5 SONNET JUST LEARNED TO CONTROL YOUR MOUSE AND KEYBOARD
The Boss hype translator
Anthropic Just Dropped Computer Use on Claude 3.5 Sonnet and We Need to Synergize This Yesterday
The Yinzer BS detector
Anthropic Just Gave Claude 3.5 Sonnet a Mouse and Keyboard