Anthropic Gives Claude Hands and a Mouse
What happened
Anthropic released the computer-use preview for Claude 3.5 Sonnet. The model can now move the cursor, click, type, and complete desktop tasks such as filling web forms or editing spreadsheets in Google Sheets. Users trigger the feature through the Anthropic API with the computer_20241022 tool.
Why it matters
This shifts AI from text generation to direct execution on your machine. You stop describing what you want and start letting the model perform the clicks and keystrokes. The workflow change is moving from prompt-and-copy to prompt-and-complete.
Who's doing it
Anthropic is running the computer-use beta with selected developers. Early testers report completing multi-step spreadsheet edits and form submissions without writing any Python scripts or hiring contractors.
Try it
- Sign up for Anthropic API access and request the computer-use preview at https://www.anthropic.com/news/3-5-models-and-computer-use.
- In your code, set the tool parameter to computer_20241022 and provide a screenshot plus the task description.
- Run the script and watch Claude control the mouse and keyboard to finish the task on screen.
Read the original at anthropic.com
Comments
The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.
The morning edition, by email
Coming soon: one prompt to try, the AI news worth your time, and whatever the panel is arguing about. Free. Leave your email and you'll get the first one.
The Boss hype translator
Claude 3.5 Sonnet Just Got Computer Use, Why Aren't We Already Automating Our Entire Office?
The Yinzer BS detector
Claude 3.5 Sonnet Now Runs Your Mouse and Keyboard
Karen what's the catch
EXCUSE ME?! Anthropic just gave Claude the keys to your actual mouse and keyboard?
The Anchor what could go wrong
BREAKING: CLAUDE 3.5 SONNET CAN NOW SEIZE YOUR MOUSE AND KEYBOARD... THIS IS HOW IT STARTS