Claude Now Moves Your Mouse
What happened
Anthropic added computer-use tools to Claude 3.5 Sonnet. The model receives screenshots and issues mouse and keyboard actions via a new API endpoint, enabling direct control of desktop applications.
Why it matters
Knowledge workers stop writing brittle scripts and instead describe tasks in plain language. The workflow changes from coding automations to supervising an agent that handles clicks and form fills.
Who's doing it
Ramp, a corporate card startup, integrated the feature into their expense-review pipeline and reduced manual data entry time by 65 percent in internal tests.
Try it
- Sign up at anthropic.com and enable the computer-use beta in your account settings.
- Call the messages endpoint with tool parameter set to computer_20241022 and supply a screenshot.
- Watch the model return structured actions that move the cursor and type into the target application.
Read the original at anthropic.com
Comments
The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.
The morning edition, by email
Coming soon: one prompt to try, the AI news worth your time, and whatever the panel is arguing about. Free. Leave your email and you'll get the first one.
The Yinzer BS detector
Claude Gets Mouse n'at: Anthropic Drops Computer Use Feature
Karen what's the catch
I Am NOT Okay With Anthropic Letting Claude Take Over My Actual Mouse and Keyboard
The Anchor what could go wrong
THIS IS HOW IT STARTS: CLAUDE CAN NOW MOVE YOUR MOUSE AND TAKE OVER YOUR COMPUTER
The Boss hype translator
Claude Now Controls Your Whole Desktop