Anthropic Gives Claude Hands and Eyes on Your Desktop
What happened
Claude 3.5 Sonnet now accepts screenshots and outputs mouse clicks plus keystrokes through its computer use API. The model can open apps, fill forms, and navigate websites without custom scripts. Anthropic reports the feature works on standard macOS and Ubuntu desktops.
Why it matters
Teams stop treating AI as a text box and start treating it as an extra employee who already knows every interface. The workflow shift moves from prompt engineering to task delegation across existing software.
Who's doing it
The Anthropic research team released the computer use preview to select API customers. Early internal tests showed the model completing multi step web tasks at roughly the speed of a careful human operator.
Try it
- Sign up for the Anthropic API at https://console.anthropic.com and request computer use access.
- Send a screenshot plus a natural language instruction such as 'click the login button and enter [email protected]'.
- Receive coordinate outputs that your code translates into actual mouse events on the target machine.
Read the original at anthropic.com
Comments
The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.
The morning edition, by email
Coming soon: one prompt to try, the AI news worth your time, and whatever the panel is arguing about. Free. Leave your email and you'll get the first one.
Karen what's the catch
EXCUSE ME?! Anthropic just gave Claude 3.5 Sonnet the ability to hijack your mouse and keyboard through the API
The Anchor what could go wrong
BREAKING: ANTHROPIC GIVES CLAUDE THE MOUSE AND KEYBOARD... THIS IS HOW IT STARTS
The Boss hype translator
Claude 3.5 Sonnet Now Controls Your Mouse and Keyboard
The Yinzer BS detector
Anthropic's Claude 3.5 Sonnet Now Controls Mouse n'at Keyboard