Anthropic Gives Claude 3.5 Sonnet Mouse and Keyboard Control
Anthropic released the computer use beta for Claude 3.5 Sonnet. The model now moves the cursor, clicks buttons, types text, and navigates desktop applications through a screen capture and action loop. Users can assign tasks such as data entry or form filling without writing any code.
This shifts AI from text output to direct execution on your machine. You stop copying and pasting results and instead let the model finish the workflow itself. The change forces you to design tasks around observable screen states rather than prompt text alone.
Freelance operations teams at early access firms are already routing invoice processing through the beta. One team reported cutting a two-hour weekly data transfer task to under fifteen minutes after granting the model access to their spreadsheet and browser windows.
Step 1: Visit the Anthropic computer use waitlist at https://www.anthropic.com/news/3-5-models-and-computer-use and request beta access. Step 2: Once approved, enable the computer use tool in the Claude API request and supply a clear goal such as 'open Excel and copy column B into a new Google Sheet'. Step 3: Watch the model execute the clicks and keystrokes on screen; verify the final state of the file matches the requested outcome.