Claude 3.5 Sonnet Now Operates Your Desktop Directly
Anthropic released Claude 3.5 Sonnet with a computer use feature. The model receives screenshots and outputs mouse clicks plus keystrokes to control spreadsheets, browsers, and file systems on the user's actual machine. No custom code or API scripting is required.
This forces users to stop treating AI as a text interface alone. They must now design tasks around observable screen states and explicit action sequences. The workflow shifts from prompting to supervising an autonomous desktop agent.
Anthropic documented the feature in its October 2024 release notes. Early enterprise testers report completing multi step spreadsheet reconciliation that previously required human assistants.
Step 1: Visit console.anthropic.com and enable the computer use beta for your workspace. Step 2: Provide the model with a goal such as update row three of budget.xlsx with Q3 figures. Step 3: Watch the agent move the cursor and type; confirm each action or stop execution at any step.