Anthropic's Claude 3.5 Sonnet Now Operates Your Computer Directly, Whether You Asked for That or Not
Claude 3.5 Sonnet gained a 'computer use' capability that allows it to control mouse movements and keyboard inputs to execute tasks on a desktop environment. Regular users can automate repetitive workflows without writing code or employing developers. The model reads screen contents and interacts with software interfaces as a human operator would.
This shifts automation from API-based scripting to visual interface manipulation. You no longer need to understand a program's backend to automate it. The principle here is 'teach by showing, not by coding.' Your workflow changes from 'learn the tool's API' to 'describe the task and let the model observe and execute.'
Anthropic released this capability. The company positioned it as accessible to regular users without technical expertise or hiring developers.
Step 1: Navigate to Claude's interface and locate the computer use feature within the available model options. Step 2: Describe a simple repetitive task you perform, such as 'open a spreadsheet, copy data from column A, and paste it into a web form.' Step 3: Observe as Claude plans the steps, then approve its proposed actions; expect it to move your cursor, click elements, and type text while you monitor. If you lack access, record a screen video of your own workflow and use that as a training reference for any automation tool you do have.