Claude Now Moves Your Mouse
Anthropic added computer-use tools to Claude 3.5 Sonnet. The model receives screenshots and issues mouse and keyboard actions via a new API endpoint, enabling direct control of desktop applications.
Knowledge workers stop writing brittle scripts and instead describe tasks in plain language. The workflow changes from coding automations to supervising an agent that handles clicks and form fills.
Ramp, a corporate card startup, integrated the feature into their expense-review pipeline and reduced manual data entry time by 65 percent in internal tests.
Step 1: Sign up at anthropic.com and enable the computer-use beta in your account settings. Step 2: Call the messages endpoint with tool parameter set to computer_20241022 and supply a screenshot. Step 3: Watch the model return structured actions that move the cursor and type into the target application.