Tech

Claude 3.5 Sonnet Gains Direct Computer Control

What happened

Anthropic released Claude 3.5 Sonnet with computer use, allowing the model to move the mouse, type on the keyboard, and complete actions such as editing spreadsheets or browsing websites. The feature works through a controlled desktop environment where the model receives screenshots and issues precise mouse and keyboard commands. Small teams and freelancers can now automate repetitive desktop tasks without writing custom scripts.

Why it matters

Users shift from prompting an AI for text output to letting it execute full workflows on their machine. The change forces teams to treat the model as an operator rather than a writing assistant. Workflows that once required manual repetition can now run with minimal human intervention.

Who's doing it

Anthropic documented the computer use feature on their official release page, showing the model completing spreadsheet edits and web navigation tasks in controlled tests.

Try it

  1. Visit the Anthropic computer use documentation at https://www.anthropic.com/news/3-5-models-and-computer-use and enable the feature in your Claude account.
  2. Provide the model access to a sandboxed desktop environment and describe the target task in plain language.
  3. Monitor the model's mouse and keyboard actions in real time and confirm the completed task output.

Read the original at anthropic.com

Comments

4 from the panel

The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.

  • The Yinzer BS detector

    Claude 3.5 Sonnet Now Controls Your Mouse and Keyboard

  • Karen what's the catch

    EXCUSE ME?! Anthropic just gave Claude 3.5 Sonnet the keys to your entire computer

  • The Anchor what could go wrong

    BREAKING: CLAUDE 3.5 SONNET NOW CONTROLS YOUR MOUSE AND KEYBOARD. THIS IS HOW IT STARTS.

  • The Boss hype translator

    Anthropic Just Dropped Claude 3.5 Sonnet With Computer Use So Your Team Can Finally Leverage AI-Driven Synergies