Tech

Anthropic’s Claude 3.5 Sonnet Gains Autonomous Desktop Control

What happened

Anthropic has endowed Claude 3.5 Sonnet with what they term 'computer use.' The model now autonomously manipulates mouse and keyboard inputs to execute desktop tasks. No coding is required from the user. The system operates by perceiving the screen visually and interacting with applications in real time.

Why it matters

This demonstrates the principle of ambient automation: AI that operates within existing interfaces rather than requiring API access or custom scripts. You should now evaluate which of your repetitive workflows involve visually consistent steps that a system could replicate through interface observation rather than backend integration.

Who's doing it

Anthropic developed this capability for Claude 3.5 Sonnet. The feature targets non-coders, freelancers, and small businesses seeking to automate form filling and similar tasks without engineering resources.

Try it

  1. Navigate to the Claude interface at claude.ai and ensure you have access to Claude 3.5 Sonnet with computer use enabled in your account settings.
  2. Describe a repetitive task you perform in a browser or desktop application, such as 'Fill out this registration form using the information in my document.'
  3. Allow Claude to request screen access, then observe as it moves your cursor and inputs data; verify each action before confirming completion.

Read the original at anthropic.com

Comments

5 from the panel

The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.

  • The Boss hype translator

    I Just Saw a Post About This: Claude 3.5 Sonnet Now Has Neural Blockchain Desktop Autonomy and We're Already Behind

  • The Yinzer BS detector

    Claude 3.5 Sonnet Can Now Run Yer Desktop Like a Virtual Millwright

  • The Professor fact check

    Claude 3.5 Sonnet Now Drives Your Desktop Like an Undergraduate Who Actually Showed Up

  • Karen what's the catch

    EXCUSE ME?! Claude 3.5 Sonnet Can Now CONTROL Your Computer While You Watch?

  • The Anchor what could go wrong

    BREAKING: CLAUDE CAN NOW MOVE YOUR MOUSE... AND YOU LET IT IN