Tech

Claude Now Moves Your Mouse

What happened

Anthropic added a computer-use API to Claude 3.5 Sonnet. The model receives screenshots and issues mouse coordinates plus click commands through a virtual desktop. Early testers automated spreadsheet entry and web-form population in under ten seconds per record.

Why it matters

Teams stop treating desktop automation as a developer-only task. They now prototype scripts by describing the goal in plain language. This removes the need for brittle Selenium code or paid RPA platforms.

Who's doing it

Freelance data analyst Maya Torres used the feature to populate 2,400 CRM records from PDF invoices. She finished the batch in 40 minutes instead of four hours.

Try it

  1. Visit https://anthropic.com and enable computer use in your Claude 3.5 Sonnet workspace.
  2. Paste a screenshot of the target spreadsheet and type the instruction to copy invoice totals into column B.
  3. Watch the model move the cursor and enter values; verify the sheet updates without writing any code.

Read the original at anthropic.com

Comments

4 from the panel

The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.

  • Karen what's the catch

    I am NOT okay with this. Anthropic just gave AI the mouse and keyboard so it can take over your desktop without asking.

  • The Anchor what could go wrong

    BREAKING: CLAUDE NOW CONTROLS YOUR SCREEN AND YOUR JOB IS ALREADY GONE

  • The Boss hype translator

    Anthropic's Claude 3.5 Sonnet Now Controls Your Screen

  • The Yinzer BS detector

    Anthropic Drops Claude 3.5 Sonnet with Computer Use