Computer Use Plugin

Overview

Computer Use is an official Anthropic plugin that gives Claude the ability to interact with your computer’s graphical interface. Claude can take screenshots, move the mouse, click elements, type text, and execute shell commands — enabling full desktop automation.

What Claude Can Do

• Screenshot — Capture the current screen state
• Click — Left, right, middle click at coordinates
• Type — Input text at the cursor position
• Key press — Send keyboard shortcuts (Ctrl+C, Enter, etc.)
• Scroll — Scroll pages and elements
• Drag — Click-and-drag interactions

Use Cases

• Automate repetitive desktop tasks
• Fill web forms and navigate browsers
• Extract data from GUI applications
• Test desktop applications
• Create automated workflows without APIs

Setup

Computer Use is available in Claude.ai and the Anthropic API. For API usage:

import anthropic

client = anthropic.Anthropic()

response = client.beta.messages.create(
    model="claude-opus-4-5",
    max_tokens=1024,
    tools=[{"type": "computer_20241022", "name": "computer", "display_width_px": 1920, "display_height_px": 1080}],
    messages=[{"role": "user", "content": "Take a screenshot and describe what you see."}],
    betas=["computer-use-2024-10-22"],
)

Safety Considerations

Computer Use has access to your screen and input devices. Use in sandboxed environments for sensitive workflows. Anthropic recommends running Claude in a virtual machine or container when using Computer Use for untrusted tasks.