Anthropic's Claude AI Now Controls Your Desktop to Boost Productivity

Anthropic is joining the increasingly crowded field of companies with AI agents that can take direct control of your local computer desktop. The company has announced that Claude Code (and its more casual user-oriented Claude Cowork) can now "point, click, and navigate what's on your screen" to "open files, use the browser, and run dev tools automatically" when necessary to complete tasks.

When possible, Anthropic says Claude Code and Cowork will still prioritize using Connectors to directly access and control outside apps or data sources. When that connection isn't available, though, those tools are now able to ask permission to "scroll, click to open, and explore as needed" on the machine itself to do what's asked. This kind of direct control of the computer can also be initiated and managed remotely via Claude's Dispatch tool as long as the target computer remains powered on.

The new desktop control features are designed to boost the capabilities of Claude Code and Cowork, allowing them to directly manipulate a user's computer to complete a wider range of tasks. This can include things like opening specific files, using web browsers to gather information, and even running developer tools to automate complex workflows.

By granting Claude this level of access, Anthropic is betting that users will find the AI assistant more useful and productive for a variety of day-to-day computing tasks. The company notes that users will be asked for permission before Claude takes control of the desktop, ensuring a level of user control and transparency.

The expansion of Claude's capabilities comes as Anthropic continues to position its AI assistant as a powerful productivity tool. With the ability to directly interact with a user's computer, Claude could potentially streamline a wide range of workflows and tasks, from research and analysis to software development and creative work.

However, the move also raises questions about the privacy and security implications of granting an AI agent such deep access to a user's device. Anthropic has emphasized the need for user consent, but as Claude becomes more integrated into users' daily computing habits, the potential for abuse or unintended consequences will be an important consideration going forward.