GitHub Copilot can now control your desktop apps

GitHub Copilot can now interact directly with desktop applications, a capability called computer use that is shipping in public preview.
The feature is available in GitHub Copilot CLI and the GitHub Copilot app on macOS and Windows. Copilot can read on-screen content, click controls, enter and edit text, press keys, scroll, drag and carry workflows across applications.
The target is software with no API, command line or integration interface, including legacy enterprise tools and GUI-only applications that agents previously could not touch. GitHub’s examples include summarizing browser notifications, updating a presentation and moving data between tools.
Control is gated by approval. Copilot asks before taking over an app, and users can review or reset the list of permanently allowed apps. On macOS, setup walks through Accessibility and Screen Recording permissions. Organisations can disable the feature through managed settings.
To enable it, CLI users run the command “/computer on”. In the Copilot app, the toggle sits under Settings and Computer Use.
GitHub did not announce pricing, a general availability date or Linux support. The move pushes Copilot beyond code assistance toward desktop automation, a space where rivals are also racing to ship agent capabilities.
Leave a Reply