The artificial intelligence assistant can now navigate macOS, edit files, and complete multi-step tasks in the background. Access requires a paid subscription and an Apple Silicon computer.
Google has added its “@Computer use” feature to the Gemini application for Mac, giving the artificial intelligence assistant agentic control to interact with local files, run applications, and browse the web, TechRadar reported. The update allows the app to carry out multi-step, repetitive workflows based on plain-language prompts, expanding an automation capability that had previously rolled out to PC users.
How the background controls work
Gemini performs these tasks inside a separate background window rather than taking over the user’s mouse and keyboard, according to Engadget. Users don’t have to stop using their computers, as the app operates without interrupting normal activity while displaying a live preview inside the Gemini chat interface.
To navigate macOS and third-party websites, the assistant analyzes the display by taking screenshots. It can then click buttons, type text, scroll through screens, and open or control different software programs to finish the assigned job.
Everyday and creative tasks
Google outlined several tasks the capability can automate, including online sales workflows. For example, a user selling clothes can prompt Gemini to scan clothing photographs stored in a local folder, research pricing across the web, compile product details, and prepare staged listings on e-commerce platforms like eBay.
The assistant can also take over repetitive administrative work involving local files. Gemini can automatically populate fields in documents such as shipping declaration PDF forms, organize folders, process batches of forms and images, or build presentation slideshows using local files.
Alongside administrative chores, Google showcased creative workflows for the tool. In one demonstration, a prompt directed Gemini to take a child’s pencil sketch of a butterfly and convert it into a fully rigged three-dimensional model inside Blender. The assistant then generated an alternative reality application that let the butterfly fly around the room, and turned the drawing into a design for a 3D-printed ring.
Safeguards and temporary file backups
Because agentic software can make errors when altering local data, Google built specific safeguards into the Mac app. Gemini operates under granular permission settings, letting users choose which files and applications the assistant can view or edit, and it stops to request explicit user approval before executing key actions.
To prevent the loss or corruption of important files, the system automatically creates temporary backup copies of every file it touches. If the user is satisfied with the results, those backup files are removed once a new task begins. Otherwise, the system automatically deletes the temporary copies after 24 hours.
Hardware and subscription requirements
The computer use feature comes with specific hardware, operating system, and account restrictions. It works only on Mac computers equipped with Apple Silicon chips, including newer MacBook Air, MacBook Pro, Mac mini, and iMac models. Devices must run macOS Sequoia 15.0 or later.
Free accounts cannot access the tool. Users must subscribe to a paid tier through Google AI Plus, Google AI Pro, or Google AI Ultra. The feature is currently limited to users in the United States who are at least 18 years old, and it operates exclusively in English. Other tech companies, including Anthropic, Meta, and OpenAI, have also released desktop automation tools with system-level controls.
