Gemini on Mac Can Now Work Across Almost Any App With Voice Commands

Google is expanding Gemini on macOS with system wide voice control, improved dictation, and an optional ability to understand information displayed on your screen.

The new features are arriving through Gemini app version 1.88. Once available, you can press and hold the Fn key to open a small floating Gemini interface at the bottom of the display.

This shortcut works across macOS instead of remaining limited to the Gemini app or a browser window. You can activate it while using a document editor, file manager, creative application, email client, or another supported program without leaving your current workspace.

The update is intended to reduce the need to copy text between apps or keep a separate assistant window open. Gemini can listen to your request while your cursor remains in the application you are already using.

Improved dictation cleans up speech before inserting text

One of the main additions is advanced speech to text input. Gemini can place spoken words directly into the active text field, allowing you to dictate messages, documents, notes, or other content.

The system does more than create a word for word transcript. It can remove filler sounds, including repeated pauses and expressions such as “umm” or “ah.”

It can also recognise corrections made while you are speaking. When you change the wording of a sentence partway through, Gemini can use the revised version instead of including both attempts.

This should produce cleaner text that requires less editing after dictation. The feature may be useful when writing emails, taking notes, preparing drafts, or entering longer sections of text without using the keyboard.

Feature	What it does
Fn key shortcut	Opens Gemini from almost any Mac application
Floating interface	Keeps the assistant available without changing windows
Intelligent dictation	Inserts polished speech as text at the cursor
Filler removal	Removes unnecessary pauses and repeated sounds
Spoken corrections	Applies revised wording during dictation
Screen context	Understands selected files, documents, images, and visible content
Image tools	Creates or changes images through spoken instructions

Optional screen access gives Gemini more context

Gemini also includes an optional mode that allows it to analyse information shown on the Mac display. You must enable this feature before the assistant can use desktop context.

Once active, you can select a file, image, folder, document, or section of text and give Gemini a spoken instruction related to that material.

For example, you could highlight several documents and ask Gemini to prepare a short summary inside an email. You could also select unorganised meeting notes and request a clearer version with important points placed at the beginning.

This system can work with information stored locally on the Mac, depending on the permissions granted to the Gemini app. That makes privacy controls important because selected content may include personal, financial, business, or medical information.

You should review the app’s access settings before enabling desktop context and avoid sharing sensitive files unless you understand how the information will be processed.

Gemini can also assist with images and creative work

The desktop awareness feature extends beyond written content. Gemini can examine selected visual material and respond to editing or generation requests.

You could select an illustration and ask the assistant to create a version designed for a dark interface. You could also request a new image based on the style or subject of an existing graphic.

These tools may reduce the number of steps required for simple creative tasks, although professional work will still need careful review. AI generated images can contain visual errors, incorrect details, or unwanted changes.

The system may be most useful for producing early concepts, alternate versions, or basic assets before further editing.

The rollout is beginning with English language systems

Google is distributing the update globally for Macs configured to use English. The rollout is gradual, which means installing version 1.88 may not make every feature available immediately.

Support for more languages is planned for later releases, although Google has not provided a complete schedule.

The update gives Gemini a more direct role in macOS by allowing it to work wherever you are typing or viewing content. Its intelligent dictation may be the most practical feature for everyday use, while screen understanding creates broader possibilities for summarising documents, organising notes, and working with visual files.

The value of these tools will depend on accuracy, privacy controls, and how reliably Gemini works across different applications. Still, system wide access removes much of the friction involved in opening a separate assistant and manually transferring information between windows.