How to use Google Gemini on your phone

While Google Assistant will still be around for a while, the future of Google-powered digital assistants now appears to be Gemini. Gemini comes pre-installed if you buy a Google Pixel 9 phone and you can install it the android app on older, non-Pixel Pixel phones. There is now an iPhone app too.

Whether you already have it installed or are thinking about upgrading from Google Assistant, here's what you can do with Gemini. (This was tested on a Pixel 9 Pro Fold.)

You can get the Gemini app for free Android and iOSSign in with your Google account and change. As with Gemini on the web, the model you can access will depend on whether you are willing to pay Google $20 a month for <a target="_blank" href="https://one.google.com/about/ai-premium/”>Google One ai Premiumwhich includes Gemini Advanced; In other words, free users get the smaller Gemini 1.5 Flash model, while paid users get the Gemini 1.5 Pro.

We previously wrote about the differences between the models, but the Pro model essentially provides smarter answers on a wider range of topics. (It's similar to the free vs. paid ChatGPT model.)

Gemini's interface is simple: you enter your question or comment at the bottom of the screen and the answer appears at the top. There are four ways to interact with Gemini: by typing in the text box; use the microphone icon to verbalize your request; use the camera icon to view an image (the camera icon); or using the sound wave icon to talk to Gemini Live.

And yes, there are There are two ways to talk to Gemini: the original voice input type (which works similarly to Google Assistant) and the new Gemini Live. Gemini Live offers a more natural experience. You can interrupt him and use filler words, and the response is also less robotic, more like a normal conversation.

Since standard voice input and Gemini Live use the same underlying ai model and are both available to free and paid users, it's unclear why anyone would want to stick with the former option, but it's there if you need it. (You may find Gemini Live too chatty, as some do.)

By the way, your previous chats can be accessed via a speech bubble icon in the top left corner of the screen, assuming it's enabled. (If not, the icon will take you to the corresponding screen.)

The prompts that Gemini can respond to are similar to what you can use with other ai robots, such as Copilot or ChatGPT. Things like:

• “Give me some birthday theme ideas for a 5 year old.”
• “Compose the text of an email telling my boss that I want a promotion.”
• “What sci-fi podcasts should I listen to?”
• “Write a poem about the iPhone 16.”

At the end of each answer, there will be icons you can use: thumbs up and thumbs down icons to rate the answer; a share icon to send to a contact; or a copy icon to send it to your phone's clipboard. A Google icon requests an evaluation of the results. Tap the three dots and you can send the response to Google Docs or Gmail or modify the response (make it shorter or more casual in tone, for example).

You can also have Gemini generate images through Google's Image 3 engine, regardless of whether you pay for Gemini Advanced. There's a caveat, though: you can't generate images of people unless you're a subscriber, at least for now.

Tap the camera icon and you can take a photo to add to your message. This gives you even more scope for directions:

• “What kind of flower is this?”
• “What can I make with these ingredients?”
• “How do I fix this?”
• “Where is this place?”
• “If I like this TV show, what else will I like?”

To upload an image from your gallery, tap the + (plus) to the left of the text entry box. (If you don't see the plus icon, tap the camera icon.) If you're a Gemini Advanced subscriber, you can also upload other types of files: Gemini can summarize PDF files, for example, or rewrite text in a letter.

The usual rules of generative ai apply here: you may get inaccuracies, so be sure to check everything important and don't rely on Gemini to give you reliable medical or legal advice.

Over time, Gemini is gradually gaining more capabilities on the web and in mobile apps, and Google is adopting the strategy of releasing these updates as individual extensions. In early November, for example, we got one for Google Home.

Step by step, these extensions are giving the Gemini mobile app the same functionality as Google Assistant, like being able to set a timer or control smart lights, plus all the generative ai abilities we've talked about above.

Tap your Google account icon (top right), then choose Extensions to see what's available (and to disable any extensions if, for example, you don't want Gemini snooping around your Gmail or Google Docs).

• “What's on my agenda for this weekend?” (Google Calendar)
• “Tell me about the emails I received today.” (Gmail)
• “Play some REM tunes.” (YouTube Music)
• “How long will it take me to drive to Los Angeles?” (Google maps)
• “Set an alarm for tomorrow at 7 am” (Utilities)

If Gemini doesn't select the correct extension by default, you can tell it how you want a message handled by using “@” followed by the extension name. So, for example, you can type “@Google Calendar” followed by “When is my next meeting?” (This is actually a good alternative method to check what extensions you have available, since they will be listed as you type.)

It's worth keeping in mind that Gemini is still a work in progress. It doesn't yet support multiple music streaming services like Google Assistant does, and its smart home controls, timer, and alarm features are currently limited to Android. Additionally, the Gemini still can't start routines (like starting a playlist and turning on the smart thermostat) with a single voice command, something Google Assistant can do. And of course, beyond the web and mobile apps, it's not connected to as many devices.

If you've invested heavily in Google Assistant, especially in terms of third-party integrations and its more advanced functionality, you're better off sticking with the older ai for now.

You can return to the Google Assistant on your phone if you want. Of Settings on Android:

• Tap Applications > Assistant > Google digital assistants.
• Choose between Gemini and Google Assistant.

That said, Gemini is undoubtedly where Google will invest its time and effort in the future. Hopefully it does a thorough job of porting all of Google Assistant's current features to your new ai assistant of choice.