1. News
  2. TECH
  3. Gemini Live’s New Camera Trick Works Like Magic — When It Wants To

Gemini Live’s New Camera Trick Works Like Magic — When It Wants To

featured
Share

Share This Post

or copy the link

When Gemini Live’s new camera feature popped up on my phone, I didn’t hesitate to try it out. In one of my longer tests, I turned it on and started walking through my apartment, asking Gemini what it saw. It identified some fruit, chapstick and a few other everyday items with no problem, but I was wowed when I asked where I left my scissors. “I just spotted your scissors on the table, right next to the green package of pistachios. Do you see them?”

It was right, and I was wowed.

I never mentioned the scissors while I was giving Gemini a tour of my apartment, but I made sure their placement was in the camera view for a couple of seconds before moving on and asking additional questions about other objects in the room. 

I was following the lead of the demo that Google did last summer when it first showed off these Live video AI capabilities. Gemini reminded the person giving the demo where they left their glasses, and it seemed too good to be true, so I had to try it out and came away impressed.

Gemini Live will recognize a whole lot more than household odds and ends. Google says it’ll help you navigate a crowded train station or figure out the filling of a pastry. It can give you deeper information about artwork, like where an object originated and whether it was a limited edition.

It’s more than just a souped-up Google Lens. You talk with it, and it talks to you. I didn’t need to speak to Gemini in any particular way — it was as casual as any conversation. Way better than talking with the old Google Assistant that the company is quickly phasing out.


Enlarge Image

Here’s a look at part of my conversation with Gemini Live about the objects it was seeing in my apartment.

Blake Stimac/CNET

Google and Samsung are just starting to roll out the feature to all Pixel 9 (including the new, Pixel 9a) and Galaxy S25 phones. It’s free for those devices, and other Pixel phones can access it via a Google AI Premium subscription. Google also released a new YouTube video for the April 2025 Pixel Drop showcasing the feature, and there’s now a dedicated page on the Google Store for it.

To get started, you can go live with Gemini, enable the camera and start talking.

Gemini Live follows on from Google’s Project Astra, first revealed last year as possibly the company’s biggest “we’re in the future” feature, an experimental next step for generative AI capabilities, beyond your simply typing or even speaking prompts into a chatbot like ChatGPT, Claude or Gemini. It comes as AI companies continue to dramatically increase the skills of AI tools, from video generation to raw processing power. Similar to Gemini Live, there’s Apple’s Visual Intelligence, which the iPhone maker released in a beta form late last year. 

My big takeaway is that a feature like Gemini Live has the potential to change how we interact with the world around us, melding our digital and physical worlds together just by holding your camera in front of almost anything.

I put Gemini Live to a real test

The first time I tried it, Gemini was shockingly accurate when I placed a very specific gaming collectible of a stuffed rabbit in my camera’s view. The second time, I showed it to a friend in an art gallery. It identified the tortoise on a cross (don’t ask me) and immediately identified and translated the kanji right next to the tortoise, giving both of us chills and leaving us more than a little creeped out. In a good way, I think.

This was the first object I tested with the new Gemini Live feature, and it impressively recognized what it was and what game it was from (American McGee’s Alice). Every other time I asked Gemini to identify the game the plush was from, it failed.

Blake Stimac/CNET

I got to thinking about how I could stress-test the feature. I tried to screen-record it in action, but it consistently fell apart at that task. And what if I went off the beaten path with it? I’m a huge fan of the horror genre — movies, TV shows, video games — and have countless collectibles, trinkets and what have you. How well would it do with more obscure stuff — like my horror-themed collectibles?

Initial tests proved significantly more successful than the last, despite my giving it several hints. Gemini eventually got the game, Silent Hill: The Short Message, but still couldn’t give the correct name for the figure, landing only on “Cherry Blossom Monster” instead of Sakurahead, which it had correctly guessed several times earlier. 

Blake Stimac/CNET

First, let me say that Gemini can be both absolutely incredible and ridiculously frustrating in the same round of questions. I had roughly 11 objects that I was asking Gemini to identify, and it would sometimes get worse the longer the live session ran, so I had to limit sessions to only one or two objects. My guess is that Gemini attempted to use contextual information from previously identified objects to guess new objects put in front of it, which sort of makes sense, but ultimately, neither I nor it benefited from this.

Sometimes, Gemini was just on point, easily landing the correct answers with no fuss or confusion, but this tended to happen with more recent or popular objects. For example, I was surprised when it immediately guessed one of my test objects was not only from Destiny 2, but was a limited edition from a seasonal event from last year. 

At other times, Gemini would be way off the mark, and I would need to give it more hints to get into the ballpark of the right answer. And sometimes, it seemed as though Gemini was taking context from my previous live sessions to come up with answers, identifying multiple objects as coming from Silent Hill when they were not. I have a display case dedicated to the game series, so I could see why it would want to dip into that territory quickly.

This was the hardest of my tests. I asked Gemini to identify not only what game this still was from (Silent Hill 2), but what iconic quote the person at the top of the stairs said. Gemini nailed the game, the characters, and half of the quote on the first round; it took two more guesses to finish the quote, “You see it, too? For me, it’s always like this.”

Blake Stimac/CNET

Gemini can get full-on bugged out at times. On more than one occasion, Gemini misidentified one of the items as a made-up character from the unreleased Silent Hill: f game, clearly merging pieces of different titles into something that never was. The other consistent bug I experienced was when Gemini would produce an incorrect answer, and I would correct it and hint closer at the answer — or straight up give it the answer, only to have it repeat the incorrect answer as if it was a new guess. When that happened, I would close the session and start a new one, which wasn’t always helpful.

One trick I found was that some conversations did better than others. If I scrolled through my Gemini conversation list, tapped an old chat that had gotten a specific item correct, and then went live again from that chat, it would be able to identify the items without issue. While that’s not necessarily surprising, it was interesting to see that some conversations worked better than others, even if you used the same language. 

Google didn’t respond to my requests for more information on how Gemini Live works.

I wanted Gemini to successfully answer my sometimes highly specific questions, so I provided plenty of hints to get there. The nudges were often helpful, but not always. Below are a series of objects I tried to get Gemini to identify and provide information about. 

For this one, I just asked Gemini what it saw. “OK, I see a black and white cat that’s basking in the sun on a hardwood floor. The cat is stretched out in a funny position. There is a green rug with ‘Home is where the..’ written on it.” I asked Gemini to guess again, and I received responses from “home is where the horror is” to “honor,” but it eventually landed on the correct answer (just the one word, “horror”). 

Blake Stimac/CNET

Gemini gave me four wrong characters from the right game before correctly identifying this iconic Bioshock Infinite character, Songbird.

Blake Stimac/CNET

Gemini nailed this creepy figure on the first guess. (Twin Victim, Silent Hill 4: The Room)

Blake Stimac/CNET

No fuss — Gemini correctly recognized Mira from Silent Hill 2, the real one in control of the town

Blake Stimac/CNET

This one impressed me. While Gemini could “see” that this was a Silent Hill map, it nailed the fact that this was a limited-run print that was a part of an ARG that took place last year. 

Blake Stimac/CNET

Gemini took a wildly different approach to identifying this jacket from Silent Hill 2. It asked 24 specific questions based on the information I gave it, with my first hint being that it was from a video game. However, by the 19th question, it seemed that it already knew exactly what game it was from by the specific questions it was asking me. 

Blake Stimac/CNET

This one didn’t take long, but Gemini originally suggested that this portrait might be of American author and poet John Ashbery. Once I moved the camera closer to the image and said it was from a TV show, Gemini replied correctly, “That’s the Log Lady from Twin Peaks, holding her famous log.”

Blake Stimac/CNET

This was an easy one for Gemini. It immediately recognized this as a limited-edition tarot deck that had to be “earned” by playing through a specific seasonal event in Destiny 2. 

Blake Stimac/CNET

Gemini Live’s New Camera Trick Works Like Magic — When It Wants To
Comment

Tamamen Ücretsiz Olarak Bültenimize Abone Olabilirsin

Yeni haberlerden haberdar olmak için fırsatı kaçırma ve ücretsiz e-posta aboneliğini hemen başlat.

Your email address will not be published. Required fields are marked *

Login

To enjoy Technology Newso privileges, log in or create an account now, and it's completely free!