Google testing Gemini-powered conversational AI: How it works

Google is reportedly bringing the power of Gemini AI to YouTube. The company is said to be experimenting with bringing its Gemini-powered conversational AI tool to YouTube on smart TVs, along with gaming consoles and streaming devices. This will allow users to ask questions about videos using voice commands through their remote controls – just like the way they converse with Gemini Live.

According to a report by 9to5google, the feature has been available on YouTube's website and mobile apps for some time, and is now being tested with “a small group of users” on TV platforms. This will also be the first time the AI assistant will work on the biggest screen, the report added.

How conversational AI works

The report claims that the conversational AI appears as an “Ask” button underneath videos on YouTube. When users select it, they can either choose from suggested prompts or use the microphone button to ask questions using their voice – like it is done in Gemini Live.

For TVs that have remote controls with built-in microphones, users can press the microphone button to directly trigger the conversational AI tool. Those TVs without dedicated mic button can navigate to the Ask button first. According to Google, Gemini works in the background to analyse the video and deliver answers in real time.

We’re experimenting with bringing YouTube’s conversational AI tool to smart TVs, gaming consoles, and streaming devices! If you’re eligible, here’s how to access it:

• While watching a video, select the “Ask” button to open the AI tool
• Select from suggested prompts, or use the microphone button to ask questions using your voice

If your TV remote has a microphone button, you can also use that button to trigger the conversational AI tool and ask questions. For example, you could say, “What ingredients are they using for this recipe?” or “What’s the story behind this song’s lyrics?”We’re starting out with a small group of users and will keep everyone up to speed on any future expansions!

Currently, the conversational AI tool is only available in English, Hindi, Spanish, Portuguese and Korean in select regions, the report said, adding that Google hasn’t disclosed which specific regions are included in the test or how many users have access.

The company also hasn't shared any images of how the feature appears on TV screens. If you're part of the test group and spot the "Ask" button on your YouTube TV app, Google would likely appreciate feedback on how it's working.