Say Goodbye to Typing - Google’s Video Search Lets You Ask Questions by Recording

Google Transforms Search with Video Capabilities

Google has introduced a significant new feature that allows users to search the internet using video.

This capability enables users to point their camera at an object, ask questions about it, and receive relevant search results.

Starting from 1700 GMT, Android and iPhone users around the globe can access this innovative feature by enabling "AI Overviews" in their Google app, although it currently only supports English.

This initiative marks yet another step by the tech giant to leverage artificial intelligence (AI) in transforming the way users search online.

Just three months prior, OpenAI, the maker of ChatGPT, began trialling a similar feature that allows users to engage with its chatbot to ask questions directly.

As the race to revolutionise search continues, Google’s introduction of video search comes on the heels of earlier AI enhancements that were met with mixed reviews.

What Were the Early Challenges?

Earlier this year, Google faced criticism for its AI-generated search results, which occasionally produced erratic and misleading answers.

One notable incident included a suggestion to use “non-toxic glue” to help cheese stick to pizza.

Addressing these concerns, a Google spokesperson clarified that these inaccuracies were “isolated examples.”

Since then, the quality of responses has improved significantly, leading to more accurate information being presented in searches.

In the quest to enhance user experience, Google has integrated AI into its search capabilities further.

Users can already ask questions about still images using Google Lens, a feature that has gained popularity and driven the company's decision to expand its capabilities even further.

How Will This New Feature Change Interaction with the Environment?

Liz Reid, Google’s head of search, emphasised the convenience this new video search capability provides, stating that it enables users to ask questions about their surroundings effortlessly.

She illustrated this with a scenario where a visitor at an aquarium could wonder,

“Why are they swimming together?”

Instead of typing out a search query, the user can simply point their camera, record a short video, and verbally pose their question.

Google’s AI analyses the video, identifies the objects—like the fish in this case—and generates pertinent search results.

What Technology Powers This Video Search?

The underlying technology for the video search feature utilises a custom Gemini model.

Google is rolling out this feature in Search Labs for both Android and iOS.

However, currently, the voice search capability within Google Lens is limited to English queries.

When a user captures a video through Lens, the system processes it as a series of image frames.

Rajan Patel, Google’s vice president of engineering, explained that the company employs existing computer vision techniques to interpret these frames, combining them with relevant web information to create accurate responses.

What Other Updates Has Google Introduced?

In addition to the new video search capability, Google has rolled out several other enhancements.

The company has improved its shopping results, which now integrate reviews and pricing from various sellers, making it easier for users to make informed purchasing decisions.

Additionally, Google is venturing into the music-identifying domain with a competitor to Apple’s Shazam.

This new tool, available through Circle to Search on Android devices, allows users to identify songs playing on a website or streaming service without having to leave the app.

Is This a Strategic Response to Growing Competition?

Google's recent feature announcements come as the company faces increasing competition in the search market, where it holds over 90% of the global market share.

Rivals like OpenAI are making strides with their own innovative features, such as SearchGPT, which enables users to ask questions to a chatbot for online searches.

Following a $6.6 billion funding round, OpenAI's value surged to $157 billion, reflecting its growing influence in the tech industry.

As Google continues to enhance its search capabilities through the integration of AI, it aims to maintain its dominance in the ever-evolving landscape of online information retrieval.