In a significant update, Google is expanding its AI Mode within its search experiment, allowing users to interact with the search engine in more sophisticated ways. This innovative feature enables users to pose complex, multi-part questions and follow-ups, providing a deeper understanding of various topics. Now, users who have access to AI Mode can leverage the new functionality to ask questions about images they’ve uploaded or captured with their cameras.
The latest enhancements to AI Mode derive their power from Google Lens’ multimodal capabilities. According to a recent blog post by Google, this advanced image-analyzing functionality can comprehend the complete scene depicted in an image. It understands how various objects relate to each other, as well as details such as their materials, colors, shapes, and overall arrangement.
One of the standout features of AI Mode is its use of a technique known as “query fan-out.” This innovative approach allows AI Mode to generate multiple questions regarding both the image and the objects within it. This results in a more comprehensive response compared to traditional Google search methods. For instance, if a user takes a photo of their bookshelf, they could ask, “If I enjoyed these, what are some similar books that are highly rated?” AI Mode will analyze each book in the image and subsequently offer a curated list of recommended reading, complete with links for further exploration or purchase.
Another impressive aspect of AI Mode is its ability to handle follow-up questions, enabling users to refine their search queries. For example, a user might inquire, “I’m looking for a quick read. Which one of these recommendations is the shortest?” This feature not only enhances user interaction but also ensures that the search results are tailored to individual preferences.
In its recent announcement, Google revealed that it is rolling out AI Mode to millions more users enrolled in Google Labs, the company’s platform for experimental features and products. Previously, access to AI Mode was limited to Google One AI Premium subscribers. This expansion signifies Google's commitment to enhancing user experience and providing advanced search capabilities to a broader audience.
With these new multimodal search features in AI Mode, Google is setting a new standard for how users interact with search engines, making it easier than ever to obtain detailed information and recommendations based on visual input.
