On Tuesday, Google announced exciting updates to its AI Mode, an experimental feature designed to transform the way users interact with search results. This innovative feature allows users to ask complex questions and engage in follow-up inquiries to explore topics more thoroughly within the Google Search platform.
One of the standout features being introduced is Canvas, a tool that will revolutionize how you create and organize study plans. With Canvas, users can easily build study plans and manage information across multiple sessions using a convenient side panel. For instance, if you need to prepare for an upcoming test, simply click the new “Create Canvas” button. From there, AI Mode will begin compiling relevant information in the Canvas side panel, allowing you to refine the output with follow-up prompts until it meets your specific needs.
In the near future, users will also have the ability to upload files such as class notes or syllabi to tailor their study guides even further. This capability will be available to users enrolled in the AI Mode Labs experiment in the U.S. in the coming weeks, enhancing the overall learning experience.
Google is also integrating Project Astra features directly into AI Mode through a new functionality called Search Live. This feature works in tandem with Google Lens, the company’s powerful visual search tool. According to Robby Stein, VP of Product for Google Search, “When you go Live with Search, it’s like having an expert on speed dial who can see what you see and talk through tricky concepts in real-time, all with easy access to helpful links on the web.”
To utilize this feature, users can open Lens in the Google app, tap the Live icon, and pose questions while pointing their camera at relevant objects. This capability allows for a dynamic, interactive conversation with Search in AI Mode, using visual context directly from the camera feed. The Search Live feature is rolling out this week on mobile devices in the U.S. for AI Mode Labs participants.
In addition to the new features, Google has announced that users will soon be able to leverage Lens in AI Mode to inquire about content displayed on their desktop screens. For example, if you're reviewing a geometry problem and wish to better understand a specific diagram, you can click on “Ask Google about this page” in the address bar and select the diagram. This action will generate an AI Overview, providing a snapshot of key information directly in the side panel.
Users can also follow up with additional questions through AI Mode by selecting AI Mode at the top of the Lens search results or by clicking the “Dive deeper” button at the bottom of the AI Overview. Furthermore, while the AI Mode is already available for asking questions about images in the Google app, this capability is now extended to desktop users as well.
Google is enhancing user interaction with documents by adding support for PDF uploads on desktop. This feature allows users to pose detailed questions about uploaded documents. For instance, you can upload PDF slides from a school lecture and engage in follow-up discussions to deepen your understanding of the material.
Looking ahead, Google has revealed that AI Mode will soon support additional file types beyond PDFs and images, including various formats from Google Drive. These updates are set to enhance the versatility and functionality of AI Mode, making it an invaluable tool for students and professionals alike.
Stay tuned for these exciting developments as Google continues to innovate and improve the way we search and learn with AI technology.
