Google has announced a series of new features for its AI Mode, aiming to enhance the learning experience for students preparing for tests and deepening their understanding of various subjects. The latest update allows users to upload images on the desktop version of AI Mode, enabling them to inquire about visual elements, whether these are complex math problems or plants they are curious about.
Initially launched in the United States in May, Google’s AI Mode integrates the power of web searches with capability to summarize findings for users. This feature also facilitates follow-up questions and allows for interactive conversations with the AI tool. The image upload option, which was previously in testing, is now being expanded to desktop to assist students with ongoing assignments and projects.
Further enhancements include an experimental feature for real-time camera sharing in AI Mode, which builds on the existing Search Live functions. Users will soon have the ability to point their mobile camera at items they wish to know more about and engage in verbal discussions about them. This functionality will be available to mobile users in the United States who participate in the AI Mode Labs experiment.
In addition, Google is making strides to simplify access to its Lens tool within Chrome. A newly introduced “Ask Google about this page” option appears when users click on the address bar, allowing them to select specific content to search and generate an AI Overview directly in the browser’s sidebar. Users will also have the option to ask follow-up questions about Lens findings using the “AI Mode” feature or by selecting “Dive deeper” at the end of the AI Overview.
Looking ahead, Google plans to introduce PDF uploads to AI Mode, as well as integration with users’ Google Drive files. The company is currently testing a feature called Canvas in AI Mode on desktop. Launched in March, Canvas serves as a collaborative workspace where users can solicit help from Gemini for tasks such as writing refinement, app creation, game development, and interactive quiz generation. The introduction of Canvas to AI Mode aims to assist students in crafting study guides by organizing relevant information in the Canvas sidebar and allowing for real-time adjustments through additional queries.
Canvas in AI Mode is expected to roll out in the coming weeks for desktop users in the United States who opt into the experiment via Search Labs.
For more updates and personalized content, users can follow relevant topics related to this story.
