Google is set to enhance its AI Mode in Search by introducing several new functionalities aimed at improving user experience. On Tuesday, the tech firm based in Mountain View unveiled four key features designed to broaden the practicality of this AI-powered search tool. The standout addition is the enhancement of Search Live, enabling users to pose questions directly from video feeds using Google Lens.
AI Mode Expands with New Functionalities
In a recent blog post, Google outlined the upcoming features for AI Mode. The rollout of these enhancements is expected to occur over the next week, although some may take longer to become available. While specifics were not provided, they will likely debut in the United States. Notably, all these features can already be accessed through Gemini.
Last month, Google rolled out Search Live for AI Mode, which allows users to engage in real-time voice conversations with the chatbot, similar to the capabilities of Gemini Live. Now, this feature is set to include video support. Users can access this functionality through Google Lens, where Search Live has been integrated.
By opening Lens in the Google app and tapping the Live icon, users can inquire about objects visible in the camera frame. The chatbot analyzes the video feed live and provides answers to user questions. The video-enabled Search Live will be launched this week for mobile users in the U.S. participating in the AI Mode Labs experiment.
AI Mode currently enables users to upload images and ask questions regarding their content. In the coming week, Google will introduce support for PDF files on desktop platforms. Users will be able to upload a PDF, pose queries concerning its content, and receive insightful answers along with contextual information from the web.
Looking ahead, Google has indicated that AI Mode will eventually accommodate additional file types beyond PDFs and images, including documents stored on Google Drive.
Another exciting addition is the Canvas feature, which mirrors functionality available in Gemini. This tool will assist users in creating plans and organizing information. Rather than a distinct button, a “Create Canvas” option will appear when users ask a relevant question. Selecting it will prompt a dynamic side panel where the chatbot will generate the requested plan.
Once a Canvas is established, users can refine it through follow-up questions or by highlighting specific text for modifications. Google intends to allow users to enrich their plans utilizing contextual information from files such as class notes and syllabi. This enhancement is set to be rolled out to AI Mode Labs participants in the U.S. on desktop in the coming weeks.
Lastly, Google is integrating AI Mode into Google Chrome via Lens. This feature will empower users to inquire about any content displayed on their screens. By clicking on the address bar in Chrome and selecting the new option labeled “Ask Google about this page,” users will open AI Mode in a side panel, allowing the chatbot to assist with any questions posed. Users will also have the option to highlight specific elements or text on the page for added context.