On Tuesday, Google revealed the introduction of two new artificial intelligence (AI) features for its Gemini platform. The tech company, headquartered in Mountain View, is enhancing Gemini with a new interactive space called Canvas, designed to facilitate collaboration between users and AI for tasks related to documents and coding. Additionally, Google is bringing the Audio Overview feature, previously available only in NotebookLM, to Gemini. This feature allows users to generate engaging audio discussions reminiscent of podcasts, based on various content, including documents, slides, and detailed research reports. The rollout of these features is set to reach Gemini Advanced subscribers as well as users on the free tier worldwide.
Google Introduces New AI Features to Gemini
In a blog post, Google outlined the latest enhancements to the Gemini platform. This update follows the introduction of the Deep Research feature, which generates comprehensive reports on intricate subjects, alongside iOS-exclusive lockscreen widgets. Both Canvas and Audio Overview will be accessible through Gemini’s web and mobile applications.
Canvas serves as an innovative interactive area within Gemini, enabling users to collaborate with AI on specific projects. Users will find a new Canvas button adjacent to the Deep Research option within the Gemini interface. By engaging this feature and uploading a document or lines of code, users can access a sandbox environment where AI drafts an initial response based on their input. Users can then modify and refine this output with the assistance of the chatbot.
At present, Canvas is limited to document-related tasks and coding. Users must upload a file and provide a prompt while the Canvas feature is on. For instance, they might input a request like, “Create a speech based on these classroom notes,” prompting the AI to generate a draft within the sandbox interface. Users can then manually edit the content or highlight sections to request alterations in tone or regenerate specific text based on their feedback.
In terms of coding, users can provide prompts for the AI to generate code. With Canvas, they can oversee previews of the code and other web application prototypes, gaining a visual understanding of their requests. Currently, this functionality applies exclusively to HTML and React code. After viewing the preview, users are empowered to request adjustments to input fields or call-to-action buttons and receive updated visual feedback. Notably, this feature bears similarities to OpenAI’s Canvas, but ChatGPT offers it solely on the web.
By selecting the FAB, Gemini will generate a podcast-style audio discussion hosted by two AI voices—a male and a female. These hosts will dive into the topic, draw connections, and engage in a lively dialogue, providing distinct perspectives. It is important to note that the generation of an AI Overview may require a few minutes.
According to reports from Gadgets 360 staff, the newly introduced features have been observed on the web interface of Gemini, although they have yet to appear on the mobile applications. As Google rolls these features out globally, users may experience a slight delay before they are accessible to everyone.
