On Monday, Apple announced the launch of the visionOS 2.4 update for its Apple Vision Pro mixed reality headset. This significant upgrade introduces a series of Apple Intelligence features designed to enhance user experience. Among the new capabilities, users will find Writing Tools for summarizing and editing text, Image Playground for creatively transforming photos, and a natural language search feature in the Photos app to quickly locate cherished memories. The update also introduces Spatial Gallery, which curates selections by Apple.
Key Features of visionOS 2.4 Update for the Apple Vision Pro
In a recent newsroom post, Apple outlined the new features included in the visionOS 2.4 update, which are currently accessible on devices set to English (US). The Writing Tools feature utilizes AI to assist with composing, rewriting, and proofreading text, offering functions for spelling and grammar checks. Users can summarize content, create lists and tables, or highlight key points within their documents.
Another addition is Image Playground, a standalone application that employs generative AI to create images based on user-generated prompts. Users can select a reference person from their Photos app for creative inspiration and can choose various artistic styles. In a related feature, Genmoji provides a way to generate emojis that users can integrate into their messages as stickers or via Tapback.
With the introduction of Apple Intelligence, users can now conduct natural language searches for specific photos stored in the Photos app. The update also includes the Create a Memory Movie feature, which allows AI to develop a narrative and organize photos into a storyline with thematic chapters based on user input. Additionally, Smart Reply has been implemented in both Mail and Messages, facilitating rapid responses.
Beyond these features, visionOS 2.4 enhances the user experience with support for Priority Messages in Mail, Mail Summaries, Image Wand in Notes, Priority Notifications in the Notification Centre, and Notification Summaries.
Apple assures users that photos and videos utilized for movie creation and other tasks remain private and are not shared with the company. Furthermore, Apple Intelligence prioritizes user privacy by employing on-device processing whenever feasible. For tasks requiring larger AI models, Apple utilizes Private Cloud Compute, ensuring that users’ data is never stored or publicly shared with the company.