Apple Intelligence Comes to Vision Pro
Apple Intelligence is set to arrive on the Vision Pro as part of an upcoming operating system update, with the company confirming on Friday that its generative AI platform will be included in visionOS 2.4. A beta version of the software is currently available for developers, with a public release slated for April.
Phased Rollout
Similar to the iPhone and Mac, the Vision Pro will receive Apple Intelligence updates in phases. The initial rollout includes several familiar features, primarily focused on generating text and images. The addition of features like Rewrite, Proofread, and Summarize is seen as crucial for on-device workflow.
Spatial Computing
It’s worth noting that Apple has positioned the Vision Pro as a "spatial computing" device from the outset. While it offers various video, gaming, and entertainment features, the company aims to differentiate it from its extended reality predecessors by showcasing it as an extension of desktop computing. As previously described, this concept can be thought of as "The infinite desktop."
Current Limitations
Currently, composing text on the headset can be a mixed experience. The default typing method, which requires the wearer to look at a letter and pinch two fingers together to select, can be cumbersome for writing more than a few words. Voice dictation helps alleviate this issue, and Apple’s recent AI-powered Siri update bodes well for the smart assistant’s future on Vision Pro.
Streamlining Workflows
Apple is betting on the combination of voice dictation and generative AI writing tools to provide a smoother experience, encouraging more Vision Pro users to incorporate the headset into their existing workflows. Features like Message Summaries and email Smart Reply aim to streamline interactions with different apps without interrupting the user’s task.
Image Playground
Image Playground is another significant component, bringing image generation to the wearable display as part of the visionOS 2.4 update. This feature is integrated into the visionOS Photos app, allowing users to create images using verbal prompts.
No New Features Exclusive to Vision Pro
It’s important to note that all the aforementioned features have already been introduced on iOS, macOS, and iPadOS. There are no new Apple Intelligence features specific to Vision Pro arriving in this update.
Vision Pro iPhone App
In conjunction with visionOS 2.4, Apple has also launched a Vision Pro iPhone app, which is now available in beta with iOS 18.4. The app serves multiple purposes, including browsing visionOS content, such as TV shows and movies, which can then be transferred to the headset. This feature appears to be a response to the limitations of wearing the headset, both in terms of comfort and battery life.
Managing Guest Accounts
When an iPhone is unlocked and in proximity to the headset, the new app can also be used to manage guest accounts. The Vision Pro will prompt its owner when someone attempts to sign in as a guest, and a streaming image of the guest’s in-headset view is accessible through the app.
Source Link