Skip to main content

Here is a rewritten version of the content without changing its meaning, retaining the original length, and keeping proper headings and titles:

Were you waiting for the ability to create AI-generated emojis to text to friends on Vision Pro? On Friday, Apple announced plans to introduce the initial Apple Intelligence features on its $3,500 Vision Pro. Although these features may be familiar to those who have used a Mac in the past six months, they could indicate that Apple’s MR headset will also receive the cross-app AI-powered Siri, whenever that becomes a reality.

The visionOS 2.4 beta, which is expected to be available to users before the full April launch, incorporates AI features that function similarly to their Mac counterparts, with UI modifications to facilitate typing prompts without a mouse and keyboard. Like Mac or iOS, users can access the ChatGPT functions. Additionally, users can leverage AI writing tools to compose or proofread text on Vision Pro, similar to iOS or macOS. The question remains, however, why one would use Apple’s headset to type an email.

Apple Visionos 2 4 Apple Intelligence Writing Tools
Image: Apple

The Vision Pro update will support Genmoji for the Messages app and the Image Playground for generating cartoon-styled versions of friends and pets, despite some results falling on the wrong side of the uncanny valley. Furthermore, the Photos app features a new “Create a Memory” function, allowing users to input a prompt using the in-headset keyboard or voice, and then AI will generate a custom slideshow from relevant videos and photos. For instance, Apple’s prompt for “day in the skate park” compiled a loose assortment of clips with simple transitions.

Apple Visionos 2 4 Guest User
GIF: Apple

VisionOS 2.4 is not as significant an update as the transition to visionOS 2, although Apple is attempting to establish its headset’s niche within the broader ecosystem. This includes a new Vision Pro app for iOS, enabling users to perform remote actions on their AVP, such as creating a watch list or downloading apps. The app will also share the Vision Pro’s serial number when needed. Anyone with a connected Vision Pro will see the new app appear on their iPhones upon upgrading to iOS 18.4. The update introduces a new app on Vision Pro called Spatial Gallery, which aggregates all spatial photos and videos taken with the headset or compatible devices like the iPhone 15 Pro and iPhone 16 models.

Among the new features, the most useful might be the enhanced guest user functionality. The headset owner no longer needs to load in first before handing it over to a friend, who can now be prompted to set up a guest account on their phone or iPad. The owner can control which apps the guest can access and even monitor their activity by streaming it to their iPhone or iPad via AirPlay. This experience is similar to Apple’s in-store AVP demo, albeit with less direct control over the headset.

AI on AVP was inevitable, although its arrival took longer than expected. The Vision Pro utilizes Apple’s M2 chip, and the company has stated that any Mac with M-series silicon should be capable of supporting Apple Intelligence. Nevertheless, the new AI features may not significantly impact users who already own Vision Pro. The device is most beneficial for creating a massive ultra-wide Mac screen or watching passive content on a pseudo-large display with AVP’s dual 4K OLED lenses.

There is a possibility that the upcoming supercharged Siri, expected to arrive in the next few months, may offer enhanced capabilities and the ability to perform actions on Vision Pro apps on behalf of users. The planned “Visual Intelligence” features, which will enable users to ask questions based on what the external cameras see, could provide new ways to utilize the device if first- or third-party apps take advantage of it. However, one feature that is still desired is iPhone to AVP mirroring, similar to what is possible on Mac with macOS Sequoia.


Source Link