This might hinted at Vision Pro’s killer app.

[cnnyy20p]

https://www.macrumors.com/2023/06/02/apple-seeking-generative-ai-engineers-for-ar-vr/

The ability to manipulate virtual space by just talking to Siri: Create mini apps for specific needs without any programming, play custom mini games with other AVP users. To make, orchestrate, or virtualize anything in 3D physical space. Basically a way to communicate and use computer at its most intuitive form. A future that Apple might imagine. With the current advanced of machine learning (LLM, generative AI, and such) it is entirely possible with enough time.

 

[Kierkegaarden]

Vision Pro does seem like the ultimate AI device — mics to accurately pick up your voice, a screen right in front of your eyes, speakers by your ears, and cameras to pick up eye movement and hand gestures.

Imagine using a hand gesture or making a certain sound to bring up an assistant, and then just saying what you want it to do for you — but then continuing to refine the thing and seeing it all in real time, as if you were directing someone right next to you. Complex things like 3D objects, or writing code based on what you want an app to do.

So with the Vision Pro, I don’t think we’ll even need to say “Siri” to do these things, and this will feel more natural and seamless. Not sure if that level of compute is possible right now, but when they get it, all other headsets will look like toys.