Apple could improve Vision Pro for travel via software Apfelpatient

Apple is working on a new software solution for the Apple Vision Pro to prevent motion sickness when using the headset in vehicles. The solution is based on a recently published patent describing how virtual content can be synchronized with real-life movements. The goal is to make wearing the headset more comfortable in cars, trains, or airplanes.

Many users find the Apple Vision Pro impractical or uncomfortable when on the go. In addition to the space constraints – for example, on airplanes – the main issue is the motion sickness that can occur when wearing the headset. Apple doesn't want to ignore this problem. Instead of preventing the use of the headset in vehicles, the company is developing new approaches to improve the experience – technological, software-based, and, if possible, automated.

Why the Apple Vision Pro can cause nausea on the go

The problem arises when what you see doesn't match what your sense of balance detects. For example, you're sitting on a bus and the headset shows you a virtual environment that doesn't move with the vehicle. This leads to a kind of brain overload – similar to reading on your iPhone while driving. Apple describes this phenomenon in connection with the Vision Pro as a form of exaggerated motion sickness. This is due to the headset's sensors, which detect movement but don't always accurately match reality – especially with fast or erratic vehicle movements.

Apple's first solution: Vehicle Motion Cues on the iPhone

Apple already introduced its first software solution with iOS 18. The so-called Vehicle Motion Cues display small dots on the screen that move in line with the vehicle's movement. This signals to the eye that the device is moving – which helps reduce the discrepancy between visual impression and physical sensation. These dots use the iPhone's accelerometer and are barely noticeable when reading or watching content. The trick: The dots' movements are subtle, yet sufficiently recognizable to provide the brain with the necessary information. According to the patent, this principle will also be applied to the Apple Vision Pro.

The patent: Immersive Virtual Display

The patent filed by Apple is titled "Immersive virtual display." It describes a system in which real vehicle movements are integrated into the virtual experience. The goal is to create the most realistic feeling possible and thus prevent motion sickness. The patent specifically addresses the need to align virtual environments with the actual movements of the vehicle. Acceleration, cornering, and other vehicle movements are to be transmitted to the headset—visually or via other sensory impressions such as sound or airflow.

An example from the patent: The user could perceive wind noise, the air conditioning, ambient noise, and even acceleration through the seat. All of this is intended to help create a harmonious experience and prevent nausea.

Nausea response: Automatic or manual control

According to the patent, the headset could even detect whether the user is feeling nauseous – for example, based on eye movements, head posture, or other biometric data. If signs of motion sickness are detected, the Vision Pro should react automatically. For example, it could slow down movements or reduce visual effects. Additionally, you should be able to manually adjust certain settings. If you know you're prone to nausea, you could set the headset to a low motion level right from the start – without waiting for an automatic response.

Origin in Apple Car development

Some of the research dates back to the time when Apple was working on its own vehicle. The now-discontinued Apple Car was intended to work closely with devices like the Vision Pro. Apple even envisioned users sitting in fully controlled vehicle cabins, with targeted sensory impressions via the seat, speakers, and surroundings. The idea was to enable a fully synchronized VR experience—including realistic body feedback. The patent still contains references to this original idea. It mentions connections to MacBook Pros, control of vehicle functions via the headset, and the representation of virtual passengers, among other things. The project has been discontinued, but the technologies are now being further developed for other devices.

Extended use: Not just for sensitive users

The new software could be helpful not only for people who suffer from motion sickness. Users without known problems should also benefit. For example, the headset could display a blend of real-world surroundings and virtual content. You would then continue to see your surroundings through the headset – supplemented by additional information, virtual objects, or tags. This merges augmented reality with virtual reality. Apple remains true to its philosophy and doesn't focus on specific applications, but rather describes technical possibilities that can be flexibly deployed later.

Inventor and development

The patent is attributed to, among others, Mark B. Rober. Rober had already spoken publicly in 2022 about his work on a virtual display specifically designed for the Apple Car to reduce motion sickness. The new patent appears to continue this work—but now with a focus on headsets like the Apple Vision Pro.

Vision Pro: Apple makes virtual reality mobile and suitable for everyday use

Apple is actively researching solutions to make it possible to wear headsets like the Apple Vision Pro while driving – without suffering from nausea. The software concept presented is based on real motion signals that are integrated into the virtual display. This could not only increase comfort but also open up entirely new usage scenarios – on the go, in everyday life, or on longer journeys. The technology originally originated in the development of the Apple Car, but now lives on in the headset. Whether and when these features will be implemented in future versions of the Apple Vision Pro is still open – but the direction is clear: Apple wants to make virtual reality more mobile and more compatible. The best products for you: Our Amazon Storefront offers a wide selection of accessories, including those for HomeKit. (Image: Shutterstock / Tada Images)