Apple Glasses: Control via hand gestures Apfelpatient

New details suggest that Apple's planned smart glasses will come with two cameras – one of which will be used exclusively for gesture recognition for Siri.

Apple's planned attack on the Ray-Ban Meta smart glasses is slowly taking shape. An insider source from MacRumors has provided exciting new details about Cupertino's eyewear project – and one of them will be particularly interesting for Vision Pro users. Apple apparently plans to extend the concept of hand gestures to the smart glasses.

Two cameras with different tasks

According to MacRumors, the core of the Apple Glasses will be two separate cameras, each serving a clearly defined function. This division of labor is cleverly conceived and fits with Apple's approach of using hardware as efficiently as possible.

The first camera is a high-resolution main camera. It's designed for classic use cases: taking photos and videos that can be shared directly or used just like iPhone images. This is precisely the function that makes Ray-Ban Meta Smart Glasses stand out today – and Apple clearly wants to catch up.

The second camera is a low-resolution wide-angle lens. It has a completely different purpose: to recognize hand gestures and transmit visual information to Siri. Apple is thus using the same principle that already works with Vision Pro – albeit in a significantly scaled-down form.

Gesture control as a common thread in Apple's strategy

What's interesting is how the gesture concept permeates Apple's entire wearable strategy. With Vision Pro, Apple uses hand gestures as the primary input method. Furthermore, reports have been circulating for some time that the next generation of AirPods could also feature low-resolution cameras and gesture support.

The logic behind this is understandable. If a device doesn't have a display, or if the display isn't directly touchable, users need an intuitive input method. Voice alone is often insufficient – some actions can be performed faster and more naturally with a gesture. With glasses, there's the added factor that any touch of the frame is unpleasant and disrupts the wearing comfort.

Apple appears to be pursuing a consistent concept, making gesture control the standard input method for all new wearable categories. Anyone who has experienced it with AirPods would immediately feel at home when switching to glasses.

First generation comes without a display

An important point to clarify right away: The first generation of Apple Glass will not have a display. Apple is deliberately foregoing integrated screens, LiDAR sensors, or 3D cameras. The reason is not a lack of technology – but rather energy consumption. Such components would drastically reduce battery life and make the device heavier.

Apple faces a key dilemma here: the glasses must be light and slim, otherwise no one will wear them willingly. At the same time, they need enough battery life to last the day. This forces the design team to significantly reduce the range of functions compared to what would be technically possible.

Augmented reality features are expected to follow in later generations – when battery technology and components are small and efficient enough. The first generation of Apple Glasses is therefore clearly positioned as AI and voice glasses, not AR glasses.

What the glasses should specifically be able to do

Despite the reduced functionality, Apple is planning some exciting features. The glasses will be able to take photos, shoot videos, and make phone calls. The highlight, however, is Siri – specifically, the revamped version that Apple intends to introduce with iOS 27.

Users will then be able to ask Siri directly through the glasses what is in front of them. This feature is reminiscent of Visual Intelligence on the iPhone, which Apple plans to integrate into the new Siri mode of the camera app in iOS 27. The glasses would thus be a logical extension of this approach – except that users wouldn't even have to take their iPhone out of their pocket.

Overall, the range of functions is largely based on what the Ray-Ban Meta Smart Glasses already offer. Apple is therefore not delivering a technological revolution, but rather relying on proven features with the typical advantages of the Apple ecosystem.

Four styles, acetate material, lots of design work

Back in mid-April, Mark Gurman reported in the "Power On" newsletter that Apple is currently testing at least four different eyewear designs. The material of choice: acetate. This is a lightweight, plant-based material that appears more flexible and premium than conventional plastic.

This variety of designs underscores Apple's intention to position its smart glasses not as a tech gadget, but as a fashion accessory. The strategy makes sense: people wear glasses on their faces every day – appearance is more important here than with any other Apple product.

Anyone wanting a comprehensive overview of all previous rumors and details about Apple's smart glasses will find a bundled summary in our overview of all Apple Glasses rumors.

The Vision Pro shadow over the project

The timing of these new details is remarkable. Just recently, indications were mounting that Apple might have put the Vision Pro development on hold. The pivot away from expensive VR headsets and towards lighter, more practical wearables is clearly evident here as well.

Apple must learn from the lessons of the Vision Pro. Too heavy, too expensive, too few compelling use cases – these three weaknesses must not be repeated with the smart glasses. The limitation to a reduced feature set, the omission of a display and LiDAR, and the focus on the glasses design are clear indications of this strategic lesson.

The question remains whether Apple can manage the balancing act of building glasses that offer enough to convince buyers, but not so much that they fail at the same hurdles as the Vision Pro.

When are the Apple Glasses expected?

Recent reports suggest that Apple could officially unveil the smart glasses this year – with a market launch in 2027. However, it is also possible that Apple will only announce the device in 2027 and then release it shortly thereafter.

The next few months should bring some exciting insights. With John Ternus taking over as Apple CEO in September, the glasses strategy is entering a phase of strategic realignment anyway. Exactly how Apple positions the glasses project will likely be one of the first major hardware decisions made by the new Apple leadership.

Apple's wearable strategy shows a clear line

The details from the report fit seamlessly into the picture Apple is currently painting: less high-end spectacle, more everyday devices, and consistent user interface concepts across product lines. Apple Glasses are not a successor to Vision Pro, but a new beginning with clearly reduced ambitions. Whether this reduction will ultimately be the key to success remains to be seen. One thing is certain, however: Apple is fundamentally rethinking wearable computing. (Image: Shutterstock / Ground Picture)