With iOS 26, Apple's Visual Intelligence is getting a major update. The feature, first introduced in iOS 18, can now do more than just work with the camera. A key new feature is its integration into the screenshot interface. This allows you to directly analyze the content you're currently viewing on your screen. Object recognition has also been enhanced. Apple is now on par with Android in terms of visual search—and in some areas, even goes further.
Visual Intelligence is part of Apple Intelligence and is used to analyze visual content. In iOS 18, the feature was limited to the camera. This meant that you had to capture an object or image with the camera for Visual Intelligence to recognize it and provide you with information about it. In iOS 26, the feature can now also analyze screenshots. This makes it significantly more flexible in everyday use. Also new: support for new object types such as books, works of art, and landmarks. There are also new options for targeted searches directly in the image.
Visual Intelligence now also recognizes your screen
One of the biggest innovations in iOS 26 is screen awareness. Visual Intelligence now works not only with the camera image, but also with what's currently displayed on your screen. This means you can take a screenshot and have Visual Intelligence analyze it directly. To do this, take a screenshot as usual (press the volume up button and side button simultaneously) and then tap the preview window. If you're in highlight mode, exit it using the small pencil icon at the top. The Visual Intelligence options will then appear.
“Mark to search” works like on Android
With the new "Mark to Search" function, you can hover your finger over an object in a screenshot to search for it specifically. This could be a piece of clothing, a piece of furniture, or a product, for example. The search is done via Google by default, but Apple has announced that apps like Etsy will also be supported if they are compatible. This means you can mark a specific object on a screenshot, and Visual Intelligence will then search for it specifically – similar to what Android users have long known with Google Lens. In addition, iOS 26 often recognizes objects automatically. You can then tap directly on the recognized object without having to mark it separately.
Ask questions or search directly
If you don't want to specifically select an object, you can simply tap the "Ask" button. Your screenshot will then be analyzed and sent to ChatGPT. You'll then receive a text-based answer to what's in the image. The "Search" button, on the other hand, performs a classic Google search based on the content detected in the screenshot. Another useful feature is that Visual Intelligence can recognize dates and appointments from the screenshot. You can then import these directly into your calendar.
New object recognition: art, books, sculptures and more
Visual Intelligence can now also recognize a number of new object types without using external services. These include:
- works of art
- books
- Sightseeing features
- Natural monuments
- Sculptures
In addition to the already supported plants and animals, you can now also have cultural and geographical objects automatically identified. This analysis takes place directly on the device. You don't need an internet connection. When an object is detected, a glowing icon appears on the screen. Tapping it will then display further information. This works both in the camera's live view and with saved photos.
Compatibility: Only on newer iPhones
Not every iPhone supports the new features. Visual Intelligence in this form only runs on devices with Apple Intelligence. These currently include:
- iPhone 15 Pro
- iPhone 16 (all models)
You can access Visual Intelligence on these devices in several ways:
- By long pressing the camera control
- Using the new action button (on supported models)
- Or via a switch in the control center
iOS 26 Availability: From September for all
iOS 26 is currently still in beta. The public release is planned for September 2025. The update will then be available for all compatible devices. Anyone with a supported iPhone will soon be able to try out the new features for themselves. The best products for you: Our Amazon Storefront offers a wide selection of accessories, including those for HomeKit. (Image: Apple)
- iOS 26: These new iPhone features are coming this fall
- CarPlay on iOS 26: All new features in detail
- iOS 26: These new features await you in Apple Notes
- iOS 26 explained: Why iOS 18 will not be followed by iOS 19
- iOS 26: These features are only available on new iPhones
- iOS 26: Apple Maps becomes more personal and intelligent
- iOS 26: When will the new update for the iPhone be released?
- iPadOS 26 is ready for the upcoming 18.8-inch iPad Fold
