{"id":58974,"date":"2025-10-03T15:40:25","date_gmt":"2025-10-03T13:40:25","guid":{"rendered":"https:\/\/www.apfelpatient.de\/?p=58974"},"modified":"2025-10-06T15:47:00","modified_gmt":"2025-10-06T13:47:00","slug":"ios-26-visual-intelligence-now-also-for-screen-content","status":"publish","type":"post","link":"https:\/\/www.apfelpatient.de\/en\/tipps-tricks\/ios-26-visuelle-intelligenz-jetzt-auch-fuer-bildschirminhalte","title":{"rendered":"iOS 26: Visual intelligence now also for screen content"},"content":{"rendered":"

With iOS 26, Apple is expanding its visual intelligence, making it more versatile than ever before. Previously limited primarily to the camera, the feature now also works directly with screen content on the iPhone. This makes information more quickly accessible and everyday tasks significantly easier.<\/strong><\/p>\n\n\n\n

Visual Intelligence was first introduced in iOS 18.2 as a camera tool. It was designed to help you better understand things around you\u2014whether describing a landmark, translating text, or recognizing plants and animals. With iOS 26, this approach is expanded. From now on, the analysis is no longer limited to the physical environment but also works with everything on the display. The new feature is part of Apple Intelligence and is available exclusively on newer models: the iPhone 15 Pro, the iPhone 16 series, and the iPhone 17 series, including the iPhone Air.<\/p>\n\n\n\n

How visual intelligence works in iOS 26<\/h4>\n\n\n\n

To use Visual Intelligence with screen content, all you need is a screenshot. This is created as usual by simultaneously pressing the side button and the volume up button. As soon as the screenshot interface appears, iOS 26 automatically displays the available Visual Intelligence options. The options available depend on the captured content.<\/p>\n\n\n\n

Search for similar items<\/h4>\n\n\n\n

By tapping on \u201cSearch\u201d you can find related products, matching images or additional information on the Internet.<\/p>\n\n\n\n

Mark sub-areas<\/h4>\n\n\n\n

If only a specific part of the screenshot is relevant, you can mark it with your finger. The search will then focus exclusively on the selected object.<\/p>\n\n\n\n

Ask questions about the screen content<\/h4>\n\n\n\n

The "Questions" option opens a text field where you can enter questions about the captured content. This can be used to explain terms, describe objects, or retrieve additional information.<\/p>\n\n\n\n

Add events directly to the calendar<\/h4>\n\n\n\n

If the screenshot contains a date or information about an event, the option to enter it directly into the calendar will automatically appear.<\/p>\n\n\n\n

\"\"
Image: Apfelpatient<\/figcaption><\/figure>\n\n\n\n

Open websites<\/h4>\n\n\n\n

If a link appears on the screen, iOS 26 recognizes it and offers to open it immediately in the browser.<\/p>\n\n\n\n

Summarize texts<\/h4>\n\n\n\n

For longer texts, you can use the "Summarize" function. It automatically creates a compact overview of the content.<\/p>\n\n\n\n

Have texts read aloud<\/h4>\n\n\n\n

Another advantage is the read-aloud function. All visible text can be read directly via voice output.<\/p>\n\n\n\n

Identify plants and animals<\/h4>\n\n\n\n

If the screenshot shows an animal or plant, iOS 26 provides the appropriate name and additional details.<\/p>\n\n\n\n

Screenshot management<\/h4>\n\n\n\n

After using the visual intelligence, the screenshot can either be saved in the photo library by tapping the check mark or deleted using the x.<\/p>\n\n\n\n

Practical use in everyday life<\/h4>\n\n\n\n

The visual intelligence in iOS 26 simplifies many small everyday tasks. Information can be accessed directly, appointments can be organized more quickly, and texts can be processed directly. The combination of search functions, AI-supported analysis, and accessibility is particularly useful, as content can be not only summarized but also read aloud.<\/p>\n\n\n\n

Availability<\/h4>\n\n\n\n

The enhanced features are available exclusively on current iPhones, including the iPhone 15 Pro, the entire iPhone 16 series, and the iPhone 17 series with the iPhone Air.<\/p>\n\n\n\n

iOS 26 makes Visual Intelligence more versatile and faster<\/h3>\n\n\n\n

With iOS 26, visual intelligence becomes significantly more powerful. It no longer works solely via the camera, but also directly with the contents of the iPhone screen. This allows you to research information, process text, open links, and save events without requiring additional steps or apps. iOS 26 makes the iPhone faster, more efficient, and even more suited to everyday use. The best products for you: Our Amazon Storefront<\/a> offers a wide selection of accessories, including those for HomeKit. (Image: Apple)<\/p>\n\n\n\n