{"id":56802,"date":"2025-07-16T01:53:52","date_gmt":"2025-07-15T23:53:52","guid":{"rendered":"https:\/\/www.apfelpatient.de\/?p=56802"},"modified":"2025-07-16T01:53:56","modified_gmt":"2025-07-15T23:53:56","slug":"apple-introduces-new-ai-iluvui-understands-app-interfaces","status":"publish","type":"post","link":"https:\/\/www.apfelpatient.de\/en\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen","title":{"rendered":"Apple introduces new AI: ILuvUI understands app interfaces"},"content":{"rendered":"<p class=\"has-drop-cap\"><strong>Apple has been researching the interface between humans and machines for years. The user-friendliness of its products is at the core of its brand. A new research report shows how the company is now using artificial intelligence to address a long-standing problem in human-computer interaction: understanding app interfaces. In collaboration with Aalto University in Finland, a new AI model was presented that can not only recognize app user interfaces but also understand their content. The model is called ILuvUI.<\/strong><\/p>\n\n\n\n<p class=\"translation-block\">ILuvUI is a vision language model (VLM) that simultaneously processes visual information from screenshots and natural language. Its development <a href=\"https:\/\/arxiv.org\/abs\/2310.04869\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"external\">is based<\/a> on the open-source LLaVA model, but has been further developed specifically for graphical user interfaces. The goal is to create an artificial intelligence that understands complex app interfaces the same way humans do. This means that the AI should not only recognize what&#039;s on the screen, but also what certain elements mean and how to interact with them.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-ein-modell-fur-app-interfaces-nicht-fur-strassenhunde\">A model for app interfaces, not for street dogs<\/h4>\n\n\n\n<p>Many existing vision language models are trained to interpret natural images such as animals, buildings, or traffic signs. However, app user interfaces pose entirely different challenges. A screen can simultaneously contain multiple layers of information\u2014lists, buttons, checkboxes, text input fields\u2014the meaning of which often depends on the context. Conventional models deliver only limited, usable results in such cases because they are not optimized for this type of content. ILuvUI addresses this issue. It has been specifically trained to analyze structured user interfaces. It combines the visual structure of the interface with additional text input in natural language. The result is a significantly more precise understanding of app interfaces.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-so-wurde-iluvui-trainiert\">How ILuvUI was trained<\/h4>\n\n\n\n<p>The research team adapted LLaVA for this purpose. First, they created synthetic text-image pairs\u2014i.e., screenshots of apps combined with appropriate description text. They also used so-called &quot;golden examples,&quot; which contain particularly precisely formulated interactions. The final dataset contained various types of information:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Question-and-answer dialogues about app usage<\/li>\n\n\n\n<li>Full descriptions of the screen content<\/li>\n\n\n\n<li>Predictions of what action a user would perform<\/li>\n\n\n\n<li>Step-by-step instructions for more complex operations (e.g., starting a podcast or changing display settings)<\/li>\n<\/ul>\n\n\n\n<p>After training with this data, ILuvUI was able to outperform the original LLaVA model in machine benchmarks and in tests with human subjects. The AI demonstrated a better understanding of app logic, higher accuracy in predicting user goals, and clearer explanations in dialog format.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-kein-bereich-von-interesse-notwendig\">No \u201carea of interest\u201d required<\/h4>\n\n\n\n<p>A notable difference from previous models: ILuvUI eliminates the need for manual selection of screen areas. The model automatically analyzes the entire context of a screenshot and simultaneously processes text input\u2014for example, a question about app usage. This makes the system versatile. ILuvUI can, for example, explain how to use certain app functions or which steps are necessary to solve a problem.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-praktische-anwendungsmoglichkeiten\">Practical applications<\/h4>\n\n\n\n<p>According to Apple, ILuvUI is particularly interesting for two areas of application: accessibility and automated UI testing. People with visual or mobility impairments could use this type of AI to navigate complex app layouts more easily. The AI automatically recognizes the correct interaction steps and can provide guidance via voice or assistance systems. For developers, ILuvUI is a tool for automated testing. The AI can simulate operating sequences, identify errors, and evaluate the logical structure of user interfaces. The model could also be used for training or support systems \u2013 anywhere a technical system needs to explain how an app works.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-ausblick-auf-kommende-entwicklungen\">Outlook on future developments<\/h4>\n\n\n\n<p>ILuvUI isn&#039;t yet at the end of its development. The current version is based on open components. In the future, the researchers plan to integrate larger image encoders, increase screenshot resolution, and improve output formats. The goal is for ILuvUI to be able to work directly with standard formats like JSON, which are used in modern UI frameworks. Combined with other Apple research projects\u2014for example, predicting in-app actions\u2014a clear direction emerges: systems that can not only see and describe, but also think and act.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-iluvui-bringt-struktur-in-komplexe-app-oberflachen\">ILuvUI brings structure to complex app interfaces<\/h3>\n\n\n\n<p>With ILuvUI, Apple has developed an AI model that can visually and linguistically analyze app user interfaces \u2013 in detail, precisely, and with a focus on application. The system not only recognizes the individual elements of an app, but also understands their meaning and possible user paths. This significantly improves the interaction between humans and technology. ILuvUI opens up new possibilities, especially for accessible user concepts and automated testing procedures. The project demonstrates how AI could become a central component of app usage in the future. (Image: Shutterstock \/ Rabbi Creative)<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.apfelpatient.de\/en\/news\/emmy-awards-2025-severance-is-the-big-favorite\">Emmy Awards 2025: Severance is the big favorite<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.apfelpatient.de\/en\/news\/apple-files-patent-for-new-mouse-button-in-keyboard\">Apple files patent for new mouse button in keyboard<\/a><\/li>\n<\/ul>\n\n\n\n<h6 class=\"wp-block-heading translation-block\" id=\"h-kennt-ihr-schon-unsere-amazon-storefront-dort-findet-ihr-eine-handverlesene-auswahl-von-diversen-produkten-f-r-euer-iphone-und-co-viel-spa-beim-st-bern\"><em>Have you already visited our Amazon Storefront? There you&#039;ll find a hand-picked selection of various products for your iPhone and other devices \u2013 <span class=\"has-inline-color has-vivid-red-color\"><a href=\"https:\/\/www.amazon.de\/shop\/apfelpatientofficial\" class=\"ek-link\" data-wpel-link=\"exclude\" rel=\"follow noopener\" target=\"_self\"><span style=\"text-decoration: underline\" class=\"ek-underline\">enjoy browsing<\/span><\/a> !<\/span><\/em><\/h6>\n\n\n\n<h6 class=\"wp-block-heading translation-block\" id=\"h-der-beitrag-enthalt-partnerlinks\">This post contains <a data-type=\"URL\" data-id=\"https:\/\/www.apfelpatient.de\/partnerprogramm\" href=\"https:\/\/www.apfelpatient.de\/en\/partner-program\" data-wpel-link=\"internal\" target=\"_self\">affiliate links<\/a>.<\/h6>","protected":false},"excerpt":{"rendered":"<p>With ILuvUI, Apple is introducing an AI that understands and analyzes app interfaces and is designed to enable accessible and automated use.<\/p>","protected":false},"author":2,"featured_media":56801,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jnews-multi-image_gallery":[],"jnews_single_post":{"format":"standard","override":[{"template":"2","parallax":"1","fullscreen":"1","layout":"right-sidebar","sidebar":"default-sidebar","second_sidebar":"default-sidebar","sticky_sidebar":"1","share_position":"top","share_float_style":"share-monocrhome","show_featured":"1","show_post_meta":"1","show_post_author":"1","show_post_author_image":"1","show_post_date":"1","post_date_format":"default","post_date_format_custom":"Y\/m\/d","show_post_reading_time":"0","post_reading_time_wpm":"300","post_calculate_word_method":"str_word_count","show_zoom_button":"0","zoom_button_out_step":"2","zoom_button_in_step":"3","show_post_tag":"1","show_prev_next_post":"1","show_popup_post":"1","number_popup_post":"1","show_author_box":"0","show_post_related":"0","show_inline_post_related":"0"}],"image_override":[{"single_post_thumbnail_size":"crop-500","single_post_gallery_size":"crop-500"}],"trending_post_position":"meta","trending_post_label":"Trending","sponsored_post_label":"Sponsored by","disable_ad":"0"},"jnews_primary_category":{"id":"9"},"footnotes":""},"categories":[9],"tags":[13],"class_list":["post-56802","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","tag-techpatient"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.4 (Yoast SEO v27.4) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Apple stellt neue KI vor: ILuvUI versteht App-Oberfl\u00e4chen Apfelpatient<\/title>\n<meta name=\"description\" content=\"Apple stellt mit ILuvUI eine KI vor, die App-Oberfl\u00e4chen versteht, analysiert &amp; barrierefreie sowie automatisierte Nutzung erm\u00f6glichen soll.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.apfelpatient.de\/en\/news\/apple-introduces-new-ai-iluvui-understands-app-interfaces\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Apple stellt neue KI vor: ILuvUI versteht App-Oberfl\u00e4chen\" \/>\n<meta property=\"og:description\" content=\"Apple stellt mit ILuvUI eine KI vor, die App-Oberfl\u00e4chen versteht, analysiert &amp; barrierefreie sowie automatisierte Nutzung erm\u00f6glichen soll.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.apfelpatient.de\/en\/news\/apple-introduces-new-ai-iluvui-understands-app-interfaces\" \/>\n<meta property=\"og:site_name\" content=\"Apfelpatient\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/apfelpatientOfficial\" \/>\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/apfelpatientOfficial\" \/>\n<meta property=\"article:published_time\" content=\"2025-07-15T23:53:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-07-15T23:53:56+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.apfelpatient.de\/wp-content\/uploads\/2025\/07\/shutterstock_2501137373.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1600\" \/>\n\t<meta property=\"og:image:height\" content=\"977\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Milan\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:description\" content=\"Apple stellt mit ILuvUI eine KI vor, die App-Oberfl\u00e4chen versteht, analysiert &amp; barrierefreie sowie automatisierte Nutzung erm\u00f6glichen soll.\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Milan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"NewsArticle\",\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/news\\\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/news\\\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen\"},\"author\":{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/en\\\/#organization\",\"name\":\"Apfelpatient\",\"url\":\"https:\\\/\\\/www.apfelpatient.de\\\/en\\\/\"},\"headline\":\"Apple stellt neue KI vor: ILuvUI versteht App-Oberfl\u00e4chen\",\"datePublished\":\"2025-07-15T23:53:52+00:00\",\"dateModified\":\"2025-07-15T23:53:56+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/news\\\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen\"},\"wordCount\":779,\"publisher\":{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/en\\\/#organization\",\"name\":\"Apfelpatient\",\"url\":\"https:\\\/\\\/www.apfelpatient.de\\\/en\\\/\"},\"image\":{\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/news\\\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.apfelpatient.de\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/shutterstock_2501137373.jpg\",\"keywords\":[\"TechPatient\"],\"articleSection\":\"News\",\"inLanguage\":\"en-US\",\"copyrightYear\":\"2025\",\"copyrightHolder\":{\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/en\\\/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/news\\\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen\",\"url\":\"https:\\\/\\\/www.apfelpatient.de\\\/news\\\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen\",\"name\":\"Apple stellt neue KI vor: ILuvUI versteht App-Oberfl\u00e4chen Apfelpatient\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/news\\\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/news\\\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.apfelpatient.de\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/shutterstock_2501137373.jpg\",\"datePublished\":\"2025-07-15T23:53:52+00:00\",\"dateModified\":\"2025-07-15T23:53:56+00:00\",\"description\":\"Apple stellt mit ILuvUI eine KI vor, die App-Oberfl\u00e4chen versteht, analysiert & barrierefreie sowie automatisierte Nutzung erm\u00f6glichen soll.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/news\\\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.apfelpatient.de\\\/news\\\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/news\\\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#primaryimage\",\"url\":\"https:\\\/\\\/www.apfelpatient.de\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/shutterstock_2501137373.jpg\",\"contentUrl\":\"https:\\\/\\\/www.apfelpatient.de\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/shutterstock_2501137373.jpg\",\"width\":1600,\"height\":977,\"caption\":\"Bild: Shutterstock \\\/ Rabbi Creative\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/news\\\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Startseite\",\"item\":\"https:\\\/\\\/www.apfelpatient.de\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Apple stellt neue KI vor: ILuvUI versteht App-Oberfl\u00e4chen\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/#website\",\"url\":\"https:\\\/\\\/www.apfelpatient.de\\\/\",\"name\":\"Apfelpatient\",\"description\":\"Alles rund um Apple!\",\"publisher\":{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/en\\\/#organization\",\"name\":\"Apfelpatient\",\"url\":\"https:\\\/\\\/www.apfelpatient.de\\\/en\\\/\"},\"alternateName\":\"Apfelpatient\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.apfelpatient.de\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/#\\\/schema\\\/person\\\/c4db8ca141256a7013ad8c2d9fa03416\",\"name\":\"Milan\",\"logo\":{\"@id\":\"https:\\\/\\\/www.apfelpatient.de\\\/#\\\/schema\\\/person\\\/image\\\/\"},\"description\":\"Hallo und herzlich willkommen auf meinem Technik-Blog! Als gro\u00dfer Apple-Fan berichte ich hier \u00fcber alles, was mit Apple zu tun hat: von den neuesten News und spannenden Ger\u00fcchten \u00fcber hilfreiche Tipps und Tricks bis hin zu ausf\u00fchrlichen Produkttests. Wenn du genauso technikbegeistert bist wie ich, bist du hier genau richtig!\",\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/apfelpatientOfficial\",\"https:\\\/\\\/www.linkedin.com\\\/in\\\/milan-jovicic-42aa0231b\"],\"url\":\"https:\\\/\\\/www.apfelpatient.de\\\/en\\\/author\\\/apfeladmin\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Apple introduces new AI: ILuvUI understands app interfaces","description":"With ILuvUI, Apple is introducing an AI that understands and analyzes app interfaces and is designed to enable accessible and automated use.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.apfelpatient.de\/en\/news\/apple-introduces-new-ai-iluvui-understands-app-interfaces","og_locale":"en_US","og_type":"article","og_title":"Apple stellt neue KI vor: ILuvUI versteht App-Oberfl\u00e4chen","og_description":"Apple stellt mit ILuvUI eine KI vor, die App-Oberfl\u00e4chen versteht, analysiert & barrierefreie sowie automatisierte Nutzung erm\u00f6glichen soll.","og_url":"https:\/\/www.apfelpatient.de\/en\/news\/apple-introduces-new-ai-iluvui-understands-app-interfaces","og_site_name":"Apfelpatient","article_publisher":"https:\/\/www.facebook.com\/apfelpatientOfficial","article_author":"https:\/\/www.facebook.com\/apfelpatientOfficial","article_published_time":"2025-07-15T23:53:52+00:00","article_modified_time":"2025-07-15T23:53:56+00:00","og_image":[{"width":1600,"height":977,"url":"https:\/\/www.apfelpatient.de\/wp-content\/uploads\/2025\/07\/shutterstock_2501137373.jpg","type":"image\/jpeg"}],"author":"Milan","twitter_card":"summary_large_image","twitter_description":"Apple stellt mit ILuvUI eine KI vor, die App-Oberfl\u00e4chen versteht, analysiert & barrierefreie sowie automatisierte Nutzung erm\u00f6glichen soll.","twitter_misc":{"Written by":"Milan","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/www.apfelpatient.de\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#article","isPartOf":{"@id":"https:\/\/www.apfelpatient.de\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen"},"author":{"@type":"Organization","@id":"https:\/\/www.apfelpatient.de\/en\/#organization","name":"Apfelpatient","url":"https:\/\/www.apfelpatient.de\/en\/"},"headline":"Apple stellt neue KI vor: ILuvUI versteht App-Oberfl\u00e4chen","datePublished":"2025-07-15T23:53:52+00:00","dateModified":"2025-07-15T23:53:56+00:00","mainEntityOfPage":{"@id":"https:\/\/www.apfelpatient.de\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen"},"wordCount":779,"publisher":{"@type":"Organization","@id":"https:\/\/www.apfelpatient.de\/en\/#organization","name":"Apfelpatient","url":"https:\/\/www.apfelpatient.de\/en\/"},"image":{"@id":"https:\/\/www.apfelpatient.de\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#primaryimage"},"thumbnailUrl":"https:\/\/www.apfelpatient.de\/wp-content\/uploads\/2025\/07\/shutterstock_2501137373.jpg","keywords":["TechPatient"],"articleSection":"News","inLanguage":"en-US","copyrightYear":"2025","copyrightHolder":{"@id":"https:\/\/www.apfelpatient.de\/en\/#organization"}},{"@type":"WebPage","@id":"https:\/\/www.apfelpatient.de\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen","url":"https:\/\/www.apfelpatient.de\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen","name":"Apple introduces new AI: ILuvUI understands app interfaces","isPartOf":{"@id":"https:\/\/www.apfelpatient.de\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.apfelpatient.de\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#primaryimage"},"image":{"@id":"https:\/\/www.apfelpatient.de\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#primaryimage"},"thumbnailUrl":"https:\/\/www.apfelpatient.de\/wp-content\/uploads\/2025\/07\/shutterstock_2501137373.jpg","datePublished":"2025-07-15T23:53:52+00:00","dateModified":"2025-07-15T23:53:56+00:00","description":"With ILuvUI, Apple is introducing an AI that understands and analyzes app interfaces and is designed to enable accessible and automated use.","breadcrumb":{"@id":"https:\/\/www.apfelpatient.de\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.apfelpatient.de\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.apfelpatient.de\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#primaryimage","url":"https:\/\/www.apfelpatient.de\/wp-content\/uploads\/2025\/07\/shutterstock_2501137373.jpg","contentUrl":"https:\/\/www.apfelpatient.de\/wp-content\/uploads\/2025\/07\/shutterstock_2501137373.jpg","width":1600,"height":977,"caption":"Bild: Shutterstock \/ Rabbi Creative"},{"@type":"BreadcrumbList","@id":"https:\/\/www.apfelpatient.de\/news\/apple-stellt-neue-ki-vor-iluvui-versteht-app-oberflaechen#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Startseite","item":"https:\/\/www.apfelpatient.de\/"},{"@type":"ListItem","position":2,"name":"Apple stellt neue KI vor: ILuvUI versteht App-Oberfl\u00e4chen"}]},{"@type":"WebSite","@id":"https:\/\/www.apfelpatient.de\/#website","url":"https:\/\/www.apfelpatient.de\/","name":"apple patient","description":"Everything about Apple!","publisher":{"@type":"Organization","@id":"https:\/\/www.apfelpatient.de\/en\/#organization","name":"Apfelpatient","url":"https:\/\/www.apfelpatient.de\/en\/"},"alternateName":"Apfelpatient","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.apfelpatient.de\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":["Person","Organization"],"@id":"https:\/\/www.apfelpatient.de\/#\/schema\/person\/c4db8ca141256a7013ad8c2d9fa03416","name":"Milan","logo":{"@id":"https:\/\/www.apfelpatient.de\/#\/schema\/person\/image\/"},"description":"Hello and welcome to my technology blog! As a big Apple fan, I report on everything to do with Apple: from the latest news and exciting rumors to helpful tips and tricks and detailed product tests. If you are as enthusiastic about technology as I am, you have come to the right place!","sameAs":["https:\/\/www.facebook.com\/apfelpatientOfficial","https:\/\/www.linkedin.com\/in\/milan-jovicic-42aa0231b"],"url":"https:\/\/www.apfelpatient.de\/en\/author\/apfeladmin"}]}},"_links":{"self":[{"href":"https:\/\/www.apfelpatient.de\/en\/wp-json\/wp\/v2\/posts\/56802","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.apfelpatient.de\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.apfelpatient.de\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.apfelpatient.de\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.apfelpatient.de\/en\/wp-json\/wp\/v2\/comments?post=56802"}],"version-history":[{"count":0,"href":"https:\/\/www.apfelpatient.de\/en\/wp-json\/wp\/v2\/posts\/56802\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.apfelpatient.de\/en\/wp-json\/wp\/v2\/media\/56801"}],"wp:attachment":[{"href":"https:\/\/www.apfelpatient.de\/en\/wp-json\/wp\/v2\/media?parent=56802"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.apfelpatient.de\/en\/wp-json\/wp\/v2\/categories?post=56802"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.apfelpatient.de\/en\/wp-json\/wp\/v2\/tags?post=56802"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}