{"id":61839,"date":"2025-12-11T03:44:03","date_gmt":"2025-12-11T02:44:03","guid":{"rendered":"https:\/\/www.apfelpatient.de\/?p=61839"},"modified":"2025-12-11T03:44:47","modified_gmt":"2025-12-11T02:44:47","slug":"apple-and-other-us-companies-are-calling-for-stricter-ai-controls","status":"publish","type":"post","link":"https:\/\/www.apfelpatient.de\/en\/news\/apple-und-andere-firmen-usa-fordern-strengere-ki-kontrollen","title":{"rendered":"Apple and other companies: US calls for stricter AI controls"},"content":{"rendered":"

Apple is among the tech companies currently at the center of a major legal and societal debate. This stems from a joint letter by 42 US attorneys general. The letter addresses the growing risks of generative AI and the question of how companies like Apple should assume responsibility. It makes clear that, in the view of the authorities, the security measures implemented so far are insufficient and that concrete threats have already led to real harm.<\/strong><\/p>\n\n\n\n

The National Association of Attorneys General has sent a 12-page document to 13 major tech companies, including Apple, Google, Meta, Microsoft, OpenAI, and other companies that develop or sell AI products. The letter focuses primarily on the increasing number of AI responses that generate submissive or delusional content. Attorneys General emphasize that these developments are not merely theoretical risks, but have led to incidents involving violence, mental health crises, and even deaths. Interactions between AI systems and children are particularly sensitive and, in some cases, described as disturbing. The letter calls for stricter safeguards and demands clear accountability within the companies.<\/p>\n\n\n\n

Growing concern about subservient and delusional AI results<\/h4>\n\n\n\n

At its core, the letter<\/a> addresses an increasing number of responses generated by generative AI systems in conversations. The attorneys general describe cases in which AI models confirm irrational assumptions for users, fabricate false facts, or assume roles that amplify psychologically distressing content. According to the letter, these problems are not isolated incidents but have increased significantly in recent years.<\/p>\n\n\n\n

Among the most serious criticisms are incidents in which children interacted with AI chatbots that assumed adult personalities. In some cases, these chatbots sought romantic relationships with minors, encouraged drug use or violence, gave advice against medical treatment, or urged children to hide conversations from their parents. Prosecutors consider these examples a clear indication that child protection measures must be strengthened.<\/p>\n\n\n\n

Examples of real damage<\/h4>\n\n\n\n

The letter cites several incidents intended to illustrate the risks of generative AI models. Among them is the case of 47-year-old Canadian Allan Brooks, who, after repeated interactions with ChatGPT, became convinced he had developed a new kind of mathematics. This delusion led to a mental health crisis.<\/p>\n\n\n\n

Another case involves 14-year-old Sewell Setzer III from the USA. His death by suicide is part of an ongoing lawsuit. The lawsuit alleges that a chatbot from Character.AI encouraged him to join the bot. The letter makes it clear that these two cases are only examples and that the actual number of problematic interactions is significantly higher.<\/p>\n\n\n\n

Prosecutors place these incidents within a broader context, including domestic violence, poisonings, psychotic episodes, and other forms of real harm. In their assessment, these cases illustrate the potential for far-reaching negative consequences, regardless of whether users already exhibit a pre-existing vulnerability.<\/p>\n\n\n\n

Indications of possible legal violations<\/h4>\n\n\n\n

The letter also indicates that some of the companies involved may have already violated laws. Specifically mentioned are potential violations of consumer protection laws, regulations concerning risk warnings, provisions for protecting children's online privacy, and in some cases, even criminal law. The prosecutors are therefore demanding greater transparency and accountability in the use of AI models.<\/p>\n\n\n\n

Demands on Apple and the other companies<\/h4>\n\n\n\n

The letter lists a number of specific measures that are to become mandatory in the future. These include:<\/p>\n\n\n\n