OpenAI plans smart speaker with camera Apfelpatient

Anyone who thought OpenAI would forever remain a purely software company is about to be proven wrong. A new report from The Information, written by Stephanie Palazzolo and Qianer Liu, provides the most concrete insights yet into OpenAI's hardware plans. According to the report, the ChatGPT maker's first physical product will be a smart speaker. It will be designed by Jony Ive, the former chief designer at Apple, who was responsible for products such as the iPhone, iMac, and Apple Watch. To observers, the device sounds like a HomePod 2.0 from Ive's hand – only this time in the service of OpenAI.

OpenAI has shaken up the tech industry in recent years with language models like GPT-4 and the ChatGPT chatbot. Now comes the next step: its own hardware product. Sam Altman, CEO of OpenAI, has never hidden his desire for a physical presence of AI in people's everyday lives. The collaboration with Jony Ive and his design firm LoveFrom is no coincidence. Ive is considered one of the world's most influential product designers, and OpenAI clearly wants to make a lasting impression with its first device. According to the report, several devices are in the pipeline – but the smart speaker will be the first to hit the market, likely in early 2027.

The Smart Speaker: Features, price and what makes it special

Price and positioning

According to two people familiar with the plans, OpenAI's smart speaker is expected to cost between $200 and $300. This places it in the upper mid-range price segment, comparable to Apple's HomePod or Sonos devices. It certainly won't be a cheap product.

Camera and environment detection

What clearly sets this device apart from existing smart speakers like the Amazon Echo or the Google Nest is its integrated camera. This camera is designed not only to take pictures but also to actively capture information about the user's surroundings. According to one of the people quoted in the report, this includes, for example, objects lying on a nearby table or conversations being held by people in the immediate vicinity. The speaker is therefore not only intended to listen when directly addressed but also to continuously perceive and process its environment.

Face recognition and shopping function

Another planned feature is particularly noteworthy: Purchases will be possible via facial recognition technology comparable to Apple's Face ID. Users will be able to order products simply through their biometric identification, without having to open an app or enter a PIN. This sounds futuristic and convenient, but at the same time raises significant data privacy concerns that OpenAI still needs to address.

Other products: Smart glasses and smart lamp

The smart speaker isn't the only device OpenAI is planning. The report mentions two other products, both under active development: smart glasses and a smart lamp. Both products are in an earlier stage of development than the speaker, and detailed information on features or pricing is not yet available. However, the selection of product categories alone demonstrates that OpenAI is aiming for a broad presence in everyday life: from the body and the desktop to room lighting.

Jony Ive, LoveFrom and the division of labor with OpenAI

The collaboration between OpenAI and Jony Ive is complex. Ive continues to run his design firm, LoveFrom, as an independent company, formally separate from OpenAI. At the same time, LoveFrom is responsible for developing the designs of potential OpenAI devices. OpenAI's internal hardware team, on the other hand, is responsible for the actual manufacturing of the devices, the associated software, and the analysis of consumer usage patterns.

Tensions between the teams

This division of labor doesn't work smoothly in practice. According to the report, some OpenAI employees have complained that LoveFrom revises its designs slowly and provides little insight into its own design process. Even OpenAI employees directly involved in device development complain about a lack of communication from LoveFrom. These are not minor disagreements, as a lack of transparency between design and engineering can lead to significant delays and quality issues in product development.

Complications after Io transfer

Another area of concern is the integration of the employees of the startup Io, which OpenAI acquired. According to the report, difficulties arose after the acquisition in integrating the Io team into OpenAI's existing hardware team. While such integration challenges are common in tech acquisitions, they can become a real problem, especially with ambitious timelines like OpenAI's.

OpenAI vs. Apple: A competition with a personal touch

The race for the future of AI hardware is gaining momentum. Apple, from which Jony Ive left in 2019 after nearly three decades, is working on several AI wearables as well as new products related to the HomePod. The fact that Ive is now working for OpenAI and may be developing a direct competitor to Apple's own home speakers adds a special dimension to the situation. Both companies are relying on different strengths: Apple on its decades-long ecosystem and proven hardware expertise, and OpenAI on its leading position in AI technology and its drive for disruption.

OpenAI will participate – once the problems are solved

OpenAI's entry into the hardware market is a bold move. The planned smart speaker combines a camera, facial recognition, environmental sensing, and shopping functions in a single device – and is intended to be just the beginning of an entire product family. The collaboration with Jony Ive promises a high level of design, but internal tensions between LoveFrom and OpenAI's own hardware team, as well as integration difficulties following the Io acquisition, demonstrate that the path to market readiness is not an easy one. Whether the targeted market launch in early 2027 will be successful remains to be seen. One thing is clear, however: the AI hardware era has begun, and OpenAI intends to be at the forefront. (Image: Shutterstock / SJ_PHOTOS)