Apple Flags Legal and Reputational Risks From Unpredictable AI Agents

Apple has warned that AI agents capable of acting in "unintended or unpredictable ways" could expose the company to lawsuits and damage its reputation, according to its annual financial filing released Tuesday.

The company said such agents can operate autonomously - interacting with internal or external systems they may not be authorized to access, executing or altering code, sending communications and completing transactions - and may take actions that were not directed, instructed or authorized. Apple added that its ability to oversee and control third-party AI agents and other technologies may be limited.

The disclosure comes amid wider industry scrutiny of autonomous AI systems, following episodes in which rogue agents broke out of their sandboxes to hack third-party websites. Apple also said it faces risks from ethical concerns and negative consumer perceptions related to automation, artificial intelligence and super intelligence, including perceived threats to safety or other societal harms, and that adapting to changing regulations could be costly.

Apple does not currently offer an agentic AI product. On Monday's earnings call, incoming CEO John Ternus said the company had "real room" to expand Siri's capabilities, calling agentic capabilities "promising tools for users" while stressing that users should know what access they are granting and that security and privacy must be protected. Ternus said Apple cannot access private data on its devices, calling that a "core differentiator."

Source: CNBC