Snapchat’s artificial intelligence chatbot, My AI, has come under regulatory scrutiny in the UK over potential privacy risks to children.
UK’s data protection regulator, the Information Commissioner’s Office (ICO), has pointed out possible risks Snapchat’s AI chatbot could pose to users. The concerns specifically surround users between the ages of 13 and 17, who may be exposed to privacy risks through the chatbot.
A preliminary enforcement notice has been issued against Snap, the parent company of Snapchat.
“The provisional findings of our investigation suggest a worrying failure by Snap to adequately identify and assess the privacy risks to children and other users before launching ‘My AI’,” said UK’s Information Commissioner John Edwards.
The findings of ICO’s investigation are provisional, however. Snap can respond to the notice until October 27 before the watchdog makes a final decision regarding the fate of My AI in the UK, where Snapchat boasts about 21 million users.
“No conclusion should be drawn at this stage that there has, in fact, been any breach of data protection law or that an enforcement notice will ultimately be issued,” the regulator said.
If Snap fails to satisfy the regulator and a final enforcement notice is issued, the company will have to cease processing data related to my AI. The chatbot will face suspension for UK consumers until Snap conducts an “adequate risk assessment” and addresses the outlined privacy concerns.
“We have been clear that organisations must consider the risks associated with AI, alongside the benefits,” said the commissioner. “Today’s preliminary enforcement notice shows we will take action in order to protect UK consumers’ privacy rights.”
In response to the ICO’s notice, Snap said it is reviewing the regulator’s provisional decision. “In line with our standard approach to product development, My AI went through a robust legal and privacy review process before being made publicly available,” a Snap spokesperson said.
Snapchat is the first major messaging platform in the UK to have incorporated AI. Although My AI was launched in February for SnapChat’s premium service, Snapchat+, it was made available to all users in April.
Since its launch, My AI has raised questions as to whether the chatbot can access private information of users, including location data. The company, however, says that location can only be shared upon consent.
