Snapchat’s AI Chatbot Targeted by UK Data Watchdog Over Privacy Risk

Back in October 2023, the United Kingdom’s data watchdog announced that it was issuing Snap, the parent company of the popular social media network Snapchat, a preliminary enforcement notice. The Information Commissioner’s Office (ICO) provisionally found that the app’s owner failed to ‘adequately identify and assess the risks’ of its AI chatbot to users, especially children.

What is My AI?

My AI is Snapchat’s ‘experimental and friendly’ chatbot. It is built into the app and appears in users’ chats alongside their friends: a sort of digital companion.

The assistant is based on Open AI’s Chat GPT and can perform many of the tasks of modern-day AI chatbots such as answering questions, inventing songs and poems or designing menus. Its conversational manner contributes to the idea of a digital sidekick.

Originally released in April (or February for paying users), the feature has encountered many difficulties along the way, such as providing incorrect or biased statements, which have also been confirmed by Snapchat.

What are the Issues?

Snapchat has approximately 21 million active monthly users in the UK. According to Insider Intelligence, around 48% of those users are under the age of 24.

The information commissioner John Edwards has stated that ‘the provisional findings of our investigation suggest a worrying failure by Snap [the parent of Snapchat] to adequately identify and assess the privacy risks to children and other users before launching My AI.’

Since the rise of AI chatbots, regulators have been scrambling to catch up with the host of legal issues these models have created, including data protection issues. While the findings do not necessarily mean Snap has breached UK data protection laws, the ICO’s statements point to potential issues with how My AI processes personal information. Snapchat has also been unclear over whether the chatbot is collecting private data such as location.

According to Snap, My AI went through a robust legal and privacy review process before being made publicly available.

What’s Next?

As the ICO’s findings are provisional, Snap had until the 27th of October 2023 to respond to the investigation and put forward its case. It has been reported that the company is collaborating with the ICO to address the watchdog’s concerns.

If it is confirmed that Snap has breached British data protection laws, the ICO has the power to fine Snap up to 4% of its global turnover, i.e., up to £17.5m.

To meet data protection standards, Snap may have to pull the chatbot in the UK and develop it further.

Conclusion

The UK's ICO has issued Snap a preliminary enforcement notice regarding its AI chatbot, My AI, as it is concerned that the company failed to adequately assess privacy risks, especially for children. The prospect of fines and necessary technological changes highlights developing challenges in regulating the intersection between AI and data privacy.

By Scott Hickman