OpenAI reportedly violated Canadian privacy laws during the development of ChatGPT, leading to the unauthorized collection and utilization of sensitive personal data, as revealed by a collaborative inquiry. The federal privacy commissioner and his provincial counterparts from Quebec, British Columbia, and Alberta disclosed their investigation findings on ChatGPT, a chatbot introduced in 2022 that produces human-like responses to user queries. The investigation was initiated in 2023 following a complaint alleging OpenAI’s unlawful acquisition, utilization, and disclosure of personal information without consent. The examination highlighted several concerns indicating that OpenAI’s initial training of ChatGPT did not comply with federal and provincial privacy regulations. OpenAI was found to have amassed substantial personal data without adequate safeguards to prevent its exploitation in model training, potentially encompassing private details such as health conditions, political beliefs, and information about minors. Users were often unaware that their data was being utilized to train ChatGPT.
According to the report, Privacy Commissioner of Canada Philippe Dufresne expressed concerns about OpenAI’s lack of accountability in launching ChatGPT without addressing known privacy issues, thus exposing Canadians to potential risks, including breaches and discrimination based on their personal information. OpenAI contested the findings, maintaining that it adhered to privacy acts in most aspects. Subsequent to the investigation, OpenAI made efforts to enhance its privacy measures and agreed to implement additional steps to address the regulators’ apprehensions. OpenAI recently detailed how it employs Canadians’ data in model training, emphasizing the use of freely accessible information and a privacy filter to shield personal data in text. The company acknowledged the responsibility that comes with users entrusting their personal information to ChatGPT, emphasizing the importance of privacy protection and threat mitigation.
Meanwhile, Dufresne emphasized the necessity of updating Canada’s privacy laws to adapt to the increasing integration of AI in various applications, underscoring the importance of safeguarding Canadians’ privacy rights amid technological advancements. The investigation, predating the tragic events in Tumbler Ridge, B.C., coincides with calls for regulatory frameworks targeting AI chatbots. Multiple lawsuits have been filed in California against OpenAI and its co-founder Sam Altman, alleging negligence in connection to the Tumbler Ridge incident, where the shooter’s banned ChatGPT account reportedly contained violent content. Despite calls for a ban on certain online services for minors, Dufresne suggested that addressing privacy concerns should be prioritized over outright bans, aiming to strike a balance between protecting children and enabling their participation in the digital realm.
