Skip to main content

Investigation exposes murkier side of ChatGPT and the AI chatbot industry

A Time investigation has exposed the murkier side of the AI chatbot industry, highlighting how at least one startup has been using questionable practices to improve its technology.

Published on Wednesday, Time’s report focuses on Microsoft-backed OpenAI and its ChatGPT chatbot, a technology that’s gained much attention recently for its remarkable ability to produce highly natural conversational text.

Time’s probe found that to train the AI technology, OpenAI used the services of a team in Kenya to pore over text that included disturbing subject matter such as child sexual abuse, bestiality, murder, suicide, torture, self-harm, and incest. And for their efforts to label the abhorrent content, many on the team received less than $2 an hour.

The work, which started in November 2021, was necessary as ChatGPT’s predecessor, GPT-3, while impressive, had a tendency to spew out offensive content as its training dataset had been compiled by scraping hundreds of billions of words from all corners of the web.

The Kenya-based team, operated by San Francisco firm Sama, would label the offensive content to help train OpenAI’s chatbot, thereby improving its dataset and reducing the chances of any objectionable output.

Time said that all four of the Sama employees that it interviewed described being mentally scarred by their work. Sama offered counseling sessions, but the employees said they were ineffective and rarely took place due to the demands of the job, though a Sama spokesperson told Time that the therapists were accessible at any time.

One worker told Time that reading the shocking material sometimes felt like “torture,” adding that they felt “disturbed” by the end of the week.

In February 2022, things took an even darker turn for Sama when OpenAI launched a separate project unrelated to ChatGPT that required its Kenya team to collect images of a sexual and violent nature. OpenAI told Time that the work was necessary for making its AI tools safer.

Within weeks of this image-based project starting, the alarming nature of the tasks prompted Sama to cancel all of its contracts with OpenAI, though Time suggests it could also have been prompted by the PR fallout from a report on a similar subject matter that it published about Facebook at around the same time.

Open AI told Time there had been “a miscommunication” about the nature of the imagery that it asked Sama to collect, insisting that it had not asked for the most extreme imagery, and had not viewed any that it had been sent.

But ending the contracts impacted the workers’ livelihoods, with some of the team in Kenya losing their jobs, while others were moved onto lower-paying projects.

Time’s investigation offers an uncomfortable but important look at the kind of work that’s going into the AI-powered chatbots that have recently been getting the tech industry so excited.

While transformative and potentially beneficial, the technology clearly comes at a human cost and throws up a slew of ethical questions about how companies go about developing their new technologies, and more broadly about how wealthier countries continue to farm out less desirable tasks to poorer nations for a lower financial outlay.

The startups behind the tech will come under more focused scrutiny in the coming months and years, and so they would do well to review and improve their practices at the earliest opportunity.

Digital Trends has reached out to OpenAI for comment on Time’s report and we will update this article when we hear back.

Editors' Recommendations

Trevor Mogg
Contributing Editor
Not so many moons ago, Trevor moved from one tea-loving island nation that drives on the left (Britain) to another (Japan)…
ChatGPT’s new upgrade finally breaks the text barrier
A person typing on a laptop that is showing the ChatGPT generative AI website.

OpenAI is rolling out new functionalities for ChatGPT that will allow prompts to be executed with images and voice directives in addition to text.

The AI brand announced on Monday that it will be making these new features available over the next two weeks to ChatGPT Plus and Enterprise users. The voice feature is available in iOS and Android in an opt-in capacity, while the images feature is available on all ChatGPT platforms. OpenAI notes it plans to expand the availability of the images and voice features beyond paid users after the staggered rollout.

Read more
Microsoft’s Copilot AI will have an ‘energy,’ apparently
The Microsoft Windows logo surrounded by colors of red, green, yellow and blue.

Microsoft has just unveiled the latest version of Windows 11, and it features updates across the operating system, from AI to new tools and features.

Among the updates are changes to Microsoft’s Copilot AI tool, which will have more features to help users in apps like Word and Excel, as well as within Windows 11 itself. Copilot can be used to summarize meetings, write emails, help with analysis, and much more.

Read more
Most people distrust AI and want regulation, says new survey
A person's hand holding a smartphone. The smartphone is showing the website for the ChatGPT generative AI.

Most American adults do not trust artificial intelligence (AI) tools like ChatGPT and worry about their potential misuse, a new survey has found. It suggests that the frequent scandals surrounding AI-created malware and disinformation are taking their toll and that the public might be increasingly receptive to ideas of AI regulation.

The survey from the MITRE Corporation and the Harris Poll claims that just 39% of 2,063 U.S. adults polled believe that today’s AI tech is “safe and secure,” a drop of 9% from when the two firms conducted their last survey in November 2022.

Read more