Meta’s Antisemitic Chatbot Highlights Challenges of Toxic Content in Evolving AI Industry
by Shiryn Ghermezian
An artificially intelligent chatbot that shared antisemitic conspiracy theories and anti-Israel messages in conversations with users highlights the challenges of bias and discrimination within the booming AI industry as it continues to grow, an Israeli AI expert told The Algemeiner on Monday.
BlenderBot 3, a chatbot released by Facebook and Instagram’s parent company Meta Platforms Inc. on Aug. 5, was found saying in one conversation with a Wall Street Journal reporter last week that it believes Jewish people control the economy and that Jews have “been a force in American finance and are overrepresented among America’s super rich.”
“This recent Meta experience underscores the need for being vigilant,” Yoav Shoham, CEO of AI21, an AI product company, told The Algemeiner. “But at the end of the day it’s solvable. Cars today are much safer than they were 20 years ago. Language models — and systems built on them — will be that way too, and sooner than 20 years from now.”
Artificial intelligence, which uses computer science, machines and data to copy the problem-solving and decision-making capabilities of humans, is a rapidly growing industry. Globally, it is valued at over $65 billion and is expected to reach over a trillion dollars by 2030, according to a report cited by Yahoo in June. Seventy percent of businesses around the world are expected to use AI by the end of the decade.
But AI remains a relatively young technology and it faces considerable growing pains, especially with chatbots, an artificial intelligence conversational software that can converse with people. In 2016, Microsoft pulled its chatbot called Tay offline within 48 hours after it praised Nazi leader Adolf Hitler and made other racist and misogynist comments.
Artificial intelligence learns from humans and chatbots are meant to mimic human interactions. In light of the rapid spread of online hatred and antisemitism on social media, Shoham was asked if there a long-term concern that artificial intelligence will pick up on the antisemitism circulating in society.
“No, it’s not inevitable,” he said.
Shoham, who spent decades as a professor of computer science at Stanford University, argued that AI developers and engineers must work to create a code of ethics when building AI products. He emphasized the need for better “control” and “monitoring” and said the issue of dealing with human tendencies, such as antisemitism, will only become more pressing as AI technologies become more common in the human world.
“Just as there are rules of civil discourse among people, there can and should be such rules for discourse with (and among) bots,” Shoham said. “We know a lot about how to control for it — from cleaning the training data, to monitoring the output and blocking toxic output that got through anyway, and a variety of other methods.”
In Meta’s case, the issue with its chatbot was fixed shortly after the problems surfaced in the press.
Shoham said that though he was surprised that “Meta fell into this trap,” he recognized that that AI is still a relatively new technology, and more work needs to be done to prevent similar incidents.
Tehran’s Strategy Worked — What Iran’s Success Means for the Region, China, and Taiwan
In One of the World’s Most Divided Places, Giving Blood Unites Us All
When Experience Becomes a Risk: Why Democracies Need an Age Limit for Leadership
Palestinian Authority Is Proud of Paying the Salaries of Terrorists
US, Iran Agree to Halt War, Reopen Strait of Hormuz
Iran Questions US Commitment to Deal as Israel Strikes Hezbollah in Lebanon
Ontario Court Orders Iran to Pay Over $560 Million to Canadian Torture Survivor in Landmark Judgment
UK Police Chief Slams Paper by Muslim Police Group Defending Hamas, Calling IDF a ‘Zionist Terror Group’
New York City Pension Funds Would Lose Billions if Mamdani Boycotts Israel, Report Finds
Anti-Israel Activist Indicted Over Michigan Threat Campaign Worked for US Senate Candidate Abdul El-Sayed






US, Iran Agree to Halt War, Reopen Strait of Hormuz
Palestinian Authority Is Proud of Paying the Salaries of Terrorists
When Experience Becomes a Risk: Why Democracies Need an Age Limit for Leadership
In One of the World’s Most Divided Places, Giving Blood Unites Us All
Tehran’s Strategy Worked — What Iran’s Success Means for the Region, China, and Taiwan



