Facebook forced to ban its AI after it ‘revealed how to make napalm and made racist comments’

FACEBOOK owner Meta was forced to ‘pause’ a public AI experiment after it started spreading misinformation and offensive comments.

The Galactica project aimed to solve “information overload in science” by using AI to sift through 48 million papers and textbooks.

1

But instead, testers found it said all sorts of nonsense – some of it derogatory and dangerous.

Among them were the benefits of eating crushed glass and being white TNW who tried the system.

It also included false instructions on how to make napalm – the substance used to make a bomb – in a bathtub.

Within days of the demo’s release, the bosses at Meta had to dramatically pull it off the internet.

Facebook warned on the technician’s website that “language models can hallucinate”.

“There are no guarantees of truthful or reliable output from language models, even large ones trained on high quality data like Galactica,” the social network said.

“Never follow the advice of a language model without verification.”

The company also said the system doesn’t work as well when less information is available on a given topic.

They added: “Language models are often confident but wrong.

“Some of the text generated by Galactica may seem very authentic and supremely confident, but could be subtly wrong on important points.

“This is especially true for highly technical content.“

Announcing the temporary end of the demo, the group said, “Thank you to everyone who tried out the Galactica model demo.

“We appreciate the feedback we’ve received from the community so far and have paused the demo for the time being.

“Our models are available to researchers who want to learn more about the work and reproduce results in the work.”

The best tips and hacks for phones and gadgets

Looking for tips and hacks for your phone? Want to find these secret features in social media apps? We’ve got you covered…

Get the latest news about WhatsApp, Instagram, Facebook and other tech gadgets here.

We pay for your stories! Do you have a story for The Sun Online Tech & Science Team? Email us at tech@the-sun.co.uk