Facebook closes down AI system after bots create own language

Ironically days after Tesla CEO Elon Musk said that artificial intelligence (AI) was the biggest risk, Facebook has shut down one of its AI systems after chatbots started speaking in their own language defying the codes provided. Going by a report published on Tech Times, the social media giant had to close the AI system that its researchers were working on "because things got out of hand".

"The AI did not start shutting down computers worldwide or something of the sort, but it stopped using English and started using a language that it created," the report noted. Initially, the AI agents were conversing in English, but they later created a new language that only AI systems could understand, going against their purpose. This is why the Facebook researchers had to pull the plug on the AI system.

Back in June, researchers from the Facebook AI Research Lab (FAIR) found that while they were busy trying to improve chatbots, the "dialogue agents" were creating their own language.

Soon, the bots began to deviate from the scripted norms and started communicating in an entirely new language which they created without human input, stated the report.

Using machine learning algorithms, the "dialogue agents" were left to converse freely in an attempt to strengthen their conversational skills.

The researchers also found these bots to be "incredibly crafty negotiators".

"After learning to negotiate, the bots relied on machine learning and advanced strategies in an attempt to improve the outcome of these negotiations," the report said.

"Over time, the bots became quite skilled at it and even began feigning interest in one item in order to 'sacrifice' it at a later stage in the negotiation as a faux compromise," it added.

While this can be seen as a huge advancement for the bots, many experts like Stephen Hawking have raised fears that humans, who are limited by slow biological evolution, could be replaced by AI.

Others like Tesla's Elon Musk, philanthropist Bill Gates and ex-Apple founder Steve Wozniak have also expressed their concerns about where the AI technology was heading.

Interestingly, this incident took place just days after a verbal spat between Facebook CEO and Musk who exchanged harsh words over a debate on the future of AI.

"I've talked to Mark about this (AI). His understanding of the subject is limited," Musk tweeted last week.

The tweet came after Zuckerberg, during a Facebook livestream earlier this month, castigated Musk for arguing that care and regulation were needed to safeguard the future if AI becomes mainstream.

"I think people who are naysayers and try to drum up these doomsday scenarios - I just, I don't understand it. It's really negative and in some ways, I actually think it is pretty irresponsible," Zuckerberg said.

Musk has been speaking frequently on AI and has called its progress the "biggest risk we face as a civilization".

"AI is a rare case where we need to be proactive in regulation instead of reactive because if we're reactive in AI regulation it's too late," he said.

IANS report