Facebook shut down an artificial intelligence engine after developers discovered that the AI had created its own unique language that humans can’t understand. Researchers at the Facebook AI Research Lab (FAIR) found that the chatbots had deviated from the script and were communicating in a new language developed without human input. It is as concerning as it is amazing – simultaneously a glimpse of both the awesome and horrifying potential of AI.
Artificial Intelligence is not sentient—at least not yet. It may be someday, though – or it may approach something close enough to be dangerous. Ray Kurzweil warned years ago about the technological singularity. The Oxford dictionary defines “the singularity” as, “A hypothetical moment in time when artificial intelligence and other technologies have become so advanced that humanity undergoes a dramatic and irreversible change.”
To be clear, we aren’t really talking about whether or not Alexa is eavesdropping on your conversations, or whether Siri knows too much about your calendar and location data. There is a massive difference between a voice-enabled digital assistant and an artificial intelligence. These digital assistant platforms are just glorified web search and basic voice interaction tools. The level of “intelligence” is minimal compared to a true machine learning artificial intelligence. Siri and Alexa can’t hold a candle to IBM’s Watson.
Why is this scary? Think SKYNET from Terminator, or WOPR from War Games. Our entire world is wired and connected. An artificial intelligence will eventually figure that out – and figure out how to collaborate and cooperate with other AI systems. Maybe the AI will determine that mankind is a threat, or that mankind is an inefficient waste of resources – conclusions that seems plausible from a purely logical perspective.
I am not saying the sky is falling. I am not saying we need to pull the plug on all machine learning and artificial intelligence and return to a simpler, more Luddite existence. We do need to proceed with caution, though. We need to closely monitor and understand the self-perpetuating evolution of an artificial intelligence, and always maintain some means of disabling it or shutting it down. If the AI is communicating using a language that only the AI knows, we may not even be able to determine why or how it does what it does, and that might not work out well for mankind.