- Supernormal stimuli;
- Replacing strong link community relationships with weak link affinity relationships;
- Training people on complicated rather than complex environments; and
- The asymmetry of Human / AI relationships
Each category is too involved to describe here with any detail so I urge you to read the whole article. However, here is an excerpt from category (4):
Imagine if your spouse, your therapist and your priest all entered into a conspiracy with a team of world class con men to control and shape your behaviour. Sound a bit unsettling? Well consider what the Facebook algorithms alone know about you. Every conversation you have — even those that you type out but don’t send — are perceived by the Facebook AI, and then analyzed by technology designed by thousands of researchers schooled in the very cutting edge of psychology and cognitive neuroscience.
Every conversation you have — and every conversation the other 1.4 billion people on the platform have. In one second, the Facebook AI learns more about how people communicate and how they make choices as a result of their communication than an average person will learn in fifty years.This is somewhat of an exaggeration at this point, but won't be in a decade or two. AI is becoming more capable than humans in many areas and, to the extent that AI is "intelligent" at all, it's a completely alien intelligence. While it sometimes seems almost human, there's nothing human about it. For example, when you're having an oh-so-pleasant conversation with Siri or Google's Assistant or one of the many automated phone systems you regularly encounter, the entity with which you're conversing has nothing in common with a human. Nothing at all. It's not even programmed by a human in any sort of conventional sense. It's just an alien entity trained to do various tasks like set your alarm clock when you ask it to do so.
When the trainers train it to do benign and helpful things it will be (mostly) benign and helpful. However, if the trainers, such as those working for social media companies, train it to manipulate social media users via emotional and other human weaknesses in order to increase profits and power, it will do that too - without having any understanding whatsoever of what it's doing. It's not immoral, just amoral. In fact, the trainers themselves may not really know what they're doing. They may just be trying to sell more advertising or whatever.
The problem is that we are changing our behaviors in ways that are simply bad for social cohesion and civilization itself. We'll see how that works out. Even those of us who are a little older we'll get to see how this one works out because I believe much of the impact will be experienced within the next 20 years.
Related: Nvidia DGX-2 is 2 petaflop AI supercomputer for $399,000