I wrote a post a month or so ago, which I called Humanity 2.0, which was quite widely circulated and worth a read if you missed it, even though I say so myself. My basic premise was that as Artificial Intelligence take us nearer to The Singularity (where machines take over the world), we should think and debate about what that new world might be like. Because there are some very scary scenarios that might emerge.
This week, a bunch of eminent scientists agreed with me – though I’m sure they didn’t read my post – as they expressed concern over the increasing use of robots in combat roles.
The problem….was that robots could not fulfil two of the basic tenets of warfare: discriminating friend from foe, and “proportionality”, determining a reasonable amount of force to gain a given military advantage.
While the headline to this post sounds like the title of a bad B movie from the 1950s, it is an area that we need to start deeply thinking about. Rogue robots are one of the more obvious manifestations of machines taking over. I’d argue that we need to also be concerned about the more subtle and innocuous use of machines in decision-making capacities and the implications of things going wrong, whether that be due to malicious intent, viruses, hackers or even the potentially sinister “machines know what’s best for man”.
Do mankind a favour and share the Singularity vision with a friend. Help them understand the consequences. If we’re going to make this happen, let us at least understand the implications for our future.