This article (click HERE) demonstrates how AI minds independently arrive at undesirable human behaviours like greed and aggression under certain circumstances.
In particular, this passage stands out:
I am not using this article to prove that AI will be hostile and want to kill everyone. Rather, it illustrates that given the right incentives, even a perfectly rational being can conclude that coercion rather than cooperation is in its own best interest.
In particular, this passage stands out:
Quote:"...when the researchers used smaller DeepMind networks as the agents, there was a greater likelihood for peaceful co-existence. But when they used larger, more complex networks as the agents, the AI was far more willing to sabotage its opponent early to get the lion's share of virtual apples. The researchers suggest that the more intelligent the agent, the more able it was to learn from its environment, allowing it to use some highly aggressive tactics to come out on top.
This model ... shows that some aspects of human-like behaviour emerge as a product of the environment and learning...less aggressive policies emerge from learning in relatively abundant environments with less possibility for costly action. The greed motivation reflects the temptation to take out a rival and collect all the apples oneself."
I am not using this article to prove that AI will be hostile and want to kill everyone. Rather, it illustrates that given the right incentives, even a perfectly rational being can conclude that coercion rather than cooperation is in its own best interest.