Some rather interesting commentary by Eliezer Yudkowsky.
https://www.facebook.com/yudkowsky/posts...8209759228
Basically, superhuman AI performance in a particular field would not look immediately obvious. Rather than outright domination, there will be a invisible shifting of odds to the AI's favor for a while, until this advantage becomes big enough to be noticeable for the human player. And by this time it is too late for any counter-strategy to be effective as the game is already lost.
Lesser intelligences in OA universe are surely familiar with this phenomena
https://www.facebook.com/yudkowsky/posts...8209759228
Basically, superhuman AI performance in a particular field would not look immediately obvious. Rather than outright domination, there will be a invisible shifting of odds to the AI's favor for a while, until this advantage becomes big enough to be noticeable for the human player. And by this time it is too late for any counter-strategy to be effective as the game is already lost.
Lesser intelligences in OA universe are surely familiar with this phenomena
Quote: AlphaGo is still a nice accidental illustration that when you've been placed in an adversarial relation to something smarter than you, you don't always know that you've lost, or that anything is even wrong, until the end