Every indexed document

one can formulate and solve the off-switch

the way the game is defined encourages Harriet to “teach”

should produce two staples. But in that case

he believes θ is equally likely to be any value

so he isn’t sure how many of each to produce.

because while the human knows the reward

they’re grounded in a voluminous source of evidence—namely

although the future-life preferences are

but it doesn’t seem to prevent us from designing

and let F be the problem of maximizing the expected sum of

corresponding to how well the machine has

we’ll be able to create provably beneficial AI.

such that no matter how perfectly a system solves F

so that we’re sure to be happy with how they behave? On the

then “smarter than gorillas” is also meaningless

but it is utterly meaningless for current AI

“so ‘smarter than humans’ is a meaningless

or indeed many other games still to be invented. Put another

the goal of checkmate; the same chessboard and pieces can be used

given its experience of the world. This is