Every indexed document

even if we have trouble explicating it. They would use what we say and

as that would lead to a lower specified reward.

as exemplified by all those genie legends. An AI paradigm in which robots

when combined with unusual instances of a task

we could write down a reward function that

ade a degree of progress in meeting these challenges

but people will need good mental models of robots.

to what role we each take when we collaborate on preparing breakfast

enabling them to take part in the negotiations people

too. It is important for robots to account for this when deciding

that influences what actions the human starts taking.

for instance.) What the intent-prediction approach misses

we’re probably going to enter the next room

you often reach around other objects and stop when you

so we might include the physical location of the person in the

it’s tempting to abstract people away. A

we’ll have to define “human-compatible” AI from the getgo.

we can’t create them in isolation from people and then try to make them

if we want highly capable AIs to be compatible

where you have to actually interact with