understood, and everything else is something the universal cortical learning figures out on its own
Epstein Suite indexes the text; the original document lives at its official source. We don't host the original file — view it on the official release to read it in full.
View the original on the official releaseDocument text
Text is machine OCR and may contain errors. Confirm against the original source above.
understood, and everything else is something the universal cortical learning figures out on its own.
This is a hypothesis that is shared by a growing number of people these days. In humans, it is reflected for
instance by the fact that races with faster motor development have lower IQ. (In individuals of the same
group, slower development often indicates defects, of course.)
Another support comes from machine learning: we find that the same learning functions can learn visual and
auditory pattern recognition, and even end-to-end-learning. Google has built automatic image recognition into
their current photo app:
http://blogs.wsj.com/digits/2015/07/01/google-mistakenly-tags-black-people-as-gorillas-showing-limits-of-
algorithms/
The state of the art in research can do better than that: it can begin to "Imagine" things. I.e. when the
experimenter asks the system to "dream" what a certain object looks like, the system can produce a somewhat
compelling image, which indicates that it is indeed learning visual structure. This stuff is something nobody
could do a few months ago:
http://www.creativeai.net/posts/Mv4 WGé6rdzAerZF7ch/synthesizing-preferred-inputs-via-deep-generator-
networks
A machine learning program that can learn how to play an Atari game without any human supervision or
hand-crafted engineering (the feat that gave DeepMind 500M from Google) now just takes about 130 lines of
Python code.
These models do not have interesting motivational systems, and a relatively simple architecture. They
currently seem to mimic some of the stuff that goes on in the first few layers of the cortex. They learn object
features, visual styles, lighting and rotation in 3d, and simple action policies. Almost everything else is
missing. But there is a lot of enthusiasm that the field might be on the right track, and that we can learn motor
simulations and intuitive physics soon. (The majority of the people in AI do not work on this, however. They
try to improve the performance for the current benchmarks.)
Noam's criticism of machine translation mostly applies to the Latent Semantic Analysis models that Google
and others have been using for many years. These models map linguistic symbols to concepts, and relate
concepts to each other, but they do not relate the concepts to "proper" mental representations of what objects
and processes look like and how they interact. Concepts are probably one of the top layers of the learning
hierarchy, i.e. they are acquired *after* we learn to simulate a mental world, not before. Classical linguists
ignored the simulation of a mental world entirely.
It seems miraculous that purely conceptual machine translation works at all, but that is because concepts are
shared between speakers, so the structure of the conceptual space can be inferred from the statistics of
language use. But the statistics of language use have too little information to infer what objects look like and
how they interact.
My own original ideas concern a few parts of the emerging understanding of what the brain does. The
"request-confirmation networks" that I have introduced at a NIPS workshop in last the December are an
attempt at modeling how the higher layers might self-organize into cognitive programs.
Cheers!
HOUSE_OVERSIGHT_025958
Have a question about what this document contains?
Ask the documents