在以下文章中，

UNDERSTANDING HOW DEEP BELIEF NETWORKS PERFORM ACOUSTIC MODELLING
Abdel-rahman Mohamed, Geoffrey Hinton, and Gerald Penn
Department of Computer Science, University of Toronto

作者对distributed representation有个简单的介绍：

A very important feature of neural networks
is their ”distributed representation” of the input, i.e., many neurons
are active simultaneously to represent each input vector.