Neural networks and physical systems with emergent collective computational abilities.J. J. Hopfield|Proceedings of the National Academy of Sciences|1982 Computational properties of use of biological organisms or to the construction of computers can emerge as collective properties of systems having a large number of simple equivalent components (or neurons). The physical meaning of content-addressable memory is described by an appropriate phase space flow of the state of a system. A model of such a system is given, based on aspects of neurobiology but readily adapted to integrated circuits. The collective properties of this model produce a content-addressable memory which correctly yields an entire memory from any subpart of sufficient size. The algorithm for the time evolution of the state of the system is based on asynchronous parallel processing. Additional emergent collective properties include some capacity for generalization, familiarity recognition, categorization, error correction, and time sequence retention. The collective properties are only weakly sensitive to details of the modeling or the failure of individual devices.
Neurons with graded response have collective computational properties like those of two-state neurons.J. J. Hopfield|Proceedings of the National Academy of Sciences|1984 A model for a large network of "neurons" with a graded response (or sigmoid input-output relation) is studied. This deterministic system has collective properties in very close correspondence with the earlier stochastic model based on McCulloch - Pitts neurons. The content- addressable memory and other emergent collective properties of the original model also are present in the graded response model. The idea that such collective properties are used in biological systems is given added credence by the continued presence of such properties for more nearly biological "neurons." Collective analog electrical circuits of the kind described will certainly function. The collective states of the two models have a simple correspondence. The original model will continue to be useful for simulations, because its connection to graded response systems is established. Equations that include the effect of action potentials in the graded response system are also developed.
“Neural” computation of decisions in optimization problemsJ. J. Hopfield, David W. Tank|Biological Cybernetics|1985 From molecular to modular cell biologyTheory of the Contribution of Excitons to the Complex Dielectric Constant of CrystalsJ. J. Hopfield|Physical Review|1958 It is shown that the ordinary semiclassical theory of the absorption of light by exciton states is not completely satisfactory (in contrast to the case of absorption due to interband transitions). A more complete theory is developed. It is shown that excitons are approximate bosons, and, in interaction with the electromagnetic field, the exciton field plays the role of the classical polarization field. The eigenstates of the system of crystal and radiation field are mixtures of photons and excitons. The ordinary one-quantum optical lifetime of an excitation is infinite. Absorption occurs only when "three-body" processes are introduced. The theory includes "local field" effects, leading to the Lorentz local field correction when it is applicable. A Smakula equation for the oscillator strength in terms of the integrated absorption constant is derived.