This paper presents a method to expand the basins of stable patterns in associative memory. It examines fully-connected associative
memory geometrically and translate the learning process into an algebraic optimization procedure. It finds that locating all
the patterns at certain stable corners of the neurons’ hypercube as far from the decision hyperplanes as possible can produce
excellent error tolerance. It then devises a method based on this finding to develop the hyperplanes. This paper further shows
that this method leads to the hairy model, or the deterministic analogue of the Gibb’s free energy model. Through simulations,
it shows that this method gives better error tolerance than does the Hopfield model and the error-correction rule in both
synchronous and asynchronous modes.
Keywords associative memory - error-correction rule - Gibb’s free energy - hairy model - Hopfield network - Little model - music perception - neural network - spin glass model