Daydreaming Algorithm for Biased Patterns

The Daydreaming algorithm was proposed as a learning rule that simultaneously reinforces stored patterns and suppresses spurious attractors to improve the storage capacity of the Hopfield model. Its effectiveness has been reported for both uncorrelated and correlated data. However, the existing formulation has mainly assumed unbiased patterns, and the formulation for biased patterns has not yet been sufficiently established. Biased patterns are known to be much more problematic for models of associative memories. In this study, we reformulate Daydreaming for biased patterns by starting from the underlying rationale of the pseudo-inverse rule. Specifically, we introduce the retrieval dynamics and an energy function based on the centered representation, and we derive a corresponding update rule for centered Daydreaming. We compare the centered pseudo-inverse rule with centered Daydreaming for biased patterns and examine the retrieval maps and eigenvalue distributions of the coupling matrices. Our results confirm that centered Daydreaming yields a larger basin of attraction than the centered pseudo-inverse rule. Moreover, as in previous studies, although both approaches aim to stabilize the stored patterns as fixed points, our results suggest that they shape the energy landscape through different mechanisms.