THE CRITICAL CAPACITY OF THE HOPFIELD MODEL

Primarily AI-generated textHuman understanding: some partsmath.PR — Probability

Contributed by Yuwen Zhou ↗

Version 1 / Nov 05, 2026 / CC BY 4.0

Abstract

Abstract. We prove that the critical capacity of the Hopfield model at zero temperature lies in [0.138198129, 0.13820106]. The best rigorous lower bound was 0.113, and our lower end exceeds the published one-step and two-step replica symmetry breaking values. The capacity is the supremum of the loads at which the free energy at fixed overlap with one pattern has a well. At every positive temperature, we give a variational formula for this free energy and show that binary patterns and Gaussian rows have the same wells, which characterizes the capacity. The proof builds on the Hamilton–Jacobi solution of the model by Ali, Boursier, Chen, Ho, Issa and Mourrat, and on a

Provenance statement

The statements, proofs, code and text were generated mainly by AI systems: Claude Opus 5.5 (Anthropic) derived the proofs and wrote the rest, and GPT-6.1 Sol (OpenAI) wrote an independent report on each result. A final audit by fresh AI readers covered the longer version in the repository. Parts checked and understood by a human: Yuwen Zhou Code and data: https://github.com/OctopusTide/hopfield-capacity

References

  1. A. Ali, J. Boursier, H.-B. Chen, F.-H. Ho, V. Issa, and J.-C. Mourrat, Free energy of the H opfield model , arXiv:2611.03306, 2026.arXiv
  2. D. J. Amit, H. Gutfreund, and H. Sompolinsky, Storing infinite numbers of patterns in a spin-glass model of neural networks , Phys. Rev. Lett. 55 (1985), 1530--1533.
  3. — , Statistical mechanics of neural networks near saturation , Ann. Physics 173 (1987), 30--67.
  4. A. Auffinger and W.-K. Chen, Parisi formula for the ground state energy in the mixed pp-spin model , Ann. Probab. 45 (2017), 4617--4631.
  5. A. Barra and F. Durante, Existence of the thermodynamic limit for the H opfield model , arXiv:2610.41938, 2026.arXiv
  6. J. Boursier and J.-C. Mourrat, Free energy of non-convex multi-species I sing spin glasses with external fields , arXiv:2610.18350, 2026.arXiv
  7. F. Camilli, P. Contucci, and E. Mingione, The solution of the H opfield model with G aussian patterns , arXiv:2610.32618, 2026.arXiv
  8. H.-B. Chen, F.-H. Ho, and V. Issa, A formula for the free energy of non-convex vector spin glasses , arXiv:2610.18744, 2026.arXiv
  9. H.-B. Chen and J.-C. Mourrat, Free energy of non-convex multi-species spherical spin glasses , arXiv:2609.32710, 2026.arXiv
  10. A. Crisanti, D. J. Amit, and H. Gutfreund, Saturation level of the H opfield model for neural network , Europhys. Lett. 2 (1986), 337--341.
Show all 24 referencesShow fewer references
  1. J. Feng, M. Shcherbina, and B. Tirozzi, On the critical capacity of the H opfield model , Comm. Math. Phys. 216 (2001), 139--177.
  2. J. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities , Proc. Natl. Acad. Sci. USA 79 (1982), 2554--2558.
  3. F. Johansson, Arb: efficient arbitrary-precision midpoint-radius interval arithmetic , IEEE Trans. Comput. 66 (2017), 1281--1292.
  4. G. A. Kohring, A high-precision study of the H opfield model in the phase of broken replica symmetry , J. Stat. Phys. 59 (1990), 1077--1086.
  5. D. Loukianova, Lower bounds on the restitution error in the H opfield model , Probab. Theory Related Fields 107 (1997), 161--176.
  6. C. M. Newman, Memory capacity in neural network models: rigorous lower bounds , Neural Networks 1 (1988), 223--238.
  7. R. T. Rockafellar, Convex analysis , Princeton University Press, 1970.
  8. M. Sion, On general minimax theorems , Pacific J. Math. 8 (1958), 171--176.
  9. H. Steffan and R. K ü hn, Replica symmetry breaking in attractor neural network models , Z. Phys. B 95 (1994), 249--260.
  10. T. Stiefvater, K.-R. M ü ller, and R. K ü hn, Averaging and finite-size analysis for disorder: the H opfield model , Phys. A 232 (1996), 61--73.
  11. M. Stojnic, Capacity of the H ebbian-- H opfield network associative memory , arXiv:2403.01907, 2024.arXiv
  12. — , Capacity of the H opfield-- H ebbian dynamics with correlated patterns , arXiv:2610.38437, 2026.arXiv
  13. M. Talagrand, Rigorous results for the H opfield model with many patterns , Probab. Theory Related Fields 110 (1998), 177--275.
  14. L. N. Trefethen and J. A. C. Weideman, The exponentially convergent trapezoidal rule , SIAM Rev. 56 (2014), 385--458.

Version history

  1. v1 · 57 pagesSubmitted by Yuwen ZhouInitial depositCurrentNov 04, 2026