In this paper we continue our investigation on the high storage regime of a neural network with Gaussian patterns. Through an exact mapping between its partition function and one of a bipartite spin glass (whose parties consist of Ising and Gaussian spins respectively), we give a complete control of the whole annealed region. The strategy explored is based on an interpolation between the bipartite system and two independent spin glasses built respectively by dichotomic and Gaussian spins: critical line, behavior of the principal thermodynamic observables and their fluctuations as well as overlap fluctuations are obtained and discussed. Then, we move further, extending such an equivalence beyond the critical line, to explore the broken ergodicity phase under the assumption of replica symmetry and show that the quenched free energy of this (analogical) Hopfield model can be described as a linear combination of the two quenched spin glass free energies even in the replica symmetric framework. © 2012 IOP Publishing Ltd and SISSA Medialab srl.

Adriano Barra, Giuseppe Genovese, Francesco Guerra, Daniele Tantari (2012). How glassy are neural networks?. JOURNAL OF STATISTICAL MECHANICS: THEORY AND EXPERIMENT, 2012, P07009-P07025 [10.1088/1742-5468/2012/07/p07009].

How glassy are neural networks?

Daniele Tantari
2012

Abstract

In this paper we continue our investigation on the high storage regime of a neural network with Gaussian patterns. Through an exact mapping between its partition function and one of a bipartite spin glass (whose parties consist of Ising and Gaussian spins respectively), we give a complete control of the whole annealed region. The strategy explored is based on an interpolation between the bipartite system and two independent spin glasses built respectively by dichotomic and Gaussian spins: critical line, behavior of the principal thermodynamic observables and their fluctuations as well as overlap fluctuations are obtained and discussed. Then, we move further, extending such an equivalence beyond the critical line, to explore the broken ergodicity phase under the assumption of replica symmetry and show that the quenched free energy of this (analogical) Hopfield model can be described as a linear combination of the two quenched spin glass free energies even in the replica symmetric framework. © 2012 IOP Publishing Ltd and SISSA Medialab srl.
2012
Adriano Barra, Giuseppe Genovese, Francesco Guerra, Daniele Tantari (2012). How glassy are neural networks?. JOURNAL OF STATISTICAL MECHANICS: THEORY AND EXPERIMENT, 2012, P07009-P07025 [10.1088/1742-5468/2012/07/p07009].
Adriano Barra; Giuseppe Genovese; Francesco Guerra; Daniele Tantari
File in questo prodotto:
Eventuali allegati, non sono esposti

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11585/717998
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 39
  • ???jsp.display-item.citation.isi??? 28
social impact