Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1112.4814

On mean-field approximations for estimating correlations and solving the inverse Ising problem

Federico Ricci‐Tersenghi, Piazzale Aldo Moro

Published Dec 20, 2011• 3 citations
arXivHTMLPDF

Abstract

The inverse Ising problem consists in inferring the coupling constants of an Ising model given the correlation matrix. The fastest methods for solving this problem are based on mean-field approximations, but which one performs better in the general case is still not completely clear. In the first part of this work, I summarize the formulas for several mean- field approximations and I derive new analytical expressions for the Bethe approximation, which allow to solve the inverse Ising problem without running the Susceptibility Propagation algorithm (thus avoiding the lack of convergence). In the second part, I compare the accuracy of different mean field approximations on several models (diluted ferromagnets and spin glasses) defined on random graphs and regular lattices, showing which one is in general more effective. A simple improvement over these approximations is proposed. Also a fundamental limitation is found in using methods based on TAP and Bethe approximations in presence of an external field.

Related papers

Estimation of quenched random fields in the inverse Ising problem using a diagonal matching method

Hirohito Kiwata

We consider a method for the accurate estimation of quenched random fields in the inverse Ising problem. Approximations such as the mean-field or Bethe methods are applied to estimate quenched random coupling parameters and external fields. A diagonal matching method is introduced to ensure consistency of the diagonal part of the susceptibility, and the method yields an accurate estimation of the external fields. We introduce the diagonal matching method into the mean-field, Thouless-Anderson-Palmer, and Bethe approximations, and we investigate the effect of the diagonal matching method on the accuracy of estimation of the external fields.

Physical Review E•Jun 26, 2014•4 citations

Belief propagation with multipoint correlations and its application to inverse problem

Masayuki Ohzeki

We give explicit formulas of the Bethe approximation with multipoint correlations for systems with magnetic field. The obtained formulas include the closed form of the magnetization and the correlations between adjacent degrees of freedom. On the basis of our results, we propose a new iterative algorithm of the improved Bethe approximation. We confirm that the proposed technique is available for the random spin systems and indeed gives more accurate locations of the critical points. We discuss the possibility of the application of our method to the inverse Ising model by use of these equations.

arXiv:1306.0283•Journal of Physics Conference Series•Dec 16, 2013•5 citations

Intrinsic limitations of the susceptibility propagation inverse inference for the mean field Ising spin glass

Enzo Marinari, Valery Van Kerrebroeck

We analyze the limits inherent to the inverse reconstruction of a pairwise Ising spin glass based on susceptibility propagation. We establish the conditions under which the susceptibility propagation algorithm is able to reconstruct the characteristics of the network given first- and second-order local observables, evaluate eventual errors due to various types of noise in the originally observed data, and discuss the scaling of the problem with the number of degrees of freedom.

arXiv:0911.1985•Journal of Statistical Mechanics Theory and Experiment•Feb 8, 2010•27 citations

Generalized mean field approximation for parallel dynamics of the Ising model

Hamed Mahmoudi, David Saad

The dynamics of the non-equilibrium Ising model with parallel updates is investigated using a generalized mean field approximation that incorporates multiple two-site correlations at any two time steps, which can be obtained recursively. The proposed method shows significant improvement in predicting local system properties compared to other mean field approximation techniques, particularly in systems with symmetric interactions. Results are also evaluated against those obtained from Monte Carlo simulations. The method is also employed to obtain parameter values for the kinetic inverse Ising modeling problem, where couplings and local field values of a fully connected spin system are inferred from data.

arXiv:1310.5460•Journal of Statistical Mechanics Theory and Experiment•Jul 2, 2014•15 citations

Pecularities of Bethe-like approximations and long-range-interaction Ising models

James L. Monroe

The mean-field approximation and the Bethe approximation are two of the most often used approximations when one wants to obtain approximations of the phase diagrams and the critical temperature of lattice spin systems. Both can and have often been generalized to produce what are known as cluster mean-field and Bethe approximations. Generally, three characteristics are associated with these approximations. First, they give upper bounds to the critical temperature; second, considering larger clusters will result in better approximations; and third, the Bethe approximation is better than the corresponding mean-field approximation. We show what we believe to be a rather surprising result that, for one-dimensional Ising models with algebraically decaying interactions falling off slowly enough, the Bethe cluster approximations violate all three of these characteristics.

Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics•Aug 12, 2003•2 citations

How to compute loop corrections to the Bethe approximation

Andrea Montanari A, Tommaso Rizzo

We introduce a method for computing corrections to the Bethe approximation for spin models on arbitrary lattices. Unlike cluster variational methods, the new approach takes into account fluctuations on all length scales. The derivation of the leading correction is explained and applied to two simple examples: the ferromagnetic Ising model on d -dimensional lattices, and the spin glass on random graphs (both in their high-temperature phases). In the first case we rederive the well known Ginzburg criterion and the upper critical dimension. In the second, we compute finite-size corrections to the free energy.

arXiv:cond-mat/0506769•Journal of Statistical Mechanics Theory and Experiment•Oct 21, 2005•81 citations
The inverse Ising problem consists in inferring the coupling constants of an Ising model given the correlation matrix. The fastest methods for solving this problem are based on mean-field approximations, but which one performs better in the general case is still not completely clear. In the first part of this work, I summarize the formulas for several mean- field approximations and I derive new analytical expressions for the Bethe approximation, which allow to solve the inverse Ising problem without running the Susceptibility Propagation algorithm (thus avoiding the lack of convergence). In the second part, I compare the accuracy of different mean field approximations on several models (diluted ferromagnets and spin glasses) defined on random graphs and regular lattices, showing which one is in general more effective. A simple improvement over these approximations is proposed. Also a fundamental limitation is found in using methods based on TAP and Bethe approximations in presence of an external field.
We consider a method for the accurate estimation of quenched random fields in the inverse Ising problem. Approximations such as the mean-field or Bethe methods are applied to estimate quenched random coupling parameters and external fields. A diagonal matching method is introduced to ensure consistency of the diagonal part of the susceptibility, and the method yields an accurate estimation of the external fields. We introduce the diagonal matching method into the mean-field, Thouless-Anderson-Palmer, and Bethe approximations, and we investigate the effect of the diagonal matching method on the accuracy of estimation of the external fields.
We give explicit formulas of the Bethe approximation with multipoint correlations for systems with magnetic field. The obtained formulas include the closed form of the magnetization and the correlations between adjacent degrees of freedom. On the basis of our results, we propose a new iterative algorithm of the improved Bethe approximation. We confirm that the proposed technique is available for the random spin systems and indeed gives more accurate locations of the critical points. We discuss the possibility of the application of our method to the inverse Ising model by use of these equations.
The dynamics of the non-equilibrium Ising model with parallel updates is investigated using a generalized mean field approximation that incorporates multiple two-site correlations at any two time steps, which can be obtained recursively. The proposed method shows significant improvement in predicting local system properties compared to other mean field approximation techniques, particularly in systems with symmetric interactions. Results are also evaluated against those obtained from Monte Carlo simulations. The method is also employed to obtain parameter values for the kinetic inverse Ising modeling problem, where couplings and local field values of a fully connected spin system are inferred from data.
The mean-field approximation and the Bethe approximation are two of the most often used approximations when one wants to obtain approximations of the phase diagrams and the critical temperature of lattice spin systems. Both can and have often been generalized to produce what are known as cluster mean-field and Bethe approximations. Generally, three characteristics are associated with these approximations. First, they give upper bounds to the critical temperature; second, considering larger clusters will result in better approximations; and third, the Bethe approximation is better than the corresponding mean-field approximation. We show what we believe to be a rather surprising result that, for one-dimensional Ising models with algebraically decaying interactions falling off slowly enough, the Bethe cluster approximations violate all three of these characteristics.
We introduce a method for computing corrections to the Bethe approximation for spin models on arbitrary lattices. Unlike cluster variational methods, the new approach takes into account fluctuations on all length scales. The derivation of the leading correction is explained and applied to two simple examples: the ferromagnetic Ising model on d -dimensional lattices, and the spin glass on random graphs (both in their high-temperature phases). In the first case we rederive the well known Ginzburg criterion and the upper critical dimension. In the second, we compute finite-size corrections to the free energy.