Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2403.00562

Comment on "Controlled Bond Expansion for Density Matrix Renormalization Group Ground State Search at Single-Site Costs" (Extended Version)

Ian P. McCulloch, Jesse J. Osborne

Published Mar 1, 2024• 18 citations
arXivHTMLPDF

Abstract

In a recent Letter [Phys. Rev. Lett. 130, 246402 (2023)], Gleis, Li, and von Delft present an algorithm for expanding the bond dimension of a Matrix Product State wave function, giving accuracy similar to 2-site DMRG, but computationally more efficient, closer to the performance of 1-site DMRG. The Controlled Bond Expansion (CBE) algorithm uses the Hamiltonian projected onto two sites, and then further projected onto the two-site tangent space, to extract a set of $k$ vectors that are used to expand the basis between the two sites. CBE achieves this with a complicated sequence of five singular value decompositions (SVDs), in order to project onto the 2-site tangent space and reduce the bond dimension of the tensor network such that the contraction can be done in time $O(dwD^3)$. In this Comment, we show that (1) the projection onto the 2-site tangent space is unnecessary, and is generally not helpful; (2) the sequence of 5 SVDs can be replaced by a single $QR$ decomposition (optionally with one SVD as well), making use of the randomized SVD (RSVD) with high accuracy and significantly improved efficiency, scaling as $O(dwkD^2)$ i.e., the most expensive operations are only quadratic in the bond dimension $D$ and linear in the number of expansion vectors $k$; (3) several statements about the variational properties of the CBE algorithm are incorrect, and the variational properties are essentially identical to existing algorithms including 2-site DMRG and single-site subspace expansion (3S); (4) a similar RSVD approach can be applied to the 3S algorithm, which leads to many advantages over CBE, especially in systems with long range interactions. We also make some comments on the benchmarking MPS algorithms, and the overall computational efficiency with respect to the accuracy of the calculation.

DOI
10.48550/arxiv.2403.00562

Related papers

Reply to comment on "Controlled bond expansion for Density Matrix Renormalization Group ground state search at single-site costs"

Andreas Gleis, Jheng-Wei Li, Jan von Delft

We reply to McCulloch and Osborne's recent comment on our manuscript (Phys. Rev. Lett. 130, 246402 (2023)) on controlled bond expansion (CBE) for density matrix renormalization group (DMRG) ground state search. We appreciate their suggestion to consider randomized SVD and address their constructive critique on the variational properties of CBE-DMRG. However, we strongly disagree with their proposal to omit the projection to the 2-site tangent space and explain its importance for efficient bond expansion. In particular, in the context of CBE applied to the time-dependent variational principle (TDVP), we show that omitting this projection can lead to avoidable errors. Lastly, we emphasize the complementary roles of 3S mixing and CBE, reiterating our recommendation from Phys. Rev. Lett. 130, 246402 (2023) to combine both methods (CBE+$α$). We provide examples to demonstrate the superior efficiency and robustness of CBE+$α$.

arXiv:2501.12291•Jan 21, 2025•5 citations

Controlled Bond Expansion for Density Matrix Renormalization Group Ground State Search at Single-Site Costs

Andreas Gleis, Jheng-Wei Li, Jan von Delft

DMRG ground state search algorithms employing symmetries must be able to expand virtual bond spaces by adding or changing symmetry sectors if these lower the energy. Traditional single-site DMRG does not allow bond expansion; two-site DMRG does, but at much higher computational costs. We present a controlled bond expansion (CBE) algorithm that yields two-site accuracy and convergence per sweep, at single-site costs. Given a matrix product state Ψ defining a variational space, CBE identifies parts of the orthogonal space carrying significant weight in HΨ and expands bonds to include only these. CBE-DMRG uses no mixing parameters and is fully variational. Using CBE-DMRG, we show that the Kondo-Heisenberg model on a width 4 cylinder features two distinct phases differing in their Fermi surface volumes.

arXiv:2207.14712•Physical Review Letters•Jun 16, 2023•44 citations

Accurate variational electronic structure calculations with the density matrix renormalization group

Sebastian Wouters

During the past 15 years, the density matrix renormalization group (DMRG) has become increasingly important for ab initio quantum chemistry. The underlying matrix product state (MPS) ansatz is a low-rank decomposition of the full configuration interaction tensor. The virtual dimension of the MPS controls the size of the corner of the many-body Hilbert space that can be reached. Whereas the MPS ansatz will only yield an efficient description for noncritical one-dimensional systems, it can still be used as a variational ansatz for other finite-size systems. Rather large virtual dimensions are then required. The two most important aspects to reduce the corresponding computational cost are a proper choice and ordering of the active space orbitals, and the exploitation of the symmetry group of the Hamiltonian. By taking care of both aspects, DMRG becomes an efficient replacement for exact diagonalization in quantum chemistry. DMRG and Hartree-Fock theory have an analogous structure. The former can be interpreted as a self-consistent mean-field theory in the DMRG lattice sites, and the latter in the particles. It is possible to build upon this analogy to introduce post-DMRG methods. Based on an approximate MPS, these methods provide improved ansätze for the ground state, as well as for excitations. Exponentiation of the single-particle (single-site) excitations for a Slater determinant (an MPS with open boundary conditions) leads to the Thouless theorem for Hartree-Fock theory (DMRG), an explicit nonredundant parameterization of the entire manifold of Slater determinants (MPS wavefunctions). This gives rise to the configuration interaction expansion for DMRG. The Hubbard-Stratonovich transformation lies at the basis of auxiliary field quantum Monte Carlo for Slater determinants. An analogous transformation for spin-lattice Hamiltonians allows to formulate a promising variant for MPSs.

arXiv:1405.1225•May 6, 2014•3 citations

What can DMRG learn from (post-)Hartree-Fock theory?

Sebastian Wouters

The density matrix renormalization group (DMRG) has an underlying variational ansatz, the matrix product state (MPS). The accuracy of this ansatz is controlled by its virtual dimension. In most applications for quantum chemistry this parameter is very large, and the high-accuracy or FCI regime is studied. With a good orbital choice and ordering, and by exploiting the symmetry group of the Hamiltonian, DMRG then allows to retrieve highly accurate results in active spaces beyond the reach of FCI. However, DMRG can also be of use with smaller virtual dimensions. I will discuss how fundamental ideas from Hartree-Fock (HF) theory are transferable to DMRG. Both methods have a variational ansatz. The time-independent variational principle leads for HF and DMRG to a self-consistent mean-field theory in the particles and lattice sites, respectively. The time-dependent variational principle results in the random-phase approximation (RPA). RPA reveals the elementary excitations: particle and site excitations for HF and DMRG, respectively. Exponentiation of these excitations provides a nonredundant parameterization of the ansatz manifold, formulated by Thouless’ theorem. A Taylor expansion in the nonredundant parameters leads to the configuration interaction expansion. I will also discuss how auxiliary field quantum Monte Carlo for Slater determinants can be extended for matrix product states.

•Jan 1, 2015•0 citations

Thouless theorem for matrix product states and subsequent post density matrix renormalization group methods

Sebastian Wouters, Naoki Nakatani, Dimitri Van Neck +1 more

The similarities between Hartree-Fock (HF) theory and the density matrix renormalization group (DMRG) are explored. Both methods can be formulated as the variational optimization of a wave-function Ansatz. Linearization of the time-dependent variational principle near a variational minimum allows to derive the random phase approximation (RPA). We show that the nonredundant parameterization of the matrix product state (MPS) tangent space [J. Haegeman, J. I. Cirac, T. J. Osborne, I. Pi\ifmmode \check{z}\else \v{z}\fi{}orn, H. Verschelde, and F. Verstraete, Phys. Rev. Lett. 107, 070601 (2011)] leads to the Thouless theorem for MPS, i.e., an explicit nonredundant parameterization of the entire MPS manifold, starting from a specific MPS reference. Excitation operators are identified, which extends the analogy between HF and DMRG to the Tamm-Dancoff approximation (TDA), the configuration interaction (CI) expansion, and coupled cluster theory. For a small one-dimensional Hubbard chain, we use a CI-MPS Ansatz with single and double excitations to improve on the ground state and to calculate low-lying excitation energies. For a symmetry-broken ground state of this model, we show that RPA-MPS allows to retrieve the Goldstone mode. We also discuss calculations of the RPA-MPS correlation energy. With the long-range quantum chemical Pariser-Parr-Pople Hamiltonian, low-lying TDA-MPS and RPA-MPS excitation energies for polyenes are obtained.

arXiv:1305.1761•Physical Review B•Aug 12, 2013•50 citations

Strictly single-site DMRG algorithm with subspace expansion

Claudius Hubig, Ian P. McCulloch, Ulrich Schollwöck +1 more

We introduce a strictly single-site DMRG algorithm based on the subspace expansion of the alternating minimal energy (AMEn) method. The proposed new MPS basis enrichment method is sufficient to avoid local minima during the optimization, similar to the density matrix perturbation method, but computationally cheaper. Each application of $\stackrel{\ifmmode \hat{}\else \^{}\fi{}}{H}$ to $|\ensuremath{\Psi}\ensuremath{\rangle}$ in the central eigensolver is reduced in cost for a speed-up of $\ensuremath{\approx}(d+1)/2$, with $d$ the physical site dimension. Further speed-ups result from cheaper auxiliary calculations and an often greatly improved convergence behavior. Runtime to convergence improves by up to a factor of 2.5 on the Fermi-Hubbard model compared to the previous single-site method and by up to a factor of 3.9 compared to two-site DMRG. The method is compatible with real-space parallelization and non-Abelian symmetries.

arXiv:1501.05504•Physical Review B•Apr 10, 2015•198 citations
In a recent Letter [Phys. Rev. Lett. 130, 246402 (2023)], Gleis, Li, and von Delft present an algorithm for expanding the bond dimension of a Matrix Product State wave function, giving accuracy similar to 2-site DMRG, but computationally more efficient, closer to the performance of 1-site DMRG. The Controlled Bond Expansion (CBE) algorithm uses the Hamiltonian projected onto two sites, and then further projected onto the two-site tangent space, to extract a set of kkk vectors that are used to expand the basis between the two sites. CBE achieves this with a complicated sequence of five singular value decompositions (SVDs), in order to project onto the 2-site tangent space and reduce the bond dimension of the tensor network such that the contraction can be done in time O(dwD3)O(dwD^3)O(dwD3). In this Comment, we show that (1) the projection onto the 2-site tangent space is unnecessary, and is generally not helpful; (2) the sequence of 5 SVDs can be replaced by a single QRQRQR decomposition (optionally with one SVD as well), making use of the randomized SVD (RSVD) with high accuracy and significantly improved efficiency, scaling as O(dwkD2)O(dwkD^2)O(dwkD2) i.e., the most expensive operations are only quadratic in the bond dimension DDD and linear in the number of expansion vectors kkk; (3) several statements about the variational properties of the CBE algorithm are incorrect, and the variational properties are essentially identical to existing algorithms including 2-site DMRG and single-site subspace expansion (3S); (4) a similar RSVD approach can be applied to the 3S algorithm, which leads to many advantages over CBE, especially in systems with long range interactions. We also make some comments on the benchmarking MPS algorithms, and the overall computational efficiency with respect to the accuracy of the calculation.
We reply to McCulloch and Osborne's recent comment on our manuscript (Phys. Rev. Lett. 130, 246402 (2023)) on controlled bond expansion (CBE) for density matrix renormalization group (DMRG) ground state search. We appreciate their suggestion to consider randomized SVD and address their constructive critique on the variational properties of CBE-DMRG. However, we strongly disagree with their proposal to omit the projection to the 2-site tangent space and explain its importance for efficient bond expansion. In particular, in the context of CBE applied to the time-dependent variational principle (TDVP), we show that omitting this projection can lead to avoidable errors. Lastly, we emphasize the complementary roles of 3S mixing and CBE, reiterating our recommendation from Phys. Rev. Lett. 130, 246402 (2023) to combine both methods (CBE+ααα). We provide examples to demonstrate the superior efficiency and robustness of CBE+ααα.
DMRG ground state search algorithms employing symmetries must be able to expand virtual bond spaces by adding or changing symmetry sectors if these lower the energy. Traditional single-site DMRG does not allow bond expansion; two-site DMRG does, but at much higher computational costs. We present a controlled bond expansion (CBE) algorithm that yields two-site accuracy and convergence per sweep, at single-site costs. Given a matrix product state Ψ defining a variational space, CBE identifies parts of the orthogonal space carrying significant weight in HΨ and expands bonds to include only these. CBE-DMRG uses no mixing parameters and is fully variational. Using CBE-DMRG, we show that the Kondo-Heisenberg model on a width 4 cylinder features two distinct phases differing in their Fermi surface volumes.
During the past 15 years, the density matrix renormalization group (DMRG) has become increasingly important for ab initio quantum chemistry. The underlying matrix product state (MPS) ansatz is a low-rank decomposition of the full configuration interaction tensor. The virtual dimension of the MPS controls the size of the corner of the many-body Hilbert space that can be reached. Whereas the MPS ansatz will only yield an efficient description for noncritical one-dimensional systems, it can still be used as a variational ansatz for other finite-size systems. Rather large virtual dimensions are then required. The two most important aspects to reduce the corresponding computational cost are a proper choice and ordering of the active space orbitals, and the exploitation of the symmetry group of the Hamiltonian. By taking care of both aspects, DMRG becomes an efficient replacement for exact diagonalization in quantum chemistry. DMRG and Hartree-Fock theory have an analogous structure. The former can be interpreted as a self-consistent mean-field theory in the DMRG lattice sites, and the latter in the particles. It is possible to build upon this analogy to introduce post-DMRG methods. Based on an approximate MPS, these methods provide improved ansätze for the ground state, as well as for excitations. Exponentiation of the single-particle (single-site) excitations for a Slater determinant (an MPS with open boundary conditions) leads to the Thouless theorem for Hartree-Fock theory (DMRG), an explicit nonredundant parameterization of the entire manifold of Slater determinants (MPS wavefunctions). This gives rise to the configuration interaction expansion for DMRG. The Hubbard-Stratonovich transformation lies at the basis of auxiliary field quantum Monte Carlo for Slater determinants. An analogous transformation for spin-lattice Hamiltonians allows to formulate a promising variant for MPSs.
The density matrix renormalization group (DMRG) has an underlying variational ansatz, the matrix product state (MPS). The accuracy of this ansatz is controlled by its virtual dimension. In most applications for quantum chemistry this parameter is very large, and the high-accuracy or FCI regime is studied. With a good orbital choice and ordering, and by exploiting the symmetry group of the Hamiltonian, DMRG then allows to retrieve highly accurate results in active spaces beyond the reach of FCI. However, DMRG can also be of use with smaller virtual dimensions. I will discuss how fundamental ideas from Hartree-Fock (HF) theory are transferable to DMRG. Both methods have a variational ansatz. The time-independent variational principle leads for HF and DMRG to a self-consistent mean-field theory in the particles and lattice sites, respectively. The time-dependent variational principle results in the random-phase approximation (RPA). RPA reveals the elementary excitations: particle and site excitations for HF and DMRG, respectively. Exponentiation of these excitations provides a nonredundant parameterization of the ansatz manifold, formulated by Thouless’ theorem. A Taylor expansion in the nonredundant parameters leads to the configuration interaction expansion. I will also discuss how auxiliary field quantum Monte Carlo for Slater determinants can be extended for matrix product states.
The similarities between Hartree-Fock (HF) theory and the density matrix renormalization group (DMRG) are explored. Both methods can be formulated as the variational optimization of a wave-function Ansatz. Linearization of the time-dependent variational principle near a variational minimum allows to derive the random phase approximation (RPA). We show that the nonredundant parameterization of the matrix product state (MPS) tangent space [J. Haegeman, J. I. Cirac, T. J. Osborne, I. Pi\ifmmode \check{z}\else \v{z}\fi{}orn, H. Verschelde, and F. Verstraete, Phys. Rev. Lett. 107, 070601 (2011)] leads to the Thouless theorem for MPS, i.e., an explicit nonredundant parameterization of the entire MPS manifold, starting from a specific MPS reference. Excitation operators are identified, which extends the analogy between HF and DMRG to the Tamm-Dancoff approximation (TDA), the configuration interaction (CI) expansion, and coupled cluster theory. For a small one-dimensional Hubbard chain, we use a CI-MPS Ansatz with single and double excitations to improve on the ground state and to calculate low-lying excitation energies. For a symmetry-broken ground state of this model, we show that RPA-MPS allows to retrieve the Goldstone mode. We also discuss calculations of the RPA-MPS correlation energy. With the long-range quantum chemical Pariser-Parr-Pople Hamiltonian, low-lying TDA-MPS and RPA-MPS excitation energies for polyenes are obtained.
We introduce a strictly single-site DMRG algorithm based on the subspace expansion of the alternating minimal energy (AMEn) method. The proposed new MPS basis enrichment method is sufficient to avoid local minima during the optimization, similar to the density matrix perturbation method, but computationally cheaper. Each application of $\stackrel{\ifmmode \hat{}\else \^{}\fi{}}{H}$ to $|\ensuremath{\Psi}\ensuremath{\rangle}$ in the central eigensolver is reduced in cost for a speed-up of $\ensuremath{\approx}(d+1)/2$, with ddd the physical site dimension. Further speed-ups result from cheaper auxiliary calculations and an often greatly improved convergence behavior. Runtime to convergence improves by up to a factor of 2.5 on the Fermi-Hubbard model compared to the previous single-site method and by up to a factor of 3.9 compared to two-site DMRG. The method is compatible with real-space parallelization and non-Abelian symmetries.