Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2503.10380 · Journal of Chemical Theory and Computation

Toward Using Matrix-free Tensor Decompositions to Systematically Improve Approximate Tensor-Networks

Karl Pierce

Published Jun 26, 2025• 3 citations
arXivHTMLPDF

Abstract

We investigate a novel approach to approximate tensor-network contraction via the exact, matrix-free decomposition of full tensor-networks. We study this method as a means to eliminate the propagation of error in the approximation of tensor-networks. Importantly, this decomposition-based approach is generic, i.e., it does not depend on a specific tensor-network, the tensor index (physical) ordering, or the choice of tensor decomposition. Careful consideration should be made to determine the best decomposition strategy. Furthermore, this method does not rely on robust cancellation of errors (i.e., the Taylor expansion). As a means to study the effectiveness of the approach, we replace the exact contraction of the particle–particle ladder (PPL) tensor diagram in the popular coupled-cluster with single and double excitation (CCSD) method with a low-rank tensor decomposition, namely the canonical polyadic decomposition (CPD). With this approach, we replace an O ( N 6 ) tensor contractions with a potentially reduced-scaling O ( N 4 R ) optimization problem, where R is the CP rank, and we reduce the computational storage of the PPL tensor from O ( N 4 ) to O ( N R ), although we do not take advantage of this compression in this study. To minimize the cost of the CPD optimization, we utilize the iterative structure of CCSD to efficiently initialize the CPD optimization. We show that accurate chemically relevant energy values can be computed with an error of less than 1 kcal/mol using a relatively low CP rank.

DOI
10.1021/acs.jctc.5c00413

Related papers

Using Matrix-Free Tensor-Network Optimizations To Construct a Reduced-Scaling and Robust Second-Order Mo̷ller-Plesset Theory

Karl Pierce, Miguel A. Morales

We investigate the efficient combination of the canonical polyadic decomposition (CPD) and tensor hyper-contraction (THC) approaches. We first present a novel low-cost CPD solver that leverages a precomputed THC factorization of an order-4 tensor to efficiently optimize the order-4 CPD with O ( N R 2 ) scaling. With the matrix-free THC-based optimization strategy in hand, we can efficiently generate CPD factorizations of the order-4 two-electron integral tensors and develop novel electronic structure methods that take advantage of both the THC and CPD approximations. Next, we investigate the application of a combined CPD and THC approximation of the Laplace transform (LT) second-order Mo̷ller-Plesset (MP2) method. We exploit the ability to switch efficiently between the THC and CPD factorizations of the two-electron integrals to reduce the computational complexity of the LT MP2 method while preserving the accuracy of the approach. Furthermore, we take advantage of the robust fitting approximation to eliminate the leading-order error in the CPD approximated tensor networks. Finally, we show that modest values of THC and CPD rank preserve the accuracy of the LT MP2 method and that this CPD + THC LT MP2 strategy realizes a performance advantage over canonical LT MP2 in both computational wall-times and memory resource requirements.

arXiv:2502.17683•Journal of Chemical Theory and Computation•Jun 4, 2025•4 citations

Robust Approximation of Tensor Networks: Application to Grid-Free Tensor Factorization of the Coulomb Interaction

Karl Pierce, Varun Rishi, Edward F. Valeev

Approximation of a tensor network by approximating (e.g., factorizing) one or more of its constituent tensors can be improved by canceling the leading-order error due to the constituents’ approximation. The utility of such robust approximation is demonstrated for robust canonical polyadic (CP) approximation of a (density-fitting) factorized two-particle Coulomb interaction tensor. The resulting algebraic (grid-free) approximation for the Coulomb tensor, closely related to the factorization appearing in pseudospectral and tensor hypercontraction approaches, is efficient and accurate, with significantly reduced rank compared to the naive (nonrobust) approximation. Application of the robust approximation to the particle–particle ladder term in the coupled-cluster singles and doubles reduces the size complexity from O ( N 6 ) to O ( N 5 ) with robustness ensuring negligible errors in chemically relevant energy differences using CP ranks approximately equal to the size of the density-fitting basis.

arXiv:2012.13002•Journal of Chemical Theory and Computation•Mar 29, 2021•26 citations

Efficient Construction of Canonical Polyadic Approximations of Tensor Networks

Karl Pierce, Edward F. Valeev

We consider the problem of constructing a canonical polyadic (CP) decomposition for a tensor network, rather than a single tensor. We illustrate how it is possible to reduce the complexity of constructing an approximate CP representation of the network by leveraging its structure in the course of the CP factor optimization. The utility of this technique is demonstrated for the order-4 Coulomb interaction tensor approximated by two order-3 tensors via an approximate generalized square-root (SQ) factorization, such as density fitting or (pivoted) Cholesky. The complexity of constructing a four-way CP decomposition is reduced from O ( n 4 R CP ) (for the nonapproximated Coulomb tensor) to O ( n 3 R CP ) (for the SQ-factorized Coulomb tensor), where n and R CP are the basis and CP ranks, respectively. This reduces the cost of constructing the CP approximation of two-body interaction tensors of relevance to accurate many-body electronic structure by up to 2 orders of magnitude for systems with up to 36 atoms studied here. The full four-way CP approximation of the Coulomb interaction tensor is shown to be more accurate than the known approaches which utilize CP-factorizations of the SQ factors (which are also constructed with an O ( n 3 R CP ) cost), such as the algebraic pseudospectral and tensor hypercontraction approaches. The CP-decomposed SQ factors can also serve as a robust initial guess for the four-way CP factors.

arXiv:2208.09992•Journal of Chemical Theory and Computation•Dec 9, 2022•12 citations

Tensor structured coupled cluster methods

Roman Schutski

A constant goal of quantum chemistry is devising accurate and computationally effective methods for molecular simulations. In this work an application of tensor decompositions in the context of highly accurate coupled cluster theory, which is often considered a "gold standard", is investigated. The scheme we develop is aimed to mitigate the steep growth of the computational cost with the system size, and hence to overcome the "curse of dimensionality" common in many potent methods in electronic structure. We show how to reduce the computational effort of the restricted coupled cluster with singles and doubles (RCCSD) by two orders of magnitude by introducing alternative parameterizations of the method using "canonical polyad decomposition" (CPD) and "tensor hypercontraction" (THC) formats. After describing CPD and THC formats in detail, we demonstrate how to cast regular index based tensors into a decomposed form. The number of parameters and the accuracy of these representations depend on the expansion length (rank) of the approximation. We investigate the dependence of rank upon the size of the system and a target accuracy and show it to be low for typical tensors in electronic structure. We then provide a generic procedure to reformulate any coupled cluster method using tensor decompositions. Two specific approximate methods, THC-RCCSD and CPD-RCCSD, are derived. We demonstrate the accuracy of these new approaches by calculating energies of a large set of organic molecules, as well as by simulations of Hubbard models. Finally, it is shown how the restriction of the number of parameters in approximate coupled cluster can improve the accuracy in the challenging strong correlation regime. We conclude by discussing a connection of our findings to other new developments in the coupled cluster theory and propose possible extensions of our approach.

•Feb 26, 2018•0 citations

A CPD-enabled low-scaling environment solver in a coupled cluster based static quantum embedding theory

Karl Pierce, Muhammad Talha Aziz, Avijit Shee +1 more

We incorporate a canonical polyadic decomposition (CPD) based low-level solver as a means to accelerate the environment-level solver for the recently developed MPCC embedding framework. Using CPD, we both factorize the three dominant order-three density-fitting two-electron integral (DF TEI) tensors and develop a novel formulation that reduces the storage complexity of the low-level solver from ${O}(N^3)$ to $O(NR)$, where $R$ is the CPD rank, and the computational scaling of the most time-consuming contractions from ${O}(N^4)$ to ${O}(NR^2)$. We provide benchmarks on representative chemical environments, namely water clusters $\mathrm{(H_2O)_n}$ with $n = 1$ to $6$ and linear alkane chains $\mathrm{C_nH_{2n+2}}$ with $n = 1$ to $6$. For both test sets, using the CPD-compressed DF TEI tensors reproduces the DF reference convergence behavior of the low-level solver, the subsequent high-level step, and the fully self-consistent MPCC iterations, while introducing only small, rank-controlled shifts in absolute energies. At a fixed tolerance in the absolute MPCC energy, the CP ranks required for these tensor approximations increase linearly with system size. Chemically relevant energy differences are likewise preserved, as demonstrated for water-cluster dissociation energies and in a proof-of-concept embedding calculation of methane in a four-water cluster.

arXiv:2602.15129•Feb 16, 2026•0 citations

Tensor decomposition in post-Hartree–Fock methods. II. CCD implementation

Udo Benedikt, Karl-Heinz Böhm, Alexander A. Auer

In a previous publication, we have discussed the usage of tensor decomposition in the canonical polyadic (CP) tensor format for electronic structure methods. There, we focused on two-electron integrals and second order Møller-Plesset perturbation theory (MP2). In this work, we discuss the CP format for Coupled Cluster (CC) theory and present a pilot implementation for the Coupled Cluster Doubles method. We discuss the iterative solution of the CC amplitude equations using tensors in CP representation and present a tensor contraction scheme that minimizes the effort necessary for the rank reductions during the iterations. Furthermore, several details concerning the reduction of complexity of the algorithm, convergence of the CC iterations, truncation errors, and the choice of threshold for chemical accuracy are discussed.

The Journal of Chemical Physics•Dec 9, 2013•58 citations
We investigate a novel approach to approximate tensor-network contraction via the exact, matrix-free decomposition of full tensor-networks. We study this method as a means to eliminate the propagation of error in the approximation of tensor-networks. Importantly, this decomposition-based approach is generic, i.e., it does not depend on a specific tensor-network, the tensor index (physical) ordering, or the choice of tensor decomposition. Careful consideration should be made to determine the best decomposition strategy. Furthermore, this method does not rely on robust cancellation of errors (i.e., the Taylor expansion). As a means to study the effectiveness of the approach, we replace the exact contraction of the particle–particle ladder (PPL) tensor diagram in the popular coupled-cluster with single and double excitation (CCSD) method with a low-rank tensor decomposition, namely the canonical polyadic decomposition (CPD). With this approach, we replace an O ( N 6 ) tensor contractions with a potentially reduced-scaling O ( N 4 R ) optimization problem, where R is the CP rank, and we reduce the computational storage of the PPL tensor from O ( N 4 ) to O ( N R ), although we do not take advantage of this compression in this study. To minimize the cost of the CPD optimization, we utilize the iterative structure of CCSD to efficiently initialize the CPD optimization. We show that accurate chemically relevant energy values can be computed with an error of less than 1 kcal/mol using a relatively low CP rank.
We investigate the efficient combination of the canonical polyadic decomposition (CPD) and tensor hyper-contraction (THC) approaches. We first present a novel low-cost CPD solver that leverages a precomputed THC factorization of an order-4 tensor to efficiently optimize the order-4 CPD with O ( N R 2 ) scaling. With the matrix-free THC-based optimization strategy in hand, we can efficiently generate CPD factorizations of the order-4 two-electron integral tensors and develop novel electronic structure methods that take advantage of both the THC and CPD approximations. Next, we investigate the application of a combined CPD and THC approximation of the Laplace transform (LT) second-order Mo̷ller-Plesset (MP2) method. We exploit the ability to switch efficiently between the THC and CPD factorizations of the two-electron integrals to reduce the computational complexity of the LT MP2 method while preserving the accuracy of the approach. Furthermore, we take advantage of the robust fitting approximation to eliminate the leading-order error in the CPD approximated tensor networks. Finally, we show that modest values of THC and CPD rank preserve the accuracy of the LT MP2 method and that this CPD + THC LT MP2 strategy realizes a performance advantage over canonical LT MP2 in both computational wall-times and memory resource requirements.
Approximation of a tensor network by approximating (e.g., factorizing) one or more of its constituent tensors can be improved by canceling the leading-order error due to the constituents’ approximation. The utility of such robust approximation is demonstrated for robust canonical polyadic (CP) approximation of a (density-fitting) factorized two-particle Coulomb interaction tensor. The resulting algebraic (grid-free) approximation for the Coulomb tensor, closely related to the factorization appearing in pseudospectral and tensor hypercontraction approaches, is efficient and accurate, with significantly reduced rank compared to the naive (nonrobust) approximation. Application of the robust approximation to the particle–particle ladder term in the coupled-cluster singles and doubles reduces the size complexity from O ( N 6 ) to O ( N 5 ) with robustness ensuring negligible errors in chemically relevant energy differences using CP ranks approximately equal to the size of the density-fitting basis.
We consider the problem of constructing a canonical polyadic (CP) decomposition for a tensor network, rather than a single tensor. We illustrate how it is possible to reduce the complexity of constructing an approximate CP representation of the network by leveraging its structure in the course of the CP factor optimization. The utility of this technique is demonstrated for the order-4 Coulomb interaction tensor approximated by two order-3 tensors via an approximate generalized square-root (SQ) factorization, such as density fitting or (pivoted) Cholesky. The complexity of constructing a four-way CP decomposition is reduced from O ( n 4 R CP ) (for the nonapproximated Coulomb tensor) to O ( n 3 R CP ) (for the SQ-factorized Coulomb tensor), where n and R CP are the basis and CP ranks, respectively. This reduces the cost of constructing the CP approximation of two-body interaction tensors of relevance to accurate many-body electronic structure by up to 2 orders of magnitude for systems with up to 36 atoms studied here. The full four-way CP approximation of the Coulomb interaction tensor is shown to be more accurate than the known approaches which utilize CP-factorizations of the SQ factors (which are also constructed with an O ( n 3 R CP ) cost), such as the algebraic pseudospectral and tensor hypercontraction approaches. The CP-decomposed SQ factors can also serve as a robust initial guess for the four-way CP factors.
A constant goal of quantum chemistry is devising accurate and computationally effective methods for molecular simulations. In this work an application of tensor decompositions in the context of highly accurate coupled cluster theory, which is often considered a "gold standard", is investigated. The scheme we develop is aimed to mitigate the steep growth of the computational cost with the system size, and hence to overcome the "curse of dimensionality" common in many potent methods in electronic structure. We show how to reduce the computational effort of the restricted coupled cluster with singles and doubles (RCCSD) by two orders of magnitude by introducing alternative parameterizations of the method using "canonical polyad decomposition" (CPD) and "tensor hypercontraction" (THC) formats. After describing CPD and THC formats in detail, we demonstrate how to cast regular index based tensors into a decomposed form. The number of parameters and the accuracy of these representations depend on the expansion length (rank) of the approximation. We investigate the dependence of rank upon the size of the system and a target accuracy and show it to be low for typical tensors in electronic structure. We then provide a generic procedure to reformulate any coupled cluster method using tensor decompositions. Two specific approximate methods, THC-RCCSD and CPD-RCCSD, are derived. We demonstrate the accuracy of these new approaches by calculating energies of a large set of organic molecules, as well as by simulations of Hubbard models. Finally, it is shown how the restriction of the number of parameters in approximate coupled cluster can improve the accuracy in the challenging strong correlation regime. We conclude by discussing a connection of our findings to other new developments in the coupled cluster theory and propose possible extensions of our approach.
We incorporate a canonical polyadic decomposition (CPD) based low-level solver as a means to accelerate the environment-level solver for the recently developed MPCC embedding framework. Using CPD, we both factorize the three dominant order-three density-fitting two-electron integral (DF TEI) tensors and develop a novel formulation that reduces the storage complexity of the low-level solver from O(N3){O}(N^3)O(N3) to O(NR)O(NR)O(NR), where RRR is the CPD rank, and the computational scaling of the most time-consuming contractions from O(N4){O}(N^4)O(N4) to O(NR2){O}(NR^2)O(NR2). We provide benchmarks on representative chemical environments, namely water clusters (H2O)n\mathrm{(H_2O)_n}(H2​O)n​ with n=1n = 1n=1 to 666 and linear alkane chains CnH2n+2\mathrm{C_nH_{2n+2}}Cn​H2n+2​ with n=1n = 1n=1 to 666. For both test sets, using the CPD-compressed DF TEI tensors reproduces the DF reference convergence behavior of the low-level solver, the subsequent high-level step, and the fully self-consistent MPCC iterations, while introducing only small, rank-controlled shifts in absolute energies. At a fixed tolerance in the absolute MPCC energy, the CP ranks required for these tensor approximations increase linearly with system size. Chemically relevant energy differences are likewise preserved, as demonstrated for water-cluster dissociation energies and in a proof-of-concept embedding calculation of methane in a four-water cluster.
In a previous publication, we have discussed the usage of tensor decomposition in the canonical polyadic (CP) tensor format for electronic structure methods. There, we focused on two-electron integrals and second order Møller-Plesset perturbation theory (MP2). In this work, we discuss the CP format for Coupled Cluster (CC) theory and present a pilot implementation for the Coupled Cluster Doubles method. We discuss the iterative solution of the CC amplitude equations using tensors in CP representation and present a tensor contraction scheme that minimizes the effort necessary for the rank reductions during the iterations. Furthermore, several details concerning the reduction of complexity of the algorithm, convergence of the CC iterations, truncation errors, and the choice of threshold for chemical accuracy are discussed.