The extension of the Rayleigh-Ritz variational principle to ensemble states ρw≡∑kwk|Ψk⟩⟨Ψk| with fixed weights wk lies ultimately at the heart of several recent methodological developments for targeting excitation energies by variational means. Prominent examples are density and density matrix functional theory, Monte Carlo sampling, state-average complete active space self-consistent field methods and variational quantum eigensolvers. In order to provide a sound basis for all these methods and to improve their current implementations, we prove the validity of the underlying critical hypothesis: Whenever the ensemble energy is well-converged, the same holds true for the ensemble state ρw as well as the individual eigenstates |Ψk⟩ and eigenenergies Ek . To be more specific, we derive linear bounds d−ΔEw≤ΔQ≤d+ΔEw on the errors ΔQ of these sought-after quantities. A subsequent analytical analysis and numerical illustration proves the tightness of our universal inequalities. Our results and particularly the explicit form of d±≡d±(Q)(w,E) provide valuable insights into the optimal choice of the auxiliary weights wk in practical applications.
The extension of the Rayleigh-Ritz variational principle to ensemble states ρw≡∑kwk|Ψk⟩⟨Ψk| with fixed weights wk lies ultimately at the heart of several recent methodological developments for targeting excitation energies by variational means. Prominent examples are density and density matrix functional theory, Monte Carlo sampling, state-average complete active space self-consistent field methods and variational quantum eigensolvers. In order to provide a sound basis for all these methods and to improve their current implementations, we prove the validity of the underlying critical hypothesis: Whenever the ensemble energy is well-converged, the same holds true for the ensemble state ρw as well as the individual eigenstates |Ψk⟩ and eigenenergies Ek . To be more specific, we derive linear bounds d−ΔEw≤ΔQ≤d+ΔEw on the errors ΔQ of these sought-after quantities. A subsequent analytical analysis and numerical illustration proves the tightness of our universal inequalities. Our results and particularly the explicit form of d±≡d±(Q)(w,E) provide valuable insights into the optimal choice of the auxiliary weights wk in practical applications.
The maximum-entropy principle is used to generalize the variational principle for the ground state (Rayleigh-Ritz minimization principle) to ensembles of unequally weighted states. A hierarchy of nested inequalities for the associated ``free energies'' is deduced. Applications of these inequalities to the estimation of the highest multiplet energy and a generalization of density-functional theory to ensembles of quantum states are discussed. Previous results given in the literature are obtained as special cases of our results under isothermal and adiabatic optimizations.
Previous work extending the Kohn–Sham theory to excited states was based on replacing the study of the ground-state energy as a functional of the ground-state density by a study of an ensemble average of the Hamiltonian as a functional of the corresponding average density. We suggest and develop an alternative to this description of excited states that utilizes the matrix of the density operator taken between any two states of the included space. Such an approach provides more detailed information about the states included, for example transition probabilities between discrete states of local one-body operators. The new theory is also based on a variational principle for the trace of the Hamiltonian over the space of states that we wish to describe, viewed, however, as a functional of the associated array of matrix elements of the density. This finds expression in a matrix version of the Kohn–Sham theory. To illustrate the formalism, we study a suitably defined weak-coupling limit, which is our equivalent of the linear response approximation. On this basis, we derive an eigenvalue equation that has the same form as an equation derived directly from the time-dependent Kohn–Sham equation and applied recently with considerable success to molecular excitations. We provide an independent proof, within the defined approximations, that the eigenvalues can be interpreted as true excitation energies.
In Phys. Rev. Lett . 2021, 127, 023001 a reduced density matrix functional theory (RDMFT) was proposed for calculating energies of selected eigenstates of interacting many-Fermion systems. Here, we develop a solid foundation for this so-called w -RDMFT and present the details of various derivations. First, we explain how a generalization of the Ritz variational principle to ensemble states with fixed weights w in combination with the constrained search would lead to a universal functional of the one-particle reduced density matrix. To turn this into a viable functional theory, however, we also need to implement an exact convex relaxation. This general procedure includes Valone’s pioneering work on ground state RDMFT as the special case w = (1,0, ···). Then, we work out in a comprehensive manner a methodology for deriving a compact description of the functional’s domain. This leads to a hierarchy of generalized exclusion principle constraints which we illustrate in great detail. By anticipating their future pivotal role in functional theories and to keep our work self-contained, several required concepts from convex analysis are introduced and discussed.
We propose and work out a reduced density matrix functional theory (RDMFT) for calculating energies of eigenstates of interacting many-electron systems beyond the ground state. Various obstacles which historically have doomed such an approach to be unfeasible are overcome. First, we resort to a generalization of the Ritz variational principle to ensemble states with fixed weights. This in combination with the constrained search formalism allows us to establish a universal functional of the one-particle reduced density matrix. Second, we employ tools from convex analysis to circumvent the too involved N-representability constraints. Remarkably, this identifies Valone's pioneering work on RDMFT as a special case of convex relaxation and reveals that crucial information about the excitation structure is contained in the functional's domain. Third, to determine the crucial latter object, a methodology is developed which eventually leads to a generalized exclusion principle. The corresponding linear constraints are calculated for systems of arbitrary size.
The Rayleigh-Ritz minimization principle is generalized to ensembles of unequally weighted states. Given the M lowest eigenvalues E1\ensuremath{\le}E2\ensuremath{\le}...\ensuremath{\le}EM of a Hamiltonian H, and given M real numbers w1\ensuremath{\ge}w2\ensuremath{\ge}...\ensuremath{\ge}wM>0, an upper bound for the weighted sum w1E1 +w2E2+...+wMEM is established. Particular cases are the ground-state Rayleigh-Ritz principle (M=1) and the variational principle for equiensembles (w1=w2=...=wM). Applications of the generalized principle are discussed.
Quantum Averages and Statistical Samplings In this chapter, we discuss the general framework in which the variational Monte Carlo methods are defined and few important implementations for interacting systems of bosons and fermions on the lattice. The main advantage of considering this approach relies on the variational principle that has been shown in section 1.4: the energy of a given quantum state is always bounded from below by the exact ground-state one, giving us the route to obtain the best possible solution to the problem. In most cases, a suitable parametrization of the variational wave function allows us to consider a wide range of different quantum phases (e.g., metals, superconductors, and insulators). By performing an optimization of the parameters, we can reach the lowest-energy state, which is expected to capture the correct ground-state behavior. Therefore, variational wave functions represent a flexible and valuable approach to get important insights into the low-energy properties of models that cannot be solved by exact methods. By contrast, the main limitation of this approach is the fact that it is based on a given Ansatz , which may contain a relevant bias that cannot be removed within the chosen parametrization. We also mention that variational wave functions can be easily defined and treated for a wide class of models, irrespective of the range of interactions and the dimension of the local (i.e., single-site) Hilbert space, which can be even infinite and does not need the use of an uncontrolled cutoff to work with a finite-dimensional space. In this respect, variational Monte Carlo is better than other methods, like densitymatrix renormalization group or tensor-network methods in which the complexity dramatically increases with both the range of the interaction and the dimension of the local Hilbert space (White, 1992; Schollwöck, 2005, 2011). Let us start by describing the general framework in which variational Monte Carlo methods are defined. First of all, we fix a complete basis set in the Hilbert space, in which (for simplicity) the states are taken to be orthogonal and normalized such that: Then, any quantum state can be written as: In turn, the expectation value of an operator over a given variational wave function takes the following form: The main problem in evaluating the expectation value is that the number of configurations in the sum is exponentially large with the number of particles.