Calculus of continuous matrix product states
Jutho Haegeman, J. Ignacio Cirac, Tobias J. Osborne, Frank Verstraete
I Introduction
Many revolutions and breakthroughs in quantum physics, and quantum many body physics in particular, were stimulated by guessing a suitable variational ansatz that captures the relevant correlations for the systems under consideration. Feynman’s ansatz for the roton in superfluid HeliumFeynman (1954); Feynman and Cohen (1956), the Bardeen-Cooper-Schrieffer wave function for superconductivityBardeen, Cooper, and Schrieffer (1957) and the Laughlin wave function for the fractional quantum Hall effectLaughlin (1983) are only a few prominent examples. For gapped one-dimensional quantum spin systems, the set of matrix product statesAffleck et al. (1987, 1988); Fannes, Nachtergaele, and Werner (1992); Verstraete, Murg, and Cirac (2008); Cirac and Verstraete (2009) is a very general ansatz that can describe a range of different phenomena and different physical phases, including normal symmetric and symmetry broken phases as well as the more exotic symmetry-protected topologically ordered phases such as the Haldane phaseHaldane (1983a, b); Pollmann et al. (2010). Indeed, with the benefit of hindsight, we now understand White’s powerful density matrix renormalization group algorithmWhite (1992, 1993) as a variational optimization over the set of matrix product statesÖstlund and Rommer (1995); Rommer and Östlund (1997).
Until recently, few equally general ansatzes that surpass mean field theory were available for extended quantum systems in the continuum, i.e. quantum fields. Numerical approaches require a finite number of degrees of freedom in order to fit the problem in the memory of a computer. For compact systems such as nuclei, atoms and molecules, an expansion in terms of a finite-dimensional basis is possible, but for extended systems this eventually results in a discretization to an effective lattice system. A new variational ansatz field theories in spatial dimensions was developed by Verstraete and Cirac in 2010 Verstraete and Cirac (2010). This ansatz is formulated in the continuum and does not require an underlying lattice approximation. It can be considered to be the continuum limit of a special subclass of matrix product states (MPS) and is therefore called the continuous matrix product state (cMPS) class.
The aim of the current paper is to discuss in greater detail the properties of cMPS. Section II reviews the different definitions and representations of these states in the current literature. We then derive a set of regularity conditions that become relevant in the case of systems with multiple particle species in Section III. Section V discusses how to (efficiently) evaluate expectation values with respect to these states. Section VI is devoted to the gauge invariance and the existence of canonical forms in the continuous matrix product state representation for generic systems without translation invariance. We also discuss uniform continuous matrix product states in the thermodynamic limit and illustrate how continuous matrix product states possess a natural ultraviolet cutoff in Section VII. Finally, Section VIII provides an intuitive construction of tangent vectors to the variational set and discusses their representation properties as well, both for finite systems and in the thermodynamic limit. These tangent states are relevant when studying time evolution or elementary excitations along the lines of analogous MPS algorithms Haegeman et al. (2011, 2012); Pirvu, Haegeman, and Verstraete (2012); Milsted et al. (2012). We do not strive for absolute mathematical rigor, but merely attempt to explain in full detail the prerequisites for using cMPS in numerical algorithms. For example, due to the intrinsic difficulty of the various infinite-dimensional function spaces involved, we do not include a rigorous proof that the set of continuous matrix product states constitutes a smooth (complex) manifold and that the construction of a tangent space is justified.
II Various definitions of the variational class
Consider a quantum system defined on a one-dimensional continuum with length that accommodates bosonic and/or fermionic particle species, which are labeled by the greek index . Throughout this paper, we restrict to non-relativistic systems. A state of the quantum system containing particles of type is then described by a square integrable function on , where () if particle species is bosonic (fermionic) and () corresponds to the symmetric (antisymmetric) subspace of , the Cartesian product of copies of . The space of the square integrable functions on this domain is a Hilbert space that is denoted as
Following the principles of second quantization, we now define the Fock space
where if both and represent fermionic particles and when at least one of the two particles species or is bosonic. Clearly . We always write sums over the species index explicitly and do not use Einstein’s summation convention with respect to this index.
II.2 Original definition
A cMPS is defined to be the state Verstraete and Cirac (2010)
A special case is obtained for , since this requires us to redefine as . Hence, the null state is not contained within but only in its closure. Correspondingly, the variational set with is not a subset of . For example, if the boundary matrices are fixed to and (periodic boundary conditions), then a representation of the cMPS with bond dimension as a cMPS with bond dimension requires and , hence is only included in the closure of . Note that this differs from the case of MPS on the lattice, where for .
II.3 Fock space embedding
We can then expand the round brackets and reorder the sum in terms of the actual number of created particles by grouping subsequent occurrences of the term, so as to obtain
only when . It can be extended to any other order of the arguments by reordering the annihilation operators in Eq. (7) according to the given commutation or anticommutation relations in Eq. (3). The non-relativistic kinetic energy requires that these functions are sufficiently regular, which together with the extension to arbitrary order of the arguments imposes certain non-trivial constraints on the matrix functions and that are to be discussed in Section III.
II.4 The continuum limit of matrix product states
The cMPS was originally constructed in Ref. Verstraete and Cirac, 2010 as the continuum limit of a certain subset of MPS, where the subset was selected in such a way as to obtain a valid continuum limit. We explore this construction in greater detail and elaborate on some of the non-trivial implications regarding ultraviolet cutoffs and correlation lengths (infrared cutoffs).
We approximate the continuum by a lattice with lattice spacing and sites, where we send . On every site of the lattice we can create and annihilate particles of type by acting with the creation and annihilation operators and . We can relate them to the field operators by
and its hermitian conjugate. The local basis on site thus consists of the states (no particles), , , … On this lattice, we can define an MPS with matrices where can take values , , , … If the local basis is infinite-dimensional, this MPS definition is only formal, i.e. it cannot be used for practical computations. In the limit , the number of sites in the lattice goes to infinity.
together with , . This equivalence can be obtained from a Taylor expansion of the -operator, although this is only completely rigorous when the entries of and are finite and the operators are bounded (i.e. not for bosons). Most results for cMPS in the remainder of this chapter can be derived from this correspondence with MPS, but we attempt to derive these results directly in the continuum as much as possible.
II.5 Alternative construction through continuous measurement
Rather than trying to construct a cMPS as the continuum limit of a MPS, we could also try to directly define the continuum limit of the processes that define MPS. Unfortunately, the process of sequential Schmidt decompositions has no straightforward generalization to the continuum and neither has the definition of valence bond solids. One can however define a continuum version of the sequential generation process that creates MPSSchön et al. (2005), based on the paradigm of continuous measurement Caves and Milburn (1987). The resulting process for creating cMPS is described in Ref. Osborne, Eisert, and Verstraete, 2010, and is here summarised for the sake of completeness.
We recall that is a Hermitian matrix. Generic cMPS can be brought into this form by using the gauge invariance of the cMPS representation, as discussed in Section VI.
From a physical perspective, this construction is important as it clearly sketches the holographic properties of the cMPS. The physical state of a one-dimensional system is described by a zero-dimensional boundary theory. The spatial coordinate of the physical system acts as a time coordinate in the boundary theory. The physical state is created because the boundary theory interacts with the physical system, where the position of the interaction shifts linearly in time. This interaction results in the boundary theory not being at equilibrium. Instead, the boundary theory is subject to dissipative dynamics, as will become clear in the following section. This holographic property is of course strongly related with the intrinsic area law for entanglement that is present in cMPS.
II.6 Path integral representation
Recently, it has also been illustrated that we can break up the path ordered exponential in the definition of and insert resolutions of the identity in order to obtain a path integral description of the same stateBrockt et al. . The easiest way to insert an identity is by first introducing a second quantized version of the ancilla by making the substitution
Following the standard recipe, we can then obtain the path integral description of as
where is a -dimensional vector function with components , . This path integral representation can serve as a useful starting point for generalizations of the cMPS, e.g. by replacing the second quantized auxiliary system by a true field theory, so that this becomes the cMPS analogon of the construction in Ref. Cirac and Sierra, 2010; Nielsen, Sierra, and Cirac, 2011. If this field theory is a conformal field theory, it is then very close in spirit to some model states for Quantum Hall SystemsMoore and Read (1991); Dubail, Read, and Rezayi .
III Regularity conditions
In Eq. (7) we have defined the -particle wave functions . For these are completely specified by Eq. (8). However, for general choices of the matrix functions and , the extension of Eq. (8) to all orders of its arguments does not automatically satisfy the required properties that a physical -particle wave function should satisfy. For example, the -particle wave functions should be differentiable in each of its arguments if the state has to produce a finite non-relativistic kinetic energy.
However, there is no need to work with the Fock space expansion of Eq. (6). We can check the regularity of the -particle wave functions by immediately evaluating the kinetic energy in second quantization. For further reference, we first define
In order to compute any expectation value, which is the topic of the next section, we need to be able to act with the field annihilation operators on the state . If we are able to drag through the path-ordered exponential, it then acts on , which is annihilated by any field operator. We can now use Eq. (106) as derived in Appendix A, where , contains both and any term for which , and contains the terms for which . We then obtain
Hence, acting with an annihilation operator of type at position not only lowers a matrix , but also transforms the path ordered exponential into , because we had to take the particle statistics into account for bringing to the position where it could lower .
The non-relativistic kinetic energy operator is given by
where the kinetic energy density at position is given by
Differentiability of the wave function is sufficient for a finite kinetic energy, which is by far the most important physical requirement of the wave function. We can also impose higher regularity constraints on the -particle wave functions. Since these do in general not arise from physical considerations, we postpone this discussion to Appendix B. While the resulting conditions are interesting from an algebraic point of view, they are in general hard to satisfy with finite-dimensional matrices. For practical applications, satisfying the original condition in Eq. (25), as imposed by the finiteness of the kinetic energy, should be sufficient.
We conclude this subsection by investigating what else can be learned from the physical considerations concerning particle statistics. The regularity conditions [Eq. (25)] already require that the matrices behave as the corresponding operators in terms of commutation and anticommutation relations. In a physical system, we should not have fermionic condensates, i.e. if particle species is fermionic. This is a consequence of the invariance of an physical Hamiltonian under the action of the parity operator , which flips the sign of any fermionic operator () and is thus idempotent (). We can construct as
with . The required transformation behavior of and then imposes the following decomposition
In the cMPS , all contributions with either an even or an odd number of fermions in Eq. (6) drop out, depending on the boundary matrices . If only states with an even number of fermions are allowed, should have a decomposition as
is required to select only states with an odd number of fermions.
IV Boundary conditions
We have already mentioned in Section II that the type of boundary conditions —open or periodic— is encoded in the rank of the boundary matrix . For a system with periodic boundary conditions, has full rank and is typically chosen to be the identity (). Since periodic boundary conditions identify the points and , it is natural to assume that the matrix functions and are also single-valued, i.e. and for all .
A more detailed discussion of these conditions is presented in Ref. Verstraete , where a partial differential equation for the evolution of and under real or imaginary time dynamics is derived. In order to solve this partial differential equation, it needs to be complemented by the proper boundary conditions as given above. Throughout the remainder of this manuscript, we assume that we are working with cMPS where the matrix functions and satisfy the required conditions.
V Computation of expectation values
This section is concerned with the computation of expectation values of normally ordered operators. We have already illustrated how to act with annihilation operators and derivatives thereof in the Section III. With a MPS, the computation of expectation values boils down to a contraction of the physical indices in the network. In the continuum, however, the intuitive notion of physical indices is a bit lost. We therefore start by computing the overlap of two cMPS , , which are given as an expansion in Fock space [Eq. (6)]. It is clear that the basis states are automatically orthogonal for different , and further that
due to the ordering of the arguments and . We thus obtain
Using trivial direct product identities such as , and for matrices , , and , the previous expression can be rewritten as
Reverting the expansion of the path ordered exponential that lead to Eq. (6), results in
The expectation value of any normally ordered operator can now be computed by first acting with all annihilation operators on the ket as we did in the Section III, and similarly acting with the creation operators on the bra. The result of this is the insertion of some operators acting on the virtual system at the corresponding positions, with operators , or connecting them. The expectation value is obtained by “contracting the physical indices”, which results in the inserted virtual operators in the ket combining with those in the bra at the same positionIf there is no insertion at the same position, we can always insert a unit operator , whereas the contraction of the part in between the local insertions result in a path ordered exponential of the transfer matrix. However, to incorporate the particle statistics, we also need to define generalized transfer operators as
All quantities in this expression, if we could store and manipulate variables with a fully continuous -dependence, are matrices. Since such matrices need to be multiplied, this is an operation with computational complexity of , or if we exploit the tensor-product structure.
From the correspondence with completely positive maps, it can be shown that the solution and of Eq. (42) starting from positive definite initial conditions and are positive for any (see Theorem 3 in Ref. Lindblad, 1976). The norm is thus guaranteed to be positive. Note that, for the special parameterization of in the continuous measurement interpretation [Eq. (12)], we can write the determining differential equation for as
with the functional derivative with respect to , and
which for a system with open boundary conditions results in
Let us now illustrate this approach by defining a generic Hamiltonian for a single-boson system with open boundary conditionsWhile we mentioned in Section IV that we always assume the matrix functions and to satisfy the proper boundary conditions, we do not have to use the condition in Eq. (33) at any point in deriving the expectation value of the Hamiltonian in Eq. (48).
describing particles with mass that interact with an external potential and with each other through two-particle interaction .
Using Eq. (45) we find (henceforth omitting the arguments and in the state )
Defining for every and solving
for every , we can write the expectation value of the potential and interaction energy as
To evaluate the expectation value of the kinetic energy, we compute
where we used the same trick. Note that derivatives with respect to the Heaviside functions (which would produce a diverging contribution ) nicely cancel for both derivatives with respect to and to . As noted in the Section III, the regularity condition Eq. (25) is automatically fulfilled for the case of a single boson. We thus obtain
VI Gauge invariance
While we prefer the continuum derivation, these transformation formulas can also be obtained by using the correspondence with MPS [Eq. (10)] and the well-known gauge transformations for MPS Haegeman et al.
Clearly, this differential equation only determines up to a unitary prefactor. Put differently, for any solution of this equation, with a unitary matrix is an equally valid solution. We can use the remaining gauge freedom to diagonalize at every point , hence obtaining the left-canonical form.
Alternatively, we can also impose the right orthonormalization condition, which boils down to
Clearly, for any solution , we obtain a family of solutions with . This unitary freedom can be fixed by diagonalizing , resulting in the right-canonical form. As for the left-canonical form, one has to pay careful attention to the boundary conditions that need to be satisfied by . For a system with open boundary conditions, the easiest solution is again to include one of the boundary vectors in the set of the variational parameters and also transform it under the action of the gauge transform.
Note that we can also define a gauge transformation for the cMPS so that
This formulation is close in spirit to the bosonic mean field ansatz
VII Translation invariance and the thermodynamic limit
In expectation values of local operators, this overall factor always appears, but the rest of the expression will not depend on . Hence, the -dependence is cancelled by considering normalized expectation values, or by henceforth choosing such that .
We can now evaluate correlation functions as
We define the Fourier transformed correlation function
then it is easy to see why we have used the suggestive notation for the Fourier transform of . We obtain
These results can be used to show that both the second and third term in the expansion vanish when they are plugged into Eq. (68). The first non-vanishing term is thus of order . Because is a dimensionless quantity, this asymptotic behavior allows us to introduce a momentum cutoff as
we have now defined a UV cutoff scale based on the large momentum behavior of the momentum occupation number .
Let us also illustrate how to compute the expectation value of a translation invariant Hamiltonian. The generic Hamiltonian in Eq. (48) becomes translation invariant for and with . Since the uniform cMPS is extensive, expectation values are proportional to the volume and it makes more sense to compute the expectation values of the kinetic, potential and interaction energy densities , and . We obtain
VIII Tangent vectors of continuous matrix product states
For MPS, a new algorithm for time evolution and variational optimization (via imaginary time evolution) was recently constructed using the time-dependent variational principleHaegeman et al. (2011). An essential ingredient of this algorithm is the study of (infinitesimally) small variations of MPS, i.e. the set of MPS tangent vectors. Indeed, it was rigorously proven that the set of MPS can be given the structure of a variational manifold with a well-defined tangent spaceHaegeman et al. by eliminating some singular points or regions. While we do expect the same theorems to hold for cMPS, the infinite dimensionality of the parameter space and Hilbert space might require a different proof strategy, especially in the absence of translation invariance. As noted several times before, this would be beyond the scope of this paper.
where the maps and () are given by
We now restrict to the case of open boundary conditions and discard the explicit reference to the base point in the notation of tangent vectors. To take full advantage of the gauge freedom, we noted in Section VI that is better to include one of the boundary vectors in the set of variational parameters. We thus generalize our definition of tangent vectors by also including variations with respect to e.g. the right boundary vector . We write
The overlap between two tangent vectors is given by
which together with the boundary condition results in the solution
Alternatively, we can also impose a right gauge fixing condition
VIII.2 Uniform case
We can also compute the overlap between two of these tangent vectors and obtain
If we again resort to the decomposition of Eq. (VII), we can further evaluate this to
The momentum eigenstates cannot be normalized to unity in the thermodynamic limit, but rather satisfy a -normalization. For , there is an additional divergence which is stronger than the -normalization. It can be related to the overlap between the and the original cMPS , which is given by
IX Conclusion and outlook
This manuscript provides a detailed description of a variational class of wave functions for one-dimensional quantum field theories, that goes by the name of “continuous matrix product states”. We reviewed different alternative constructions that produce the same class of states and have their own merits, e.g. in offering clear hints on how to generalize this class to different settings such as open quantum systems or higher-dimensional theories.
We illustrated how to formulate the cMPS ansatz for the most general class of theories including an arbitrary number of bosonic and fermionic particles, and were naturally led to a set of constraints that the variational parameters needed to satisfy in order to produce a finite kinetic energy density. We also discussed other physical constraints such as fermion parity. We then proceeded by explaining in detail how to compute expectation values, in particular for the case of systems with open boundary conditions. We provided some additional details for the case of systems with translation invariance, where we can use the expectation value of a correlation function to define an ultraviolet cutoff within the cMPS state.
We also discussed the important topic of gauge invariance in the cMPS representation. Finally we introduced the concept of cMPS tangent vectors, and discussed how the gauge invariance allows to represent them in such a way that the metric of the cMPS manifold simplifies tremendously.
While we have not introduced any practical algorithms or recipes for finding cMPS approximations of ground states or for describing other physical phenomena, we have introduced all necessary definitions and concepts in order to comfortably work with cMPS. This set of definitions can now be used in follow-up papers that will focus on new algorithms. As such, the current paper provides a stepping stone that will hopefully spur more research in the context of variational methods for quantum field theories in one dimension and beyond.
References
Appendix A A useful formula
Consider an operator defined as
where is not necessarily antihermitian. This operator satisfies
For the derivatives of the inverse operator we can use the general result
Now define the following operator quantity depending on an arbitrary operator
By taking the derivative with respect to , we obtain
We then multiply this equality with to the right and make use of the obvious identity for any in the integral of the right hand side in order to obtain our final result
We can further generalize this result. Suppose we have two operators defined as
for arbitrary . If we consider the quantity
using a similar derivation. Continuing along the same line results in
Appendix B Higher order regularity conditions
We can also impose regularity of the mixed derivatives of the -particle wave function, by first evaluating
where a new set of operators () was introduced as
Note that the regularity condition in Eq. (25) is sufficient for the annihilation of two particles to be continuous at . By first differentiating with respect to , we obtain
where we have assumed the regularity condition in Eq. (25) to hold. This allows one to eliminate the fixed insertion of particles at position as well as the terms obtained from differentiating the Heaviside functions (i.e. the terms proportional to ). Such terms would indeed arise if were not continuous at . If we now also differentiate with respect to , we obtain a divergent contribution
If we differentiated with respect to first, and then to , the divergent contribution is
The higher order regularity conditions derived in this appendix put very strong constraints on and that might be hard to satisfy with finite-dimensional matrices. As mentioned in the main text, satisfying the original condition in Eq. (25), as imposed by the finiteness of the kinetic energy, should be sufficient for most practical applications.