Minimization of the Probabilistic p-frame Potential

Martin Ehler, Kasso A. Okoudjou

Introduction

Frames are overcomplete (or redundant) sets of vectors that serve to faithfully represent signals. They were introduced in 19521952 by Duffin and Schaeffer , and reemerged with the advent of wavelets . Though the overcompleteness of frames precludes signals from having unique representation in the frame expansions, it is, in fact, the driving force behind the use of frames in signal processing .

In the finite dimensional setting, frames are exactly spanning sets. However, many applications require “custom-built” frames that possess additional properties which are dictated by these applications. As a result, the construction of frames with prescribed structures has been actively pursued. For instance, a special class called finite unit norm tight frames (FUNTFs) that provide a Parseval-type representation very similar to orthonormal bases, has been customized to model data transmissions . Since then the characterization and construction of FUNTFs and some of their generalizations have received a lot of attention . Beyond their use in applications, FUNTFs are also related to some deep open problems in pure mathematics such as the Kadison-Singer conjecture . FUNTFs appear also in statistics where, for instance, Tyler used them to construct MM-estimators of multivariate scatter . We elaborate more on the connection between the MM-estimators and FUNTFs in Remark 2.3. These MM-estimators were subsequently used to construct maximum likelihood estimators for the the wrapped Cauchy distribution on the circle in and for the angular central Gaussian distribution on the sphere in .

FUNTFs are exactly the minimizers of a functional called the frame potential . This was extended to characterize all finite tight frames in . Furthermore, in , finite tight frames with a convolutional structure, which can be used to model filter banks, have been characterized as minimizers of an appropriate potential. All these potentials are connected to other functionals whose extremals have long been investigated in various settings. We refer to for details and related results.

In Section 3, we give lower estimates on the pp-frame potentials, and prove that in certain cases their minimizers are FUNTFs, which possess additional properties and structure. In particular, if 0<p≤20<p\leq 2, we completely characterize the minimizers of the pp-frame potentials when N=kdN=kd for some positive integer kk. Moreover, when N=d+1N=d+1 and 0<p≤20<p\leq 2, we characterize the minimizers of the pp-frame potentials, under a technical condition, which, we have only been able to establish when d=2d=2. We conjecture that this technical condition holds when d>2d>2. Finally in Section 4, we introduce probabilistic pp-frames that generalize the concepts of frames and pp-frames. We characterize the minimizers of probabilistic pp-frame potentials in terms of probabilistic pp-frames. The latter problem is solved completely for 0<p≤20<p\leq 2, and for all even integers pp. In particular, these last results generalize as well as the recently introduced notion of the probabilistic frame potential in .

Further relations to statistics: Besides the results on FUNTFs used in , and mentioned above, frame theory has essentially evolved independently of statistical fields such as statistical shape analysis and directional statistics . Nevertheless, there still exist several overlaps, and to the best of our knowledge, these overlaps have not yet been fully explored. Recently, frame theory has been used in directional statistics , where FUNTFs are utilized to investigate on statistical tests for directional uniformity and to model and analyze patterns found in granular rod experiments. We must point out that similar results were obtained earlier by Tyler in .

Probabilistic tight frames are multivariate probability distributions whose second moments’ matrix is a multiple of the identity, and they are used in to obtain approximate FUNTFs. The latter approximation procedure is connected to a classical problem in multivariate statistics, namely estimating the population covariance from a sample, which is closely related to the MM-estimators addressed in . The pp-frame potentials and their probabilistic counterparts that we consider in the sequel, are linked to the notion of shape measure, shape space, and mean shape used in statistical shape analysis. In Section 2.2, we establish a precise connection between the full Procrustes estimate of mean shape [23, Definition 3.3] which is the eigenvector corresponding to the largest eigenvalue of the frame operator. Moreover, this eigenvalue coincides with the upper frame redundancy as introduced in . The full Procrustes estimate of mean shape also saturates the upper frame inequality. Moreover, the pp-frame potentials form size measures as required in statistical shape analysis, and their minimizers among all collections of NN points on the sphere define a shape space modulo rotations.

We hope that the present paper will renew interests in more investigation on the role of frames and the pp-th frame potential in directional statistics and statistical shape analysis.

The p𝑝p-frame potential

To introduce frames and their elementary properties, we follow the textbook .

A collection of unit vectors {xi}i=1N⊂Sd−1\{x_{i}\}_{i=1}^{N}\subset S^{d-1} is called equiangular if there exists a nonnegative constant CC such that ∣⟨xi,xj⟩∣=C|\langle x_{i},x_{j}\rangle|=C, for i≠ji\neq j.

Its adjoint operator is called the synthesis operator and given by

Using these operators, it is easy to see that {xi}i=1N\{x_{i}\}_{i=1}^{N} is a frame if and only if the frame operator defined by

is positive, self-adjoint, and invertible. In this case, the following reconstruction formula holds

and {S−1xi}i=1N\{S^{-1}x_{i}\}_{i=1}^{N}, in fact, is a frame too, called the canonical dual frame. If {xi}i=1N\{x_{i}\}_{i=1}^{N} is a frame, then {S−1/2xi}i=1N\{S^{-1/2}x_{i}\}_{i=1}^{N} is a finite tight frame. Moreover, note that {xi}i=1N\{x_{i}\}_{i=1}^{N} is a FUNTF if and only if its frame operator SS is Nd\frac{N}{d} times the identity.

As mentioned in the introduction, the question of the existence and characterization of FUNTFs was settled in , where the frame potential, defined by

was introduced and used to give a characterization of its minimizers in terms of FUNTFs. More specifically, they prove the following result:

[2, Theorem 7.1] Let NN be fixed and consider the minimization of the frame potential among all collections of NN points on the sphere Sd−1S^{d-1}.

We shall prove in the sequel that the frame potential is just an example in a family of functionals defined on points on the sphere, and whose minimizers have approximation properties similar to those of the frame potential. But first, we briefly comment on the relation between FUNTFs and MM-estimators of multivariate scatter:

is the identity matrix. Whenever this is possible, the estimate VV of the population scatter matrix is then given by V=Γ−1V=\Gamma^{-1}. We refer to for details. Note that M(Γ)=IdM(\Gamma)=I_{d} implies that

forms a FUNTF. Moreover, {xi}i=1N⊂Sd−1\{x_{i}\}_{i=1}^{N}\subset S^{d-1} is a FUNTF if and only if M(Id)=IdM(I_{d})=I_{d}.

2 Definition of the p𝑝p-frame potential

Let NN be a positive integer, and 0<p<∞0<p<\infty. Given a collection of unit vectors {xi}i=1N⊂Sd−1\{x_{i}\}_{i=1}^{N}\subset S^{d-1}, the pp-frame potential is the functional

When, p=∞p=\infty, the definition reduces to

It is immediate that the following family of functionals can be seen as size measures:

cf. [14, Definition 3.3]. The average axis from the complex Bingham maximum likelihood estimator is the same as the full Procrustes estimate of mean shape for two-dimensional shapes, and the same holds for the complex Watson distribution, cf. [14, Sections 6.2 &\& 6.3]. If we assume that {zi}i=1N\{z_{i}\}_{i=1}^{N} are centered around zero, then zˉP\bar{z}_{P} is given by the eigenvector corresponding to the largest eigenvalue λ\lambda of the frame operator of the normalized collection {zi∥zi∥}i=1N\{\frac{z_{i}}{\|z_{i}\|}\}_{i=1}^{N}. Furthermore, one observes that this eigenvalue λ\lambda is the upper frame redundancy of {zi}i=1N\{z_{i}\}_{i=1}^{N} as introduced in , which also coincides with the optimal upper frame bound BB in (1). Therefore, the full Procrustes estimate of mean shape satisfies the upper frame inequality with equality. Moreover, we have observed that the root mean square of the full Procrustes estimate of mean shape is 1−λN1-\frac{\lambda}{N}.

For each p∈(1,∞)p\in(1,\infty), the pp-frame potential FP⁡p,N\operatorname{FP}_{p,N} is induced by the conservative force Fp=fp(∥a−b∥)(a−b)F_{p}=f_{p}(\|a-b\|)(a-b), for a,b∈Sd−1a,b\in S^{d-1}, where

FpF_{p} is a central force between the ‘particles’ aa and bb that we call the pp-frame force.

is differentiable and satisfies pp′(x)=−xfp(x)\mathbf{p}_{p}^{\prime}(x)=-xf_{p}(x). This is sufficient to verify that the potential Pp(a,b):=pp(∥a−b∥)P_{p}(a,b):=\mathbf{p}_{p}(\|a-b\|), defined for a,b∈Sd−1a,b\in S^{d-1}, satisfies ∇aPp(a,b)=−F(a,b)\nabla_{a}P_{p}(a,b)=-F(a,b), where bb is held fixed. Thus, FpF_{p} is a conservative vector field. The physical meaningful potential Pp(a,b)P_{p}(a,b) is in fact given by

where we used that ∥a∥=∥b∥=1\|a\|=\|b\|=1. Consequently, the pp-frame potential is induced by the conservative central force FpF_{p}. ∎

As a consequence of the above lemma, {xi}i=1N⊂Sd−1\{x_{i}\}_{i=1}^{N}\subset S^{d-1} are in equilibrium under the pp-frame force if they minimize the pp-frame potential among all collections of NN points on the sphere. Note that such a collection of equilibria modulo rotations form a shape space.

We will use repeatedly the fact that for a fixed {xi}i=1N⊂Sd−1\{x_{i}\}_{i=1}^{N}\subset S^{d-1}, the pp-frame potential FP⁡p,N({xi}i=1N)\operatorname{FP}_{p,N}(\{x_{i}\}_{i=1}^{N}) is a decreasing and continuous function of p∈(0,∞)p\in(0,\infty).

Lower estimates for the p𝑝p-frame potential

We start this section with a few elementary results about the minimizers of the pp-frame potential as well as their connection to tt-designs. In fact, potentials on the sphere, and tt-designs have been well investigated . However, one of the key differences between tt-designs and our pp-frame potential is that the former is considered only for positive integers tt while the latter is investigated for p∈(0,∞)p\in(0,\infty).

If p=2kp=2k is an even integer, one can use Welch’s results to conclude that, for {xi}i=1N⊂Sd−1\{x_{i}\}_{i=1}^{N}\subset S^{d-1},

We shall verify that this estimate is not optimal for small NN, by proving an estimate for FP⁡p,N\operatorname{FP}_{p,N} when 2<p<∞2<p<\infty. The following Proposition first appeared in :

Let {xi}i=1N⊂Sd−1\{x_{i}\}_{i=1}^{N}\subset S^{d-1}, N≥dN\geq d, and 2<p<∞2<p<\infty, then

and equality holds if and only if {xi}i=1N\{x_{i}\}_{i=1}^{N} is an equiangular FUNTF.

For 12=1p+1r\frac{1}{2}=\frac{1}{p}+\frac{1}{r}, Hölder’s inequality yields

Raising to the pp-th power and applying 1r=12−1p\frac{1}{r}=\frac{1}{2}-\frac{1}{p} leads to

Using the fact that ∑i≠j∣⟨xi,xj⟩∣2≥N2d−N\sum_{i\neq j}|\langle x_{i},x_{j}\rangle|^{2}\geq\frac{N^{2}}{d}-N (see Theorem 2.2) implies that

see, , for details. Consequently, if {xk}k=1N\{x_{k}\}_{k=1}^{N} is an equiangular FUNTF, then (7) holds with equality.

On the other hand, if equality holds in (7), then ∑i≠j∣⟨xi,xj⟩∣2=N2d−N\sum_{i\neq j}|\langle x_{i},x_{j}\rangle|^{2}=\frac{N^{2}}{d}-N and {xi}i=1N\{x_{i}\}_{i=1}^{N} is a FUNTF due to Theorem 2.2. Moreover, the Hölder estimate (8) must have been an equality which means that ∣⟨xi,xj⟩∣=C|\langle x_{i},x_{j}\rangle|=C for i≠ji\neq j, and some constant C≥0C\geq 0. Thus, the FUNTF must be equiangular. ∎

By comparing (6) with (7), it is easily seen that the Welch bound is not optimal for small NN:

Let {xi}i=1N⊂Sd−1\{x_{i}\}_{i=1}^{N}\subset S^{d-1} and p=2k>2p=2k>2 be an even integer. If d<N≤(d+k−1k)d<N\leq\binom{d+k-1}{k}, then

The condition on NN implies 1≥N(d+k−1k)1\geq\frac{N}{\binom{d+k-1}{k}}, and adding (N-1)\big{(}\frac{N-d}{d(N-1)}\big{)}^{k}>0 to the right hand side leads to

Multiplication by NN and Proposition 3.1 then yield (11). ∎

The estimate in Proposition 3.1 is sharp if and only if an equiangular FUNTF exists. In [31, Sections 4 &\& 6], construction (and hence existence) of equiangular FUNTFs was established when d+2≤N≤100d+2\leq N\leq 100. For general dd and NN, a necessary condition for existence of equiangular FUNTFs is given, and it is conjectured that the conditions are sufficient as well. The authors essentially provide on upper bound on NN that depends on the dimension dd. Therefore, Proposition 3.1 might not be optimal when the redundancy N/dN/d is much larger than 11.

2 Relations to spherical t𝑡t-designs

for all homogeneous polynomials hh of total degree equals or less than tt in dd variables and where σ\sigma denotes the uniform surface measure on Sd−1S^{d-1} normalized to have mass one. The following result is due to [34, Theorem 8.1] (see , for similar results).

[34, Theorem 8.1] Let p=2kp=2k be an even integer and {xi}i=1N={−xi}i=1N⊂Sd−1\{x_{i}\}_{i=1}^{N}=\{-x_{i}\}_{i=1}^{N}\subset S^{d-1}, then

and equality holds if and only if {xi}i=1N\{x_{i}\}_{i=1}^{N} is a spherical pp-design.

3 Optimal configurations for the p𝑝p-frame potential

We first use Theorem 2.2 to characterize the minimizers of the pp-frame potential for 0<p<20<p<2 provided that the number of points NN is a multiple of the dimension dd:

Let 0<p<20<p<2 and assume that N=kdN=kd for some positive integer kk. Then the minimizers of the pp-frame potential are exactly the kk copies of any orthonormal basis modulo multiplications by ±1\pm 1. The minimum of (5), over all sets of N=kdN=kd unit norm vectors, is k2dk^{2}d.

If we fix a collection of vectors {xi}i=1N\{x_{i}\}_{i=1}^{N}, then the frame potential is a decreasing function in p∈(0,2)p\in(0,2). Therefore,

We now consider the pp-frame potential for N=d+1N=d+1. The case p=2p=2 is covered by Theorem 2.2. Note that any FUNTF with N=d+1N=d+1 vectors is equiangular . Hence, the case 2<p<∞2<p<\infty is settled by Proposition 3.1, so we focus on p∈(0,2)p\in(0,2).

One easily verifies that, for p0=log⁡(d(d+1)2)log⁡(d)p_{0}=\frac{\log(\frac{d(d+1)}{2})}{\log(d)}, an orthonormal basis plus one repeated vector and an equiangular FUNTF have the same p0p_{0}-frame potential FP⁡p0,d+1\operatorname{FP}_{p_{0},d+1}. Under the assumption that those two systems are exactly the minimizers of FP⁡p0,d+1\operatorname{FP}_{p_{0},d+1}, the next result will give a complete characterization of the minimizers of FP⁡p,d+1\operatorname{FP}_{p,d+1}, for 0<p<20<p<2. However, we have only been able to establish the validity of this assumption when d=2d=2, cf. Corollary 3.7.

Let N=d+1N=d+1 and set p0=log⁡(d(d+1)2)log⁡(d)=log⁡(N(N−1)2)log⁡(N−1)p_{0}=\frac{\log(\frac{d(d+1)}{2})}{\log(d)}=\frac{\log(\frac{N(N-1)}{2})}{\log(N-1)}. Let {xi}i=1N⊂Sd−1\{x_{i}\}_{i=1}^{N}\subset S^{d-1}, and assume that FP⁡p0,N({xi}i=1N)≥N+2,\operatorname{FP}_{p_{0},N}(\{x_{i}\}_{i=1}^{N})\geq N+2, with equality holds if and only if {xi}i=1N\{x_{i}\}_{i=1}^{N} is an orthonormal basis plus one repeated vector or an equiangular FUNTF. Then,

for 0<p<p00<p<p_{0}, then for any {xi}i=1N⊂Sd−1\{x_{i}\}_{i=1}^{N}\subset S^{d-1}, we have FP⁡p,N({xi}i=1N)≥N+2,\operatorname{FP}_{p,N}(\{x_{i}\}_{i=1}^{N})\geq N+2, and equality holds if and only if {xi}i=1N\{x_{i}\}_{i=1}^{N} is an orthonormal basis plus one repeated vector,

for p0<p<2p_{0}<p<2, then for any {xi}i=1N⊂Sd−1\{x_{i}\}_{i=1}^{N}\subset S^{d-1}, we have FP⁡p,N({xi}i=1N)≥2pp0 (Nd)1−pp0+N,\operatorname{FP}_{p,N}(\{x_{i}\}_{i=1}^{N})\geq 2^{\frac{p}{p_{0}}}\,(Nd)^{1-\frac{p}{p_{0}}}+N, and equality holds if and only if {xi}i=1N\{x_{i}\}_{i=1}^{N} is an equiangular FUNTF.

Under the assumptions of the Theorem, let 0<p<p00<p<p_{0}, then

Consequently, min⁡FP⁡p0,N({xi}i=1N)=min⁡FP⁡p,N({xi}i=1N)=N+2\min\operatorname{FP}_{p_{0},N}(\{x_{i}\}_{i=1}^{N})=\min\operatorname{FP}_{p,N}(\{x_{i}\}_{i=1}^{N})=N+2. Since an orthonormal basis plus one repeated vector minimizes the pp-frame potential for p=p0p=p_{0}, it must also minimize FP⁡p,N\operatorname{FP}_{p,N} for 0<p<p00<p<p_{0}, which proves (1)(1).

Assume now that p0<p<2p_{0}<p<2. Choose rr such that 1p0=1p+1r\frac{1}{p_{0}}=\frac{1}{p}+\frac{1}{r}, Hölder’s inequality yields

Since we assume that (2)(2) holds, we have ∑i≠j∣⟨xi,xj⟩∣p0≥2\sum_{i\neq j}|\langle x_{i},x_{j}\rangle|^{p_{0}}\geq 2, which leads to

This concludes the proof of (2)(2). By applying (10), one then checks that an equiangular FUNTF satisfies (2)(2) with equality.

The “only” part comes from the fact that the Hölder inequality becomes an equality only if the sequences are linearly dependent. This means that the {xi}i=1N\{x_{i}\}_{i=1}^{N} are equiangular. They must then satisfy ∣⟨xi,xj⟩∣=1d|\langle x_{i},x_{j}\rangle|=\frac{1}{d}. Thus, by (10) they form an equiangular FUNTF . ∎

When d=2d=2 we can in fact verify the main hypothesis of Theorem 3.6, which leads to the following result:

Let {xi}i=13⊂S1\{x_{i}\}_{i=1}^{3}\subset S^{1}, and set p0=log⁡(3)log⁡(2)p_{0}=\frac{\log(3)}{\log(2)}. Then,

and equality holds if and only if {xi}i=13\{x_{i}\}_{i=1}^{3} is an orthonormal basis plus one repeated vector or an equiangular FUNTF.

for 0<p<p00<p<p_{0}, then for any {xi}i=13⊂S1\{x_{i}\}_{i=1}^{3}\subset S^{1}, we have FP⁡p,3({xi}i=13)≥5,\operatorname{FP}_{p,3}(\{x_{i}\}_{i=1}^{3})\geq 5, and equality holds if and only if {xi}i=13\{x_{i}\}_{i=1}^{3} is an orthonormal basis plus one repeated vector,

for p0<p<∞p_{0}<p<\infty, then for any {xi}i=13⊂S1\{x_{i}\}_{i=1}^{3}\subset S^{1}, we have FP⁡p,3({xi}i=13)≥62p+3,\operatorname{FP}_{p,3}(\{x_{i}\}_{i=1}^{3})\geq\frac{6}{2^{p}}+3, and equality holds if and only if {xi}i=13\{x_{i}\}_{i=1}^{3} is an equiangular FUNTF.

The minimum of FP⁡p,3\operatorname{FP}_{p,3}, for 0<p<∞0<p<\infty is plotted in Figure 1.

Clearly (1)(1) and (2)(2) follows from Theorem 3.6 once the minimizers of FP⁡p0,N\operatorname{FP}_{p_{0},N} are characterized.

Without loss of generality, let β\beta be the smallest angle between x1x_{1}, x2x_{2}, and x3x_{3} and let α\alpha be the second smallest angle between them. This yields, of course, 0≤β≤α0\leq\beta\leq\alpha.

Case 1: For 0≤α+β≤π20\leq\alpha+\beta\leq\frac{\pi}{2}, we have

Since 1<p01<p_{0}, the pp-frame potential is differentiable in α\alpha and β\beta, and its critical points are

This implies that either α=β=0\alpha=\beta=0 or β=0\beta=0 and α=π2\alpha=\frac{\pi}{2}. In the first case, we have a maximum since it implies x1=x2=x3x_{1}=x_{2}=x_{3}. The latter case means that two points are identical and the third one is perpendicular which is a potential minimum of the pp-frame potential.

Case 2: We can assume that π4≤α\frac{\pi}{4}\leq\alpha (otherwise we are in Case 1). We can further assume that π4≤α≤π2≤α+β≤2π3\frac{\pi}{4}\leq\alpha\leq\frac{\pi}{2}\leq\alpha+\beta\leq\frac{2\pi}{3} (if 2π3<α+β≤π\frac{2\pi}{3}<\alpha+\beta\leq\pi. Otherwise, substitute xix_{i} with −xi-x_{i}. We now have

By subtracting one equation from the other and raising to the second power, we obtain

where z1=cos⁡(α)2z_{1}=\cos(\alpha)^{2} and z2=cos⁡2(α+β)z_{2}=\cos^{2}(\alpha+\beta). Since sin⁡2(x)−1/2≥cos⁡2(x)\sin^{2}(x)-1/2\geq\cos^{2}(x) for all π/2≤x≤2π/3\pi/2\leq x\leq 2\pi/3, we have 0≤z1≤1/20\leq z_{1}\leq 1/2 and 0≤z2≤1/40\leq z_{2}\leq 1/4 because z2≤1−z2−1/2z_{2}\leq 1-z_{2}-1/2.

We consider the function F(z)=zp−1(1−z)F(z)=z^{p-1}(1-z) on 0≤z≤1/20\leq z\leq 1/2. FF achieves its maximum at z=p−1p≈0.3691z=\frac{p-1}{p}\approx 0.3691 and is convex, cf. Figure 2.

Therefore, for 0≤z1≤1/20\leq z_{1}\leq 1/2 and 0≤z2≤1/40\leq z_{2}\leq 1/4, we have F(z1)=F(z2)F(z_{1})=F(z_{2}) if and only if z1=z2z_{1}=z_{2} or z1=1/2z_{1}=1/2 and z2=1/4z_{2}=1/4. For z1=cos⁡2(α)=1/2z_{1}=\cos^{2}(\alpha)=1/2, we have α=π/3\alpha=\pi/3 and z2=cos⁡2(π/3+β)=1/4z_{2}=\cos^{2}(\pi/3+\beta)=1/4 yields β=π/3\beta=\pi/3. The case z1=z2z_{1}=z_{2} leads to cos⁡2(α)=cos⁡2(α+β)\cos^{2}(\alpha)=\cos^{2}(\alpha+\beta) which implies α+β−π/2=π/2−α\alpha+\beta-\pi/2=\pi/2-\alpha. This is equivalent to β=π−2α\beta=\pi-2\alpha. Since we assume β≤α\beta\leq\alpha, we obtain π/3≤α≤π/2\pi/3\leq\alpha\leq\pi/2.

on π/3≤α≤π/2\pi/3\leq\alpha\leq\pi/2, cf. Figure 2. Its derivative

By substituting x=cos⁡(α)x=\cos(\alpha), we obtain, for 0<x≤1/20<x\leq 1/2

where q=1/(p−1)q=1/(p-1). To show that gg has only one extremal point on 0<x≤1/20<x\leq 1/2, we differentiate

The term ∂g∂x(x)\frac{\partial g}{\partial x}(x) vanishes if and only if

Hence, x≈0.3618x\approx 0.3618 and ∂g∂x\frac{\partial g}{\partial x} does not have any other zeros on 0<x≤1/20<x\leq 1/2. This means that gg has only one extremal point and can then only have two zeros on 0<x≤1/20<x\leq 1/2. The zero at x=1/2x=1/2 corresponds to a minimum. This means that the zero of ∂g∂x\frac{\partial g}{\partial x} at x≈0.3618x\approx 0.3618 is a maximum of gg. Hence the other zero of g is between and ≈0.3618\approx 0.3618. However, this other zero corresponds to a maximum of ff. The minimum of ff can thus be at x=0x=0 or x=1/2x=1/2. This implies α=π/3\alpha=\pi/3 or α=π/2\alpha=\pi/2. It is easy to verify that α=π/3\alpha=\pi/3 would lead to β=π/3\beta=\pi/3, and α=π/2\alpha=\pi/2 yields β=0\beta=0. Thus, the minimum of the pp-frame potential corresponds to either an orthonormal basis plus one repeated element (α=π/2\alpha=\pi/2, β=0\beta=0) or an equiangular FUNTF (α=β=π/3\alpha=\beta=\pi/3). One easily checks that both situations lead to the same global minimum.

In view of Theorem 3.6 and Corollary 3.7, we have the following conjecture:

Let N=d+1N=d+1 and p0=log⁡(d(d+1)2)log⁡(d)p_{0}=\frac{\log(\frac{d(d+1)}{2})}{\log(d)}. Then

and equality holds if and only if {xi}i=1N\{x_{i}\}_{i=1}^{N} is an orthonormal basis plus one repeated vector or an equiangular FUNTF.

One can check that 1<p0<21<p_{0}<2, for d>1d>1. According to Proposition 3.1, the minimizers of the pp-frame potential for 2<p<∞2<p<\infty are exactly the equiangular FUNTFs. Thus, our conjecture essentially addresses the range 0<p<20<p<2.

The probabilistic p𝑝p-frame potential

The present section is dedicated to introducing a probabilistic version of the previous section. We shall consider probability distributions on the sphere rather than finite point sets. Let M(Sd−1,B)\mathcal{M}(S^{d-1},\mathcal{B}) denote the collection of probability distributions on the sphere with respect to the Borel sigma algebra B\mathcal{B}.

We begin by introducing the probabilistic pp-frame which generalizes the notion of probabilistic frames introduced in .

We call μ\mu a tight probabilistic pp-frame if and only if we can choose A=BA=B.

Due to Cauchy-Schwartz, the upper bound BB always exists. Consequently, in order to check that μ\mu is a probabilistic pp-frame one only needs to focus on the lower bound AA.

Since the uniform surface measure σ\sigma on Sd−1S^{d-1} is invariant under orthogonal transformations, one can easily check that it constitutes a tight probabilistic pp-frame, for any 0<p<∞0<p<\infty.

Given a probability measure μ∈M(Sd−1,B)\mu\in\mathcal{M}(S^{d-1},\mathcal{B}), we call

the analysis operator. It is trivially seen that

for all 0<p≤∞0<p\leq\infty. The dual of FF is called synthesis operator and is given by

where 1=1p+1q1=\frac{1}{p}+\frac{1}{q}, and 1≤p≤∞1\leq p\leq\infty. In fact, F∗F^{*} is well-defined and bounded operator on all Lr(Sd−1,μ)L_{r}(S^{d-1},\mu) where 1≤r≤∞1\leq r\leq\infty. Indeed, for f∈Lr(Sd−1,μ)f\in L_{r}(S^{d-1},\mu) we have

Given μ∈M(Sd−1,B)\mu\in\mathcal{M}(S^{d-1},\mathcal{B}), the second moments matrix of μ\mu is the d×dd\times d matrix defined by

If 1≤p<∞1\leq p<\infty, then μ∈M(Sd−1,B)\mu\in\mathcal{M}(S^{d-1},\mathcal{B}) is a probabilistic pp-frame if and only if F∗F^{*} is onto.

As mentioned earlier the upper bound in the probabilistic pp-frame definition always holds. So we only need to show the equivalence between the lower bound and the surjectivity of F∗F^{*}.

for all f∈Lp′f\in L_{p^{\prime}}. A contradiction argument leads to ⟨x,z⟩=0\langle x,z\rangle=0 for all x∈Sd−1x\in S^{d-1} which implies that z=0z=0. Thus F∗F^{*} is surjective. ∎

The second moments matrix can also be used to show that a probabilistic pp-frame gives rise to a reconstruction formula that extends the finite frame expansion in (3). In addition, the next result generalizes the reconstruction formula for tight probabilistic frames obtained in [16, Lemma 3.7].

The result follows by noticing that y=SS−1y=S−1Syy=SS^{-1}y=S^{-1}Sy. ∎

The above result motivates the following definition:

a) If μ\mu is probabilistic frame, then it is a probabilistic pp-frame for all 1≤p<∞1\leq p<\infty. Conversely, if μ\mu is a probabilistic pp-frame for some 1≤p<∞1\leq p<\infty, then it is a probabilistic frame.

where we have used the fact that for p<2p<2, L2(Sd−1,μ)⊂Lp(Sd−1,μ)L_{2}(S^{d-1},\mu)\subset L_{p}(S^{d-1},\mu). This conclude the proof of a).

We are particularly interested in tight probabilistic pp-frame potentials, which we seek to characterize in terms of minimizers of appropriate potentials. This motivates the following definition:

For 0<p<∞0<p<\infty and μ∈M(Sd−1,B)\mu\in\mathcal{M}(S^{d-1},\mathcal{B}), the probabilistic pp-frame potential is defined by

From the weak-star-compactness of the collection of all probability distributions on the sphere, we can deduce that PFP⁡(μ,p)\operatorname{PFP}(\mu,p) admits a minimizer which satisfies

We now turn to the minimizers of the probabilistic frame potential PFP⁡(μ)\operatorname{PFP}(\mu). In the process, we extend some ideas developed in to the probabilistic frame potential.

Let 0<p<∞0<p<\infty and let μ\mu be a minimizer of (15), then

∫Sd−1∣⟨x,y⟩∣pdμ(x)=PFP⁡(p)\int_{S^{d-1}}|\langle x,y\rangle|^{p}d\mu(x)=\operatorname{PFP}(p), for all y∈supp⁡(μ)y\in\operatorname{supp}(\mu),

∫Sd−1∣⟨x,y⟩∣pdμ(x)≥PFP⁡(p)\int_{S^{d-1}}|\langle x,y\rangle|^{p}d\mu(x)\geq\operatorname{PFP}(p), for all y∈Sd−1y\in S^{d-1}.

The proof will use the following observation. Let μ\mu be a probability measure on Sd−1S^{d-1} and choose a measure ν\nu, such that ν(Sd−1)=0\nu(S^{d-1})=0 and μ+εν≥0\mu+\varepsilon\nu\geq 0, for all 0≤ε≤10\leq\varepsilon\leq 1. Let us also introduce the notation

We thus have 0≤εPFP⁡(ν,p)+2PFP⁡(μ,ν,p)0\leq\varepsilon\operatorname{PFP}(\nu,p)+2\operatorname{PFP}(\mu,\nu,p), for all 0≤ε≤10\leq\varepsilon\leq 1, which implies PFP⁡(μ,ν,p)≥0\operatorname{PFP}(\mu,\nu,p)\geq 0.

We now prove (1)(1) using a contradiction argument. In particular, assume that (1)(1) does not hold. This implies that there are y1,y2∈supp⁡(μ)y_{1},y_{2}\in\operatorname{supp}(\mu) such that

Set Pμ(y)=∫Sd−1∣⟨x,y⟩∣pdμ(x)P_{\mu}(y)=\int_{S^{d-1}}|\langle x,y\rangle|^{p}d\mu(x). Let KK be an open ball around y1y_{1} in Sd−1S^{d-1} and so small that y2∉Ky_{2}\not\in K and that the oscillation of Pμ(y)P_{\mu}(y) on KK is smaller than b−a2\frac{b-a}{2}. Let m=μ(K)>0m=\mu(K)>0. One can check that the measure ν\nu defined by

satisfies ν(Sd−1)=0\nu(S^{d-1})=0, and μ+ϵν≥0\mu+\epsilon\nu\geq 0. Hence, PFP⁡(μ,ν,p)≥0\operatorname{PFP}(\mu,\nu,p)\geq 0. On the other hand, we can estimate

This is a contradiction to PFP⁡(μ,ν,p)≥0\operatorname{PFP}(\mu,\nu,p)\geq 0 and implies that there is a constant CC such that Pμ(y)=CP_{\mu}(y)=C, for all y∈supp⁡(μ)y\in\operatorname{supp}(\mu). We still have to verify that the constant CC is in fact PFP⁡(p)\operatorname{PFP}(p):

The proof of (2)(2) is similar to the one above, and so we omit it. ∎

The following result is an immediate consequence of Proposition 4.7.

Let 0<p<∞0<p<\infty and let μ\mu be a minimizer of (15), then

∫Sd−1∣⟨x,y⟩∣pdμ(x)=PFP⁡(p)∥y∥p\int_{S^{d-1}}|\langle x,y\rangle|^{p}d\mu(x)=\operatorname{PFP}(p)\|y\|^{p}, for all y∥y∥∈supp⁡(μ)\frac{y}{\|y\|}\in\operatorname{supp}(\mu),

(1)(1) directly follows from (1)(1) in Proposition 4.7.

We can now characterize the minimizers of the probabilistic pp-frame potential when 0<p<20<p<2. In fact, we shall show that these minimizers are discrete probability measures, and the following theorem is the analogue of Proposition 3.5:

Let 0<p<20<p<2, then the minimizers of (15) are exactly those probability distributions μ\mu that satisfy both,

The measure ν±x1,…,±xd(x)\nu_{\pm x_{1},\ldots,\pm x_{d}}(x) in Theorem 4.9 denotes the counting measure of the set {±xi:i=1,…,d}\{\pm x_{i}:i=1,\ldots,d\}.

Since 0≤∣⟨x,y⟩∣≤10\leq|\langle x,y\rangle|\leq 1, for x,y∈Sd−1x,y\in S^{d-1}, we have PFP⁡(μ,p)≥PFP⁡(μ,2)\operatorname{PFP}(\mu,p)\geq\operatorname{PFP}(\mu,2). In [16, Theorem 3.10] it was shown that the normalized counting measure 1dνx1,…,xd\frac{1}{d}\nu_{x_{1},\ldots,x_{d}} of an orthonormal basis minimizes PFP⁡(⋅,2)\operatorname{PFP}(\cdot,2). Due to PFP⁡(1dνx1,…,xd,2)=PFP⁡(1dνx1,…,xd,p)\operatorname{PFP}(\frac{1}{d}\nu_{x_{1},\ldots,x_{d}},2)=\operatorname{PFP}(\frac{1}{d}\nu_{x_{1},\ldots,x_{d}},p), we obtain that 1dνx1,…,xd\frac{1}{d}\nu_{x_{1},\ldots,x_{d}} also minimizes PFP⁡(⋅,p)\operatorname{PFP}(\cdot,p) and hence PFP⁡(p)=PFP⁡(2)\operatorname{PFP}(p)=\operatorname{PFP}(2).

In the following, we prove that all minimizers of PFP⁡(⋅,p)\operatorname{PFP}(\cdot,p) are essentially induced by an orthonormal basis. Let μ\mu be a minimizer and let v,w∈supp⁡(μ)v,w\in\operatorname{supp}(\mu). We first show that ∣⟨v,w⟩∣∈{0,1}|\langle v,w\rangle|\in\{0,1\}. The implications ⟨v,w⟩=1\langle v,w\rangle=1 if and only if v=wv=w and ⟨v,w⟩=−1\langle v,w\rangle=-1 if and only if v=−wv=-w are trivial.

Suppose now that v≠±wv\neq\pm w and ⟨v,w⟩≠0\langle v,w\rangle\neq 0, then there exist ε>0\varepsilon>0 and δε>0\delta_{\varepsilon}>0 such that

Bε(v)∩Bε(w)=∅B_{\varepsilon}(v)\cap B_{\varepsilon}(w)=\emptyset and μ(Bε(v)),μ(Bε(w))≥δε\mu(B_{\varepsilon}(v)),\mu(B_{\varepsilon}(w))\geq\delta_{\varepsilon}.

for all x∈Bε(v)x\in B_{\varepsilon}(v) and y∈Bε(w)y\in B_{\varepsilon}(w), ∣⟨x,y⟩∣p≥∣⟨x,y⟩∣2+ε|\langle x,y\rangle|^{p}\geq|\langle x,y\rangle|^{2}+\varepsilon.

By using B=Bε(v)×Bε(w)B=B_{\varepsilon}(v)\times B_{\varepsilon}(w), this implies

For even integers pp, we can give the minimum of PFP⁡(μ,p)\operatorname{PFP}(\mu,p) and characterize its minimizers. The following theorem generalizes Theorem 3.4. Moreover, note that the bounds are now sharp, i.e., for any even integer pp, there is a probabilistic tight pp-frame:

Let pp be an even integer. For any probability distribution μ\mu on Sd−1S^{d-1},

and equality holds if and only if μ\mu is a probabilistic tight pp-frame.

Let α=d2−1\alpha=\frac{d}{2}-1 and consider the Gegenbauer polynomials {Cnα}n≥0\{C_{n}^{\alpha}\}_{n\geq 0} defined by

{Cn(α)}n=1s\{C_{n}^{(\alpha)}\}_{n=1}^{s} is an orthogonal basis for the collection of polynomials of degree less or equal to ss on the interval $$ with respect to the weight

The polynomials tpt^{p}, pp an even integer, can be represented by means of

It is known (see, e.g., ) that λi>0\lambda_{i}>0, i=0,…,pi=0,\ldots,p, and λ0\lambda_{0} is given by

see . Note that the probability measures with finite support are weak star dense in M(Sd−1,B)\mathcal{M}(S^{d-1},\mathcal{B}). Since CkαC^{\alpha}_{k} is continuous, we obtain, for all μ∈M(Sd−1,B)\mu\in\mathcal{M}(S^{d-1},\mathcal{B}),

From the results in , one can deduce that

We still have to address the “if and only if” part. Equality holds if and only if μ\mu satisfies

is a polynomial in yy. In fact, the integral resolves in the polynomial’s coefficients. These two observations enable us to follow the lines in , and we can conclude the proof. ∎

One may speculate that Theorem 4.10 could be extended to p≥2p\geq 2 that are not even integers. This is not true in general. For d=2d=2 and p=3p=3, for instance, the equiangular FUNTF with 33 elements induces a smaller potential than the uniform distribution. The uniform distribution is a probabilistic tight 33-frame, but the equiangular FUNTF is not.

Acknowledgements

The authors would like to thank C. Bachoc, W. Czaja, C. Wickman, and W. S. Yu for discussions leading to some of the results presented here. M. Ehler was supported by the Intramural Research Program of the National Institute of Child Health and Human Development and by NIH/DFG Research Career Transition Awards Program (EH 405/1-1/575910). K. A. Okoudjou was partially supported by ONR grant N000140910324, by RASA from the Graduate School of UMCP, and by the Alexander von Humboldt foundation.

References