Invertibility and Robustness of Phaseless Reconstruction

Radu Balan, Yang Wang

Introduction

This paper is concerned with the question of reconstructing a vector xx in a finite-dimensional real Hilbert space HH of dimension nn when only the magnitudes of the coefficients of the vector under a redundant linear map are known.

Specifically our problem is to reconstruct x∈Hx\in H up to a global phase factor from the magnitudes {∣⟨x,fk⟩∣ , 1≤k≤m}\{|{\langle x,f_{k}\rangle}|~{},~{}1\leq k\leq m\} where F={f1,⋅⋅⋅,fm}\mathcal{F}=\{f_{1},\mathinner{\cdotp\cdotp\cdotp},f_{m}\} is a frame (complete system) for HH.

A previous paper described the importance of this problem to signal processing, in particular to the analysis of speech. Of particular interest is the case when the coefficients are obtained from a Windowed Fourier Transform (also known as Short-Time Fourier Transform), or an Undecimated Wavelet Transform (in audio and image signal processing). A similar problem appears in Quantum Information (QI) literature (see e.g. ). However some important differences are notable: first the unknown objects to be reconstructed are quantum states (meaning nonnegative symmetric operators of unit trace); secondly, measurements are performed by taking Hilbert-Schmidt inner products against some (nonnegative) symmetric operators of rank not necessarily one. In QI language our problem is to reconstruct rank one nonnegative symmetric operators from measurements against a set of rank one nonnegative symmetric operators.

While presents some necessary and sufficient conditions for reconstruction, the general problem of finding fast/efficient algorithms is still open. In we describe one solution in the case of STFT coefficients.

For vectors in real Hilbert spaces, the reconstruction problem is easily shown to be equivalent to a combinatorial problem. In this problem is further proved to be equivalent to a (nonconvex) optimization problem.

A different approach (which we called the algebraic approach) was proposed in . While it applies to both real and complex cases, noisless and noisy cases, the approach requires solving a linear system of size exponentially in space dimension. This algebraic approach generalizes the approach in where reconstruction is performed with complexity O(n2)O(n^{2}) (plus computation of the principal eigenvector for a matrix of size nn). However this method requires m=O(n2)m=O(n^{2}) frame vectors.

Recently the authors of developed a convex optimization algorithm (a SemiDefinite Program called PhaseLift) and proved its ability to perform exact reconstruction in the absence of noise, as well as its stability under noise conditions. In a separate paper , the authors further developed a similar algorithm in the case of windowed DFT transforms. Inspired by the PhaseLift and MaxCut algorithms, but operating in the coefficients space, the authors of proposed a SemiDefinite Program called PhaseCut. They show the algorithm yields the exact solution in the absence of noise under similar conditions as PhaseLift.

The paper presents an iterative regularized least-square algorithm for inverting the nonlinear map and compares its performance to a Cramer-Rao lower bound for this problem in the real case. The paper also presents some new injectivity results which are incorporated into this paper.

A different approach is proposed in . There the authors use a 4-term polarization identity together with a family of spectral expander graphs to design a frame of bounded redundancy (mn≤236\frac{m}{n}\leq 236) that yields an exact reconstruction algorithm in the absence of noise.

The authors of study several robustness bounds to the phase recovery problem in the real case. However their approach is different than ours in several respects. First they consider a probabilistic setup of this problem, where data xx and frame vectors fjf_{j}’s are random vectors with probabilities from a class of subgaussian distributions. Additionally, their focus is on classes of kk-sparse signals. Their results show that, with high probability, recovery is possible from a number of measurements mm that has a similar asymptotic behavior with respect to nn and kk as in the case of linear measurements (that is with the phase). In our paper we analyze stability bounds of reconstruction for a fixed frame using deterministic analytic tools. After that we present asymptotic behavior of these bounds for random frames.

Finally, the authors of analyze the phaseless reconstruction problem for both the real and complex case. In the real case the authors obtain the exact upper Lipschitz constant for the nonlinear map αF{\alpha_{\mathcal{F}}}, namely B\sqrt{B} where BB is the upper frame bound. For the lower Lipschitz constant, they give an estimate between two computable singular eienvalues. Our results have overlaps with their results somewhat here. However, in this paper we improve the improve the lower Lipschitz constant by giving its exact value. There are some significant differences between this paper and . In addition to studying of the Lipschitz property of the map αF{\alpha_{\mathcal{F}}} we focus also on two related but different settings. First we study the robustness of the reconstruction given a fixed error allowance in measurements. Second we also consider the Lipschitz property of the map αF2{\alpha_{\mathcal{F}}}^{2}. The authors of point out that the map αF2{\alpha_{\mathcal{F}}}^{2} is not bi-Lipschitz. However in our paper we show αF2{\alpha_{\mathcal{F}}}^{2} becomes bi-Lipschitz for a different metric on the domain. With this metric (the one induced by the nuclear norm on the set of symmetric operators) the nonlinear map αF2{\alpha_{\mathcal{F}}}^{2} is bi-Lipschitz with constants indicated in Theorem 4.5. Furthermore the same conclusion holds true in the complex case, although this will be studied elsewhere.

The organization of the paper is as follows. Section 2 formally defines the problem and reviews existing inversion results in the real case. Section 3 establishes information theoretic performance bounds, namely the Cramer-Rao lower bound. Section 4 contains robustness measures of any reconstruction algorithm. Section 5 presents a stochastic analysis of these bounds, and is followed by references.

Background

When we can choose A=BA=B the frame is said tight. For A=B=1A=B=1 the frame is called Parseval. The frame matrix corresponding to F\mathcal{F} is defined as F=[f1,f2,…,fm]F=[f_{1},f_{2},\dots,f_{m}] with the vectors fj∈Ff_{j}\in\mathcal{F} as its columns. We shall frequently identify F\mathcal{F} with its corresponding frame matrix FF. The largest AA and smallest BB in (2.1) are called the lower frame bound and upper frame bound of F\mathcal{F}, and they are given by

Thus the phaseless reconstruction problems aims to reconstruct x^∈H^\hat{x}\in\hat{H} from the map αF(x){\alpha_{\mathcal{F}}}(x). We say a frame F\mathcal{F} is phase retrievable if one can reconstruct x^∈H^\hat{x}\in\hat{H} for all x^\hat{x}, or in other words, αF{\alpha_{\mathcal{F}}} is injective on H^\hat{H}. The main objective of this paper is to analyze robustness and stability of the inversion map, and to give performance bounds of any reconstruction algorithm.

If F\mathcal{F} is phase retrievable in H^\hat{H} then m≥2n−1m\geq 2n-1. Furthermore, for a generic F\mathcal{F} with m≥2n−1m\geq 2n-1 the map αF{\alpha_{\mathcal{F}}} is phase retrievable in H^\hat{H}.

Let m=2n−1m=2n-1. Then F\mathcal{F} is phase retrievable in H^\hat{H} if an only if F\mathcal{F} is full spark.

Then F\mathcal{F} is phase retrievable in H^\hat{H} if and only if a0>0a_{0}>0.

Proof. The results (1)-(3) are in , and (4)-(5) are in .

Information Theoretic Performance Bounds

In this section we derive expressions for the Fisher Information Matrix and obtain performance bounds for reconstruction algorithms in the noisy case.

Consider the following noisy measurement process:

where the noise model is AWGN (additive white Gaussian noise): each random variable νk\nu_{k} is independent and normally distributed with zero mean and σ2\sigma^{2} variance.

Under these assumptions we compute the Fisher Information matrix (see ). This is given by

where the likelihood function L(x)L(x) is given by

Note the matrix R(x)R(x) is exactly the same as the matrix introduced in (2.6). Thus we obtain the following results:

This allows to state the following performance bound result (see for details on the Cramer-Rao lower bound).

Furthermore, any efficient estimator (that is, any unbiased estimator ω{\omega} that achieves the Cramer-Rao Lower Bound (3.6)) has the covariance matrix bounded from above by

Robustness Measures for Reconstruction

In this section we analyze the robustness of deterministic phaseless reconstruction. Additionally we connect the constant a0a_{0} introduced earlier in Theorem 2.1 to quantities directly computable from the frame F\mathcal{F}.

The size of Qε(x)Q_{\varepsilon}(x) measures the worst case stability of the reconstruction for the vector xx, under the assumption that the total noise level is controlled by ε\varepsilon. We also study the global stability by analyzing the measures

Here ∥.∥\|.\| denotes usual Euclidian norm. Note that Qε(x)Q_{\varepsilon}(x) has the scaling property Qε(x)=Q∣c∣ε(cx)Q_{\varepsilon}(x)=Q_{|c|\varepsilon}(cx) for any real c≠0c\neq 0. Thus it is natural to focus on unit vectors xx.

We introduce now some quantities that play key roles in the estimation of these robustness measures. For the frame F\mathcal{F} let F=[f1,f2,⋯ ,fm]F=[f_{1},f_{2},\cdots,f_{m}] be its frame matrix. Denote by F[S]={fk , k∈S}\mathcal{F}[S]=\{f_{k}~{},~{}k\in S\} the subset of F\mathcal{F} indexed by a subset S⊆{1,2,⋅⋅⋅,m}S\subseteq\{1,2,\mathinner{\cdotp\cdotp\cdotp},m\}, and by FSF_{S} the frame matrix corresponding to F[S]\mathcal{F}[S] (which is the matrix with vectors in F[S]\mathcal{F}[S] as its columns). Set

All of them depend of course on F\mathcal{F}. However since we fix F\mathcal{F} throughout the paper, we shall without confusion not explicitly reference F\mathcal{F} in the notation for simplicity as there will not be any confusion. Clearly

Let ε>0\varepsilon>0. Then the stability measurement function Qε(x)Q_{\varepsilon}(x) is given by

under the constraints 12(w1+w2)=x\frac{1}{2}(w_{1}+w_{2})=x and

where S:=S(w1,w2)={j: ∣⟨fj,w1⟩∣≤∣⟨fj,w2⟩∣}S:=S(w_{1},w_{2})=\{j:~{}|\langle f_{j},w_{1}\rangle|\leq|\langle f_{j},w_{2}\rangle|\}.

Let FF be the frame matrix of F\mathcal{F}. We thus have

Note that d(x,y)=min⁡(∥w1∥,∥w2∥)d(x,y)=\min(\|w_{1}\|,\|w_{2}\|). The proposition now follows.

The above proposition allows us to establish the following stability result for the worst case scenario.

Assume that the frame F\mathcal{F} is phase retrievable. Let A>0A>0 be the lower frame bound for the frame F\mathcal{F} and let τ:=min⁡{σn(FS): S⊆{1,…,m}, rank(FS)=n}\tau:=\min\{\sigma_{n}(F_{S}):~{}S\subseteq\{1,\dots,m\},~{}{\rm rank}(F_{S})=n\}.

If ε<τ\varepsilon<\tau then qε=1ωq_{\varepsilon}=\frac{1}{\omega}. Consequently q0=1ωq_{0}=\frac{1}{\omega}.

The upper bound q∞q_{\infty} equals the reciprocal of Δ\Delta:

under the constraints 12(w1+w2)=x\frac{1}{2}(w_{1}+w_{2})=x and

for some SS. Now assume without loss of generality that ∥w1∥≤∥w2∥\|w_{1}\|\leq\|w_{2}\|. Then

Thus Qε(x)≤1ΔQ_{\varepsilon}(x)\leq\frac{1}{\Delta}.

Thus ∥w2∥≥∥w1∥{\|w_{2}\|}\geq{\|w_{1}\|}. Now let

It follows that qε≥min⁡ {1ε,1ω}q_{\varepsilon}\geq\min\,\{\frac{1}{\varepsilon},\frac{1}{\omega}\}. Now by taking ε>0\varepsilon>0 sufficiently small we have qε≥1ωq_{\varepsilon}\geq\frac{1}{\omega}.

This is a contradiction. So rank(FS)<n{\rm rank}(F_{S})<n and hence

Thus ∥w2∥≤εω\|w_{2}\|\leq\frac{\varepsilon}{\omega}. Proposition 4.1 now yields qε=1ωq_{\varepsilon}=\frac{1}{\omega}, proving part (B).

Now we prove (C). We go back to the formulation in Proposition 4.1.

under the constraints 12(w1+w2)=x\frac{1}{2}(w_{1}+w_{2})=x and

where S:=S(w1,w2)={j: ∣⟨fj,w1⟩∣≤∣⟨fj,w2⟩∣}S:=S(w_{1},w_{2})=\{j:~{}|\langle f_{j},w_{1}\rangle|\leq|\langle f_{j},w_{2}\rangle|\}. Since αF{\alpha_{\mathcal{F}}} is injective, either rank(FS)=n{\rm rank}(F_{S})=n or rank(FSc)=n{\rm rank}(F_{S^{c}})=n by Theorem 2.1 (1). Without loss of generality we assume rank(FS)=n{\rm rank}(F_{S})=n. Thus \varepsilon\geq\|F_{S}^{*}w_{1}\bigr{\|}\geq\tau\|w_{1}\|. So ∥w1∥≤ε/τ\|w_{1}\|\leq\varepsilon/\tau. We show that for any k∈Sck\in S^{c} we must have ⟨fk,x⟩=0\langle f_{k},x\rangle=0. Assume otherwise and write w2=2x−w1w_{2}=2x-w_{1}, Lx:=min⁡ {∣⟨fj,x⟩∣: ⟨fj,x⟩≠0}L_{x}:=\min\,\{|\langle f_{j},x\rangle|:~{}\langle f_{j},x\rangle\neq 0\}. Then

This is a contradiction. Thus for k∈Sck\in S^{c} we have ⟨fk,x⟩=0\langle f_{k},x\rangle=0 and

Thus ∥w1∥≤ε/A\|w_{1}\|\leq\varepsilon/\sqrt{A} and hence Qε(x)≤1AQ_{\varepsilon}(x)\leq\frac{1}{\sqrt{A}}. Now we show the bound can be achieved. Let w1w_{1} satisfy ∥F∗w1∥=A∥w1∥=ε\|F^{*}w_{1}\|=\sqrt{A}\|w_{1}\|=\varepsilon. Such a w1w_{1} always exists. Then clearly w1w_{1} and w2=2x−w1w_{2}=2x-w_{1} satisfy the required constraints, and it is easy to check that min⁡ (∥w1∥,∥w2∥)=∥w1∥=ε/A\min\,(\|w_{1}\|,\|w_{2}\|)=\|w_{1}\|=\varepsilon/\sqrt{A}.

Finally we prove (D). By the result at part (A), q∞≤1Δq_{\infty}\leq\frac{1}{\Delta}. It is therefore sufficient to shoow that Qε(x)≥1ΔQ_{\varepsilon}(x)\geq\frac{1}{\Delta} for some xx and ε\varepsilon. Let S0S_{0} be the subset that achieves the minimum in (4.4). Let u,v∈Hu,v\in H be unit eigenvectors corresponding to the lowest eigenvalues of FS0FS0∗F_{S_{0}}F_{S_{0}}^{*} and FS0cFS0c∗F_{S_{0}^{c}}F_{S_{0}^{c}}^{*} respectively. Thus

Let x=(u+v)/2x=(u+v)/2 and ε=Δ\varepsilon=\Delta, and set w1=uw_{1}=u, w2=vw_{2}=v. Then by Proposition 4.1

Remark. It may seem strange that Qε(x)=1AQ_{\varepsilon}(x)=\frac{1}{\sqrt{A}} for all x≠0x\neq 0 and sufficiently small ε\varepsilon while q0=1ωq_{0}=\frac{1}{\omega}, where ω\omega is typically much smaller than A\sqrt{A}. The reason is that for Qε(x)=1AQ_{\varepsilon}(x)=\frac{1}{\sqrt{A}} to hold, ε\varepsilon depends on xx. Thus we cannot exchange the order of lim sup⁡ε→0\limsup_{\varepsilon{\rightarrow}0} and max⁡∥x∥=1\max_{\|x\|=1}.

We first investigate the bounds for U(x,y)U(x,y). For this the upper bound is relatively straightforward. Let w1=x−yw_{1}=x-y and w2=x+yw_{2}=x+y. We have already shown in the proof of Theorem 4.2 using (4.9) that

To study the lower bound U(x,y)U(x,y) we now consider the following quantities:

where again w1=x−yw_{1}=x-y and w2=x+yw_{2}=x+y. Now fix xx and let d(x,y)<εd(x,y)<\varepsilon. Without loss of generality we may assume ∥y−x∥<ε\|y-x\|<\varepsilon. Thus ∥w1∥<ε\|w_{1}\|<\varepsilon and ∥w2−2x∥=∥w1∥<ε\|w_{2}-2x\|=\|w_{1}\|<\varepsilon. Let S={j, ⟨fj,x⟩≠0}S=\{j,~{}\langle f_{j},x\rangle\neq 0\} and set

Note for any w1w_{1} with ∥w1∥<ε0{\|w_{1}\|}<\varepsilon_{0} and k∈Sk\in S we have

Hence min⁡ (∣⟨fj,w1⟩∣2,∣⟨fj,w2⟩∣2)=∣⟨fj,w1⟩∣2\min\,(|\langle f_{j},w_{1}\rangle|^{2},|\langle f_{j},w_{2}\rangle|^{2})=|\langle f_{j},w_{1}\rangle|^{2} for all jj whenever ε<ε0(x)\varepsilon<\varepsilon_{0}(x). It follows that

Thus U2(x,y)≥AU^{2}(x,y)\geq A where AA is the lower frame bound for the frame F\mathcal{F}. Furthermore this lower bound is achieved whenever w1=x−yw_{1}=x-y is an eigenvector corresponding to the smallest eigenvalue of FF∗FF^{*}. This implies that

whenever ε<ε0(x)\varepsilon<\varepsilon_{0}(x). Consequently ρ(x)=A\rho(x)=\sqrt{A}. We have the following theorem:

Assume that ε<ε0(x)\varepsilon<\varepsilon_{0}(x). Then ρε(x)=A\rho_{\varepsilon}(x)=\sqrt{A}. Consequently ρ(x)=ρ0=A\rho(x)=\rho_{0}=\sqrt{A}.

Δ=ρ∞≤ω≤ρ0=ρ(x)=A\Delta=\rho_{\infty}\leq\omega\leq\rho_{0}=\rho(x)=\sqrt{A}.

The map αF{\alpha_{\mathcal{F}}} is bi-Lipschitz with (optimal) upper Lipschitz bound B\sqrt{B} and lower Lipschitz bound ρ∞\rho_{\infty}:

Proof. We have already proved (1) and (2) of the theorem in the discussion. It remains only to prove (3) since (4) is just a restatement of (1) and (3). Note that

For any w1,w2w_{1},w_{2}, assume without loss of generality that 0<∥w1∥≤∥w2∥0<\|w_{1}\|\leq\|w_{2}\|. Let S={j: ∣⟨fj,w1⟩∣≤∣⟨fj,w2⟩∣}S=\{j:~{}|{\langle f_{j},w_{1}\rangle}|\leq|{\langle f_{j},w_{2}\rangle}|\}. Set v1=w1/∥w1∥v_{1}=w_{1}/\|w_{1}\|, v2=w2/∥w2∥v_{2}=w_{2}/\|w_{2}\| and t=∥w2∥/∥w1∥≥1t=\|w_{2}\|/\|w_{1}\|\geq 1. Then

Let SS and u,v∈Hu,v\in H be normalized (eigen) vectors that achieve the bound Δ\Delta, that is:

Remark. The two quantities, ρ∞\rho_{\infty} and q∞q_{\infty} satisfy ρ∞=1q∞\rho_{\infty}=\frac{1}{q_{\infty}}. However there are subtle differences between qε(x)q_{\varepsilon}(x) and ρε(x)\rho_{\varepsilon}(x) so that the simple relationship ρε(x)=1/qε(x)\rho_{\varepsilon}(x)=1/q_{\varepsilon}(x) does not usually hold.

Remark. The upper Lipschitz bound B\sqrt{B} has been obtained independently in . The lower Lipschitz bound we obtained here strenghtens the estimates given in . Specifically their estimate for ρ∞\rho_{\infty} reads σ≤ρ∞≤2σ{\boldsymbol{\sigma}}\leq\rho_{\infty}\leq\sqrt{2}{\boldsymbol{\sigma}} where

Clearly σ≤Δ≤2σ{\boldsymbol{\sigma}}\leq\Delta\leq\sqrt{2}{\boldsymbol{\sigma}}.

We conclude this section by turning our attention to the analysis of V(x,y)V(x,y). A motivation for studying it is that in practical problems the noise is often added directly to αF2{\alpha_{\mathcal{F}}}^{2} as in (3.1) rather than to αF{\alpha_{\mathcal{F}}}. Such noise model is used in many studies of phaseless reconstruction, e.g. in the Phaselift algorithm , or in the IRLS algorithm in .

The following lemma will be useful in this analysis

Furthermore, for X=12(w1w2T+w2w1T)X=\frac{1}{2}(w_{1}w_{2}^{T}+w_{2}w_{1}^{T}) its nuclear norm is ∥X∥1=∥w1∥∥w2∥\|X\|_{1}=\|w_{1}\|\|w_{2}\|.

(B) ⇒\Rightarrow (C) is proved directly by setting w1=x−yw_{1}=x-y and w2=x+yw_{2}=x+y.

We now prove (C) ⇒\Rightarrow (A) by computing the eigenvalues of X=12(w1w2T+w2w1T)X=\frac{1}{2}(w_{1}w_{2}^{T}+w_{2}w_{1}^{T}). Obviously rank(X)≤2{\rm rank}(X)\leq 2. Let λ1,λ2\lambda_{1},\lambda_{2} be the two (possibly) nonzero eigenvalues of XX. Then

Hence, by Cauchy-Schwartz inequality, λ1≥0≥λ2\lambda_{1}\geq 0\geq\lambda_{2} which proves X∈Sn1,1X\in S_{n}^{1,1}. Furthermore, it also shows that the nuclear norm of XX is ∥X∥1=∣λ1∣+∣λ2∣=∥w1∥∥w2∥\|X\|_{1}=|\lambda_{1}|+|\lambda_{2}|=\|w_{1}\|\|w_{2}\|.

Now we analyze V(x,y)V(x,y). Parallel to the study of U(x,y)U(x,y) we consider the following quantities:

as well as the upper bound supd1(x,y)>0V(x,y)sup_{d_{1}(x,y)>0}V(x,y). By (4.15) we have ∣⟨fj,x⟩∣2−∣⟨fj,y⟩∣2=⟨Fj,X⟩|\langle f_{j},x\rangle|^{2}-|\langle f_{j},y\rangle|^{2}={\langle F_{j},X\rangle} where Fj=fjfjTF_{j}=f_{j}f_{j}^{T} and X=xxT−yyTX=xx^{T}-yy^{T}. Hence

Set w1=x−yw_{1}=x-y and w2=x+yw_{2}=x+y and apply Lemma 4.4 we obtain

We can immediately obtain the upper bound:

where R(x)R(x) was defined in (2.6). An immediate bound is ΛF≤Bmax⁡∥fk∥{\Lambda_{\mathcal{F}}}\leq\sqrt{B}\max{\|f_{k}\|} with BB the upper frame bound of F\mathcal{F}.

Fix x≠0x\neq 0 and let d(x,y)→0d(x,y){\rightarrow}0. Then either y→xy\rightarrow x or y→−xy{\rightarrow}-x. Without loss of generality we assume that x→yx{\rightarrow}y. Thus w1=x−y→0w_{1}=x-y\rightarrow 0 and w2=x+y→2xw_{2}=x+y\rightarrow 2x. However w1/∥w1∥w_{1}/{\|w_{1}\|} can be any unit vector. Thus

where R(x)R(x) was introduced in (2.6). Thus we obtain

where a0a_{0} was introduced in (2.4). Thus we proved:

Assume the frame F\mathcal{F} is phase retrievable. Then

Furthermore αF2{\alpha_{\mathcal{F}}}^{2} is bi-Lipschitz with upper Lipschitz bound ΛF2{\Lambda_{\mathcal{F}}}^{2} and lower Lipschitz bound μ0\mu_{0}:

Remark. Note that the distance d(.,.)d(.,.) is not equivalent to d1(.,.)d_{1}(.,.). Theorem 4.5 now also implies that αF2{\alpha_{\mathcal{F}}}^{2} is not bi-Lipschitz with respect to the distance d(.,.)d(.,.) on H^\hat{H}. This fact was pointed out in .

Robustness and Size of Redundancy

Previous sections establish results on the robustness of phaseless reconstruction for the worst case scenario. A natural question is to ask: can “reasonable” robustness be achieved for a given frame, and in particular with small number of samples? We shall examine how q∞q_{\infty} scales as the dimension nn increases.

Consider the case where m=2n−1m=2n-1. This is the minimal redundancy required for phaseless reconstruction. In this case any frame F\mathcal{F} would have Δ=ω\Delta=\omega. Hence we have min⁡{1/ω,1/ε}≤qε=1/ω\min\{1/\omega,1/\varepsilon\}\leq q_{\varepsilon}=1/\omega. The stability of the reconstruction is thus mostly controlled by the size of 1/ω1/\omega. The question is: how big is ω\omega, especially as nn increases?

It follows that σn(G)≤Ln\sigma_{n}(G)\leq\frac{L}{\sqrt{n}}, and hence

Note that here we have considered only the first n+1n+1 vectors of the frame F\mathcal{F}. The actual value of ω\omega will likely decay much faster as nn increases. In a preliminary work we are able to establish the bound ω≤CL/n3\omega\leq CL/\sqrt{n^{3}} where CC is independent of nn . But even this estimate is likely far from optimal.

Let m=2n−1m=2n-1 and ∥fj∥≤L\|f_{j}\|\leq L for all fj∈Ff_{j}\in\mathcal{F}. Then there exist constants C>0C>0 and 0<β<10<\beta<1 independent of nn such that

A related problem is as follows: Consider an n×(n+k)n\times(n+k) matrix F=[g1,g2,…,gn+k]F=[g_{1},g_{2},\dots,g_{n+k}]. Let τ=min⁡{σn(FS): S⊂{1,…,n+k},∣S∣=n}\tau=\min\{\sigma_{n}(F_{S}):~{}S\subset\{1,\dots,n+k\},|S|=n\}. Assume that all ∥gj∥≤1\|g_{j}\|\leq 1. How large can τ\tau be? For k=1k=1 we have already seen that it is bounded from above by C/nC/\sqrt{n}. The preliminary work shows that for k=1k=1 it is bounded from above by C/n32C/n^{\frac{3}{2}}.

There exists a constant C=C(k)C=C(k) such that

Thus in the minimal setting with m=2n−1m=2n-1 it is impossible to achieve scale independent stability for phaseless reconstruction. The same arguments can be used to show that even when m=2n+k0m=2n+k_{0} for some fixed k0k_{0} scale independent stability is not possible. A natural question is whether scale independent stability is possible when we increase the redundancy of the frame. As it turns out this is possible via a recent work by Wang . More precisely, the following result follows from the main results in :

Let r0>2r_{0}>2 and let F=1nGF=\frac{1}{\sqrt{n}}G where GG is an n×mn\times m random matrix whose elements are i.i.d. normal N(0,1)N(0,1) random variables such that m/n=r0m/n=r_{0}. Then there exist constants 0<Δ0≤ω00<\Delta_{0}\leq\omega_{0} dependent only on r0r_{0} and not on nn such that with high probability we have

Proof. Part of the main theorem of proves the following result: Let λ>δ>1\lambda>\delta>1 be fixed. Assume that A=1nBA=\frac{1}{\sqrt{n}}B where BB is an n×Nn\times N random Gaussian matrix with i.i.d N(0,1)N(0,1) entries such that N/n=λN/n=\lambda. Then there exists a constant c>0c>0 depending continuously and only on λ\lambda and δ\delta such that

The theorem now readily follows. Observe that because r0>2r_{0}>2, in the expression for Δ\Delta we may choose λ=r0\lambda=r_{0} δ=r02>1\delta=\frac{r_{0}}{2}>1 and clearly we have

for some Δ0>0\Delta_{0}>0 independent of nn. For ω\omega we may choose λ=r0\lambda=r_{0} and δ=r0−1>1\delta=r_{0}-1>1. Again the theorem of implies that

In the theorem the values Δ0\Delta_{0} and ω0\omega_{0} can be estimated explicitly. Here with high probability is in the standard sense that the probability is at least 1−c0e−βn1-c_{0}e^{-\beta n} for some c0,β>0c_{0},\beta>0. Thus scale independent stable phaseless reconstruction is possible whenever the redundancy is greater than 2+δ2+\delta, δ>0\delta>0, at least for random Gaussian matrices.

Acknowledgement. The authors would like to thank Matt Fickus, Dustin Mixon and Jeffrey Schenker for very helpful discussions.

References