Professional Documents
Culture Documents
Abstract
Recently the theory of widths of Kolmogorov (especially of Gelfand
widths) has received a great deal of interest due to its close relation-
ship with the newly born area of Compressed Sensing. It has been
realized that widths re‡ect properly the sparsity of the data in Signal
Processing. However fundamental problems of the theory of widths
in multidimensional Theory of Functions remain untouched, and their
progress will have a major impact over analogous problems in the the-
ory of multidimensional Signal Analysis. The present paper has three
major contributions:
1. We solve the longstanding problem of …nding multidimensional
generalization of the Chebyshev systems: we introduce Multidimen-
sional Chebyshev spaces, based on solutions of higher order elliptic
equation, as a generalization of the one-dimensional Chebyshev sys-
tems, more precisely of the ECT–systems.
2. Based on that we introduce a new hierarchy of in…nite-dimensional
spaces for functions de…ned in multidimensional domains; we de…ne
corresponding generalization of Kolmogorov’s widths.
3. We generalize the original results of Kolmogorov by computing
the widths for special "ellipsoidal" sets of functions de…ned in multi-
dimensional domains.
MSC2010: 35J, 46L, 41A, 42B.
1
Keywords: Kolmogorov widths, Gelfand widths, Compressed Sens-
ing, Chebyshev systems, Approximation by solutions of PDEs.
1 Introduction
It is a notorious fact that the polynomials of several variables fail to enjoy
the nice interpolation and approximation properties of the one-dimensional
polynomials, and this is particularly visible in such fundamental areas of
Mathematical Analysis as the Moment problem, Interpolation, Approxima-
tion, etc. One alternative approach is to use solutions of elliptic equations, in
particular polyharmonic functions, which has led to new amazing Ansatzes in
multidimensional Approximation and Interpolation [17], [15], [13], [24], [18],
in Spline and Wavelet Theory [32], [22], and recently in the Moment Problem
[26]. This approach has been given the name Polyharmonic Paradigm [22], as
an approach to Multidimensional Mathematical Analysis, which is opposite
to the usual concept which is based on algebraic and trigonometric poly-
nomials of several variables. However the e¤ectiveness of the Polyharmonic
Paradigm has remained unexplained for a long time.
One of the main objectives of the present research is to …nd a new point of
view on the longstanding problem of …nding multidimensional generalization
of Chebyshev systems: In Section 2 we show that the solution spaces of a wide
class of elliptic PDEs (de…ned further as Multidimensional Chebyshev spaces)
are a natural generalization of the one-variable polynomials as well as of the
one-dimensional Chebyshev systems.1 In particular, this shows that the poly-
harmonic functions which are solutions to the polyharmonic operators are a
generalization of the one-variable polynomials. Let us recall that there has
been a long search for proper multidimensional generalization of Chebyshev
systems. The standard generalization by means of zero set property fails to
produce a non-trivial multidimensional system which is the content of the
theorem of Mairhuber, see the thorough discussion in [29] (chapter 2; section
1:1). Our generalization provided by the Multidimensional Chebyshev spaces
comes from a completely di¤erent perspective, by generalizing the boundary
value properties of the one-dimensional polynomials.2
1
Recall that the one-dimensional Chebyshev systems appeared as a generalization of
the one-variable algebraic polynomials in the works of A. Markov in the context of the
classical Moment problem. They were further developed and applied to the generalized
Moment problem and Approximation theory by A. Haar (the Haar spaces), S. Bernstein,
M. Krein, S. Karlin, and others, cf. [29], [20], [34].
2
In general, zero set properties and intersections are not a reliable reference point
for multidimensional Analysis. In particular, let us recall that polyharmonic (and even
harmonic) functions do not have simple zero sets, although they are solutions to nice BVPs
2
On the other hand the cornerstone of the present paper is an amaz-
ing though simple characterization of the N dimensional subspaces XN of
C N 1 (I) (here I is an interval in R) via Chebyshev systems. This charac-
terization says that the typical subspace XN is a …nite-piecewise Chebyshev
space, or to be more correct, …nite-piecewise ECT-system. This discovery
causes an immediate chain reaction: by analogy, for a domain D Rn ;
we use the newly-invented Multidimensional Chebyshev spaces to de…ne in
L2 (D) a multidimensional generalization XN of the spaces XN ; which we call
"spaces of Harmonic Dimension N ". These spaces XN represent a new hier-
archy of in…nite-dimensional spaces. Hence, the big surprise of the present
research is the reconsideration of the simplistic understanding that the nat-
ural generalization of XN is provided just by the …nite-dimensional subspaces
of L2 (D) : We realize that the …nite-dimensional subspaces in C N (D) ; for do-
mains D Rn for n 2; do not serve the same job as the …nite-dimensional
subspaces in C N (D) for intervals D R1 ; and one has to replace them by
a lot more sophisticated objects, namely by the spaces having Harmonic
Dimension N:
Respectively, the focus of the present research is, by means of the spaces
XN to de…ne a multidimensional generalization of the Kolmogorov-Gelfand
N widths, which we call "Harmonic N widths". After that we compute the
Harmonic N widths for "cylindrical ellipsoids" in L2 (D) ; by generalizing
the original results of Kolmogorov.
Another important motivation for the present research is the recent in-
terest to the theory of widths (especially to Gelfand widths) coming from
the applications in an area of Signal Analysis, called Compressed Sensing
(CS). In a certain sense the central idea of CS is rooted in the theory of
widths, cf. e.g. [10], [8], [9], [37]. However, apparently this strategy works
smoothly only in the case of representation of one-dimensional signals, while
an adequate approach to multivariate signals is missing –one reason may be
found by analogy in the fact that the theory of Kolmogorov-Gelfand widths
…ts properly only for one-dimensional function spaces (as pointed out below,
e.g. in formula (27)). Recently, a new multivariate Wavelet Analysis was
developed based on solutions of elliptic partial di¤erential equations ([22]),
in particular "polyharmonic subdivision wavelets" were introduced (cf. [11],
[27]). In order to apply CS ideas to these wavelets it would require essential
generalization of the theory of widths for in…nite-dimensional spaces, and it
is expected that the present research is a step in the right direction.
In his seminal paper [21] Kolmogorov has introduced the theory of widths
and has applied it ingeniously to the following set of functions de…ned in the
as (38)-(39), cf. [18].
3
compact interval:
Z 1
p 1 2
Kp := f 2 AC ([a; b]) : f (p) (t) dt 1 : (1)
0
X
n
p
where is the p th iterate of the Laplace operator = @ 2 =@x2j ; we
j=1
consider more general sets Kp given in (26) below.
Let us summarize the major contributions of the present paper:
4
here P2N is an elliptic operator of order 2N in the domain D: Respectively,
the simplest version of our generalization of Kolmogorov’s theorem about
widths …nds the extremizer of the following problem
inf dist XN ; Kp ;
XN
Z t Z t2 Z tN 1
vN (t) = 1 (t) 2 (t2 ) 3 (t3 ) N (tN ) dt2 dt3 dtN : (6)
c c c
5
Let us recall some classical results about the space XN = span fvj gNj=1 :
For every k = 1; 2; :::; N the consecutive Wronskians for the system of func-
tions fvj gN
j=1 may be computed explicitly and are given by
k k 1
Wk := W (v1 ; v2 ; :::; vk ) = 1 2 k; (7)
(cf. [38], or [20], chapter 11; formulas 1:12 and 1:13). From representation
formula (7) directly follows that for all k = 1; 2; :::; N the Wronskians satisfy
d d 1 d 1 d 1
LN t; = ; (11)
dt dt N (t) dt 2 (t) dt 1 (t)
Then, from formulas (4)–(6) directly follows that all vj ’s, hence all elements
of the space span fvj gN
j=1 ; satisfy the ODE
XN = span fvj gN
j=1 (13)
is an N dimensional subspace of C N 1
(J) :
6
Our terminology above di¤ers slightly from the accepted terminology: we
consider Chebyshev systems on open intervals J and instead of "ECT-system"
we say "ECT-space".
The following result characterizes the typical ("general position") N dimensional
subspaces of C N 1 [a; b] by means of the ECT-spaces.
The proof and an example are provided in the Appendix in Section 10.1
below.
Hence, from Theorem 3 and formula (12) we see that a typical N dimen-
sional subspace of C N 1 [a; b] is a piecewise ECT-space, i.e. piecewise solu-
tion space of a family of ordinary di¤erential operators LN (with coe¢ cients
depending on the intervals (tj ; tj+1 ) ). In our multidimensional generaliza-
tion we will generalize these typical N dimensional subspaces of C N 1 [a; b] :
Indeed, Theorem 3 already suggests an Ansatz for Multidimensional
Chebyshev spaces which generalize the one-dimensional ECT–spaces:
First, we generalize the one-dimensional operators LN in (11) by considering
in a domain D Rn elliptic partial di¤erential operators of the form
where Q(j) are elliptic operators of second order in D: Then the corresponding
solution space XN de…ned by
7
interpolation properties of the one-dimensional ECT–spaces XN ; and this
would require more conditions to be imposed on the operators Q(j) : Com-
plete analogy between the one-dimensional and the multidimensional case is
achieved only for the one-dimensional ECT–spaces of even dimension which
satisfy the following interpolation property ([20], chapter 11):
8
After having de…ned the Multidimensional Chebyshev spaces, the next
step will be to introduce the promised multidimensional generalization of
the "typical" N dimensional subspaces of C N 1 (I) : We will de…ne them
in De…nition 14 below as subspaces XN of functions in L2 (D) which are
piecewise solutions of (regular) elliptic di¤erential operators P2N of order
2N: We will say that XN has "Harmonic Dimension N " and we will write
hdim (XN ) = N
see De…nition 22 below. The main result of the present paper is the com-
putation of
hdN Kp for N p;
where Kp is de…ned in (2) and more generally in (26).
inf dist XN ; Kp ;
XN
9
A special case of the present results is available in [28], and might be
instructive for the reader to start with.
A …nal remark to our generalization is in order. In our consideration we
will not strive to achieve a maximal generality. As it is clear, especially in the
applications to the theory of widths even in the one-dimensional case we may
consider not all N dimensional subspaces but "almost all" N dimensional
subspaces of C 1 (D) in some sense, or a class of N dimensional subspaces
which are dense (in a proper topology) in the set of all other N dimensional
subspaces. This "genericity" point of view is essential in our multivariate
generalization since it will allow us to avoid burdensome proofs necessary in
the case of the bigger generality of the construction. For the same reason
we will not consider elliptic pseudo-di¤erential operators although almost all
results have a generalization for such setting.
10
Proposition 6 Let f 2 L2 ([a; b]) have the L2 expansion
X
1
f (t) = fj j (t) :
j=1
X
N
1 1
f fj j (t) p =O : (21)
j=1 N +1 (N + 1)p
L2
However, Kolmogorov didn’t stop at this point but asked further, whether
eN := f j gN provides the "best possible approximation
the linear space X j=1
among the linear spaces of dimension N " in the following sense: If we put
eN ; Kp :
dN (Kp ) = dist X (23)
11
Thus the main approach to the successful application of the theory of
widths is based on a Jackson type theorem by which a special space X eN
is identi…ed. Then one has to …nd, among which subspaces XN is XN the e
extremal subspace. Put in a di¤erent perspective : one has to …nd as wide
class of spaces XN as possible, among which X eN is the extremal subspace.
Now let us consider the following set which is a natural multivariate gen-
eralization of the above set Kp de…ned in (1): For a bounded domain B in
Rn we put (more generally than (2))
Z
2p
Kp := u 2 H (B) : jL2p u (x)j2 dx 1 ; (26)
B
where L2p is a strongly elliptic operator in B: Let us remark that the Sobolev
space H 2p (B) is the multivariate version of the space of absolutely continuous
functions on the interval with a highest derivative in L2 (as in (1)). An
important feature of the set Kp is that it contains an in…nite-dimensional
subspace
u 2 H 2p (B) : L2p u (x) = 0; for x 2 B :
Hence, all Kolmogorov widths are equal to in…nity, i.e.
dN Kp = 1 for N 0 (27)
and no way is seen to improve this if one remains within the …nite-dimensio-
nal setting.
The main purpose of the present paper is to …nd a proper setting in the
framework of the Polyharmonic Paradigm which generalizes the above results
of Kolmogorov.
fA; Bj ; j = 1; 2; :::; mg
12
1. The operator
X
A (x; Dx ) = ( 1)j j D a (x) D
j j;j j m
13
Obviously,
ord (Bj ) = j 1; ord (Sj ) = p + j 1:
Let us denote by L2p the operator formally adjoint to the elliptic operator
L2p . There exist boundary operators Cj ; Tj ; for j = 1; 2; :::; p 1; such that
ord (Tj ) = 2p j; ord (Cj ) = p j
and the following Green’s formula holds:
Z Xp 1Z
L2p u v u L2p v dx = (Sj u Cj v Bj u Tj v) d y ; (28)
B j=0 @B
here @n denotes the normal derivative to @B; for functions u and v in the
classes of Sobolev, u; v 2 H 2p (B) (cf. [30], Theorem 2:1 in section 2:2;
chapter 2, and Remark 2:2 in section 2:3).
For us the following eigenvalue problem will be important to consider for
U 2 H 2p (B) ; which is analogous to problem (19)-(20):
L2p L2p U (x) = U (x) for x 2 B (29)
Bj L2p U (y) = Sj L2p U (y) = 0; for y 2 @B; j = 0; 1; :::; p 1 (30)
where @n denotes the normal derivative at y 2 @B: It is obvious that the
operator L2p L2p is formally self-adjoint, however the BVP (29)-(30) is not a
nice one. Since a direct reference seems not to be available, we provide its
consideration in the following theorem which is an analog to Proposition 5.
Theorem 10 Let the operator L2p be uniformly strongly elliptic in the do-
main B: Then problem (29)-(30) has only real non-negative eigenvalues.
1. The eigenvalue = 0 has in…nite multiplicity with corresponding eigen-
0 1
functions j j=1 which represent an orthonormal basis of the space of all
solutions to the equation L2p U (x) = 0; for x 2 B:
2. The positive eigenvalues are countably many and each has …nite mul-
tiplicity, and if we denote them by j ordered increasingly, they satisfy
j ! 1 for j ! 1:
3. The orthonormalized eigenfunctions, corresponding to eigenvalues j >
1 1 S 0 1
0; will be denoted by f j gj=1 : The set of functions f j gj=1 j j=1 form
a complete orthonormal system in L2 (B) :
Remark 11 Problem (29)-(30) is well known to be a non-regular elliptic
BVP, as well as non-coercive variational, cf. [1] ( p. 150 ) and [30] (Remark
9:8 in chapter 2; section 9:6, and section 9:8 ).
The proof is provided in the Appendix below, section 11.1.
14
6 The principal axes of the ellipsoid Kp and
a Jackson type theorem
Here we will …nd the principal exes of the ellipsoid Kp de…ned as
Z
Kp := 2p
u 2 H (B) : jL2p u (x)j2 dx 1 ; (31)
B
X
1 X
1
f (x) = fj0 0
j (x) + fj j (x) ;
j=1 j=1
X
1
2
j fj 1: (32)
j=1
1 S X
1
2
X
1
Vice versa, every sequence fj0 j=1 ffj g1
j=1 with fj0 + jfj j2 < 1
j=1 j=1
X
1
2
and j fj 1 de…nes a function f 2 L2 (B) which is in Kp :
j=1
15
(2) From the proof of Theorem 10, we know that if we put
X
1
2p
Indeed, for every f 2 H (B) we have the expansion f (x) = fj0 0
j (x) +
j=1
X
1
fj j (x) : We want to see that it is possible to di¤erentiate termwise this
j=1
expansion, i.e.
X
1 X
1
L2p f (x) = fj L2p j (x) = fj j (x)
j=1 j=1
Hence
X
1 X
1 X
1
p j (x)
L2p f (x) = fj L2p j (x) = fj j (x) = j fj p
j=1 j=1 j=1 j
16
and since pj is an orthonormal system, it follows
j
j 1
X
1
kL2p f k2L2 = 2
j fj :
j=1
X
1
2
Thus if f 2 Kp it follows that j fj 1:
j=1
X
1 X
1
2
Now, assume vice versa, that fj2 j 1 holds together with fj0 +
j=1 j=1
X
1
jfj j2 < 1. We have to see that the function
j=1
X
1 X
1
f (x) = fj0 0
j (x) + fj j (x)
j=1 j=1
X
1
p (x) Xj
1
g (x) = j fj p = fj j (x) ;
j=1 j j=1
= g j dx
B
17
Theorem 13 Let N 1: Then for every N 1 and every f 2 Kp holds the
following estimate:
X
1 X
N
1
f fj0 0
j (x) fj j (x) p :
j=1 j=1 N +1
L2
18
satisfy the maximum principle in the domain D; and the functions j de…ned
in D are in…nitely smooth and satisfy
[
M [
Z := fx 2 D : k (x) = 0g @Dj n @D:
k=1 j
19
from the interface conditions (36) it follows that "analytic continuation" is
possible, hence every function in XM is a solution to P2M u = 0 in the whole
domain D (see similar result in [22], Lemma 20:10; and the proof of Theorem
20:11).
3. One may choose a di¤erent set of interface conditions which are equiv-
alent to (36), see [22] (Remark 20:12), and [30] (Lemma 2:1 in chapter 2).
4. The spaces XM de…ned in De…nition 14 mimic in a natural way the
one-dimensional case: the operator P2M (35) is similar to the operator (11)
in Proposition 3.
Q
5. The operator j j P2M does not have a singularity in the principal
symbol but possibly only in the lower order coe¢ cients.
u = (1 jxj) w in D;
where w = 0 in D:
The following result shows that we may construct a lot of solutions be-
longing to the set XM of De…nition 14. We call these "direct solutions".
20
is solvable for arbitrary data fhk gM
k=1 from the corresponding Sobolev spaces,
i.e. hk 2 H 2M ord(Bk ) 1=2 (@D) ; and the solution has the maximal regularity,
i.e. u 2 H 2M (D) :
Qj w = f on D (40)
w=h on @D: (41)
u= 1 I1 ( M 1 IM 1 ( M IM (0; hM ) ; hM 1) ); (42)
Q2 w = 0 on D
B2 w = h2 on @D;
and
1
Q1 u = 2w on D
1
1
B1 u = h1 on @D:
1
Hence, we obtain
1 1
B2 Q1 u = h2 :
2 1
1 1 1
B1 u = u; B2 u = Q1 u
1 2 1
21
Remark 18 1. Formula (42) for representing the solution of P2M u (x) = 0
in Proposition 17 coincides with the solution in formulas (4)-(6) in the one-
dimensional case.
2. One may prove that the set of "direct solutions" obtained in Proposition
17 is dense in the whole space XM de…ned in De…nition 14, but we will not
need this fact.
hdim (XM ) = M:
Assume that the elliptic operator P2M which corresponds to the space XM has
factorization operators Qj (from (35)) satisfying condition (U )s for unique-
ness in the Cauchy
T S problem in the small.3 Let G be a compact subdomain in
some Dj ; i.e. G ( @Dj ) = ?: Then the set of "direct solutions" considered
in Proposition 17 is dense in L2 (G) in the space
u 2 H 2M (G) : P2M u = 0 in G :
Proof. For simplicity of notations we assume that for the elliptic operator
P2M associated with XM ; by De…nition 14, we have only two factorizing
operators Q1 and Q2 ; i.e. P2M u = Q2 12 Q1 11 u :
Let us take a solution u 2 H 2M (G) to P2M u = 0 in G: We use the solution
of formula (42)
u = 1 I1 ( 2 I2 (0; h2 ) ; h1 ) ;
where the boundary data h1 and h2 are arbitrary in proper Sobolev spaces.
By the approximation theorem of Runge-Lax-Malgrange type (cf. [6], Theo-
rem 4; and references there), which uses essentially property (U )s of operator
3
The di¤erential operator P satis…es condition (U )s for uniqueness in the Cauchy prob-
lem in the small in G provided that if G1 is a connected open subset of G and u 2 C r (G1 )
is a solution to P u = 0 and u is zero on a non-emplty subset of G1 then u is identically
zero. Elliptic operators with analytic coe¢ cients satisfy this property (cf. [4], part II;
chapter 1:4; [6], p. 402).
22
Q2 ; we obtain a function w" which is a solution to Q2 w" = 0 in D and such
that
kI2 (0; h2 ) w" kL2 (G) < ":
Next we apply the same approximation argument but with non-zero right-
hand side 2 I2 (0; h2 ) (cf. [7]) to prove the existence of a function v" such
that
kI1 ( 2 I2 (0; h2 ) ; h1 ) v" k < C"
for some constant C > 0; where the constant C depends on the functions j:
Thus we obtain the function
u" = 1 v "
which satis…es
ku" ukL2 (G) < C1 ";
and is a "direct solution" in the sense of Proposition 17.
Theorem 20 Let M < N and the First Kind spaces XM ; XN satisfy De…-
nition 14 with
hdim (XM ) = M; hdim (XN ) = N:
0
Assume that the elliptic operator P2N ; which is associated with the space
XN ; has (by (35)) factorization operators Qj satisfying condition (U )s for
uniqueness in the Cauchy problem in the small (as in Theorem 19). Then
the space Y = XN n XM is in…nite-dimensional.
S
Proof. (1) Let, by De…nition 14, theS partition Dj and the operator P2M
correspond to XM ; whileTthe partition Dj0 and the operator P2N 0
correspond
0
to XN : Assume that D1 D1 6=T?: Then we will choose a subdomain G which
is compactly supported in D1 D10 :
Further we will …x our attention to the subdomain G where both operators
0
P2M and P2N are uniformly strongly elliptic and will construct a subset of
XN XM restricted to the domain G: Let us be more precise: If we denote
by
XNG := u : H 2N (G) : P2N 0
u = 0 in G (43)
then we will construct an in…nite-dimensional subspace of XNG • XM G
:
(2) For the uniformly strongly elliptic operator P2M on the domain G
@j 1
we choose the Dirichlet system of boundary operators Bj = @n j 1 ; for j
23
@
1; which are iterates of the normal derivative n @n onj the boundary @G: As o
@
already mentioned the system of operators P2M ; @n j : j = 0; 1; :::; M 1
on G forms a regular Elliptic BVP (this is the Dirichlet Elliptic BVP for the
operator P2M ) (cf. [30], Remark 1:3 in section 1:4, chapter 2).
We complete the system fBj gM j=1 by the system of boundary operators
@ M 1+j
S
Sj = @nM 1+j for j = 1; 2; :::M: Hence, the system composed fBj gM j=1 fSj gM
j=1
is a Dirichlet system of order 2M (cf. [30], De…nition 2:1 and Theorem 2:1 in
section 2:2; chapter 2). Further, by [30] (Theorem 2:1), there exists a unique
Dirichlet system of order 2M of boundary operators fCj ; Tj gM j=1 which is
M
uniquely determined as the adjoint to the system fBj ; Sj gj=1 ; and the Green
formula (28) holds on the domain G: We will use this below.
0
(3) In the domain G we consider the elliptic operator P2N P2M : As a
product of two strongly elliptic operators it is such again. By a standard
construction cited above (cf. [30], Theorem 2:1; section 2:2; chapter 2), we
may complete the Dirichlet system of operators fBj ; Sj gM j=1 with N M
@ 2M 1+j
boundary operators Rj = @n 2M 1+j ; j = 1; 2; :::; N M: Again by the above
cited theorem, the Dirichlet system of boundary operators
S
fBj ; Sj gM
j=1 fRj gN j=1
M
0
covers the operator P2N P2M : Finally, we consider the solutions g 2 H 2N +2M (G)
to the following Elliptic BVP:
0
P2N P2M g (x) = 0 for x 2 G (44)
Bj g (y) = Sj g (y) = 0 for j = 0; 1; :::; N 1; for y 2 @G (45)
Rj g (y) = hj (y) for j = 1; 2; :::; N M; for y 2 @G: (46)
We may apply a classical result [30] (the existence Theorem 5:2 and The-
orem 5:3 in chapter 2), to the solvability of problem (44)-(46) in the space
H 2M +2N (G) :
(4) Let us check the properties of the function P2M g where g satis…es
(44)-(46). First of all, it is clear from (44) that P2M g 2 XNG where we have
used the notation (43).
By Green’s formula (28), applied for the operator P2M and for u = g we
obtain Z
P2M g vdx = 0 for all v with P2M v = 0
G
G G
which implies that the function P2M g satis…es P2M g ? XM (XM de…ned as
(43)).
24
By the general existence theorem for Elliptic BVP used already above (cf.
[30], Theorem 5:3, the Fredholmness property), we know that a solution g
to problem (44)-(46) exists for those boundary data fhj gN j=1
M
which satisfy
only a …nite number of linear conditions (cf. [30], conditions (5.18)); these
are determined by the solutions to the homogeneous adjoint Elliptic BVP.
Hence, it follows that the space YNG M of the functions P2M g where g is a
solution to (44)-(46) is in…nite-dimensional.
(5) Let us construct a subspace of XN nXM which is in…nite-dimensional.
We use the obvious inclusion XN jG XNG ; XM jG XMG
; where for a space
of functions Y L2 (B) the space YjG consists of the restrictions of the
elements of Y to the domain G:
First of all, we …nd an orthonormal basis fvj gj 1 in the in…nite-dimensio-
nal space YNG M (where the norm is k kL2 (G) ); by the Gram-Schmidt ortho-
normalization we obtain functions gj such that vj = P2M gj for j 1:
Let us put "j = 2j1 1 and use the density Theorem 19 to choose uj 2
2N
H (D) with
kuj vj kL2 (G) "j for j 1:
G G
The orthogonality of vj to XM infers dist ujjG ; XM 1 "j in the L2 (G)
norm. Hence, dist (uj ; XM ) 1 "j in the L2 (D) norm, hence uj 2 = XM :
Let us see that for every choice of the constants j holds
X1
N
j uj 6= uN :
j=1
Indeed, by the triangle inequality for the norm k kL2 (G) it follows
X1
N
2
X1
N
1+ j j j = vN j vj
j=1 j=1
X1
N X1
N X1
N
= vN uN + uN j uj + j uj j vj
j=1 j=1 j=1
X1
N X1
N
"N + uN j uj + j j j "j
j=1 j=1
or
X1
N X1
N
1 "N + j j j2 j j j "j uN j uj :
j=1 j=1
25
Obviously
X1
N
"2j "j X1
N
1 "N + "j 1 "N + j j j2 j j j "j
j=1
4 2 j=1
and since the left-hand side always exceeds 1=4, this ends the proof that the
system of functions ujjG j 1 is linearly independent. Hence, the system
fuj gj 1 is linearly independent in the whole domain D:
As noted above uj 2 = XM ; hence span fuj gj 1 is the in…nite-dimensional
space we sought. The proof is …nished.
Y = XN XM :
The proof may be derived from the proof of Theorem 20 where we have
put G = D: Note that we do not need the (U )s condition for the operator
0
P2N : Hence, strictly speaking, Corollary 21 is not a special case of Theorem
20.
Now we provide a generalization of Kolmogorov’s notion of width from
formula (22); without restricting the generality we assume that we work only
with symmetric subsets.
hdim (XM ) = M
dim (FN ) = N:
26
8 Generalization of Kolmogorov’s result about
widths
Next we prove results which are analogs to the original Kolmogorov’s results
about widths in (23).
We denote by FN a …nite-dimensional subspace of L2 (B) of dimension
N: We denote the special subspaces for an elliptic operator P2p = L2p by
ep := u 2 H 2p (B) : L2p u (x) = 0;
X for x 2 B ; (47)
with a constant coe¢ cient operator L2p which is uniformly strongly elliptic
in the domain B: Let XM be a First Kind subspace of L2 (B) of Harmonic
Dimension M; according to De…nition 14, i.e.
hdim (XM ) = M;
Hence, L
inf dist XM FN ; Kp = 1
XM ;FN
or equivalently,
hdM;N Kp = 1:
2. If M = p then
L ep LFeN ; Kp ;
inf dist Xp FN ; Kp = dist X
Xp ;FN
i.e.
ep LFeN ; Kp :
hdp;N Kp = dist X
27
Remark 24 In both cases we see that the special spaces eM LFeN are ex-
X
L
tremizers among the large class of spaces XM FN :
which implies L
dist XM FN ; Kp = 1:
If they are not transversal we remind that operators with analytic coe¢ cients
satisfy the (U )s condition, and we may apply Lemma 25.
ep L
2. For proving the second item, let us …rst note that X Xp FN :
ep ep L
Indeed, since X Kp the violation of X Xp FNL would imply that
there exists an in…nite axis f in Kp not contained in Xp FN which would
immediately give L
dist Xp FN ; Kp = 1:
S
Using the notations of De…nition 14, there exists a …nite cover Dj = B; and
by Lemma 28 (applied for M = N = p ) it follows that on every subdomain
j
Dj holds P2p = Cj (x) L2p for some function Cj (x) : Thus we see that every
u 2 Xp is a piecewise solution of L2p u = 0 on B; satisfying the interface
conditions (36) in De…nition 14. Here we use an uniqueness theorem for
"analytic continuation" across the boundary argument (proved directly by
Green’s formula (28) as in [22], Lemma 20:10 and the proof of Theorem 20:11;
p. 422) that u 2 X ep ; hence Xp = Xep :
Further we follow the usual way as in [31] to see that FeN is extremal
among all …nite-dimensional spaces FN ; i.e.
ep LFN ; Kp = dist X
inf dist X ep LFeN ; Kp :
FN
We prove the following fundamental result which shows the mutual posi-
tion of two subspaces:
28
The proof follows directly from Theorem 20 since a …nite-dimensional
subspace FM1 would not disturb the arguments there.
We obtain immediately the following result.
Lemma 28 Let for the strongly elliptic di¤erential operators L2N = P2N (x; Dx )
and P2M = P2M (x; Dx ) of orders respectively 2N 2M in the domain B;
the following inclusion hold
T
XN H 2M (B) XM n F;
or
Proof. It is clear that the arguments for proving equality (49) are purely
local, and it su¢ ces to consider only x0 = 0; or we assume that the operator
L2N has constant coe¢ cients.
First, we assume that the polynomial L2N ( ) is irreducible. Then we
consider the roots of the equation
29
and by a well-known result on division of polynomials in algebra [41] (The-
orem 9:7; p. 26), the statement of the theorem follows.
Now let us assume that L2N is reducible and decomposed in two irre-
ducible factors L2N = Q2 Q1 ; which may be equal. Obviously, both poly-
nomials Q1 and Q2 are uniformly strongly elliptic. Since the solutions to
Q1 u = 0 are also solutions to L2N it follows by the above that
0
P2M (x; Dx ) = P2M 2N1 (x; Dx ) Q1 (Dx )
where 2N1 is the order of the operator Q1 : Further, following the standard
arguments in [30], by the uniform strong ellipticity of the operator Q1 ; for
every 2 Cn ; and for arbitrary s 2N1 ; there exists a solution u 2 H s (B)
to equation
Q1 u (x) = eh ;xi for x 2 B:
Let 2 Cn be a solution to equation Q2 ( ) = 0: Obviously,
L2N u = 0
hence, by the above it follows
0 0
P2M (x; Dx ) u = P2M 2N1 (x; Dx ) Q1 (Dx ) u = P2M 2N1 (x; ) = 0:
0
It follows that P2M 2N1 (x0 ; ) = 0: We proceed inductively if L2N has more
than two irreducible factors.
30
then it is natural to expect that the space
Y := fu 2 XN : u = 0 on @Bg
has Harmonic Dimension N 1: A simple example is the space
Y = u 2 H 4 (B) : 2
u = 0 in B; u = 0 on @B :
On the other hand, it is Theorem 20 and Corollary 21 above which show
that such Second Kind spaces of Harmonic Dimension N appear in a natural
way when we consider the space XN •XM based on solutions of Elliptic BVP
(44)-(46).
We give the following de…nition.
31
Lemma 31 Let Xp be a Second Kind space of Harmonic Dimension p and
L 0 be an arbitrary integer. Let FL be an L dimensional subset of L2 (B) :
Then L
dist Xp FL ; Kp < 1
implies
ep
X Xp : (51)
Let the elliptic operator P2M and the boundary operators fBj gM p
be associ-
j=1
ated with Xp by De…nition 29. Then (51) implies the following factorizations:
0
P2M = P2M 2p L2p
0
Bj = Bj L2p for j = 1; 2; :::; M p:
0
The operator P2M 2p is uniformly strongly elliptic in D; and the boundary
M p
operators Bj0 j=1 0
form a normal system which covers the operator P2M 2p :
From the theory of Elliptic BVP is known that dim (N ) < 1 (cf. [30],
dim(N )
Theorem 5:3; chapter 2; section 5:3). Let us denote by fws gs=1 a basis of
the space N ; and by us a …xed solution to L2p us = ws : The main point in
the proof of Theorem 32 is that arbitrary solution u to equation P2M u = 0
may be expressed as
dim(N )
X
u= s us + v
s=1
where v is a solution to L2p v = 0:
32
10 Appendix
10.1 Proof of Theorem 3
Follows the proof of Theorem 3:
Proof. Let fvj gN N
j=1 be a basis of the space XN ; i.e. XN = span fvj gj=1 :
Then by a Theorem in [16] there exists a sequence of algebraic polynomials
N
Pjm j=1 ; m 1; such that in the norm of C N 1 (I) for j = 1; 2; :::; N holds
Wk (t) = W (P1m (t) ; P2m (t) ; :::; Pkm (t)) for k = 1; 2; :::; N;
they are polynomials, and since they cannot be identically zero it follows
that they have a …nite number of zeros. Hence, for …xed m 1 we may
subdivide the interval I into subintervals a t0 < t1 < < tpk = b;
and on every subinterval (tj ; tj+1 ) all Wronskians have a de…nite sign. By
[20] (chapter 11; Theorem 1:1) it follows that on every interval (tj ; tj+1 )
N N
the polynomials Pjm j=1 constitute an ECT-system. Hence Pjm j=1 is a
piecewise ECT-system. This ends the proof.
u1 (t) = (t) t2
u2 (t) = t2
and I = ( 1; 1) ; here (t) is the Heaviside function equal to 0 for t < 0 and
to 1 for t 0: Note that the Wronskian W (u1 (t) ; u2 (t)) 0 on I: How-
ever we may approximate the space X2 by the linear 2 dimensional spaces
33
X2" = span fu1 + "; u2 g C 1 (I) with " ! 0: The system fu1 + "; u2 g has
a Wronskian W (u1 (t) + "; u2 (t)) equal to 2t": For the last system the func-
tions "1 and "2 satisfying equations (4)-(6) are given by
"
1 (t) = u1 (t) + "
2t
" "
for t 0
2 (t) = 2t"
for t 0 :
(t2 +")2
11 Appendix
11.1 Proof of Theorem 10
Proof. (1) We consider the following auxiliary elliptic eigenvalue problem
L2p L2p (x) = (x) on B; (53)
Bj (y) = Sj (y) = 0 for j = 0; 1; :::; p 1; for y 2 @B: (54)
Since this is the Dirichlet problem for the operator L2p L2p it is a classical
fact that (53)-(54) is a regular Elliptic BVP considered in the Sobolev space
H 2p (B) ; as de…ned in De…nition 8. Also, it is a classical fact that the
Dirichlet problem is a self-adjoint problem (cf. [30], Remark 2:4 in section
2:4 and Remark 2:6 in section 2:5, chapter 2).
Hence, we may apply the main results about the Spectral theory of regular
self-adjoint Elliptic BVP. We refer to [12] (section 3 in chapter 2; p. 122;
Theorem 2:52) and to references therein.
By the uniqueness Lemma 33 the eigenvalue problem (53)-(54) has only
zero solution for = 0: It has eigenfunctions k 2 H 2p (B) with eigenvalues
k > 0 for k = 1; 2; 3; ::: for which k ! 1 as k ! 1:
(2) Next, in the Sobolev space H 2p (B) ; we consider the problem:
L2p L2p ' (x) = k (x) on B (55)
Bj ' (y) = Sj ' (y) = 0 for j = 0; 1; :::; p 1; for y 2 @B: (56)
Obviously, the Elliptic BVP de…ned by problem (55)-(56) coincides with
the Elliptic BVP de…ned by (53)-(54) up to the right-hand sides, and all
remarks there hold as well. Hence, problem (55)-(56) has unique solution
'k 2 H 2p (B) : We put
k = L2p 'k :
34
We will prove that k are solutions to problem (29)-(30), they are mutu-
ally orthogonal, and they are also orthogonal to the space fv 2 H 2p : L2p v = 0g :
(3) Let us see that
L2p L2p k = k k :
By the de…nition of k this is equivalent to
On the other hand, by the basic properties of k and 'k ; we have obviously
L2p L2p k = k L2p L2p 'k ; hence
Note that both k and 'k satisfy the same zero Dirichlet boundary conditions,
namely (54) and (56). Hence, by the uniqueness Lemma 33 it follows that
k k 'k = 0 which implies L2p L2p k = k k : Thus we see that k is a
solution to problem (29)-(30) and does not satisfy L2p = 0:
(4) The orthogonality to the subspace fv 2 H 2p : L2p v = 0g follows easily
from the Green formula (28) applied to the operator L2p L2p ;
Z
L2p L2p k v L2p k L2p v dx
D
2p 1Z
X
= (Sj L2p k Cj v Bj L2p k Tj v)
j=0 @D
1
The orthonormality of the system f k gk=1 follows now easily by the equal-
ity
Z Z Z Z
k k j dx = L2p L2p k j dx = L2p k L2p j dx = k j dx
1
and the orthogonality of the system f k gk=1 :
35
1
(5) For the completeness of the system f k gk=1 , let us assume that for
some f 2 L2 (B) holds
Z Z
f k dx = f k0 dx = 0 for all k 1: (58)
B B
hence L2p = 0:
Now for arbitrary v 2 H 2p (B) by the same Green’s formula we obtain
Z p Z
X
L2p v L2p v dx = (Sj Cj v Bj Tj v) d y = 0;
B j=1 @B
hence Z
L2p vdx = 0:
B
From the local existence theorem for elliptic operators (cf. [30]) it follows
that for arbitrary f 2 L2 (B) we may solve the elliptic equation L2p v = f
with v 2 H 2p (B) : From the density of H 2p (B) in L2 (B) we infer 0:
This ends the proof.
36
12 Some open problems
1. First of all, one has to study basic questions about
T the sets L
having
Harmonic
N Dimension, by considering the sets XM XN ; XM XN ;
XM XN ; and similar, and …nding their Harmonic Dimension.
2. One has to check that the maximal generality of the theory in the
present paper will be achieved by considering elliptic pseudo-di¤erential
operators.
4. One has to …nd a proper discrete version of the present research which
will be essential for the applications to Compressed Sensing, compare
the role of Gelfand’s widths in [10], [9].
37
[3]. In view of this circle of problems, one may try to apply the present
framework and to obtain a proper Ansatz for multidimensional Sturm
type theorems.
References
[1] Agmon, S., Lectures on Elliptic Boundary Value Problems. Princeton,
NJ: Van Nostrand, 1965; Reprinted in 2010 by AMS Chelsea publishing,
Providence, RI.
[4] Bers L., John F., Schechter M., Partial Di¤erential Equations, J. Wiley
and Sons, NY, 1964: Reprinted in AMS, Providence, RI, 2010:
[5] Bostan, A., Dumas, Ph., Wronskians and linear independence, The
American Mathematical Monthly, Vol. 117, No. 8 (October 2010), p.
722-727.
[8] Candes, E., J. Romberg, and T. Tao, Stable signal recovery from incom-
plete and inaccurate measurements, Comm. Pure and Appl. Math., 59
(2006), p. 1207-1223.
38
[12] Egorov, Yu.V., Shubin, M.A. , Linear Partial Di¤erential Equations.
Foundations of Classical Theory. In: Partial Di¤erential Equations I, En-
cycl. Math. Sci. 30, Berlin-Heidelberg-New York: Springer-Verlag 1992.
[15] Goldstein, M., Haussmann, W. and Rogge, L., On the mean value prop-
erty of harmonic functions and best harmonic L1 approximation, Trans.
Amer. Math. Soc. 305 (1988), p. 505-515.
[17] Hayman, W.K, D. Kershaw, and T. J. Lyons, The best harmonic approx-
imant to a continuous function, Anniversary Volume on Approximation
Theory and Functional Analysis, ISNM 65 (P. L. Butzer, R. L. Stens,
and B. Sz.-Nagy, eds.), Academic Press, San Diego, 1984, pp. 317-327.
[21] Kolmogoro¤, A., Ueber die beste Annaeherung von Funktionen einer
gegebenen Funktionenklasse, Annals of Mathematics, 37 (1936), p. 107
110; Russian translation in: Selected papers of A. N. Kolmogorov, vol.
1, Mathematics and Mechanics, S. M. Nikolskii ed., p. 186 189:
39
[23] Kounchev, O., Harmonicity Modulus and Applications to the Approxi-
mation by Polyharmonic Functions, In: Approximation by solutions of
partial di¤erential equations (Hanstholm, 1991), 111–125, NATO Adv.
Sci. Inst. Ser. C Math. Phys. Sci., 365, Kluwer Acad. Publ., Dordrecht,
1992; online at arxiv, http://arxiv.org/abs/1005.4970
[24] Kounchev, O., Sharp estimate for the Laplacian of a. polyharmonic func-
tion and applications, Trans. Amer. Math. Soc. 332 (1992), p. 121-133.
[29] Krein, M. and Nudelman, A., The Markov Moment Problem and Ex-
tremal Problems. Amer. Math. Soc., Providence, RI, 1977:
[33] Mazure, M.-L., Finding all systems of weight functions associated with
a given extended Chebyshev space, Journal of Approximation Theory.
163 (2011), p. 363–376.
[34] McCullough, S., The topological spaces that support Haar systems.
Proc. Amer. Math. Soc. 94 (1985), no. 4, p. 687–692.
40
[35] Najmark, M.A., Linear Di¤erential Operators, 2nd ed., Nauka, Moscow,
1969: English translation: Frederick Ungar Publ. Co., New York (1967,
Part I; 1968, Part II).
[39] Taylor, M., Partial di¤erential equations, Vol. I Basic Theory, Springer-
Verlag, New York, 1996:
[41] Walker, R. J., Algebraic Curves, Springer-Verlag, New York, 1950, print-
ing 1978:
41