Home | About | Journals | Submit | Contact Us | Français |

**|**Elsevier Sponsored Documents**|**PMC5341757

Formats

Article sections

- Abstract
- Highlights
- 1. Introduction
- 2. Preliminaries
- 3. The main result
- 4. Universal series and probability densities
- 5. Universal series and the heat equation
- 6. Universal series and Laplace’s equation
- References

Authors

Related links

J Approx Theory. 2011 December; 163(12): 1783–1797.

PMCID: PMC5341757

Vassili Nestoridis: rg.aou.htam@rotsenv; Sebastian Schmutzhard: ta.ca.eivinu@drahztumhcs.naitsabes; Vangelis Stefanopoulos: rg.naegea@nafetsv

Received 2010 September 11; Revised 2011 March 21; Accepted 2011 June 2.

Copyright © 2011 Elsevier Inc.

This document may be redistributed and reused, subject to certain conditions.

This document was posted here by permission of the publisher.
At the time of the deposit, it included all changes made during peer review,
copy editing, and publishing. The U. S. National Library of Medicine is responsible
for all links within the document and for incorporating any publisher-supplied
amendments or retractions issued subsequently. The published journal article,
guaranteed
to be such by Elsevier, is available for free, on ScienceDirect, at: http://dx.doi.org/10.1016/j.jat.2011.06.001

We prove the existence of series $\sum {a}_{n}{\psi}_{n}$, whose coefficients $\left({a}_{n}\right)$ are in ${\cap}_{p>1}{\ell}^{p}$ and whose terms $\left({\psi}_{n}\right)$ are translates by rational vectors in ${\mathbb{R}}^{d}$ of a family of approximations to the identity, having the property that the partial sums are dense in various spaces of functions such as Wiener’s algebra $W({C}_{0},{\ell}^{1})$, ${C}_{b}\left({\mathbb{R}}^{d}\right)$, ${C}_{0}\left({\mathbb{R}}^{d}\right)$, ${L}^{p}\left({\mathbb{R}}^{d}\right)$, for every $p\in [1,\infty )$, and the space of measurable functions. Applying this theory to particular situations, we establish approximations by such series to solutions of the heat and Laplace equations as well as to probability density functions.

► The existence of universal series for Wiener’s algebra is proved. ► The existence of universal series for further function spaces is proved. ► The theory of universal series is applied to the heat and Laplace equations.

Starting from any random variable and taking appropriate averages, we end up in the limit with a normal distribution. Conversely, starting from the normal distribution is it possible to reach, by some limiting process, any random variable? The answer is in the affirmative, because any probability density can be approximated in the ${L}^{1}$ norm by a convex combination of normal densities ${\sum}_{k=1}^{n}{a}_{k}\varphi (\cdot -{m}_{k},{b}_{k})$ ^{[1]}^{, }^{[8]}. It turns out that this approximation result can be put in the framework of universal series, strengthened significantly, and generalized. More precisely, in the present paper we prove the following results (see ^{Theorem 3.1}).

*Let*
${\left\{{\varphi}_{\u03f5}\right\}}_{\u03f5>0}$
*be an approximation to the identity on*
${\mathbb{R}}^{d}$, *and let*
${\left\{{\xi}_{n}\right\}}_{n=1}^{\infty}$
*be an enumeration of*
${\mathbb{Q}}^{d}$. *If*
${\left\{{\psi}_{n}\right\}}_{n=1}^{\infty}$
*is an enumeration of all*
${\varphi}_{1/k}(\cdot -{\xi}_{l}),k,l\in \mathbb{N}$, *then there exists a sequence*
${\left({a}_{n}\right)}_{n\ge 1}$
*in*
${\cap}_{p>1}{\ell}^{p}$
*such that the partial sums of the series*
${\sum}_{k=1}^{\infty}{a}_{k}{\psi}_{k}$
*are dense in*
$W({C}_{0},{\ell}^{1})$, *the so-called Wiener algebra*.

Moreover, thanks to the density properties of $W({C}_{0},{\ell}^{1})$ to several classical spaces, we also show the following (see ^{Theorem 3.2}).

*The partial sums of the series*
${\sum}_{k=1}^{\infty}{a}_{k}{\psi}_{k}$
*are also dense, with respect to their natural topologies, in*
${L}^{p}\left({\mathbb{R}}^{d}\right)$
*for every*
$p\in [1,\infty )$, *the space of continuous functions vanishing at infinity*
${C}_{0}\left({\mathbb{R}}^{d}\right),{C}_{0}\cap {L}^{1}\left({\mathbb{R}}^{d}\right)$, *the space of continuous and bounded functions*
${C}_{b}\left({\mathbb{R}}^{d}\right)$, *and the space of measurable functions*
${L}^{0}\left({\mathbb{R}}^{d}\right)$.

Similar results can be obtained if we replace ${\cap}_{p>1}{\ell}^{p}$ by ${\ell}^{q},1<q<\infty ,{c}_{0}$, or ${\mathbb{R}}^{\mathbb{N}}$ the space of all real sequences. We show, however, that the space ${\cap}_{p>1}{\ell}^{p}$ cannot be replaced by ${\ell}^{1}$. The proof is based on the fact that, if ${\left({\psi}_{\u03f5}\right)}_{\u03f5>0}$ is an approximation to the identity and $f$ is a function in $W({C}_{0},{\ell}^{1})$ on ${\mathbb{R}}^{d}$, then ${\psi}_{\u03f5}\ast f$ approximates $f$, as $\u03f5\to 0$ in various ways, and that each convolution ${\psi}_{\u03f5}\ast f$, being an integral, can be approximated by a Riemann sum. Thus some linear combinations of translates of ${\psi}_{\u03f5}$ approximate $f$. This fact, according to a recently developed *abstract theory of universal series* ^{[9]}^{, }^{[2]}, implies the generic existence of such series, and in particular implies the above-mentioned approximation results.

The same argument extends naturally to obtaining universal series for solutions to the heat or Laplace equations. Here, what we deal with is that every such solution fits together with initial or boundary data through a convolution with an appropriate approximation of the identity: the Gauss kernel for the parabolic case and the Poisson kernel for the elliptic one. The new element here is that we do not approximate the initial or boundary state but rather the solution itself. The series obtained are valuable in the context of partial differential equations (PDEs) since the derivatives of all orders of the approximating partial sums converge to the corresponding derivatives of the solution.

The above approximation results and in particular those related to probability and partial differential equations are new contributions to the theory of universal series and lead outside the initial range of applications of Baire’s category theorem, as described in the excellent surveys on universal series ^{[7]}^{, }^{[6]}.

This paper is organized as follows. Section 2 contains mainly background material on universal series and Wiener’s algebra $W({C}_{0},{\ell}^{1})$. In Section 3, we prove the main approximation results of the paper. In Section 4, we state the results of Section 3 in terms of probability densities. In Section 5, extending the approximation result of Section 3, we prove the existence of series whose partial sums converge uniformly on compact sets, along appropriate subsequences, to bounded solutions of the heat equation, in ${\mathbb{R}}^{d}$. We also show that the derivatives of all orders of the partial sums converge to the derivatives of the corresponding solution. Finally, in Section 6, we obtain analogous approximation results to the ones obtained in Section 5 for solutions of the Dirichlet problem for Laplace’s equation in the upper half space of ${\mathbb{R}}^{d+1}$ as well as in the unit ball of ${\mathbb{R}}^{d}$. In all series, the coefficients belong to${\cap}_{p>1}{\ell}^{p}$.

Let $X$ be a real vector space, and consider the metric space $(X,\rho )$, where $\rho $ is compatible with $+,\cdot $ and is invariant under translations. If ${\left({y}_{n}\right)}_{n\ge 1}$ is a fixed sequence of elements of $X$, by $\mathfrak{U}$ we denote the class of sequences ${\left({a}_{n}\right)}_{n\ge 1}$ in $\mathbb{R}$ for which the partial sums ${\sum}_{k=1}^{n}{a}_{k}{y}_{k},\phantom{\rule{0ex}{0ex}}n=1,2,\dots $ form a dense set in $X$. Observe that if ${\left({a}_{n}\right)}_{n\ge 1}\in \mathfrak{U}$ and $x\in X$ then there exists a sequence of natural numbers ${\left({\nu}_{n}\right)}_{n\ge 1}$, which can be taken to satisfy ${\nu}_{n}<{\nu}_{n+1}$ for all $n$, such that

$$\underset{n\to \infty}{lim}\rho (x,\sum _{k=1}^{{\nu}_{n}}{a}_{k}{y}_{k})=0\text{.}$$

Thus each ${\left({a}_{n}\right)}_{n\ge 1}\in \mathfrak{U}$, whenever $\mathfrak{U}\ne \varnothing $, generates an *unrestricted* universal series.

Of special interest is the case where the coefficients of the universal series are required to belong to a particular subspace of the space of all real sequences, ${\mathbb{R}}^{\mathbb{N}}$, where by $\mathbb{N}$ we denote the set of positive integers. These are the *restricted* universal series for which the following result is established in ^{[9]}^{, }^{[2]}.

Let $A$ be a vector subspace of the set of all sequences in $\mathbb{R}$ and let $\sigma $ be a metric on $A$ compatible with $+,\cdot $ that is invariant under translations. Setting ${\tilde{e}}_{1}=(1,0,0,\dots ),{\tilde{e}}_{2}=(0,1,0,\dots ),\dots $, we moreover assume that the following hold.

- (A1)$(A,\sigma )$ is complete.
- (A2)The projections $A\ni {\left({a}_{n}\right)}_{n\ge 1}\to {a}_{m}\in \mathbb{R}$ are continuous for all $m\in \mathbb{N}$.
- (A3)$A\supset G=\{{\left({a}_{n}\right)}_{n\ge 1}:{a}_{n}\ne 0\text{foronlyfinitelymany}n\text{\u2019s}\}$.
- (A4)If $\tilde{a}={\left({a}_{n}\right)}_{n\ge 1}\in A$ then $\sigma ({\sum}_{k=1}^{n}{a}_{k}{\tilde{e}}_{k},\tilde{a})\to 0$, as $n\to \infty $.

Then we have the following.

Theorem 2.1^{[9]}^{, }^{[2]} —

*Let*
$X,{\left({y}_{n}\right)}_{n\ge 1},\mathfrak{U}$
*and*
$A$
*be as above, and let*
$\tilde{o}$
*be the zero sequence of*
$A$
*. We set*
${\mathfrak{U}}_{A}\u2254\mathfrak{U}\cap A$
*. Then the following statements are equivalent.*

- 1.${\mathfrak{U}}_{A}\ne \varnothing $
*.* - 2.
*Given*$x\in X$*and*$\u03f5>0$*, there exist*$N\ge 1$*and*${b}_{1},{b}_{2},\dots ,{b}_{N}$*in*$\mathbb{R}$*such that*$$\rho (x,\sum _{k=1}^{N}{b}_{k}{y}_{k})<\u03f5\text{,}\phantom{\rule{2em}{0ex}}\sigma (\tilde{o},\sum _{k=1}^{N}{b}_{k}{\tilde{e}}_{k})<\u03f5\text{.}$$ - 3.${\mathfrak{U}}_{A}$
*is a dense*${G}_{\delta}$*set in*$A$*, and*${\mathfrak{U}}_{A}\cup \left\{\tilde{o}\right\}$*contains a dense vector subspace of*$A$*.*

In this paper, we deal with series whose coefficients are sequences belonging to the intersection of all ${\ell}^{p}$ spaces for $p>1$.

Definition 2.1

Let ${p}_{0}\in [1,\infty )$ be fixed and let ${p}_{n}\u2254{p}_{0}+1/n,n\in \mathbb{N}$. We define the metric space $(A,\sigma )$ by

$$A\u2254\underset{p>{p}_{0}}{\cap}{\ell}^{p}\text{,}\phantom{\rule{2em}{0ex}}\sigma (\tilde{a},\tilde{c})\u2254\sum _{n=1}^{\infty}\frac{1}{{2}^{n}}\frac{{\Vert \tilde{a}-\tilde{c}\Vert}_{{p}_{n}}}{1+{\Vert \tilde{a}-\tilde{c}\Vert}_{{p}_{n}}}\text{,}$$

(2.1)

with $\tilde{a},\tilde{c}\in A$ and ${\Vert \cdot \Vert}_{p}$ being the usual ${\ell}^{p}$ norm.

We note that the definition above makes sense since ${\ell}^{p}\subset {\ell}^{q}$, whenever $p<q$; hence ${\cap}_{p>{p}_{0}}{\ell}^{p}={\cap}_{n\ge 1}{\ell}^{{p}_{n}}$. The space $(A,\sigma )$ is a Fréchet space, and one can check with no difficulty that the postulates (A1)–(A4) are satisfied.

Lemma 2.1

*Let*
$(X,\rho )$
*be a real vector space with translation-invariant metric*
$\rho $
*compatible with*
$+,\cdot $*, and let*
${\left({y}_{n}\right)}_{n\ge 1}$
*be a fixed sequence in*
$X$
*. Let*
$\mathfrak{U}$
*be the set of scalar sequences defining universal series. Let*
${p}_{0}\ge 1$
*be fixed. The following statements are equivalent.*

- (1)$\mathfrak{U}\cap {\ell}^{p}\ne \varnothing $
*, for every*$p>{p}_{0}$*.* - (2)$\mathfrak{U}\cap \left({\cap}_{p>{p}_{0}}{\ell}^{p}\right)\ne \varnothing $
*.*

Proof

The direction $\left(2\right)\Rightarrow \left(1\right)$ is obvious. We prove $\left(1\right)\Rightarrow \left(2\right)$. Appealing to ^{Theorem 2.1}(2), it suffices to show that, given $x\in X$ and $\u03f5>0$, there exist scalars ${c}_{1},\dots ,{c}_{N}$ so that the following approximations are accomplished:

$$\rho (x,\sum _{k=1}^{N}{c}_{k}{y}_{k})<\u03f5\text{,}\phantom{\rule{2em}{0ex}}\sigma (\tilde{o},\sum _{k=1}^{N}{c}_{k}{\tilde{e}}_{k})<\u03f5\text{.}$$

Choose, first, $n\in \mathbb{N}$ so that ${\sum}_{k=n+1}^{\infty}{2}^{-k}<\u03f5/2$. Applying, next, (1) with $p={p}_{n}$, where, as before, ${p}_{n}={p}_{0}+1/n$, and since $\mathfrak{U}\cap {\ell}^{{p}_{n}}\ne \varnothing $, there exist ${c}_{1},\dots ,{c}_{N}$ so that

$$\rho (x,\sum _{k=1}^{N}{c}_{k}{y}_{k})<\frac{\u03f5}{2}\text{,}\phantom{\rule{2em}{0ex}}{\Vert \tilde{o}-\sum _{k=1}^{N}{c}_{k}{\tilde{e}}_{k}\Vert}_{{p}_{n}}<\frac{\u03f5}{2}\text{.}$$

Setting $\tilde{c}={\sum}_{k=1}^{N}{c}_{k}{\tilde{e}}_{k}$,and recalling that ${\Vert \cdot \Vert}_{p}\le {\Vert \cdot \Vert}_{{p}_{n}}$, whenever $p>{p}_{n}$, we compute, by the choice of $n$,

$$\sigma (\tilde{o},\tilde{c})<\sum _{k=1}^{n}\frac{1}{{2}^{k}}\frac{{\Vert \tilde{c}\Vert}_{{p}_{k}}}{1+{\Vert \tilde{c}\Vert}_{{p}_{k}}}+\frac{\u03f5}{2}\le (1-\frac{1}{{2}^{n}}){\Vert \tilde{c}\Vert}_{{p}_{n}}+\frac{\u03f5}{2}<\u03f5\text{.}$$

Thus $\mathfrak{U}\cap \left({\cap}_{p>{p}_{0}}{\ell}^{p}\right)\ne \varnothing $, and the proof is complete. □

As a kind of universal function space, we introduce the following.

Definition 2.2

The space of all $f\in {C}_{0}\left({\mathbb{R}}^{d}\right)$ for which ${\sum}_{n\in {\mathbb{Z}}^{d}}{sup}_{x\in {[0,1]}^{d}}\left|f(x+n)\right|<\infty $, endowed with the norm

$${\Vert f\Vert}_{W({C}_{0},{\ell}^{1})}\u2254\sum _{n\in {\mathbb{Z}}^{d}}\underset{x\in {[0,1]}^{d}}{sup}\left|f(x+n)\right|\text{,}$$

is a Banach space and is called Wiener’s algebra $W({C}_{0},{\ell}^{1})$.

In what follows, whenever we write $\Vert \cdot \Vert $ we will always mean the $W({C}_{0},{\ell}^{1})$ norm. Simplifying notation, we set ${Q}_{n}\u2254n+{[0,1]}^{d}$ for $n\in {\mathbb{Z}}^{d}$.

Remark 2.1

One immediately sees that $W({C}_{0},{\ell}^{1})\subset {L}^{\infty}\left({\mathbb{R}}^{d}\right)$ and that ${\Vert f\Vert}_{\infty}\le \Vert f\Vert $, whenever $f\in W({C}_{0},{\ell}^{1})$. Moreover, $W({C}_{0},{\ell}^{1})$ is continuously and densely embedded in ${L}^{p}$ for $1\le p\le \infty $ (see ^{[5, Chapter 6.1]}).

The proofs in this paper make use of several convenient properties of this space; in particular, the fact that it is densely and continuously embedded in several common function spaces, see for example ^{[3]} or ^{[10]}, plays an important role.

In the proof of the main outcome, we will need the following straightforward result.

Lemma 2.2

*Let*
$f\in W({C}_{0},{\ell}^{1})$
*. Then, for each*
$x\in {\mathbb{R}}^{d}$*, the translation*
${T}_{x}f\u2254f(\cdot -x)$
*is in*
$W({C}_{0},{\ell}^{1})$*, and*

$$\Vert {T}_{x}f\Vert \le {2}^{d}\Vert f\Vert \text{.}$$

(2.2)

*Moreover, for a fixed*
$f\in W({C}_{0},{\ell}^{1})$*, the map*

$${\mathbb{R}}^{d}\ni x\mapsto {T}_{x}f(\cdot )\in W({C}_{0},{\ell}^{1})$$

*is continuous.*

Proof

Since, for each $n\in {\mathbb{Z}}^{d}$, ${sup}_{t\in {Q}_{n}}\left|f(t-x)\right|={sup}_{t\in {Q}_{n}-x}\left|f\left(t\right)\right|$, assuming first that $x\in {\mathbb{Z}}^{d}$, we conclude that $\Vert {T}_{x}f\Vert =\Vert f\Vert $. Otherwise, each cube ${Q}_{n}-x$, of unit edge, is contained in a cube with integral vertices with double-size edge. From this observation, (2.2) follows.

Let $x\in {\mathbb{R}}^{d}$ and $\u03f5>0$ be given. Then

$$\Vert {T}_{x}f-{T}_{y}f\Vert =\sum _{n\in {\mathbb{Z}}^{d}}\underset{t\in {Q}_{n}}{sup}|f(t-x)-f(t-y)|=(\sum _{\left|n\right|>2{N}_{x}}+\sum _{\left|n\right|\le 2{N}_{x}})\underset{t\in {Q}_{n}}{sup}|f(t-x)-f(t-y)|\text{,}$$

where ${N}_{x}\in \mathbb{N}$ is arbitrary. The first sum may become arbitrarily small, less than $\u03f5/2$ say, for the right choice of ${N}_{x}$ as the tail of a convergent series. Indeed, let ${N}_{\u03f5}$ be such that ${\sum}_{\left|n\right|>{N}_{\u03f5}}{sup}_{t\in {Q}_{n}}\left|f\left(t\right)\right|<\u03f5/{2}^{2+d}$. Choose ${N}_{x}>{N}_{\u03f5}$ such that ${\cup}_{\left|n\right|>2{N}_{x}}{Q}_{n}-z\subset {\cup}_{\left|n\right|>{N}_{x}}{Q}_{n}$, for $z=x,y$, where $|x-y|<1$, say. Then

$$\sum _{\left|n\right|>2{N}_{x}}\underset{t\in {Q}_{n}}{sup}|f(t-x)-f(t-y)|\le \sum _{\left|n\right|>2{N}_{x}}\underset{t\in {Q}_{n}}{sup}\left|f(t-x)\right|+\sum _{\left|n\right|>2{N}_{x}}\underset{t\in {Q}_{n}}{sup}\left|f(t-y)\right|=\sum _{\left|n\right|>2{N}_{x}}\underset{t\in {Q}_{n}-x}{sup}\left|f\left(t\right)\right|+\sum _{\left|n\right|>2{N}_{x}}\underset{t\in {Q}_{n}-y}{sup}\left|f\left(t\right)\right|\le {2}^{d}\sum _{\left|n\right|>{N}_{x}}\underset{t\in {Q}_{n}}{sup}\left|f\left(t\right)\right|+{2}^{d}\sum _{\left|n\right|>{N}_{x}}\underset{t\in {Q}_{n}}{sup}\left|f\left(t\right)\right|\text{.}$$

The second sum may become less than $\u03f5/2$, for $y$ sufficiently close to $x$, by the uniform continuity of $f$. □

Remark 2.2

This lemma shows that Wiener’s algebra is a Segal algebra with the translation-invariant and equivalent norm

$${\Vert f\Vert}^{\prime}\u2254\underset{x}{sup}\Vert {T}_{x}f\Vert \text{.}$$

In fact, it is the first example of a Segal algebra. See also ^{[10, Chapter 6.2]}.

A family ${\left\{{F}_{\u03f5}\right\}}_{\u03f5>0}$ of integrable functions on ${\mathbb{R}}^{d}$ satisfying

$$\left(i\right)\phantom{\rule{0ex}{0ex}}{\int}_{{\mathbb{R}}^{d}}{F}_{\u03f5}\left(x\right)\phantom{\rule{0.16667em}{0ex}}dx=1\text{,}\phantom{\rule{2em}{0ex}}\left(\mathrm{ii}\right)\phantom{\rule{0ex}{0ex}}\left|{F}_{\u03f5}\left(x\right)\right|\le \frac{\beta {\u03f5}^{\theta}}{{(\u03f5+\left|x\right|)}^{d+\theta}}\text{,}$$

(2.3)

where $\beta $ and $\theta $ are positive constants independent of $\u03f5$, is called an *approximation to the identity*, or *approximate identity*. The reason is explained by the fact that, if $f:{\mathbb{R}}^{d}\to \mathbb{R}$ is an integrable function and ${f}_{\u03f5}\u2254{F}_{\u03f5}\ast f$, that is

$${f}_{\u03f5}\left(x\right)\u2254{\int}_{{\mathbb{R}}^{d}}{F}_{\u03f5}(x-y)f\left(y\right)\phantom{\rule{0.16667em}{0ex}}dy={\int}_{{\mathbb{R}}^{d}}{F}_{\u03f5}\left(y\right)f(x-y)\phantom{\rule{0.16667em}{0ex}}dy\text{,}$$

then ${f}_{\u03f5}\to f$, as $\u03f5\to 0$, in various ways. In the context of Wiener’s algebra, we have the following.

Lemma 2.3

*Assume that the family*
${\left\{{F}_{\u03f5}\right\}}_{\u03f5>0}$
*satisfies conditions* (2.3)*. Let*
$f\in W({C}_{0},{\ell}^{1})$
*and*
${f}_{\u03f5}={F}_{\u03f5}\ast f$
*. Then*
${f}_{\u03f5}\in W({C}_{0},{\ell}^{1})$
*and*
${f}_{\u03f5}\to f$*, in the*
$W({C}_{0},{\ell}^{1})$
*norm, as*
$\u03f5\to 0$*.*

Proof

An easy calculation shows that

$${\int}_{{\mathbb{R}}^{d}}\left|{F}_{\u03f5}\left(x\right)\right|\phantom{\rule{0.16667em}{0ex}}dx\le \frac{\beta {\omega}_{d}}{\theta}\text{,}\phantom{\rule{2em}{0ex}}{\int}_{\left|x\right|>\delta}\left|{F}_{\u03f5}\left(x\right)\right|\phantom{\rule{0.16667em}{0ex}}dx\le \frac{\beta {\omega}_{d}}{\theta}{\left(\frac{\u03f5}{\u03f5+\delta}\right)}^{\theta}\text{,}$$

(2.4)

where ${\omega}_{d}$ is the area of the unit sphere in ${\mathbb{R}}^{d}$. Therefore, if $f\in W({C}_{0},{\ell}^{1})$, then

$$\Vert {f}_{\u03f5}\Vert =\sum _{n\in {\mathbb{Z}}^{d}}\underset{x\in {Q}_{n}}{sup}\left|{\int}_{{\mathbb{R}}^{d}}{F}_{\u03f5}\left(y\right)f(x-y)\phantom{\rule{0.16667em}{0ex}}dy\right|\le {\int}_{{\mathbb{R}}^{d}}\left|{F}_{\u03f5}\left(y\right)\right|\sum _{n\in {\mathbb{Z}}^{d}}\underset{x\in {Q}_{n}}{sup}\left|f(x-y)\right|\phantom{\rule{0.16667em}{0ex}}dy\le {2}^{d}\Vert f\Vert \frac{\beta}{\theta}{\omega}_{d}\text{,}$$

via (2.2), (2.4), and thus ${f}_{\u03f5}\in W({C}_{0},{\ell}^{1})$. Next, via the continuity result of ^{Lemma 2.2}, (2.2), (2.4), we compute

$$\Vert {f}_{\u03f5}-f\Vert =\sum _{n\in {\mathbb{Z}}^{d}}\underset{x\in {Q}_{n}}{sup}\left|{\int}_{{\mathbb{R}}^{d}}{F}_{\u03f5}\left(y\right)[f(x-y)-f\left(x\right)]\phantom{\rule{0.16667em}{0ex}}dy\right|\le {\int}_{{\mathbb{R}}^{d}}\left|{F}_{\u03f5}\left(y\right)\right|\sum _{n\in {\mathbb{Z}}^{d}}\underset{x\in {Q}_{n}}{sup}|f(x-y)-f\left(x\right)|\phantom{\rule{0.16667em}{0ex}}dy={\int}_{\left|y\right|<\delta}\left|{F}_{\u03f5}\left(y\right)\right|\Vert {T}_{y}f-f\Vert \phantom{\rule{0.16667em}{0ex}}dy+{\int}_{\left|y\right|\ge \delta}\left|{F}_{\u03f5}\left(y\right)\right|\Vert {T}_{y}f-f\Vert \phantom{\rule{0.16667em}{0ex}}dy\le \frac{\beta {\omega}_{d}}{\theta}\u03f5+\frac{\beta {\omega}_{d}}{\theta}{\left(\frac{\u03f5}{\u03f5+\delta}\right)}^{\theta}({2}^{d}+1)\Vert f\Vert \text{,}$$

for $\delta $ sufficiently small. Hence the result follows. □

Remark 2.3

This result is shared by all Segal algebras. In ^{[10]}, Proposition 6.2.4 shows that Segal algebras are ideals in ${L}^{1}$, and the proof of Proposition 6.2.8 in the same book shows the approximation property. Moreover, ^{Lemma 2.3} is valid for all homogeneous Banach spaces, if the functions ${F}_{\u03f5}$ are generated by one function (see ^{[4]}), as is done below.

The typical way of constructing approximate identities is that, given a function $F\in {L}^{1}$ satisfying $\int F\left(x\right)\phantom{\rule{0.16667em}{0ex}}dx=1$ and $\left|F\left(x\right)\right|\le \beta {(1+\left|x\right|)}^{-d-\theta}$, one defines

$${F}_{\u03f5}\left(x\right)\u2254\frac{1}{{\u03f5}^{d}}F\left(\frac{x}{\u03f5}\right)\text{,}\phantom{\rule{1em}{0ex}}x\in {\mathbb{R}}^{d},\phantom{\rule{0ex}{0ex}}\u03f5>0\text{.}$$

(2.5)

Then each ${F}_{\u03f5}$ satisfies conditions (i) and (ii) of (2.3).

We consider a family of continuous functions ${\left\{{\varphi}_{\u03f5}\right\}}_{\u03f5>0}$ satisfying (2.3), where $\beta $ and $\theta $ are constants independent of $\u03f5$. Note that, due to the assumed continuity and property (2.3)(ii), it is easy to show that ${\varphi}_{\u03f5}\in W({C}_{0},{\ell}^{1})$ for all $\u03f5>0$.

Definition 3.1

We set ${\left\{{\psi}_{n}\right\}}_{n=1}^{\infty}$ to be an arbitrary but fixed enumeration of the countable collection of the functions $\{{\varphi}_{{k}^{-1}}(\cdot -\xi ):(k,\xi )\in \mathbb{N}\times {\mathbb{Q}}^{d}\}$; that is,

$${\psi}_{n}\left(x\right)={\varphi}_{{k}^{-1}}(x-\xi )\text{,}\phantom{\rule{1em}{0ex}}\text{forsome}k\in \mathbb{N}\text{and}\xi \in {\mathbb{Q}}^{d}\text{.}$$

(3.1)

Theorem 3.1

*Let*
${\left\{{\psi}_{n}\right\}}_{n=1}^{\infty}$
*be as in*(3.1)*. Then there exists a sequence*
${\left({a}_{n}\right)}_{n\ge 1}$
*in*
${\cap}_{p>1}{\ell}^{p}$
*with the property that, given a function*
$f\in W({C}_{0},{\ell}^{1})$*, there exists an increasing sequence*
${\left({\nu}_{n}\right)}_{n\ge 1}$
*in*
$\mathbb{N}$
*such that*

$$\underset{n\to \infty}{lim}\Vert \sum _{k=1}^{{\nu}_{n}}{a}_{k}{\psi}_{k}-f\Vert =0\text{.}$$

(3.2)

*Moreover, the set of such universal sequences is a dense*
${G}_{\delta}$
*set in*
${\cap}_{p>1}{\ell}^{p}$*, and it contains a dense vector subspace of*
${\cap}_{p>1}{\ell}^{p}$
*except the zero sequence.*

Proof

We prove the theorem by showing that condition (2) of ^{Theorem 2.1} is fulfilled. For a given approximation error $\u03f5$, we choose a ${k}_{0}$ so that $\Vert f-f\ast {\varphi}_{{k}^{-1}}\Vert \le \u03f5/3$ for all $k\ge {k}_{0}$ (see ^{Lemma 2.3}). We will show that, due to the properties of Wiener’s algebra $W({C}_{0},{\ell}^{1})$, and in fact this would work for every Segal algebra, it is possible to approximate the convolution $f\ast {\varphi}_{{k}^{-1}}$ by a Riemann sum, and furthermore to use only translates by rational vectors. First, we approximate the convolution by an integral over a rational cube $K$.

$$\Vert f\ast {\varphi}_{{k}^{-1}}-\left(f{\chi}_{K}\right)\ast {\varphi}_{{k}^{-1}}\Vert =\Vert \left(f{\chi}_{{K}^{c}}\right)\ast {\varphi}_{{k}^{-1}}\Vert =\sum _{n\in {\mathbb{Z}}^{d}}\underset{x\in {Q}_{n}}{sup}\left|{\int}_{{K}^{c}}f\left(y\right){\varphi}_{{k}^{-1}}(x-y)\phantom{\rule{0.16667em}{0ex}}dy\right|\le {\int}_{{K}^{c}}\left|f\left(y\right)\right|\sum _{n\in {\mathbb{Z}}^{d}}\underset{x\in {Q}_{n}}{sup}\left|{\varphi}_{{k}^{-1}}(x-y)\right|\phantom{\rule{0.16667em}{0ex}}dy\le {2}^{d}\Vert {\varphi}_{{k}^{-1}}\Vert {\int}_{{K}^{c}}\left|f\left(y\right)\right|\phantom{\rule{0.16667em}{0ex}}dy\text{,}$$

via (2.2). For $K$ large enough, the right-hand side gets smaller than $\u03f5/3$. Since we can interpret the convolution $f{\chi}_{K}\ast {\varphi}_{{k}^{-1}}\left(x\right)={\int}_{K}f\left(y\right){\varphi}_{{k}^{-1}}(x-y)\phantom{\rule{0.16667em}{0ex}}dy$ as a Riemann integral, we can approximate it in the $W({C}_{0},{\ell}^{1})$ sense by Riemann sums, which are, in this situation, weighted sums of translates of ${\varphi}_{{k}^{-1}}$. It is enough to take the translations on a uniform, rational grid ${K}_{g}$ in $K$ with ‘gridsize’ $\eta $, i.e. $K={\cup}_{y\in {K}_{g}}y+{[0,\eta ]}^{d}$, where, for ${y}_{1},{y}_{2}\in {K}_{g}$ with ${y}_{1}\ne {y}_{2}$, the intersections $\{{y}_{1}+{[0,\eta )}^{d}\}\cap \{{y}_{2}+{[0,\eta )}^{d}\}$ are empty sets. Reshuffling sums and integrals gives

$$\Vert \left(f{\chi}_{K}\right)\ast {\varphi}_{{k}^{-1}}-\sum _{y\in {K}_{g}}{\eta}^{d}f\left(y\right){\varphi}_{{k}^{-1}}(\cdot -y)\Vert =\sum _{n\in {\mathbb{Z}}^{d}}\underset{x\in {Q}_{n}}{sup}\left|\sum _{y\in {K}_{g}}{\int}_{{[0,\eta ]}^{d}}[f(y+t){\varphi}_{{k}^{-1}}(x-y-t)-f\left(y\right){\varphi}_{{k}^{-1}}(x-y)]\phantom{\rule{0.16667em}{0ex}}dt\right|\le \sum _{y\in {K}_{g}}{\int}_{{[0,\eta ]}^{d}}\sum _{n\in {\mathbb{Z}}^{d}}\underset{x\in {Q}_{n}}{sup}|f(y+t){\varphi}_{{k}^{-1}}(x-y-t)-f\left(y\right){\varphi}_{{k}^{-1}}(x-y)|\phantom{\rule{0.16667em}{0ex}}dt\le \sum _{y\in {K}_{g}}{\int}_{{[0,\eta ]}^{d}}\sum _{n\in {\mathbb{Z}}^{d}}\underset{x\in {Q}_{n}}{sup}[|f(y+t){\varphi}_{{k}^{-1}}(x-y-t)-f\left(y\right){\varphi}_{{k}^{-1}}(x-y-t)|+|f\left(y\right){\varphi}_{{k}^{-1}}(x-y-t)-f\left(y\right){\varphi}_{{k}^{-1}}(x-y)|]\phantom{\rule{0.16667em}{0ex}}dt\text{,}$$

from which, using the continuity result of ^{Lemma 2.2}, and the fact that $f$ is uniformly continuous, by taking $\eta $ small enough, leads us to

$$\le \sum _{y\in {K}_{g}}{\int}_{{[0,\eta ]}^{d}}(|f(y+t)-f\left(y\right)|\Vert {T}_{y+t}{\varphi}_{{k}^{-1}}\Vert +\left|f\left(y\right)\right|\Vert {T}_{t}{\varphi}_{{k}^{-1}}-{\varphi}_{{k}^{-1}}\Vert )\phantom{\rule{0.16667em}{0ex}}dt\le {2}^{d}\Vert {\varphi}_{{k}^{-1}}\Vert \phantom{\rule{0.16667em}{0ex}}\left|K\right|\underset{t\in {[0,\eta ]}^{d}}{sup}{\Vert {T}_{t}f-f\Vert}_{\infty}+\left|K\right|{\Vert f\Vert}_{\infty}\underset{t\in {[0,\eta ]}^{d}}{sup}\Vert {T}_{t}{\varphi}_{{k}^{-1}}-{\varphi}_{{k}^{-1}}\Vert <\frac{\u03f5}{3}\text{.}$$

So we have found that

$$\Vert f-\sum _{y\in {K}_{g}}{\eta}^{d}f\left(y\right){\varphi}_{{k}^{-1}}(\cdot -y)\Vert <\u03f5\text{,}$$

and therefore

$$\Vert f-\sum _{n=1}^{N}{c}_{n}{\psi}_{n}\Vert <\u03f5$$

for an $N\in \mathbb{N}$ and the right choice of the coefficients ${c}_{n}$. Notice that there are fewer than ${2}^{d}\left|K\right|/{\eta}^{d}$ coefficients in this sum, all smaller than or equal to ${\eta}^{d}{\Vert f\Vert}_{\infty}$. So the ${\ell}^{p}$-norm of the coefficients is smaller than or equal to ${({\eta}^{dp}{\Vert f\Vert}_{\infty}^{p}{2}^{d}\left|K\right|/{\eta}^{d})}^{1/p}=C{\eta}^{d(p-1)/p}$, which could be made arbitrary small by again choosing $\eta $ sufficiently small. ^{Lemma 2.1} finishes the proof. □

Remark 3.1

We note at this point that there exists no universal series $\sum {a}_{k}{\psi}_{k}$ with ${\ell}^{1}$ coefficients. Indeed, supposing that such a series exists, we are led via (2.4) to

$$\sum _{k=1}^{\infty}\left|{a}_{k}\right|{\int}_{{\mathbb{R}}^{d}}\left|{\psi}_{k}\left(x\right)\right|\phantom{\rule{0.16667em}{0ex}}dx\le \frac{\beta}{\theta}{\omega}_{d}\sum _{k=1}^{\infty}\left|{a}_{k}\right|<\infty \text{.}$$

Thus the series converges almost everywhere on ${\mathbb{R}}^{d}$ to an ${L}^{1}\left({\mathbb{R}}^{d}\right)$ function. This is, however, in contradiction with the fact that its partial sums are dense in $W({C}_{0},{\ell}^{1})$.

Theorem 3.2

*Let*
${\left\{{\psi}_{n}\right\}}_{n=1}^{\infty}\subset W({C}_{0},{\ell}^{1})$
*be as in* (3.1)*. The universal sequence*
${\left({a}_{n}\right)}_{n\ge 1}\in {\cap}_{p>1}{\ell}^{p}$
*provided by* ^{Theorem 3.1} *also satisfies the following.*

- (1)
*Given a function*$f\in {L}^{q}\left({\mathbb{R}}^{d}\right)$*, with*$1\le q<\infty $*, there exists an increasing sequence*${\left({\nu}_{n}\right)}_{n\ge 1}$*in*$\mathbb{N}$*such that*$$\underset{n\to \infty}{lim}{\Vert f-\sum _{k=1}^{{\nu}_{n}}{a}_{k}{\psi}_{k}\Vert}_{q}=0\text{.}$$ - (2)
*Given a function*$f\in {C}_{0}\left({\mathbb{R}}^{d}\right)$*, that is,*$f$*is continuous and vanishes at infinity, there exists an increasing sequence*${\left({\nu}_{n}\right)}_{n\ge 1}$*in*$\mathbb{N}$*such that*$$\underset{n\to \infty}{lim}\underset{x\in {\mathbb{R}}^{d}}{sup}|f\left(x\right)-\sum _{k=1}^{{\nu}_{n}}{a}_{k}{\psi}_{k}\left(x\right)|=0\text{.}$$ - (3)
*Given a function*$f\in {C}_{0}\left({\mathbb{R}}^{d}\right)\cap {L}^{1}\left({\mathbb{R}}^{d}\right)$*, there exists an increasing sequence*${\left({\nu}_{n}\right)}_{n\ge 1}$*in*$\mathbb{N}$*such that*$$\underset{n\to \infty}{lim}{\Vert f-\sum _{k=1}^{{\nu}_{n}}{a}_{k}{\psi}_{k}\Vert}_{1}+{\Vert f-\sum _{k=1}^{{\nu}_{n}}{a}_{k}{\psi}_{k}\Vert}_{\infty}=0\text{.}$$ - (4)
*Given a function*$f\in {C}_{b}\left({\mathbb{R}}^{d}\right)$*, that is,*$f$*is continuous and bounded, there exists an increasing sequence*${\left({\nu}_{n}\right)}_{n\ge 1}$*in*$\mathbb{N}$*such that*$$\underset{n\to \infty}{lim}\underset{x\in K}{sup}|f\left(x\right)-\sum _{k=1}^{{\nu}_{n}}{a}_{k}{\psi}_{k}\left(x\right)|=0$$ *for every compact*$K\subset {\mathbb{R}}^{d}$*.*- (5)
*Given a measurable function*$f$*, there exists an increasing sequence*${\left({\nu}_{n}\right)}_{n\ge 1}$*in*$\mathbb{N}$*such that*$$\sum _{k=1}^{{\nu}_{n}}{a}_{k}{\psi}_{k}\to f\text{,}\phantom{\rule{1em}{0ex}}\text{a.e.as}n\to \infty \text{.}$$ - (6)
*Let*$\mu $*be a*$\sigma $*-finite Borel measure on*${\mathbb{R}}^{d}$*. Then, given a*$\mu $*-measurable function*$f$*, there exists an increasing sequence*${\left({\nu}_{n}\right)}_{n\ge 1}$*in*$\mathbb{N}$*such that*$$\sum _{k=1}^{{\nu}_{n}}{a}_{k}{\psi}_{k}\to f\text{,}\phantom{\rule{1em}{0ex}}\mu \text{\u2014a.e.as}n\to \infty \text{.}$$

Proof

The assertions in (1), (2), (3), and (4) are easily shown by the fact that $W({C}_{0},{\ell}^{1})$ is densely and continuously embedded in ${L}^{q},1\le q<\infty ,{C}_{0},{C}_{0}\cap {L}^{1}$ and ${C}_{b}$ with respect to the natural topologies, respectively.

(5) A combination of Lusin’s theorem and Urysohn’s lemma renders a sequence of continuous functions with compact support ${\left({g}_{k}\right)}_{k\ge 1}$ converging to $f$ almost everywhere. (2) implies that for each $k\in \mathbb{N}$ there exists ${\nu}_{k}$ such that ${\Vert {g}_{k}-{S}_{{\nu}_{k}}\Vert}_{\infty}<1/k$. Then, the sequence of partial sums ${\left({S}_{{\nu}_{k}}\right)}_{k\ge 1}$ converges to $f$ almost everywhere.

(6) The proof is similar to the one in (5). □

Remark 3.2

In ^{Theorem 3.1}, ^{Theorem 3.2}, we proved existence of universal series with coefficients in ${\cap}_{p>1}{\ell}^{p}$. The same result holds in ${\ell}^{q}$, $q>1$, and ${c}_{0}$, since ${\cap}_{p>1}{\ell}^{p}\subset {\ell}^{q}\subset {c}_{0}$, as well as for the space of all sequences ${\mathbb{R}}^{\mathbb{N}}$. In particular, the generic results contained in statement (3) of ^{Theorem 2.1} hold in the ${\ell}^{q},q>1,{c}_{0}$ and ${\mathbb{R}}^{\mathbb{N}}$ settings.

In this section, we consider approximations of the identity generated, via (2.5), by probability densities. To simplify the presentation, we consider the one-dimensional case. Possible such densities are the *Laplace density*: $f\left(x\right)=\lambda exp(-\lambda \left|x\right|)/2,\lambda >0$, the *standard normal density*: $f\left(x\right)=exp(-{x}^{2}/2)/\sqrt{2\pi}$, the *Cauchy density*: $f\left(x\right)=\theta /\left[\pi ({x}^{2}+{\theta}^{2})\right],\theta >0$, or any other continuous density. Hence, we prove the existence of universal series whose terms are modified rational translates of these densities. Translating ^{Theorem 3.2} in this setting, we have the following.

Proposition 4.1

*Let*
$\varphi $
*be a continuous probability density and let*
${\left\{{r}_{n}\right\}}_{n=1}^{\infty}$
*be an arbitrary but fixed enumeration of the set*
$\mathbb{N}\times \mathbb{Q}$
*. For*
${r}_{n}=(k,\xi )$*, we set*
${\varphi}_{{r}_{n}}\left(x\right)=k\varphi \left(k(x-\xi )\right)$*, and we consider the family*
${\left\{{\varphi}_{{r}_{n}}\right\}}_{n=1}^{\infty}$
*. Then, there exists a sequence*
${\left({a}_{n}\right)}_{n\ge 1}$
*in*
${\cap}_{p>1}{\ell}^{p}$
*such that the series*
$\sum {a}_{n}{\varphi}_{{r}_{n}}$
*has the properties of the series of* ^{Theorem 3.1}, ^{Theorem 3.2}*. Moreover, the set of such universal sequences*
${\left({a}_{n}\right)}_{n\ge 1}$
*is a dense*
${G}_{\delta}$
*set in*
${\cap}_{p>1}{\ell}^{p}$*, and it contains a dense vector subspace of*
${\cap}_{p>1}{\ell}^{p}$
*except the zero sequence.*

Remark 4.1

Notice that, if $\varphi $ is the standard normal density, then

$${\varphi}_{{k}^{-1}}(x-\xi )={\varphi}_{\xi ,{k}^{-2}}\left(x\right)\text{,}$$

(4.1)

the normal density with mean $\xi $ and variance $1/{k}^{2}$. In analogy to statement (1) of ^{Theorem 3.2} for $q=1$, we recover the known result that any probability distribution is approximated in the ${L}^{1}$ norm by a finite linear combination of normal distributions. By ^{Proposition 4.1} it follows, however, that this approximation is accomplished by other probability distributions as well and in every ${L}^{q}$ norm, $q\ge 1$.

We consider the initial value problem for the heat equation

$${u}_{t}={\Delta}_{x}u\text{,}\phantom{\rule{1em}{0ex}}x\in {\mathbb{R}}^{d},\phantom{\rule{0ex}{0ex}}t>0\text{,}$$

(5.1a)

$$u(x,0)=f\left(x\right)\text{,}\phantom{\rule{1em}{0ex}}x\in {\mathbb{R}}^{d}\text{,}$$

(5.1b)

where ${\Delta}_{x}$ is the Laplacian and $f$ is a continuous function. Let

$$G(x,t)\u2254{\left(4\pi t\right)}^{-d/2}{e}^{-{\left|x\right|}^{2}/4t}\text{,}\phantom{\rule{1em}{0ex}}x\in {\mathbb{R}}^{d},\phantom{\rule{0ex}{0ex}}t>0\text{,}$$

(5.2)

and set ${G}_{t}\left(x\right)\u2254G(x,t)$. Then the family $\{{G}_{t}\left(x\right):t>0,\phantom{\rule{0ex}{0ex}}x\in {\mathbb{R}}^{d}\}$ is an approximation to the identity. This is the *Gauss* or *heat kernel*. We recall that the function $G(x-y,t)$ is a solution of (5.1a), for each $y$, and, if $f$ is a continuous and bounded function, then the unique bounded solution of (5.1a) and (5.1b) is given by

$$u(x,t)={\int}_{{\mathbb{R}}^{d}}G(x-y,t)f\left(y\right)\phantom{\rule{0.16667em}{0ex}}dy,\u2255G(\cdot ,t){\ast}_{1}f\left(x\right)\text{,}$$

and the initial condition is attained as $f\left(x\right)={lim}_{t\to 0}{\int}_{{\mathbb{R}}^{d}}G(x-y,t)f\left(y\right)\phantom{\rule{0.16667em}{0ex}}dy$. Moreover, the map

$${C}_{b}\left({\mathbb{R}}^{d}\right)\ni f\mapsto G{\ast}_{1}f\in {C}^{\infty}({\mathbb{R}}^{d}\times {\mathbb{R}}_{+})$$

is well defined and continuous if we regard the topologies of uniform convergence on compact sets on ${C}_{b}\left({\mathbb{R}}^{d}\right)$ and the uniform convergence on compact sets of arbitrary derivatives on ${C}^{\infty}({\mathbb{R}}^{d}\times {\mathbb{R}}_{+})$. The latter topology is given by the semi-norms

$${p}_{n}\left(u\right)\u2254\underset{\genfrac{}{}{0ex}{}{\left|x\right|\le n,1/n\le t\le n}{\left|\alpha \right|\le n,r\le n}}{sup}\left|\underset{x}{\overset{\alpha}{\partial}}{\partial}_{t}^{r}u(x,t)\right|\text{,}$$

so the continuity inequalities

$${p}_{n}\left(G{\ast}_{1}f\right)\le {C}_{n}{\Vert f\Vert}_{\infty}$$

(5.3)

are valid for the right choice of ${C}_{n}>0$. Furthermore, ${C}^{\infty}({\mathbb{R}}^{d}\times {\mathbb{R}}_{+})$ is a complete metric space with metric

$$\rho (u,v)=\sum _{n=1}^{\infty}\frac{1}{{2}^{n}}\frac{{p}_{n}(u-v)}{1+{p}_{n}(u-v)}\text{.}$$

Theorem 5.1

*Let*
${\left\{{\xi}_{n}\right\}}_{n=1}^{\infty}$
*be an enumeration of all rational vectors in*
${\mathbb{R}}^{d}$
*and let us set*
${G}_{n}(x,t)\u2254G(x-{\xi}_{n},t)$
*. Then there exist series*
$\sum {a}_{n}{G}_{n}$
*with*
${\left({a}_{n}\right)}_{n\ge 1}\in {\cap}_{p>1}{\ell}^{p}$*, having the property that, given any bounded solution*
$u$
*of the heat equation with continuous and bounded initial data*
$f$*, there exists an increasing sequence*
${\left({\nu}_{n}\right)}_{n\ge 1}$
*in*
$\mathbb{N}$
*such that*

$${\partial}_{x}^{\alpha}{\partial}_{t}^{r}\sum _{k=1}^{{\nu}_{n}}{a}_{k}{G}_{k}(x,t)\to {\partial}_{x}^{\alpha}{\partial}_{t}^{r}u(x,t)\text{,}\phantom{\rule{1em}{0ex}}\text{as}n\to \infty $$

(5.4)

*uniformly on compact sets of*
${\mathbb{R}}^{d}\times {\mathbb{R}}_{+}$*, for every multi-index*
$\alpha $
*with*
$\left|\alpha \right|\ge 0$
*and for every nonnegative integer*
$r$
*. Moreover, the set of such universal sequences*
${\left({a}_{n}\right)}_{n\ge 1}$
*is a dense*
${G}_{\delta}$
*set in*
${\cap}_{p>1}{\ell}^{p}$*, and it contains a dense vector subspace of*
${\cap}_{p>1}{\ell}^{p}$
*except the zero sequence.*

Proof

We again show assertion (2) of ^{Theorem 2.1} by inferring ^{Lemma 2.1}. Let $u$ be the bounded solution of the heat equation with boundary data $f\in W({C}_{0},{\ell}^{1})$, or ${C}_{0}$, and $\u03f5>0$. For a compact set $K\subset {\mathbb{R}}^{d}\times {\mathbb{R}}_{+}$ there is an $N\in \mathbb{N}$ such that $K\subset \{\left|x\right|\le N,1/N\le t\le N\}$ on the one hand, and on the other ${\sum}_{k=N+1}{2}^{-k}\le \u03f5/3$. Therefore, $\rho (u,v)\le {p}_{N}(u-v)+\u03f5/3$ holds for all $v\in {C}^{\infty}({\mathbb{R}}^{d}\times {\mathbb{R}}_{+})$. Since $u$ and its derivatives are uniformly continuous on $\{\left|x\right|\le 2N,1/2N\le t\le 2N\}$, we can further choose $0<{\tau}_{0}<1/2N$ such that

$${p}_{N}(u(\cdot ,\cdot )-u(\cdot ,\cdot -\tau ))<\frac{\u03f5}{3}$$

for all $0<\tau <{\tau}_{0}$. By the reasoning in the proof of ^{Theorem 3.1}, we can also take ${\tau}_{0}$ in a way that for $0<\tau <{\tau}_{0}$ there are coefficients ${\left\{{b}_{k}\right\}}_{k=1}^{n}\subset \mathbb{C}$ and points ${\left\{{x}_{k}\right\}}_{k=1}^{n}\subset {\mathbb{Q}}^{d}$ such that

$${\Vert f-\sum _{k=1}^{n}{b}_{k}G(\cdot -{x}_{k},\tau )\Vert}_{\infty}<\frac{\u03f5}{3{C}_{2N}}$$

and

$${\left(\sum _{k=1}^{n}{\left|{b}_{k}\right|}^{p}\right)}^{1/p}<\u03f5$$

for a fixed $p>1$ and ${C}_{2N}$ corresponding to the appropriate constant of inequality (5.3). Due to the continuity inequality in (5.3) mentioned above, and using the well-known property of the Gaussian kernel $G(\cdot ,t)\ast G(\cdot ,s)=G(\cdot ,s+t)$, we derive

$${p}_{2N}(u(\cdot ,\cdot )-\sum _{k=1}^{n}{b}_{k}G(\cdot -{x}_{k},\cdot +\tau ))<\frac{\u03f5}{3}\text{.}$$

From this,

$${p}_{N}(u(\cdot ,\cdot -\tau )-\sum _{k=1}^{n}{b}_{k}G(\cdot -{x}_{k},\cdot ))<\frac{\u03f5}{3}$$

follows, since $\tau <1/2N$. By the triangle inequality, we now establish

$$\rho (u(\cdot ,\cdot ),\sum _{k=1}^{n}{b}_{k}G(\cdot -{x}_{k},\cdot ))\le {p}_{N}(u(\cdot ,\cdot )-\sum _{k=1}^{n}{b}_{k}G(\cdot -{x}_{k},\cdot ))+\frac{\u03f5}{3}\le {p}_{N}(u(\cdot ,\cdot )-u(\cdot ,\cdot -\tau ))+{p}_{N}(u(\cdot ,\cdot -\tau )-\sum _{k=1}^{n}{b}_{k}G(\cdot -{x}_{k},\cdot ))+\frac{\u03f5}{3}\le \u03f5\text{.}$$

Again, by continuity and density, this result is also valid for $f\in {C}_{b}$. ^{Lemma 2.1} finishes the proof. □

Note 5.1

If a sequence of partial sums of the series $\sum {a}_{n}{G}_{n}$ approximates the solution $u$, then the same sequence approximates the initial condition $f$ for $t$ small, uniformly on compact sets of ${\mathbb{R}}^{d}$. Indeed, assuming that $\rho (u,{\sum}_{k=1}^{{\nu}_{n}}{a}_{n}{G}_{n})\to 0$ as $n\to \infty $, then, for $\u03f5$ small, via ^{Lemma 2.3}, we have ${\Vert f-u(\cdot ,\tau )\Vert}_{\infty}<\u03f5/2$. Hence, for $1/N<\tau $, we finally obtain

$$\underset{\left|x\right|\le N}{sup}|f\left(x\right)-\sum _{k=1}^{{\nu}_{n}}{a}_{n}{G}_{n}(x,\tau )|\le \underset{\left|x\right|\le N}{sup}|f\left(x\right)-u(x,\tau )|+\underset{\left|x\right|\le N}{sup}|u(x,\tau )-\sum _{k=1}^{{\nu}_{n}}{a}_{n}{G}_{n}(x,\tau )|\le {\Vert f-u(\cdot ,\tau )\Vert}_{\infty}+{p}_{N}(u-\sum _{k=1}^{{\nu}_{n}}{a}_{n}{G}_{n})<\u03f5\text{,}$$

as long as ${p}_{N}(u-{\sum}_{k=1}^{{\nu}_{n}}{a}_{n}{G}_{n})<\u03f5/2$.

Let $H$ be the upper half space in ${\mathbb{R}}^{d+1}$, that is, $H=\{(x,y)\in {\mathbb{R}}^{d+1}:y>0\}$, and consider the boundary value problem

$$\Delta u=0\text{,}\phantom{\rule{1em}{0ex}}(x,y)\in H\text{,}$$

(6.1a)

$$u(x,0)=f\left(x\right)\text{,}\phantom{\rule{1em}{0ex}}x\in \partial H\text{,}$$

(6.1b)

where $f$ is a bounded, continuous, real-valued function on ${\mathbb{R}}^{d}=\partial H$. The corresponding solution is given by

$$u(x,y)={\int}_{{\mathbb{R}}^{d}}f\left(s\right)P(x-s,y)\phantom{\rule{0.16667em}{0ex}}ds\text{,}\phantom{\rule{1em}{0ex}}x\in {\mathbb{R}}^{d},\phantom{\rule{0ex}{0ex}}y>0\text{,}$$

(6.2)

and the boundary value is realized as the limit of the integral as $y\to 0$. The function $P(x,y)$ in the integrand is the *Poisson kernel* for the upper half space, and it is defined by

$$P(x,y)=\frac{2}{{\omega}_{d+1}}\frac{y}{{({\left|x\right|}^{2}+{y}^{2})}^{(d+1)/2}}\text{,}$$

where ${\omega}_{d+1}$ is the surface area of the unit sphere in ${\mathbb{R}}^{d+1}$. $P$ is a harmonic function, and, defining ${P}_{y}\left(x\right)\u2254P(x,y)$, the family $\{{P}_{y}\left(x\right):y>0,\phantom{\rule{0ex}{0ex}}x\in {\mathbb{R}}^{d}\}$ is also an approximate identity, and hence a result that is analogous to the ^{Theorem 5.1} result can be proved.

Theorem 6.1

*If*
${\left\{{\xi}_{n}\right\}}_{n=1}^{\infty}$
*is an enumeration of the rational vectors in*
${\mathbb{R}}^{d}$
*and*
${P}_{n}(x,y)\u2254{P}_{y}(x-{\xi}_{n})$*, then there exist series*
$\sum {a}_{n}{P}_{n}$
*with coefficients in*
${\cap}_{p>1}{\ell}^{p}$
*having the property that, given any function*
$u$
*harmonic on*
$H$*, and with continuous and bounded boundary data, there exists an increasing sequence*
${\left({\nu}_{n}\right)}_{n\ge 1}$
*in*
$\mathbb{N}$
*such that*

$${\partial}^{\alpha}\sum _{k=1}^{{\nu}_{n}}{a}_{k}{P}_{k}(x,y)\to {\partial}^{\alpha}u(x,y)\text{,}\phantom{\rule{1em}{0ex}}\text{as}n\to \infty $$

*uniformly on compact sets of*
$H$*, for every multi-index*
$\alpha $*,*
$\left|\alpha \right|\ge 0$
*. Moreover, the set of such universal sequences*
${\left({a}_{n}\right)}_{n\ge 1}$
*is a dense*
${G}_{\delta}$
*set in*
${\cap}_{p>1}{\ell}^{p}$*, and it contains a dense vector subspace of*
${\cap}_{p>1}{\ell}^{p}$
*except the zero sequence.*

Proof

Let $u$ be a function harmonic on $H$ and continuous on the closure of $H$, and let $K\subset H$ be compact. Since ${\int}_{{\mathbb{R}}^{d}}P(x-s,y)\phantom{\rule{0.16667em}{0ex}}ds=1$, for all $y>0$, the integral $\int u(s,0)P(x-s,y)\phantom{\rule{0.16667em}{0ex}}ds$ may become arbitrarily small outside a compact set containing $K$. Hence the integral in (6.2) is approximated uniformly on $K$ by Riemann sums

$$\sum _{k=1}^{N}u({\xi}_{k},0)P(x-{\xi}_{k},y)\left|{K}_{k}\right|\text{,}$$

where ${K}_{1},\dots ,{K}_{N}$ are cubes covering $K$. Hence, by ^{Theorem 3.2}(4), there exists a series $\sum {a}_{n}{P}_{n}$ with ${\left({a}_{n}\right)}_{n\ge 1}\in {\cap}_{p>1}{\ell}^{p}$ and ${P}_{n}(x,y)={P}_{y}(x-{\xi}_{n})$, so that a sequence of partial sums ${\left({S}_{{\nu}_{n}}\right)}_{n\ge 1}$ converges uniformly on compact subsets of $H$ to $u$. The proof of the statement for the derivatives follows from the fact that the sequence of harmonic functions ${\left({S}_{{\nu}_{n}}\right)}_{n\ge 1}$, being convergent to $u$ uniformly on compact subsets of $H$, also satisfies that, for any multi-index $\alpha $, ${\partial}^{\alpha}{S}_{{\nu}_{n}}\to {\partial}^{\alpha}u$ in the same sense. The proof is complete. □

Let us replace $H$ in (6.1) by $B$, the unit ball of ${\mathbb{R}}^{d}$, and $\partial H$ by $S=\partial B$, the unit sphere in ${\mathbb{R}}^{d}$, where now $f$ is a continuous function on $S$. We recall that the function

$$u\left(x\right)=\frac{1}{{\omega}_{d}}{\int}_{S}f\left(\zeta \right)\frac{1-{\left|x\right|}^{2}}{{|\zeta -x|}^{d}}\phantom{\rule{0.16667em}{0ex}}d\sigma \left(\zeta \right)\text{,}\phantom{\rule{1em}{0ex}}x\in B\text{,}$$

$$u\left(x\right)=f\left(x\right)\text{,}\phantom{\rule{1em}{0ex}}x\in S\text{,}$$

where $\sigma $ is the area measure on $S$, is harmonic on $B$ and continuous on $\overline{B}$. It is therefore the solution of the boundary value problem. The expression

$$P(x;\zeta )\u2254\frac{1}{{\omega}_{d}}\frac{1-{\left|x\right|}^{2}}{{|\zeta -x|}^{d}}\text{,}\phantom{\rule{1em}{0ex}}x\in B,\phantom{\rule{0ex}{0ex}}\zeta \in S\text{,}$$

in the integrand is the *Poisson kernel* for $B$. For $\zeta \in S$, the function $P(\cdot ;\zeta )$ is harmonic on ${\mathbb{R}}^{d}\setminus \left\{\zeta \right\}$ and, moreover, ${\int}_{S}P(x;\zeta )\phantom{\rule{0.16667em}{0ex}}d\sigma \left(\zeta \right)=1$. We can then write the solution of (6.1) as

$$u\left(x\right)=P\left[f\right]\left(x\right)\u2254{\int}_{S}f\left(\zeta \right)P(x,\zeta )\phantom{\rule{0.16667em}{0ex}}d\sigma \left(\zeta \right)\text{.}$$

(6.3)

If, on the other hand, $u$ is a continuous function on $\overline{B}$ and harmonic on $B$, then, by the uniqueness of the solution of (6.1), $u\left(x\right)=P\left[u{|}_{S}\right]\left(x\right)$, where $u{|}_{S}$ is the restriction of $u$ on $S$. Although the integral representation in (6.3) is not a convolution of the boundary data with the Poisson kernel for the ball, the integral can be broken into a finite number of integrals over pieces of $S$ and then approximated uniformly over compact subsets of $B$ by Riemann sums, where the $\zeta $ belong to a countable dense subset of $S$. Hence a theorem like ^{Theorem 6.1} can be proved. Alternatively we may work as follows.

Writing each point $x\in {\mathbb{R}}^{d}$ in spherical coordinates $x=x(r,\theta )$ with $\theta =({\theta}_{1},\dots ,{\theta}_{d-1})$, where $0\le {\theta}_{j}\le \pi $ for $j=1,2,\dots ,d-2$ and $0\le {\theta}_{d-1}\le 2\pi $, we have the following.

Theorem 6.2

*Let*
${\left\{{s}_{n}\right\}}_{n=1}^{\infty}$
*be an enumeration of all rational vectors in*
${[0,\pi ]}^{d-2}\times [0,2\pi ]$
*and let*
${\zeta}_{n}=\zeta (1,{s}_{n}),n\in \mathbb{N}$
*. Let*
${P}_{n}\left(x\right)\u2254P(x,{\zeta}_{n})$
*. Then there exist series*
$\sum {a}_{n}{P}_{n}$
*with*
${\left({a}_{n}\right)}_{n\ge 1}\in {\cap}_{p>1}{\ell}^{p}$*, having the property that, given a function*
$u$
*harmonic on*
$B$
*and continuous on*
$\overline{B}$*, there exists an increasing sequence*
${\left({\nu}_{n}\right)}_{n\ge 1}$
*in*
$\mathbb{N}$
*such that*

$${\partial}_{x}^{\alpha}\sum _{k=1}^{{\nu}_{n}}{a}_{k}{P}_{k}\left(x\right)\to {\partial}_{x}^{\alpha}u\left(x\right)\text{,}\phantom{\rule{1em}{0ex}}\text{as}n\to \infty $$

(6.4)

*uniformly on compact sets of*
$B$
*for every multi-index*
$\alpha $*,*
$\left|\alpha \right|\ge 0$
*. Moreover, the set of such universal sequences*
${\left({a}_{n}\right)}_{n\ge 1}$
*is a dense*
${G}_{\delta}$
*set in*
${\cap}_{p>1}{\ell}^{p}$*, and it contains a dense vector subspace of*
${\cap}_{p>1}{\ell}^{p}$
*except the zero sequence.*

The proof is similar to that of ^{Theorem 6.1}, and is omitted.

We conclude this section with a few comments.

Remark 6.1

Although ^{Theorem 6.2} is stated and proved in the context of boundary value problems for the steady-state equation, the result holds true in a more general setting. In particular, the series obtained is universal in the space of functions harmonic in the unit ball $B$. Indeed, every such function is approximated in the topology of uniform convergence on compact sets of $B$ by functions harmonic on $B$ and continuous on $\overline{B}$. The same result also holds for harmonic functions on $H$. The analogous statement is also true for solutions of the heat equation in ${\mathbb{R}}^{d}\times {\mathbb{R}}_{+}$.

Remark 6.2

We note, as in ^{Remark 3.1}, that no universal series $\sum {a}_{n}{P}_{n}$ exists with ${\ell}^{1}$ coefficients. The supposition that it does leads to

$$\sum _{n=1}^{\infty}\left|{a}_{n}{P}_{n}(x,y)\right|=\frac{2}{{\omega}_{d+1}}\sum _{n=1}^{\infty}\left|{a}_{n}\right|\frac{y}{{({|x-{\xi}_{n}|}^{2}+{y}^{2})}^{(d+1)/2}}\le \frac{2}{{\omega}_{d+1}}\sum _{n=1}^{\infty}\left|{a}_{n}\right|\frac{1}{{y}^{d}}=a{y}^{-d}\text{,}$$

for the upper half space $H$, and

$$\sum _{n=1}^{\infty}{a}_{n}{P}_{n}\left(0\right)=\frac{1}{{\omega}_{d}}\sum _{n=1}^{\infty}{a}_{n}=b\text{,}$$

for the ball, where $a,b\in \mathbb{R}$, via the absolute convergence of the series ${\sum}_{n=1}^{\infty}{a}_{n}$. But this contradicts that the partial sums are dense in the relevant spaces of harmonic functions.

Note.

An earlier version of this work was completed while the first and the last author were visiting the Department of Mathematics and Statistics of the University of Cyprus. It appeared as technical report: V. Nestoridis and V. Stefanopoulos, *Universal Series and Approximate Identities*, TR-28-2007, Department of Mathematics and Statistics, University of Cyprus. When some authors refer to “V. Nestoridis and V. Stefanopoulos, *Universal Series and Approximate Identities*”, they mean the above-mentioned technical report. In particular, “A.G. Bacharoglou, *Approximation of Probability Distributions by Convex Mixtures of Gaussian Measures*, Proc. AMS, 138, (2010), no. 7, 2619–2628” uses a lemma which does not exist in the present version.

V.N. and V.S. are grateful for hospitality at the University of Cyprus. We also thank K. Fokianos and A.M. Olevskii for several fruitful discussions we had while preparing this paper.

V.N. and V.S. were partially supported by Caratheodory program#C164. S.S. was supported by the FWF GrantSISE S10602.

Communicated by Hans G Feichtinger

1. Alspach D.L., Sorenson H.W. Nonlinear Bayesian estimation using Gaussian sum approximations. IEEE Trans. Automat. Control. 1972;AC-17(4):439–448.

2. Bayart F., Grosse-Erdmann K.-G., Nestoridis V., Papadimitropoulos C. Abstract theory of universal series and applications. Proc. Lond. Math. Soc. (3) 2008;96(2):417–463.

3. Feichtinger H.G. A characterization of Wiener’s algebra on locally compact groups. Arch. Math. 1977;29:136–140.

4. Feichtinger H.G., Weisz F. The Segal algebra ${S}_{0}\left({R}^{d}\right)$ and norm summability of Fourier series and Fourier transforms. Monatsh. Math. 2006;148:333–349.

5. Gröchenig K. Birkhäuser; Boston: 2001. Foundations of Time–Frequency Analysis.

6. Grosse-Erdmann K-G. Universal families and hypercyclic operators. Bull. Amer. Math. Soc. 1999;36(3):345–381.

7. Kahane J.P. Baire’s category theorem and trigonometric series. J. Anal. Math. 2000;80:143–182.

8. Lo J.T.H. Finite dimensional sensor orbits and optimal nonlinear filtering. IEEE Trans. Inform. Theory. 1972;IT-18(5):583–589.

9. Nestoridis V., Papadimitropoulos C. Abstract theory of universal series and an application to Dirichlet series. C. R. Acad. Sci. Paris. 2005;341(9):539–543.

10. Reiter H., Stegeman J.D. Oxford Science Publications, Clarendon Press; 2000. Classical Harmonic Analysis and Locally Compact Groups.

PubMed Central Canada is a service of the Canadian Institutes of Health Research (CIHR) working in partnership with the National Research Council's national science library in cooperation with the National Center for Biotechnology Information at the U.S. National Library of Medicine(NCBI/NLM). It includes content provided to the PubMed Central International archive by participating publishers. |