Weak convergence (Hilbert space)

Definition

A sequence of points ( x n ) in a Hilbert space H is said to converge weakly to a point x in H if

⟨ x n , y ⟩ → ⟨ x , y ⟩

for all y in H. Here, ⟨ ⋅ , ⋅ ⟩ is understood to be the inner product on the Hilbert space. The notation

x n ⇀ x

is sometimes used to denote this kind of convergence.

Properties

If a sequence converges strongly, then it converges weakly as well.

Since every closed and bounded set is weakly relatively compact (its closure in the weak topology is compact), every bounded sequence x n in a Hilbert space H contains a weakly convergent subsequence. Note that closed and bounded sets are not in general weakly compact in Hilbert spaces (consider the set consisting of an orthonormal basis in an infinitely dimensional Hilbert space which is closed and bounded but not weakly compact since it doesn't contain 0). However, bounded and weakly closed sets are weakly compact so as a consequence every convex bounded closed set is weakly compact.

As a consequence of the principle of uniform boundedness, every weakly convergent sequence is bounded.

The norm is (sequentially) weakly lower-semicontinuous: if x n converges weakly to x, then

and this inequality is strict whenever the convergence is not strong. For example, infinite orthonormal sequences converge weakly to zero, as demonstrated below.

If x n converges weakly to x and we have the additional assumption that ∥ x n ∥ → ∥ x ∥ , then x n converges to x strongly:

If the Hilbert space is finite-dimensional, i.e. a Euclidean space, then the concepts of weak convergence and strong convergence are the same.

Example

The Hilbert space L 2 [ 0 , 2 π ] is the space of the square-integrable functions on the interval [ 0 , 2 π ] equipped with the inner product defined by

⟨ f , g ⟩ = ∫ 0 2 π f ( x ) ⋅ g ( x ) d x ,

(see L^p space). The sequence of functions f 1 , f 2 , … defined by

f n ( x ) = sin ⁡ ( n x )

converges weakly to the zero function in L 2 [ 0 , 2 π ] , as the integral

∫ 0 2 π sin ⁡ ( n x ) ⋅ g ( x ) d x .

tends to zero for any square-integrable function g on [ 0 , 2 π ] when n goes to infinity, i.e.

⟨ f n , g ⟩ → ⟨ 0 , g ⟩ = 0.

Although f n has an increasing number of 0's in [ 0 , 2 π ] as n goes to infinity, it is of course not equal to the zero function for any n . Note that f n does not converge to 0 in the L ∞ or L 2 norms. This dissimilarity is one of the reasons why this type of convergence is considered to be "weak."

Weak convergence of orthonormal sequences

Consider a sequence e n which was constructed to be orthonormal, that is,

⟨ e n , e m ⟩ = δ m n

where δ m n equals one if m = n and zero otherwise. We claim that if the sequence is infinite, then it converges weakly to zero. A simple proof is as follows. For x ∈ H, we have

∑ n | ⟨ e n , x ⟩ | 2 ≤ ∥ x ∥ 2 (Bessel's inequality)

where equality holds when {e_n} is a Hilbert space basis. Therefore

| ⟨ e n , x ⟩ | 2 → 0 (since the series above converges, its corresponding sequence must go to zero)

i.e.

⟨ e n , x ⟩ → 0.

Banach–Saks theorem

The Banach–Saks theorem states that every bounded sequence x n contains a subsequence x n k and a point x such that

1 N ∑ k = 1 N x n k

converges strongly to x as N goes to infinity.

Generalizations

The definition of weak convergence can be extended to Banach spaces. A sequence of points ( x n ) in a Banach space B is said to converge weakly to a point x in B if

f ( x n ) → f ( x )

for any bounded linear functional f defined on B , that is, for any f in the dual space B ′ . If B is a Hilbert space, then, by the Riesz representation theorem, any such f has the form

f ( ⋅ ) = ⟨ ⋅ , y ⟩

for some y in B , so one obtains the Hilbert space definition of weak convergence.