Hahn–Banach theorem

The Hahn–Banach theorem is a central tool in functional analysis (a field of mathematics). It allows the extension of bounded linear functionals defined on a subspace of some vector space to the whole space, and it also shows that there are "enough" continuous linear functionals defined on every normed vector space to make the study of the dual space "interesting". Another version of the Hahn–Banach theorem is known as the Hahn–Banach separation theorem or the hyperplane separation theorem, and has numerous uses in convex geometry.

The theorem is named for the mathematicians Hans Hahn and Stefan Banach, who proved it independently in the late 1920s. The special case of the theorem for the space ${C}{\left[a,b\right]}$ of continuous functions on an interval was proved earlier (in 1912) by Eduard Helly,[1] and a more general extension theorem, the M. Riesz extension theorem, from which the Hahn–Banach theorem can be derived, was proved in 1923 by Marcel Riesz.[2]

Formulation

The most general formulation of the theorem needs some preparation. Given a real vector space $V$ , a function $f : V \to R$ is called sublinear if

Positive homogeneity: $f (γx) = γ f (x)$ for all $γ \in R +, x \in V$ ,
Subadditivity: $f (x + y) \leq f (x) + f (y)$ for all $x, y \in V$ .

Every seminorm on $V$ (in particular, every norm on $V$ ) is sublinear. Other sublinear functions can be useful as well, especially Minkowski functionals of convex sets.

Hahn–Banach theorem (Rudin 1991, Th. 3.2). If $p : V \to R$ is a sublinear function, and $φ : U \to R$ is a linear functional on a linear subspace $U \subseteq V$ which is dominated by $p$ on $U$ , i.e.

\varphi (x)\leq p(x)\qquad \forall x\in U

then there exists a linear extension $ψ : V \to R$ of $φ$ to the whole space $V$ , i.e., there exists a linear functional $ψ$ such that

\psi (x)=\varphi (x)\qquad \forall x\in U,

\psi (x)\leq p(x)\qquad \forall x\in V.

Hahn–Banach theorem (alternative version). Set $K = R$ or $C$ and let $V$ be a $K$ -vector space with a seminorm $p : V \to R$ . If $φ : U \to K$ is a $K$ -linear functional on a $K$ -linear subspace $U$ of $V$ which is dominated by $p$ on $U$ in absolute value,

|\varphi (x)|\leq p(x)\qquad \forall x\in U

then there exists a linear extension $ψ : V \to K$ of $φ$ to the whole space $V$ , i.e., there exists a $K$ -linear functional $ψ$ such that

\psi (x)=\varphi (x)\qquad \forall x\in U,

|\psi (x)|\leq p(x)\qquad \forall x\in V.

In the complex case of the alternate version, the $C$ -linearity assumptions demand, in addition to the assumptions for the real case, that for every vector $x \in U$ , we have $i x \in U$ and $φ (i x) = i φ (x)$ .

The extension $ψ$ is in general not uniquely specified by $φ$ and the proof gives no explicit method as to how to find $ψ$ . The usual proof for the case of an infinite dimensional space $V$ uses Zorn's lemma or, equivalently, the axiom of choice. It is now known (see below) that the ultrafilter lemma, which is slightly weaker than the axiom of choice, is actually strong enough.

It is possible to relax slightly the subadditivity condition on $p$ , requiring only that (Reed and Simon, 1980):

p(ax+by)\leq |a|\,p(x)+|b|\,p(y),\qquad x,y\in V,\quad |a|+|b|\leq 1.

It is further possible to relax the positive homogeneity and the subadditivity conditions on $p$ , requiring only that $p$ is convex (Schechter, 1996).

This reveals the intimate connection between the Hahn–Banach theorem and convexity.

The Mizar project has completely formalized and automatically checked the proof of the Hahn–Banach theorem in the HAHNBAN file.[3]

Important consequences

The theorem has several important consequences, some of which are also sometimes called "Hahn–Banach theorem":

If $V$ is a normed vector space with linear subspace $U$ (not necessarily closed) and if $φ : U \to K$ is continuous and linear, then there exists an extension $ψ : V \to K$ of $φ$ which is also continuous and linear and which has the same operator norm as $φ$ (see Banach space for a discussion of the norm of a linear map). In other words, in the category of normed vector spaces, the space $K$ is an injective object.
If $V$ is a normed vector space with linear subspace $U$ (not necessarily closed) and if $z$ is an element of $V$ not in the closure of $U$ , then there exists a continuous linear map $ψ : V \to K$ with $ψ (x) = 0$ for all $x$ in $U$ , $ψ (z) = 1$ , and $|| ψ || = dist(z, U) -1$ .
In particular, if $V$ is a normed vector space and $z$ is an element of $V$ , then there exists a continuous linear map $ψ : V \to K$ such that $ψ (z) = || z ||$ and $|| ψ || \leq 1$ . This implies that the natural injection $J$ from a normed space $V$ into its double dual $V''$ is isometric.

Hahn–Banach separation theorems

Hahn–Banach separation theorems are the geometrical versions of the Hahn–Banach Theorem.[4][5] It has numerous uses in convex geometry,[6] optimization theory, and economics. The separation theorem is derived from the original form of the theorem.

Let X be a real vector space, A and B subsets of X, $\lambda \neq 0$ a linear functional on X, α a scalar, and let $H=\lambda ^{-1}(\alpha )$ . If $\operatorname {sup} \lambda (A)\leq \alpha \leq \operatorname {inf} \lambda (B)$ then we say that H (or $\lambda$ ) separates A and B; the separation is proper if $A\cup B\not \subseteq H$ and it is strict if $A\cap H=\emptyset$ or $B\cap H=\emptyset$ .[4] A and B are united if they cannot be properly separated.

If $a_{0}\in A$ and H separates A and $\left\{a_{0}\right\}$ then H is called a supporting hyperplane of A at $a_{0}$ , $a_{0}$ is called a support point of A, and $\lambda$ is called a support functional.[4]

Separation of sets

Theorem. Set $K = R$ or $C$ and let $V$ be a topological vector space over $K$ . If $A, B$ are convex, non-empty disjoint subsets of $V$ , then:

If $A$ is open, then there exists a continuous linear map $λ : V \to K$ and $t \in R$ such that $Re(λ (a)) < t \leq Re(λ (b))$ for all $a \in A, b \in B$ .
If $V$ is locally convex, $A$ is compact, and $B$ closed, then there exists a continuous linear map $λ : V \to K$ and $s, t \in R$ such that $Re(λ (a)) < t < s < Re(λ (b))$ for all $a \in A, b \in B$ .

The following theorem may be used if the sets are not necessarily disjoint.[4]

Theorem. Let X be a real locally convex topological vector space and let A and B be non-empty convex subsets. If $\operatorname {Int} A\neq \emptyset$ and $B\cap \operatorname {Int} A=\emptyset$ then there exists a continuous $\lambda \in X^{*}$ and such that $\operatorname {sup} \lambda (A)\leq \operatorname {inf} \lambda (B)$ and $\lambda (a)<\operatorname {inf} \lambda (B)$ for all $a\in \operatorname {Int} A$ (such is $\lambda$ is necessarily non-zero).

Separation of a point and set

The following is the Hahn–Banach separation theorem for a point and a set.[4]

Theorem. Let X be a real topological vector space and $A\subseteq X$ be convex with $\operatorname {Int} A\neq \emptyset$ . If $a_{0}\in A\setminus \operatorname {Int} A$ then $a_{0}$ is a support point of A.

Corollary. Let X be a real topological vector space, A a non-empty convex open subset of X, and $x_{0}\notin A$ . Then there exists a continuous $\lambda \in X^{*}$ such that $\lambda \left(a-x_{0}\right)>0$ for every $a\in A$ .

Generalizations

The above separation theorems may be generalized to the following theorems:[4]

Theorem. Let $A$ and $B$ be non-empty convex subsets of a real topological vector space X.

If $\operatorname {Int} \left(A-B\right)\neq \emptyset$ then:

0\notin \operatorname {Int} \left(A-B\right)

if and only if there exists some continuous

\lambda \in X^{*}

such that

\operatorname {sup} \lambda (A)\leq \operatorname {inf} \lambda (B)

and

\lambda \neq 0

.

If X is locally convex then:

\,0\notin \operatorname {Cl} \left(A-B\right)\,

if and only if there exists some continuous

\lambda \in X^{*}

such that

\operatorname {sup} \lambda (A)<\operatorname {inf} \lambda (B)

. (Such a

\lambda

will necessarily be non-

0

).

Geometric Hahn–Banach theorem

One form of Hahn–Banach theorem is known as the Geometric Hahn–Banach theorem, or Mazur's theorem.[7]

Theorem. Let $K$ be a convex set having a nonempty interior in a real normed linear vector space $X$ . Suppose $V$ is a linear variety in $X$ containing no interior points of $K$ . Then there is a closed hyperplane in $X$ containing $V$ but containing no interior points of $K$ ; i.e., there is an element $x * \in X *$ and a constant $c$ such that $\langle v,x^{*}\rangle =c$ for all $v \in V$ and $\langle k,x^{*}\rangle <c$ for all $k \in int (K)$ .

This can be generalized to an arbitrary topological vector space, which need not be locally convex or even Hausdorff, as:[8]

Theorem. Let $M$ be a vector subspace of the topological vector space $X$ . Suppose $K$ is a non-empty convex open subset of $X$ with $K \cap M = \emptyset$ . Then there is a closed hyperplane $N$ in $X$ containing $M$ with $K \cap N = \emptyset$ .

Relation to axiom of choice

As mentioned earlier, the axiom of choice implies the Hahn–Banach theorem. The converse is not true. One way to see that is by noting that the ultrafilter lemma (or equivalently, the Boolean prime ideal theorem), which is strictly weaker than the axiom of choice, can be used to show the Hahn–Banach theorem, although the converse is not the case.

The Hahn–Banach theorem is equivalent to the following:[9]

(∗): On every Boolean algebra

B

there exists a "probability charge", that is: a nonconstant finitely additive map from

B

into

[0, 1]

.

(The Boolean prime ideal theorem is easily seen to be equivalent to the statement that there are always nonconstant probability charges which take only the values 0 and 1.)

In Zermelo–Fraenkel set theory, one can show that the Hahn–Banach theorem is enough to derive the existence of a non-Lebesgue measurable set.[10] Moreover, the Hahn–Banach theorem implies the Banach–Tarski paradox.[11]

For separable Banach spaces, D. K. Brown and S. G. Simpson proved that the Hahn–Banach theorem follows from WKL₀, a weak subsystem of second-order arithmetic that takes a form of Kőnig's lemma restricted to binary trees as an axiom. In fact, they prove that under a weak set of assumptions, the two are equivalent, an example of reverse mathematics.[12][13]

Consequences

Topological vector spaces

If $X$ is a topological vector space, not necessarily Hausdorff or locally convex, then there exists a non-zero continuous linear form if and only if $X$ contains a nonempty, proper, convex, open set $U$ .[14] So if the continuous dual space of $X, X *$ , is non-trivial then by considering $X$ with the weak topology induced by $X *, X$ becomes a locally convex topological vector space with a non-trivial topology that is weaker than original topology on $X$ . If in addition, $X *$ separates points on $X$ (which means that for each $x \in X$ there is a linear functional in $X *$ that's non-zero on $x$ ) then $X$ with this weak topology becomes Hausdorff. This sometimes allows some results from locally convex topological vector spaces to be applied to non-Hausdorff and non-locally convex spaces.

The dual space $C [a, b]*$

We have the following consequence of the Hahn–Banach theorem.

Proposition. Let $-\infty < a < b < \infty$ . Then, $F \in C [a, b]*$ if and only if there exists a (complex) measure $ρ : [a, b] \to R$ of bounded variation such that

F(u)=\int _{a}^{b}u(x)d\rho (x),

for all $u \in C [a, b]$ . In addition, $| F | = V (ρ)$ , where $V (ρ)$ denotes the total variation of $ρ$ .

Partial differential equations

The Hahn–Banach theorem is often useful when one wishes to apply the method of a priori estimates. Suppose that we wish to solve the linear differential equation $Pu=f$ for $u$ , with $f$ given in some Banach space $X$ . If we have control on the size of $u$ in terms of $||F||_{X}$ and we can think of $u$ as a bounded linear functional on some suitable space of test functions $g$ , then we can view $f$ as a linear functional by adjunction: $(f,g)=(u,P^{*}g)$ . At first, this functional is only defined on the image of $P$ , but using the Hahn–Banach theorem, we can try to extend it to the entire codomain $X$ . We can then reasonably view this functional as a weak solution to the equation.

Notes

O'Connor, John J.; Robertson, Edmund F., "Hahn–Banach theorem", MacTutor History of Mathematics archive, University of St Andrews.
See M. Riesz extension theorem. According to Gȧrding, L. (1970). "Marcel Riesz in memoriam". Acta Math. 124 (1): I–XI. doi:10.1007/bf02394565. MR 0256837.CS1 maint: ref=harv (link), the argument was known to Riesz already in 1918.
HAHNBAN file
Zălinescu, C. (2002). Convex analysis in general vector spaces. River Edge, NJ: World Scientific Publishing Co., Inc. pp. 5–7. ISBN 981-238-067-1. MR 1921556.
Gabriel Nagy, Real Analysis lecture notes
Harvey, R.; Lawson, H. B. (1983). "An intrinsic characterisation of Kähler manifolds". Invent. Math. 74 (2): 169–198. doi:10.1007/BF01394312.CS1 maint: ref=harv (link)
Luenberger, David G. (1969). Optimization by Vector Space Methods. New York: John Wiley & Sons. pp. 131–134. ISBN 978-0-471-18117-0.
Treves, p. 184
Schechter, Eric. Handbook of Analysis and its Foundations. p. 620.
Foreman, M.; Wehrung, F. (1991). "The Hahn–Banach theorem implies the existence of a non-Lebesgue measurable set" (PDF). Fundamenta Mathematicae. 138: 13–19.CS1 maint: ref=harv (link)
Pawlikowski, Janusz (1991). "The Hahn–Banach theorem implies the Banach–Tarski paradox". Fundamenta Mathematicae. 138: 21–22.
Brown, D. K.; Simpson, S. G. (1986). "Which set existence axioms are needed to prove the separable Hahn–Banach theorem?". Annals of Pure and Applied Logic. 31: 123–144. doi:10.1016/0168-0072(86)90066-7.CS1 maint: ref=harv (link) Source of citation.
Simpson, Stephen G. (2009), Subsystems of second order arithmetic, Perspectives in Logic (2nd ed.), Cambridge University Press, ISBN 978-0-521-88439-6, MR 2517689
Schaefer 1999, p. 47

References

Hazewinkel, Michiel, ed. (2001) [1994], "Hahn–Banach theorem", Encyclopedia of Mathematics, Springer Science+Business Media B.V. / Kluwer Academic Publishers, ISBN 978-1-55608-010-4
Narici, Lawrence; Beckenstein, Edward (1997). "The Hahn–Banach Theorem: The Life and Times". Topology and its Applications. 77 (2): 193–211. doi:10.1016/s0166-8641(96)00142-3.
Schmitt, Lothar M (1992). "An Equivariant Version of the Hahn–Banach Theorem". Houston J. Of Math. 18: 429–447.
Michael Reed and Barry Simon, Methods of Modern Mathematical Physics, Vol. 1, Functional Analysis, Section III.3. Academic Press, San Diego, 1980. ISBN 0-12-585050-6.
Eric Schechter, Handbook of Analysis and Its Foundations, Chapter 12, Academic Press, 1996. ISBN 0-12-622760-8.
Rudin, Walter (1991). Functional analysis. McGraw-Hill Science/Engineering/Math. ISBN 978-0-07-054236-5.CS1 maint: ref=harv (link)
Terence Tao, The Hahn–Banach theorem, Menger’s theorem, and Helly’s theorem
Trèves, François (1995). Topological Vector Spaces, Distributions and Kernels. Dover Publications. pp. 136–149, 195–201, 240–252, 335–390, 420–433. ISBN 9780486453521.
Gerd Wittstock, Ein operatorwertiger Hahn-Banach Satz, J. of Functional Analysis 40 (1981), 127–150
Eberhard Zeidler, Applied Functional Analysis: main principles and their applications, Springer, 1995.

This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.

[1] O'Connor, John J.; Robertson, Edmund F., "Hahn–Banach theorem", MacTutor History of Mathematics archive, University of St Andrews.

[2] See M. Riesz extension theorem. According to Gȧrding, L. (1970). "Marcel Riesz in memoriam". Acta Math. 124 (1): I–XI. doi:10.1007/bf02394565. MR 0256837.CS1 maint: ref=harv (link), the argument was known to Riesz already in 1918.

[3] HAHNBAN file

[Zalinescu-4] Zălinescu, C. (2002). Convex analysis in general vector spaces. River Edge, NJ: World Scientific Publishing Co., Inc. pp. 5–7. ISBN 981-238-067-1. MR 1921556.

[5] Gabriel Nagy, Real Analysis lecture notes

[6] Harvey, R.; Lawson, H. B. (1983). "An intrinsic characterisation of Kähler manifolds". Invent. Math. 74 (2): 169–198. doi:10.1007/BF01394312.CS1 maint: ref=harv (link)

[7] Luenberger, David G. (1969). Optimization by Vector Space Methods. New York: John Wiley & Sons. pp. 131–134. ISBN 978-0-471-18117-0.

[8] Treves, p. 184

[9] Schechter, Eric. Handbook of Analysis and its Foundations. p. 620.

[10] Foreman, M.; Wehrung, F. (1991). "The Hahn–Banach theorem implies the existence of a non-Lebesgue measurable set" (PDF). Fundamenta Mathematicae. 138: 13–19.CS1 maint: ref=harv (link)

[11] Pawlikowski, Janusz (1991). "The Hahn–Banach theorem implies the Banach–Tarski paradox". Fundamenta Mathematicae. 138: 21–22.

[12] Brown, D. K.; Simpson, S. G. (1986). "Which set existence axioms are needed to prove the separable Hahn–Banach theorem?". Annals of Pure and Applied Logic. 31: 123–144. doi:10.1016/0168-0072(86)90066-7.CS1 maint: ref=harv (link) Source of citation.

[13] Simpson, Stephen G. (2009), Subsystems of second order arithmetic, Perspectives in Logic (2nd ed.), Cambridge University Press, ISBN 978-0-521-88439-6, MR 2517689

[14] Schaefer 1999, p. 47