
Course Introduction
This course is based primarily on John B. Conway’s “A Course in Operator Theory” book. The goal is to develop a rigorous foundation suitable for graduate-level pure mathematics, while presenting the material in a way that remains meaningful to students in the applied sciences.
Operator Theory sits naturally at the intersection of analysis, physics, and modern machine learning. While such applications will not be assumed or developed initially, the theory presented here is the mathematical framework on which many contemporary results are built (for further reading, see the footnotes).
Again, this is so you understand there exist many applications of this theory, and I will make no assumptions that you initially understand what a -Algebra is or Banach algebra, or even an algebra is for that matter. Instead, I will tailor my explanations, assuming a strong background in Calculus and Linear Algebra, and some understanding of Topology.
What is an Operator?
Operators are a broad concept in mathematical literature, and are often associated with functions that map elements from one space to another. However in this course, an operator will always mean a linear operator acting between topological vector spaces.
Recall, for any two vector spaces and
over the field
, an operator
is linear, provided it satisfies
for and
.
Example 1.
A trivial example of this would be any square matrix , operating on vectors in
. Namely we construct the mapping
, defined by
For all . The linearity of
is often shown in a standard Linear Algebra course. Yet this example should be viewed as a finite-dimensional prototype of a much broader theory. Now lets provide another example of linear operators.
Example 2.
Let be the set of square-integrable functions on the interval
. Namely for any complex-valued, measurable function
, it is necessarily the case
Then for some , we introduce the Volterra operator
, defined by
which takes for any
. This is clearly linear, since
This example was purposefully chosen, since historically functional analysis was crafted by the Italian mathematician and physicist, Vito Volterra, who, in his work dealing with integral equations, began to interpret functions as vectors defined on infinite-dimensional vector spaces.
Inner Products
Although you likely learned about inner products from Linear Algebra, we will revisit them briefly. Particularly in , the inner products is shown:
to which your professor moved on to prove how this product induces a norm, or can be used for interpreting angular relationships between vectors. Another example is often provided:
for any two functions where
is the space of continuous complex-valued functions. This example induces an inner product whose completion is the space of square-integrable functions in
. However when done correctly, the student shouldn’t miss the underlying connection here. The inner product
is described in
, which is a finite-dimensional vector space, but
is what we consider once we ask about the corresponding inner product in an uncountably infinite number of dimensions. That is because the integral can be seen as an infinite dimensional analogue of the sum.
So now that we understand one can view the space of continuous functions as an infinite dimensional vector space, we should ask about operators over these spaces. Linear algebra commonly treats operators over spaces of finite dimension (commonly referred to as matrices), but what we discussed implies linear algebra needs more generality. This is exactly the study of operator theory.
Click here for part II: On the Hierarchy of Topological Spaces
Further reading:
- Works by Yuka Hashimoto et al:
- “C*-Algebra Net: A Novel Approach to Generalizing Neural Network Parameters using C*-Algebra.”
- “Koopman-based Generalization Bound: A New Perspective for Full-rank Weights”
- “C*-Algebraic Machine Learning: Moving in a New Direction”
- “Why High-rank Neural Networks Generalize?: An Algebraic Framework with RKHS”
- Works by Ansers C. Hansen: