Appendix A: Sets, functions, and proofs
A.1Sets and functions
This appendix collects the set-theoretic language that the book uses without comment: functions and their inverses, finite sets, induction, equivalence relations, and Zorn’s lemma. The main text cites the results here where they are needed. Several of them have linear counterparts in the main text (one-sided inverses of linear maps in Section 2.5, injectivity and surjectivity in Section 2.6, quotient spaces in Section 4.6), and comparing the two versions shows which parts of a linear-algebra argument are really about linearity.
A.1.1Sets
Notation A.1.1 (Sets). We write when is an element of the set , and when every element of is an element of . Two sets are equal when they have the same elements, so means and (Technique 1.3.14). For subsets ,
The empty set is , and and are disjoint if . The power set is the set of all subsets of . The Cartesian product is the set of ordered pairs with and , and is the set of -tuples of elements of . For an integer , we write , so that . Finally, includes .
A.1.2Functions, images, and preimages
Formally, is its graph
Definition A.1.3 (Image and preimage). Let . For , the image of under is
and the image of is . For , the preimage of under is
For we write for , the set of preimages of , and call it the fiber of over .
The notation reads “the image of restricted to ”, which is what it is. The notation does not presuppose that has an inverse: every function has preimages, and a fiber can be empty or have many elements. In this language, Definition 2.6.1, Definition 2.6.2 and Definition 2.6.3 say that is injective, surjective, or bijective when every fiber has at most one, at least one, or exactly one element. For a linear map , the kernel is the fiber , and the solution set of is the fiber .
The example shows the general pattern. Preimages respect all the set operations, images respect unions but not intersections, and the two operations undo each other exactly when is injective (in one order) or surjective (in the other).
Proposition A.1.5 (Images and preimages). Let , let , and let .
- (a)
, , and . - (b)
and , with equality if is injective. - (c)
, with equality if is injective. - (d)
. In particular , with equality if is surjective.
Uses. Definition A.1.3 (Image and preimage), Definition 2.6.1 (Injective), Definition 2.6.2 (Surjective)
Techniques. Double containment (Technique 1.3.14), Fix an arbitrary element and chase it (Technique 1.3.13)
(a) For , means , that is, or , that is, or . The same unwinding with “and” proves the second equality. For the third, means , that is, .
(b) An element of is with or , so it lies in or in ; conversely, and are both contained in . If , then lies in both images, which proves the containment. Now suppose is injective and
(c) If , then , so
(d) An element of is with , so it lies in . Conversely, if , write ; then and
The hypotheses in (b), (c), and (d) cannot be dropped. For , the sets and are disjoint, so , while
A.1.3Composition and inverses
Composition is defined only when the codomain of is the domain of , and it is read right to left: applies first. Even when both and are defined, they are usually different (Example 2.1.19 shows this for linear maps).
Uses. Definition A.1.6 (Composition), Definition A.1.2 (Function)
Both sides are functions . For ,
Similarly
So we may write without parentheses. The next proposition is used constantly, and its last two parts are easy to get backwards. If is injective, the function applied first must be injective, since a collision would survive into
Proposition A.1.8 (Composites, injectivity, and surjectivity). Let and .
- (a)If and are injective, so is . If and are surjective, so is .
- (b)If is injective, then is injective.
- (c)If is surjective, then is surjective.
Uses. Definition 2.6.1 (Injective), Definition 2.6.2 (Surjective), Definition A.1.6 (Composition)
(a) Suppose and are injective, and
(b) If , then
(c) Let . Since is surjective, for some , so is a value of . □
These are Definition 2.5.1, Definition 2.5.2 and Definition 2.5.12 without linearity. The definitions in Section 2.5 ask for more: there, a left inverse of a linear map must itself be linear. Remark 2.5.8 explains why that matters for one-sided inverses, and Proposition 2.7.7 shows that it does not matter for two-sided ones.
Example A.1.11 (The successor function). Let , . For any , the function
satisfies for all , so every is a left inverse of . The value at is free because is not a value of . On the other hand, has no right inverse: is impossible for every function , since . Multiplication by on (Example 2.6.4(e)) is the linear version of : it shifts coefficients up by one place.
Theorem A.1.12 (One-sided inverses of functions). Let .
- (a)If has a left inverse, then is injective. Conversely, if is injective and , then has a left inverse.
- (b) has a right inverse if and only if is surjective.
Uses. Definition A.1.9 (One-sided inverses of a function), Definition 2.6.1 (Injective), Definition 2.6.2 (Surjective), Remark A.1.13 (The axiom of choice)
Techniques. Fix an arbitrary element and chase it (Technique 1.3.13)
(a) Suppose , and . Then
Conversely, suppose is injective, and fix some . Each has exactly one preimage, which we call . Define by if and otherwise. For every , is the preimage of , so . Hence .
(b) If , then every equals , so is surjective. Conversely, suppose is surjective. Then every fiber is nonempty, and we let be an element of for each (Remark A.1.13). Then for all , so . □
Remark A.1.13 (The axiom of choice). The last step of the proof chooses an element of every fiber at once. When is finite, these are finitely many choices, and induction on makes the construction precise. In general, the step is an instance of the axiom of choice: for every family of nonempty sets there is a function on with for every . Conversely, the axiom of choice follows from (b): given nonempty sets , the map from the set of pairs to is surjective, and if is a right inverse of it, then the second coordinate of is a choice function. So “every surjection has a right inverse” is the axiom of choice in another form. The left inverses in (a) need no choice, because is forced on and constant elsewhere.
The axiom is part of the standard foundations (ZFC), and we use it freely. Its most useful form for linear algebra is Zorn’s lemma (Section A.4), which shows that every vector space has a basis (Section 15.1).
When is a bijection, neither half of the construction involves a choice, and the one-sided inverses merge.
Theorem A.1.14 (Bijections and inverses). Let .
- (a)If has a left inverse and a right inverse , then . In particular, an inverse of , if it exists, is unique. We denote it .
- (b) is invertible if and only if is bijective. In that case is the unique preimage of , and is bijective with .
- (c)If and are bijective, then so is , and
.
Uses. Proposition A.1.7 (Associativity and identities), Theorem A.1.12 (One-sided inverses of functions), Proposition A.1.8 (Composites, injectivity, and surjectivity), Definition A.1.10 (Inverse function)
Techniques. Uniqueness via two candidates (Technique 1.1.8)
(a) By Proposition A.1.7,
If and are both inverses of , then is a left inverse and is a right inverse, so .
(b) If is invertible, it has a left and a right inverse, so it is injective and surjective by Theorem A.1.12. Conversely, if is bijective, every has exactly one preimage . Let . Then , and because is the preimage of . So is an inverse of , and by (a) it is the only one. Finally, the equations and say that is an inverse of . So is invertible, hence bijective, and by (a).
(c) By Proposition A.1.7,
and similarly
For a bijection and , the preimage of Definition A.1.3 equals the image of under the inverse function, so the two meanings of agree whenever both make sense.
Uses. Theorem A.1.12 (One-sided inverses of functions), Theorem A.1.14 (Bijections and inverses)
Techniques. Finding counterexamples and minimal examples (Technique 1.4.18)
The claim is false. Let , , and . There is exactly one function , the constant function with value , and , so has exactly one left inverse. But , so is not surjective.
The claim becomes true when has at least two elements. A left inverse exists only if is injective (Theorem A.1.12), and it is forced on . If some is not in , changing the value at to any other element of gives a second left inverse. So a unique left inverse forces , and is bijective.
A.1.4Finite sets and counting
A finite set is one whose elements can be listed as without repetition, which is a bijection . That the number does not depend on the listing is a theorem, and the same theorem is behind every counting argument in the book.
Uses. Theorem A.2.1 (Induction, strong induction, and well-ordering), Proposition A.1.8 (Composites, injectivity, and surjectivity)
We use induction on (Theorem A.2.1). For and there is no function at all, since would need a value.
Let , suppose that there is no injection whenever , and suppose for contradiction that is injective with . We first arrange that only can map to . If for some , let swap and and fix everything else. Then is a bijection, so is injective (Proposition A.1.8), and . If , let . In either case, is injective and no has : in the first case because
Corollary A.1.18 (Cardinality is well defined). Let and be finite.
- (a)If there are bijections and , then . So is well defined.
- (b)If there is an injection , then . There is a bijection if and only if .
Uses. Theorem A.1.17 (Pigeonhole principle), Theorem A.1.14 (Bijections and inverses), Proposition A.1.8 (Composites, injectivity, and surjectivity)
Let and be bijections. If is injective, then
(a) Take and : with two bijections and , the argument above gives , and exchanging their roles gives .
(b) The first claim is the argument above. If is a bijection, it is injective, and so is , which gives . Conversely, if , then is a bijection by Theorem A.1.14(c). □
Uses. Corollary A.1.18 (Cardinality is well defined), Theorem A.2.1 (Induction, strong induction, and well-ordering), Definition A.1.16 (Finite set and cardinality)
Let be a bijection and . Then restricts to a bijection , so is finite with once is, and if and only if . So we may assume , and we induct on . If , then .
Let and . By the induction hypothesis, is finite with , and only if . If , then , so is finite with . If , then with . A bijection , extended by , is a bijection , so . Equality holds if and only if , that is, , and since this means . □
For finite sets of the same size, half of bijectivity is free. This is the set-theoretic model for Corollary 4.2.18, where an operator on a finite-dimensional space is injective if and only if it is surjective; there, dimension plays the role of cardinality.
Uses. Proposition A.1.19 (Subsets of finite sets), Corollary A.1.18 (Cardinality is well defined), Theorem A.1.12 (One-sided inverses of functions), Theorem A.1.14 (Bijections and inverses)
Suppose is injective. Then , viewed as a function , is a bijection, so by Corollary A.1.18. Since , Proposition A.1.19 gives , and is surjective.
Suppose is surjective. By Theorem A.1.12(b) it has a right inverse . Since , is a left inverse of , so is injective by Theorem A.1.12(a). As , the first half applied to shows that is bijective. Then
so is bijective by Theorem A.1.14(b). (Here is finite, so the choice of needs no axiom of choice.) □
The successor function on (Example A.1.11) is injective and not surjective, so Theorem A.1.20 fails for infinite sets. It is one way of saying that is infinite.
Technique A.1.21 (Pigeonhole). If a function goes from a finite set to a smaller one, two inputs share a value (Theorem A.1.17). In practice: more than objects in boxes put two objects in one box. The skill is in choosing the boxes, which are often the values of some quantity that can take only values, such as a remainder mod or an element of a finite field or of a finite set of matrices.
Reach for it when a statement claims that some coincidence or repetition must occur, but gives no way to find it. A typical consequence is that a sequence in a finite set repeats, so an invertible operation applied repeatedly eventually returns to the start. The canonical example is Example A.1.22; the cycle decomposition of permutations (Section 5.2) uses the same idea.
Used in 1 place and 1 practice exercise
Example A.1.22 (Powers of a matrix over a finite field). Let be a finite field with elements and invertible. We show that for some with .
The set has elements (Exercise A.1.28). The function from , a set of elements, to is not injective by Theorem A.1.17 (composed with bijections to and ). So for some . Multiplying by gives , and satisfies .
For example, over the matrix has and , much sooner than the bound . Over the conclusion fails: for every .
Exercises
Uses. Definition A.1.3 (Image and preimage), Proposition A.1.5 (Images and preimages)
Write . For , ranges over , so ranges over and
Every value of is at least , so if and only if , that is, . Hence
For , ranges over , so
Uses. Proposition A.1.5 (Images and preimages), Definition 2.6.1 (Injective)
Techniques. Contrapositive (Technique 1.5.4)
If is injective, the equality is Proposition A.1.5(b). We prove the converse by contrapositive. Suppose is not injective, say with . Let and . Then , so , while
So the equality fails for this pair.
Exercise A.1.25. Let and . Prove or disprove each claim.
- (a)If is injective, then is injective.
- (b)If is bijective, then is injective and is surjective.
- (c)If is bijective, then and are bijective.
Uses. Proposition A.1.8 (Composites, injectivity, and surjectivity)
Techniques. Finding counterexamples and minimal examples (Technique 1.4.18)
Let , , , and let be the constant function with value . Then is bijective.
(a) False: in the example, is injective but .
(b) True. If is bijective, it is injective, so is injective by Proposition A.1.8(b), and it is surjective, so is surjective by Proposition A.1.8(c).
(c) False: in the example, is not surjective () and is not injective. By (b), what is true is that is injective and surjective; if moreover are finite, then both are bijective by Theorem A.1.20.
Uses. Definition 2.6.1 (Injective), Definition 2.6.2 (Surjective), Definition A.1.2 (Function)
Techniques. Fix an arbitrary element and chase it (Technique 1.3.13)
Suppose is injective and . For each ,
The analogue: is surjective if and only if, for every set and all , implies . Suppose is surjective and . Each equals for some , so
For matrices, Section 2.5 shows that a left-invertible matrix can be cancelled on the left. For functions, left cancellation is in fact equivalent to having a left inverse when , by Theorem A.1.12(a).
- (a)Let and be finite with and , and let be injective. How many left inverses does have?
- (b)Let be surjective with finite and every fiber finite. Show that has exactly right inverses.
- (c)Find the number of left inverses of , , and the number of right inverses of , for odd and for even.
Uses. Theorem A.1.12 (One-sided inverses of functions), Exercise A.1.28
(a) A function is a left inverse of if and only if for all . Since is injective, this fixes at each of the elements of and says nothing about the elements of , where may take any of the values in . By Exercise A.1.28 there are such .
(b) A function is a right inverse of if and only if for each , that is,
(c) For , and , so there are left inverses: , , and arbitrary. For , the fibers are and , so there are right inverses.
Exercise A.1.28. For sets and , let be the set of all functions .
- (a)Show by induction on that if and are finite, then (with ).
- (b)Construct a bijection , and deduce that .
- (c)Deduce that and for a field with elements.
Uses. Corollary A.1.18 (Cardinality is well defined), Theorem A.1.14 (Bijections and inverses), Remark 1.2.11 (Tuples and matrices are functions)
(a) If , then , and there is exactly one function , so . Let , pick , and let , so (remove from a listing of ). The map
is a bijection, with inverse sending to the function that agrees with on and takes the value at . If and , then : listing and , the pair corresponds to
(b) For , let be its indicator function: if and otherwise. The map has inverse : indeed , and and agree at every . So it is a bijection (Theorem A.1.14), and
(c) An element of is a function , and an element of is a function (Remark 1.2.11). So and by (a), using .
Uses. Theorem A.1.17 (Pigeonhole principle), Definition 1.1.19 (Integers modulo )
Techniques. Pigeonhole (Technique A.1.21)
Let and for . The function
The bound is sharp: for , which has only terms, every block sum lies between and .
Uses. Definition 2.6.2 (Surjective)
Techniques. Extremal choice and minimal counterexamples (Technique 1.5.9)
Let and
The set is built to disagree with about the single element . The same diagonal idea shows that the real numbers cannot be listed as a sequence.
More practice
The practice bank has 5 exercises on this section’s topics.