Appendix A: Sets, functions, and proofs
A.3Equivalence relations
Much of the book classifies objects up to some notion of sameness: matrices up to row operations (Section 3.2.4), vector spaces up to isomorphism and square matrices up to change of basis (Section 4.5), vectors up to an element of a subspace (Section 4.6). Each notion is an equivalence relation, and each one cuts its set into classes. This section sets up the general language: equivalence classes, quotient sets, functions on quotient sets, and invariants.
A.3.1Equivalence relations
Definition A.3.1 (Equivalence relation). A relation on a set is a subset ; we write for . A relation is an equivalence relation if it is
- reflexive: for every ;
- symmetric: if , then ;
- transitive: if and , then .
- (a)Equality on any set.
- (b)Let . Congruence modulo on : if divides . It is reflexive since , symmetric since implies , and transitive since
. - (c)Any function defines the relation if . It inherits the three properties from equality in . For instance, “ if ” is an equivalence relation on .
- (d)Row equivalence of matrices (Proposition 3.2.22), similarity of square matrices (Proposition 4.5.24), isomorphism of vector spaces (Proposition 4.5.4), and congruence modulo a subspace , (Remark 4.6.16).
Each axiom can fail on its own, and the failures of transitivity are the instructive ones.
- (a) on is reflexive and transitive but not symmetric.
- (b)On a vector space , let if one of is a scalar multiple of the other. This is reflexive and symmetric, but not transitive when : for independent we have and , since , but not . On , the relation becomes “ for some ”, which is an equivalence relation (Exercise A.3.16).
- (c)On , let if . This is reflexive and symmetric, but every commutes with , so transitivity would make all matrices commute, which fails for (Example 2.1.19).
- (d)On , let if . Then but not . “Close to” is rarely transitive.
A.3.2Classes and partitions
Definition A.3.4 (Equivalence class). Let be an equivalence relation on . The equivalence class of is
Any element of is called a representative of the class.
For congruence modulo , the class of is
- (i);
- (ii);
- (iii).
Uses. Definition A.3.1 (Equivalence relation), Definition A.3.4 (Equivalence class)
Techniques. Proving TFAE (Technique 2.7.1), Double containment (Technique 1.3.14)
(i) (ii). Suppose . If , then , so by transitivity, and . Thus . By symmetry , and the same argument gives .
(ii) (iii). By reflexivity , so .
(iii) (i). Let , so and . By symmetry , and by transitivity . □
Theorem A.3.7 (Equivalence relations are partitions). Let be a set.
- (a)If is an equivalence relation on , its equivalence classes form a partition of .
- (b)If is a partition of , the relation “ if and lie in the same block” is an equivalence relation, and its classes are the blocks of .
- (c)These two constructions are inverse to each other. So equivalence relations on correspond bijectively to partitions of .
Uses. Lemma A.3.5 (Equal classes), Definition A.3.6 (Partition), Definition A.3.1 (Equivalence relation)
(a) Each class is nonempty, since by reflexivity, so every element lies in at least one class. If and , then , so by Lemma A.3.5. So lies in exactly one class.
(b) Let denote the block containing . Then means , and this is an equivalence relation by Example A.3.2(c), applied to the function . The class of is
(c) Start with , form the partition into classes, and let be “in the same class”. Then means that the class containing , which is , is the class containing , which is . By Lemma A.3.5 this happens if and only if , so is . In the other order, starting with a partition, (b) says that the classes of the relation are the blocks, so we recover the partition. □
For congruence modulo a subspace, (a) is Corollary 4.6.15. In practice, the theorem is used to define a partition by giving a relation, which is easier to check: three axioms instead of “exactly one block”.
A.3.3Quotient sets and well-defined functions
Definition A.3.8 (Quotient set). Let be an equivalence relation on . The quotient set is the set of equivalence classes, and the quotient map is
The quotient map is surjective, and if and only if (Lemma A.3.5), so passing to the quotient set turns into equality. That is the purpose of the construction: in , equivalent elements have become equal. The quotient space of Definition 4.6.20 is the quotient set for congruence modulo , with a vector space structure added.
Example A.3.9 ( as a quotient set). Let , and let be congruence modulo . By Proposition A.2.4, each is congruent to exactly one , namely . So each class contains exactly one of , and
with these classes distinct. In Definition 1.1.19, was defined as the set of remainders; we identify the remainder with its class . Under this identification, Lemma 1.1.21(a) says that and . These formulas define operations on classes, because the right side does not depend on the representatives: if and , then divides and
The last sentence is the general issue with quotient sets. A function on is usually given by a formula in a representative, and the formula must not depend on which representative is used (Technique 4.6.18). The theorem below says exactly when such a formula defines a function, and what properties the function then has.
Theorem A.3.10 (Functions on a quotient set). Let be an equivalence relation on with quotient map , and let .
- (a)There is a function with if and only if is constant on classes: implies . In that case is unique, and .
- (b)Such a is injective if and only if implies .
- (c)Such a is surjective if and only if is surjective.
Uses. Definition A.3.8 (Quotient set), Lemma A.3.5 (Equal classes), Definition A.1.2 (Function)
Techniques. Check that a definition does not depend on the representative (Technique 4.6.18), Uniqueness via two candidates (Technique 1.1.8)
(a) Suppose . Then for every , which determines , since every class is for some . And if , then by Lemma A.3.5, so
Conversely, suppose is constant on classes. For a class , all satisfy for a fixed , so takes the single value on . Setting equal to this value defines a function , and because .
(b) is injective if and only if
(c) Since is surjective, the values of are exactly the values , so . □
Taking to be gives a factorization of every function.
Corollary A.3.11 (Factoring a function). Let , and let be the relation . Then is a well-defined bijection . So is the composite
of a surjection, a bijection, and the injective inclusion .
Uses. Theorem A.3.10 (Functions on a quotient set)
For a linear map , if and only if , so is congruence modulo and is the quotient space . The corollary then says that is a bijection , and the first isomorphism theorem (Theorem 4.6.34) adds that it is linear.
A.3.4Invariants and normal forms
To classify objects up to is to describe the quotient set : decide when two given objects are equivalent, and list one object from each class.
Definition A.3.12 (Invariant, normal form). Let be an equivalence relation on .
- An invariant of is a function that is constant on classes: implies .
- An invariant is complete if moreover implies .
- A set of normal forms for is a subset that contains exactly one element of each class.
By Theorem A.3.10, an invariant is a function on , and a complete invariant is an injective one, so it identifies with the set of its values. A set of normal forms is mapped bijectively onto by , and “the normal form of ” is a complete invariant with values in . The classification results of the book all have this shape:
- For row equivalence on , the RREF is a complete invariant, and the matrices in RREF are normal forms (Corollary 3.3.18). So is the kernel (Corollary 3.3.20).
- For isomorphism of finite-dimensional vector spaces, the dimension is a complete invariant (Theorem 4.5.6), and are normal forms.
- For the relation with , invertible, the rank is a complete invariant, with normal forms (Theorem 3.5.27).
- For similarity, rank, trace, and determinant are invariants (Proposition 4.5.27, Proposition 5.4.17), but even all of them together are not complete: and share them and are not similar. Over , the Jordan form, with a fixed ordering of the blocks, provides normal forms (Section 10.3).
- For congruence modulo , the remainder is a complete invariant, with normal forms (Example A.3.9).
Technique A.3.13 (Classify by a complete invariant). To decide when two objects are equivalent, find a quantity that equivalent objects share (an invariant), and then prove that it is complete. To prove that and are not equivalent, one invariant on which they differ is enough (Technique 4.5.29). To prove that they are equivalent, completeness is needed, and it is usually proved by reducing every object to a normal form that depends only on the invariant: if both and are equivalent to the same normal form, they are equivalent to each other by symmetry and transitivity.
Reach for it whenever a question asks “when are these the same up to ?” or “how many essentially different are there?”. The canonical example is Theorem 3.5.27, where row and column operations reduce every matrix to with the rank.
Used in 1 practice exercise
Exercises
Exercise A.3.14. Decide which of the following are equivalence relations. For those that are, describe the classes.
- (a)On : if .
- (b)On : if .
- (c)On : if .
- (d)On , for a vector space : if .
- (e)On , for a set with at least two elements: if .
Uses. Definition A.3.1 (Equivalence relation), Example A.3.2 (Equivalence relations)
Techniques. Finding counterexamples and minimal examples (Technique 1.4.18)
(a) Yes. ; if , then ; and
(b) No: , so fails. (On it is an equivalence relation, “same sign”, with two classes.)
(c) Yes: it is for . The classes are the sets of matrices of rank for
(d) Yes: it is for . The class of is
(e) No: , so fails. Transitivity fails too: for distinct , and , but .
Uses. Theorem A.3.7 (Equivalence relations are partitions)
By Theorem A.3.7, equivalence relations on correspond to partitions of , so we count partitions by their block sizes.
For : one partition with a single block; three of type (choose the singleton); one into three singletons. Total .
For : one of type ; four of type (choose the singleton); three of type (the block containing is for ); six of type (choose the pair, ); one into singletons. Total .
Exercise A.3.16. Let be a field and . On , let if for some nonzero .
- (a)Show that is an equivalence relation, and describe its classes in terms of one-dimensional subspaces of .
- (b)If has elements, show that the quotient set has
elements.
Uses. Definition A.3.1 (Equivalence relation), Theorem A.3.7 (Equivalence relations are partitions), Exercise A.1.28, Proposition 1.2.35 (Zero products)
(a) Reflexivity: . Symmetry: if with , then . Transitivity: if and , then with . The class of is
(b) For , the map , , is surjective by definition and injective since gives , so . So every class has elements. The set has elements (Exercise A.1.28), and by Theorem A.3.7 it is the disjoint union of the classes. If there are classes, then , so
Uses. Definition A.3.1 (Equivalence relation)
Techniques. Finding counterexamples and minimal examples (Technique 1.4.18)
(a) True. lies in and in . If , then and . If
(b) False. On , let be congruence modulo and congruence modulo . Then and , so both lie in , but is divisible by neither nor , so . Transitivity fails. ( is still reflexive and symmetric.)
Exercise A.3.18. Find the error in the following argument.
Claim: A relation that is symmetric and transitive is reflexive. Proof: Let and pick with . By symmetry , and by transitivity, and give .
Uses. Definition A.3.1 (Equivalence relation)
Techniques. Finding counterexamples and minimal examples (Technique 1.4.18)
Uses. Theorem A.3.10 (Functions on a quotient set), Example A.3.9 ( as a quotient set)
Techniques. Check that a definition does not depend on the representative (Technique 4.6.18)
Let , . By Theorem A.3.10(a), the formula defines a function with if and only if is constant on classes mod , that is, if and only if implies for all .
If and , then . Conversely, if the implication holds, apply it to and : since , we get .
Suppose . Since is surjective, so is (Theorem A.3.10(c)). By Example A.3.9, has elements and has , so if is bijective, then (Corollary A.1.18). Conversely, for , is the identity. For example, reduction mod is a well-defined function , but “reduction mod ” is not: while .
Exercise A.3.20. Let be any relation on . Define if there is a finite sequence
- (a)Show that is an equivalence relation containing , and that it is contained in every equivalence relation that contains . It is the equivalence relation generated by .
- (b)Let be the relation on given by “ is obtained from by one elementary row operation”. Show that the equivalence relation generated by is row equivalence (Definition 3.2.21).
Uses. Definition A.3.1 (Equivalence relation), Definition 3.2.21 (Row equivalence), Proposition 3.2.10 (Inverses of elementary matrices)
Techniques. Double containment (Technique 1.3.14)
(a) Reflexivity: the chain with . Symmetry: a chain from to , read backwards, is a chain from to , since the condition on consecutive pairs is symmetric. Transitivity: a chain from to followed by one from to is a chain from to . If , then is a chain with , so .
Now let be an equivalence relation with , and let be a chain. We show by induction on . For this is reflexivity. If , then gives , and gives , hence by symmetry. Either way by transitivity. So implies .
(b) Row equivalence is an equivalence relation (Proposition 3.2.22) and contains , so by (a) it contains the generated relation . Conversely, if with elementary, then
More practice
The practice bank has 3 exercises on this section’s topics.