Chapter 2: Linear maps and matrices
Problems for Chapter 2
These problems combine the sections of Chapter 2 with each other, and several combine them with Chapters 1 and 3. The first three are review prompts: state a main result, prove it without looking, and then answer a question that the text did not ask. The rest are ordered roughly by difficulty. Problems of kind “competition” are harder than anything the course expects. Some problems multiply polynomials, which Section 7.1 develops; each of them says what may be used. Section 2.8 compares the techniques these problems call for.
Review: state and prove
- (a)State Theorem 2.6.11 and Proposition 2.6.14.
- (b)Prove both.
- (c)The proof of the theorem uses only part of linearity. Show that its statement holds for every additive map , with
as before. Then show that it fails for homogeneous maps: find a function with for all and , such that only for , but is not injective.
Uses. Definition 2.6.1 (Injective), Definition 2.6.5 (Kernel), Proposition 2.1.4 (Linear maps preserve and negatives), Theorem 1.5.5 (Independence is decided at zero), Proposition 1.5.15 (Short lists, zeros, and repeats), Definition 2.1.1 (Linear map)
Techniques. Test injectivity at (Technique 2.6.12), Fix an arbitrary element and chase it (Technique 1.3.13)
(a) Theorem 2.6.11: a linear map is injective if and only if . Proposition 2.6.14: is injective if and only if sends every linearly independent list in to a linearly independent list
(b) The theorem. Suppose is injective, and let . Then by Proposition 2.1.4, so . Conversely, suppose , and let . By Proposition 2.1.4,
The proposition. Suppose is injective, let be independent, and let
(c) Additive maps. The proof of the theorem used two facts: , and
Homogeneous maps. Define by and for . The only scalars are and , and
- (a)State Theorem 2.4.2(a).
- (b)Prove it from the definitions, and deduce from it, without computing any entry, that for all matrices of compatible sizes.
- (c)Let and be bases of of the same length . Show that
holds for every if and only if .
Uses. Definition 2.3.1 (Matrix of a linear map), Theorem 2.3.9 (The matrix of a map computes the map), Definition 2.4.1 (Matrix product), Proposition 2.3.16 (The matrix of ), Proposition 2.1.24 (Algebra of composition), Example 2.5.21 (Change of coordinates is invertible), Exercise 2.5.32, Exercise 2.3.26
Techniques. Translate between maps and matrices (Technique 2.3.27)
(a) Let , , have bases , , and . For and ,
(b) By Definition 2.3.1, column of is . By Theorem 2.3.9, applied to at the vector , this is , and is column of . By Definition 2.4.1, times column of is column of . The two matrices have the same columns.
Associativity. Let , , , and use standard bases throughout, so that for every matrix (Proposition 2.3.16). Applying (a) twice,
Composition of functions is associative (Proposition 2.1.24(a)), so
(c) If , then (a) with and all three bases equal to gives
Conversely, suppose the identity holds for every , and take . With it reads
In the product , the right factor produces -coordinates and the left factor expects -coordinates. Part (c) says that this mismatch is harmless only when the two bases coincide.
- (a)State Theorem 2.7.4.
- (b)Prove (II) (V). Explain why the construction chooses solutions of only for , and not for every separately.
- (c)Let be a prime, and let with surjective. Show that has exactly right inverses. Check the count against Exercise 2.5.36(c).
Uses. Theorem 2.7.4 (Second Fundamental Theorem), Theorem 2.2.1 (Linear maps are determined by a basis), Proposition 2.4.8 (Four views of the product), Theorem 2.4.2 (The matrix of a composite), Non-example 2.7.10 (Choices that are not linear), Corollary 2.6.31 (Fibers are translates of the kernel), Exercise 2.6.44
Techniques. Construct a map by choosing it on a basis (Technique 2.2.4), Check it on a basis (Technique 2.2.7)
(a) Theorem 2.7.4: for the following are equivalent. (I) is surjective. (II) For every , has at least one solution. (III) The columns of span . (IV) . (V) has a right inverse, a linear map with .
(b) Assume (II). For choose with , and let have columns . By the column view (Proposition 2.4.8(b)), column of is , so . By Theorem 2.4.2(b),
The choices are made on a basis because only there do they automatically fit together. A choice of one solution for each separately is a function , but usually not a linear one (Non-example 2.7.10(b)). Once are chosen, the extension sends to , which is a solution of by linearity: no further choice is made.
(c) By the column view, satisfies if and only if its columns satisfy for . The solutions of form the fiber , which is nonempty since is surjective, and is a translate of (Corollary 2.6.31(b)); so it has elements. By Exercise 2.6.44(a),
so . The columns are chosen independently, so there are
In Exercise 2.5.36(c), is surjective for the matrix there, and it has right inverses; the formula gives . A square surjective has exactly one right inverse, as it must (Theorem 3.5.23).
Synthesis problems
Problem 2.4. For let
- (a)Show that is linear, that
, and that . - (b)Show that
. Compute , and for . - (c)Show that every linear map is a sum of maps of the form , and write in this form.
Uses. Proposition 2.4.14 (Algebra of matrices), Proposition 2.4.23 (Transpose of a product), Proposition 2.4.22 (Transpose is a linear involution), Lemma 2.4.24 (Matrix units), Definition 2.3.1 (Matrix of a linear map), Proposition 2.4.12 (Matrices of sums and scalar multiples), Proposition 2.4.27 (The trace is linear), Exercise 2.2.34
Techniques. Compute entry by entry (Technique 2.4.15), Check it on a basis (Technique 2.2.7)
(a) is linear by Proposition 2.4.14(c) and (d). For every , associativity gives
and by Proposition 2.4.23 and Proposition 2.4.22,
(b) By Lemma 2.4.24(a), the coordinates of a matrix with respect to are its entries. So the diagonal entry of in the position of is the entry of , whatever order is listed in, and is the sum of these entries over all . For , by Lemma 2.4.24(b),
and
For , , whose entry is . So
For
(c) For all indices, associativity and Lemma 2.4.24(b) give
So sends to and every other matrix unit to . These are the maps of Exercise 2.2.34 for with the basis on both sides: as runs over all quadruples, the pair runs over all pairs of matrix units exactly once. By that exercise they form a basis of . Every is therefore a combination
The transpose sends to , so it is the sum of the maps with and :
Directly,
Problem 2.5. For , let be the substitution
(a)Let and . Show that on ,
In particular
, Taylor’s formula. - (b)Deduce that is invertible on , and find its inverse as a combination of powers of .
- (c)Let be a prime and . Show that
on when , but that for there are no scalars with on .
Uses. Example 2.1.9 (Maps of polynomials), Corollary 2.2.6 (Agreeing on a spanning list), Proposition 2.1.23 ( is a vector space), Proposition 2.1.17 (Compositions of linear maps are linear), Exercise 2.1.32
Techniques. Check it on a basis (Technique 2.2.7), Guess the inverse, then check both products (Technique 2.5.16)
Throughout, by induction on ,
(a) maps into itself, since has degree , and so does every . Both sides of the claim are linear (Proposition 2.1.23, Proposition 2.1.17), so by Corollary 2.2.6 it suffices to compare them on for . For ,
(b)
(c) The case . For , the scalar is a product of the nonzero elements of , so it is invertible. The integer identity
The case . Suppose
So , and the constant terms give , a contradiction.
Over the derivative cannot see , but the shift moves it. So Taylor’s formula is a statement about fields in which the factorials can be inverted, and it fails exactly when the space contains .
Problem 2.6. Let and be multiplication by and differentiation on . You may use that multiplication of polynomials is associative and commutative and distributes over addition, that
- (a)Show that satisfies if and only if there is with for every , and that then .
- (b)For such , show that is injective if and only if , and surjective if and only if is a nonzero constant.
- (c)Find all that commute with both and , when has characteristic and when .
Uses. Proposition 2.2.20 (Linear maps out of ), Theorem 2.6.11 (Injectivity is decided at ), Example 2.6.27 (Differentiation on ), Exercise 2.1.49
Techniques. Check it on a basis (Technique 2.2.7)
(a) If for all , then and
Multiplication by is linear, by distributivity and , and it agrees with on every monomial. By the uniqueness in Proposition 2.2.20, for all .
(b) If , then , which is not injective. If and , then
If is a nonzero constant, then is surjective. Conversely, if is surjective, then for some . Both and are nonzero, so
(c) By (a), commutes with exactly when it is multiplication by some . For such , the product rule gives
- If has characteristic , consists of the constants, so for some .
- If , consists of the polynomials
, so is multiplication by a polynomial in . For instance commutes with , because .
Problem 2.7. Let , let be distinct, and let
- (a)Show that is a basis of , and that every satisfies
. Deduce that is a basis of . - (b)Let and
, and suppose in . Find the scalars with for every , where . Write the formula over . - (c)Show that over no make the formula of (b) hold for every .
Uses. Proposition 3.4.27 (Lagrange’s formula), Definition 3.4.26 (Lagrange polynomials), Proposition 1.2.18 (Degree and evaluation versus the operations), Example 2.1.9 (Maps of polynomials), Proposition 2.1.23 ( is a vector space), Corollary 2.2.6 (Agreeing on a spanning list)
Techniques. Check it on a basis (Technique 2.2.7)
(a) Basis. Let . By Proposition 3.4.27 with , the polynomial is the unique element of with the values
The formula. Each is linear (Example 2.1.9), so
since only the term survives. By Corollary 2.2.6, . So the evaluations span . If is the zero map, applying it to gives . So is a basis of , and the coefficients of in it are the values .
(b) Since , the points are distinct. The polynomials
have the required values: takes the values
Over , , so and , and the formula reads
(c) Let . Then , , , and , the coefficient of . Any formula
Problem 2.8. A matrix is idempotent if . By Exercise 2.5.46(a), every
- (a)Show that is idempotent if and only if , , or ( and ).
- (b)Let be a prime. Show that exactly matrices in are idempotent.
- (c)Suppose in . Show that is a bijection from the idempotent matrices in onto the matrices with . Compare (b) with Exercise 2.5.46(c).
- (d)Over , count the with , and show that every is invertible, idempotent, or satisfies . Show that this fails over .
Uses. Exercise 2.5.46, Proposition 2.5.28 (Inverse of a matrix), Proposition 2.4.14 (Algebra of matrices)
Techniques. Try small cases and small fields (Technique 1.2.38)
Write and , so that .
(a) Suppose . Then , that is, . If , then
(b) By (a), we count the with and , and add . Fix .
- If , the condition is , which has solutions ( with arbitrary, or with ).
- Otherwise , and has solutions: is any nonzero element and .
The total is
(c) Write . If , then by Proposition 2.4.14
If , then satisfies
(d) Over , , so . If , then . If , then is or , and both have trace , a contradiction. So , and then gives . Conversely, and give . These are the matrices with and : for , ; for , . So there are :
against idempotents. The bijection of (c) fails because for every .
Every has . If , is invertible (Proposition 2.5.28(a)). If , then , which is for and for . Over , has , so it is not invertible (Proposition 2.5.28(b)), and , which is neither nor .
Problem 2.9. Let and . A square matrix is nilpotent if for some .
- (a)Show that
for every . - (b)Deduce that is nilpotent if and only if is, and that implies .
- (c)Find with and . So the exponents in (b) can differ.
- (d)Show that
for every .
Uses. Proposition 2.4.14 (Algebra of matrices), Lemma 2.4.24 (Matrix units), Proposition 2.4.28 (Cyclicity of the trace)
Techniques. Cyclicity of trace (Technique 2.4.29)
(a) For both sides are . If the identity holds for , then by associativity
(b) If , then
(c) Let and , with
(d) For , by Proposition 2.4.28 applied to the product of and , and then (a),
So and cannot be told apart by the traces of their powers, although they may have different sizes and, as (c) shows, different nilpotency exponents.
Problem 2.10. Call nilpotent if for some . You may use the binomial theorem for commuting operators, which has the same proof as for numbers.
- (a)Show that the sum of two commuting nilpotent operators is nilpotent.
- (b)Show that the sum of two nilpotent matrices in can be invertible. Deduce that the nilpotent matrices in do not form a subspace.
- (c)Let be invertible and nilpotent, with . Show that is invertible, and find its inverse.
- (d)Show that (c) can fail if .
Uses. Exercise 2.5.39, Proposition 2.5.17 (Algebra of inverses), Proposition 2.1.24 (Algebra of composition), Lemma 2.4.24 (Matrix units)
Techniques. Guess the inverse, then check both products (Technique 2.5.16), Finding counterexamples and minimal examples (Technique 1.4.18)
(a) Let and , with . By the binomial theorem,
In each term, either , and then , or , and then and . So every term is .
(b) and satisfy by Lemma 2.4.24(c), but
(c) Multiplying by on both sides gives . So and commute, and by induction
(d) Let
In (c) the commutation is what lets the geometric series of Technique 2.5.16 run: without it, is not , and need not be nilpotent at all.
Problem 2.11. Let , and let be invertible with columns . Let have columns , the columns of moved one place to the left with a zero column at the end.
- (a)Find a matrix , not depending on , with .
- (b)Show that and are nilpotent, and that and .
Uses. Proposition 2.4.8 (Four views of the product), Proposition 2.3.13 (Linearity of the product), Proposition 2.4.14 (Algebra of matrices)
(a) Let have columns , so for and . By the column view (Proposition 2.4.8(b)) and Proposition 2.3.13(c), column of is , which is for and for . So .
(b) . By induction on , if , and otherwise. So for every , that is, , while , so .
. By induction,
The problem looks like a statement about , but only changes coordinates: both products are the shift , seen in two different bases.
Problem 2.12. Let , let be a subspace of , and let .
- (a)Suppose that and for all and . Show that or .
- (b)Let , and let be the set of matrices whose columns are zero. Show that for all and , but that for some and .
- (c)Let
be linear and nonzero, with for all . Show that is injective, and give an example with .
Uses. Lemma 2.4.24 (Matrix units), Proposition 1.4.14 (The span is the smallest subspace containing a list), Theorem 1.4.3 (Subspace criterion), Theorem 2.4.34 (Block multiplication), Proposition 2.6.8 (Kernels and images are subspaces), Theorem 2.6.11 (Injectivity is decided at )
Techniques. Compute entry by entry (Technique 2.4.15)
(a) Suppose , and let have an entry . For any , the hypothesis applied twice gives and then . By associativity and Lemma 2.4.24(b),
Since is a subspace,
(b) The matrices of are the with , and they form a subspace (Theorem 1.4.3). For ,
(c) is a subspace of (Proposition 2.6.8). If and , then
For an example, let
Problem 2.13. For write with (the entrywise real and imaginary parts), and let
- (a)Show that
for and , that is -linear, and that . - (b)Regard as a vector space over (Proposition 1.2.19), with the list
. Show that is a basis, that is -linear, and that . - (c)Show that is invertible if and only if is, and that then .
- (d)Show that
for .
Uses. Theorem 2.4.34 (Block multiplication), Proposition 2.4.14 (Algebra of matrices), Proposition 1.2.19 (Restriction of scalars), Definition 2.3.1 (Matrix of a linear map), Proposition 2.5.20 (Inverses and matrices), Theorem 2.7.8 (Third Fundamental Theorem), Definition 2.4.26 (Trace)
Techniques. Block decomposition (Technique 2.4.35), Translate between maps and matrices (Technique 2.3.27)
(a) Let . Matrix multiplication over distributes, and real scalars and pass through products (Proposition 2.4.14), so
with and real. By block multiplication (Theorem 2.4.34),
The real and imaginary parts of and of for real are the sums and real multiples of those of and , so is -linear. Finally , so
(b) Every can be written with in exactly one way (real and imaginary parts), and then
So is a basis of over , and the -coordinates of are . The map is -linear, so in particular -linear. Its matrix has as column the coordinates of
(c) If is invertible, then by (a),
Conversely, suppose is invertible. By (b) and Proposition 2.5.20(b), the -linear map is invertible, so it is a bijection. Bijectivity is a property of the function, not of the field of scalars, so is bijective as a -linear map too, and is invertible by Theorem 2.7.8, (I) (V), and Proposition 2.5.20(c).
(d) The diagonal of consists of the diagonal of twice, so
For ,
Problem 2.14. Prove or disprove each statement.
- (a)If satisfy , , and , then is idempotent.
- (b)If and , then .
- (c)If and for every , then for some .
- (d)If are idempotent, with , then is idempotent.
- (e)If and satisfy and is injective, then is invertible.
Uses. Proposition 2.4.14 (Algebra of matrices), Proposition 2.6.15 (Kernels and images of composites), Example 2.6.4 (Injective, surjective, both, neither), Definition 2.4.26 (Trace), Lemma 2.4.24 (Matrix units), Definition 2.5.12 (Invertible)
Techniques. Finding counterexamples and minimal examples (Technique 1.4.18), Try small cases and small fields (Technique 1.2.38)
(a) True. Write ; then
(b) False. Let and , multiplication by . It is injective (Example 2.6.4(e)), so is injective as well, and . But , while every element of has coefficient at , so . (When has a finite basis the statement is true; it follows from rank–nullity, Section 4.2.)
(c) False. Let be a prime and . Then
(d) False. Let and , padded with zeros to size . By Lemma 2.4.24(c), and , since
whose entry in position is , while that of is . Since in every field, is not idempotent. When , on the other hand,
(e) True. Since is injective, so is (Proposition 2.6.15(c)). Using ,
So for every ,
Problem 2.15. Let be a prime, , and .
- (a)Show that exactly linear maps satisfy .
- (b)Show that exactly of them have , and that each of these is surjective.
- (c)Show that every surjective linear map has a line , , as its kernel. Use (b) and the number of lines in (Problem 1.13) to count the surjective linear maps , and compare with Exercise 2.6.45.
Uses. Corollary 2.2.18 (Linear maps correspond to lists of vectors), Theorem 2.6.11 (Injectivity is decided at ), Proposition 2.1.16 (Linear maps preserve spans and linear relations), Exercise 1.5.43, Exercise 2.6.44, Proposition 1.5.14 (Appending a vector), Problem 1.13, Proposition 1.5.15 (Short lists, zeros, and repeats)
Techniques. Construct a map by choosing it on a basis (Technique 2.2.4), Test injectivity at (Technique 2.6.12)
(a) The list is a basis of : the equation
(b) Let , and write , . For
If is independent, then forces , so , and since . If the pair is dependent, a nontrivial relation gives
For such a , the span of the independent list has elements (Exercise 1.5.43(a)), so it is all of , and
(c) Let be surjective. By Exercise 2.6.44(a),
Conversely, fix a line . By Proposition 1.5.14, appending to the list each standard basis vector that is not in the span of the list so far gives an independent list whose span contains every , hence a basis of . It has exactly vectors, since an independent list of length spans vectors (Exercise 1.5.43(a)). The argument of (a) and (b), with this basis in place of , shows that exactly maps have kernel , and that they are surjective.
So the surjective maps are sorted by their kernels, which are exactly the lines. By Problem 1.13(b), has
in agreement with Exercise 2.6.45, which counted them through their columns instead.
- (a)Let satisfy , and let . Show that .
- (b)Let satisfy . Show that .
- (c)Let be idempotent with . Show that
. Show that this fails over .
Uses. Theorem 3.5.27 (Rank normal form), Theorem 2.4.34 (Block multiplication), Proposition 2.4.28 (Cyclicity of the trace), Proposition 2.4.27 (The trace is linear)
Techniques. Cyclicity of trace (Technique 2.4.29), Block decomposition (Technique 2.4.35)
(a) By Theorem 3.5.27 there are invertible with , so . If , then , so and . Let . Let . Then
and multiplying by on the left and on the right gives . Partition
So . By cyclicity (Proposition 2.4.28), applied to and ,
(When the blocks other than are empty and the same computation applies.)
(b) Let . If , then . Otherwise write and as in (a). Now gives , so , and
(c) Let . By Proposition 2.4.27 and (a),
in , where the are integers; so . Over , take , , and : they are idempotent, their sum is , and their ranks add up to . Part (a) still holds there, but the trace only records .
The trace of an idempotent counts the dimension of the space it projects onto, but only modulo the characteristic. In particular, over an idempotent with trace is , and over , is a nonzero idempotent with trace .
Problem 2.17. Let satisfy .
- (a)Show that
for every . - (b)Show that
can fail: find with and .
Uses. Proposition 2.4.14 (Algebra of matrices), Proposition 2.4.28 (Cyclicity of the trace), Proposition 2.4.27 (The trace is linear), Lemma 2.4.24 (Matrix units)
Techniques. Cyclicity of trace (Technique 2.4.29)
(a) By distributivity (Proposition 2.4.14), is the sum, over all choices of
Consider a product in which both and occur, and read the indices cyclically, so that position is followed by position . Some is followed by a : if every were followed by an , then starting from any position holding and moving forward around the cycle, every position would hold , contradicting the presence of . So there is a with and , where means .
- If , the product contains the adjacent factors , so it is by associativity, and its trace is .
If , then and . By Proposition 2.4.28, applied to and ,
and the product on the right contains . Its trace is .
So
(b) Let and , with
The extra term has trace , as (a) requires. The trace cannot see a cyclic rotation of the factors, and one rotation is all it takes to bring an next to a .
Problem 2.18. A town has residents and clubs. Every club has an odd number of members, and every two different clubs have an even number of members in common.
- (a)Show that .
- (b)Show that is possible for every .
- (c)Suppose instead that every club has an even number of members, and every two different clubs still share an even number. Show that there can be more than clubs: find nonempty clubs in a town of residents.
Uses. Proposition 2.4.8 (Four views of the product), Definition 2.4.21 (Transpose), Proposition 2.5.4 (Left inverses give uniqueness), Exercise 2.6.44
Techniques. Test injectivity at (Technique 2.6.12)
(a) Number the residents , and for club let have -th entry if resident belongs to club and otherwise. For any clubs and ,
adds a for each common member, so it is the number of common members, reduced modulo . By hypothesis this is for and for .
Let have columns . The entry of is row of , which is , times column of (Proposition 2.4.8(a)), so . Thus is a left inverse of , and is injective (Proposition 2.5.4). By Exercise 2.6.44(b), .
(b) Let club consist of resident alone, for . Each club has one member and two different clubs share none.
(c) Split six residents into the pairs , , , and let the clubs be the nonempty unions of these pairs:
Each is a union of pairs, so it has an even number of members, and the intersection of two of them is again a union of pairs (those they share), so it is even as well. That is clubs. In the vector language every is now , so and there is no left inverse to be had: the oddness of the clubs is what made the vectors independent.
This is the Oddtown theorem. For the even version, one can show that at most clubs are possible, counting the empty club, but the proof needs more than this chapter.
Problem 2.19. Let be different matrices with and .
- (a)Can be invertible?
- (b)Show that need not be .
Uses. Proposition 2.4.14 (Algebra of matrices), Proposition 2.5.4 (Left inverses give uniqueness), Lemma 2.4.24 (Matrix units)
Techniques. Test injectivity at (Technique 2.6.12)
(a) No. By distributivity,
Since , some column of is nonzero, and by the column view is the corresponding column of . So is not injective, and has no left inverse (Proposition 2.5.4), let alone an inverse. The argument works over every field.
(b) Let and in . By Lemma 2.4.24(c), kills and on both sides, and . So , hence
This is Problem A2 of the 1991 Putnam Competition. The idea is to find a product with that the hypotheses kill, which is the zero-divisor phenomenon of Example 2.4.19 put to work.
Problem 2.20. Let satisfy .
- (a)Show that if , then .
- (b)Show that for every there are with but .
Uses. Problem 2.9, Proposition 2.5.28 (Inverse of a matrix), Exercise 2.5.46, Exercise 2.5.32, Lemma 2.4.24 (Matrix units), Theorem 2.4.34 (Block multiplication)
Techniques. Finding counterexamples and minimal examples (Technique 1.4.18), Try small cases and small fields (Technique 1.2.38)
(a) Let . By Problem 2.9(a) with ,
If , this gives ; otherwise . Either way , that is, .
(b) Let , , and , where . By Lemma 2.4.24(c),
since the other three products of units vanish. On the other side,
Explicitly,
For , use the block diagonal matrices and in ; by Theorem 2.4.34 their products are computed in the top left block, so the same identities hold there.
In size a matrix with already has , and that is what (a) used. In size , is still nilpotent by Problem 2.9, but it can take three steps to die, as does: . This is Problem A5 of the 1990 Putnam Competition.