Chapter 3: Linear systems and row reduction
Problems for Chapter 3
These problems combine the sections of Chapter 3, and some of them combine it with Chapters 1 and 2. The first four are review prompts: state a main result, prove it without looking, and then answer a question that the text did not ask. The rest are ordered roughly by difficulty. Problems of kind “competition” are harder than anything the course expects. Section 3.6 surveys the techniques they use.
Review: state and prove
- (a)State the theorem that describes the solution set of a consistent linear equation , where is linear, and prove it.
- (b)Let . Show that the set of for which has exactly one solution is either empty or all of , and decide which in terms of .
Uses. Definition 2.1.1 (Linear map), Corollary 3.1.22 (Uniqueness depends only on ), Proposition 3.1.8 (Systems and the map ), Definition 2.6.5 (Kernel), Proposition 2.1.4 (Linear maps preserve and negatives)
Techniques. Particular plus homogeneous (Technique 3.1.18), Double containment (Technique 1.3.14)
(a) Statement (Proposition 3.1.19). Let be linear, , and
Proof. We prove both containments. If , then
(b) Let be the set of for which has exactly one solution. Every makes the system consistent, so (Proposition 3.1.8(a)).
Case . Let . The system is consistent, so by Corollary 3.1.22(a) it has exactly one solution, and . Hence .
Case . Then contains (Proposition 2.1.4) and some , so it has at least two elements. If is consistent, its solution set is in bijection with by (a), applied to , so it has at least two elements. If it is inconsistent, it has none. Either way , so .
So the set is when , and empty otherwise. Uniqueness is all or nothing: it holds for every consistent right-hand side or for none.
- (a)State the theorem on the uniqueness of the reduced row echelon form, and prove it by comparing the linear relations among the columns.
- (b)Show that the analogous statement for column operations is false: find matrices , both in RREF, and an invertible with .
- (c)Show that nevertheless, if is in RREF, is invertible, and is also in RREF, then and have the same number of pivots.
Uses. Corollary 3.2.17 (Row operations preserve relations among columns), Lemma 3.3.16 (Reading the columns of a matrix in RREF), Definition 2.4.1 (Matrix product), Theorem 3.3.12 (Matrices in RREF), Proposition 3.3.8 (Properties of the output)
Techniques. Uniqueness via two candidates (Technique 1.1.8), Transpose to trade rows for columns (Technique 3.2.27)
(a) Statement (Theorem 3.3.17). If are in RREF and for an invertible , then .
Proof. Write and for the columns. By Corollary 3.2.17, for all scalars ,
An equation
So every column of equals the corresponding column of .
(b) and both satisfy (R1)–(R4), so they are in RREF (Theorem 3.3.12), and with the swap, which is invertible. The proof of (a) breaks because right multiplication does not preserve the relations among the columns: here but .
(c) Let have pivot columns . By Theorem 3.3.12 and Proposition 3.3.8, rows of are nonzero and the others are zero; write for the nonzero rows. They are linearly independent: if
By Definition 2.4.1, row of is for , and for . The rows are again independent: if , then
Part (c) is the transpose of a row statement in disguise (Technique 3.2.27): the rows of are the columns of , and left multiplication by an invertible matrix preserves independence of columns (Corollary 3.2.17).
- (a)State the criterion for invertibility of a square matrix in terms of its reduced row echelon form, prove it, and explain why Algorithm 3.3.24 is correct.
- (b)Suppose that while row reducing , at some intermediate stage, row of the left block is zero. Show that row of the right block is then a nonzero row vector with , and deduce directly from this, without using (a), that is not invertible.
- (c)Carry out (b) for the integer matrix , read over . Is invertible over ?
Uses. Theorem 3.3.10 (), Proposition 3.3.11 (Carrying extra columns along), Proposition 3.3.8 (Properties of the output), Corollary 3.2.11 (Products of elementary matrices), Proposition 3.2.7 (Row operations are left multiplications), Definition 2.4.1 (Matrix product)
Techniques. Reduce to RREF (Technique 3.3.22)
(a) Statement (Theorem 3.3.23). Let , and let be a product of elementary matrices with . Then is invertible if and only if , and in that case .
Proof. If , then , and is invertible (Corollary 3.2.11), so and ; thus . Conversely, suppose . If had pivots, they would lie in columns among , forcing , and then by Proposition 3.3.8(c). So has fewer than pivots, and its last row is zero (Proposition 3.3.8(a)). Then the last row of is zero for every , so and is not invertible. If were invertible, would be invertible with inverse . So is not invertible.
The algorithm. By Proposition 3.3.11, Gauss–Jordan elimination on , scanning only the left block, ends at , where is the product of the elementary matrices of the run on . By the theorem, if the left block is then , and otherwise is not invertible.
(b) Each row operation is left multiplication by an elementary matrix (Proposition 3.2.7), so at every stage the current matrix is
If were invertible, then
(c) Over the entry is . Pass adds times row to row and times row to row :
using , , , and in . Pass has its pivot at ; adding times row to row makes row of the left block zero, with right block row
So is not invertible over : there, its third row is the sum of the first two.
Over the same computation gives , so the certificate is lost. Indeed, over pass leaves the rows and below the first, pass scales the first of them to and adds times it to the last, which becomes . So a third pivot appears, , and is invertible over . Whether a matrix with integer entries is invertible can depend on the field in which the entries are read (compare Example 3.5.3).
- (a)State the rank normal form theorem and prove it.
- (b)Deduce that every of rank is a sum of matrices of rank .
- (c)Deduce that every of rank can be written as with and .
Uses. Theorem 3.3.10 (), Lemma 3.3.16 (Reading the columns of a matrix in RREF), Theorem 2.4.34 (Block multiplication), Theorem 3.5.14 (Third Fundamental Theorem, completed), Lemma 2.4.24 (Matrix units), Theorem 3.3.12 (Matrices in RREF), Proposition 3.5.2 (First properties of rank), Exercise 3.5.41
Techniques. Reduce to RREF (Technique 3.3.22), Block decomposition (Technique 2.4.35)
(a) Statement (Theorem 3.5.27). Let have rank , and let have in positions and elsewhere. Then for some invertible and .
Proof. Let be invertible with (Theorem 3.3.10), with pivot columns and free columns , . Let have columns
With , we get
(b) By (a), . By Lemma 2.4.24,
The matrix has a single nonzero entry, a in position . Swapping row to the top gives a matrix whose only nonzero row is , which satisfies (R1)–(R4) and so is in RREF with one pivot (Theorem 3.3.12); so it has rank . Multiplying by invertible matrices on the left (Proposition 3.5.2(c)) and on the right (Exercise 3.5.41(c)) does not change the rank, so .
(c) By block multiplication,
where the left factor is and the right one is . So
where consists of the first columns of and of the first rows of .
Problem 3.17 finds a factorization of this shape in which is the nonzero part of , and shows that it is unique. Section 4.3 studies such factorizations in general.
Synthesis problems
Problem 3.5. Let
- (a)Find and over and over . Find a relation among the rows of over that explains the difference.
- (b)Over , write each free column of as a combination of the pivot columns, and find vectors spanning .
- (c)Over , for which is consistent, and how many such are there? Find all solutions of , and count them.
- (d)Over , find a right inverse of . Does have a right inverse over ?
Uses. Algorithm 3.3.1 (Gauss–Jordan elimination), Proposition 3.3.11 (Carrying extra columns along), Exercise 3.3.57, Corollary 3.3.19 (Pivot columns, intrinsically), Definition 3.4.8 (Basic solutions), Theorem 3.4.9 (All solutions), Corollary 3.4.4 (Consistency), Corollary 3.4.14 (Counting solutions), Proposition 3.5.8 (Right inverses from the pivots), Theorem 3.5.13 (Second Fundamental Theorem, completed)
Techniques. Reduce to RREF (Technique 3.3.22), Particular plus homogeneous (Technique 3.1.18)
(a) We reduce . Pass adds times row to row and times row to row . In pass , column vanishes in rows and , so the pivot is at , and we add times row to row . These steps are the same over any field:
Over . Pass scales row by and clears column , adding times row to row and times row to row :
So , with pivot columns .
Over . Here and , so after pass the third row of the left block is zero and the algorithm halts:
So , with pivot columns . The last row of is a relation among the rows of (Exercise 3.3.57):
This is in but not in , and it is exactly why the third pivot disappears.
(b) Over the free columns are . By Corollary 3.3.19(b), with the entries of as coefficients,
(Check:
and
(c) By Corollary 3.4.4, is consistent if and only if the third entry of vanishes, that is, . The vectors satisfying it are determined by (then ), so there are of them. For ,
and there are of them (Corollary 3.4.14(b)).
(d) Over , is the number of rows, so by Proposition 3.5.8 the matrix , which has row of in row and zeros in the free rows, is a right inverse:
Check: the first row of times the columns of gives
Uses. Theorem 3.3.23 (Invertibility and RREF), Theorem 3.4.9 (All solutions), Definition 1.1.29 (Complex numbers)
Techniques. Reduce to RREF (Technique 3.3.22), Try small cases and small fields (Technique 1.2.38)
The equation says . We row reduce
If , the second row has a pivot, and clearing gives ; so is invertible (Theorem 3.3.23) and only satisfies . If , the reduced form is , so is not invertible, and by Theorem 3.4.9 the solutions are the multiples of the basic solution . (Check:
So we need the solutions of in each field.
- : none, since . So is invertible for every real .
- : , with , respectively .
- : , and works ( does not). The solutions are the multiples of , that is, and .
- : the squares are , and is not among them. No .
- : , so or , with , respectively .
Over , rotates the plane by , so no nonzero vector is sent to a multiple of itself, and the computation agrees. Whether such vectors exist depends on the field, through the single equation ; Section 7.2 takes this up.
Problem 3.7. Find the error in each argument, and give a counterexample to its conclusion.
(a)Claim. Every with has a right inverse.
Proof. Run Gauss–Jordan elimination on . Each pivot uses up one row and one column, and there are at least as many columns as rows, so every row receives a pivot. Hence , and Proposition 3.5.8 gives a right inverse.
- (b)Claim. for all and .
Proof. By Theorem 3.5.19, with each elementary. Multiplying on the left by , then by , and so on, performs row operations on , and row operations do not change the rank (Proposition 3.5.2(c)).
Uses. Proposition 3.5.2 (First properties of rank), Proposition 3.3.8 (Properties of the output), Theorem 3.5.19 (Invertible matrices are products of elementary matrices), Corollary 3.2.11 (Products of elementary matrices)
Techniques. Reduce to elementary matrices (Technique 5.4.6), Finding counterexamples and minimal examples (Technique 1.4.18)
(a) The step “every row receives a pivot” is wrong. A pass of Gauss–Jordan elimination creates a pivot only in a column that has a nonzero entry in an unpivoted row, and the algorithm halts as soon as the unpivoted rows are zero (step 1 of Algorithm 3.3.1). The count of rows and columns gives (Proposition 3.5.2(a)), an upper bound, not equality. For example, has and , so . It has no right inverse: if , then the two rows of would be equal (both rows of are equal), but the rows of are not. The smallest counterexample is .
(b) The first step is wrong: Theorem 3.5.19 applies only to invertible matrices, and only those are products of elementary matrices (Corollary 3.2.11). For and ,
Problem 3.8. Prove or disprove each statement.
- (a)If and has exactly one solution for some , then .
- (b)If and, for every , the systems and have the same solution set, then .
- (c)If and satisfy , then , even when .
- (d)If and is invertible, then and have the same pivot columns.
- (e)If column of is zero, then column of is zero.
- (f)The matrices of rank at most form a subspace of .
Uses. Corollary 3.1.22 (Uniqueness depends only on ), Theorem 3.5.12 (First Fundamental Theorem, completed), Exercise 3.4.37, Proposition 3.5.2 (First properties of rank), Theorem 3.3.10 (), Theorem 3.3.12 (Matrices in RREF)
Techniques. Finding counterexamples and minimal examples (Technique 1.4.18), Reduce to RREF (Technique 3.3.22)
(a) True. If has exactly one solution, then by Corollary 3.1.22(a). By Theorem 3.5.12, , and .
(b) True. Let and . Then solves , so by hypothesis it solves , that is, . With , column of equals column of , for every .
(c) True. By Exercise 3.4.37, is a free variable of if and only if some has and for all . This condition involves only , so and have the same free columns, and by Proposition 3.5.2(b),
(d) False. Let and . Both and are in RREF (Theorem 3.3.12), with pivot columns and respectively.
(e) True. Write with invertible (Theorem 3.3.10). Column of is , so if it is zero, then
(f) False. The matrix units and each have exactly one nonzero column, so by Proposition 3.5.2(d) each has rank . Their sum has rank . So the set is not closed under addition.
Problem 3.9. Let be a finite field with elements, let and , let be distinct, and let .
- (a)Suppose . Show that exactly polynomials satisfy for .
- (b)Suppose . Show that at most one satisfies these conditions, and that for some choice of the there is none.
- (c)How many satisfy , , and ? How many of these also satisfy ?
Uses. Exercise 3.4.39, Proposition 3.4.16 (A pivot in every row), Proposition 3.5.2 (First properties of rank), Corollary 3.4.14 (Counting solutions), Proposition 3.4.15 (A pivot in every column), Corollary 3.1.22 (Uniqueness depends only on ), Definition 1.2.17 (Evaluation)
Techniques. Undetermined coefficients (Technique 3.1.9), Particular plus homogeneous (Technique 3.1.18)
Write
(a) Since , Exercise 3.4.39(b) shows that has a pivot in every row, so and the system is consistent for every (Proposition 3.4.16). It has free columns (Proposition 3.5.2(b)), so by Corollary 3.4.14(b) it has exactly solutions. Each solution is one polynomial.
(b) Since , Exercise 3.4.39(a) shows that has a pivot in every column, so has only the trivial solution (Proposition 3.4.15), and every system has at most one solution (Corollary 3.1.22). By Exercise 3.4.39(b), does not have a pivot in every row, so some is inconsistent (Proposition 3.4.16).
(c) Here , , and the nodes are distinct, so and there are such polynomials. Adding the condition gives distinct nodes , and polynomials.
In words: each condition at a new node cuts the number of polynomials by a factor of , until there are conditions and exactly one polynomial is left (Theorem 3.4.24).
Problem 3.10. Let be linearly independent, and let have columns .
- (a)Show that the pivot columns of the matrix are together with some columns
, and that is a basis of . Show also that . - (b)Carry this out for and in , and express the standard basis vectors left out as combinations of the basis you found.
- (c)In the second proof of Proposition 3.5.9, the columns of were extended to a basis by appending, for in turn, each not in the span of the list built so far. Show that this appends exactly .
Uses. Corollary 3.3.19 (Pivot columns, intrinsically), Lemma 1.5.10 (Linear dependence lemma), Proposition 1.4.14 (The span is the smallest subspace containing a list), Definition 1.6.1 (Basis), Theorem 3.5.13 (Second Fundamental Theorem, completed)
Techniques. Reduce to RREF (Technique 3.3.22)
(a) The columns of are
is independent. No pivot column is a combination of the columns before it, so in particular none is a combination of the pivot columns before it. If were dependent, the linear dependence lemma (Lemma 1.5.10) would give an entry in the span of the earlier entries. So is independent.
spans . By Corollary 3.3.19(b), every non-pivot column of is a combination of the pivot columns to its left, so every column of lies in . In particular
So is a basis of (Definition 1.6.1). Finally, the columns of span , so by Theorem 3.5.13 ((III) (VI)), and is the number of pivot columns, .
(b) We apply the criterion of (a) to the columns
- and is not a multiple of (third entries), as (a) predicts.
- : a combination
equal to needs , then , and then . So column is a pivot column. - , so column is not.
- , since
; so column is not. - : every earlier column has fourth entry , and so does every combination of them. So column is a pivot column.
The pivot columns are , and is a basis of . (Row reducing confirms this: the result has pivots in columns , and its columns and are and , the coefficients found above.)
(c) Let be the list built before step , and
So the procedure appends exactly when , that is, by Corollary 3.3.19(a), exactly when column of is a pivot column. The greedy extension and the pivot columns of are the same construction; the second one can be carried out by a single row reduction.
Problem 3.11. Let , and let and .
- (a)Show that there is a linear map with for if and only if every linear relation among the also holds among the : whenever
, also . - (b)Suppose such a exists. Show that it is unique if and only if span .
- (c)Find all such for , , and , , over . What changes if ?
Uses. Exercise 3.6.9, Proposition 2.3.17 (Every linear map is some ), Definition 2.3.8 (Matrix–vector product), Definition 2.4.1 (Matrix product), Theorem 3.5.13 (Second Fundamental Theorem, completed), Proposition 3.3.8 (Properties of the output), Theorem 3.4.9 (All solutions), Exercise 3.3.57
Techniques. Undetermined coefficients (Technique 3.1.9), Reduce to RREF (Technique 3.3.22)
Let and have columns and . Every linear map is for exactly one (Proposition 2.3.17), and column of is (Definition 2.4.1). So for all if and only if . By Definition 2.3.8, a relation is a vector , and it holds among the exactly when .
(a) So the condition on relations says , and the existence of says for some . These are equivalent by Exercise 3.6.9(a), applied with and .
(b) Let . Another matrix satisfies if and only if satisfies . So is unique if and only if forces .
Suppose the span , and . Then for every , so for every combination of the , which is every . In particular every column of is zero, and .
Suppose the do not span . By Theorem 3.5.13 ((III) (VI)), , so row of is zero (Proposition 3.3.8(a)). Let be invertible with , and let be row of . Then is row of , which is zero, and since is invertible. Let have first row and all other rows zero. Then and (its first row is ), so is a second solution.
(c) Row reducing (adding times row to row , then times row to row and row to row ) gives
The basic solution is , so by Theorem 3.4.9 the relations among the are exactly the multiples of . And
Check: ,
If , then
Problem 3.12. For
- (a)Show that is linear, and find its matrix with respect to the basis
of matrix units. - (b)Show that if is a scalar multiple of , and otherwise.
- (c)For , find all with , and all matrices of the form .
Uses. Lemma 2.4.24 (Matrix units), Definition 2.3.1 (Matrix of a linear map), Proposition 2.4.14 (Algebra of matrices), Proposition 3.5.2 (First properties of rank), Definition 1.3.10 (Span)
Techniques. Translate between maps and matrices (Technique 2.3.27), Reduce to RREF (Technique 3.3.22)
(a) By the distributive laws for matrix multiplication (Proposition 2.4.14),
so
The coordinates of in the basis of matrix units are (Lemma 2.4.24(a)), so by Definition 2.3.1, is the matrix taking these coordinates to those of :
Its columns are ,
(b) By Proposition 3.5.2(d), is the number of with
Case . Then , so counts; and , since its first entry is while that of is . But is a combination of and :
So .
Case , . Then
Case . Then , , . If , then and count, and . If , then and .
The case , is exactly . So for scalar and otherwise.
(c) Here and , so by (a)
So if and only if and , that is,
Problem 3.13. For
- (a)Show that these conditions form a square linear system in the coefficients of and .
- (b)Show that for all there is exactly one natural cubic spline.
- (c)Find the spline for
. Use (b) to shorten the computation.
Uses. Corollary 3.4.20 (Square systems), Definition 1.2.17 (Evaluation)
Techniques. Uniqueness gives existence (Technique 3.4.21), Undetermined coefficients (Technique 3.1.9)
Write
(a) By Definition 1.2.17 and the formulas for and , the conditions read
These are eight linear equations in the eight unknowns
(b) By Corollary 3.4.20 ((iv) (vi)) it suffices to show that the homogeneous system, with , has only the trivial solution. Its equations give , , , , and . The two remaining equations become
that is, and . So , hence and , and all eight coefficients vanish. Therefore every system of this form, for every , has exactly one solution.
(c) Let be the spline for . Define
- ,
, and ; and ; - and .
By the uniqueness in (b), , so for every .
So it remains to find . From and we get ; and . The conditions and give and , so and : , . Hence
Check the conditions not used:
The same holds for any nodes
Problem 3.14. Let be invertible, , , , and
The matrix is the Schur complement of in .
- (a)Find invertible block matrices and with .
- (b)Deduce that . In particular, is invertible if and only if is.
(c)For which does the following matrix have rank ?
Uses. Theorem 2.4.34 (Block multiplication), Definition 2.5.12 (Invertible), Proposition 3.5.2 (First properties of rank), Exercise 3.5.41, Exercise 3.5.36, Corollary 3.5.25 (The invertible matrix theorem), Theorem 3.5.14 (Third Fundamental Theorem, completed)
Techniques. Block decomposition (Technique 2.4.35), Reduce to RREF (Technique 3.3.22)
(a) Let
By block multiplication (Theorem 2.4.34),
is invertible: is a two-sided inverse, since both products have off-diagonal block and identity diagonal blocks. Likewise is a two-sided inverse of (Definition 2.5.12).
(b) Left multiplication by an invertible matrix does not change the rank (Proposition 3.5.2(c)), and neither does right multiplication (Exercise 3.5.41(c)). So by (a) and Exercise 3.5.36(a),
where because is invertible (Theorem 3.5.14). is square of size , so it is invertible if and only if (Corollary 3.5.25), if and only if , if and only if is invertible.
(c) Here , , and . Row reducing gives (check:
If and , the first column of is nonzero, and the second column is not a multiple of it (a multiple with first entry needs ), so (Proposition 3.5.2(d)). If , then , and if , then ; in both cases the two columns are proportional and . By (b), for , and for those two values.
Problem 3.15. An electrical network has nodes . Some pairs of nodes are joined by a resistor; let be the conductance (the reciprocal of the resistance) if and are joined, and otherwise, with . The network is connected: any node can be reached from any other along resistors. Node is grounded, so its potential is . An external source injects a current into node for . By Ohm’s law, the current from to through their resistor is , and Kirchhoff’s current law at node says
- (a)Show that for every there is exactly one vector of potentials satisfying these equations.
- (b)Show that the current flowing into the ground node through the resistors is automatically .
(c)In the network of Figure 3.1, one ampere is injected at node . Find the potentials, the current through the diagonal resistor, and the effective resistance between nodes and , which is divided by the injected current.
Figure 3.1. Four nodes on a square with one diagonal. The resistor between nodes and has resistance Ω (conductance ); the other four have resistance Ω.
Uses. Corollary 3.4.20 (Square systems)
Techniques. Uniqueness gives existence (Technique 3.4.21), A sum of nonnegative terms (Technique 6.1.9)
Throughout, sums over or run over all nodes unless stated otherwise, and .
(a) The equations are linear in (the terms with contribute ), and there are of them, so the system is square. By Corollary 3.4.20 ((iv) (vi)) it suffices to show that the homogeneous system, with every , has only the trivial solution.
Let solve the homogeneous system. Multiply equation by and add over . We may also add the term with , which is
Renaming and and using , the same sum is
Every term is a nonnegative real number, so every term is : whenever and are joined, forces . Since the network is connected, every node is joined to node by a path of resistors, along which the potential does not change; so . Thus the homogeneous system has only the trivial solution, and for every there is exactly one solution.
(b) The current flowing out of node through the resistors is . Now
because the terms and cancel:
So a current flows into the ground node, as conservation of charge requires; the equation at node is a consequence of the others, just as one balance equation was redundant in Exercise 3.1.38.
(c) The conductances are and
The first gives ; then the third gives , so and . The second becomes , so . Hence
Check: in the second equation, and in the third. The current through the diagonal is
The argument in (a) follows the same strategy as the uniqueness of the plate temperatures in Exercise 3.1.47, with an energy in place of a maximum. In physical terms, is the power dissipated in the resistors, and a network with no sources dissipates no power only if no current flows.
Problem 3.16. For , let have entry in every position with , and elsewhere.
- (a)Show that, over every field , is invertible if and only if is not congruent to modulo .
- (b)Over , is the matrix of “lights out” on a row of lamps, where pressing a lamp toggles it and its immediate neighbors (compare Exercise 3.1.40). Suppose . Show that a pattern of lit lamps can be switched off if and only if the number of lit lamps in positions not divisible by is even. You may use Exercise 3.5.37.
Uses. Corollary 3.4.20 (Square systems), Exercise 3.5.37, Proposition 2.4.23 (Transpose of a product)
Techniques. Uniqueness gives existence (Technique 3.4.21), Particular plus homogeneous (Technique 3.1.18)
(a) For , is invertible, and . Let . Since is square, it is invertible if and only if has only the trivial solution (Corollary 3.4.20). The equations of are
Define , , and
(Indeed, if
The first equations. We claim that they hold exactly for the vectors , , where . If they hold, put . The first equation gives , and equation gives
The last equation. For it reads , that is, . If , then , so and : only the trivial solution, and is invertible. If , then , so solves , and is not invertible. Nothing in the argument depends on the field.
(b) As in Exercise 3.1.40, a set of presses switches off the pattern exactly when : lamp is toggled by presses at , , . Let . By (a),
with exactly when divides .
By Exercise 3.5.37, has no solution if and only if there is with and . The matrix is symmetric, so transposing (Proposition 2.4.23), says , that is, . And . So the pattern cannot be switched off if and only if . Finally, in , which is exactly when the number of lit lamps in positions not divisible by is even.
Problem 3.17. Let be a field and .
- (a)Let have rank , and let consist of the nonzero rows of . Show that for exactly one , and that this has rank . Conversely, show that if is in RREF with no zero row and has rank , then has rank and .
(b)Let have elements, and let be the number of matrices in RREF with no zero row (compare Exercise 3.3.58). Show that the number of matrices in of rank is
(c)Deduce that
and check this against Exercise 3.3.48 for , .
Uses. Theorem 3.3.10 (), Theorem 2.4.34 (Block multiplication), Theorem 3.5.14 (Third Fundamental Theorem, completed), Corollary 1.5.17 (Sublists), Corollary 3.5.16 (Lists of vectors in ), Theorem 3.3.12 (Matrices in RREF), Proposition 3.5.8 (Right inverses from the pivots), Proposition 3.5.9 (Left inverses), Corollary 3.3.18 (RREF and row equivalence), Corollary 3.5.21 (Invertibility and row equivalence), Exercise 1.5.43, Theorem 3.5.13 (Second Fundamental Theorem, completed)
Techniques. Reduce to RREF (Technique 3.3.22), Uniqueness via two candidates (Technique 1.1.8)
(a) Existence. Let be invertible with (Theorem 3.3.10). Since , the nonzero rows of are its first rows, so . Split with its first columns. By block multiplication (Theorem 2.4.34),
The columns of form a basis of (Theorem 3.5.14, as is invertible), so the columns of are independent (Corollary 1.5.17), and by Corollary 3.5.16(a).
Uniqueness of . satisfies (R1)–(R4), so it is in RREF and its pivots are the leading entries of its nonzero rows (Theorem 3.3.12); so , the number of its rows. By Proposition 3.5.8, for some . If , then
Converse. Let have rank and be in RREF with no zero row. Since is the number of columns of , the first proof of Proposition 3.5.9 shows that for an invertible (one with ). Then
This matrix satisfies (R1)–(R4): does, and the zero rows come last. By Corollary 3.5.21(b), , so by Corollary 3.3.18(c). It has pivots, so .
(b) Let be the set of of rank , the set of matrices in RREF with no zero row, and the set of of rank . By the converse in (a), maps into . It is onto, by the existence part. It is injective: if , then by the converse
(c) Take in (b): the number of matrices of rank is . We count them a second way. An matrix has rank if and only if its rows are linearly independent:
- if , then has a right inverse (Theorem 3.5.13), and a relation among the rows gives ;
- if , the last row of is zero, so the last row of is nonzero (as is invertible) and satisfies , a nontrivial relation among the rows.
So by Exercise 1.5.43(b), applied to rows in , there are such matrices. Equating the two counts and dividing by the nonzero integer gives the formula.
For , :
which is the number of matrices in RREF with two pivots found in Exercise 3.3.48 over (, , and for the pivot columns , , ), with . The same count works over any finite field.
With , part (b) counts the invertible matrices, since (only ): there are of them. The numbers are the Gaussian binomial coefficients; by Exercise 3.3.50 they also count the subspaces of spanned by independent vectors.
Problem 3.18. For , let be the matrix of remainders of its entries modulo .
- (a)Show that if is invertible over , then is invertible as a real matrix.
- (b)Deduce that an integer matrix whose diagonal entries are odd and whose other entries are even is invertible over .
- (c)Show that an integer matrix whose diagonal entries are even and whose other entries are odd is invertible over when is even, and give a non-invertible example with .
- (d)Show that the converse of (a) is false.
Uses. Corollary 3.4.20 (Square systems), Lemma 1.1.21 (Arithmetic in ), Exercise 3.3.54, Exercise 3.3.52
Techniques. Extremal choice and minimal counterexamples (Technique 1.5.9)
(a) We prove the contrapositive. Suppose is not invertible over . By Corollary 3.4.20 there is a nonzero with . Multiplying by a common denominator of its entries, we may assume , still nonzero. Let be the largest power of dividing every entry of (it exists, since some entry is a nonzero integer), and replace by . Now has integer entries, , and some entry of is odd.
Each equation is an identity between integers, so it remains true after reducing modulo , because reduction modulo respects sums and products (Lemma 1.1.21). That is, in , where is the vector of remainders of . Since some entry of is odd, . So is not invertible over (Corollary 3.4.20).
So if is invertible, then is invertible over , that is, computed over . By Exercise 3.3.54, the reduced form is the same over , so is invertible over too.
(b) For such , , which is invertible.
(c) Now has on the diagonal and elsewhere. By Exercise 3.3.52, this matrix is invertible over if and only if in , that is, if and only if is even. Then is invertible by (a). For , the matrix
has even diagonal entries and odd off-diagonal entries, but its third column is the sum of the first two, so and is not invertible.
(d) is invertible over , with inverse , but .
The point of (a) is that a single computation over a small field certifies invertibility over an infinite one. Choosing with an odd entry is an extremal choice, as in Technique 1.5.9: without it, reducing modulo could turn into and prove nothing. Section 5.3 revisits this with determinants (Technique 5.3.21).
Problem 3.19. Let be a field, let be distinct, let be distinct, and suppose for all .
- (a)Show that the Cauchy matrix with entries
is invertible. - (b)Deduce that the Hilbert matrix with entries is invertible.
Uses. Corollary 3.4.20 (Square systems), Lemma 3.4.23 (Too many roots), Definition 1.2.17 (Evaluation), Proposition 1.1.17 (No zero divisors)
Techniques. Uniqueness gives existence (Technique 3.4.21)
(a) is square, so by Corollary 3.4.20 it suffices to show that implies . Let .
A polynomial. For a list of scalars , the function
which is again a polynomial expression in , of degree at most . So for each there is with
since evaluation is linear (Definition 1.2.17).
It vanishes at the . Fix . Every factor is nonzero, and
Thus has degree at most and vanishes at the distinct points , so by Lemma 3.4.23 (with in place of ). Hence for every .
Evaluating at . For , the product contains the factor , which is . So only the term survives:
The are distinct, so the product is nonzero (Proposition 1.1.17), and . As was arbitrary, . So is invertible.
(b) Take , , and for . The are distinct, the are distinct, and
The proof never computes ; it shows that the only combination of the functions vanishing at points is the trivial one, and lets Corollary 3.4.20 produce the inverse. This is Technique 3.4.21 in its pure form: interpolation by the functions in place of the monomials . (A formula for exists, but is much harder to find this way.)