Books
Theme
Text size
Width

[ and ] go to the previous and next page.

Nearly every proof in this chapter ran through Gauss–Jordan elimination, but it used the algorithm in only a handful of ways: as a reduction to a simpler matrix, as an object whose correctness had to be proved, as a way to settle existence questions, and as a table from which structure can be read. This section sorts the chapter’s proofs by the question they answer, compares the tools on examples from the chapter, and says when each tool is the wrong one. The exercises at the end practice one move at a time, and the chapter’s problems (Problems for Chapter 3) mix them.

3.6.1Proving a statement about every matrix

The chapter has two reductions. Technique 3.3.22 replaces 𝐴 by rref(𝐴)=𝐺𝐴 with 𝐺 invertible (Theorem 3.3.10). Technique 5.4.6, which is named in Section 5.4 but first used here, writes an invertible matrix as a product of elementary matrices (Theorem 3.5.19) and checks the three types one at a time. The rank normal form 𝐺𝐴𝐻=𝑁𝑘 (Theorem 3.5.27) is a two-sided version of the first. To choose between them, ask what the property you want has to survive.

Reducing to RREF needs a property 𝑃 with 𝑃(𝐴)⇔𝑃(𝐺𝐴) for every invertible 𝐺. The chapter found many: the kernel (Corollary 3.2.23), the linear relations among the columns (Corollary 3.2.17), and everything defined from these, such as which columns are pivot columns (Corollary 3.3.19), the rank (Proposition 3.5.2(c)), and, for square 𝐴, invertibility. Solution sets survive only if the right-hand side moves too: 𝐴𝐱=𝐲 becomes rref(𝐴)𝐱=𝐺𝐲 (Proposition 3.2.14). Once invariance is checked, the question is about a matrix whose pivot columns are 𝐞1,…,𝐞𝑟 and whose zero rows are visible, and it usually answers itself. This is how Theorem 3.3.23, Proposition 3.4.15, and Corollary 3.3.20 were proved.

Reducing to elementary matrices needs something else: a statement about invertible matrices that survives products. Then two checks suffice, one computation for each type and one step showing that the statement passes from 𝐴 to 𝐸𝐴 (or 𝐴𝐸). Invariance under 𝐴↦𝐺𝐴 plays no role. This is how Corollary 3.5.22 turned “multiply by invertible matrices” into “perform row and column operations”, and how Section 5.4 proves det(𝐴𝐵)=det𝐴det𝐵. The method only reaches invertible matrices, because products of elementary matrices are invertible. A statement about all square matrices needs a second argument for the others. Often both sides of the claim simply vanish there; otherwise one reduces to RREF, writes 𝐴=𝐺−1rref(𝐴), and uses the zero row of rref(𝐴) (Exercise 3.6.10). Forgetting this case is the error in Exercise 5.4.35.

Example 3.6.1 (Which reduction fits). Commuting with every invertible matrix. Which 𝑀∈𝐹𝑛×𝑛 satisfy 𝑀𝑋=𝑋𝑀 for every invertible 𝑋? Reducing to RREF is useless here, since 𝑀 commuting with 𝑋 says nothing about 𝑀 commuting with 𝐺𝑋. But the property survives products: if 𝑀𝑋=𝑋𝑀 and 𝑀𝑌=𝑌𝑀, then 𝑀𝑋𝑌=𝑋𝑀𝑌=𝑋𝑌𝑀. So by Theorem 3.5.19, 𝑀 commutes with every invertible matrix if and only if it commutes with every elementary one, and for 𝑛≥2 the type 3 matrices alone already force 𝑀=𝜆𝐼𝑛 (Exercise 3.2.52; for 𝑛=1 every 𝑀 works).

Rank under row and column operations. That rank(𝐺𝐴)=rank𝐴 for invertible 𝐺 is one line by reducing to RREF: rref(𝐺𝐴)=rref(𝐴) (Corollary 3.3.18(a)). The same attempt for 𝐴𝐻 fails. With 𝐴=(01) and 𝐻=𝐸12 we get 𝐴𝐻=(10), and 𝐴 and 𝐴𝐻 are both in RREF, so rref(𝐴𝐻)≠rref(𝐴), although both have rank 1. Right multiplication does not preserve the reduced form, so the reduction cannot see that rank(𝐴𝐻)=rank𝐴. A different argument is needed: the uniqueness of the rank normal form (Exercise 3.5.41), or transposition, which turns the column operations into row operations of 𝐴𝖳 and so reduces the question to the equality rank𝐴𝖳=rank𝐴 of Section 4.3.

3.6.2Proving that an algorithm is correct

An algorithm proves that something exists once two things are shown about every run (Technique 3.3.5). For termination, find a quantity that moves in one direction and cannot do so forever: in Gauss–Jordan elimination, the number 𝑘 of pivoted rows grows by 1 in each pass and never exceeds 𝑚 (Proposition 3.3.6). For correctness, find an invariant that the starting state satisfies and every step preserves, and that, combined with the reason for halting, gives the property of the output.

The invariant is where the work is, and its typical feature is visible in Lemma 3.3.7. The property we want at the end, conditions (R1)–(R4), is not preserved pass by pass: halfway through, the unpivoted rows are an arbitrary mess. The invariant has to say something about that mess, and part (e) does: the unpivoted rows vanish in every column up to the last pivot. Part (e) is what forces each new pivot to lie to the right of the old ones, which is (b), and it, together with the vanishing of the new pivot row to the left of its pivot, is exactly what choosing the leftmost column in step 1 of Algorithm 3.3.1 keeps true. Drop that choice and both the proof and the algorithm break (Exercise 3.3.47). The same pattern recurs in the exercises: Euclid’s algorithm by row operations has the monovariant |𝑏| and the invariant “the common divisors of the two entries” (Exercise 3.2.54), and elimination on a strictly diagonally dominant matrix needs no swap because the block still to be processed stays diagonally dominant (Exercise 3.3.56). Even Theorem 3.3.12 was proved by running the algorithm, on a matrix of the right shape, with the invariant “nothing has changed yet”. Exercise 3.6.11 practices the technique on an algorithm that has nothing to do with elimination.

An algorithm proves that some output with the guaranteed properties exists. It does not prove that this output is the only object with those properties, and a run that made different choices could, as far as the invariant knows, stop somewhere else. That is why the uniqueness of the reduced row echelon form needed its own theorem (Theorem 3.3.17), and why, before it, we could not say that another way of reducing 𝐴 finds the same pivots, or that rank(𝐺𝐴)=rank𝐴 (Remark 3.3.2). For echelon forms that are not reduced, uniqueness really fails (Example 3.3.29).

3.6.3Turning an existence question into a linear system

“Is there a polynomial, a combination, a map, a set of weights, such that …?” The move of Technique 3.1.9 is to write the unknown object with unknown scalars, translate each requirement into an equation in them, and check that the equations are linear. The question has become the consistency of a linear system, and the set of all answers has the shape of Technique 3.1.18: one answer plus everything that solves the homogeneous version. The chapter used this for membership in a span (Example 3.1.10), interpolation (Theorem 3.4.24), chemical balancing (Exercise 3.1.39), quadrature weights (Exercise 3.4.43), and antiderivatives, where the homogeneous solutions are the constants (Example 3.1.20).

Example 3.6.2 (One question, three answers). Which polynomials take the values 2,1,4 at −1,0,1? The answer depends on how many coefficients we allow, that is, on the number of unknowns against the three equations (Exercise 3.1.37).

  • In ℝ[𝑥]≤1, write 𝑝=𝑎+𝑏𝑥. The conditions 𝑎−𝑏=2, 𝑎=1, 𝑎+𝑏=4 give 𝑏=−1 and 𝑏=3, so there is no solution: three equations, two unknowns, and an inconsistent system.
  • In ℝ[𝑥]≤2 there are three unknowns and exactly one solution, 1+𝑥+2𝑥2.
  • In ℝ[𝑥]≤3 there are four unknowns, and the solutions are 1+𝑥+2𝑥2+𝑡(𝑥3−𝑥) for 𝑡∈ℝ: the particular solution from the previous case plus the cubics that vanish at −1,0,1.

The count of unknowns against equations predicts what can happen (Corollary 3.4.19), but only the system decides. The square case has exactly one solution here because of a structural fact, which is the subject of the next subsection.

The technique is the wrong tool when the requirements are not linear in the unknowns. Asking for a matrix 𝑋 with 𝑋2=𝐴 gives quadratic equations in the entries of 𝑋, and elimination does not apply. Side conditions such as positivity or integrality are not linear either: the linear system only finds the subspace of all balancings in Exercise 3.1.39, and a separate divisibility argument picks the smallest positive integer one; the nonnegative flows of Exercise 3.1.38 come from an inequality on the parameter. Also remember that the system lives over a field, and solving it divides by scalars: in Example 3.1.10 the same equations are solvable over ℝ and inconsistent over 𝔽2, because one step divided by 2.

3.6.4When uniqueness gives existence

Uniqueness and existence behave differently. Uniqueness is a property of the homogeneous problem alone, for a matrix of any size: a consistent system has exactly one solution if and only if ker𝑇𝐴={𝟎} (Corollary 3.1.22). Existence for every right-hand side is a property of the zero rows of rref(𝐴) (Proposition 3.4.16). For a square matrix the two conditions coincide, since both say rank𝐴=𝑛 (Corollary 3.4.20). So for square problems the homogeneous statement buys existence for free (Technique 3.4.21). The homogeneous statement says that a single object is zero, and it is usually proved by structure rather than computation: a polynomial with too many roots (Lemma 3.4.23), a maximum principle (Exercise 3.1.47), or the observation that 𝐵𝐴=𝐼𝑛 leaves no room for free variables (Theorem 3.5.23).

Example 3.6.3 (Existence, with and without a formula). Interpolation (Theorem 3.4.24) was proved without solving anything: 𝑛+1 conditions on 𝑛+1 coefficients, and a polynomial of degree at most 𝑛 with 𝑛+1 roots is zero. The Lagrange polynomials (Definition 3.4.26) were then defined through the theorem, so Lagrange’s formula did not give a second existence proof. That needs the closed form 𝐿𝑖=∏𝑗≠𝑖(𝑥−𝑐𝑗)/(𝑐𝑖−𝑐𝑗), which is a construction, and which waits for polynomial multiplication in Section 7.1. The construction gives more, a formula, but only when a formula is available. For the plate of Exercise 3.1.47 there is none, and uniqueness is the natural route to existence.

There are three ways to misuse the technique. First, on a non-square system it proves nothing: 𝐴=(11) has trivial kernel and 𝐴𝑥=(1,0) has no solution (Exercise 3.1.34). Second, counting conditions is not the proof; the homogeneous problem must actually have only the zero solution, and when it does not, existence fails too for some data. In the cyclic system of Exercise 3.1.46 with 𝑛 even, the homogeneous solution (1,−1,…,1,−1) comes with the condition that the alternating sum of the right-hand sides vanish, since the alternating sum of the left sides is 0. Exercise 3.6.14 is a smaller instance. Third, the technique depends on finite size. On 𝐹[𝑥], the shift 𝑆 with 𝑆(𝑥𝑘)=𝑥𝑘+1 has a left inverse but is not surjective (the intuition after Theorem 3.5.23), and Section 4.2 replaces “square” by dim𝑉=dim𝑊.

3.6.5Reading structure off the reduced form

Once 𝐺𝐴=𝑅=rref(𝐴) is computed, a great deal can be read off without further work:

  • a pivot in every column means at most one solution for each 𝐲, independent columns, and injectivity of 𝑇𝐴 (Proposition 3.4.15, Theorem 3.5.12); a pivot in every row means solutions for every 𝐲, spanning columns, and surjectivity (Proposition 3.4.16, Theorem 3.5.13);
  • the pivot columns are the columns of 𝐴 that are not combinations of earlier ones, and the entries of 𝑅 in a free column are the coefficients that build that column of 𝐴 from the pivot columns (Corollary 3.3.19);
  • the basic solutions, one for each free column, describe ker𝑇𝐴 (Theorem 3.4.9);
  • the last 𝑚−rank𝐴 rows of 𝐺 give the consistency conditions, so they describe im𝑇𝐴 (Corollary 3.4.4), and they are also the relations among the rows of 𝐴 (Exercise 3.3.57).

Everything in the first three items is about relations among the columns, and 𝑅 carries it alone. The image is different: it needs 𝐺, or the original columns of 𝐴.

Example 3.6.4 (Everything about one matrix). For the matrix 𝐴 of Example 3.3.3, with columns 𝐚1,…,𝐚4,

𝐴=(002424201234),𝑅=(120−200120000),𝐺=(−1/21/201/200−1−1/21).

The rank is 2, with pivot columns 1,3 and free columns 2,4. From the entries of 𝑅, 𝐚2=2𝐚1 and 𝐚4=−2𝐚1+2𝐚3. The basic solutions (−2,1,0,0) and (2,0,−2,1) describe ker𝑇𝐴 (Example 3.4.10). The last row of 𝐺 gives the single consistency condition −𝑦1−𝑦2/2+𝑦3=0, so im𝑇𝐴 is the plane 2𝑦3=2𝑦1+𝑦2 (Example 3.4.6), spanned by the pivot columns 𝐚1=(0,2,1) and 𝐚3=(2,2,3) of 𝐴.

The classic error is to take the pivot columns of 𝑅 instead. They are 𝐞1 and 𝐞2, and 𝐞1=(1,0,0) is not in im𝑇𝐴, since 2⋅0≠2⋅1+0. The columns of 𝑅 span im𝑇𝑅, which is im𝑇𝐴 moved by 𝐺 (Non-example 3.2.19). The fix is to read which columns are pivot columns from 𝑅 and to take those columns from 𝐴. Exercise 3.6.6 and Exercise 3.6.7 practice the distinction.

3.6.6Row operations and column operations

Row operations multiply on the left by an invertible 𝐺, and column operations multiply on the right by an invertible 𝐻. They preserve different things (Table 3.6.1).

Property of 𝐴Row operations, 𝐴↦𝐺𝐴Column operations, 𝐴↦𝐴𝐻
ker𝑇𝐴kept (Corollary 3.2.23)moved by 𝐻−1
relations among the columnskept (Corollary 3.2.17)changed
im𝑇𝐴, the span of the columnsmoved by 𝐺kept (Proposition 3.2.30)
relations among the rowschangedkept (Exercise 3.6.8)
rref(𝐴) and the pivot columnskept (Corollary 3.3.18)changed
rank𝐴kept (Proposition 3.5.2)kept (Exercise 3.5.41)
Table 3.6.1. What the two kinds of operations preserve. “Moved by 𝐺” means that the new image is {𝐺𝐲|𝐲∈im𝑇𝐴}, and similarly for the kernel, which becomes {𝐻−1𝐱|𝐱∈ker𝑇𝐴}. Transposing turns column operations on 𝐴 into row operations on 𝐴𝖳 (Technique 3.2.27); for instance, the relations among the rows of 𝐴 form the kernel of 𝑇𝐴𝖳, which is why column operations keep them.
Example 3.6.5 (One matrix, both operations). Let 𝐴=(1111), so ker𝑇𝐴=span((1,−1)) and im𝑇𝐴=span((1,1)). The row operation 𝐸1,−1,2 gives (1100), with the same kernel and the image span((1,0)). The column operation “add −1 times column 1 to column 2”, which is right multiplication by 𝐻=𝐸2,−1,1=(1−101), gives (1010), with the same image and the kernel span((0,1)). Indeed 𝐻−1(1,−1)=(1101)(1−1)=(0,−1), as the table predicts.

So row operations are the tool for solving systems and for finding relations among the columns, and column operations are the tool for questions about the span of the columns. Using column operations to solve 𝐴𝐱=𝐲 changes the unknowns: 𝐴𝐻𝐱′=𝐲 is solved by 𝐱′ exactly when 𝐴𝐱=𝐲 is solved by 𝐱=𝐻𝐱′, so the answer must be translated back. Using row operations on a question about the span of the columns moves the span. This is why the bad right-hand side in the proof of Proposition 3.4.16 is 𝐺−1𝐞𝑚 and not 𝐞𝑚 (Remark 3.4.17). With both kinds of operations allowed, only the rank survives, and every matrix of rank 𝑘 becomes 𝑁𝑘 (Theorem 3.5.27).

3.6.7Reading the chapter’s proofs

Uniqueness of the reduced form, two ways. Writing 𝑅′=𝐺𝑅 column by column suggests the first proof of Theorem 3.3.17: track 𝐺, and show pivot by pivot, from the left, that the pivot columns agree and that 𝐺 fixes 𝐞1,…,𝐞𝑟. It needs invertibility of 𝐺 in a concrete form, the independence of its columns, to rule out a pivot that appears too early in one matrix. The second proof forgets 𝐺. It notices that everything about a matrix in RREF, which columns are pivot columns and what the other columns are, is determined by the linear relations among its columns (Lemma 3.3.16), and that row operations preserve those relations. The comparison teaches a habit: after a proof, list the hypotheses it actually used. The second proof used one consequence of 𝑅′=𝐺𝑅, namely that 𝑅 and 𝑅′ have the same kernel, so it proves the stronger statement Corollary 3.3.20 at no extra cost. The first proof, in turn, says something the second does not: 𝐺 is rigid on 𝐞1,…,𝐞𝑟 and free elsewhere (Exercise 3.3.46).

Constructive and structural proofs. Several results got one proof of each kind. Proposition 3.4.15 was proved by setting one free variable to 1, which produces a nonzero solution, and by the linear dependence lemma, which explains what a missing pivot means. Proposition 3.5.9 was proved from the pivots, which gives a formula, and by extending the columns to a basis, which works for linear maps between abstract vector spaces as long as the domain has a finite basis and the target a finite spanning list (Exercise 3.5.40). Theorem 3.5.27 was proved by clearing columns and by row reducing the transpose. The computational proof usually produces a formula or a witness, and the structural one usually survives the passage to abstract vector spaces.

Do it to the identity. To find the matrix of an operation that acts on each column by the same linear map, perform the operation on 𝐼𝑚 (Lemma 3.2.6, the first proof of Proposition 3.2.7). The same idea, run along with the algorithm, records the whole elimination: carrying 𝐼𝑚 next to 𝐴 produces 𝐺 (Proposition 3.3.11), and carrying 𝐼𝑛 next to a square 𝐴 produces 𝐴−1 (Algorithm 3.3.24).

3.6.8Common errors

Each of these appears in the chapter, most of them as find-the-error exercises.

  • Simultaneous row operations. Replacing two equations at once, where the second replacement uses an equation the first one changed, can gain solutions (Exercise 3.1.35). So can scaling a row by 0, which is why it is not an elementary operation.
  • The order of the factors. The first row operation is the rightmost factor of 𝐺=𝐸𝑡⋯𝐸1 (Example 3.2.8); for column operations it is the leftmost (Remark 3.2.29).
  • Row operations do not preserve the image. 𝐴𝐱=𝐲 is equivalent to 𝐺𝐴𝐱=𝐺𝐲, not to 𝐺𝐴𝐱=𝐲 (Exercise 3.2.43, Remark 3.4.17), and the columns of rref(𝐴) do not span im𝑇𝐴 (Exercise 3.6.6).
  • Uniqueness is not existence. A trivial kernel gives at most one solution, not one (Exercise 3.1.34). Checking that some vectors are solutions does not show that they are all of them (Exercise 3.4.34, Remark 3.4.12). Counting equations and unknowns does not replace proving uniqueness (Exercise 3.6.14).
  • The shape bounds the rank only from above. rank𝐴≤min(𝑚,𝑛), and equality is a condition to check, not a consequence of the shape (Problem 3.7).
  • One-sided inverses of non-square matrices. Cancelling a matrix that has only a right inverse, or inverting 𝐴𝐵 when 𝐴 is not square, is invalid (Exercise 3.5.26, Exercise 3.5.35).
  • Rigidity overstated. 𝐺𝑅=𝑅 with 𝑅 in RREF does not force 𝐺=𝐼𝑚 (Exercise 3.3.46).
  • Reducing to elementary matrices beyond its reach. Only invertible matrices are products of elementary matrices; the other case needs its own argument (Exercise 5.4.35, Problem 3.7).
  • Hidden division. Pivots, ranks, and inverses depend on the field, because elimination divides (Example 3.5.3, Exercise 3.3.27).
  • Pictures from the plane. Three planes in ℝ3, no two of them parallel, can still have no common point (Exercise 3.1.36).

Exercises

Exercise 3.6.6.routine Let

𝐴=(120241361)∈ℝ3×3,rref(𝐴)=(120001000).

A student argues: “Row operations do not change the linear relations among the columns, and the pivot columns of rref(𝐴) are independent. So im𝑇𝐴 has the independent spanning list (1,0,0),(0,1,0), the pivot columns of rref(𝐴).”

  1. (a)Show that (1,0,0)∉im𝑇𝐴, and find the error.
  2. (b)Find two vectors that span im𝑇𝐴, and an equation for im𝑇𝐴.

Solution.

Uses. Corollary 3.3.19 (Pivot columns, intrinsically), Corollary 3.2.17 (Row operations preserve relations among columns), Proposition 3.1.8 (Systems and the map 𝑇𝐴), Corollary 3.4.4 (Consistency), Non-example 3.2.19 (Row operations move the column space)

Techniques. Reduce to RREF (Technique 3.3.22)

Hint 1. Every column of 𝐴 has third entry equal to the sum of the first two. Does (1,0,0)?
Hint 2. Row operations preserve the relations among the columns, so they preserve which columns are pivot columns. Do they preserve the columns themselves?
Hint 3. Use Corollary 3.3.19(b): every column of 𝐴 is a combination of the pivot columns of 𝐴.
Sketch. (a) The columns (1,2,3), (2,4,6), (0,1,1) all satisfy 𝑦3=𝑦1+𝑦2, so every vector of im𝑇𝐴 does, and (1,0,0) does not. The relations transfer, but the columns of rref(𝐴)=𝐺𝐴 are 𝐺𝐚𝑗, and they span im𝑇𝐺𝐴, not im𝑇𝐴. (b) The pivot columns of 𝐴, (1,2,3) and (0,1,1), span im𝑇𝐴, which is the plane 𝑦3=𝑦1+𝑦2.

(a) The columns of 𝐴 are 𝐚1=(1,2,3), 𝐚2=(2,4,6), and 𝐚3=(0,1,1), and each satisfies 𝑦3=𝑦1+𝑦2. This condition is preserved by sums and scalar multiples, so every linear combination of the columns satisfies it, and by Proposition 3.1.8(a) every vector of im𝑇𝐴 does. The vector (1,0,0) has 0≠1+0, so it is not in im𝑇𝐴.

The first sentence of the argument is correct (Corollary 3.2.17), and it does show that columns 1 and 3 of 𝐴 are independent and that column 2 is a combination of them. The error is the step from relations to the vectors themselves. Writing rref(𝐴)=𝐺𝐴 with 𝐺 invertible, the columns of rref(𝐴) are 𝐺𝐚1,𝐺𝐚2,𝐺𝐚3, so they span im𝑇𝐺𝐴, the image of 𝑇𝐴 moved by 𝐺. Row operations move the image (Non-example 3.2.19).

(b) By Corollary 3.3.19(b), the non-pivot column 𝐚2 is a combination of the pivot column 𝐚1 (indeed 𝐚2=2𝐚1, read off the entry 2 of rref(𝐴)). So im𝑇𝐴=span(𝐚1,𝐚2,𝐚3)=span(𝐚1,𝐚3)=span((1,2,3),(0,1,1)). For an equation: we showed that every vector of im𝑇𝐴 satisfies 𝑦3=𝑦1+𝑦2. Conversely, if 𝑦3=𝑦1+𝑦2, then

𝑦1(1,2,3)+(𝑦2−2𝑦1)(0,1,1)=(𝑦1,𝑦2,𝑦1+𝑦2)=𝐲,

so 𝐲∈im𝑇𝐴. Hence im𝑇𝐴={𝐲∈ℝ3|𝑦3=𝑦1+𝑦2}. (The same equation comes out of Corollary 3.4.4: reducing 𝐴 uses 𝐸1,−2,2, 𝐸1,−3,3, and 𝐸2,−1,3, and the last row of 𝐺 is (−1,−1,1).)

Exercise 3.6.7.routine A matrix 𝐴∈ℝ3×4 has

rref(𝐴)=(120−100130000),

and its first and third columns are 𝐚1=(1,1,2) and 𝐚3=(0,1,−1).

  1. (a)Find 𝐴.
  2. (b)Find vectors spanning ker𝑇𝐴, and an equation describing im𝑇𝐴.

Solution.

Uses. Corollary 3.3.19 (Pivot columns, intrinsically), Theorem 3.4.9 (All solutions), Definition 3.4.8 (Basic solutions), Proposition 3.1.8 (Systems and the map 𝑇𝐴)

Techniques. Reduce to RREF (Technique 3.3.22)

Hint 1. Columns 1 and 3 are the pivot columns. What does Corollary 3.3.19(b) say about columns 2 and 4?
Hint 2. The kernel depends only on rref(𝐴): use the basic solutions. The image is spanned by the pivot columns of 𝐴.
Sketch. (a) 𝐚2=2𝐚1=(2,2,4) and 𝐚4=−𝐚1+3𝐚3=(−1,2,−5). (b) ker𝑇𝐴=span((−2,1,0,0),(1,0,−3,1)), and im𝑇𝐴=span(𝐚1,𝐚3), which is the plane 𝑦3=3𝑦1−𝑦2.

(a) The pivot columns of rref(𝐴) are 1 and 3, so these are the pivot columns of 𝐴, and columns 2 and 4 are free. By Corollary 3.3.19(b), each free column of 𝐴 is the combination of the pivot columns to its left whose coefficients are the entries of the corresponding column of rref(𝐴):

𝐚2=2𝐚1=(2,2,4),𝐚4=−𝐚1+3𝐚3=(−1,−1+3,−2−3)=(−1,2,−5).

So

𝐴=(120−1121224−1−5).

(b) By Theorem 3.4.9, ker𝑇𝐴 is spanned by the basic solutions (Definition 3.4.8), one for each free column, read off from rref(𝐴): 𝐬1=(−2,1,0,0) and 𝐬2=(1,0,−3,1). As a check, 𝐴𝐬1=−2𝐚1+𝐚2=𝟎 and 𝐴𝐬2=𝐚1−3𝐚3+𝐚4=𝟎.

By (a), every column of 𝐴 is a combination of 𝐚1 and 𝐚3, so im𝑇𝐴=span(𝐚1,𝐚3) (Proposition 3.1.8(a)). A vector 𝐲 lies in it if and only if 𝐲=𝑠(1,1,2)+𝑡(0,1,−1)=(𝑠,𝑠+𝑡,2𝑠−𝑡) for some 𝑠,𝑡. Such 𝑠,𝑡 must be 𝑠=𝑦1 and 𝑡=𝑦2−𝑦1, and then the third entry is 2𝑦1−(𝑦2−𝑦1)=3𝑦1−𝑦2. So im𝑇𝐴={𝐲∈ℝ3|𝑦3=3𝑦1−𝑦2}.

Exercise 3.6.8.standard Let 𝐴∈𝐹𝑚×𝑛 and let 𝐻∈𝐹𝑛×𝑛 be invertible. Decide which of the following are always the same for 𝐴 and for 𝐴𝐻, with a proof or a counterexample.

  1. (a)The image im𝑇𝐴.
  2. (b)The kernel ker𝑇𝐴.
  3. (c)The set of row vectors 𝐳∈𝐹1×𝑚 with 𝐳𝐴=𝟎 (the relations among the rows).
  4. (d)The reduced row echelon form.
  5. (e)The rank.
  6. (f)Whether there is a left inverse.

Solution.

Uses. Proposition 3.2.30 (Column operations preserve the image), Non-example 3.2.31 (Column operations change the kernel), Corollary 3.2.23 (Row equivalent matrices have the same kernel), Proposition 2.4.23 (Transpose of a product), Exercise 3.5.41, Definition 2.5.1 (Left inverse)

Techniques. Transpose to trade rows for columns (Technique 3.2.27)

Hint 1. (a) and (b) are in Section 3.2.5. For (c), transpose: 𝐳𝐴=𝟎 says 𝐴𝖳𝐳𝖳=𝟎. What is (𝐴𝐻)𝖳?
Hint 2. For (d), try 𝐴=(01) and a swap. For (f), if 𝐶𝐴=𝐼𝑛, find a left inverse of 𝐴𝐻.
Sketch. (a) Same, Proposition 3.2.30. (b) Not always: (11) and (01). (c) Same: (𝐴𝐻)𝖳=𝐻𝖳𝐴𝖳 is a row operation applied to 𝐴𝖳, which keeps the kernel; or directly, 𝐳𝐴𝐻=𝟎⇔𝐳𝐴=𝟎. (d) Not always: (01) and (10). (e) Same, by Exercise 3.5.41(c). (f) Same: (𝐻−1𝐶)(𝐴𝐻)=𝐼𝑛.

Since 𝐴=(𝐴𝐻)𝐻−1 and 𝐻−1 is invertible, a property that passes from 𝐴 to 𝐴𝐻 for every invertible 𝐻 also passes back from 𝐴𝐻 to 𝐴. So in each “same” case it suffices to show one direction.

(a) Always the same, by Proposition 3.2.30.

(b) Not always. For 𝐴=(11) and 𝐻=𝐸1,−1,2 (which adds −1 times column 2 to column 1), 𝐴𝐻=(01), and the kernels are span((1,−1)) and span((1,0)) (Non-example 3.2.31).

(c) Always the same. Transposing, 𝐳𝐴=𝟎 says 𝐴𝖳𝐳𝖳=𝟎, that is, 𝐳𝖳∈ker𝑇𝐴𝖳. By Proposition 2.4.23, (𝐴𝐻)𝖳=𝐻𝖳𝐴𝖳, and 𝐻𝖳 is invertible, with inverse (𝐻−1)𝖳. So by Corollary 3.2.23, ker𝑇(𝐴𝐻)𝖳=ker𝑇𝐻𝖳𝐴𝖳=ker𝑇𝐴𝖳. (Directly: if 𝐳𝐴=𝟎 then 𝐳𝐴𝐻=𝟎, and the converse follows by multiplying on the right by 𝐻−1.) This is Corollary 3.2.23 seen in the mirror of Technique 3.2.27.

(d) Not always. 𝐴=(01) is in RREF, and with 𝐻=𝐸12, 𝐴𝐻=(10) is also in RREF. They are different matrices, so their reduced forms differ (and so do their pivot columns).

(e) Always the same, by Exercise 3.5.41(c).

(f) Always the same. If 𝐶𝐴=𝐼𝑛, then (𝐻−1𝐶)(𝐴𝐻)=𝐻−1(𝐶𝐴)𝐻=𝐻−1𝐻=𝐼𝑛, so 𝐻−1𝐶 is a left inverse of 𝐴𝐻.

Exercise 3.6.9.hard Let 𝐴∈𝐹𝑚×𝑛 and 𝐵∈𝐹𝑝×𝑛.

  1. (a)Show that ker𝑇𝐴⊆ker𝑇𝐵 if and only if 𝐵=𝑋𝐴 for some 𝑋∈𝐹𝑝×𝑚.
  2. (b)Deduce that ker𝑇𝐴⊆ker𝑇𝐵 if and only if every row of 𝐵 is a linear combination of the rows of 𝐴.

Solution.

Uses. Theorem 3.3.10 (𝐺𝐴=rref(𝐴)), Corollary 3.2.23 (Row equivalent matrices have the same kernel), Lemma 3.3.16 (Reading the columns of a matrix in RREF), Definition 2.3.8 (Matrix–vector product), Definition 2.4.1 (Matrix product)

Techniques. Reduce to RREF (Technique 3.3.22)

Hint 1. One direction is one line. For the other, first treat the case where 𝐴=𝑅 is in RREF, then use 𝑅=𝐺𝐴.
Hint 2. If 𝐴=𝑅 is in RREF with pivot columns 𝑝1,…,𝑝𝑟, guess 𝑌 with 𝑌𝑅=𝐵 from the pivot columns: 𝑅𝐞𝑝𝑠=𝐞𝑠, so 𝑌 must send 𝐞𝑠 to column 𝑝𝑠 of 𝐵.
Hint 3. For a free column 𝑗, the relation 𝐫𝑗=∑𝑠𝑟𝑠𝑗𝐫𝑝𝑠 among the columns of 𝑅 is a vector of ker𝑇𝑅. Transfer it to 𝐵.
Sketch. If 𝐵=𝑋𝐴 and 𝐴𝐱=𝟎, then 𝐵𝐱=𝟎. Conversely, let 𝑅=𝐺𝐴=rref(𝐴), so ker𝑇𝑅=ker𝑇𝐴⊆ker𝑇𝐵. Let 𝑌 have column 𝑠 equal to column 𝑝𝑠 of 𝐵 for 𝑠≤𝑟 and 𝟎 for 𝑠>𝑟. Every column of 𝑅 is 𝐫𝑗=∑𝑠≤𝑟𝑟𝑠𝑗𝐞𝑠, and the relation 𝐫𝑗=∑𝑠𝑟𝑠𝑗𝐫𝑝𝑠 lies in ker𝑇𝑅, so it holds in 𝐵: 𝐛𝑗=∑𝑠𝑟𝑠𝑗𝐛𝑝𝑠=𝑌𝐫𝑗. Hence 𝑌𝑅=𝐵, and 𝑋=𝑌𝐺 works. (b) Row 𝑘 of 𝑋𝐴 is the combination of the rows of 𝐴 with coefficients from row 𝑘 of 𝑋.

(a) Suppose 𝐵=𝑋𝐴. If 𝐴𝐱=𝟎, then 𝐵𝐱=𝑋(𝐴𝐱)=𝟎. So ker𝑇𝐴⊆ker𝑇𝐵.

Conversely, suppose ker𝑇𝐴⊆ker𝑇𝐵. By Theorem 3.3.10, 𝑅=rref(𝐴)=𝐺𝐴 for an invertible 𝐺, and ker𝑇𝑅=ker𝑇𝐴 (Corollary 3.2.23), so ker𝑇𝑅⊆ker𝑇𝐵. Let 𝑝1<⋯<𝑝𝑟 be the pivot columns, write 𝐫𝑗 and 𝐛𝑗 for the columns of 𝑅 and 𝐵, and let 𝑌∈𝐹𝑝×𝑚 be the matrix whose column 𝑠 is 𝐛𝑝𝑠 for 𝑠≤𝑟 and 𝟎 for 𝑠>𝑟. We show 𝑌𝑅=𝐵, column by column.

Fix 𝑗. By Lemma 3.3.16(a) (with 𝑠=𝑟), 𝐫𝑗=∑𝑠=1𝑟𝑟𝑠𝑗𝐞𝑠, so by Definition 2.3.8,

𝑌𝐫𝑗=∑𝑠=1𝑟𝑟𝑠𝑗𝑌𝐞𝑠=∑𝑠=1𝑟𝑟𝑠𝑗𝐛𝑝𝑠.

On the other hand, 𝐫𝑝𝑠=𝐞𝑠 (Lemma 3.3.16(b)), so 𝐫𝑗=∑𝑠=1𝑟𝑟𝑠𝑗𝐫𝑝𝑠. This says that the vector

𝐱=𝐞𝑗−∑𝑠=1𝑟𝑟𝑠𝑗𝐞𝑝𝑠

satisfies 𝑅𝐱=𝟎. (If 𝑗=𝑝𝑡 is itself a pivot column, then 𝑟𝑠𝑗=0 for 𝑠≠𝑡 and 𝑟𝑡𝑗=1, so 𝐱=𝟎, and the argument still works.) Hence 𝐱∈ker𝑇𝐵, that is, 𝐛𝑗=∑𝑠𝑟𝑠𝑗𝐛𝑝𝑠=𝑌𝐫𝑗. So the columns of 𝑌𝑅 are those of 𝐵, and 𝑌𝑅=𝐵 (Definition 2.4.1). With 𝑋=𝑌𝐺, we get 𝑋𝐴=𝑌(𝐺𝐴)=𝑌𝑅=𝐵, as desired.

(b) By the row description of a product (Definition 2.4.1, as in the second proof of Proposition 3.2.7), row 𝑘 of 𝑋𝐴 is 𝑥𝑘1 times row 1 of 𝐴, plus ⋯, plus 𝑥𝑘𝑚 times row 𝑚 of 𝐴. So “𝐵=𝑋𝐴 for some 𝑋” says exactly that every row of 𝐵 is a linear combination of the rows of 𝐴, and (b) is a restatement of (a).

If ker𝑇𝐴=ker𝑇𝐵, then (b) applies in both directions, so 𝐴 and 𝐵 have the same row space; this generalizes one half of Exercise 3.3.50(b) to matrices with different numbers of rows. The proof of (a) is the second proof of Theorem 3.3.17 once more: it used only relations among the columns.

Exercise 3.6.10.standard For 𝑋=(𝑎𝑏𝑐𝑑)∈𝐹2×2, let 𝐷(𝑋)=𝑎𝑑−𝑏𝑐. Prove that 𝐷(𝑋𝑌)=𝐷(𝑋)𝐷(𝑌) for all 𝑋,𝑌∈𝐹2×2, by reducing to elementary matrices: first for invertible 𝑋, then separately for 𝑋 that are not invertible. You may use Exercise 3.2.42.

Solution.

Uses. Exercise 3.2.42, Theorem 3.5.19 (Invertible matrices are products of elementary matrices), Theorem 3.3.10 (𝐺𝐴=rref(𝐴)), Theorem 3.3.23 (Invertibility and RREF), Corollary 3.4.20 (Square systems), Proposition 3.3.8 (Properties of the output), Proposition 3.2.10 (Inverses of elementary matrices)

Techniques. Reduce to elementary matrices (Technique 5.4.6), Reduce to RREF (Technique 3.3.22)

Hint 1. By Exercise 3.2.42, 𝐷(𝐸𝑌)=𝐷(𝐸)𝐷(𝑌) for every elementary 𝐸 and every 𝑌: check that 𝐷(𝐸) is 1, −1, or 𝑠 for the three types.
Hint 2. If 𝑋=𝐸1⋯𝐸𝑡, apply the previous hint 𝑡 times, once to 𝑋𝑌 and once to 𝑋=𝑋𝐼2.
Hint 3. If 𝑋 is not invertible, write 𝑋=𝐺−1𝑅 with 𝑅=rref(𝑋)≠𝐼2. What is the second row of 𝑅, and of 𝑅𝑌?
Sketch. For elementary 𝐸, 𝐷(𝐸𝑌)=𝐷(𝐸)𝐷(𝑌): the factors 1, −1, 𝑠 of Exercise 3.2.42 are 𝐷(𝐸). For 𝑋=𝐸1⋯𝐸𝑡, induction gives 𝐷(𝑋𝑌)=𝐷(𝐸1)⋯𝐷(𝐸𝑡)𝐷(𝑌), and with 𝑌=𝐼2, 𝐷(𝑋)=𝐷(𝐸1)⋯𝐷(𝐸𝑡). If 𝑋 is not invertible, 𝑋=𝑃𝑅 with 𝑃=𝐺−1 a product of elementary matrices and 𝑅=rref(𝑋) having zero second row; then 𝐷(𝑋𝑌)=𝐷(𝑃)𝐷(𝑅𝑌)=0 and 𝐷(𝑋)=𝐷(𝑃)𝐷(𝑅)=0.

Step 1: elementary matrices. By Exercise 3.2.42, for every 𝑌∈𝐹2×2, 𝐷(𝐸𝑌)=𝐷(𝑌) if 𝐸 has type 3, 𝐷(𝐸12𝑌)=−𝐷(𝑌), and 𝐷(𝐸𝑖𝑠𝑌)=𝑠𝐷(𝑌). Directly from the definition, 𝐷(𝐸)=1 for 𝐸=(10𝑡1) or (1𝑡01), 𝐷(𝐸12)=0⋅0−1⋅1=−1, and 𝐷(𝐸1𝑠)=𝐷(𝐸2𝑠)=𝑠. So in all cases

𝐷(𝐸𝑌)=𝐷(𝐸)𝐷(𝑌)for every elementary𝐸and every𝑌.
(3.6.1)

Step 2: invertible 𝑋. By Theorem 3.5.19, 𝑋=𝐸1𝐸2⋯𝐸𝑡 with each 𝐸𝑖 elementary. Applying (3.6.1) 𝑡 times,

𝐷(𝑋𝑌)=𝐷(𝐸1(𝐸2⋯𝐸𝑡𝑌))=𝐷(𝐸1)𝐷(𝐸2⋯𝐸𝑡𝑌)=⋯=𝐷(𝐸1)⋯𝐷(𝐸𝑡)𝐷(𝑌).

With 𝑌=𝐼2, and 𝐷(𝐼2)=1, this gives 𝐷(𝑋)=𝐷(𝐸1)⋯𝐷(𝐸𝑡). Hence 𝐷(𝑋𝑌)=𝐷(𝑋)𝐷(𝑌).

Step 3: 𝑋 not invertible. Let 𝑅=rref(𝑋)=𝐺𝑋 with 𝐺 a product of elementary matrices (Theorem 3.3.10). Since 𝑋 is not invertible, 𝑅≠𝐼2 (Theorem 3.3.23). A 2×2 matrix in RREF with two pivots is 𝐼2 (Corollary 3.4.20, (i) ⇔ (iii)), so 𝑅 has at most one pivot and its second row is zero (Proposition 3.3.8(a)). Then the second row of 𝑅𝑌 is zero as well (row 2 of 𝑅𝑌 is row 2 of 𝑅 times 𝑌), so 𝐷(𝑅)=0 and 𝐷(𝑅𝑌)=0, since a matrix with zero second row has 𝑐=𝑑=0. Now 𝑃=𝐺−1 is a product of elementary matrices (Proposition 3.2.10), and 𝑋=𝑃𝑅, so Step 2 applied to 𝑃 gives

𝐷(𝑋𝑌)=𝐷(𝑃(𝑅𝑌))=𝐷(𝑃)𝐷(𝑅𝑌)=0,𝐷(𝑋)=𝐷(𝑃𝑅)=𝐷(𝑃)𝐷(𝑅)=0.

So 𝐷(𝑋𝑌)=0=𝐷(𝑋)𝐷(𝑌).

Step 3 is the part that is easy to forget, since a matrix that is not invertible is not a product of elementary matrices at all. In Section 5.4 the same strategy (elementary matrices, then invertible matrices, then a separate argument for the rest) proves det(𝐴𝐵)=det𝐴det𝐵 for every 𝑛 (Theorem 5.4.10).

Exercise 3.6.11.standard Start with a real 𝑚×𝑛 matrix. A move chooses a row or a column whose entries have a negative sum and multiplies every entry of it by −1.

  1. (a)Show that every sequence of moves is finite, whatever choices are made.
  2. (b)Deduce that some finite sequence of moves produces a matrix all of whose row sums and column sums are nonnegative.
  3. (c)Express the final matrix as 𝐷1𝐴𝐷2, where 𝐴 is the starting matrix and 𝐷1, 𝐷2 are products of elementary matrices of one type.

Solution.

Uses. Proposition 3.2.7 (Row operations are left multiplications), Proposition 3.2.28 (Column operations are right multiplications)

Techniques. Algorithms as proofs: invariants and termination (Technique 3.3.5)

Hint 1. Look for a quantity that every move increases. What happens to the sum of all entries when a row with sum 𝑠<0 is negated?
Hint 2. An increasing quantity proves termination only if it can take finitely many values. Which matrices can occur? Find an invariant relating each entry to the starting entry.
Sketch. Invariant: every entry is ± the corresponding starting entry, so at most 2𝑚𝑛 matrices can occur. Monovariant: negating a row or column with sum 𝑠<0 changes the total sum 𝑆 by −2𝑠>0. So 𝑆 strictly increases, no matrix occurs twice, and there are fewer than 2𝑚𝑛 moves. When no move is possible, all row and column sums are ≥0. Each move is left multiplication by 𝐸𝑖,−1 or right multiplication by 𝐸𝑗,−1.

(a) Let 𝐴 be the starting matrix and 𝑀 the current one.

Invariant. Every entry of 𝑀 is ± the corresponding entry of 𝐴. This holds at the start, and a move multiplies some entries by −1, which keeps it true. So 𝑀 is one of at most 2𝑚𝑛 matrices (two choices of sign for each entry).

Monovariant. Let 𝑆(𝑀) be the sum of all entries of 𝑀. If a move negates a row or column whose entries sum to 𝑠<0, the entries of that line now sum to −𝑠, and no other entry changes, so 𝑆 changes by −𝑠−𝑠=−2𝑠>0. So 𝑆 strictly increases with every move.

In a sequence of moves 𝑀0=𝐴,𝑀1,𝑀2,…, the values 𝑆(𝑀0)<𝑆(𝑀1)<⋯ are distinct, so the matrices 𝑀0,𝑀1,… are distinct. By the invariant they come from a set of at most 2𝑚𝑛 matrices, so the sequence has at most 2𝑚𝑛 terms, that is, fewer than 2𝑚𝑛 moves.

(b) Make moves as long as one is possible. By (a) this stops, and it stops exactly when no row and no column has a negative sum.

(c) Negating row 𝑖 is left multiplication by 𝐸𝑖,−1 (Proposition 3.2.7), and negating column 𝑗 is right multiplication by the 𝑛×𝑛 matrix 𝐸𝑗,−1 (Proposition 3.2.28). Since (𝐸𝑋)𝐸′=𝐸(𝑋𝐸′), the final matrix is 𝐷1𝐴𝐷2, where 𝐷1 is the product of the row negations (the last one leftmost) and 𝐷2 the product of the column negations (the first one leftmost). Both are diagonal with entries ±1, and they are products of type 2 elementary matrices.

The proof follows the two halves of Technique 3.3.5. The monovariant alone would not do: an increasing real number can increase forever. The invariant supplies the finiteness.

Exercise 3.6.12.standard
  1. (a)Find all 𝑝∈ℚ[𝑥]≤4 such that 𝑝(𝑡+1)−𝑝(𝑡)=𝑡3 for every 𝑡∈ℚ.
  2. (b)Deduce that 03+13+⋯+(𝑁−1)3=(𝑁(𝑁−1)/2)2 for every integer 𝑁≥1.

Solution.

Uses. Definition 1.2.17 (Evaluation), Lemma 3.4.23 (Too many roots), Proposition 3.1.19 (Solution sets are translates of the kernel)

Techniques. Undetermined coefficients (Technique 3.1.9), Particular plus homogeneous (Technique 3.1.18)

Hint 1. Write 𝑝=𝑎0+𝑎1𝑥+⋯+𝑎4𝑥4 and expand (𝑡+1)𝑘−𝑡𝑘 for 𝑘=1,…,4. The difference 𝑝(𝑡+1)−𝑝(𝑡) is then a polynomial expression of degree at most 3 in 𝑡.
Hint 2. A polynomial of degree at most 3 that vanishes at every 𝑡∈ℚ is the zero polynomial (Lemma 3.4.23). So you may compare coefficients: four linear equations in 𝑎1,…,𝑎4.
Hint 3. The system is triangular. What does 𝑎0 do? For (b), sum 𝑝(𝑘+1)−𝑝(𝑘) over 𝑘=0,…,𝑁−1.
Sketch. The difference is (𝑎1+𝑎2+𝑎3+𝑎4)+(2𝑎2+3𝑎3+4𝑎4)𝑡+(3𝑎3+6𝑎4)𝑡2+4𝑎4𝑡3. Comparing with 𝑡3: 𝑎4=1/4, 𝑎3=−1/2, 𝑎2=1/4, 𝑎1=0, and 𝑎0 is free. So 𝑝=(𝑥(𝑥−1)/2)2+𝑎0: a particular solution plus the constants, which are the homogeneous solutions. Telescoping gives (b).

(a) Write 𝑝=𝑎0+𝑎1𝑥+𝑎2𝑥2+𝑎3𝑥3+𝑎4𝑥4. By the binomial theorem,

(𝑡+1)−𝑡=1,(𝑡+1)2−𝑡2=2𝑡+1,(𝑡+1)3−𝑡3=3𝑡2+3𝑡+1,(𝑡+1)4−𝑡4=4𝑡3+6𝑡2+4𝑡+1,

so for every 𝑡∈ℚ (Definition 1.2.17),

𝑝(𝑡+1)−𝑝(𝑡)=𝑐0+𝑐1𝑡+𝑐2𝑡2+𝑐3𝑡3,

where

𝑐0=𝑎1+𝑎2+𝑎3+𝑎4,𝑐1=2𝑎2+3𝑎3+4𝑎4,𝑐2=3𝑎3+6𝑎4,𝑐3=4𝑎4.

The condition is that 𝑞=(𝑐0−0)+𝑐1𝑥+𝑐2𝑥2+(𝑐3−1)𝑥3∈ℚ[𝑥]≤3 satisfies 𝑞(𝑡)=0 for every 𝑡∈ℚ. If 𝑞 vanishes at all of ℚ, it vanishes at the four distinct points 0,1,2,3, so 𝑞=𝟎 by Lemma 3.4.23; conversely, 𝑞=𝟎 certainly vanishes everywhere. So the condition is the linear system

𝑎1+𝑎2+𝑎3+𝑎4=0,2𝑎2+3𝑎3+4𝑎4=0,3𝑎3+6𝑎4=0,4𝑎4=1

in the unknowns 𝑎0,…,𝑎4, in which 𝑎0 does not occur. Solving from the bottom: 𝑎4=1/4, 𝑎3=−2𝑎4=−1/2, 2𝑎2=−3𝑎3−4𝑎4=3/2−1=1/2, so 𝑎2=1/4, and 𝑎1=−(𝑎2+𝑎3+𝑎4)=0. So the solutions are

𝑝=𝑎0+14𝑥2−12𝑥3+14𝑥4(𝑎0∈ℚ),

and 14𝑥2−12𝑥3+14𝑥4 is the polynomial whose value at 𝑡 is (𝑡(𝑡−1)/2)2, since 𝑡2(𝑡−1)2=𝑡4−2𝑡3+𝑡2. In the language of Proposition 3.1.19, applied to the linear map 𝑝↦(𝑝(𝑡+1)−𝑝(𝑡))𝑡, this is a particular solution plus the homogeneous solutions, which are the constants: the same triangular system with right-hand side 0 forces 𝑎1=⋯=𝑎4=0.

(b) Let 𝑝 be the solution with 𝑎0=0, so 𝑝(𝑡)=(𝑡(𝑡−1)/2)2. Summing 𝑝(𝑘+1)−𝑝(𝑘)=𝑘3 over 𝑘=0,…,𝑁−1, the left side telescopes:

03+13+⋯+(𝑁−1)3=𝑝(𝑁)−𝑝(0)=(𝑁(𝑁−1)/2)2.

The method needs a field in which comparing coefficients is allowed, which used four distinct points 0,1,2,3, and in which 2, 3, 4 are nonzero, for the triangular solve. Over 𝔽𝑝 with 𝑝≥5 both hold. Over 𝔽2 and 𝔽3 both fail: for instance 𝑥3−𝑥 vanishes at every point of 𝔽3, so a polynomial identity on the field no longer determines the coefficients.

Exercise 3.6.13.standard Let 𝑛≥3. Read indices modulo 𝑛, so that 𝑥0=𝑥𝑛 and 𝑥𝑛+1=𝑥1.

  1. (a)Show that for every 𝐲∈ℝ𝑛 there is exactly one 𝐱∈ℝ𝑛 with

    4𝑥𝑖−𝑥𝑖−1−𝑥𝑖+1=𝑦𝑖(𝑖=1,…,𝑛).
  2. (b)Now replace 4 by 2. Show that the system 2𝑥𝑖−𝑥𝑖−1−𝑥𝑖+1=𝑦𝑖 (𝑖=1,…,𝑛) has a solution if and only if 𝑦1+⋯+𝑦𝑛=0. You may use Exercise 3.5.37.

Solution.

Hint 1. The system in (a) is square. By Corollary 3.4.20 it suffices to show that 4𝑥𝑖=𝑥𝑖−1+𝑥𝑖+1 for all 𝑖 forces 𝐱=𝟎.
Hint 2. Choose 𝑘 with |𝑥𝑘| as large as possible, and compare 4|𝑥𝑘| with |𝑥𝑘−1|+|𝑥𝑘+1|.
Hint 3. In (b), the vector (1,…,1) is a homogeneous solution. Show it spans the homogeneous solutions (look at a largest entry again), note that the matrix is symmetric, and apply Exercise 3.5.37.
Sketch. (a) For a homogeneous solution, take 𝑘 with |𝑥𝑘| maximal: 4|𝑥𝑘|≤|𝑥𝑘−1|+|𝑥𝑘+1|≤2|𝑥𝑘|, so 𝑥𝑘=0 and 𝐱=𝟎; the system is square, so Corollary 3.4.20 gives existence and uniqueness. (b) Summing the equations gives 0=∑𝑦𝑖, which is necessary. The homogeneous solutions are the constant vectors (at a largest entry 𝑥𝑘, both neighbors equal 𝑥𝑘; go around the cycle). The matrix 𝐿 is symmetric, so 𝐳𝖳𝐿=𝟎 iff 𝐿𝐳=𝟎 iff 𝐳 is constant, and Exercise 3.5.37 says 𝐿𝐱=𝐲 is solvable iff 𝐳𝖳𝐲=0 for those 𝐳, that is, iff ∑𝑦𝑖=0.

(a) This is a system of 𝑛 equations in 𝑛 unknowns, so by Corollary 3.4.20 ((iv) ⇒ (vi)) it suffices to show that the homogeneous system has only the trivial solution. Let 𝐱 satisfy 4𝑥𝑖=𝑥𝑖−1+𝑥𝑖+1 for all 𝑖, and choose 𝑘 with |𝑥𝑘|≥|𝑥𝑖| for all 𝑖 (an extremal choice). Then

4|𝑥𝑘|=|𝑥𝑘−1+𝑥𝑘+1|≤|𝑥𝑘−1|+|𝑥𝑘+1|≤2|𝑥𝑘|,

so 2|𝑥𝑘|≤0 and 𝑥𝑘=0. As |𝑥𝑘| is the largest of the |𝑥𝑖|, every 𝑥𝑖=0.

(b) Let 𝐿∈ℝ𝑛×𝑛 be the coefficient matrix: 2 on the diagonal, −1 in the positions (𝑖,𝑖−1) and (𝑖,𝑖+1) (modulo 𝑛), and 0 elsewhere. It is symmetric, 𝐿𝖳=𝐿, because 𝑗=𝑖+1 exactly when 𝑖=𝑗−1. Let 𝟏=(1,…,1).

Necessity. Each 𝑥𝑗 occurs in three equations, with total coefficient 2−1−1=0 (in equation 𝑗 with 2, and in equations 𝑗−1 and 𝑗+1 with −1; these are three different equations since 𝑛≥3). So summing all equations gives 0=𝑦1+⋯+𝑦𝑛, and a solution can exist only if ∑𝑦𝑖=0.

The homogeneous solutions are the constant vectors. Constant vectors are solutions, since 2𝑐−𝑐−𝑐=0. Conversely, let 𝐿𝐱=𝟎, and let 𝑥𝑘 be a largest entry. Then 2𝑥𝑘=𝑥𝑘−1+𝑥𝑘+1 with 𝑥𝑘−1≤𝑥𝑘 and 𝑥𝑘+1≤𝑥𝑘, which forces 𝑥𝑘−1=𝑥𝑘+1=𝑥𝑘. So the neighbors of a largest entry are largest entries too, and going around the cycle, all entries equal 𝑥𝑘. Thus 𝐿𝐱=𝟎 if and only if 𝐱∈span(𝟏).

Sufficiency. Suppose ∑𝑦𝑖=0 but 𝐿𝐱=𝐲 has no solution. By Exercise 3.5.37 there is 𝐳 with 𝐳𝖳𝐿=𝟎 and 𝐳𝖳𝐲≠0. Transposing (Proposition 2.4.23), 𝐿𝖳𝐳=𝐿𝐳=𝟎, so 𝐳=𝑐𝟏 for some 𝑐, and then 𝐳𝖳𝐲=𝑐(𝑦1+⋯+𝑦𝑛)=0, a contradiction.

So with 4 the homogeneous system has only the trivial solution and every 𝐲 is reached; with 2 there is a homogeneous solution 𝟏, and in exchange one condition on 𝐲. For a square system the two failures come together, as Corollary 3.4.20 says they must.

Exercise 3.6.14.routine For 𝑝=𝑎+𝑏𝑥+𝑐𝑥2∈ℝ[𝑥]≤2, write 𝑝′=𝑏+2𝑐𝑥. Find the error in the following argument, and decide for which (𝑢,𝑣,𝑤)∈ℝ3 the conclusion holds.

Claim. For all 𝑢,𝑣,𝑤∈ℝ there is exactly one 𝑝∈ℝ[𝑥]≤2 with 𝑝(0)=𝑢, 𝑝(1)=𝑣, and 𝑝′(1/2)=𝑤.

Proof. The three conditions are linear equations in the three unknown coefficients of 𝑝. The system is square, so by Technique 3.4.21 it has exactly one solution.

Solution.

Uses. Corollary 3.4.20 (Square systems), Proposition 3.1.19 (Solution sets are translates of the kernel)

Techniques. Uniqueness gives existence (Technique 3.4.21)

Hint 1. Squareness only sets the technique up; its content is the homogeneous uniqueness. Check it: is there a nonzero 𝑝 with 𝑝(0)=𝑝(1)=𝑝′(1/2)=0?
Hint 2. Compare 𝑝′(1/2) with 𝑝(1)−𝑝(0) for a general 𝑝.
Sketch. The argument never proves that the homogeneous system has only the trivial solution, and it does not: 𝑥2−𝑥 is a nonzero solution. Since 𝑝′(1/2)=𝑏+𝑐=𝑝(1)−𝑝(0) for every 𝑝, a solution exists only if 𝑤=𝑣−𝑢, and then the solutions are 𝑢+(𝑣−𝑢)𝑥+𝑡(𝑥2−𝑥), infinitely many. So the claim fails for every (𝑢,𝑣,𝑤).

The argument checks that the problem is linear and square, which is what makes Technique 3.4.21 applicable, and then skips the technique itself: the homogeneous problem must be shown to have only the trivial solution, and here it does not. For 𝑝=𝑎+𝑏𝑥+𝑐𝑥2, the homogeneous conditions are 𝑎=0, 𝑎+𝑏+𝑐=0, and 𝑏+𝑐=0, and 𝑝=𝑥2−𝑥 (that is, 𝑎=0, 𝑏=−1, 𝑐=1) satisfies all three.

In fact, for every 𝑝,

𝑝(1)−𝑝(0)=𝑏+𝑐=𝑝′(1/2).

So a solution can exist only if 𝑤=𝑣−𝑢. If 𝑤=𝑣−𝑢, then 𝑢+(𝑣−𝑢)𝑥 is a solution, and by Proposition 3.1.19 the solutions are 𝑢+(𝑣−𝑢)𝑥+𝑡(𝑥2−𝑥) for 𝑡∈ℝ, since the homogeneous solutions are the multiples of 𝑥2−𝑥 (the first two homogeneous equations give 𝑎=0 and 𝑐=−𝑏, and the third is then automatic). So the conclusion “exactly one” holds for no (𝑢,𝑣,𝑤): there are no solutions when 𝑤≠𝑣−𝑢 and infinitely many when 𝑤=𝑣−𝑢. By Corollary 3.4.20 this had to be so once uniqueness failed.