Books
Theme
Text size
Width

[ and ] go to the previous and next page.

By Theorem 2.2.1, a linear map 𝑇:𝑉→𝑊 is determined by its values 𝑇(𝐯1),…,𝑇(𝐯𝑛) on a basis 𝐯1,…,𝐯𝑛 of 𝑉, and these values can be any list in 𝑊 (Corollary 2.2.18). If 𝑊 has a basis 𝐰1,…,𝐰𝑚 as well, each value 𝑇(𝐯𝑗) is in turn determined by its coordinate vector in 𝐹𝑚. So 𝑇 is recorded by 𝑚𝑛 scalars, and writing the 𝑛 coordinate vectors side by side gives an 𝑚×𝑛 matrix, the matrix of 𝑇. Two things then have to be worked out: how to recover the values of 𝑇 from its matrix, which will force the definition of the matrix–vector product, and how much the matrix depends on the chosen bases, which turns out to be a great deal.

Throughout this section, 𝑉 and 𝑊 are vector spaces over 𝐹 with bases ℬ︀=𝐯1,…,𝐯𝑛 of 𝑉 and 𝒞︀=𝐰1,…,𝐰𝑚 of 𝑊, where 𝑛,𝑚≥1, unless other bases are named. (We leave out the zero space, because matrices with no rows or no columns are not defined in Definition 1.2.7.)

2.3.1The matrix of a linear map

Definition 2.3.1 (Matrix of a linear map). Let 𝑇∈L(𝑉,𝑊). The matrix of 𝑇 with respect to ℬ︀ and 𝒞︀ is the 𝑚×𝑛 matrix

[𝑇]𝒞︀ℬ︀=([𝑇(𝐯1)]𝒞︀[𝑇(𝐯2)]𝒞︀⋯[𝑇(𝐯𝑛)]𝒞︀)

whose 𝑗-th column is the coordinate vector of 𝑇(𝐯𝑗) with respect to 𝒞︀. Equivalently, its entries 𝑎𝑖𝑗 are the scalars with

𝑇(𝐯𝑗)=𝑎1𝑗𝐰1+𝑎2𝑗𝐰2+⋯+𝑎𝑚𝑗𝐰𝑚(𝑗=1,…,𝑛).

For an operator 𝑇∈L(𝑉), the matrix of 𝑇 with respect to ℬ︀ is [𝑇]ℬ︀ℬ︀.

The matrix is well defined, since each 𝑇(𝐯𝑗) has exactly one coordinate vector with respect to the basis 𝒞︀ (Definition 1.6.14).

The matrix has one column for each vector of ℬ︀ and one row for each vector of 𝒞︀, so its size is (length of 𝒞︀) × (length of ℬ︀). Column 𝑗 records where 𝑇 sends the 𝑗-th basis vector of the domain, written in the coordinates of the target, and the entry 𝑎𝑖𝑗 is the coefficient of 𝐰𝑖 in 𝑇(𝐯𝑗). To keep the indices straight, imagine 𝐯1,…,𝐯𝑛 written above the columns and 𝐰1,…,𝐰𝑚 written to the left of the rows. The target basis comes first in [𝑇]𝒞︀ℬ︀ so that the two copies of ℬ︀ sit next to each other in the formula [𝑇]𝒞︀ℬ︀[𝐯]ℬ︀=[𝑇(𝐯)]𝒞︀ of Theorem 2.3.9 below. We always write both subscripts, even when they are equal.

Notation 2.3.2 (The standard basis ℰ︀). We write ℰ︀ for the standard basis 𝐞1,…,𝐞𝑘 of 𝐹𝑘 (Definition 1.6.8), with 𝑘 determined by the context. Since 𝐲=𝑦1𝐞1+⋯+𝑦𝑘𝐞𝑘 for 𝐲=(𝑦1,…,𝑦𝑘)∈𝐹𝑘, we have [𝐲]ℰ︀=𝐲. That is, in the standard basis a vector of 𝐹𝑘 is its own coordinate vector.

In particular, for a linear map 𝑇:𝐹𝑛→𝐹𝑚, the matrix [𝑇]ℰ︀ℰ︀ with respect to the standard bases of 𝐹𝑛 and 𝐹𝑚 has the columns 𝑇(𝐞1),…,𝑇(𝐞𝑛).

Example 2.3.3 (Matrices with respect to standard bases).
  1. (a)Let 𝑇:ℝ3→ℝ2, 𝑇(𝑥,𝑦,𝑧)=(2𝑥−𝑦+3𝑧,𝑥+5𝑧), the map of Example 2.1.7. Then 𝑇(𝐞1)=(2,1), 𝑇(𝐞2)=(−1,0), and 𝑇(𝐞3)=(3,5), so

    [𝑇]ℰ︀ℰ︀=(2−13105).

    This is the matrix 𝐴 of Example 2.1.7: the coefficient of the 𝑗-th variable in the 𝑖-th coordinate of 𝑇(𝑥,𝑦,𝑧) is the entry in row 𝑖 and column 𝑗. Proposition 2.3.17 shows that this always happens.

  2. (b)The rotation 𝑅𝜃 of ℝ2 by the angle 𝜃 (Example 2.1.11) sends 𝐞1 to (cos𝜃,sin𝜃) and 𝐞2 to (−sin𝜃,cos𝜃), so

    [𝑅𝜃]ℰ︀ℰ︀=(cos𝜃−sin𝜃sin𝜃cos𝜃),for example[𝑅𝜋/2]ℰ︀ℰ︀=(0−110).

Example 2.3.4 (Differentiation). Let 𝑉=𝐹[𝑥]≤2. Every element of 𝑉 is 𝑎+𝑏𝑥+𝑐𝑥2 for exactly one triple (𝑎,𝑏,𝑐)∈𝐹3 (Definition 1.2.13, Definition 1.2.16), so ℬ︀=1,𝑥,𝑥2 is a basis of 𝑉 and [𝑎+𝑏𝑥+𝑐𝑥2]ℬ︀=(𝑎,𝑏,𝑐). Differentiation does not raise degrees, so 𝐷 maps 𝑉 into 𝑉, and we regard it as an operator 𝐷∈L(𝑉) (Example 2.1.9). Since

𝐷(1)=𝟎,𝐷(𝑥)=1,𝐷(𝑥2)=2𝑥,

whose coordinate vectors are (0,0,0), (1,0,0), and (0,2,0),

[𝐷]ℬ︀ℬ︀=(010002000).

Over 𝔽2 the entry 2 is 0. The domain and the target can also be different spaces. Regarded as a map 𝐹[𝑥]≤3→𝐹[𝑥]≤2, with the bases ℬ︀′=1,𝑥,𝑥2,𝑥3 and ℬ︀, differentiation has the 3×4 matrix

[𝐷]ℬ︀ℬ︀′=(010000200003).

Strictly speaking these are two different linear maps, since their domains differ.

Definition 2.3.5 (Identity matrix). The 𝑛×𝑛 identity matrix 𝐼𝑛 is the matrix with columns 𝐞1,…,𝐞𝑛. Its entry in row 𝑖 and column 𝑗 is 1 if 𝑖=𝑗 and 0 if 𝑖≠𝑗. We write 𝐼 when 𝑛 is clear from the context.

Example 2.3.6 (The zero map and the identity map). The zero map 0∈L(𝑉,𝑊) sends each 𝐯𝑗 to 𝟎, whose coordinate vector is 𝟎. So [0]𝒞︀ℬ︀ is the zero matrix, for all bases. The identity map sends 𝐯𝑗 to 𝐯𝑗=0𝐯1+⋯+1𝐯𝑗+⋯+0𝐯𝑛, whose ℬ︀-coordinate vector is 𝐞𝑗. So

[id𝑉]ℬ︀ℬ︀=𝐼𝑛for every basisℬ︀of𝑉.

Here the same basis is used on both sides. Section 2.3.5 shows that [id𝑉]𝒞︀ℬ︀ looks quite different when 𝒞︀≠ℬ︀.

Exercise 2.3.7.routine Let 𝑇:𝐹[𝑥]≤1→𝐹2, 𝑇(𝑝)=(𝑝(0),𝑝(1)). Find [𝑇]ℰ︀ℬ︀ for the basis ℬ︀=1,𝑥, and [𝑇]ℰ︀ℬ︀̊ for the basis ℬ︀̊=1−𝑥,𝑥.

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Notation 2.3.2 (The standard basis ℰ︀), Example 2.1.9 (Maps of polynomials)

Hint 1. Each coordinate of 𝑇(𝑝) is an evaluation, so 𝑇 is linear. The columns of [𝑇]ℰ︀ℬ︀ are 𝑇(1) and 𝑇(𝑥).
Hint 2. For ℬ︀̊, compute 𝑇(1−𝑥) and 𝑇(𝑥). You should also check that ℬ︀̊ is a basis.
Sketch. 𝑇(1)=(1,1) and 𝑇(𝑥)=(0,1), so [𝑇]ℰ︀ℬ︀=(1011). 𝑇(1−𝑥)=(1,0) and 𝑇(𝑥)=(0,1), so [𝑇]ℰ︀ℬ︀̊=𝐼2.

The coordinates of 𝑇(𝑝) are ev0(𝑝) and ev1(𝑝), which are linear in 𝑝 (Example 2.1.9), so 𝑇(𝑐𝑝+𝑞)=𝑐𝑇(𝑝)+𝑇(𝑞) coordinate by coordinate, and 𝑇 is linear. By Notation 2.3.2, the columns of [𝑇]ℰ︀ℬ︀ are 𝑇(1)=(1,1) and 𝑇(𝑥)=(0,1):

[𝑇]ℰ︀ℬ︀=(1011).

The list ℬ︀̊ is a basis: 𝑐(1−𝑥)+𝑑𝑥=𝑐+(𝑑−𝑐)𝑥 equals 𝑎+𝑏𝑥 exactly when 𝑐=𝑎 and 𝑑=𝑎+𝑏. Since 𝑇(1−𝑥)=(1,0) and 𝑇(𝑥)=(0,1),

[𝑇]ℰ︀ℬ︀̊=(1001)=𝐼2.

The same map has two different matrices. In the second basis the coordinates of 𝑝 are exactly its values at 0 and 1.

2.3.2The matrix–vector product

Suppose we know 𝐴=[𝑇]𝒞︀ℬ︀ and the coordinates [𝐯]ℬ︀=(𝑥1,…,𝑥𝑛) of a vector 𝐯∈𝑉, and we want the coordinates of 𝑇(𝐯).

Intuition (Computing [𝑇(𝐯)]𝒞︀). Since 𝐯=𝑥1𝐯1+⋯+𝑥𝑛𝐯𝑛, linearity of 𝑇 gives 𝑇(𝐯)=𝑥1𝑇(𝐯1)+⋯+𝑥𝑛𝑇(𝐯𝑛). Taking 𝒞︀-coordinates is linear as well (Proposition 1.6.19), so

[𝑇(𝐯)]𝒞︀=𝑥1[𝑇(𝐯1)]𝒞︀+⋯+𝑥𝑛[𝑇(𝐯𝑛)]𝒞︀.

The right side is the linear combination of the columns of 𝐴 whose coefficients are the entries of [𝐯]ℬ︀. Realize that it no longer mentions 𝑇, the spaces 𝑉 and 𝑊, or the bases: it is computed from the matrix 𝐴 and the column (𝑥1,…,𝑥𝑛) alone. So it is an operation on a matrix and a column, and we give it a name.

Definition 2.3.8 (Matrix–vector product). Let 𝐴∈𝐹𝑚×𝑛 have columns 𝐚1,…,𝐚𝑛∈𝐹𝑚, and let 𝐱=(𝑥1,…,𝑥𝑛)∈𝐹𝑛. The product of 𝐴 and 𝐱 is

𝐴𝐱=𝑥1𝐚1+𝑥2𝐚2+⋯+𝑥𝑛𝐚𝑛∈𝐹𝑚.

It is defined only when the number of columns of 𝐴 equals the number of entries of 𝐱, and then 𝐴𝐱 has as many entries as 𝐴 has rows.

In words, 𝐴𝐱 is the linear combination of the columns of 𝐴 with coefficients 𝑥1,…,𝑥𝑛. With this definition, the computation above becomes a theorem.

Theorem 2.3.9 (The matrix of a map computes the map). For every 𝑇∈L(𝑉,𝑊) and every 𝐯∈𝑉,

[𝑇]𝒞︀ℬ︀[𝐯]ℬ︀=[𝑇(𝐯)]𝒞︀.

Proof.routine

Uses. Definition 2.3.1 (Matrix of a linear map), Definition 2.3.8 (Matrix–vector product), Definition 1.6.14 (Coordinates), Proposition 1.6.19 (Coordinates respect linear combinations), Definition 2.1.1 (Linear map)

Hint 1. Write 𝐯 in terms of ℬ︀, using its coordinates (𝑥1,…,𝑥𝑛)=[𝐯]ℬ︀.
Hint 2. Apply 𝑇, then take 𝒞︀-coordinates. Both steps respect linear combinations, and what comes out is a combination of the columns of [𝑇]𝒞︀ℬ︀.
Sketch. With [𝐯]ℬ︀=(𝑥1,…,𝑥𝑛), linearity of 𝑇 and of [⋅]𝒞︀ gives [𝑇(𝐯)]𝒞︀=∑𝑗𝑥𝑗[𝑇(𝐯𝑗)]𝒞︀, a combination of the vectors [𝑇(𝐯𝑗)]𝒞︀. These are the columns of [𝑇]𝒞︀ℬ︀, so the combination is [𝑇]𝒞︀ℬ︀[𝐯]ℬ︀ by Definition 2.3.8.

Let [𝐯]ℬ︀=(𝑥1,…,𝑥𝑛), so that 𝐯=𝑥1𝐯1+⋯+𝑥𝑛𝐯𝑛 (Definition 1.6.14). Then

[𝑇(𝐯)]𝒞︀=[𝑥1𝑇(𝐯1)+⋯+𝑥𝑛𝑇(𝐯𝑛)]𝒞︀(linearity of𝑇)=𝑥1[𝑇(𝐯1)]𝒞︀+⋯+𝑥𝑛[𝑇(𝐯𝑛)]𝒞︀(linearity of[⋅]𝒞︀)=[𝑇]𝒞︀ℬ︀[𝐯]ℬ︀(definition of the product),

since the 𝑗-th column of [𝑇]𝒞︀ℬ︀ is [𝑇(𝐯𝑗)]𝒞︀ (Definition 2.3.1). □

So to evaluate 𝑇 in coordinates, take the ℬ︀-coordinates of 𝐯, multiply by the matrix, and read the result as 𝒞︀-coordinates. Another way to say this: there are two routes from a vector 𝐯∈𝑉 to a column in 𝐹𝑚. One applies 𝑇 and then takes 𝒞︀-coordinates; the other takes ℬ︀-coordinates and then multiplies by 𝐴=[𝑇]𝒞︀ℬ︀. Theorem 2.3.9 says that the two routes always arrive at the same column (Figure 2.3.1). In terms of maps, [⋅]𝒞︀∘𝑇=𝑇𝐴∘[⋅]ℬ︀, where 𝑇𝐴 is multiplication by 𝐴 (Definition 2.3.15 below). The map 𝑇𝐴 does to coordinate vectors what 𝑇 does to vectors.

Figure 2.3.1. Two routes from 𝑉 to 𝐹𝑚, where 𝐴=[𝑇]𝒞︀ℬ︀. Left: the spaces and maps. Right: what happens to a single vector 𝐯. Going right and then down gives [𝑇(𝐯)]𝒞︀, and going down and then right gives 𝐴[𝐯]ℬ︀; Theorem 2.3.9 says that these agree.

You have probably met the product 𝐴𝐱 before, defined by a formula for its entries. The point here is that its definition is not a convention. Once we record vectors by their coordinates and linear maps by the columns [𝑇(𝐯𝑗)]𝒞︀, only one product makes Theorem 2.3.9 true. In fact, the special case of the standard bases already forces it.

Proposition 2.3.10 (The product is forced). Suppose that for all 𝑚,𝑛≥1 we are given a rule that assigns to each 𝐴∈𝐹𝑚×𝑛 and 𝐱∈𝐹𝑛 a vector 𝐴⋆𝐱∈𝐹𝑚, such that

[𝑇]ℰ︀ℰ︀⋆𝐱=𝑇(𝐱)for every𝑇∈L(𝐹𝑛,𝐹𝑚)and every𝐱∈𝐹𝑛.

Then 𝐴⋆𝐱=𝐴𝐱 for all 𝐴 and 𝐱.

Since [𝐱]ℰ︀=𝐱 and [𝑇(𝐱)]ℰ︀=𝑇(𝐱), the hypothesis is exactly Theorem 2.3.9 for 𝑉=𝐹𝑛 and 𝑊=𝐹𝑚 with their standard bases, with ⋆ in place of the product.

Proof.routine

Uses. Corollary 2.2.17 (Linear maps out of 𝐹𝑛), Definition 2.3.1 (Matrix of a linear map), Notation 2.3.2 (The standard basis ℰ︀), Definition 2.3.8 (Matrix–vector product)

Techniques. Uniqueness via two candidates (Technique 1.1.8)

Hint 1. Given 𝐴 and 𝐱, find a linear map 𝑇:𝐹𝑛→𝐹𝑚 whose matrix with respect to the standard bases is 𝐴.
Hint 2. By Corollary 2.2.17 there is a linear 𝑇 with 𝑇(𝐞𝑗)=𝐚𝑗, the 𝑗-th column of 𝐴. That corollary also tells you what 𝑇(𝐱) is.
Sketch. Let 𝑇 be the linear map with 𝑇(𝐞𝑗)=𝐚𝑗. Then [𝑇]ℰ︀ℰ︀=𝐴 and 𝑇(𝐱)=∑𝑗𝑥𝑗𝐚𝑗 (Corollary 2.2.17), so 𝐴⋆𝐱=𝑇(𝐱)=𝐴𝐱.

Let 𝐴∈𝐹𝑚×𝑛 have columns 𝐚1,…,𝐚𝑛, and let 𝐱=(𝑥1,…,𝑥𝑛)∈𝐹𝑛. By Corollary 2.2.17 there is a linear map 𝑇:𝐹𝑛→𝐹𝑚 with 𝑇(𝐞𝑗)=𝐚𝑗 for each 𝑗, and 𝑇(𝐱)=𝑥1𝐚1+⋯+𝑥𝑛𝐚𝑛. The 𝑗-th column of [𝑇]ℰ︀ℰ︀ is [𝑇(𝐞𝑗)]ℰ︀=𝐚𝑗 (Notation 2.3.2), so [𝑇]ℰ︀ℰ︀=𝐴. Hence

𝐴⋆𝐱=[𝑇]ℰ︀ℰ︀⋆𝐱=𝑇(𝐱)=𝑥1𝐚1+⋯+𝑥𝑛𝐚𝑛=𝐴𝐱.

□

Matrix multiplication arises the same way in Section 2.4: it is the only product of matrices for which the matrix of a composite is the product of the matrices (Theorem 2.4.2).

The definition describes 𝐴𝐱 one column at a time. The familiar formula for its entries is a consequence.

Proposition 2.3.11 (Entries of 𝐴𝐱). Let 𝐴=(𝑎𝑖𝑗)∈𝐹𝑚×𝑛 and 𝐱=(𝑥1,…,𝑥𝑛)∈𝐹𝑛. For 𝑖=1,…,𝑚, the 𝑖-th entry of 𝐴𝐱 is

𝑎𝑖1𝑥1+𝑎𝑖2𝑥2+⋯+𝑎𝑖𝑛𝑥𝑛=∑𝑗=1𝑛𝑎𝑖𝑗𝑥𝑗.

Proof.routine

Uses. Definition 2.3.8 (Matrix–vector product), Definition 1.2.4 (The space 𝐹𝑛)

Hint 1. What is the 𝑖-th entry of the 𝑗-th column 𝐚𝑗?
Hint 2. Vectors in 𝐹𝑚 are added and scaled entry by entry.
Sketch. The 𝑖-th entry of 𝐚𝑗 is 𝑎𝑖𝑗, so the 𝑖-th entry of 𝑥1𝐚1+⋯+𝑥𝑛𝐚𝑛 is 𝑥1𝑎𝑖1+⋯+𝑥𝑛𝑎𝑖𝑛.
The 𝑗-th column 𝐚𝑗 has 𝑖-th entry 𝑎𝑖𝑗. Since the operations of 𝐹𝑚 are entrywise (Definition 1.2.4), the 𝑖-th entry of 𝐴𝐱=𝑥1𝐚1+⋯+𝑥𝑛𝐚𝑛 is 𝑥1𝑎𝑖1+⋯+𝑥𝑛𝑎𝑖𝑛=𝑎𝑖1𝑥1+⋯+𝑎𝑖𝑛𝑥𝑛. □

This is the row-times-column rule: the 𝑖-th entry of 𝐴𝐱 pairs row 𝑖 of 𝐴 with 𝐱, multiplying entries in matching positions and adding. So there are two ways to read 𝐴𝐱. By columns, it is a linear combination of the columns of 𝐴, and this is the view to remember for proofs. By rows, it is a list of 𝑚 numbers, each computed from one row of 𝐴. This is usually quicker by hand, and it is how Section 3.1 reads a system of equations.

Example 2.3.12 (A product computed two ways). Let 𝐴=(1−20314)∈ℝ2×3 and 𝐱=(2,1,−1). By columns,

𝐴𝐱=2(13)+1(−21)+(−1)(04)=(2−2+06+1−4)=(03).

By rows, the first entry is 1⋅2+(−2)⋅1+0⋅(−1)=0 and the second is 3⋅2+1⋅1+4⋅(−1)=3.

Proposition 2.3.13 (Linearity of the product). Let 𝐴,𝐴′∈𝐹𝑚×𝑛, 𝐱,𝐲∈𝐹𝑛, and 𝑐∈𝐹, and let 𝐚𝑗 be the 𝑗-th column of 𝐴.
  1. (a)𝐴(𝑐𝐱+𝐲)=𝑐𝐴𝐱+𝐴𝐲.
  2. (b)(𝑐𝐴+𝐴′)𝐱=𝑐𝐴𝐱+𝐴′𝐱.
  3. (c)𝐴𝐞𝑗=𝐚𝑗 for 𝑗=1,…,𝑛, and 𝐼𝑛𝐱=𝐱.

Proof.routine

Uses. Definition 2.3.8 (Matrix–vector product), Definition 1.2.7 (Matrices), Definition 2.3.5 (Identity matrix), Definition 1.2.4 (The space 𝐹𝑛)

Hint 1. Write each side as a combination of columns using Definition 2.3.8, and regroup with the vector space axioms of 𝐹𝑚.
Hint 2. For (b), what are the columns of 𝑐𝐴+𝐴′? For (c), what are the entries of 𝐞𝑗?
Sketch. (a) Expand ∑𝑗(𝑐𝑥𝑗+𝑦𝑗)𝐚𝑗 and regroup. (b) Matrices are added and scaled entrywise, so the 𝑗-th column of 𝑐𝐴+𝐴′ is 𝑐𝐚𝑗+𝐚𝑗′; expand ∑𝑗𝑥𝑗(𝑐𝐚𝑗+𝐚𝑗′) and regroup. (c) 𝐞𝑗 has a single nonzero entry, a 1 in position 𝑗, and 𝐼𝑛 has columns 𝐞1,…,𝐞𝑛.

(a) The vector 𝑐𝐱+𝐲 has entries 𝑐𝑥𝑗+𝑦𝑗 (Definition 1.2.4), so by Definition 2.3.8 and the vector space axioms of 𝐹𝑚,

𝐴(𝑐𝐱+𝐲)=∑𝑗=1𝑛(𝑐𝑥𝑗+𝑦𝑗)𝐚𝑗=𝑐∑𝑗=1𝑛𝑥𝑗𝐚𝑗+∑𝑗=1𝑛𝑦𝑗𝐚𝑗=𝑐𝐴𝐱+𝐴𝐲.

(b) Let 𝐚𝑗′ be the 𝑗-th column of 𝐴′. Matrices are added and scaled entrywise (Definition 1.2.7), so the 𝑗-th column of 𝑐𝐴+𝐴′ is 𝑐𝐚𝑗+𝐚𝑗′. Hence

(𝑐𝐴+𝐴′)𝐱=∑𝑗=1𝑛𝑥𝑗(𝑐𝐚𝑗+𝐚𝑗′)=𝑐∑𝑗=1𝑛𝑥𝑗𝐚𝑗+∑𝑗=1𝑛𝑥𝑗𝐚𝑗′=𝑐𝐴𝐱+𝐴′𝐱.

(c) The entries of 𝐞𝑗 are 0 except for a 1 in position 𝑗, so 𝐴𝐞𝑗=0𝐚1+⋯+1𝐚𝑗+⋯+0𝐚𝑛=𝐚𝑗. The columns of 𝐼𝑛 are 𝐞1,…,𝐞𝑛 (Definition 2.3.5), so 𝐼𝑛𝐱=𝑥1𝐞1+⋯+𝑥𝑛𝐞𝑛=𝐱. □

Part (c) says that multiplying by 𝐞𝑗 picks out the 𝑗-th column. It is the quickest way to get information about 𝐴 out of the products 𝐴𝐱.

Exercise 2.3.14.routine Compute each product by columns and by rows.

  1. (a)(123401)(214) over 𝔽5.
  2. (b)(1𝑖−𝑖2)(𝑖1) over ℂ.

Solution.

Uses. Definition 2.3.8 (Matrix–vector product), Proposition 2.3.11 (Entries of 𝐴𝐱)

Hint 1. By columns: 2 times the first column, plus 1 times the second, plus 4 times the third. Reduce modulo 5 at the end.
Hint 2. By rows: each entry pairs one row with the vector. In (b), 𝑖⋅𝑖=−1.
Sketch. (a) Both ways give (16,12), which is (1,2) in 𝔽52. By rows, 2+2+12=16 and 8+0+4=12. (b) 𝑖(1,−𝑖)+(𝑖,2)=(2𝑖,3), and by rows 𝑖+𝑖=2𝑖 and −𝑖2+2=3.

(a) By columns, in 𝔽52,

2(14)+1(20)+4(31)=(2+2+128+0+4)=(1612)=(12).

By rows, the first entry is 1⋅2+2⋅1+3⋅4=16=1 and the second is 4⋅2+0⋅1+1⋅4=12=2.

(b) By columns,

𝑖(1−𝑖)+1(𝑖2)=(𝑖1)+(𝑖2)=(2𝑖3),

using 𝑖(−𝑖)=−𝑖2=1. By rows, the entries are 1⋅𝑖+𝑖⋅1=2𝑖 and (−𝑖)⋅𝑖+2⋅1=1+2=3.

2.3.3Matrices as linear maps

Fixing the matrix and letting the vector vary turns the product into a function.

Definition 2.3.15 (The linear map of a matrix). For 𝐴∈𝐹𝑚×𝑛, the map 𝑇𝐴:𝐹𝑛→𝐹𝑚 is

𝑇𝐴(𝐱)=𝐴𝐱.

The map 𝑇𝐴 is linear by Proposition 2.3.13(a). By Proposition 2.3.11, the 𝑖-th coordinate of 𝑇𝐴(𝐱) is 𝑎𝑖1𝑥1+⋯+𝑎𝑖𝑛𝑥𝑛, so 𝑇𝐴 is the map given by a linear formula in Example 2.1.7, and the two definitions of 𝑇𝐴 agree. So a matrix can be regarded either as a table of scalars or as a linear map. The next two results show that the two views carry the same information.

Proposition 2.3.16 (The matrix of 𝑇𝐴). For every 𝐴∈𝐹𝑚×𝑛, [𝑇𝐴]ℰ︀ℰ︀=𝐴.

Proof.routine

Uses. Definition 2.3.1 (Matrix of a linear map), Definition 2.3.15 (The linear map of a matrix), Proposition 2.3.13 (Linearity of the product), Notation 2.3.2 (The standard basis ℰ︀)

Hint 1. What is the 𝑗-th column of [𝑇𝐴]ℰ︀ℰ︀?
Hint 2. Compute 𝑇𝐴(𝐞𝑗)=𝐴𝐞𝑗 with Proposition 2.3.13(c).
Sketch. The 𝑗-th column of [𝑇𝐴]ℰ︀ℰ︀ is [𝐴𝐞𝑗]ℰ︀=𝐴𝐞𝑗=𝐚𝑗.
By Definition 2.3.1 and Notation 2.3.2, the 𝑗-th column of [𝑇𝐴]ℰ︀ℰ︀ is [𝑇𝐴(𝐞𝑗)]ℰ︀=𝑇𝐴(𝐞𝑗)=𝐴𝐞𝑗, which is the 𝑗-th column of 𝐴 by Proposition 2.3.13(c). So the two matrices have the same columns. □
Proposition 2.3.17 (Every linear map 𝐹𝑛→𝐹𝑚 is some 𝑇𝐴). For every 𝑇∈L(𝐹𝑛,𝐹𝑚) there is exactly one 𝐴∈𝐹𝑚×𝑛 with 𝑇=𝑇𝐴, namely 𝐴=[𝑇]ℰ︀ℰ︀, the matrix whose columns are 𝑇(𝐞1),…,𝑇(𝐞𝑛).

Proof.routine

Uses. Theorem 2.3.9 (The matrix of a map computes the map), Notation 2.3.2 (The standard basis ℰ︀), Proposition 2.3.13 (Linearity of the product)

Techniques. Uniqueness via two candidates (Technique 1.1.8)

Hint 1. For existence, apply Theorem 2.3.9 with the standard bases on both sides. What are [𝐱]ℰ︀ and [𝑇(𝐱)]ℰ︀?
Hint 2. For uniqueness, suppose that 𝑇𝐴=𝑇𝐴′, and evaluate both maps at 𝐞𝑗.
Sketch. With 𝐴=[𝑇]ℰ︀ℰ︀, Theorem 2.3.9 gives 𝑇(𝐱)=𝐴[𝐱]ℰ︀=𝐴𝐱, since standard coordinates do nothing. If 𝑇𝐴=𝑇𝐴′, then 𝐴𝐞𝑗=𝐴′𝐞𝑗, so 𝐴 and 𝐴′ have the same 𝑗-th column for every 𝑗.

Existence. Let 𝐴=[𝑇]ℰ︀ℰ︀. Its columns are [𝑇(𝐞𝑗)]ℰ︀=𝑇(𝐞𝑗) (Notation 2.3.2). For 𝐱∈𝐹𝑛, Theorem 2.3.9 with the standard bases of 𝐹𝑛 and 𝐹𝑚 gives

𝑇(𝐱)=[𝑇(𝐱)]ℰ︀=[𝑇]ℰ︀ℰ︀[𝐱]ℰ︀=𝐴𝐱=𝑇𝐴(𝐱).

So 𝑇=𝑇𝐴.

Uniqueness. Suppose 𝑇𝐴=𝑇𝐴′ for some 𝐴,𝐴′∈𝐹𝑚×𝑛. By Proposition 2.3.13(c), for each 𝑗 the 𝑗-th columns of 𝐴 and 𝐴′ are

𝐴𝐞𝑗=𝑇𝐴(𝐞𝑗)=𝑇𝐴′(𝐞𝑗)=𝐴′𝐞𝑗.

So 𝐴 and 𝐴′ have the same columns, and 𝐴=𝐴′. □

Together with Proposition 2.3.16, this says that 𝐴↦𝑇𝐴 and 𝑇↦[𝑇]ℰ︀ℰ︀ are inverse bijections between 𝐹𝑚×𝑛 and L(𝐹𝑛,𝐹𝑚). Two consequences are worth spelling out. First, the linear maps 𝐹𝑛→𝐹𝑚 are exactly the maps given by linear formulas, which makes precise the rule of thumb at the end of Section 2.1.3. Second, finding the matrix of a linear map 𝐹𝑛→𝐹𝑚 requires no formula at all: compute 𝑇(𝐞1),…,𝑇(𝐞𝑛) and write them down as columns. From now on we often say “the matrix 𝐴” for the map 𝑇𝐴, and write 𝐴𝐱 rather than 𝑇𝐴(𝐱).

Exercise 2.3.18.routine For each linear map 𝑇, find the matrix 𝐴 with 𝑇=𝑇𝐴.

  1. (a)𝑇:ℝ3→ℝ3, 𝑇(𝑥,𝑦,𝑧)=(𝑧,𝑥,𝑦).
  2. (b)𝑇:ℝ3→ℝ3, the projection (𝑥,𝑦,𝑧)↦(𝑥,𝑦,0) onto the 𝑥𝑦-plane.
  3. (c)𝑇:ℝ3→ℝ, 𝑇(𝑥,𝑦,𝑧)=𝑥+𝑦+𝑧.
  4. (d)𝑇:𝔽22→𝔽22, the linear map with 𝑇(1,0)=(1,1) and 𝑇(0,1)=(0,1). What is 𝑇(1,1)?

Solution.

Uses. Proposition 2.3.17 (Every linear map 𝐹𝑛→𝐹𝑚 is some 𝑇𝐴), Definition 2.3.8 (Matrix–vector product)

Hint 1. By Proposition 2.3.17, the columns of 𝐴 are 𝑇(𝐞1),…,𝑇(𝐞𝑛). No formula for the entries is needed.
Hint 2. In (c) the target is ℝ=ℝ1, so 𝐴 has one row. In (d), 𝑇(1,1)=𝐴(1,1) is the sum of the two columns.
Sketch. (a) Columns 𝐞2,𝐞3,𝐞1. (b) Columns 𝐞1,𝐞2,𝟎. (c) (111). (d) (1011), and 𝑇(1,1)=(1,1)+(0,1)=(1,0).

By Proposition 2.3.17, 𝐴 is the matrix with columns 𝑇(𝐞1),…,𝑇(𝐞𝑛).

(a) 𝑇(𝐞1)=(0,1,0), 𝑇(𝐞2)=(0,0,1), and 𝑇(𝐞3)=(1,0,0), so 𝐴=(001100010).

(b) 𝑇(𝐞1)=𝐞1, 𝑇(𝐞2)=𝐞2, and 𝑇(𝐞3)=𝟎, so 𝐴=(100010000).

(c) 𝑇(𝐞1)=𝑇(𝐞2)=𝑇(𝐞3)=1, so 𝐴 is the 1×3 matrix (111).

(d) 𝐴=(1011). By Definition 2.3.8, 𝑇(1,1)=𝐴(1,1)=(1,1)+(0,1)=(1,2)=(1,0) in 𝔽22. So 𝑇 swaps (1,0) and (1,1) and fixes (0,1).

Example 2.3.19 (Projection and reflection). Let ℓ be the line 𝑦=2𝑥 in ℝ2. It passes through 𝟎 at the angle 𝜃 with cos𝜃=1/5 and sin𝜃=2/5, so cos2𝜃=1/5, sin𝜃cos𝜃=2/5, sin2𝜃=4/5, cos2𝜃=−3/5, and sin2𝜃=4/5. By the formulas of Example 2.1.11, the projection onto ℓ and the reflection across ℓ satisfy

Prℓ(𝐞1)=(15,25),Prℓ(𝐞2)=(25,45),𝑆ℓ(𝐞1)=(−35,45),𝑆ℓ(𝐞2)=(45,35).

These are the columns of their matrices:

[Prℓ]ℰ︀ℰ︀=15(1224),[𝑆ℓ]ℰ︀ℰ︀=15(−3443).

The plane transformer below shows the reflection. Its panel displays the matrix 𝐴, and its two handles are the columns 𝐴𝐞1 and 𝐴𝐞2, that is, the images of 𝐞1 and 𝐞2. Dragging a handle changes one column of 𝐴 and leaves the other alone, and the whole grid follows, because 𝐴(𝑥,𝑦)=𝑥𝐴𝐞1+𝑦𝐴𝐞2.

The reflection across the line 𝑦=2𝑥. Its matrix has columns 𝐴𝐞1=(−0.6,0.8) and 𝐴𝐞2=(0.8,0.6). Type the entries 0.2,0.4,0.4,0.8 for the projection onto the same line, which flattens the grid onto it, or 0,−1,1,0 for the rotation by a right angle. In each case the columns of the matrix are where 𝐞1 and 𝐞2 go.

For general 𝑉 and 𝑊 the same holds once the bases are fixed: a linear map is determined by its matrix, and every matrix of the right size is the matrix of some linear map.

Theorem 2.3.20 (Linear maps correspond to matrices). Let ℬ︀ be a basis of 𝑉 of length 𝑛 and 𝒞︀ a basis of 𝑊 of length 𝑚.
  1. (a)If 𝑆,𝑇∈L(𝑉,𝑊) and [𝑆]𝒞︀ℬ︀=[𝑇]𝒞︀ℬ︀, then 𝑆=𝑇.
  2. (b)For every 𝐴∈𝐹𝑚×𝑛 there is a 𝑇∈L(𝑉,𝑊) with [𝑇]𝒞︀ℬ︀=𝐴.
That is, 𝑇↦[𝑇]𝒞︀ℬ︀ is a bijection from L(𝑉,𝑊) onto 𝐹𝑚×𝑛.
Intuition. For 𝑉=𝐹𝑛 and 𝑊=𝐹𝑚 with their standard bases, this is Proposition 2.3.17 together with Proposition 2.3.16. In general there are two natural strategies. One is to notice that the matrix is another way of writing the list 𝑇(𝐯1),…,𝑇(𝐯𝑛), which determines 𝑇 by Section 2.2. The other is to move the problem into 𝐹𝑛 and 𝐹𝑚 with coordinates, where the special case applies, and move back. The first proof is shorter. The second exhibits every 𝑇 as some 𝑇𝐴 in disguise, which is the picture of Figure 2.3.1.

Proof (via lists).routine

Uses. Theorem 2.2.1 (Linear maps are determined by a basis), Definition 1.6.14 (Coordinates), Definition 2.3.1 (Matrix of a linear map)

Hint 1. Two matrices are equal when their columns are equal. What does equality of the 𝑗-th columns of [𝑆]𝒞︀ℬ︀ and [𝑇]𝒞︀ℬ︀ say about 𝑆(𝐯𝑗) and 𝑇(𝐯𝑗)?
Hint 2. For (b), the 𝑗-th column of 𝐴 is the 𝒞︀-coordinate vector of exactly one vector 𝐲𝑗∈𝑊. Send 𝐯𝑗 there.
Sketch. (a) Equal columns mean [𝑆(𝐯𝑗)]𝒞︀=[𝑇(𝐯𝑗)]𝒞︀, so 𝑆(𝐯𝑗)=𝑇(𝐯𝑗) for all 𝑗, and 𝑆=𝑇 by uniqueness in Theorem 2.2.1. (b) Let 𝐲𝑗=∑𝑖𝑎𝑖𝑗𝐰𝑖; the linear map with 𝑇(𝐯𝑗)=𝐲𝑗 has 𝑗-th column [𝐲𝑗]𝒞︀=𝐚𝑗.

(a) Suppose [𝑆]𝒞︀ℬ︀=[𝑇]𝒞︀ℬ︀. Comparing 𝑗-th columns, [𝑆(𝐯𝑗)]𝒞︀=[𝑇(𝐯𝑗)]𝒞︀ for each 𝑗. A vector of 𝑊 is determined by its coordinates: if [𝐰]𝒞︀=(𝑐1,…,𝑐𝑚), then 𝐰=𝑐1𝐰1+⋯+𝑐𝑚𝐰𝑚 (Definition 1.6.14). So 𝑆(𝐯𝑗)=𝑇(𝐯𝑗) for every 𝑗, and 𝑆=𝑇 by the uniqueness part of Theorem 2.2.1.

(b) Let 𝐚1,…,𝐚𝑛 be the columns of 𝐴, and let 𝐲𝑗=𝑎1𝑗𝐰1+⋯+𝑎𝑚𝑗𝐰𝑚∈𝑊, so that [𝐲𝑗]𝒞︀=𝐚𝑗. By Theorem 2.2.1 there is a linear map 𝑇:𝑉→𝑊 with 𝑇(𝐯𝑗)=𝐲𝑗 for each 𝑗. The 𝑗-th column of [𝑇]𝒞︀ℬ︀ is [𝐲𝑗]𝒞︀=𝐚𝑗, so [𝑇]𝒞︀ℬ︀=𝐴. □

Proof (via coordinates).routine

Uses. Theorem 2.3.9 (The matrix of a map computes the map), Example 2.1.8 (Coordinates), Proposition 1.6.19 (Coordinates respect linear combinations), Definition 2.3.15 (The linear map of a matrix), Proposition 2.1.17 (Compositions of linear maps are linear)

Techniques. Assemble linear maps from linear pieces (Technique 2.1.26)

Hint 1. Let Φ:𝐹𝑚→𝑊 be the map (𝑦1,…,𝑦𝑚)↦𝑦1𝐰1+⋯+𝑦𝑚𝐰𝑚. How are Φ and [⋅]𝒞︀ related?
Hint 2. For (a), use Theorem 2.3.9 to compare [𝑆(𝐯)]𝒞︀ and [𝑇(𝐯)]𝒞︀. For (b), try 𝑇=Φ∘𝑇𝐴∘[⋅]ℬ︀.
Sketch. Φ and [⋅]𝒞︀ undo each other. (a) Both [𝑆(𝐯)]𝒞︀ and [𝑇(𝐯)]𝒞︀ equal 𝐴[𝐯]ℬ︀; apply Φ. (b) 𝑇=Φ∘𝑇𝐴∘[⋅]ℬ︀ is a composite of linear maps, and [𝑇(𝐯𝑗)]𝒞︀=𝐴𝐞𝑗=𝐚𝑗.

Let Φ:𝐹𝑚→𝑊 be the linear map (𝑦1,…,𝑦𝑚)↦𝑦1𝐰1+⋯+𝑦𝑚𝐰𝑚 of Example 2.1.8. It undoes 𝒞︀-coordinates in both orders: Φ([𝐰]𝒞︀)=𝐰 for 𝐰∈𝑊, and [Φ(𝐲)]𝒞︀=𝐲 for 𝐲∈𝐹𝑚.

(a) Let 𝐴=[𝑆]𝒞︀ℬ︀=[𝑇]𝒞︀ℬ︀. For 𝐯∈𝑉, Theorem 2.3.9 gives

[𝑆(𝐯)]𝒞︀=𝐴[𝐯]ℬ︀=[𝑇(𝐯)]𝒞︀,

and applying Φ gives 𝑆(𝐯)=𝑇(𝐯).

(b) Define 𝑇=Φ∘𝑇𝐴∘[⋅]ℬ︀, that is, 𝑇(𝐯)=Φ(𝐴[𝐯]ℬ︀). It is a composite of linear maps (Proposition 1.6.19, Definition 2.3.15, Example 2.1.8), so it is linear by Proposition 2.1.17. Since [𝐯𝑗]ℬ︀=𝐞𝑗,

[𝑇(𝐯𝑗)]𝒞︀=[Φ(𝐴𝐞𝑗)]𝒞︀=𝐴𝐞𝑗=𝐚𝑗,

so the 𝑗-th column of [𝑇]𝒞︀ℬ︀ is the 𝑗-th column of 𝐴. □

The second proof shows what an arbitrary linear map looks like through coordinates. By (a), every 𝑇∈L(𝑉,𝑊) is the map built in (b) from its own matrix: 𝑇=Φ∘𝑇𝐴∘[⋅]ℬ︀ with 𝐴=[𝑇]𝒞︀ℬ︀. Read from right to left, this says: take coordinates, multiply by the matrix, and turn the resulting coordinates back into a vector. In Section 2.4 we will see that the bijection 𝑇↦[𝑇]𝒞︀ℬ︀ also respects addition and scalar multiplication and turns composition into matrix multiplication. So L(𝑉,𝑊) and 𝐹𝑚×𝑛 are isomorphic vector spaces (Section 4.5).

Exercise 2.3.21.routine Let ℬ︀=1,𝑥 and 𝒞︀=1,1+𝑥, both bases of 𝐹[𝑥]≤1, and let 𝑇∈L(𝐹[𝑥]≤1) be the operator with

[𝑇]𝒞︀ℬ︀=(1201).

Find 𝑇(𝑎+𝑏𝑥), and find [𝑇]ℬ︀ℬ︀.

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Theorem 2.3.20 (Linear maps correspond to matrices), Theorem 2.2.1 (Linear maps are determined by a basis)

Hint 1. The columns say what 𝑇(1) and 𝑇(𝑥) are, in 𝒞︀-coordinates. Turn them back into polynomials.
Hint 2. Then 𝑇(𝑎+𝑏𝑥)=𝑎𝑇(1)+𝑏𝑇(𝑥). For [𝑇]ℬ︀ℬ︀, write 𝑇(1) and 𝑇(𝑥) in the basis 1,𝑥.
Sketch. 𝑇(1)=1⋅1+0⋅(1+𝑥)=1 and 𝑇(𝑥)=2⋅1+1⋅(1+𝑥)=3+𝑥. So 𝑇(𝑎+𝑏𝑥)=(𝑎+3𝑏)+𝑏𝑥 and [𝑇]ℬ︀ℬ︀=(1301).

𝒞︀ is a basis, since 𝑎+𝑏𝑥=(𝑎−𝑏)⋅1+𝑏(1+𝑥), and these are the only possible coefficients. By Definition 2.3.1, the first column says 𝑇(1)=1⋅1+0⋅(1+𝑥)=1, and the second says 𝑇(𝑥)=2⋅1+1⋅(1+𝑥)=3+𝑥. By linearity,

𝑇(𝑎+𝑏𝑥)=𝑎𝑇(1)+𝑏𝑇(𝑥)=(𝑎+3𝑏)+𝑏𝑥.

(By Theorem 2.3.20, this is the only operator with the given matrix.) In the basis ℬ︀, 𝑇(1)=1 has coordinates (1,0) and 𝑇(𝑥)=3+𝑥 has coordinates (3,1), so

[𝑇]ℬ︀ℬ︀=(1301).

2.3.4Different bases, different matrices

The matrix [𝑇]𝒞︀ℬ︀ depends on three things: the map 𝑇, the basis ℬ︀, and the basis 𝒞︀. Changing either basis, even by reordering it, can change the matrix, and one map can have matrices that look nothing alike.

Example 2.3.22 (Differentiation in four bases). Let 𝑉=𝐹[𝑥]≤2, and let 𝐷∈L(𝑉) be differentiation, as in Example 2.3.4.

  1. (a)For ℬ︀=1,𝑥,𝑥2, we found

    [𝐷]ℬ︀ℬ︀=(010002000).
  2. (b)Reverse the order: ℛ︀=𝑥2,𝑥,1. Now 𝐷(𝑥2)=2𝑥, 𝐷(𝑥)=1, and 𝐷(1)=𝟎 have the ℛ︀-coordinates (0,2,0), (0,0,1), and (0,0,0), so

    [𝐷]ℛ︀ℛ︀=(000200010).

    The vectors are the same as in (a), but a basis is a list, and its order matters.

  3. (c)Suppose that 2≠0 in 𝐹, and let ℬ︀̊=1,𝑥,12𝑥2. This is a basis, since 𝑎+𝑏𝑥+𝑐𝑥2=𝑎⋅1+𝑏𝑥+2𝑐⋅12𝑥2, with only these coefficients possible. Now 𝐷(12𝑥2)=𝑥, so

    [𝐷]ℬ︀̊ℬ︀̊=(010001000).

    Each basis vector goes to the one before it, and the first goes to 𝟎.

  4. (d)Keep the assumption 2≠0, and use different bases on the two sides: ℬ︀′=𝑥,12𝑥2,1 in the domain and ℬ︀=1,𝑥,𝑥2 in the target. Then 𝐷(𝑥)=1, 𝐷(12𝑥2)=𝑥, and 𝐷(1)=𝟎 have the ℬ︀-coordinates 𝐞1, 𝐞2, and 𝟎, so

    [𝐷]ℬ︀ℬ︀′=(100010000).

Intuition (One basis or two). The matrix in (d) is the matrix of the projection (𝑥1,𝑥2,𝑥3)↦(𝑥1,𝑥2,0) of 𝐹3, a map 𝑃 with 𝑃∘𝑃=𝑃. But 𝐷 is nothing like that: 𝐷(𝐷(𝐷(𝑝)))=𝟎 for every 𝑝∈𝑉, since each application of 𝐷 lowers the degree. Using different bases on the two sides gives so much freedom that the matrix forgets almost everything about 𝐷. What survives is how many independent values 𝐷 takes, its rank (Section 4.2, and Theorem 3.5.27 for matrices).

For an operator 𝑇∈L(𝑉), comparing 𝑇(𝐯) with 𝐯 only makes sense in a single coordinate system, so we use the same basis on both sides, and then more survives. Let 𝑁 be any of the three matrices in (a)–(c), with its basis 𝒜︀. Applying Theorem 2.3.9 three times,

𝑁(𝑁(𝑁[𝑝]𝒜︀))=𝑁(𝑁[𝐷(𝑝)]𝒜︀)=𝑁[𝐷(𝐷(𝑝))]𝒜︀=[𝐷(𝐷(𝐷(𝑝)))]𝒜︀=𝟎

for every 𝑝, and since every 𝐱∈𝐹3 is [𝑝]𝒜︀ for some 𝑝, multiplying by 𝑁 three times kills every vector. You can check this directly for each 𝑁. The matrix in (d) does not have this property: it fixes 𝐞1. Properties of an operator that are visible in its matrix in every basis are studied in Section 4.5, under the name of similarity.

Example 2.3.23 (Maps of the plane in adapted bases). Let ℓ be the line 𝑦=2𝑥, as in Example 2.3.19, and let 𝒰︀=𝐮1,𝐮2 with 𝐮1=(1,2) on ℓ and 𝐮2=(−2,1) perpendicular to ℓ (since 1⋅(−2)+2⋅1=0). This is a basis of ℝ2: the equations 𝑎−2𝑏=𝑥 and 2𝑎+𝑏=𝑦 have exactly one solution, 𝑎=(𝑥+2𝑦)/5 and 𝑏=(𝑦−2𝑥)/5.

The projection 𝑃=Prℓ fixes 𝐮1 and sends 𝐮2 to 𝟎, and the reflection 𝑆=𝑆ℓ fixes 𝐮1 and sends 𝐮2 to −𝐮2. (With the matrices of Example 2.3.19: 15(1+4,2+8)=(1,2) and 15(−2+2,−4+4)=(0,0).) So

[𝑃]𝒰︀𝒰︀=(1000),[𝑆]𝒰︀𝒰︀=(100−1),

compared with 15(1224) and 15(−3443) in the standard basis. In the adapted basis, the matrices show what the maps do.

The rotation 𝑅=𝑅𝜋/2 has [𝑅]ℰ︀ℰ︀=(0−110). In the reversed standard basis 𝐞2,𝐞1, the vector 𝑅(𝐞2)=−𝐞1 has coordinates (0,−1) and 𝑅(𝐞1)=𝐞2 has coordinates (1,0), so the matrix becomes (01−10). That is the standard matrix of the clockwise rotation 𝑅−𝜋/2: reordering the basis reverses the orientation of the coordinate system. In the basis 𝒰︀, on the other hand, 𝑅(𝐮1)=(−2,1)=𝐮2 and 𝑅(𝐮2)=(−1,−2)=−𝐮1, so [𝑅]𝒰︀𝒰︀=(0−110), the same as in the standard basis.

Two lessons. First, a matrix alone does not determine a map; only the matrix together with the bases does (Theorem 2.3.20). For instance (100−1) is [𝑆ℓ]𝒰︀𝒰︀, and it is also the standard matrix of the reflection across the 𝑥-axis. Second, choosing a basis adapted to the map is how one understands it. If some basis consists of vectors that 𝑇 sends to multiples of themselves, the matrix of 𝑇 in that basis is diagonal. This is how Example 2.2.3 built 𝑃 and 𝑆 in the first place (Technique 2.2.4), and finding such bases is the subject of Section 7.4.

2.3.5The identity map in two bases

By Example 2.3.6, [id𝑉]ℬ︀ℬ︀=𝐼𝑛 for every basis ℬ︀. With two different bases, the matrix of the identity map is a different matrix, and it can look like almost anything. What it does is given by Theorem 2.3.9: for any two bases ℬ︀ and 𝒞︀ of 𝑉,

[id𝑉]𝒞︀ℬ︀[𝐯]ℬ︀=[id𝑉(𝐯)]𝒞︀=[𝐯]𝒞︀for every𝐯∈𝑉.

That is, the matrix of the identity converts ℬ︀-coordinates into 𝒞︀-coordinates.

Example 2.3.24 (The identity in two bases). Let 𝐹 be a field with 1+1≠0, and let ℬ︀=(1,1),(1,−1), a basis of 𝐹2 (Example 2.2.3). The columns of [id]ℰ︀ℬ︀ are the standard coordinates of (1,1) and (1,−1), which are these vectors themselves. The columns of [id]ℬ︀ℰ︀ are the ℬ︀-coordinates of 𝐞1=12(1,1)+12(1,−1) and 𝐞2=12(1,1)−12(1,−1). So

[id]ℰ︀ℬ︀=(111−1),[id]ℬ︀ℰ︀=12(111−1).

For 𝐯=(3,1)=2(1,1)+(1,−1) we have [𝐯]ℬ︀=(2,1), and indeed the two matrices convert between the two coordinate vectors of 𝐯:

(111−1)(21)=(31)=[𝐯]ℰ︀,12(111−1)(31)=(21)=[𝐯]ℬ︀.

The example generalizes in one direction. For any basis ℬ︀=𝐛1,…,𝐛𝑛 of 𝐹𝑛, [id]ℰ︀ℬ︀ is the matrix whose columns are 𝐛1,…,𝐛𝑛, because [𝐛𝑗]ℰ︀=𝐛𝑗. The other direction, [id]ℬ︀ℰ︀, requires solving for coordinates.

Remark 2.3.25 (A warning about the identity). The phrase “the matrix of the identity map” means nothing until both bases are specified: [id𝑉]𝒞︀ℬ︀=𝐼𝑛 exactly when ℬ︀=𝒞︀ (Exercise 2.3.26). In general, [id𝑉]𝒞︀ℬ︀ is the matrix that changes ℬ︀-coordinates into 𝒞︀-coordinates. These matrices are the subject of Section 4.5 (Definition 4.5.10). There, once matrix multiplication is available (Section 2.4), they compute [𝑇]𝒞︀̊ℬ︀̊ from [𝑇]𝒞︀ℬ︀ for any other bases ℬ︀̊ and 𝒞︀̊, and explain the different matrices of 𝐷 and of the plane maps found above.
Exercise 2.3.26.routine Let ℬ︀=𝐯1,…,𝐯𝑛 and 𝒞︀=𝐰1,…,𝐰𝑛 be bases of 𝑉 of the same length. Show that [id𝑉]𝒞︀ℬ︀=𝐼𝑛 if and only if ℬ︀=𝒞︀, that is, 𝐯𝑗=𝐰𝑗 for every 𝑗.

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Definition 2.3.5 (Identity matrix), Definition 1.6.14 (Coordinates)

Hint 1. The 𝑗-th column of [id𝑉]𝒞︀ℬ︀ is [𝐯𝑗]𝒞︀. When is it 𝐞𝑗?
Hint 2. A vector with 𝒞︀-coordinates 𝐞𝑗 is 0𝐰1+⋯+1𝐰𝑗+⋯+0𝐰𝑛.
Sketch. The 𝑗-th column is [𝐯𝑗]𝒞︀, and [𝐯𝑗]𝒞︀=𝐞𝑗 if and only if 𝐯𝑗=𝐰𝑗. So all columns agree with those of 𝐼𝑛 if and only if 𝐯𝑗=𝐰𝑗 for all 𝑗.

By Definition 2.3.1, the 𝑗-th column of [id𝑉]𝒞︀ℬ︀ is [𝐯𝑗]𝒞︀, and the 𝑗-th column of 𝐼𝑛 is 𝐞𝑗. Since a vector is determined by its coordinates (Definition 1.6.14), [𝐯𝑗]𝒞︀=𝐞𝑗 holds if and only if

𝐯𝑗=0𝐰1+⋯+1𝐰𝑗+⋯+0𝐰𝑛=𝐰𝑗.

So [id𝑉]𝒞︀ℬ︀=𝐼𝑛 if and only if 𝐯𝑗=𝐰𝑗 for every 𝑗.

2.3.6Translating between maps and matrices

The results of this section give a dictionary between linear maps of spaces with chosen bases and matrices.

  • A vector 𝐯∈𝑉 corresponds to its coordinate vector [𝐯]ℬ︀∈𝐹𝑛, and a map 𝑇∈L(𝑉,𝑊) to its matrix [𝑇]𝒞︀ℬ︀∈𝐹𝑚×𝑛.
  • The value 𝑇(𝐯) corresponds to the product [𝑇]𝒞︀ℬ︀[𝐯]ℬ︀ (Theorem 2.3.9), and the value 𝑇(𝐯𝑗) on a basis vector to the 𝑗-th column.
  • Two maps are equal if and only if their matrices are (Theorem 2.3.20).
  • For 𝑉=𝐹𝑛 and 𝑊=𝐹𝑚 with the standard bases, 𝑇 corresponds to the unique 𝐴 with 𝑇=𝑇𝐴 (Proposition 2.3.17), and id corresponds to 𝐼𝑛.

Technique 2.3.27 (Translate between maps and matrices). A linear map between spaces with chosen bases and its matrix carry the same information, so a question about one can be translated into a question about the other, using the dictionary above.

In one direction, to compute with a linear map, replace vectors by their coordinate vectors and the map by its matrix. Evaluating 𝑇 becomes a matrix–vector product, and an equation 𝑇(𝐯)=𝐰 becomes the linear system [𝑇]𝒞︀ℬ︀𝐱=[𝐰]𝒞︀ in the unknown coordinates 𝐱 of 𝐯 (Section 3.1). In the other direction, to prove a statement about a matrix 𝐴, read it as a statement about the linear map 𝑇𝐴, prove it with the theory of linear maps, which needs no indices, and translate back with the uniqueness in Proposition 2.3.17.

Reach for the first direction when you need numbers, and for the second when a matrix identity would otherwise need a computation with indices. A rule of thumb: compute with matrices, prove with maps. Before translating, fix the bases and keep track of which basis each coordinate vector refers to; most errors come from mixing them up. The canonical example is Example 2.3.28. Later instances: matrix multiplication is defined by translating composition (Section 2.4), the rank of a matrix is the rank of its map (Section 4.2), and the determinant and the eigenvalues of an operator are read off from its matrix in any basis (Section 5.4, Section 7.3).

Example 2.3.28 (Translating in both directions).
  1. (a)From maps to matrices. We find all 𝑝∈ℚ[𝑥]≤2 with 𝑝(𝑥+1)−𝑝(𝑥)=𝑥. The map Δ:ℚ[𝑥]≤2→ℚ[𝑥]≤2, Δ(𝑝)=𝑝(𝑥+1)−𝑝(𝑥), is linear, being the difference of the substitution map of Exercise 2.1.32 and the identity (Technique 2.1.26). With ℬ︀=1,𝑥,𝑥2,

    Δ(1)=𝟎,Δ(𝑥)=(𝑥+1)−𝑥=1,Δ(𝑥2)=(𝑥+1)2−𝑥2=1+2𝑥,

    so

    [Δ]ℬ︀ℬ︀=(011002000).

    By Theorem 2.3.9, 𝑝=𝑎+𝑏𝑥+𝑐𝑥2 satisfies Δ(𝑝)=𝑥 if and only if [Δ]ℬ︀ℬ︀(𝑎,𝑏,𝑐)=[𝑥]ℬ︀=(0,1,0). By Proposition 2.3.11 this is the system 𝑏+𝑐=0, 2𝑐=1, 0=0, whose solutions are 𝑐=1/2, 𝑏=−1/2, and 𝑎 arbitrary. So the solutions are

    𝑝=𝑎+𝑥2−𝑥2(𝑎∈ℚ).

    This gives a formula for sums. For 𝑞(𝑡)=𝑡(𝑡−1)/2 and every number 𝑡,

    𝑞(𝑡+1)−𝑞(𝑡)=(𝑡+1)𝑡−𝑡(𝑡−1)2=𝑡,

    so the sum 0+1+⋯+(𝑛−1) telescopes:

    ∑𝑘=0𝑛−1𝑘=∑𝑘=0𝑛−1(𝑞(𝑘+1)−𝑞(𝑘))=𝑞(𝑛)−𝑞(0)=𝑛(𝑛−1)2.
  2. (b)From matrices to maps. Let 𝐴∈𝐹𝑛×𝑛, and suppose that for every 𝐱∈𝐹𝑛 the vector 𝐴𝐱 is a scalar multiple of 𝐱. We show that 𝐴=𝜆𝐼𝑛 for some 𝜆∈𝐹. The hypothesis says that 𝑇𝐴(𝐱)∈span(𝐱) for every 𝐱. By Exercise 2.1.48, 𝑇𝐴=𝜆id for some 𝜆∈𝐹. Now (𝜆𝐼𝑛)𝐱=𝜆(𝐼𝑛𝐱)=𝜆𝐱 by Proposition 2.3.13, so 𝜆id=𝑇𝜆𝐼𝑛. Hence 𝑇𝐴=𝑇𝜆𝐼𝑛, and 𝐴=𝜆𝐼𝑛 by the uniqueness in Proposition 2.3.17. A direct proof with entries is possible, but it would repeat the argument of Exercise 2.1.48 in coordinates.

Exercises

Exercise 2.3.29.routine Let 𝑇:ℝ2→ℝ3, 𝑇(𝑥,𝑦)=(𝑥+𝑦,𝑥−𝑦,2𝑥), and consider the bases ℬ︀=(1,1),(1,−1) of ℝ2 and 𝒞︀=(1,0,0),(1,1,0),(1,1,1) of ℝ3.

  1. (a)Find [𝑇]𝒞︀ℬ︀.
  2. (b)Check Theorem 2.3.9 for 𝐯=(3,1) by computing both sides.

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Theorem 2.3.9 (The matrix of a map computes the map), Definition 2.3.8 (Matrix–vector product)

Hint 1. First find a formula for the 𝒞︀-coordinates (𝑎,𝑏,𝑐) of a vector (𝑥,𝑦,𝑧) by solving for 𝑎,𝑏,𝑐.
Hint 2. The columns of [𝑇]𝒞︀ℬ︀ are the 𝒞︀-coordinates of 𝑇(1,1) and 𝑇(1,−1). For (b), (3,1)=2(1,1)+(1,−1).
Sketch. [(𝑥,𝑦,𝑧)]𝒞︀=(𝑥−𝑦,𝑦−𝑧,𝑧). 𝑇(1,1)=(2,0,2) and 𝑇(1,−1)=(0,2,2) give [𝑇]𝒞︀ℬ︀=(2−2−2022). For 𝐯=(3,1), [𝐯]ℬ︀=(2,1), and both sides equal (2,−4,6).

Since

𝑎(1,0,0)+𝑏(1,1,0)+𝑐(1,1,1)=(𝑎+𝑏+𝑐,𝑏+𝑐,𝑐),

the 𝒞︀-coordinates of (𝑥,𝑦,𝑧) are 𝑐=𝑧, 𝑏=𝑦−𝑧, and 𝑎=𝑥−𝑦:

[(𝑥,𝑦,𝑧)]𝒞︀=(𝑥−𝑦,𝑦−𝑧,𝑧).

(a) 𝑇(1,1)=(2,0,2) has 𝒞︀-coordinates (2,−2,2), and 𝑇(1,−1)=(0,2,2) has 𝒞︀-coordinates (−2,0,2). So

[𝑇]𝒞︀ℬ︀=(2−2−2022).

(b) Since (3,1)=2(1,1)+1(1,−1), [𝐯]ℬ︀=(2,1), and

[𝑇]𝒞︀ℬ︀[𝐯]ℬ︀=2(2−22)+1(−202)=(2−46).

On the other side, 𝑇(3,1)=(4,2,6), whose 𝒞︀-coordinates are (4−2,2−6,6)=(2,−4,6). The two sides agree.

Exercise 2.3.30.routine Find the error in the following computation, and correct it.

Let ℬ︀=(1,1),(1,−1), a basis of ℝ2, and let 𝐯=(3,1). The matrix [id]ℰ︀ℬ︀=(111−1) relates the two bases, so the ℬ︀-coordinates of 𝐯 are

[𝐯]ℬ︀=[id]ℰ︀ℬ︀𝐯=(111−1)(31)=(42).

Solution.

Uses. Theorem 2.3.9 (The matrix of a map computes the map), Example 2.3.24 (The identity in two bases)

Hint 1. Check the answer: is 4(1,1)+2(1,−1) equal to (3,1)?
Hint 2. By Theorem 2.3.9, [id]ℰ︀ℬ︀ multiplies ℬ︀-coordinates and produces ℰ︀-coordinates. Which matrix goes the other way?
Sketch. [id]ℰ︀ℬ︀[𝐯]ℬ︀=[𝐯]ℰ︀, so this matrix turns ℬ︀-coordinates into standard coordinates, not the reverse. The correct matrix is [id]ℬ︀ℰ︀=12(111−1), which gives [𝐯]ℬ︀=(2,1).

The answer is wrong: 4(1,1)+2(1,−1)=(6,2)≠(3,1). By Theorem 2.3.9, [id]ℰ︀ℬ︀[𝐰]ℬ︀=[𝐰]ℰ︀ for every 𝐰, so [id]ℰ︀ℬ︀ takes ℬ︀-coordinates as input and produces standard coordinates. The computation feeds it standard coordinates. What it actually produced is the vector whose ℬ︀-coordinates are (3,1), namely 3(1,1)+(1,−1)=(4,2).

To go from standard coordinates to ℬ︀-coordinates, use [id]ℬ︀ℰ︀=12(111−1) (Example 2.3.24):

[𝐯]ℬ︀=[id]ℬ︀ℰ︀[𝐯]ℰ︀=12(111−1)(31)=(21).

Check: 2(1,1)+(1,−1)=(3,1). The subscripts are a guide: in [id]𝒞︀ℬ︀[𝐯]ℬ︀ the inner two must match.

Exercise 2.3.31.routine Find the error in the following argument.

Claim. Let 𝐹 be any field. If 𝐴∈𝐹2×2 satisfies 𝐴(1,1)=(1,1) and 𝐴(1,−1)=(1,−1), then 𝐴=𝐼2.

Proof. The maps 𝑇𝐴 and id=𝑇𝐼2 agree on the vectors (1,1) and (1,−1), which form a basis of 𝐹2. Two linear maps that agree on a basis are equal, so 𝑇𝐴=𝑇𝐼2, and 𝐴=𝐼2 by Proposition 2.3.17.

Solution.

Uses. Example 2.2.3 (Building maps from a convenient basis), Corollary 2.2.6 (Agreeing on a spanning list), Proposition 2.3.17 (Every linear map 𝐹𝑛→𝐹𝑚 is some 𝑇𝐴)

Hint 1. When is (1,1),(1,−1) a basis of 𝐹2? Look at Example 2.2.3.
Hint 2. Over 𝔽2, −1=1. Try 𝐴=(0110).
Sketch. (1,1),(1,−1) is a basis only when 1+1≠0. Over 𝔽2 the two vectors coincide, and 𝐴=(0110) satisfies both hypotheses without being 𝐼2. When 1+1≠0 the argument is correct.

The error is the claim that (1,1),(1,−1) is a basis of 𝐹2 for every field. It is a basis when 1+1≠0 (Example 2.2.3), but over 𝔽2 we have −1=1, so the two vectors are equal and the list is linearly dependent. Then the hypothesis says only that 𝐴(1,1)=(1,1), and the claim fails: over 𝔽2,

(0110)(11)=(11),

so 𝐴=(0110) satisfies both hypotheses and 𝐴≠𝐼2. In general (1,−1)=(1,1) exactly when 1+1=0. When 1+1≠0 the argument is correct as written, by Corollary 2.2.6 and Proposition 2.3.17.

Exercise 2.3.32.standard Let 𝑇:𝐹[𝑥]≤3→𝐹[𝑥]≤3, 𝑇(𝑝)=𝑝(𝑥+1), which is linear by Exercise 2.1.32, and let ℬ︀=1,𝑥,𝑥2,𝑥3.

  1. (a)Find [𝑇]ℬ︀ℬ︀ for 𝐹=ℚ and for 𝐹=𝔽2.
  2. (b)Over 𝔽2, use the matrix to find all 𝑝∈𝔽2[𝑥]≤3 with 𝑝(𝑥+1)=𝑝(𝑥).
  3. (c)Do the same over ℚ.

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Theorem 2.3.9 (The matrix of a map computes the map), Proposition 2.3.11 (Entries of 𝐴𝐱), Theorem 2.3.20 (Linear maps correspond to matrices)

Techniques. Translate between maps and matrices (Technique 2.3.27)

Hint 1. Expand (𝑥+1)𝑘 for 𝑘=0,1,2,3. Over 𝔽2, reduce the binomial coefficients modulo 2.
Hint 2. 𝑝(𝑥+1)=𝑝(𝑥) means 𝑇(𝑝)=𝑝, that is, 𝐴[𝑝]ℬ︀=[𝑝]ℬ︀ with 𝐴=[𝑇]ℬ︀ℬ︀. Write out the four entries of 𝐴(𝑎,𝑏,𝑐,𝑑) and compare.
Sketch. The columns are the coefficients of 1, 1+𝑥, 1+2𝑥+𝑥2, 1+3𝑥+3𝑥2+𝑥3. Over 𝔽2 the condition 𝐴(𝑎,𝑏,𝑐,𝑑)=(𝑎,𝑏,𝑐,𝑑) reads 𝑏+𝑐+𝑑=0 and 𝑑=0, so 𝑝=𝑎+𝑏(𝑥+𝑥2). Over ℚ it reads 𝑏+𝑐+𝑑=0, 2𝑐+3𝑑=0, 3𝑑=0, so 𝑝 is constant.

(a) 𝑇(1)=1, 𝑇(𝑥)=1+𝑥, 𝑇(𝑥2)=1+2𝑥+𝑥2, and 𝑇(𝑥3)=1+3𝑥+3𝑥2+𝑥3. Their coordinate vectors are the columns, so over ℚ and over 𝔽2 (where 2=0 and 3=1) respectively

[𝑇]ℬ︀ℬ︀=(1111012300130001),[𝑇]ℬ︀ℬ︀=(1111010100110001).

The entries are the binomial coefficients of Pascal’s triangle, reduced modulo 2 in the second case.

(b) Let 𝐴 be the matrix over 𝔽2, and [𝑝]ℬ︀=(𝑎,𝑏,𝑐,𝑑). By Theorem 2.3.9 and since coordinates determine vectors, 𝑇(𝑝)=𝑝 if and only if 𝐴(𝑎,𝑏,𝑐,𝑑)=(𝑎,𝑏,𝑐,𝑑). By Proposition 2.3.11,

𝐴(𝑎𝑏𝑐𝑑)=(𝑎+𝑏+𝑐+𝑑𝑏+𝑑𝑐+𝑑𝑑),

so the condition is 𝑏+𝑐+𝑑=0 and 𝑑=0, that is, 𝑑=0 and 𝑐=𝑏 (in 𝔽2, 𝑏+𝑐=0 means 𝑐=𝑏). So the solutions are the four polynomials 𝑝=𝑎+𝑏(𝑥+𝑥2) with 𝑎,𝑏∈𝔽2. Check: (𝑥+1)+(𝑥+1)2=𝑥+1+𝑥2+1=𝑥+𝑥2 over 𝔽2.

(c) Over ℚ the condition 𝐴(𝑎,𝑏,𝑐,𝑑)=(𝑎,𝑏,𝑐,𝑑) reads

𝑎+𝑏+𝑐+𝑑=𝑎,𝑏+2𝑐+3𝑑=𝑏,𝑐+3𝑑=𝑐,𝑑=𝑑,

so 3𝑑=0, then 2𝑐=0, then 𝑏=0: only the constant polynomials satisfy 𝑝(𝑥+1)=𝑝(𝑥). The difference between the two fields is the entry 2 in row 2, column 3: over ℚ it forces 𝑐=0, and over 𝔽2 it vanishes, which lets 𝑥+𝑥2 through.

Exercise 2.3.33.standard Let 𝑇:𝐹[𝑥]≤2→𝐹3, 𝑇(𝑝)=(𝑝(0),𝑝(1),𝑝(2)), where 2=1+1.

  1. (a)Find [𝑇]ℰ︀ℬ︀ for ℬ︀=1,𝑥,𝑥2.
  2. (b)Suppose 2≠0 in 𝐹. Find a basis ℬ︀̊=𝑝0,𝑝1,𝑝2 of 𝐹[𝑥]≤2 with [𝑇]ℰ︀ℬ︀̊=𝐼3, and prove that it is a basis.
  3. (c)With ℬ︀̊ as in (b), show that [𝑞]ℬ︀̊=(𝑞(0),𝑞(1),𝑞(2)) for every 𝑞∈𝐹[𝑥]≤2.
  4. (d)Show that over 𝔽2 no basis ℬ︀̊ with [𝑇]ℰ︀ℬ︀̊=𝐼3 exists.

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Theorem 2.3.9 (The matrix of a map computes the map), Definition 1.6.1 (Basis), Definition 1.2.17 (Evaluation)

Hint 1. (a) The columns are 𝑇(1), 𝑇(𝑥), 𝑇(𝑥2). (b) The condition says 𝑇(𝑝𝑗)=𝐞𝑗+1: each 𝑝𝑗 is 1 at 𝑗 and 0 at the other two points. Build it from the factors 𝑥, 𝑥−1, 𝑥−2.
Hint 2. To prove that 𝑝0,𝑝1,𝑝2 is a basis, show that 𝑞−(𝑞(0)𝑝0+𝑞(1)𝑝1+𝑞(2)𝑝2) vanishes at 0,1,2, and that the only 𝑟=𝑎+𝑏𝑥+𝑐𝑥2 vanishing at 0,1,2 is 𝑟=𝟎.
Hint 3. (d) Over 𝔽2, 2=0. Compare the first and third coordinates of 𝑇(𝑝).
Sketch. (a) (100111124). (b) 𝑝0=(𝑥−1)(𝑥−2)/2, 𝑝1=−𝑥(𝑥−2), 𝑝2=𝑥(𝑥−1)/2. Every 𝑞 equals ∑𝑗𝑞(𝑗)𝑝𝑗, because the difference vanishes at 0,1,2 and 𝑟(0)=𝑟(1)=𝑟(2)=0 forces 𝑟=𝟎 when 2≠0; the coefficients are unique because evaluating ∑𝑐𝑗𝑝𝑗 at 𝑘 gives 𝑐𝑘. (c) [𝑇(𝑞)]ℰ︀=𝐼3[𝑞]ℬ︀̊. (d) Every value 𝑇(𝑝)=(𝑝(0),𝑝(1),𝑝(0)) has equal first and third coordinates, but 𝐞1 does not.

(a) 𝑇(1)=(1,1,1), 𝑇(𝑥)=(0,1,2), and 𝑇(𝑥2)=(0,1,4), so

[𝑇]ℰ︀ℬ︀=(100111124).

(b) We need 𝑇(𝑝𝑗)=𝐞𝑗+1, that is, 𝑝𝑗(𝑘)=1 if 𝑘=𝑗 and 0 otherwise, for 𝑗,𝑘∈{0,1,2}. Let

𝑝0=12(𝑥−1)(𝑥−2)=12(𝑥2−3𝑥+2),𝑝1=−𝑥(𝑥−2)=−𝑥2+2𝑥,𝑝2=12𝑥(𝑥−1)=12(𝑥2−𝑥).

Evaluating the expanded forms: 𝑝0 takes the values 1,0,0 at 0,1,2 (at 2: (4−6+2)/2=0), 𝑝1 takes 0,1,0, and 𝑝2 takes 0,0,1.

Spanning. Let 𝑞∈𝐹[𝑥]≤2 and 𝑟=𝑞−(𝑞(0)𝑝0+𝑞(1)𝑝1+𝑞(2)𝑝2). Evaluation is linear, so 𝑟(𝑘)=𝑞(𝑘)−𝑞(𝑘)=0 for 𝑘=0,1,2. Write 𝑟=𝑎+𝑏𝑥+𝑐𝑥2. Then 𝑟(0)=𝑎=0, 𝑟(1)=𝑏+𝑐=0, and 𝑟(2)=2𝑏+4𝑐=0. Substituting 𝑏=−𝑐 into the last equation gives 2𝑐=0, so 𝑐=0 because 2≠0, and then 𝑏=0. Hence 𝑟=𝟎 and 𝑞=𝑞(0)𝑝0+𝑞(1)𝑝1+𝑞(2)𝑝2.

Uniqueness. If 𝑞=𝑐0𝑝0+𝑐1𝑝1+𝑐2𝑝2, evaluating at 𝑘 gives 𝑞(𝑘)=𝑐𝑘. So the coefficients are determined by 𝑞, and ℬ︀̊ is a basis (Definition 1.6.1). By construction, [𝑇]ℰ︀ℬ︀̊=𝐼3.

(c) By Theorem 2.3.9 and Proposition 2.3.13(c),

(𝑞(0),𝑞(1),𝑞(2))=[𝑇(𝑞)]ℰ︀=𝐼3[𝑞]ℬ︀̊=[𝑞]ℬ︀̊.

(This is also visible in the uniqueness argument.) In this basis, the coordinates of a polynomial are its values.

(d) Over 𝔽2, 2=0, so 𝑇(𝑝)=(𝑝(0),𝑝(1),𝑝(0)) for every 𝑝: the first and third coordinates of every value of 𝑇 agree. If [𝑇]ℰ︀ℬ︀̊=𝐼3, then 𝑇(𝑝0)=𝐞1=(1,0,0), whose first and third coordinates differ. So no such basis exists. Correspondingly, the first and third rows of [𝑇]ℰ︀ℬ︀=(100111100) are equal over 𝔽2.

Exercise 2.3.34.standard Let 𝑇:ℝ2→ℝ2, 𝑇(𝑥,𝑦)=(𝑥+𝑦,2𝑥+2𝑦).

  1. (a)Find bases ℬ︀ and 𝒞︀ of ℝ2 with [𝑇]𝒞︀ℬ︀=(1000).
  2. (b)Show that there is no basis ℬ︀ of ℝ2 with [𝑇]ℬ︀ℬ︀=(1000).
  3. (c)Find a basis ℬ︀ of ℝ2 for which [𝑇]ℬ︀ℬ︀ is diagonal.

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Definition 1.6.1 (Basis), Proposition 1.2.35 (Zero products)

Hint 1. Every value of 𝑇 is a multiple of (1,2): 𝑇(𝑥,𝑦)=(𝑥+𝑦)(1,2). For (a) you need 𝑇(𝐯1)=𝐰1 and 𝑇(𝐯2)=𝟎.
Hint 2. For (b), the matrix would force 𝑇(𝐯1)=𝐯1. Then 𝐯1 is a value of 𝑇. Compute 𝑇 on a multiple of (1,2).
Sketch. (a) ℬ︀=(1,0),(1,−1) and 𝒞︀=(1,2),(0,1): 𝑇(1,0)=(1,2) and 𝑇(1,−1)=𝟎. (b) 𝑇(𝐯1)=𝐯1 forces 𝐯1=𝑐(1,2), but 𝑇(𝑐(1,2))=3𝑐(1,2), so 2𝐯1=𝟎. (c) ℬ︀=(1,2),(1,−1) gives (3000).

Note that 𝑇(𝑥,𝑦)=(𝑥+𝑦)(1,2), so every value of 𝑇 is a multiple of (1,2), and 𝑇(1,2)=3(1,2).

(a) We need 𝑇(𝐯1)=𝐰1 and 𝑇(𝐯2)=𝟎. Take ℬ︀=(1,0),(1,−1), a basis since (𝑥,𝑦)=(𝑥+𝑦)(1,0)−𝑦(1,−1) with no other coefficients possible. Then 𝑇(1,0)=(1,2) and 𝑇(1,−1)=(0,0). Take 𝒞︀=(1,2),(0,1), a basis since (𝑥,𝑦)=𝑥(1,2)+(𝑦−2𝑥)(0,1) with no other coefficients possible. Then [𝑇(1,0)]𝒞︀=(1,0) and [𝑇(1,−1)]𝒞︀=(0,0), so [𝑇]𝒞︀ℬ︀=(1000).

(b) Suppose ℬ︀=𝐯1,𝐯2 is a basis with [𝑇]ℬ︀ℬ︀=(1000). The first column says 𝑇(𝐯1)=𝐯1. So 𝐯1 is a value of 𝑇, hence 𝐯1=𝑐(1,2) for some 𝑐∈ℝ, and then 𝑇(𝐯1)=𝑐𝑇(1,2)=3𝑐(1,2)=3𝐯1. So 3𝐯1=𝐯1, that is, 2𝐯1=𝟎, and 𝐯1=𝟎 by Proposition 1.2.35. But a basis does not contain 𝟎, a contradiction.

(c) Let ℬ︀=(1,2),(1,−1). It is a basis: 𝑎(1,2)+𝑏(1,−1)=(𝑥,𝑦) exactly when 𝑎=(𝑥+𝑦)/3 and 𝑏=(2𝑥−𝑦)/3. Since 𝑇(1,2)=3(1,2) and 𝑇(1,−1)=𝟎,

[𝑇]ℬ︀ℬ︀=(3000).

With two bases the nonzero entry can be scaled to 1, as in (a); with one basis the factor 3 by which 𝑇 stretches the line through (1,2) cannot be changed. Such factors are the eigenvalues of Section 7.2.

Exercise 2.3.35.standard Regard ℂ as a vector space over ℝ with the basis ℬ︀=1,𝑖.

  1. (a)For 𝑧=𝑎+𝑏𝑖 with 𝑎,𝑏∈ℝ, let 𝑀𝑧:ℂ→ℂ, 𝑀𝑧(𝑤)=𝑧𝑤. Find [𝑀𝑧]ℬ︀ℬ︀.
  2. (b)Find the matrix of complex conjugation 𝑤↦𝑤 with respect to ℬ︀.
  3. (c)Show that a matrix 𝐴∈ℝ2×2 is [𝑇]ℬ︀ℬ︀ for some ℂ-linear 𝑇:ℂ→ℂ if and only if 𝐴=(𝑎−𝑏𝑏𝑎) for some 𝑎,𝑏∈ℝ.

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Exercise 2.1.5, Non-example 2.1.14 (Complex conjugation), Theorem 2.3.20 (Linear maps correspond to matrices)

Techniques. Translate between maps and matrices (Technique 2.3.27)

Hint 1. The columns are the ℬ︀-coordinates of 𝑀𝑧(1)=𝑧 and 𝑀𝑧(𝑖)=𝑧𝑖.
Hint 2. For (c), a ℂ-linear map ℂ→ℂ is multiplication by some complex number (Exercise 2.1.5), and it is in particular ℝ-linear, so it has a matrix with respect to ℬ︀.
Sketch. (a) 𝑧=𝑎+𝑏𝑖 and 𝑧𝑖=−𝑏+𝑎𝑖 give (𝑎−𝑏𝑏𝑎). (b) 1=1 and 𝑖=−𝑖 give (100−1). (c) A ℂ-linear 𝑇 is 𝑀𝑧 for 𝑧=𝑇(1), so its matrix has the form in (a); conversely (𝑎−𝑏𝑏𝑎)=[𝑀𝑎+𝑏𝑖]ℬ︀ℬ︀.

(a) 𝑀𝑧 is ℝ-linear (it is even ℂ-linear, Exercise 2.1.5), so it has a matrix with respect to ℬ︀. Since 𝑀𝑧(1)=𝑎+𝑏𝑖 and 𝑀𝑧(𝑖)=(𝑎+𝑏𝑖)𝑖=−𝑏+𝑎𝑖,

[𝑀𝑧]ℬ︀ℬ︀=(𝑎−𝑏𝑏𝑎).

For 𝑧=cos𝜃+𝑖sin𝜃 this is the rotation matrix of Example 2.3.3: multiplying by a complex number of modulus 1 rotates the plane.

(b) Conjugation is ℝ-linear (Non-example 2.1.14), with 1=1 and 𝑖=−𝑖, so its matrix is (100−1).

(c) Let 𝑇:ℂ→ℂ be ℂ-linear. By Exercise 2.1.5, 𝑇=𝑀𝑧 with 𝑧=𝑇(1), and 𝑇 is in particular ℝ-linear. Writing 𝑧=𝑎+𝑏𝑖, part (a) gives [𝑇]ℬ︀ℬ︀=(𝑎−𝑏𝑏𝑎). Conversely, (𝑎−𝑏𝑏𝑎)=[𝑀𝑎+𝑏𝑖]ℬ︀ℬ︀ by (a), and 𝑀𝑎+𝑏𝑖 is ℂ-linear. By Theorem 2.3.20, each such matrix is the matrix of exactly one ℝ-linear map, so the matrices of the form (𝑎−𝑏𝑏𝑎) are exactly the matrices of the ℂ-linear maps. The matrix of conjugation in (b) is not of this form, consistent with Non-example 2.1.14.

Exercise 2.3.36.standard Let 𝑉 and 𝑊 be vector spaces over ℝ with bases. Prove or disprove each statement.

  1. (a)If 𝑆,𝑇∈L(𝑉,𝑊) and [𝑆]𝒞︀ℬ︀=[𝑇]𝒞︀̊ℬ︀̊ for some bases ℬ︀,ℬ︀̊ of 𝑉 and 𝒞︀,𝒞︀̊ of 𝑊, then 𝑆=𝑇.
  2. (b)If 𝑇∈L(𝑉) and [𝑇]ℬ︀ℬ︀ is the zero matrix for some basis ℬ︀, then 𝑇=0.
  3. (c)If 𝑇∈L(𝑉) and [𝑇]𝒞︀ℬ︀=𝐼𝑛 for some bases ℬ︀,𝒞︀ of 𝑉, then 𝑇=id𝑉.
  4. (d)If 𝑇∈L(𝑉) and [𝑇]ℬ︀ℬ︀ is diagonal for some basis ℬ︀, then [𝑇]𝒞︀𝒞︀ is diagonal for every basis 𝒞︀ of 𝑉.
  5. (e)There are bases ℬ︀,𝒞︀ of ℝ2 with [id]𝒞︀ℬ︀=(1111).

Solution.

Uses. Theorem 2.3.20 (Linear maps correspond to matrices), Example 2.3.6 (The zero map and the identity map), Example 2.3.23 (Maps of the plane in adapted bases), Definition 2.3.1 (Matrix of a linear map)

Hint 1. Only (b) is true. For (a), (c), and (d), look at Example 2.3.23 and at maps that send one basis to another.
Hint 2. For (e), what would the two columns say about the vectors of ℬ︀?
Sketch. (a) False: [𝑆ℓ]𝒰︀𝒰︀=(100−1) is also the standard matrix of the reflection across the 𝑥-axis. (b) True: [𝑇]ℬ︀ℬ︀=[0]ℬ︀ℬ︀, so 𝑇=0 by Theorem 2.3.20. (c) False: 𝑇=2id with 𝒞︀=2𝐯1,…,2𝐯𝑛. (d) False: 𝑆ℓ in 𝒰︀ and in ℰ︀. (e) False: both columns equal means 𝐯1=𝐯2.

(a) False. Let ℓ be the line 𝑦=2𝑥 and 𝒰︀ as in Example 2.3.23. Then [𝑆ℓ]𝒰︀𝒰︀=(100−1), which is also [𝑆]ℰ︀ℰ︀ for the reflection 𝑆(𝑥,𝑦)=(𝑥,−𝑦) across the 𝑥-axis. But 𝑆ℓ≠𝑆, since 𝑆ℓ(1,2)=(1,2) and 𝑆(1,2)=(1,−2).

(b) True. The zero map also has the zero matrix (Example 2.3.6), so [𝑇]ℬ︀ℬ︀=[0]ℬ︀ℬ︀, and 𝑇=0 by Theorem 2.3.20(a).

(c) False. Take 𝑉=ℝ with ℬ︀=1 and 𝒞︀=2, and 𝑇=2idℝ. Then 𝑇(1)=2=1⋅2, so [𝑇]𝒞︀ℬ︀=(1)=𝐼1, but 𝑇≠id. In general, [𝑇]𝒞︀ℬ︀=𝐼𝑛 says exactly that 𝑇(𝐯𝑗)=𝐰𝑗 for each 𝑗, which describes the map sending one basis to the other.

(d) False. With 𝒰︀ as in (a), [𝑆ℓ]𝒰︀𝒰︀=(100−1) is diagonal, but [𝑆ℓ]ℰ︀ℰ︀=15(−3443) is not (Example 2.3.19).

(e) False. The columns of [id]𝒞︀ℬ︀ are [𝐯1]𝒞︀ and [𝐯2]𝒞︀. If both are (1,1), then 𝐯1=𝐰1+𝐰2=𝐯2, so ℬ︀ contains a vector twice and is linearly dependent, which is impossible for a basis.

Exercise 2.3.37.standard Let 𝑇∈L(𝑉,𝑊) and 𝐴=[𝑇]𝒞︀ℬ︀. Describe how 𝐴 changes when the bases are modified as follows, and prove your answer. (Each modified list is again a basis; check this too.)

  1. (a)Two vectors 𝐯𝑗 and 𝐯𝑘 of ℬ︀ are swapped.
  2. (b)𝐯𝑗 is replaced by 𝑐𝐯𝑗, where 𝑐≠0.
  3. (c)Two vectors 𝐰𝑖 and 𝐰𝑘 of 𝒞︀ are swapped.
  4. (d)𝐰𝑖 is replaced by 𝑐𝐰𝑖, where 𝑐≠0.
  5. (e)𝐰𝑘 is replaced by 𝐰𝑘+𝑐𝐰𝑖, where 𝑖≠𝑘 and 𝑐∈𝐹.

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Definition 1.6.14 (Coordinates), Definition 1.6.1 (Basis)

Hint 1. Changing ℬ︀ changes which vectors 𝑇 is applied to, so it acts on the columns. Changing 𝒞︀ changes the coordinates of every value, so it acts on the rows.
Hint 2. For (d) and (e), take 𝑇(𝐯𝑗)=∑𝑙𝑎𝑙𝑗𝐰𝑙 and rewrite the right side in the new basis. In (e), 𝐰𝑘=(𝐰𝑘+𝑐𝐰𝑖)−𝑐𝐰𝑖.
Sketch. (a) Columns 𝑗 and 𝑘 swap. (b) Column 𝑗 is multiplied by 𝑐. (c) Rows 𝑖 and 𝑘 swap. (d) Row 𝑖 is multiplied by 𝑐−1, since 𝑎𝐰𝑖=(𝑎𝑐−1)(𝑐𝐰𝑖). (e) Row 𝑖 becomes row 𝑖 minus 𝑐 times row 𝑘, since 𝑎𝐰𝑘=𝑎(𝐰𝑘+𝑐𝐰𝑖)−𝑎𝑐𝐰𝑖.

The modified lists are bases. Reordering a list does not change which combinations represent a vector, only the order of the terms, so (a) and (c) give bases. For (b),

∑𝑙𝑎𝑙𝐯𝑙=∑𝑙≠𝑗𝑎𝑙𝐯𝑙+(𝑎𝑗𝑐−1)(𝑐𝐯𝑗),

so a vector has a representation in the new list exactly when it has one in the old, and the coefficients correspond one to one; the same goes for (d). For (e), write 𝐰𝑘′=𝐰𝑘+𝑐𝐰𝑖 and 𝐰𝑙′=𝐰𝑙 for 𝑙≠𝑘. Then

∑𝑙𝑏𝑙𝐰𝑙′=∑𝑙𝑏𝑙𝐰𝑙+𝑐𝑏𝑘𝐰𝑖,

so the combination with coefficients (𝑏𝑙) in the new list equals the combination with coefficients (𝑎𝑙) in the old list, where 𝑎𝑙=𝑏𝑙 for 𝑙≠𝑖 and 𝑎𝑖=𝑏𝑖+𝑐𝑏𝑘. This correspondence between coefficient lists is a bijection (its inverse is 𝑏𝑙=𝑎𝑙 for 𝑙≠𝑖 and 𝑏𝑖=𝑎𝑖−𝑐𝑎𝑘), so every vector has exactly one representation in the new list.

(a) The columns of the new matrix are [𝑇(𝐯𝑙)]𝒞︀ in the new order, so columns 𝑗 and 𝑘 of 𝐴 are swapped.

(b) The new 𝑗-th column is [𝑇(𝑐𝐯𝑗)]𝒞︀=𝑐[𝑇(𝐯𝑗)]𝒞︀ by linearity of 𝑇 and of coordinates, so column 𝑗 is multiplied by 𝑐; the other columns are unchanged.

(c) The coordinates of a vector with respect to the reordered basis are its old coordinates reordered in the same way. So in every column, the entries in positions 𝑖 and 𝑘 are swapped: rows 𝑖 and 𝑘 of 𝐴 are swapped.

(d) For each 𝑗,

𝑇(𝐯𝑗)=∑𝑙≠𝑖𝑎𝑙𝑗𝐰𝑙+(𝑎𝑖𝑗𝑐−1)(𝑐𝐰𝑖),

so in the new basis the coordinates of 𝑇(𝐯𝑗) are the old ones with the 𝑖-th entry multiplied by 𝑐−1. Row 𝑖 of 𝐴 is multiplied by 𝑐−1, not by 𝑐.

(e) For each 𝑗, substituting 𝐰𝑘=𝐰𝑘′−𝑐𝐰𝑖,

𝑇(𝐯𝑗)=∑𝑙≠𝑘𝑎𝑙𝑗𝐰𝑙+𝑎𝑘𝑗(𝐰𝑘′−𝑐𝐰𝑖)=∑𝑙≠𝑖,𝑘𝑎𝑙𝑗𝐰𝑙′+(𝑎𝑖𝑗−𝑐𝑎𝑘𝑗)𝐰𝑖′+𝑎𝑘𝑗𝐰𝑘′.

So row 𝑖 of 𝐴 is replaced by row 𝑖 minus 𝑐 times row 𝑘, and the other rows are unchanged.

In the language of Section 3.2: changing the basis of the target performs row operations on the matrix, and changing the basis of the domain performs column operations. Note that in (d) and (e) the row operation undoes the operation on the basis, with the roles of the indices exchanged in (e): adding 𝑐 times 𝐰𝑖 to 𝐰𝑘 subtracts 𝑐 times row 𝑘 from row 𝑖.

Exercise 2.3.38.standard A matrix 𝐴∈𝐹𝑛×𝑛 is upper triangular if 𝑎𝑖𝑗=0 whenever 𝑖>𝑗. Let 𝑇∈L(𝑉), and for 𝑘=1,…,𝑛 let 𝑉𝑘=span(𝐯1,…,𝐯𝑘). Show that the following are equivalent.
  1. (i)[𝑇]ℬ︀ℬ︀ is upper triangular.
  2. (ii)𝑇(𝐯𝑘)∈𝑉𝑘 for 𝑘=1,…,𝑛.
  3. (iii)𝑇(𝑉𝑘)⊆𝑉𝑘 for 𝑘=1,…,𝑛.

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Definition 1.6.14 (Coordinates), Proposition 2.1.16 (Linear maps preserve spans and linear relations), Proposition 1.4.14 (The span is the smallest subspace containing a list)

Techniques. Check it on a basis (Technique 2.2.7)

Hint 1. Column 𝑘 of [𝑇]ℬ︀ℬ︀ is [𝑇(𝐯𝑘)]ℬ︀. Upper triangular means that its entries below position 𝑘 vanish.
Hint 2. For (ii) ⇒ (iii), 𝑇(𝑉𝑘) is spanned by 𝑇(𝐯1),…,𝑇(𝐯𝑘), and each of these lies in 𝑉𝑗⊆𝑉𝑘 for some 𝑗≤𝑘.
Sketch. (i) ⇔ (ii): 𝑎𝑖𝑘=0 for all 𝑖>𝑘 says that 𝑇(𝐯𝑘)=∑𝑖≤𝑘𝑎𝑖𝑘𝐯𝑖∈𝑉𝑘, and conversely, by uniqueness of coordinates. (ii) ⇒ (iii): 𝑇(𝑉𝑘)=span(𝑇(𝐯1),…,𝑇(𝐯𝑘))⊆𝑉𝑘. (iii) ⇒ (ii): 𝐯𝑘∈𝑉𝑘.

(i) ⇔ (ii). Fix 𝑘. The 𝑘-th column of [𝑇]ℬ︀ℬ︀ is [𝑇(𝐯𝑘)]ℬ︀=(𝑎1𝑘,…,𝑎𝑛𝑘), so 𝑇(𝐯𝑘)=∑𝑖=1𝑛𝑎𝑖𝑘𝐯𝑖. If 𝑎𝑖𝑘=0 for all 𝑖>𝑘, then 𝑇(𝐯𝑘)=∑𝑖≤𝑘𝑎𝑖𝑘𝐯𝑖∈𝑉𝑘. Conversely, if 𝑇(𝐯𝑘)∈𝑉𝑘, then 𝑇(𝐯𝑘)=∑𝑖≤𝑘𝑐𝑖𝐯𝑖 for some scalars, which is a representation in terms of ℬ︀ with coefficients 0 for 𝑖>𝑘. By uniqueness of coordinates (Definition 1.6.14), 𝑎𝑖𝑘=0 for 𝑖>𝑘. Applying this for every 𝑘 gives the equivalence.

(ii) ⇒ (iii). For 𝑗≤𝑘, 𝑇(𝐯𝑗)∈𝑉𝑗⊆𝑉𝑘. By Proposition 2.1.16, 𝑇(𝑉𝑘)=span(𝑇(𝐯1),…,𝑇(𝐯𝑘)), and this is contained in the subspace 𝑉𝑘 by Proposition 1.4.14.

(iii) ⇒ (ii). 𝐯𝑘∈𝑉𝑘, so 𝑇(𝐯𝑘)∈𝑇(𝑉𝑘)⊆𝑉𝑘.

For example, [𝐷]ℬ︀ℬ︀ in Example 2.3.4 is upper triangular, because 𝐷 maps polynomials of degree at most 𝑘 to polynomials of degree at most 𝑘. Upper-triangular matrices of operators return in Section 7.5.

Exercise 2.3.39.hard Let 𝑁∈𝐹4×4 be the matrix with 1 in positions (1,2), (2,3), (3,4) and 0 elsewhere, and let 𝐷 be differentiation on 𝐹[𝑥]≤3. For each of 𝐹=ℚ, 𝔽2, 𝔽3, 𝔽5, decide whether there is a basis ℬ︀ of 𝐹[𝑥]≤3 with [𝐷]ℬ︀ℬ︀=𝑁.

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Example 2.1.9 (Maps of polynomials), Corollary 2.2.6 (Agreeing on a spanning list), Proposition 1.1.24 (ℤ/𝑛ℤ is a field if and only if 𝑛 is prime)

Hint 1. Read off what [𝐷]ℬ︀ℬ︀=𝑁 says about 𝐷(𝐯1),…,𝐷(𝐯4). What is 𝐷(𝐷(𝐷(𝐯4)))?
Hint 2. Over 𝔽2, compute 𝐷(𝐷(𝑥𝑘)); over 𝔽3, compute 𝐷(𝐷(𝐷(𝑥𝑘))). Products of two, or of three, consecutive integers are divisible by 2, or by 3.
Hint 3. Over ℚ and 𝔽5, try to scale the monomials so that each one differentiates to the previous one.
Sketch. [𝐷]ℬ︀ℬ︀=𝑁 means 𝐷(𝐯1)=𝟎 and 𝐷(𝐯𝑘)=𝐯𝑘−1, so 𝐷3(𝐯4)=𝐯1≠𝟎 and 𝐷2(𝐯3)=𝐯1≠𝟎. Over 𝔽2, 𝐷2=0 since 𝑘(𝑘−1) is even; over 𝔽3, 𝐷3=0 since 𝑘(𝑘−1)(𝑘−2) is divisible by 3. So no basis exists there. Over ℚ and 𝔽5, 6≠0 and 1,𝑥,𝑥2/2,𝑥3/6 works.

The 𝑘-th column of 𝑁 is 𝟎 for 𝑘=1 and 𝐞𝑘−1 for 𝑘=2,3,4. So [𝐷]ℬ︀ℬ︀=𝑁 for ℬ︀=𝐯1,𝐯2,𝐯3,𝐯4 means exactly that

𝐷(𝐯1)=𝟎,𝐷(𝐯2)=𝐯1,𝐷(𝐯3)=𝐯2,𝐷(𝐯4)=𝐯3.

In that case 𝐷(𝐷(𝐯3))=𝐯1 and 𝐷(𝐷(𝐷(𝐯4)))=𝐯1, and 𝐯1≠𝟎 because it belongs to a basis.

𝔽2: no. For 𝑘≥2, 𝐷(𝐷(𝑥𝑘))=𝑘(𝑘−1)𝑥𝑘−2, and 𝑘(𝑘−1) is even, so it is 0 in 𝔽2. Also 𝐷(𝐷(1))=𝐷(𝐷(𝑥))=𝟎. So the linear maps 𝐷∘𝐷 and 0 agree on the basis 1,𝑥,𝑥2,𝑥3, and 𝐷∘𝐷=0 (Corollary 2.2.6). This contradicts 𝐷(𝐷(𝐯3))=𝐯1≠𝟎.

𝔽3: no. For 𝑘≥3, 𝐷(𝐷(𝐷(𝑥𝑘)))=𝑘(𝑘−1)(𝑘−2)𝑥𝑘−3, and one of three consecutive integers is divisible by 3, so the coefficient is 0 in 𝔽3. For 𝑘≤2, 𝐷(𝐷(𝐷(𝑥𝑘)))=𝟎 as well. As before, 𝐷∘𝐷∘𝐷=0, contradicting 𝐷(𝐷(𝐷(𝐯4)))=𝐯1≠𝟎.

ℚ and 𝔽5: yes. In both fields 2≠0 and 6≠0 (in 𝔽5, 6=1). Let

ℬ︀=1,𝑥,12𝑥2,16𝑥3.

It is a basis of 𝐹[𝑥]≤3, since

𝑎+𝑏𝑥+𝑐𝑥2+𝑑𝑥3=𝑎⋅1+𝑏𝑥+2𝑐⋅12𝑥2+6𝑑⋅16𝑥3,

and these coefficients are the only possible ones. Also 𝐷(1)=𝟎, 𝐷(𝑥)=1, 𝐷(12𝑥2)=𝑥, and 𝐷(16𝑥3)=12𝑥2, so [𝐷]ℬ︀ℬ︀=𝑁. Over 𝔽5, 12=3 and 16=1, so the basis is 1,𝑥,3𝑥2,𝑥3; for instance 𝐷(𝑥3)=3𝑥2.

So the answer depends on the field: the property 𝐷∘𝐷∘𝐷≠0, which every operator with matrix 𝑁 has, holds over ℚ and 𝔽5 and fails over 𝔽2 and 𝔽3.

Exercise 2.3.40.hard Let 𝑇∈L(𝑉), where 𝑉 has a basis of length 𝑛≥1. Show that [𝑇]ℬ︀ℬ︀ is the same matrix for every basis ℬ︀ of 𝑉 of length 𝑛 if and only if 𝑇=𝜆id𝑉 for some 𝜆∈𝐹. (In Section 4.1 we will see that every basis of 𝑉 has length 𝑛.)

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Example 2.3.6 (The zero map and the identity map), Theorem 2.3.20 (Linear maps correspond to matrices), Exercise 2.3.37

Hint 1. One direction is quick: what is [𝜆id𝑉]ℬ︀ℬ︀? For the other, fix one basis ℬ︀ with matrix 𝐴, and compare 𝐴 with the matrix in a cleverly modified basis.
Hint 2. For 𝑖≠𝑗, replace 𝐯𝑗 by 𝐯𝑗+𝐯𝑖. How do the coordinates of a vector change? (See Exercise 2.3.37.)
Hint 3. In the new basis, a vector’s coordinates are the old ones except that the 𝑖-th becomes (old 𝑖-th) minus (old 𝑗-th). Compare the entries in row 𝑖 of the two matrices, first in a column 𝑘≠𝑗, then in column 𝑗.
Sketch. [𝜆id]ℬ︀ℬ︀=𝜆𝐼𝑛 for every ℬ︀. Conversely, let 𝐴=[𝑇]ℬ︀ℬ︀ and let ℬ︀′ be ℬ︀ with 𝐯𝑗 replaced by 𝐯𝑗+𝐯𝑖. The ℬ︀′-coordinates of a vector are its ℬ︀-coordinates with the 𝑖-th entry replaced by (entry 𝑖) − (entry 𝑗). Entry (𝑖,𝑘) of [𝑇]ℬ︀′ℬ︀′ for 𝑘≠𝑗 is 𝑎𝑖𝑘−𝑎𝑗𝑘, so 𝑎𝑗𝑘=0. Entry (𝑖,𝑗) is 𝑎𝑖𝑗+𝑎𝑖𝑖−𝑎𝑗𝑗−𝑎𝑗𝑖, so 𝑎𝑖𝑖=𝑎𝑗𝑗. Hence 𝐴=𝜆𝐼𝑛 and 𝑇=𝜆id.

If 𝑇=𝜆id𝑉. Then 𝑇(𝐯𝑗)=𝜆𝐯𝑗, whose coordinate vector is 𝜆𝐞𝑗, so [𝑇]ℬ︀ℬ︀=𝜆𝐼𝑛 for every basis ℬ︀ of length 𝑛.

Conversely, suppose all the matrices [𝑇]ℬ︀ℬ︀ with ℬ︀ of length 𝑛 are equal. Fix a basis ℬ︀=𝐯1,…,𝐯𝑛 and let 𝐴=[𝑇]ℬ︀ℬ︀. If 𝑛=1, then 𝐴=(𝜆) for some 𝜆, so 𝑇(𝐯1)=𝜆𝐯1, and 𝑇=𝜆id𝑉 because both are linear and agree on the basis.

Let 𝑛≥2, and fix 𝑖≠𝑗. Let ℬ︀′ be ℬ︀ with 𝐯𝑗 replaced by 𝐯𝑗+𝐯𝑖; it is a basis of length 𝑛 by Exercise 2.3.37(e) (with 𝑐=1). Since 𝐯𝑗=(𝐯𝑗+𝐯𝑖)−𝐯𝑖, a vector 𝐲=∑𝑙𝑐𝑙𝐯𝑙 equals

𝐲=∑𝑙≠𝑖,𝑗𝑐𝑙𝐯𝑙+(𝑐𝑖−𝑐𝑗)𝐯𝑖+𝑐𝑗(𝐯𝑗+𝐯𝑖).

So [𝐲]ℬ︀′ is [𝐲]ℬ︀ with the 𝑖-th entry replaced by 𝑐𝑖−𝑐𝑗.

Column 𝑘≠𝑗. The 𝑘-th vector of ℬ︀′ is 𝐯𝑘, and 𝑇(𝐯𝑘)=∑𝑙𝑎𝑙𝑘𝐯𝑙. So the (𝑖,𝑘) entry of [𝑇]ℬ︀′ℬ︀′ is 𝑎𝑖𝑘−𝑎𝑗𝑘. Since this matrix equals 𝐴, 𝑎𝑖𝑘−𝑎𝑗𝑘=𝑎𝑖𝑘, that is, 𝑎𝑗𝑘=0. Since 𝑛≥2, for every 𝑗 there is some 𝑖≠𝑗, so 𝑎𝑗𝑘=0 whenever 𝑗≠𝑘: 𝐴 is diagonal.

Column 𝑗. The 𝑗-th vector of ℬ︀′ is 𝐯𝑗+𝐯𝑖, and 𝑇(𝐯𝑗+𝐯𝑖)=∑𝑙(𝑎𝑙𝑗+𝑎𝑙𝑖)𝐯𝑙. So the (𝑖,𝑗) entry of [𝑇]ℬ︀′ℬ︀′ is (𝑎𝑖𝑗+𝑎𝑖𝑖)−(𝑎𝑗𝑗+𝑎𝑗𝑖)=𝑎𝑖𝑖−𝑎𝑗𝑗, using that 𝐴 is diagonal. It must equal 𝑎𝑖𝑗=0, so 𝑎𝑖𝑖=𝑎𝑗𝑗.

So 𝐴=𝜆𝐼𝑛 with 𝜆=𝑎11. Since [𝜆id𝑉]ℬ︀ℬ︀=𝜆𝐼𝑛 as well, 𝑇=𝜆id𝑉 by Theorem 2.3.20.

Exercise 2.3.41.hard Lights out on a line. A row of 𝑛≥2 lamps is controlled by 𝑛 buttons. Pressing button 𝑖 switches lamp 𝑖 and its neighbours (lamps 𝑖−1 and 𝑖+1, when they exist) from on to off or from off to on. Record a configuration of the lamps as 𝐬∈𝔽2𝑛, with 𝑠𝑖=1 when lamp 𝑖 is on.

  1. (a)Let 𝐴∈𝔽2𝑛×𝑛 have 𝑎𝑖𝑗=1 when |𝑖−𝑗|≤1 and 𝑎𝑖𝑗=0 otherwise. Show that pressing buttons in any order changes the configuration 𝐬 to 𝐬+𝐴𝐱, where 𝑥𝑗∈𝔽2 is the number of times button 𝑗 was pressed, modulo 2.
  2. (b)Show that every configuration can be switched off completely if and only if 𝑛 is not of the form 3𝑘+2.

Solution.

Uses. Definition 2.3.8 (Matrix–vector product), Proposition 2.3.11 (Entries of 𝐴𝐱)

Hint 1. Pressing button 𝑗 adds the 𝑗-th column of 𝐴 to 𝐬. Over 𝔽2, adding a vector twice adds nothing.
Hint 2. Switching everything off means solving 𝐴𝐱=𝐬. Set 𝑥0=𝑥𝑛+1=0, so that every equation reads 𝑥𝑖−1+𝑥𝑖+𝑥𝑖+1=𝑠𝑖. Once 𝑥1 is chosen, the equations for 𝑖=1,…,𝑛−1 determine 𝑥2,…,𝑥𝑛 one at a time.
Hint 3. Compare the two sequences obtained from 𝑥1=0 and 𝑥1=1. Their sum satisfies 𝑑𝑖+1=𝑑𝑖+𝑑𝑖−1 with 𝑑0=0, 𝑑1=1, which is periodic: 0,1,1,0,1,1,….
Sketch. (a) Each press of button 𝑗 adds column 𝐚𝑗; addition in 𝔽2𝑛 is commutative and 𝐚𝑗+𝐚𝑗=𝟎, so the total change is ∑𝑗𝑥𝑗𝐚𝑗=𝐴𝐱. (b) Solving 𝐴𝐱=𝐬 by choosing 𝑥1 and propagating, the last equation becomes 𝑥𝑛+1=0. The two choices of 𝑥1 give values of 𝑥𝑛+1 differing by 𝑑𝑛+1, where 𝑑 is 0,1,1 repeated. If 3∤𝑛+1, exactly one choice works for each 𝐬. If 3∣𝑛+1, either both or neither work, so each solvable 𝐬 has two solutions 𝐱, only 2𝑛−1 of the 2𝑛 configurations are solvable, and some configuration cannot be switched off.

(a) Pressing button 𝑗 switches exactly the lamps 𝑖 with |𝑖−𝑗|≤1, that is, it adds to 𝐬 the vector 𝐚𝑗 with 1 in these positions, which is the 𝑗-th column of 𝐴. A sequence of presses adds the corresponding columns, and since addition in 𝔽2𝑛 is commutative, the order does not matter. Since 𝐚𝑗+𝐚𝑗=𝟎 in 𝔽2𝑛, pressing button 𝑗 a total of 𝑚𝑗 times adds 𝐚𝑗 if 𝑚𝑗 is odd and nothing if it is even. So the configuration becomes 𝐬+∑𝑗𝑥𝑗𝐚𝑗=𝐬+𝐴𝐱 (Definition 2.3.8).

(b) By (a), 𝐬 can be switched off exactly when 𝐬+𝐴𝐱=𝟎 for some 𝐱∈𝔽2𝑛, that is, when 𝐴𝐱=𝐬 (in 𝔽2, −𝐬=𝐬). By Proposition 2.3.11, with the convention 𝑥0=𝑥𝑛+1=0, this system reads

𝑥𝑖−1+𝑥𝑖+𝑥𝑖+1=𝑠𝑖(𝑖=1,…,𝑛).

Propagation. Given 𝐬 and a choice of 𝑥1∈𝔽2, set 𝑥0=0 and define 𝑥2,𝑥3,…,𝑥𝑛+1 by 𝑥𝑖+1=𝑠𝑖+𝑥𝑖−1+𝑥𝑖 for 𝑖=1,…,𝑛. For 𝑖≤𝑛−1 this is forced by the 𝑖-th equation, and the last step defines a number 𝑥𝑛+1. The sequence 𝑥1,…,𝑥𝑛 is a solution if and only if the 𝑛-th equation also holds with 𝑥𝑛+1=0, that is, if and only if the propagated value 𝑥𝑛+1 is 0. Every solution arises this way from its own 𝑥1. So for each 𝐬, the solutions correspond to those 𝑥1∈{0,1} whose propagated 𝑥𝑛+1 is 0.

Comparing the two choices. Let 𝑥 and 𝑥′ be the sequences propagated from 𝑥1=0 and 𝑥1′=1, and let 𝑑𝑖=𝑥𝑖+𝑥𝑖′. Then 𝑑0=0, 𝑑1=1, and 𝑑𝑖+1=𝑑𝑖−1+𝑑𝑖, since the 𝑠𝑖 cancel. So 𝑑=0,1,1,0,1,1,0,…, and 𝑑𝑖=0 exactly when 3 divides 𝑖.

If 3∤𝑛+1, then 𝑥𝑛+1+𝑥𝑛+1′=𝑑𝑛+1=1, so exactly one of 𝑥𝑛+1,𝑥𝑛+1′ is 0, and 𝐴𝐱=𝐬 has exactly one solution. Every configuration can be switched off.

If 3∣𝑛+1, then 𝑥𝑛+1=𝑥𝑛+1′, so for each 𝐬 the system has either two solutions or none. Each of the 2𝑛 vectors 𝐱 solves the system for exactly one 𝐬, namely 𝐬=𝐴𝐱. So the solvable configurations number 2𝑛/2=2𝑛−1<2𝑛, and some configuration cannot be switched off. Finally, 3 divides 𝑛+1 exactly when 𝑛=3𝑘+2 for some integer 𝑘≥0.

For example, for 𝑛=2 the matrix is (1111), both buttons switch both lamps, and the configuration (1,0) cannot be switched off.

Exercise 2.3.42.standard Using the matrix of Δ(𝑝)=𝑝(𝑥+1)−𝑝(𝑥) on ℚ[𝑥]≤3 with respect to 1,𝑥,𝑥2,𝑥3, find all 𝑝∈ℚ[𝑥]≤3 with 𝑝(𝑥+1)−𝑝(𝑥)=𝑥2. Deduce a formula for 02+12+⋯+(𝑛−1)2, as in Example 2.3.28.

Solution.

Uses. Example 2.3.28 (Translating in both directions), Theorem 2.3.9 (The matrix of a map computes the map), Proposition 2.3.11 (Entries of 𝐴𝐱)

Techniques. Translate between maps and matrices (Technique 2.3.27)

Hint 1. Δ(𝑥3)=(𝑥+1)3−𝑥3=1+3𝑥+3𝑥2. The other columns are as in Example 2.3.28, with an extra zero row.
Hint 2. Solve [Δ](𝑎,𝑏,𝑐,𝑑)=(0,0,1,0) from the bottom up.
Sketch. The new column is (1,3,3,0). The system 𝑏+𝑐+𝑑=0, 2𝑐+3𝑑=0, 3𝑑=1 gives 𝑑=1/3, 𝑐=−1/2, 𝑏=1/6, 𝑎 free, so 𝑝=𝑎+𝑥(𝑥−1)(2𝑥−1)/6. Telescoping gives ∑𝑘=0𝑛−1𝑘2=𝑛(𝑛−1)(2𝑛−1)/6.

With ℬ︀=1,𝑥,𝑥2,𝑥3, we have Δ(1)=𝟎, Δ(𝑥)=1, Δ(𝑥2)=1+2𝑥, and Δ(𝑥3)=1+3𝑥+3𝑥2, so

[Δ]ℬ︀ℬ︀=(0111002300030000).

For 𝑝=𝑎+𝑏𝑥+𝑐𝑥2+𝑑𝑥3, the equation Δ(𝑝)=𝑥2 becomes [Δ]ℬ︀ℬ︀(𝑎,𝑏,𝑐,𝑑)=(0,0,1,0) (Theorem 2.3.9), that is,

𝑏+𝑐+𝑑=0,2𝑐+3𝑑=0,3𝑑=1.

So 𝑑=1/3, 𝑐=−1/2, 𝑏=1/2−1/3=1/6, and 𝑎 is arbitrary:

𝑝=𝑎+𝑥6−𝑥22+𝑥33=𝑎+𝑥(𝑥−1)(2𝑥−1)6.

(Indeed 𝑥(𝑥−1)(2𝑥−1)=2𝑥3−3𝑥2+𝑥.)

For 𝑞(𝑡)=𝑡(𝑡−1)(2𝑡−1)/6 and every number 𝑡,

𝑞(𝑡+1)−𝑞(𝑡)=𝑡((𝑡+1)(2𝑡+1)−(𝑡−1)(2𝑡−1))6=𝑡⋅6𝑡6=𝑡2.

Summing over 𝑡=0,1,…,𝑛−1, the right side telescopes:

∑𝑘=0𝑛−1𝑘2=𝑞(𝑛)−𝑞(0)=𝑛(𝑛−1)(2𝑛−1)6.

For 𝑛=3: 0+1+4=5=(3⋅2⋅5)/6.

Exercise 2.3.43.standard For 𝐲∈𝐹𝑘 let 𝑠(𝐲)=𝑦1+⋯+𝑦𝑘 be the sum of its entries, and let 𝐴∈𝐹𝑚×𝑛.

  1. (a)Show that 𝑠(𝐴𝐱)=𝑠(𝐱) for every 𝐱∈𝐹𝑛 if and only if the entries of each column of 𝐴 add up to 1.
  2. (b)Show that 𝐴(1,…,1)=𝑐(1,…,1) if and only if the entries of each row of 𝐴 add up to 𝑐.
  3. (c)Let 𝐹=ℝ, and suppose that all entries of 𝐴 are nonnegative and each column adds up to 1. Show that if the entries of 𝐱 are nonnegative and add up to 1, then the entries of 𝐴𝐱 are also nonnegative and add up to 1.

Solution.

Uses. Definition 2.3.8 (Matrix–vector product), Proposition 2.3.11 (Entries of 𝐴𝐱), Proposition 2.3.13 (Linearity of the product)

Hint 1. The map 𝑠 is linear. Apply it to 𝐴𝐱=∑𝑗𝑥𝑗𝐚𝑗.
Hint 2. For the converse in (a), take 𝐱=𝐞𝑗. For (b), use the row-times-column rule.
Sketch. (a) 𝑠(𝐴𝐱)=∑𝑗𝑥𝑗𝑠(𝐚𝑗), which is 𝑠(𝐱) when every 𝑠(𝐚𝑗)=1; conversely 𝑠(𝐚𝑗)=𝑠(𝐴𝐞𝑗)=𝑠(𝐞𝑗)=1. (b) The 𝑖-th entry of 𝐴(1,…,1) is the 𝑖-th row sum. (c) The entries ∑𝑗𝑎𝑖𝑗𝑥𝑗 are sums of products of nonnegative numbers, and they add up to 1 by (a).

The map 𝑠:𝐹𝑘→𝐹 is linear, since

𝑠(𝑐𝐲+𝐳)=∑𝑖(𝑐𝑦𝑖+𝑧𝑖)=𝑐𝑠(𝐲)+𝑠(𝐳).

(a) Let 𝐚1,…,𝐚𝑛 be the columns of 𝐴. By Definition 2.3.8 and linearity of 𝑠,

𝑠(𝐴𝐱)=𝑠(𝑥1𝐚1+⋯+𝑥𝑛𝐚𝑛)=𝑥1𝑠(𝐚1)+⋯+𝑥𝑛𝑠(𝐚𝑛).

If 𝑠(𝐚𝑗)=1 for every 𝑗, this is 𝑥1+⋯+𝑥𝑛=𝑠(𝐱). Conversely, if 𝑠(𝐴𝐱)=𝑠(𝐱) for all 𝐱, take 𝐱=𝐞𝑗: by Proposition 2.3.13(c), 𝑠(𝐚𝑗)=𝑠(𝐴𝐞𝑗)=𝑠(𝐞𝑗)=1.

(b) By Proposition 2.3.11, the 𝑖-th entry of 𝐴(1,…,1) is 𝑎𝑖1+⋯+𝑎𝑖𝑛, the sum of the entries of row 𝑖. So 𝐴(1,…,1)=𝑐(1,…,1) if and only if every row sum is 𝑐.

(c) By Proposition 2.3.11, the 𝑖-th entry of 𝐴𝐱 is ∑𝑗𝑎𝑖𝑗𝑥𝑗, a sum of products of nonnegative numbers, hence nonnegative. By (a), the entries of 𝐴𝐱 add up to 𝑠(𝐱)=1. Vectors with nonnegative entries adding up to 1 are probability distributions, and matrices as in (c) describe how they evolve in a Markov chain (Section 11.1).

Exercise 2.3.44.standardBeyond 21-242 The matrix of an operator on 𝐹[𝑥], which has no finite basis, can still be defined. For 𝑇∈L(𝐹[𝑥]), let 𝑎𝑖𝑗∈𝐹 (𝑖,𝑗≥0) be the coefficients with 𝑇(𝑥𝑗)=∑𝑖𝑎𝑖𝑗𝑥𝑖. Call the array (𝑎𝑖𝑗)𝑖,𝑗≥0 the matrix of 𝑇.

  1. (a)Show that each column of the matrix has only finitely many nonzero entries, and that every array (𝑎𝑖𝑗)𝑖,𝑗≥0 with this property is the matrix of exactly one 𝑇∈L(𝐹[𝑥]).
  2. (b)Find the matrices of differentiation 𝐷 and of multiplication by 𝑥.
  3. (c)Show that if 𝑝 has coefficients (𝑐0,𝑐1,…), then 𝑇(𝑝) has coefficients (∑𝑗𝑎𝑖𝑗𝑐𝑗)𝑖≥0, where each sum has only finitely many nonzero terms.
  4. (d)Give an operator whose matrix has a row with infinitely many nonzero entries.

Solution.

Uses. Proposition 2.2.20 (Linear maps out of 𝐹[𝑥]), Definition 1.2.13 (Polynomials), Example 2.1.9 (Maps of polynomials)

Hint 1. Column 𝑗 lists the coefficients of the polynomial 𝑇(𝑥𝑗). For the converse, use Proposition 2.2.20.
Hint 2. For (c), write 𝑝=∑𝑗𝑐𝑗𝑥𝑗 and apply 𝑇 term by term. For (d), try an evaluation, viewed as a map into constants.
Sketch. (a) 𝑇(𝑥𝑗) is a polynomial, so its coefficients are eventually 0. Given a column-finite array, 𝐰𝑗=∑𝑖𝑎𝑖𝑗𝑥𝑖 is a polynomial, and Proposition 2.2.20 gives exactly one 𝑇 with 𝑇(𝑥𝑗)=𝐰𝑗. (b) 𝐷: 𝑎𝑗−1,𝑗=𝑗; 𝑀: 𝑎𝑗+1,𝑗=1; all else 0. (c) Expand 𝑇(𝑝)=∑𝑗𝑐𝑗𝑇(𝑥𝑗) and collect the coefficient of each 𝑥𝑖. (d) 𝑝↦𝑝(1), regarded as a constant polynomial, has row 0 equal to 1,1,1,….

(a) Column 𝑗 consists of the coefficients of the polynomial 𝑇(𝑥𝑗), and only finitely many coefficients of a polynomial are nonzero (Definition 1.2.13). Conversely, let (𝑎𝑖𝑗) be an array whose columns have finitely many nonzero entries. Then 𝐰𝑗=∑𝑖𝑎𝑖𝑗𝑥𝑖 is a polynomial for each 𝑗, and by Proposition 2.2.20 there is exactly one 𝑇∈L(𝐹[𝑥]) with 𝑇(𝑥𝑗)=𝐰𝑗 for every 𝑗. Its matrix is the given array, and any operator with this matrix sends each 𝑥𝑗 to 𝐰𝑗, so it is this 𝑇.

(b) 𝐷(𝑥𝑗)=𝑗𝑥𝑗−1 for 𝑗≥1 and 𝐷(1)=𝟎, so the matrix of 𝐷 has the entries 𝑎𝑗−1,𝑗=𝑗 for 𝑗≥1, just above the diagonal, and zeros elsewhere. Multiplication by 𝑥 sends 𝑥𝑗 to 𝑥𝑗+1, so its matrix has 𝑎𝑗+1,𝑗=1 just below the diagonal, and zeros elsewhere.

(c) Let 𝑝=∑𝑗=0𝑑𝑐𝑗𝑥𝑗, with 𝑐𝑗=0 for 𝑗>𝑑. By linearity,

𝑇(𝑝)=∑𝑗=0𝑑𝑐𝑗𝑇(𝑥𝑗)=∑𝑗=0𝑑𝑐𝑗∑𝑖𝑎𝑖𝑗𝑥𝑖=∑𝑖(∑𝑗=0𝑑𝑎𝑖𝑗𝑐𝑗)𝑥𝑖.

So the 𝑖-th coefficient of 𝑇(𝑝) is ∑𝑗𝑎𝑖𝑗𝑐𝑗, in which the terms with 𝑗>𝑑 are 0. This is the row-times-column rule of Proposition 2.3.11 for infinite matrices whose columns are finite.

(d) Let 𝑇(𝑝)=𝑝(1), regarded as a constant polynomial. It is linear (Example 2.1.9), and 𝑇(𝑥𝑗)=1 for every 𝑗, so row 0 of its matrix is 1,1,1,…. Rows can be infinite; only the columns must be finite.

Exercise 2.3.45.routine Let 𝑇:ℂ2→ℂ2, 𝑇(𝑧,𝑤)=(𝑧+𝑖𝑤,𝑖𝑧−𝑤).

  1. (a)Find [𝑇]ℰ︀ℰ︀.
  2. (b)Show that ℬ︀=(1,𝑖),(1,−𝑖) is a basis of ℂ2, and find [𝑇]ℬ︀ℬ︀. What does it tell you about 𝑇∘𝑇?

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Definition 1.6.1 (Basis), Theorem 2.3.9 (The matrix of a map computes the map), Corollary 2.2.6 (Agreeing on a spanning list)

Hint 1. (a) The columns are 𝑇(1,0) and 𝑇(0,1).
Hint 2. (b) Compute 𝑇(1,𝑖) and 𝑇(1,−𝑖) and express them in terms of (1,𝑖) and (1,−𝑖).
Sketch. (a) (1𝑖𝑖−1). (b) (𝑧,𝑤)=𝑎(1,𝑖)+𝑏(1,−𝑖) has the unique solution 𝑎=(𝑧−𝑖𝑤)/2, 𝑏=(𝑧+𝑖𝑤)/2. 𝑇(1,𝑖)=𝟎 and 𝑇(1,−𝑖)=(2,2𝑖)=2(1,𝑖), so [𝑇]ℬ︀ℬ︀=(0200). So 𝑇 sends (1,−𝑖) to a multiple of (1,𝑖) and (1,𝑖) to 𝟎, hence 𝑇∘𝑇=0.

(a) 𝑇(1,0)=(1,𝑖) and 𝑇(0,1)=(𝑖,−1), so [𝑇]ℰ︀ℰ︀=(1𝑖𝑖−1).

(b) The equation (𝑧,𝑤)=𝑎(1,𝑖)+𝑏(1,−𝑖) means 𝑎+𝑏=𝑧 and 𝑖(𝑎−𝑏)=𝑤, that is, 𝑎−𝑏=−𝑖𝑤. Adding and subtracting, 𝑎=(𝑧−𝑖𝑤)/2 and 𝑏=(𝑧+𝑖𝑤)/2, and these values do satisfy both equations. So every vector has exactly one representation, and ℬ︀ is a basis. Now

𝑇(1,𝑖)=(1+𝑖2,𝑖−𝑖)=(0,0),𝑇(1,−𝑖)=(1−𝑖2,𝑖+𝑖)=(2,2𝑖)=2(1,𝑖),

so

[𝑇]ℬ︀ℬ︀=(0200).

So 𝑇 kills (1,𝑖) and sends (1,−𝑖) into span((1,𝑖)). Hence 𝑇(𝑇(𝐯𝑗))=𝟎 for both basis vectors, and 𝑇∘𝑇=0 by Corollary 2.2.6. Directly,

𝑇(𝑇(𝑧,𝑤))=(𝑧+𝑖𝑤+𝑖(𝑖𝑧−𝑤),𝑖(𝑧+𝑖𝑤)−(𝑖𝑧−𝑤))=(0,0).

The standard matrix hides this; the basis ℬ︀ shows it.

Exercise 2.3.46.standard For 𝜑∈ℝ, let 𝐮1=(cos𝜑,sin𝜑) and 𝐮2=(−sin𝜑,cos𝜑), and let 𝒰︀=𝐮1,𝐮2. Let 𝑅𝜃 be the rotation by 𝜃 and 𝑆𝛼 the reflection across the line through 𝟎 at angle 𝛼 (Example 2.1.11).

  1. (a)Show that 𝑎𝐮1+𝑏𝐮2=𝑅𝜑(𝑎,𝑏), that 𝒰︀ is a basis of ℝ2, and that the vector (𝑟cos𝛽,𝑟sin𝛽) has 𝒰︀-coordinates (𝑟cos(𝛽−𝜑),𝑟sin(𝛽−𝜑)).
  2. (b)Show that [𝑅𝜃]𝒰︀𝒰︀=[𝑅𝜃]ℰ︀ℰ︀.
  3. (c)Show that [𝑆𝛼]𝒰︀𝒰︀=[𝑆𝛼−𝜑]ℰ︀ℰ︀, and interpret this.

Solution.

Uses. Example 2.1.11 (Rotations, projections, and reflections), Exercise 2.1.43, Definition 2.3.1 (Matrix of a linear map), Example 2.3.3 (Matrices with respect to standard bases)

Hint 1. (a) Compare 𝑎𝐮1+𝑏𝐮2 with the formula for 𝑅𝜑(𝑎,𝑏). For the basis property, 𝑅𝜑 is undone by 𝑅−𝜑 (Exercise 2.1.43).
Hint 2. The formula for 𝑆𝛼 shows that 𝑆𝛼 sends the unit vector at angle 𝛽 to the unit vector at angle 2𝛼−𝛽, and 𝑅𝜃 adds 𝜃 to the angle. Write down the angles of the images of 𝐮1 (angle 𝜑) and 𝐮2 (angle 𝜑+𝜋/2), and use (a).
Sketch. (a) Expanding gives 𝑎𝐮1+𝑏𝐮2=𝑅𝜑(𝑎,𝑏), and since 𝑅−𝜑𝑅𝜑=id=𝑅𝜑𝑅−𝜑, (𝑎,𝑏)=𝑅−𝜑(𝐲) is the unique coefficient vector for 𝐲; 𝑅−𝜑 subtracts 𝜑 from the angle. (b) 𝑅𝜃(𝐮1) and 𝑅𝜃(𝐮2) have angles 𝜑+𝜃 and 𝜑+𝜋/2+𝜃, hence coordinates (cos𝜃,sin𝜃) and (−sin𝜃,cos𝜃). (c) 𝑆𝛼(𝐮1) and 𝑆𝛼(𝐮2) have angles 2𝛼−𝜑 and 2𝛼−𝜑−𝜋/2, hence coordinates (cos2𝛾,sin2𝛾) and (sin2𝛾,−cos2𝛾) with 𝛾=𝛼−𝜑.

(a) By the formula for 𝑅𝜑 in Example 2.1.11,

𝑎𝐮1+𝑏𝐮2=(𝑎cos𝜑−𝑏sin𝜑,𝑎sin𝜑+𝑏cos𝜑)=𝑅𝜑(𝑎,𝑏).

By Exercise 2.1.43, 𝑅𝜑𝑅−𝜑=𝑅−𝜑𝑅𝜑=𝑅0=id. So for 𝐲∈ℝ2, the coefficients (𝑎,𝑏)=𝑅−𝜑(𝐲) work, since 𝑅𝜑 undoes 𝑅−𝜑. They are the only ones: if 𝑅𝜑(𝑎,𝑏)=𝐲, then applying 𝑅−𝜑 gives (𝑎,𝑏)=𝑅−𝜑(𝐲). Hence 𝒰︀ is a basis and [𝐲]𝒰︀=𝑅−𝜑(𝐲). Rotation by −𝜑 subtracts 𝜑 from the polar angle (Example 2.1.11), so

[(𝑟cos𝛽,𝑟sin𝛽)]𝒰︀=(𝑟cos(𝛽−𝜑),𝑟sin(𝛽−𝜑)).

(b) The vector 𝐮1 has angle 𝜑 and 𝐮2=(cos(𝜑+𝜋/2),sin(𝜑+𝜋/2)) has angle 𝜑+𝜋/2, both of length 1. Rotation adds 𝜃 to the angle, so by (a),

[𝑅𝜃(𝐮1)]𝒰︀=(cos𝜃,sin𝜃),[𝑅𝜃(𝐮2)]𝒰︀=(cos(𝜃+𝜋/2),sin(𝜃+𝜋/2))=(−sin𝜃,cos𝜃).

These are the columns of [𝑅𝜃]ℰ︀ℰ︀ (Example 2.3.3).

(c) From the formula in Example 2.1.11 and the angle subtraction formulas,

𝑆𝛼(cos𝛽,sin𝛽)=(cos𝛽cos2𝛼+sin𝛽sin2𝛼,cos𝛽sin2𝛼−sin𝛽cos2𝛼)=(cos(2𝛼−𝛽),sin(2𝛼−𝛽)).

So 𝑆𝛼(𝐮1) has angle 2𝛼−𝜑 and 𝑆𝛼(𝐮2) has angle 2𝛼−𝜑−𝜋/2. With 𝛾=𝛼−𝜑, part (a) gives the coordinates

[𝑆𝛼(𝐮1)]𝒰︀=(cos2𝛾,sin2𝛾),[𝑆𝛼(𝐮2)]𝒰︀=(cos(2𝛾−𝜋/2),sin(2𝛾−𝜋/2))=(sin2𝛾,−cos2𝛾).

By the formula for 𝑆𝛾, these are 𝑆𝛾(𝐞1) and 𝑆𝛾(𝐞2), the columns of [𝑆𝛾]ℰ︀ℰ︀.

In words: in coordinates rotated by 𝜑, a rotation looks the same, and the reflection across the line at angle 𝛼 looks like the reflection across the line at angle 𝛼−𝜑, the angle of the mirror measured from 𝐮1 instead of from 𝐞1. Taking 𝜑=𝛼 puts 𝐮1 on the mirror, and then [𝑆𝛼]𝒰︀𝒰︀=[𝑆0]ℰ︀ℰ︀=(100−1), as in Example 2.3.23.

Exercise 2.3.47.hard Let 𝐴∈ℂ𝑛×𝑛 satisfy

|𝑎𝑖𝑖|>∑𝑗≠𝑖|𝑎𝑖𝑗|for every𝑖=1,…,𝑛.

Show that if 𝐴𝐱=𝟎, then 𝐱=𝟎.

Solution.

Uses. Proposition 2.3.11 (Entries of 𝐴𝐱), the triangle inequality |𝑧+𝑤|≤|𝑧|+|𝑤| in ℂ, Section B.1

Hint 1. Suppose 𝐴𝐱=𝟎 with 𝐱≠𝟎. Look at the equation coming from a cleverly chosen row.
Hint 2. Choose 𝑖 with |𝑥𝑖| as large as possible. The 𝑖-th entry of 𝐴𝐱 gives 𝑎𝑖𝑖𝑥𝑖=−∑𝑗≠𝑖𝑎𝑖𝑗𝑥𝑗. Estimate both sides.
Sketch. If 𝐱≠𝟎, pick 𝑖 with |𝑥𝑖| maximal, so |𝑥𝑖|>0. Row 𝑖 of 𝐴𝐱=𝟎 and the triangle inequality give |𝑎𝑖𝑖||𝑥𝑖|≤∑𝑗≠𝑖|𝑎𝑖𝑗||𝑥𝑗|. Bounding each |𝑥𝑗| by |𝑥𝑖| makes the right side smaller than |𝑎𝑖𝑖||𝑥𝑖|, a contradiction.

Suppose 𝐴𝐱=𝟎 and 𝐱≠𝟎. Choose 𝑖 with |𝑥𝑖|≥|𝑥𝑗| for all 𝑗; then |𝑥𝑖|>0. By Proposition 2.3.11, the 𝑖-th entry of 𝐴𝐱 is ∑𝑗𝑎𝑖𝑗𝑥𝑗=0, so 𝑎𝑖𝑖𝑥𝑖=−∑𝑗≠𝑖𝑎𝑖𝑗𝑥𝑗. Taking absolute values and using the triangle inequality,

|𝑎𝑖𝑖||𝑥𝑖|=|∑𝑗≠𝑖𝑎𝑖𝑗𝑥𝑗|≤∑𝑗≠𝑖|𝑎𝑖𝑗||𝑥𝑗|≤(∑𝑗≠𝑖|𝑎𝑖𝑗|)|𝑥𝑖|<|𝑎𝑖𝑖||𝑥𝑖|,

where the last step uses the hypothesis and |𝑥𝑖|>0. This is a contradiction, so 𝐱=𝟎.

The proof chose an extremal coordinate, the largest one in absolute value, so that a single row of 𝐴 could be played against all the others. In the language of Section 2.6 the conclusion says that 𝑇𝐴 is injective, and since 𝐴 is square it is then invertible (Corollary 3.5.25).

Exercise 2.3.48.challenge Let 𝑛≥1 and let 𝑇:𝐹[𝑥]≤𝑛→𝐹[𝑥]≤𝑛, 𝑇(𝑓)=𝑓(𝑥+1). Let 𝐽∈𝐹(𝑛+1)×(𝑛+1) have 1 in each diagonal position (𝑘,𝑘) and in each position (𝑘,𝑘+1) just above the diagonal, and 0 elsewhere. (Use the usual algebra of polynomials freely, including that substituting 𝑥+1 respects products and that substituting twice in a row gives 𝑓(𝑥+2); these facts are proved in Section 7.1.)

  1. (a)Over ℚ, let 𝑏0=1 and 𝑏𝑘=𝑥(𝑥−1)⋯(𝑥−𝑘+1)/𝑘! for 𝑘≥1. Show that ℬ︀=𝑏0,𝑏1,…,𝑏𝑛 is a basis of ℚ[𝑥]≤𝑛 with [𝑇]ℬ︀ℬ︀=𝐽.
  2. (b)Let 𝑝 be a prime. Show that over 𝔽𝑝 there is a basis ℬ︀ of 𝔽𝑝[𝑥]≤𝑛 with [𝑇]ℬ︀ℬ︀=𝐽 if and only if 𝑛<𝑝.

Solution.

Uses. Definition 2.3.1 (Matrix of a linear map), Definition 1.6.1 (Basis), Definition 1.2.16 (Degree), Proposition 1.1.24 (ℤ/𝑛ℤ is a field if and only if 𝑛 is prime), Corollary 2.2.6 (Agreeing on a spanning list), binomial coefficients: (𝑝𝑘) is divisible by 𝑝 for 0<𝑘<𝑝

Hint 1. (a) deg𝑏𝑘=𝑘, which gives the basis property. For the matrix, prove the polynomial identity 𝑏𝑘(𝑥+1)=𝑏𝑘+𝑏𝑘−1 by pulling out the common factor 𝑥(𝑥−1)⋯(𝑥−𝑘+2).
Hint 2. (b), “if”: for 𝑘≤𝑛<𝑝, the integer 𝑘! is not divisible by 𝑝, so it is invertible in 𝔽𝑝 and (a) goes through. “Only if”: what does [𝑇]ℬ︀ℬ︀=𝐽 say about 𝑇(𝐯𝑘)? Compute 𝑇𝑟(𝐯𝑠) by induction on 𝑟.
Hint 3. You should find 𝑇𝑟(𝐯𝑠)=∑𝑘(𝑟𝑘)𝐯𝑠−𝑘. Take 𝑟=𝑠=𝑝, and compare with 𝑇𝑝(𝑓)=𝑓(𝑥+𝑝).
Sketch. (a) The 𝑏𝑘 have degrees 0,1,…,𝑛, so they form a basis. Pulling out the common factor 𝑥(𝑥−1)⋯(𝑥−𝑘+2) shows 𝑏𝑘(𝑥+1)−𝑏𝑘=𝑏𝑘−1, so 𝑇(𝑏𝑘)=𝑏𝑘+𝑏𝑘−1 and 𝑇(𝑏0)=𝑏0: the matrix is 𝐽. (b) If 𝑛<𝑝, the same construction works in 𝔽𝑝. If 𝑛≥𝑝 and [𝑇]ℬ︀ℬ︀=𝐽 with ℬ︀=𝐯0,…,𝐯𝑛, then 𝑇(𝐯𝑘)=𝐯𝑘+𝐯𝑘−1, and by induction 𝑇𝑝(𝐯𝑝)=∑𝑘(𝑝𝑘)𝐯𝑝−𝑘=𝐯𝑝+𝐯0 in characteristic 𝑝. But 𝑇𝑝(𝑓)=𝑓(𝑥+𝑝)=𝑓, so 𝐯0=𝟎, a contradiction.

Throughout, index the basis vectors from 0, so that column 𝑘 of 𝐽 (for 𝑘=0,…,𝑛) is 𝐞𝑘 for 𝑘=0 and 𝐞𝑘−1+𝐞𝑘 for 𝑘≥1, where 𝐞0,…,𝐞𝑛 is the standard basis of 𝐹𝑛+1. So [𝑇]ℬ︀ℬ︀=𝐽 for ℬ︀=𝐯0,…,𝐯𝑛 means

𝑇(𝐯0)=𝐯0,𝑇(𝐯𝑘)=𝐯𝑘+𝐯𝑘−1(1≤𝑘≤𝑛).
(2.3.1)

Polynomials of degrees 0,1,…,𝑛. Let 𝑞0,…,𝑞𝑛∈𝐹[𝑥]≤𝑛 with deg𝑞𝑘=𝑘. They span 𝐹[𝑥]≤𝑛: by induction on 𝑘, every 𝑥𝑘 is in their span, since 𝑥𝑘 minus a suitable multiple of 𝑞𝑘 has degree less than 𝑘. They are linearly independent: in a relation ∑𝑘𝑐𝑘𝑞𝑘=𝟎 with some 𝑐𝑘≠0, let 𝑘 be the largest index with 𝑐𝑘≠0; then the coefficient of 𝑥𝑘 on the left is 𝑐𝑘 times the leading coefficient of 𝑞𝑘, which is nonzero. So 𝑞0,…,𝑞𝑛 is a basis (Definition 1.6.1).

(a) Over ℚ, 𝑏𝑘 is a product of 𝑘 factors of degree 1 divided by 𝑘!, so deg𝑏𝑘=𝑘, and ℬ︀ is a basis by the paragraph above. For 𝑘≥1, write 𝑃=𝑥(𝑥−1)⋯(𝑥−𝑘+2) (with 𝑃=1 when 𝑘=1), so that 𝑏𝑘=𝑃(𝑥−𝑘+1)/𝑘! and 𝑏𝑘−1=𝑃/(𝑘−1)!. Substituting 𝑥+1 for 𝑥 in 𝑏𝑘 gives (𝑥+1)𝑃/𝑘!. Hence

𝑏𝑘(𝑥+1)−𝑏𝑘=𝑃((𝑥+1)−(𝑥−𝑘+1))𝑘!=𝑘𝑃𝑘!=𝑃(𝑘−1)!=𝑏𝑘−1.

So 𝑇(𝑏𝑘)=𝑏𝑘+𝑏𝑘−1 for 𝑘≥1, and 𝑇(𝑏0)=𝑏0. This is (2.3.1), so [𝑇]ℬ︀ℬ︀=𝐽.

(b) If 𝑛<𝑝. For 𝑘≤𝑛<𝑝, the integer 𝑘! is a product of integers between 1 and 𝑝−1, none divisible by the prime 𝑝, so 𝑘!≠0 in 𝔽𝑝 and it is invertible (Proposition 1.1.24). So 𝑏0,…,𝑏𝑛 are defined in 𝔽𝑝[𝑥], and the computation in (a) uses only the field operations and division by 𝑘!. It goes through unchanged, and gives a basis with [𝑇]ℬ︀ℬ︀=𝐽.

If 𝑛≥𝑝. Suppose ℬ︀=𝐯0,…,𝐯𝑛 is a basis satisfying (2.3.1). Set 𝐯𝑘=𝟎 for 𝑘<0, so that 𝑇(𝐯𝑘)=𝐯𝑘+𝐯𝑘−1 for all 𝑘≤𝑛 (for 𝑘<0 both sides are 𝟎). We claim that for all 𝑟≥0 and 0≤𝑠≤𝑛,

𝑇𝑟(𝐯𝑠)=∑𝑘=0𝑟(𝑟𝑘)𝐯𝑠−𝑘.

For 𝑟=0 both sides are 𝐯𝑠. If it holds for 𝑟, then by linearity

𝑇𝑟+1(𝐯𝑠)=∑𝑘=0𝑟(𝑟𝑘)(𝐯𝑠−𝑘+𝐯𝑠−𝑘−1)=∑𝑘=0𝑟+1((𝑟𝑘)+(𝑟𝑘−1))𝐯𝑠−𝑘=∑𝑘=0𝑟+1(𝑟+1𝑘)𝐯𝑠−𝑘,

with the conventions (𝑟−1)=(𝑟𝑟+1)=0 and Pascal’s rule. Now take 𝑟=𝑠=𝑝, which is allowed since 𝑝≤𝑛. For 0<𝑘<𝑝, (𝑝𝑘) is divisible by 𝑝, so it is 0 in 𝔽𝑝, and

𝑇𝑝(𝐯𝑝)=𝐯𝑝+𝐯0.

On the other hand, substituting 𝑥+1 a total of 𝑝 times gives 𝑇𝑝(𝑓)=𝑓(𝑥+𝑝⋅1)=𝑓(𝑥), since 𝑝⋅1=0 in 𝔽𝑝. So 𝑇𝑝(𝐯𝑝)=𝐯𝑝, and 𝐯0=𝟎, which is impossible for a vector of a basis. Hence no such basis exists.

For example, over 𝔽2 with 𝑛=2: 𝑇2=id, while a basis as above would give 𝑇2(𝐯2)=𝐯2+2𝐯1+𝐯0=𝐯2+𝐯0.

More practice

The practice bank has 33 exercises on this section’s topics.