4.4Sums and direct sums
In Section 1.4.5 we met the sum of two subspaces, the smallest subspace that contains both. This section answers two questions about it: how large it is, and when a vector of can be written as in only one way. Two pictures in already suggest the answers. Every vector of is, in exactly one way, a vector of the -plane plus a vector of the -axis, and . The -plane and the -plane also add up to , but now
Sums in which decompositions are unique, the direct sums, are to subspaces what bases are to vectors. A basis cuts into lines, and the coordinates of a vector name its pieces; a direct sum cuts into subspaces of any dimension. Later chapters understand an operator by cutting into pieces that it maps into themselves. A diagonalizable operator is one for which is the direct sum of its eigenspaces (Section 7.4), and the Jordan form starts from a direct sum of generalized eigenspaces (Section 10.2). Both need direct sums of more than two subspaces, and that is where the subtleties are.
Throughout, is a vector space over a field , and , , , , , denote subspaces of .
4.4.1Sums of several subspaces
The sum of two subspaces extends to any finite number of them.
Definition 4.4.1 (Sum of subspaces). Let be subspaces of , where . Their sum is
also written . An expression with for each is a decomposition of along , with components .
For this is the sum of Proposition 1.4.24, and for it is . By convention, a sum of no subspaces is , just as an empty sum of vectors is . The sum of subspaces is the sum of two, applied repeatedly, so the two-subspace facts carry over.
Proposition 4.4.2 (Sums are the smallest containing subspaces). Let be subspaces of .
- (a)If , then
. - (b) is a subspace of that contains every , and it is contained in every subspace of that contains every .
- (c)If for lists , then
.
Uses. Definition 4.4.1 (Sum of subspaces), Proposition 1.4.24 (The sum of two subspaces), Exercise 1.3.36
Techniques. Double containment (Technique 1.3.14), Induction on the number of summands (Technique 4.4.10)
(a) Let . An element of has the form
(b) We induct on . For the sum is , and there is nothing to prove. Let , and assume that is a subspace containing and contained in every subspace that contains them. By (a) and Proposition 1.4.24(a),
(c) Again we induct on , and is trivial. For , the inductive hypothesis gives
□
By (b), the sum depends only on the subspaces involved, not on their order or grouping. For instance and
- (a)In ,
by Proposition 4.4.2(c). In , the three lines , , and also add up to , although the third is not needed. - (b)In , let be the subspace of upper triangular matrices and the subspace of lower triangular matrices. Every matrix is the sum of its part on and above the diagonal, which lies in , and its part below the diagonal, which lies in . So . The two subspaces overlap in the diagonal matrices, so many matrices have more than one decomposition:
. - (c)For we have
, so . Together with the bound of Theorem 4.4.13 below, this is the reason that rank is subadditive (Proposition 4.3.20). The containment can be strict: for , is smaller than .
4.4.2Direct sums
A basis of writes every vector in exactly one way as . Each term lies in the line , so the basis exhibits as a sum of lines in which every vector has exactly one decomposition. Direct sums keep the uniqueness and allow pieces of any dimension.
Definition 4.4.4 (Direct sum). Let be subspaces of . The sum is direct if every vector of has exactly one decomposition along . In that case we also say that are independent, and we write the sum as
If moreover , we write and say that is the direct sum of .
So writing is an assertion, not a new operation: it denotes the subspace , together with the claim that the sum is direct. (The external direct sum, which builds a new space out of two unrelated ones, is the product of Section 4.6.) Some texts define independent subspaces by condition (II) of Theorem 4.4.7 below instead; the theorem shows that the two definitions agree.
- (a)Bases. If is a basis of , then
. A decomposition of has components with , and the component determines the scalar: if , then , so by Proposition 1.2.35, since . So decompositions of correspond to representations , and there is exactly one. The components of are its coordinates times the basis vectors. - (b)Triangular parts. Let be the upper triangular matrices in and the strictly lower triangular ones, whose diagonal entries are . Then : in a decomposition with and , the entries of on and above the diagonal must be those of and the entries below must be those of .
- (c)Even and odd functions. In , the even functions and the odd functions satisfy and (Exercise 1.4.35). By Theorem 4.4.7 below, this says .
- (d)Even and odd polynomials. In , let be the polynomials whose coefficients of vanish and those whose coefficients of vanish. Every polynomial is the sum of its even-degree terms and its odd-degree terms, and in a decomposition with and , each coefficient of belongs to exactly one of and . So over every field, including . Compare Exercise 1.4.35(b), where even and odd functions on coincide.
- (a)The -plane and the -plane add up to , but
is a second decomposition of , besides . (b)In , the three lines , , meet pairwise only in . Their sum is still not direct:
is a decomposition of with nonzero components.
Part (b) is the trap of this section. For three or more subspaces, “no two of them overlap” is not the right notion of independence. The analogy with lists explains why: three vectors of , no two of them parallel, are still dependent. Independence of a list compares each vector with the span of the others (Corollary 1.5.13), and the right condition for subspaces compares each subspace with the sum of the others.
Theorem 4.4.7 (Criteria for direct sums). Let be subspaces of . The following are equivalent.
- (I)The sum is direct.
- (II) has only the trivial decomposition: if with for each , then .
- (III)Each meets the sum of the others only in :
for . - (IV)Each meets the sum of the earlier ones only in :
for .
In particular, for two subspaces, is direct if and only if .
Here is the sum of all except . (For it is the empty sum , and all four conditions hold.) The first proof is a cycle of implications.
Technique 4.4.8 (Compare components). In a direct sum, an equation between decompositions splits into one equation per summand. If
Proving that a sum is direct runs the same move backwards. Take two decompositions of one vector, subtract them, and move terms across so that the two sides of the resulting equation lie in different subspaces. Then both sides lie in the intersection, and if the intersection is , both sides vanish. For two subspaces this is the whole argument: gives
Reach for it whenever a vector is given as a sum of pieces from known subspaces. The canonical example is Theorem 4.4.7. Later uses include orthogonal decompositions (Section 6.4), the independence of eigenvectors with distinct eigenvalues (Section 7.2), and the generalized eigenspace decomposition (Section 10.2).
Used in 12 places and 1 practice exercise
Theorem 4.4.7, Proposition 4.4.9, Exercise 4.4.11, Proposition 4.4.12, Proposition 4.4.26, Theorem 4.4.27, Proposition 4.4.29, Proposition 4.4.31, Exercise 4.4.36, Exercise 4.4.44, Exercise 4.4.51, Problem 4.7; 1 practice exercise.
Proof (by a cycle of implications).
Uses. Definition 4.4.4 (Direct sum), Definition 4.4.1 (Sum of subspaces)
Techniques. Proving TFAE (Technique 2.7.1), Compare components (Technique 4.4.8), Extremal choice and minimal counterexamples (Technique 1.5.9)
We prove (I) (II), and then (II) (III) (IV) (II).
(I) (II). Since for each , is a decomposition of . By (I) it is the only one.
(II) (I). Suppose
and , since is a subspace. By (II), for each , so the two decompositions agree.
(II) (III). Fix , and let
is a decomposition of , as . By (II) all its components vanish. In particular , so .
(III) (IV). Let . Every element of is also an element of : take the components in for . So
(IV) (II). Let with . Suppose, for a contradiction, that some , and let be the largest index with . Then for , so
If , the right side is the empty sum , which contradicts . If , the left side lies in and the right side in , so
For , condition (III) says , which proves the last sentence. □
The step (IV) (II) chose an extremal index, the largest with , exactly as the linear dependence lemma does for lists. The other natural route is induction on the number of summands. It rests on a fact that is useful in its own right: independent subspaces can be grouped.
Proposition 4.4.9 (Grouping summands). Let be subspaces of , let , and write and . Then is direct if and only if both of the following hold.
- (i)The sums and are direct.
- (ii).
Moreover, independence of subspaces does not depend on their order, and if are independent, then so is any selection of them.
Uses. Theorem 4.4.7 (Criteria for direct sums), Definition 4.4.1 (Sum of subspaces)
Techniques. Compare components (Technique 4.4.8)
We use the equivalence of (I) and (II) in Theorem 4.4.7.
() Suppose the sum of all subspaces is direct. If with , then
is a decomposition of , so all components vanish and .
() Suppose (i) and (ii), and let with . Put and
Finally, condition (II) does not refer to the order of , since a sum of vectors does not depend on the order of its terms. If are some of the (with distinct indices), a decomposition of along them becomes a decomposition of along once we insert the component for every other . If are independent, all its components vanish. □
With , the proposition says: is direct exactly when is direct and
Technique 4.4.10 (Induction on the number of summands). To prove a statement about subspaces , group the first of them into and treat as a sum of two subspaces. Proposition 4.4.2(a) says that is the whole sum, and Proposition 4.4.9 says that it is direct exactly when is direct and . So the two-subspace case and the inductive hypothesis for combine into the case of subspaces.
Reach for it when the statement for two subspaces is easy, typically because it reduces to , and the general case looks messy. Watch the hypothesis in the inductive step: it needs , an intersection with a sum, and not just for each (Non-example 4.4.6(b)). The canonical example is the second proof of Theorem 4.4.7. The same induction shows that eigenspaces for distinct eigenvalues are independent (Section 7.2).
Used in 4 places
Proposition 4.4.2, Theorem 4.4.7, Exercise 4.4.37, Exercise 4.4.40.
Proof of Theorem 4.4.7 (of (IV) (II), by induction on ).
Uses. Proposition 4.4.9 (Grouping summands)
Techniques. Induction on the number of summands (Technique 4.4.10)
This proof uses only (I) (II), which was proved directly above, through Proposition 4.4.9, whose proof uses nothing else. We induct on . For , condition (II) says that implies .
Let , assume the implication for subspaces, and suppose satisfy (IV). The conditions of (IV) for are condition (IV) for , so by the inductive hypothesis these subspaces satisfy (II), and their sum is direct. The sum of one subspace is trivially direct. Condition (IV) for says . By Proposition 4.4.9 with , the sum is direct, which is (II). □
The second proof explains where (IV) comes from: it is exactly what the induction consumes, and each step asks only that the new subspace avoid everything built so far.
Exercise 4.4.11. Let , , and in .
- (a)Show that whenever , over every field .
- (b)Show that is direct if in , and not direct if .
Uses. Theorem 4.4.7 (Criteria for direct sums), Proposition 1.1.17 (No zero divisors)
Techniques. Compare components (Technique 4.4.8)
(a) If
(b) We check (IV) of Theorem 4.4.7. By (a), . Suppose , say
Then , , and , so . If , then (Proposition 1.1.17), so
a decomposition of with nonzero components, so (II) fails and the sum is not direct.
So the pairwise intersections are trivial over every field, but directness depends on the field. Over , the three lines lie in the plane , like the three lines of Non-example 4.4.6(b).
4.4.3Bases and dimension
For lists, independence is what makes a spanning list a basis. For subspaces it plays the same role one level up: bases of the summands concatenate to a basis of the sum exactly when the summands are independent. The lists version is a recitation exercise.
Uses. Theorem 4.4.7 (Criteria for direct sums), Theorem 1.5.5 (Independence is decided at zero), Definition 1.3.10 (Span)
Techniques. Compare components (Technique 4.4.8)
Write
() Suppose are independent, and let
() Suppose the concatenation is independent, and let with , say
The case follows from the last sentence of Theorem 4.4.7. □
Theorem 4.4.13 (Bases and dimension of a sum). Let be finite-dimensional subspaces of , and for each let be a basis of .
(a)The concatenation spans . Hence is finite-dimensional, and
- (b)The sum is direct if and only if is a basis of .
- (c)The sum is direct if and only if
.
Uses. Proposition 4.4.2 (Sums are the smallest containing subspaces), Proposition 4.4.12 (Concatenating independent lists), Definition 1.6.23 (Finite-dimensional), Corollary 4.1.11 (Spanning lists are long), Theorem 4.1.4 (All bases have the same length)
Techniques. Glue bases of the summands (Technique 4.4.14), Dimension counting (Technique 4.2.24)
Let , so that has length , and let be the length of the concatenation .
(a) By Proposition 4.4.2(c),
(b) By (a), spans the sum, so is a basis of the sum if and only if it is linearly independent. Each is independent with span , so by Proposition 4.4.12, is independent if and only if are independent.
(c) Let
In particular, if is finite-dimensional, then
Technique 4.4.14 (Glue bases of the summands). When , choose a basis of each and concatenate. The result is a basis of (Theorem 4.4.13) adapted to the decomposition: each basis vector lies in one summand, so the coordinates of a vector split into blocks, one block for each component. In the other direction, to show that subspaces are independent, it suffices to check that bases of them concatenate to an independent list, or just to compare dimensions.
Reach for it to compute the dimension of a direct sum, or to turn a statement about subspaces into one about lists. The canonical example is Theorem 4.4.13. Later, a basis glued from bases of eigenspaces is an eigenbasis (Section 7.4), and Jordan bases are glued from chains (Section 10.3).
Used in 7 places
Theorem 4.4.13, Proposition 4.4.16, Theorem 7.4.16, Theorem 7.6.34, Exercise 7.6.49, Exercise 8.1.36, Exercise 8.2.36.
The span explorer shows the case of a plane and a line in .
With and :
4.4.4Complements
Given a subspace of , can be split as ? In finite dimensions it always can, by extending a basis.
By Theorem 4.4.7, is a complement of if and only if and . The relation is symmetric: is a complement of if and only if is a complement of .
Proposition 4.4.16 (Complements exist). Let be finite-dimensional, and let be a subspace of .
- (a)If is a basis of and
is a basis of , then is a complement of . In particular, has a complement. - (b)Every complement of arises as in (a), and every complement of has .
Uses. Proposition 4.1.21 (Dimensions of subspaces), Theorem 4.1.16 (Extending to a basis), Proposition 4.4.2 (Sums are the smallest containing subspaces), Proposition 4.4.12 (Concatenating independent lists), Theorem 4.4.13 (Bases and dimension of a sum)
Techniques. Extend a basis of a subspace (Technique 4.1.18), Glue bases of the summands (Technique 4.4.14)
(a) Let
For the existence of a complement: is finite-dimensional (Proposition 4.1.21(a)), so it has a basis , which is independent in and extends to a basis of (Theorem 4.1.16). Apply the first part.
(b) Let be a complement of . It is finite-dimensional (Proposition 4.1.21(a)); let be a basis of , and a basis of . Since , Theorem 4.4.13(b) says that
Example 4.4.17 (Complements are not unique). In , every line through other than the -axis is a complement of the -axis: two distinct lines meet only in , and their sum has dimension by Theorem 4.4.13(c), so it is .
In , Example 4.1.17 extended , by to a basis of . So is a complement of . So is . A vector
What a subspace does determine is the dimension of its complements, by (b). Exercise 4.4.46 shows that a subspace has only one complement exactly when it is or , and Exercise 4.4.49 counts the complements over a finite field.
Complements also show that nothing distinguishes kernels or images among subspaces.
Proposition 4.4.18 (Every subspace is a kernel and an image). Let be finite-dimensional, and let be a subspace of with a complement . There are with
In particular, every subspace of is the image of some operator on and the kernel of another.
Uses. Proposition 4.4.16 (Complements exist), Theorem 4.4.13 (Bases and dimension of a sum), Theorem 2.2.1 (Linear maps are determined by a basis), Proposition 2.1.16 (Linear maps preserve spans and linear relations), Theorem 1.5.5 (Independence is decided at zero)
Techniques. Extend a basis of a subspace (Technique 4.1.18), Construct a map by choosing it on a basis (Technique 2.2.4)
Let and be bases of and . Since , their concatenation is a basis of (Theorem 4.4.13(b)). By Theorem 2.2.1 there are with
for all and . For
The image of is the span of
For this says that every subspace of is a column space (which is clear: put a spanning list in the columns) and a null space. The second statement is the useful one: every subspace of is the solution set of a homogeneous linear system. The operators and will reappear in Section 4.4.6 as the projections attached to .
4.4.5The dimension formula
Theorem 4.4.19 (Dimension of a sum). Let and be finite-dimensional subspaces of . Then and are finite-dimensional, and
Proof (by extending a basis of ).
Uses. Proposition 4.1.21 (Dimensions of subspaces), Theorem 4.1.16 (Extending to a basis), Proposition 1.4.14 (The span is the smallest subspace containing a list), Theorem 1.5.5 (Independence is decided at zero), Theorem 4.1.4 (All bases have the same length)
Techniques. Extend a basis of a subspace (Technique 4.1.18)
Since is a subspace of the finite-dimensional space , it is finite-dimensional (Proposition 4.1.21(a)). Let be a basis of . It is an independent list in , so it extends to a basis
is a basis of . Then is finite-dimensional, and
spans . Every entry of lies in or in , hence in the subspace , so (Proposition 1.4.14(b)). Conversely, let with and . Then is a combination of the ’s and ’s, and is a combination of the ’s and ’s, so .
is independent. Suppose
Then
and since
The second proof reduces the formula to the direct case. Inside , split off the part of that overlaps ; what remains of meets trivially.
Proof (via a complement inside ).
Uses. Proposition 4.4.16 (Complements exist), Proposition 4.1.21 (Dimensions of subspaces), Theorem 4.4.7 (Criteria for direct sums), Theorem 4.4.13 (Bases and dimension of a sum), Proposition 4.4.2 (Sums are the smallest containing subspaces)
Techniques. Dimension counting (Technique 4.2.24)
As in the first proof, is finite-dimensional. Apply Proposition 4.4.16 in the finite-dimensional space to its subspace : there is a subspace with , and
First, : a vector of lies in (as ) and in , so it lies in . Second, : since , we have ; and since , we have
□
The third proof counts a kernel and an image. It completes the remark after Proposition 4.2.26, whose first proof used the same map to bound .
Proof (by rank–nullity).
Uses. Theorem 4.2.11 (Rank–nullity), Proposition 4.2.6 (Injective maps preserve dimension), Theorem 1.5.5 (Independence is decided at zero), Proposition 4.2.26 (Subspaces that must meet), Proposition 4.1.21 (Dimensions of subspaces)
Techniques. Dimension counting (Technique 4.2.24)
Let and be bases of and . Write elements of as with and , and define the linear map
Every value of is a vector of plus a vector of , and every with and equals . So . By rank–nullity (Theorem 4.2.11(b)), is finite-dimensional and
Define by
The three proofs teach different things. The first builds an explicit basis of and is the one to adapt when a basis is wanted. The second shows that the formula is the direct case,
Example 4.4.20 (Computing a sum and an intersection). In , let and , where
Row reduce the matrix whose columns are :
The first two columns are pivot columns, so is independent and . The vectors are not parallel (look at the second coordinates), so . By Proposition 4.4.2(c), is the column space, so , the number of pivots (Theorem 4.2.7). The formula gives
To find the line , read the free column: it says (Corollary 3.3.19(b)). Sorting the terms by subspace,
The left side lies in and the right side in , so this nonzero vector spans . In the language of the third proof,
Since , the formula recovers Proposition 4.2.26:
Proposition 4.4.21 (Two out of three). Let be finite-dimensional, and let and be subspaces of . Consider the conditions
- (i);
- (ii);
- (iii).
Any two of them imply the third, and then .
Uses. Theorem 4.4.19 (Dimension of a sum), Proposition 4.1.21 (Dimensions of subspaces), Theorem 4.4.7 (Criteria for direct sums)
Techniques. Dimension counting (Technique 4.2.24)
By Theorem 4.4.19,
If (i) and (ii) hold, the left side is , which gives (iii). If (i) and (iii) hold, then , so by Proposition 4.1.21(b), which is (ii). If (ii) and (iii) hold, then
This is the subspace version of the fact that a list of length is a basis as soon as it is independent or spanning (Theorem 4.1.10, Corollary 4.1.11): with the right dimensions, checking one of “meet trivially” and “add up to ” gives the other for free.
Exercise 4.4.23. Let
- (a)Show that the complements of in are exactly the lines with .
- (b)Is a complement of when ? When ? When ?
Uses. Example 4.2.25 (Kernels of linear functionals), Proposition 4.4.16 (Complements exist), Proposition 4.4.21 (Two out of three), Proposition 1.2.35 (Zero products)
Techniques. Dimension counting (Technique 4.2.24)
(a) is the kernel of the nonzero linear functional
(b) By (a), is a complement exactly when , that is, when in . In , , so yes. In , , so no: there . In , , so yes.
4.4.6Projections
A decomposition gives every vector a well-defined -component. Taking that component is a linear map, and the maps that arise in this way are exactly the operators with .
Definition 4.4.24 (Projection along a complement). Suppose . The projection onto along is the map
It is well defined because every vector of has exactly one decomposition . The order of the subscripts matters: keeps the -component and keeps the -component. Changing changes the map, even though its image is still . The orthogonal projection of Section 6.4 is the special case .
Example 4.4.25 (Projecting along a slanted line). In , let and . Every vector decomposes as
with and . So
Each matrix squares to itself, the two add up to , and their products in either order are . Over , slides every point parallel to until it reaches the -axis. It is not the perpendicular projection onto the -axis, which is , the projection onto along the -axis.
Proposition 4.4.26 (Properties of projections). Suppose , and let and .
- (a) is linear.
- (b) and , and for every .
- (c).
- (d) and .
Uses. Definition 4.4.24 (Projection along a complement), Definition 4.4.4 (Direct sum), Definition 2.1.1 (Linear map)
Techniques. Compare components (Technique 4.4.8)
Throughout, and with and .
(a) Since and are subspaces,
(b) Every value of lies in . For , the decomposition of is , so ; hence , and . Next, is if and only if , so .
(c) For every , , so by (b).
(d) By definition
An operator with is called idempotent. The converse of (c) is the main result of this subsection: every idempotent operator is a projection.
Theorem 4.4.27 (Idempotents are projections). Let satisfy . Then
and . Moreover,
Together with Proposition 4.4.26, the theorem gives a bijection between the ways of writing (with and in this order) and the idempotent operators on : a decomposition gives , and an idempotent gives the decomposition .
Proof (by writing down the decomposition).
Uses. Theorem 4.4.7 (Criteria for direct sums), Definition 4.4.24 (Projection along a complement), Proposition 2.6.8 (Kernels and images are subspaces)
Techniques. Compare components (Technique 4.4.8)
Let . Then , and
so . Hence
is a decomposition of along and , and . Next, let , say . Then
Finally, if , then ; conversely, if , then
In finite dimensions there is a second proof, which never writes down the decomposition
Proof (in finite dimensions, by counting).
Uses. Theorem 4.2.11 (Rank–nullity), Proposition 4.4.21 (Two out of three), Definition 4.4.24 (Projection along a complement)
Techniques. Dimension counting (Technique 4.2.24)
The counting proof does not reach infinite-dimensional spaces, and even in finite dimensions the first proof is more informative: it says what the components of are.
Technique 4.4.28 (Split the space with an idempotent). To decompose as a direct sum, look for an operator with . Then , every vector splits as
Reach for it when a formula suggests “the part of that …”, such as the symmetric part of a matrix, or more generally the average of and for an operator with (Exercise 4.4.43). Each is for an idempotent . The canonical example is Theorem 4.4.27. Later, idempotent matrices over , , have trace equal to rank (Exercise 4.3.43), and orthogonal projections are the idempotents that are self-adjoint (Section 6.6).
Used in 4 places and 1 practice exercise
Exercise 4.4.30, Exercise 4.4.43, Exercise 4.4.51, Problem 4.4; 1 practice exercise.
A direct sum of subspaces comes with projections, one for each summand. They are the algebraic form of the decomposition, and they are how Chapters 7 and 8 talk about splitting into eigenspaces.
(a)Suppose , and let send each vector to its component in . Then each is linear with , and
- (b)Conversely, let satisfy and for . Then each is idempotent, , and sends each vector to its component in .
Uses. Theorem 4.4.7 (Criteria for direct sums), Proposition 4.4.26 (Properties of projections), Definition 4.4.24 (Projection along a complement), Proposition 4.4.2 (Sums are the smallest containing subspaces)
Techniques. Apply an operator to a relation to kill terms (Technique 4.1.25), Compare components (Technique 4.4.8)
(a) Fix and let . Every (with ) is
(b) For each ,
since every term with is . For ,
Exercise 4.4.30. In , let
- (a)Show that , and find the matrices of and with respect to the standard basis.
- (b)Show that over , . Which step of (a) fails?
Uses. Definition 4.4.24 (Projection along a complement), Theorem 4.4.7 (Criteria for direct sums), Example 4.2.25 (Kernels of linear functionals)
Techniques. Split the space with an idempotent (Technique 4.4.28)
(a) For , let
is a decomposition of along and . If , then and , so . By Theorem 4.4.7, , with
(b) In , , so and . Then , which has dimension (Example 4.2.25), so . The step that fails is the division by in the definition of , since in . Correspondingly, the uniqueness argument fails too: holds for every .
4.4.7Linear maps on direct sums
A linear map is determined by its values on a basis, and those values can be prescribed freely (Theorem 2.2.1). A direct sum decomposition gives the same freedom, one summand at a time.
Proposition 4.4.31 (Defining maps summand by summand). Suppose , and let for each . There is exactly one with for every and every , namely
Uses. Definition 4.4.4 (Direct sum), Proposition 4.4.29 (Projections of a direct sum), Proposition 2.1.17 (Compositions of linear maps are linear), Proposition 2.1.23 ( is a vector space)
Techniques. Uniqueness via two candidates (Technique 1.1.8), Compare components (Technique 4.4.8)
Uniqueness. If agrees with on for each , then for ,
Every vector of is of this form, so is determined.
Existence. Since every has exactly one decomposition, the displayed formula defines a function . Let send to its component in ; it is the projection of Proposition 4.4.29(a) with its target shrunk to , so it is linear. Then
When is a basis and , a linear map is determined by , which can be any vector of , and the proposition becomes Theorem 2.2.1.
Remark 4.4.32 (Block diagonal matrices). Suppose is finite-dimensional, and maps into and into . Let and be the operators and . Glue a basis of and a basis of into a basis of (Technique 4.4.14). The image of a vector of is a combination of alone, and similarly for , so the matrix of is block diagonal (Definition 2.4.33):
By Proposition 4.4.31, is determined by and , so can be studied through the two smaller operators. This is the strategy of the eigenvalue chapters. An operator is diagonalizable when is a direct sum of subspaces on each of which acts as multiplication by a scalar (Section 7.4), and the Jordan form refines such a splitting (Section 10.3). Exercise 4.4.44 computes the kernel and image of such a .
Exercises
Exercise 4.4.33. In , let
- (a)For , find , , a basis of , and .
- (b)Repeat (a) for .
Uses. Theorem 4.4.19 (Dimension of a sum), Theorem 4.2.11 (Rank–nullity), Theorem 4.2.7 (The image of ), Theorem 1.5.5 (Independence is decided at zero)
(a) If
Its first two columns and are independent, so it has rank (Theorem 4.2.7), and by Theorem 4.2.11.
A general vector of is . It lies in if and only if
Over , the first condition says , and together with it gives , so and . Hence
(b) Over the same arguments give and (the matrix is now , with the same first two columns). But in , so the first condition holds for every vector of , and consists of the vectors with :
So
Exercise 4.4.34. Let , , be subspaces of a finite-dimensional space . Prove or disprove:
- (a)If
, then is direct. - (b)If is direct, then is direct.
- (c)If and , then .
- (d)If and , then .
- (e)If , then
. - (f)If and , then .
Uses. Non-example 4.4.6 (Sums that are not direct), Proposition 4.4.9 (Grouping summands), Example 4.4.17 (Complements are not unique), Proposition 4.4.16 (Complements exist), Proposition 4.4.21 (Two out of three)
Techniques. Finding counterexamples and minimal examples (Technique 1.4.18), Dimension counting (Technique 4.2.24)
(a) False. In , the lines , , meet pairwise in , but their sum is not direct (Non-example 4.4.6(b)).
(b) True, by the last part of Proposition 4.4.9: a selection of independent subspaces is independent.
(c) False. In , with , both and are complements of (Example 4.4.17), and .
(d) True. By Proposition 4.4.16(b),
(e) False. In , let , , and . Then , but , so
(f) True. Conditions (ii) and (iii) of Proposition 4.4.21 hold, so .
Exercise 4.4.35. Let , and let be subspaces of .
- (a)Show that
. - (b)Show that if is injective and are independent, then
are independent. - (c)Show by an example that (b) can fail if is not injective.
Uses. Definition 4.2.1 (Restriction), Theorem 4.4.7 (Criteria for direct sums), Theorem 2.6.11 (Injectivity is decided at )
Techniques. Test injectivity at (Technique 2.6.12)
(a) An element of the left side is with , and by linearity this equals
(b) We check (II) of Theorem 4.4.7. Let
(c) Let , , and , , which are independent. Both images are all of , and is not direct, since .
Exercise 4.4.36. In , let and .
- (a)Show that . Find the matrix of with respect to the standard basis, and check that .
- (b)Let
, the rotation by a quarter turn. Find scalars and with for all and for all .
Uses. Example 4.4.5 (Direct sums), Definition 4.4.24 (Projection along a complement), Theorem 4.1.10 (Independent lists are short)
Techniques. Compare components (Technique 4.4.8)
(a) If , then and , which is false; so is independent, hence a basis of (Theorem 4.1.10(b)), and by Example 4.4.5(a). To decompose , solve
Hence
(b)
Over , the quarter turn maps no line through into itself. Over , it splits into two lines on which it acts as multiplication by a scalar. This is diagonalization (Section 7.4) in its simplest form.
Exercise 4.4.37. Find the error in the following argument.
Claim. Let , , be finite-dimensional subspaces of with whenever . Then
Proof. Let be a basis of , and let be the concatenation , which spans . Suppose is dependent. By the linear dependence lemma, some entry of is a combination of the entries before it. Say is in ; the other cases are similar. Move the terms that come from to the left side. The left side is now minus a combination of earlier entries of , so it lies in . The right side is a combination of entries of and , so it lies in or in . Hence both sides lie in or in , which are . So is a combination of earlier entries of , contradicting the independence of . Therefore is a basis, and the claim follows.
Uses. Non-example 4.4.6 (Sums that are not direct), Theorem 4.4.7 (Criteria for direct sums), Theorem 4.4.13 (Bases and dimension of a sum)
Techniques. Induction on the number of summands (Technique 4.4.10)
The claim is false. The lines , , and in meet pairwise in , their dimensions add up to , and their sum is , of dimension .
The error is the sentence “it lies in or in ”. A combination of entries of and is a vector of plus a vector of , so it lies in , not in . To conclude that both sides vanish, the argument needs
With the hypotheses and
Exercise 4.4.38. Find the error in the following proof of Theorem 4.4.19.
Proof. Let be a basis of and a basis of . The concatenation spans . The vectors that occur in both and lie in , and they form a basis of . Deleting one copy of each of them from leaves a basis of with
Uses. Theorem 4.4.19 (Dimension of a sum)
Techniques. Extend a basis of a subspace (Technique 4.1.18)
The error is the claim that the vectors occurring in both and form a basis of . Arbitrary bases need not share any vector, and the entries of that happen to lie in need not span it.
For example, in let with , and
The argument becomes correct if the bases are chosen with care: start from a basis of and extend it to a basis of and to a basis of . Then the shared vectors are exactly the chosen basis of , and what remains to be shown is that the merged list is independent. That is the first proof of Theorem 4.4.19.
Exercise 4.4.39. For finite-dimensional subspaces , , of , let
- (a)Find subspaces of with
. - (b)Show that
always. - (c)Show that
whenever .
Uses. Remark 4.4.22 (No formula for three subspaces), Proposition 1.4.16 (Intersections of subspaces), Proposition 4.4.2 (Sums are the smallest containing subspaces), Theorem 4.4.19 (Dimension of a sum)
(a) Let , , and . All pairwise intersections and the triple intersection are , so , but
(b) and , so ; likewise . Since is a subspace (Proposition 1.4.16), it contains by Proposition 4.4.2(b).
(c) All the subspaces involved are finite-dimensional, being contained in (Theorem 4.4.13(a)). By Proposition 4.4.2(a),
By Theorem 4.4.19 again,
Substituting both gives
For instance, the hypothesis holds when , since then both sides equal .
Exercise 4.4.40. Let have dimension , and let be subspaces of .
- (a)Show that
. - (b)Let . Show that the bound in (a) is attained by the subspaces
, . - (c)Deduce that if , any subspaces of of dimension have a nonzero vector in common.
Uses. Theorem 4.4.19 (Dimension of a sum), Proposition 4.1.21 (Dimensions of subspaces), Example 4.2.25 (Kernels of linear functionals)
Techniques. Induction on the number of summands (Technique 4.4.10), Dimension counting (Technique 4.2.24)
(a) We induct on . For both sides equal . Let , and put ; by the inductive hypothesis,
Since
(b) Each is the kernel of the nonzero functional , so (Example 4.2.25), and the bound in (a) is
(c) For subspaces of dimension , (a) gives
Exercise 4.4.41. Let , and let be the matrix whose columns are those of followed by those of .
- (a)Show that
. - (b)Deduce that
. This sharpens Proposition 4.3.20. - (c)Find with but
.
Uses. Proposition 2.6.18 (The column space is spanned by the columns), Proposition 4.4.2 (Sums are the smallest containing subspaces), Theorem 4.4.19 (Dimension of a sum), Theorem 4.2.7 (The image of ), Proposition 4.1.21 (Dimensions of subspaces)
(a) By Proposition 2.6.18, , , and are the spans of the columns of , of , and of both together. So
(b) For every ,
(c) Let and . Then and meet only in , and . But has rank . The loss comes from the other side: and both kill , so does too.
Exercise 4.4.42. Let be finite-dimensional, and let and be subspaces of .
- (a)Show that there is with and if and only if .
- (b)Show that in (a) can be chosen with if and only if .
- (c)In , let . Find as in (a), and explain directly why no such satisfies .
Uses. Theorem 4.2.11 (Rank–nullity), Proposition 4.4.16 (Complements exist), Theorem 4.4.13 (Bases and dimension of a sum), Theorem 2.2.1 (Linear maps are determined by a basis), Proposition 2.1.16 (Linear maps preserve spans and linear relations), Theorem 4.4.27 (Idempotents are projections), Proposition 4.4.26 (Properties of projections)
Techniques. Extend a basis of a subspace (Technique 4.1.18), Construct a map by choosing it on a basis (Technique 2.2.4)
(a) If and , then by Theorem 4.2.11. Conversely, suppose . Let be a complement of (Proposition 4.4.16), so
(b) If , then
(c) Here , and has
Exercise 4.4.43. Suppose in , and let satisfy . Let
- (a)Show that .
- (b)Deduce that is the direct sum of the subspace of symmetric matrices () and the subspace of skew-symmetric matrices (), and find the dimensions of both.
- (c)Over , find with but .
Uses. Proposition 2.6.8 (Kernels and images are subspaces), Theorem 4.4.7 (Criteria for direct sums), Proposition 1.2.35 (Zero products), Theorem 4.4.27 (Idempotents are projections), Definition 2.4.21 (Transpose), Lemma 2.4.24 (Matrix units), Theorem 4.4.13 (Bases and dimension of a sum)
Techniques. Split the space with an idempotent (Technique 4.4.28)
(a) and are subspaces (Proposition 2.6.8). Write , which is nonzero by hypothesis. For , put
So and , and . If , then , so and (Proposition 1.2.35). By Theorem 4.4.7, .
In the language of Theorem 4.4.27, satisfies
(b) The map on is linear, and (Definition 2.4.21). Its consists of the symmetric matrices and its of the skew-symmetric ones, so (a) gives the direct sum, with
So the matrices and () span the symmetric matrices, and they are independent, since a combination of them has entry in position for , and the matrix units are independent (Lemma 2.4.24). Hence the symmetric matrices have dimension , and by Theorem 4.4.13(c) the skew-symmetric matrices have dimension
(c) Over , let have matrix . Then has matrix .
Exercise 4.4.44. Suppose , and let satisfy for all and for all .
- (a)Show that
and . - (b)Deduce that if is finite-dimensional, then
. - (c)Show that (a) can fail without the hypothesis on : find with
, where and .
Uses. Theorem 4.4.7 (Criteria for direct sums), Theorem 4.4.13 (Bases and dimension of a sum), Definition 4.2.14 (Rank and nullity of a linear map), Proposition 4.4.2 (Sums are the smallest containing subspaces)
Techniques. Compare components (Technique 4.4.8)
(a) Let with and . Then with and , a decomposition of along , so by (II) of Theorem 4.4.7. Hence and , so
For the image, every
(b) By (a) and Theorem 4.4.13(c),
(c) Let
Uses. Theorem 4.2.11 (Rank–nullity), Theorem 4.3.8 (Row rank equals column rank), Theorem 4.2.7 (The image of ), Proposition 4.4.21 (Two out of three), Proposition 2.4.23 (Transpose of a product)
Techniques. Dimension counting (Technique 4.2.24)
Over every field,
Over . Let , say . By Proposition 2.4.23, , so
A sum of squares of real numbers vanishes only if each term does, so .
Over . Let . Then if and only if , so
Over . Let . Then
Uses. Proposition 4.4.16 (Complements exist), Proposition 4.4.21 (Two out of three), Theorem 1.5.5 (Independence is decided at zero)
Techniques. Dimension counting (Technique 4.2.24)
If , then , and any complement satisfies . If , then , and any complement satisfies . In both cases the complement is unique.
Now suppose . By Proposition 4.4.16, has a complement , of dimension ; let be a basis of , and let be nonzero. Let
Then
Exercise 4.4.47. Let , let be distinct, and let
Show that
Uses. Example 2.1.9 (Maps of polynomials), Lemma 3.4.23 (Too many roots), Theorem 3.4.24 (Polynomial interpolation), Theorem 4.4.7 (Criteria for direct sums), Theorem 4.4.13 (Bases and dimension of a sum), Theorem 4.2.11 (Rank–nullity)
The map
If , then has degree at most and vanishes at the distinct points , so by Lemma 3.4.23. Next, let . By Theorem 3.4.24 there is with for . Since , , and it vanishes at every , so and
First count. By Theorem 4.4.13(c), , so .
Second count. The map is surjective: for
The decomposition says that the projection onto along sends to its interpolating polynomial at . Note that the hypothesis requires to have at least elements.
Exercise 4.4.48. Let satisfy , and suppose that is invertible.
- (a)Show that and .
- (b)Show that .
- (c)Show that if also , then . Show by an example that can fail without the hypothesis .
Uses. Theorem 4.4.13 (Bases and dimension of a sum), Theorem 4.2.11 (Rank–nullity), Theorem 4.2.7 (The image of ), Proposition 4.1.21 (Dimensions of subspaces), Proposition 4.4.21 (Two out of three)
Techniques. Dimension counting (Technique 4.2.24)
(a) For , invertibility of gives with
(b) , and
(c) If , the hypotheses are symmetric in and (note ), so (b) with the roles exchanged gives .
Without , let and . Then and is invertible, with inverse , but , and while
The kernels are complementary in any case:
Exercise 4.4.49. Let be finite-dimensional with .
- (a)For , let
. Show that is a complement of . - (b)Show that every complement of equals for exactly one .
- (c)Deduce that if has elements, , and , then has exactly complements in .
- (d)List the complements of in .
Uses. Proposition 4.2.6 (Injective maps preserve dimension), Proposition 4.4.21 (Two out of three), Proposition 4.4.16 (Complements exist), Definition 4.4.24 (Projection along a complement), Proposition 4.4.26 (Properties of projections), Proposition 4.1.21 (Dimensions of subspaces), Theorem 2.2.1 (Linear maps are determined by a basis), Proposition 4.1.34 (Size of a vector space over a finite field)
Techniques. Dimension counting (Technique 4.2.24)
Let and , so (Proposition 4.4.16(b)).
(a) The map , , is linear with image , so is a subspace. If , then
(b) Existence. Let be a complement of . Define by
by Proposition 4.4.26(d). So . Both have dimension , by (a) and Proposition 4.4.16(b), so (Proposition 4.1.21(b)).
Uniqueness. Suppose , and let . Then , so
(c) By (a) and (b), is a bijection from onto the set of complements of . Fix a basis of . By Theorem 2.2.1,
(d) Here and , so there are complements. Take
These are exactly the planes of that do not contain .
Exercise 4.4.50. Let be finite-dimensional.
- (a)Let and be subspaces of with . Show that and have a common complement, that is, a subspace with .
- (b)Show that the three lines through in have no common complement.
Uses. Exercise 1.4.21, Proposition 4.1.21 (Dimensions of subspaces), Theorem 4.4.13 (Bases and dimension of a sum), Proposition 4.4.21 (Two out of three), Proposition 4.4.16 (Complements exist)
Techniques. Dimension counting (Technique 4.2.24), Extend a basis of a subspace (Technique 4.1.18)
(a) Let and . We prove the claim by induction on , for all pairs of subspaces of of equal dimension. If , then (Proposition 4.1.21(b)) and works.
Let . Then and are proper subspaces, so by Exercise 1.4.21; choose with and . If with , then ; so , and has dimension by Theorem 4.4.13(c). Likewise has dimension . By the inductive hypothesis there is with
We show . Let with and . Then lies in , since and . So , and , which forces since . Hence . As , Proposition 4.4.21 gives . The same argument with and in place of and gives .
(b) Each line through in contains exactly one nonzero vector, so there are exactly three lines: , , . A complement of a line has dimension (Proposition 4.4.16(b)) and is a line different from it. A common complement of all three would be a fourth line, which does not exist.
So (a) does not extend to three subspaces over every field. Over an infinite field it does extend to any finite number of subspaces of equal dimension, by the same induction together with Exercise 1.4.43.
Exercise 4.4.51. Let be , , or , and let
- (a)Show that
. - (b)Deduce that whenever .
- (c)Show that the conclusion of (b) can fail over .
Uses. Exercise 4.3.43, Proposition 2.4.27 (The trace is linear), Theorem 4.2.7 (The image of ), Theorem 4.4.13 (Bases and dimension of a sum), Proposition 4.4.29 (Projections of a direct sum)
Techniques. Compare components (Technique 4.4.8), Split the space with an idempotent (Technique 4.4.28)
(a) For ,
This is the dimension of the sum, so the sum is direct by Theorem 4.4.13(c).
(b) Fix and , and let . Since ,
a decomposition of along . Another decomposition of has component in and in every other . By (a) the two agree, so
By (b) and Proposition 4.4.29(b), the are the projections of the decomposition in (a).
(c) Over , let , , and
Exercise 4.4.52. Let be a field with elements. Call subspaces of a spread if each has dimension and any two of them are complements of each other.
- (a)Show that a spread has at most members.
- (b)For , construct a spread with members. (For , consider the subspace of vectors with
.)
Uses. Proposition 4.1.34 (Size of a vector space over a finite field), Theorem 4.4.7 (Criteria for direct sums), Proposition 4.4.21 (Two out of three), Proposition 4.2.6 (Injective maps preserve dimension)
Techniques. Double counting (Technique 4.1.36)
Write vectors of as with .
(a) Let be a spread. For , , so the sets are pairwise disjoint subsets of . Each has elements (Proposition 4.1.34), so
and .
(b) For let
So and are invertible, with . We claim that
Since in , the differences of two distinct matrices among are
all invertible. If
The four matrices , with matrix addition and multiplication, form the field with four elements (Section 14.3). The same construction, with realized as matrices in , gives a spread of size for every .
More practice
The practice bank has 29 exercises on this section’s topics.