Section 2.1 Vectors and basic operations
Subsection 2.1.1 Vectors in \(\mathbb{R}^2\text{.}\)
Definition 2.1.1.
A vector in \(\mathbb{R}^2\) is a column with two entries, each of which is a real number. \(\mathbb{R}^2\) is the collection of all such vectors.Example 2.1.2.
Just like in the ordered pair notation for points, the order of the numbers matters. Thus \(\begin{bmatrix}1\\0\end{bmatrix}\) is not the same vector as \(\begin{bmatrix}0\\1\end{bmatrix}\text{.}\)
Geometrically, vectors arise as directed line segments describing how to get from one point in the plane to another. If \(P = (x_1, y_1)\) and \(Q = (x_2, y_2)\) are points in the plane then the vector \(\vec{PQ}\) is the vector \(\vec{PQ} = \begin{bmatrix}x_2-x_1 \\ y_2-y_1\end{bmatrix}\text{.}\)
Example 2.1.3.
The next example shows that our algebraic representation of vectors does not determine the starting point or ending point of the geometric representation.
Example 2.1.5.
The geometric interpretation of two vectors being equal is that they have the same length and point in the same direction (we will define "length" and "direction" carefully in the next section). This means that we can move a vector around without changing which vector it is, as long as we do not change the length or direction. It is helpful to think of vectors as "instructions": Knowing a list of instructions does not tell you where you will end up, only how that place relates to where you started.
Definition 2.1.7.
Suppose that \(\vec{v}\) is a vector in \(\mathbb{R}^2\text{.}\) We say that \(\vec{v}\) is drawn in standard position if it is drawn in the plane so that the starting point of the vector is the origin, \((0, 0)\text{.}\)Subsection 2.1.2 Addition and scalar multiplication
Definition 2.1.8.
Suppose that \(\vec{v} = \begin{bmatrix}v_1\\v_2\end{bmatrix}\) and \(\vec{w} = \begin{bmatrix}w_1\\w_2\end{bmatrix}\text{.}\) We define vector addition "\(\vec{v}\) plus \(\vec{w}\)" by definingGeometrically, following the vector \(\vec{v}+\vec{w}\) amounts to first following \(\vec{v}\) and then following \(\vec{w}\text{.}\)
Example 2.1.9.
Addition of vectors in \(\mathbb{R}^2\) shares many properties with addition of numbers. We list some of the most important properties in the following theorem, but before that we need one more definition.
Definition 2.1.11.
The zero vector in \(\mathbb{R}^2\) is the vector \(\vec{0} = \begin{bmatrix}0\\0\end{bmatrix}\)Theorem 2.1.12.
Suppose that \(\vec{v}\text{,}\) \(\vec{w}\text{,}\) and \(\vec{z}\) are vectors in \(\mathbb{R}^2\text{.}\) Then:
\(\displaystyle \vec{v}+\vec{w} = \vec{w}+\vec{v}\)
\(\displaystyle (\vec{v}+\vec{w}) +\vec{z} = \vec{v} + (\vec{w}+\vec{z})\)
\(\displaystyle \vec{v} + \vec{0} = \vec{v}\)
Proof.
We will only prove the second property, as an illustration of what it takes to prove a statement like this. We emphasize that the theorem statement is supposed to apply to any vectors we might have, so a proof needs to handle all possible choices for \(\vec{v}, \vec{w}, \vec{z}\text{,}\) so working with a numerical example is not enough. Instead, we assign variables to the entries of our vectors, and thus do a calculation that will work for all possible vectors. Suppose that \(\vec{v} = \begin{bmatrix}v_1\\v_2\end{bmatrix}, \vec{w} = \begin{bmatrix}w_1\\w_2\end{bmatrix}, \vec{z} = \begin{bmatrix}z_1\\z_2\end{bmatrix}\text{.}\) Then we calculate:
The proofs of the other two statements of the theorem are similar, and are good exercises to make sure you're comfortable with what a proof needs to do.
The second of the two main things we do with vectors is scalar multiplication, which allows us to change the length of a vector without changing its direction.
Definition 2.1.13.
Suppose that \(\vec{v} = \begin{bmatrix}v_1\\v_2\end{bmatrix}\) is a vector in \(\mathbb{R}^2\text{,}\) and \(r\) is a scalar (that is, a real number). We define the scalar multiplication "\(r\) times \(\vec{v}\)" by definingDefinition 2.1.14.
If \(\vec{v}\) and \(\vec{w}\) are vectors, and there is a scalar \(c\) such that \(\vec{v} = c\vec{w}\text{,}\) then we say that \(\vec{v}\) is parallel to \(\vec{w}\text{.}\)Example 2.1.15.
\(\displaystyle 2\vec{v} = \begin{bmatrix}2\\4\end{bmatrix}\)
\(\displaystyle \frac{1}{2}\vec{v} = \begin{bmatrix}1/2 \\ 1\end{bmatrix}\)
\(\displaystyle -3\vec{v} = \begin{bmatrix}-3\\-6\end{bmatrix}\)
\(\displaystyle 0\vec{v} = \vec{0}\)
Addition and scalar multiplication of vectors interact in the ways that you probably expect based on how addition and multiplication of numbers work. However, we must be a little bit careful! We are not defining what it means to multiply a vector by another vector; an expression like \(r(\vec{v}\vec{w}) = (r\vec{v})\vec{w}\) isn't even false, it is meaningless.
Theorem 2.1.17.
Suppose that \(\vec{v}\) and \(\vec{w}\) are vectors in \(\mathbb{R}^2\text{,}\) and \(r\) and \(s\) are scalars. Then:
\(\displaystyle r(\vec{v}+\vec{w}) = r\vec{v} + r\vec{w}\)
\(\displaystyle (r+s)(\vec{v}) = r\vec{v} + s\vec{v}\)
\(\displaystyle (rs)(\vec{v}) = r(s\vec{v})\)
\(\displaystyle 0\vec{v} = \vec{0}\)
\(\displaystyle r\vec{0} = \vec{0}\)
Definition 2.1.18.
If \(\vec{v} = \begin{bmatrix}v_1\\v_2\end{bmatrix}\) and \(\vec{w} = \begin{bmatrix}w_1\\w_2\end{bmatrix}\text{,}\) then we define subtraction bySubsection 2.1.3 Vectors in \(\mathbb{R}^n\)
So far we have considered vectors in the plane, \(\mathbb{R}^2\text{.}\) In applications of linear algebra one often needs to work in higher dimensions for a variety of reasons. First, the space around us is three-dimensional, so for physical applications we often work in \(\mathbb{R}^3\text{.}\) Other applications of linear algebra think of a vector as a list of data (rather than as a geometric object), and so may need even higher dimensions. For instance, if you are taking five courses this term, then when the term is over your grades for the term could be listed as a vector with \(5\) entries (that is, a vector in \(\mathbb{R}^5\)).
If you look back at the previous section, you will see that the algebraic definitions we gave make perfect sense no matter how many dimensions we are in. Thus, for example, if \(\vec{v} = \begin{bmatrix}v_1\\v_2\\v_3\\v_4\end{bmatrix}\) and \(\vec{w} = \begin{bmatrix}w_1\\w_2\\w_3\\w_4\end{bmatrix}\) then it still makes sense to define \(\vec{v}+\vec{w} = \begin{bmatrix}v_1+w_1\\v_2+w_2\\v_3+w_3\\v_4+w_4\end{bmatrix}.\) You can also verify that the properties of addition and scalar multiplication continue to work in any number of dimensions. This will become a recurring theme in the course: We will take geometric ideas from \(\mathbb{R}^2\) or \(\mathbb{R}^3\text{,}\) translate them into algebraic language, and then use that to generalize to \(\mathbb{R}^n\) for higher values of \(n\text{.}\)
We will usually state general results for vectors in \(\mathbb{R}^n\text{,}\) leaving \(n\) unspecified so that our results can be applied in any number of dimensions.
Note 2.1.19.
There are a few subtle details that we should be careful about.It does not make sense to combine vectors with different numbers of entries. If \(\vec{v}\) is in \(\mathbb{R}^4\) and \(\vec{w}\) is in \(\mathbb{R}^6\) then the expression \(\vec{v}+\vec{w}\) does not make sense.
The zero vector in \(\mathbb{R}^2\) is \(\begin{bmatrix}0\\0\end{bmatrix}\text{,}\) while the zero vector in \(\mathbb{R}^3\) is \(\begin{bmatrix}0\\0\\0\end{bmatrix}\text{,}\) and these are different! Much of the time it will be clear from context what the symbol \(\vec{0}\) means, but sometimes we will write \(\vec{0}_n\) if we need to emphasize that we are talking about the zero vector in \(\mathbb{R}^n\text{.}\)
Subsection 2.1.4 A first look at linear combinations
Definition 2.1.20.
Suppose that \(\vec{v}_1, \ldots, \vec{v}_k\) are vectors in \(\mathbb{R}^n\text{.}\) A linear combination of \(\vec{v}_1, \ldots, \vec{v}_k\) is a vector that can be written in the formExample 2.1.21.
Example 2.1.22.
Example 2.1.23.
Which vectors in \(\mathbb{R}^3\) can be expressed as linear combinations of \(\vec{v_1} = \begin{bmatrix}1\\1\\-1\end{bmatrix}, \vec{v_2} = \begin{bmatrix}2\\-1\\0\end{bmatrix}, \vec{v_3} = \begin{bmatrix}3\\0\\-1\end{bmatrix}\text{?}\)
Solution.Consider any vector \(\vec{w} = \begin{bmatrix}x\\y\\z\end{bmatrix}\) in \(\mathbb{R}^3\text{.}\) We are interested in knowing what must be true about \(x, y, z\) in order for there to be scalars \(a, b, c\) such that
that is,
By calculating the right side of this equation and then comparing first entries, second entries, and third entries, we get a system of equations:
We recognize this as a system of linear equations, but we should be careful to remember what we're trying to do: We want to know what must be true about \(x, y, z\) in order for this system to have a solution. We set up an augmented matrix and row reduce.
From the row-echelon form we can see that our system will have a solution as long as \(\frac{1}{3}x+\frac{2}{3}y+z=0\text{.}\) We therefore conclude that the vectors that can be expressed as linear combinations of \(\vec{v_1}, \vec{v_2}, \vec{v_3}\) are precisely those vectors \(\begin{bmatrix}x\\y\\z\end{bmatrix}\) where \(\frac{1}{3}x+\frac{2}{3}y+z=0\text{.}\)
Exercises 2.1.5 Exercises
1.
Given the points \(P = (2,0,4)\) and \(Q= (5,-2,1)\text{,}\) find \(\overrightarrow{PQ}\) and \(\overrightarrow{QP}\text{.}\)
the same direction as \(\mathbf{v}\text{;}\) the opposite direction of \(\mathbf{v}\text{.}\) \(P=(-1,2,2)\text{,}\) \(\mathbf{v} = \begin{bmatrix} 1 \\ 3 \\ 1 \end{bmatrix}\) \(P=(3,0,-1)\text{,}\) \(\mathbf{v} = \begin{bmatrix} 2 \\ -1 \\ 3 \end{bmatrix} \) same direction: \(Q = (0 , 5 , 3).\) opposite direction: \(Q = (-2 , -1 , 1).\) same direction: \(Q = (5 , -1 , 2).\) opposite direction: \(Q = (1 , 1 , -4).\) First, our solution for \(P=(-1,2,2)\) and \(\mathbf{v} = \begin{bmatrix} 1 \\ 3 \\ 1 \end{bmatrix}\): same direction: We compute We have argued before that this should equal \(\vect{OQ}\text{,}\) so we conclude: Let us check our solution: we have so that \(\vect{PQ}\) indeed has the same direction as \(\vec{v}\) (since they are equal). opposite direction: We compute We have argued before that this should equal \(\vect{OQ}\text{,}\) so we conclude: Let us check our solution: we have so that \(\vect{PQ}\) indeed has the opposite direction as \(\vec{v}\text{.}\) Next, our solution for \(P=(3,0,-1)\) and \(\mathbf{v} = \begin{bmatrix} 2 \\ -1 \\ 3 \end{bmatrix} \): same direction: We compute We have argued before that this should equal \(\vect{OQ}\text{,}\) so we conclude: Let us check our solution: we have so that \(\vect{PQ}\) indeed has the same direction as \(\vec{v}\) (since they are equal). opposite direction: We compute We have argued before that this should equal \(\vect{OQ}\text{,}\) so we conclude: Let us check our solution: we have so that \(\vect{PQ}\) indeed has the opposite direction as \(\vec{v}\text{.}\)2.
In each case, find a point \(Q\) such that \(\overrightarrow{PQ}\) has
The vector from \((5,3)\) to \((6,2)\) and the vector from \((1,-2)\) to \((1,1)\text{.}\) The vector from \((2,1,1)\) to \((3,0,4)\) and the vector from \((5,1,4)\) and \((6,0,7)\text{.}\) The two vectors are different. The two vectors are the same. By definition, the vector \(\vect{v}\) from \((5,3)\) to \((6,2)\) is given by By definition, the vector \(\vect{v}\) from \((2,1,1)\) to \((3,0,4)\) is given by3.
Decide if the two vectors are equal.
\(\overrightarrow{QP}\text{,}\) \(\overrightarrow{QR}\text{,}\) \(\overrightarrow{RP}\text{,}\) \(\overrightarrow{RO}\) where \(O\) is the origin. By definition, the components of \(\overrightarrow{QP}\) are the difference of the respective components of the point \(P\) and of the point \(Q\text{,}\) or in other words: Similarly, we have Just as above, we have If we write \(\vec{0}\) for the vector of the origin \(O\text{,}\) all of whose components are zero, then4.
Let \(\mathbf{p}\) and \(\mathbf{q}\) be the vectors of points \(P\) and \(Q\text{,}\) respectively, and let \(R\) be the point whose vector is \(\mathbf{p+q}\text{.}\) Express the following in terms of \(\mathbf{p}\) and \(\mathbf{q}\text{:}\)
5.
Find
We draw all seven vectors in standard position. Notice that \(\vec{u}+\vec{v}\) represents the diagonal of the parallelogram with sides \(\vec{u}\) and \(\vec{v}\text{,}\) and similarly, \(-\vec{u}+\vec{v}\) represents the diagonal of the parallelogram with sides \(-\vec{u}\) and \(\vec{v}\text{.}\) Furthermore, \(-1/2\vec{v}\) has the opposite direction of \(\vec{v}\text{,}\) and \(-\vec{u}\) the opposite direction of \(\vec{v}\text{.}\)6.
Draw the vectors \(\mathbf{u} =\begin{bmatrix} 2 \\ 1 \end{bmatrix} \) and \(\mathbf{v}=\begin{bmatrix} 1 \\ -1 \end{bmatrix} \text{.}\) Then draw \(-\vec{u}, 2\vec{v}, -1/2\vec{v}, \vec{u}+\vec{v},\) and \(-\vec{u}+\vec{v}\) on the same set of coordinate axes.
\(\displaystyle 3(2\mathbf{u}+ \mathbf{x}) + \mathbf{w} = 2\mathbf{x} -\mathbf{v}\) \(2(3\mathbf{v}- \mathbf{x}) = 5\mathbf{w} +\mathbf{u} - 3\mathbf{x}\text{.}\) Using that and so forth, we can now just plug in the values in the equation for \(\vec{x}\text{:}\) First, we compute: Plugging in the vectors, we get:7.
Let \(\mathbf{u} = \begin{bmatrix} 3 \\ -1 \\ 0 \end{bmatrix} \text{,}\) \(\mathbf{v} = \begin{bmatrix} 4 \\ 0 \\ 1 \end{bmatrix} \text{,}\) and \(\mathbf{w} = \begin{bmatrix} -1 \\ 1 \\ 5 \end{bmatrix} \text{.}\) In each case, find \(\mathbf{x}\) such that:
For good measure, let us check that we did not make a mistake. With \(c_2=-1\text{,}\) we get \(c_1 = 4 + c_2 2 = 4 + (-1) 2 = 2\text{.}\) For these values, we compute:8.
Decide whether
9.
Decide whether