MIT 18.06 by Glibert Strang

§1 The Geometry of Linear Equations

Give the follow equation

(1.1){2xy=0x+2y=3\left\{\begin{aligned} 2x - y = 0 \\ -x + 2y = 3 \end{aligned} \tag{1.1} \right .

the matrix form

(1.2)[2112][xy]=[03]\left[\begin{matrix}2 & -1\\-1 & 2\end{matrix}\right]\left[\begin{matrix}x\\y\end{matrix}\right]=\left[\begin{matrix}0\\3\end{matrix}\right]\tag{1.2}

equation (1.4) is a Linear Combination

(1.3)x[21]+y[12]=[30]x\left[\begin{matrix}2\\-1\end{matrix}\right] + y\left[\begin{matrix}-1\\2\end{matrix}\right] =\left[\begin{matrix}3\\0\end{matrix}\right]\tag{1.3}

the euqtion (1.3) can be written as a normal form, x is a vector,

(1.4)Ax=bA\textbf{x} = b\tag{1.4}

we are supposed to solve the x while x is not always exits, here's an example

(1.5)x[210]+y[120]+z[010]=[014]\begin{aligned} &x \left[\begin{matrix}2\\-1\\0\end{matrix}\right] + y\left[\begin{matrix}-1\\2\\0 \end{matrix}\right] + z\left[\begin{matrix}0\\-1\\0 \end{matrix}\right]\\ =& \left[\begin{matrix}0\\-1\\-4 \end{matrix}\right] \end{aligned}\tag{1.5}

In this case, column1column 1, column2column 2 and column3column 3 are in the same plane, then their combinations will lie in that same plane. so this would be a singular case, the martix would be not invertible. There would be no a solution for any bb.

After, we can get a conclusion that for Ax=bA\textbf{x} = b:
Ax is a combination of columns of A
for the follow example,

(1.6)[2513][12]=1×[21]+2×[53]=[21]+[106]=[127]\begin{aligned} \left[\begin{matrix}2 & 5 \\ 1 & 3 \end{matrix}\right]\left[\begin{matrix}1 \\ 2 \end{matrix}\right] &= 1 \times \left[\begin{matrix}2 \\ 1 \end{matrix}\right] + 2 \times \left[\begin{matrix}5 \\ 3 \end{matrix}\right]\\ &= \left[\begin{matrix}2 \\ 1 \end{matrix}\right] + \left[\begin{matrix}10 \\ 6 \end{matrix}\right]\\ &= \left[\begin{matrix}12 \\ 7 \end{matrix}\right] \end{aligned}\tag{1.6}

§2 Elimination with Matrices

The key idea of Elimination is Matrix Operation
Give the follow equation

(2.1){x+2y+z=23x+8y+z=124y+z=2\left\{ \begin{aligned} x + 2y + z = 2\\ 3x + 8y + z = 12\\ 4y + z = 2 \end{aligned} \right . \tag{2.1}

Give the determinant form of the equation

(2.2)121381041\left|\begin{matrix}{\color{red}1} & 2 & 1 \\ 3 & 8 & 1 \\ 0 & 4 & 1 \end{matrix}\right| \tag{2.2}

The red 1 is called 1st pivot; then we row2 minus 3×\timesrow1, get the follow determinant

(2.3)121022041\left|\begin{matrix}1 & 2 & 1 \\ 0 & {\color{red}2} & -2 \\ 0 & 4 & 1 \end{matrix}\right| \tag{2.3}

then row3 minus 2×\timesrow2

(2.4)121020005\left|\begin{matrix}1 & 2 & 1 \\ 0 & 2 & 0 \\ 0 & 0 & {\color{red}5} \end{matrix}\right| \tag{2.4}

write the right hand of equation (2.1) into the matrix (2.2), it's called Augmented Matrix

(2.5)[1212381120412]\left[\begin{matrix}1 & 2 & 1 & 2\\ 3 & 8 & 1 & 12\\ 0 & 4 & 1 & 2\end{matrix}\right] \tag{2.5}

do the same elimination for matrix (2.5)

(2.6)[1212022600510]\left[\begin{matrix}1 & 2 & 1 & 2\\ 0 & 2 & -2 & 6\\ 0 & 0 & 5 & -10\end{matrix}\right] \tag{2.6}

The Rule of Matrix Multiplication

Matrix×column=columnrow×Matrix=rowMatrix \times column = column\\ row \times Matrix = row

The reasult of multiplying a matrix by some vector is a linear combination of the columns of the matrix

(2.7)[ABCDEFGHI][xyz]=x[ADG]+y[BEH]+z[CFI]\begin{aligned} & \left[\begin{matrix}{\color{red}A} & B & {\color{blue}C} \\ {\color{red}D} & E & {\color{blue}F} \\ {\color{red}G} & H & {\color{blue}I} \end{matrix}\right] \left[\begin{matrix}{\color{red}x} \\ y \\ {\color{blue}z}\end{matrix}\right]\\ =& {\color{red}x}\left[\begin{matrix}{\color{red}A} \\ {\color{red}D} \\ {\color{red}G}\end{matrix}\right] + {y}\left[\begin{matrix}{B} \\ {E} \\ {H}\end{matrix}\right] +{\color{blue}z} \left[\begin{matrix}{\color{blue}C} \\ {\color{blue}F} \\ {\color{blue}I}\end{matrix}\right] \end{aligned} \tag{2.7}