Glossary
Every defined term in this course, A–Z.
adjugate
Read the section →The transposed matrix of cofactors; A^{-1}=\frac{1}{\det A}\operatorname{adj}(A).
algebraic multiplicity
Read the section →How many times an eigenvalue repeats as a root of the characteristic polynomial.
augmented matrix
Read the section →A system's coefficients and constants compressed into one grid.
basic variable
Read the section →A variable corresponding to a pivot column; determined once free variables are set.
basis
Read the section →A set that both spans a space and is linearly independent.
change-of-coordinates matrix
Read the section →The matrix P converting \mathcal B-coordinates to standard coordinates.
characteristic equation
Read the section →\det(A-\lambda I) = 0 — solved for \lambda, its roots are A's eigenvalues.
characteristic polynomial
Read the section →p_A(\lambda)=\det(A-\lambda I), a degree-n polynomial whose roots are A's eigenvalues.
coefficient matrix
Read the section →The m\times n array of a system's coefficients, without the constants column.
cofactor
Read the section →A minor with a checkerboard sign attached: C_{ij}=(-1)^{i+j}M_{ij}.
cofactor expansion
Read the section →Computing a determinant by summing entries times signed minors along any row or column.
column space
Read the section →\operatorname{Col}(A) — the span of a matrix's columns.
coordinate vector
Read the section →[\mathbf x]_{\mathcal B} — the unique list of coefficients expressing \mathbf x in a given basis.
Cramer's rule
Read the section →Solving for one variable of A\mathbf x=\mathbf b at a time, as a ratio of two determinants.
cross product
Read the section →A vector, defined only in \mathbb{R}^3, perpendicular to both inputs.
defective
Read the section →An eigenvalue (or matrix) whose geometric multiplicity falls short of its algebraic multiplicity.
determinant
Read the section →A single number, \det A, reporting a matrix's signed scaling factor.
determinant and invertibility
Read the section →\det A \ne 0 exactly when a square matrix A is invertible.
diagonal matrix
Read the section →A square matrix whose only nonzero entries (if any) lie on the main diagonal.
diagonalizable
Read the section →A = PDP^{-1} for some invertible P and diagonal D; equivalent to having n independent eigenvectors.
dimension
Read the section →\dim V — the number of vectors in any basis of V.
distance
Read the section →The length of the vector connecting two points, d(P,Q) = \lVert P - Q\rVert.
dot product
Read the section →\mathbf u \cdot \mathbf v = u_1v_1 + \cdots + u_nv_n — a single number, not a vector.
eigenspace
Read the section →\operatorname{Nul}(A-\lambda I) — every eigenvector for a given \lambda, plus \mathbf 0.
eigenvalue
Read the section →\lambda in A\mathbf v = \lambda\mathbf v — the stretch factor belonging to an eigenvector.
eigenvector
Read the section →A nonzero vector A only stretches or shrinks, never turns off its own line.
elementary matrix
Read the section →The identity matrix after one elementary row operation; multiplying by it performs that operation.
elementary row operations
Read the section →Swap, scale, or replace a row — the three legal, reversible moves on a matrix.
free variable
Read the section →A variable corresponding to a free (non-pivot) column; a genuine degree of freedom.
Gauss-Jordan elimination
Read the section →Ordinary elimination plus a backward pass, reaching RREF directly.
Gaussian elimination
Read the section →The column-by-column procedure that reduces any matrix to row echelon form.
geometric multiplicity
Read the section →The dimension of an eigenvalue's eigenspace — how many independent eigenvectors it actually supplies.
Gram-Schmidt process
Read the section →Converting any basis into an orthogonal basis of the same subspace.
homogeneous system
Read the section →A\mathbf x = \mathbf 0 — a system whose right-hand side is entirely zero.
identity matrix
Read the section →I_n — 1s on the diagonal, 0s elsewhere; the matrix analogue of 1.
image
Read the section →\operatorname{im}(T) — every output a linear transformation can produce.
inner product
Read the section →Any operation on two vectors obeying symmetry, additivity, homogeneity, and positive definiteness.
inverse
Read the section →A^{-1} — the matrix with AA^{-1}=A^{-1}A=I.
Invertible Matrix Theorem
Read the section →A list of conditions on a square matrix that all hold together, or all fail together.
invertible transformation
Read the section →A linear map T with an S that perfectly undoes it, S(T(\mathbf x))=\mathbf x.
isomorphism
Read the section →A bijective linear map; two spaces linked this way are V \cong W.
kernel
Read the section →\ker T — every input a linear transformation sends to the zero vector.
least-squares solution
Read the section →\hat{\mathbf x} — the \mathbf x minimizing \lVert A\mathbf x - \mathbf b\rVert^2.
left null space
Read the section →\operatorname{Nul}(A^{\mathsf T}) — vectors \mathbf y with \mathbf y^{\mathsf T}A=\mathbf 0.
linear combination
Read the section →A sum of scaled vectors, c_1\mathbf v_1 + \cdots + c_k\mathbf v_k.
linear equation
Read the section →a_1x_1+\cdots+a_nx_n=b — every variable alone, never multiplied or raised to a power.
linear independence
Read the section →No vector in the set can be built from the others; only the trivial combination gives \mathbf 0.
linear transformation
Read the section →A map preserving addition and scalar multiplication: T(a\mathbf u+b\mathbf v)=aT(\mathbf u)+bT(\mathbf v).
LU factorization
Read the section →A = LU — elimination's multipliers (L) times the resulting triangular matrix (U).
Markov chain
Read the section →A system moving between states where next-state odds depend only on the current state.
matrix
Read the section →A rectangular array of numbers, with shape m\times n.
matrix equation
Read the section →A\mathbf x = \mathbf b — a whole linear system collapsed into one line.
matrix multiplication
Read the section →(AB)_{ij} is row i of A dotted with column j of B.
minor
Read the section →The determinant of the smaller matrix left after deleting one row and one column.
norm
Read the section →A vector's length, \lVert\mathbf v\rVert = \sqrt{\mathbf v\cdot\mathbf v}.
normal equations
Read the section →A^{\mathsf T}A\hat{\mathbf x}=A^{\mathsf T}\mathbf b — the algebraic form of least squares.
null space
Read the section →\operatorname{Nul}(A) — every \mathbf x with A\mathbf x = \mathbf 0.
nullity
Read the section →\operatorname{nullity}(A) = \dim\operatorname{Nul}(A), the number of free variables.
one-to-one
Read the section →Distinct inputs always produce distinct outputs; injective.
onto
Read the section →Every vector in the codomain is hit by at least one input; surjective.
orthogonal
Read the section →Perpendicular — two vectors with dot product exactly 0.
orthogonal complement
Read the section →W^\perp — every vector orthogonal to all of a subspace W at once.
orthogonal decomposition theorem
Read the section →Every \mathbf y splits uniquely into \hat{\mathbf y}\in W plus a piece orthogonal to W.
orthogonal diagonalization
Read the section →Diagonalizing a symmetric matrix using an orthonormal eigenbasis, so P^{-1}=P^{\mathsf T}.
orthogonal matrix
Read the section →A square matrix whose columns form an orthonormal set; Q^{-1}=Q^{\mathsf T}.
orthogonal projection onto a subspace
Read the section →\operatorname{proj}_W(\mathbf v) — summing single-vector projections onto an orthogonal basis of W.
orthogonal set
Read the section →A collection of vectors, every distinct pair of which is orthogonal.
orthonormal set
Read the section →An orthogonal set whose vectors also all have length 1.
parametric vector form
Read the section →A solution set written as \mathbf p + t\mathbf d, a base point plus a direction times a parameter.
permutation matrix
Read the section →The identity matrix with its rows reordered; used to record row swaps.
pivot
Read the section →A row's leading (first nonzero) entry, reading left to right.
pivot column
Read the section →A column of row echelon form that contains a leading entry.
projection onto a vector
Read the section →The shadow of \mathbf u cast onto the line through \mathbf v.
QR factorization
Read the section →A = QR — orthonormal columns (Q) times an upper-triangular record of Gram-Schmidt (R).
R-squared
Read the section →The fraction of a dataset's total variation a least-squares fit explains.
rank
Read the section →\operatorname{rank}(A) — the shared dimension of the row space and column space.
reduced row echelon form
Read the section →Row echelon form with every pivot equal to 1 and cleared above as well as below.
residual vector
Read the section →\mathbf r = \mathbf b - A\mathbf x — the gap between actual and predicted output.
row echelon form
Read the section →A staircase shape: leading entries march right going down, zero rows at the bottom.
row equivalent
Read the section →Two matrices reachable from each other by elementary row operations.
row space
Read the section →\operatorname{Row}(A) — the span of a matrix's rows.
scalar multiplication
Read the section →Rescaling every entry of a vector by the same number.
similar matrices
Read the section →Square matrices A,B with B = P^{-1}AP for some invertible P.
singular
Read the section →A square matrix with no inverse.
solution set
Read the section →Every tuple that satisfies an equation or system — a point, line, plane, or more.
span
Read the section →The set of every linear combination of a given collection of vectors.
standard matrix
Read the section →The matrix A with T(\mathbf x) = A\mathbf x, columns T(\mathbf e_i).
subspace
Read the section →A subset of a vector space that is itself a complete vector space.
symmetric matrix
Read the section →A square matrix equal to its own transpose, A = A^{\mathsf T}.
trace
Read the section →\operatorname{tr}(A) — the sum of a matrix's diagonal entries; also equal to the sum of its eigenvalues.
transition matrix
Read the section →P — a column-stochastic matrix whose (i,j) entry is the probability of moving from state j to state i.
transpose
Read the section →A^{\mathsf T} — rows of A rewritten as columns.
triangular matrix
Read the section →Upper triangular: zero below the diagonal. Lower triangular: zero above.
trivial solution
Read the section →\mathbf x = \mathbf 0 — the solution every homogeneous system always has.
unit vector
Read the section →A vector of length exactly 1, pure direction with no length attached.
vector
Read the section →An ordered list of numbers, viewable as an arrow, a list, or a point.
vector addition
Read the section →Adding two vectors component by component.
vector space
Read the section →A set with addition and scalar multiplication obeying ten algebraic axioms.
zero vector
Read the section →The vector \mathbf{0} whose every entry is 0; the additive identity.