Many calculations involve solving systems of linear equations. In many cases, you will find it convenient to write down the equations explicitly, and then solve them using Solve.
In some cases, however, you may prefer to convert the system of linear equations into a matrix equation, and then apply matrix manipulation operations to solve it. This approach is often useful when the system of equations arises as part of a general algorithm, and you do not know in advance how many variables will be involved.
A system of linear equations can be stated in matrix form as m.x = b, where x is the vector of variables.
Note that if your system of equations is sparse, so that most of the entries in the matrix m are zero, then it is best to represent the matrix as a SparseArray object. As discussed in "Sparse Arrays: Linear Algebra", you can convert from symbolic equations to SparseArray objects using CoefficientArrays. All the functions described here work on SparseArray objects as well as ordinary matrices.
LinearSolve @m,bD a vector x which solves the matrix equation m.x == b NullSpace@mD a list of linearly independent vectors whose linear
combina-tions span all solucombina-tions to the matrix equation m.x == 0 MatrixRank@mD the number of linearly independent rows or columns of m RowReduce@mD a simplified form of m obtained by making linear
combina-tions of rows Solving and analyzing linear systems.
Here is a 2x2 matrix.
Here is a 2x2 matrix.
In[1]:= m = 881, 5<, 82, 1<<
Out[1]= 881, 5<, 82, 1<<
This gives two linear equations.
In[2]:= m.8x, y< == 8a, b<
Out[2]= 8x + 5 y, 2 x + y< ã 8a, b<
You can use Solve directly to solve these equations.
In[3]:= Solve@%, 8x, y<D
You can also get the vector of solutions by calling LinearSolve. The result is equivalent to the one you get from Solve.
In[4]:= LinearSolve@m, 8a, b<D
Out[4]= :1
9H-a + 5 bL, 1
9H2 a - bL>
Another way to solve the equations is to invert the matrix m, and then multiply 8a, b< by the inverse. This is not as efficient as using LinearSolve.
In[5]:= [email protected], b<
RowReduce performs a version of Gaussian elimination and can also be used to solve the equations.
In[6]:= RowReduce@881, 5, a<, 82, 1, b<<D
Out[6]= ::1, 0, 1
9H-a + 5 bL>, :0, 1, 1
9H2 a - bL>>
If you have a square matrix m with a nonzero determinant, then you can always find a unique solution to the matrix equation m.x = b for any b. If, however, the matrix m has determinant zero, then there may be either no vector, or an infinite number of vectors x which satisfy m.x = b for a particular b. This occurs when the linear equations embodied in m are not independent.
When m has determinant zero, it is nevertheless always possible to find nonzero vectors x that satisfy m.x = 0. The set of vectors x satisfying this equation form the null space or kernel of the matrix m. Any of these vectors can be expressed as a linear combination of a particular set of basis vectors, which can be obtained using NullSpace@mD.
When m has determinant zero, it is nevertheless always possible to find nonzero vectors x that satisfy m.x = 0. The set of vectors x satisfying this equation form the null space or kernel of the matrix m. Any of these vectors can be expressed as a linear combination of a particular set of basis vectors, which can be obtained using NullSpace@mD.
Here is a simple matrix, corresponding to two identical linear equations.
In[7]:= m = 881, 2<, 81, 2<<
Out[7]= 881, 2<, 81, 2<<
The matrix has determinant zero.
In[8]:= Det@mD
Out[8]= 0
LinearSolve cannot find a solution to the equation m.x ã b in this case.
In[9]:= LinearSolve@m, 8a, b<D
LinearSolve::nosol : Linear equation encountered that has no solution.à Out[9]= LinearSolve@881, 2<, 81, 2<<, 8a, b<D
There is a single basis vector for the null space of m.
In[10]:= NullSpace@mD
Out[10]= 88-2, 1<<
Multiplying the basis vector for the null space by m gives the zero vector.
In[11]:= m.%@@1DD
Out[11]= 80, 0<
There is only 1 linearly independent row in m.
In[12]:= MatrixRank@mD
Out[12]= 1
NullSpace and MatrixRank have to determine whether particular combinations of matrix elements are zero. For approximate numerical matrices, the Tolerance option can be used to specify how close to zero is considered good enough. For exact symbolic matrices, you may sometimes need to specify something like ZeroTest -> HFullSimplify@ÒD == 0 &L to force more to be done to test whether symbolic expressions are zero.
Here is a simple symbolic matrix with determinant zero.
Here is a simple symbolic matrix with determinant zero.
In[13]:= m = 88a, b, c<, 82 a, 2 b, 2 c<, 83 a, 3 b, 3 c<<
Out[13]= 88a, b, c<, 82 a, 2 b, 2 c<, 83 a, 3 b, 3 c<<
The basis for the null space of m contains two vectors.
In[14]:= NullSpace@mD
Out[14]= ::-c a
, 0, 1>, :-b a
, 1, 0>>
Multiplying m by any linear combination of these vectors gives zero.
In[15]:= [email protected] %@@1DD + y %@@2DDLD
Out[15]= 80, 0, 0<
An important feature of functions like LinearSolve and NullSpace is that they work with rectangular, as well as square, matrices.
When you represent a system of linear equations by a matrix equation of the form m.x = b, the number of columns in m gives the number of variables, and the number of rows gives the num-ber of equations. There are a numnum-ber of cases.
Underdetermined number of equations less than the number of variables; no solutions or many solutions may exist
Overdetermined number of equations more than the number of variables;
solutions may or may not exist
Nonsingular number of independent equations equal to the number of variables, and determinant nonzero; a unique solution exists
Consistent at least one solution exists
Inconsistent no solutions exist
Classes of linear systems represented by rectangular matrices.
This asks for the solution to the inconsistent set of equations x = 1 and x = 0.
In[16]:= LinearSolve@881<, 81<<, 81, 0<D
LinearSolve::nosol : Linear equation encountered that has no solution.à Out[16]= LinearSolve@881<, 81<<, 81, 0<D
This matrix represents two equations, for three variables.
In[17]:= m = 881, 3, 4<, 82, 1, 3<<
Out[17]= 881, 3, 4<, 82, 1, 3<<
LinearSolve gives one of the possible solutions to this underdetermined set of equations.
In[18]:= v = LinearSolve@m, 81, 1<D
Out[18]= :2 5
, 1 5
, 0>
When a matrix represents an underdetermined system of equations, the matrix has a nontrivial null space. In this case, the null space is spanned by a single vector.
In[19]:= NullSpace@mD
Out[19]= 88-1, -1, 1<<
If you take the solution you get from LinearSolve, and add any linear combination of the basis vectors for the null space, you still get a solution.
In[20]:= m.Hv + 4 %@@1DDL
Out[20]= 81, 1<
The number of independent equations is the rank of the matrix MatrixRank@mD. The number of redundant equations is Length@NullSpace@mDD. Note that the sum of these quantities is always equal to the number of columns in m.
LinearSolve @mD generate a function for solving equations of the form m.x = b Generating LinearSolveFunction objects.
In some applications, you will want to solve equations of the form m.x = b many times with the same m, but different b. You can do this efficiently in Mathematica by using LinearSolve@mD to create a single LinearSolveFunction that you can apply to as many vectors as you want.
This creates a LinearSolveFunction.
In[21]:= f = LinearSolve@881, 4<, 82, 3<<D
Out[21]= LinearSolveFunction@82, 2<, <>D
You can apply this to a vector.
You get the same result by giving the vector as an explicit second argument to LinearSolve.
In[23]:= LinearSolve@881, 4<, 82, 3<<, 85, 7<D
Out[23]= :13
LeastSquares@m,bD give a vector x that solves the least-squares problem m.x == b
Solving least-squares problems.
This linear system is inconsistent.
In[25]:= LinearSolve@881, 2<, 83, 4<, 85, 6<<, 8- 1, 0, 2<D
LinearSolve::nosol : Linear equation encountered that has no solution.à Out[25]= LinearSolve@881, 2<, 83, 4<, 85, 6<<, 8-1, 0, 2<D
LeastSquares finds a vector x that minimizes m.x - b in the least-squares sense.
In[26]:= LeastSquares@881, 2<, 83, 4<, 85, 6<<, 8- 1, 0, 2<D
Out[26]= :8
Eigenvalues @mD a list of the eigenvalues of m Eigenvectors@mD a list of the eigenvectors of m