kidzsearch.com > wiki Explore:web images videos games
System of linear equations
In mathematics, a system of linear equations (or linear system) is a collection of linear equations involving the same set of variables.
Contents
Description
Mathematicians show the relationship between different factors in the form of equations. "Linear equations" mean the variable appears only once in each equation without being raised to a power. A "system" of linear equations means that all of the equations are true at the same time. So, the person solving the system of equations is looking for the values of each variable that will make all of the equations true at the same time. If no such values can satisfy all of the equations in the system, then the equations are called "inconsistent."
For example,
 [math]\begin{alignat}{7} 3x &&\; + \;&& 2y &&\;  \;&& z &&\; = \;&& 1 & \\ 2x &&\;  \;&& 2y &&\; + \;&& 4z &&\; = \;&& 2 & \\ x &&\; + \;&& \tfrac{1}{2} y &&\;  \;&& z &&\; = \;&& 0 & \end{alignat}[/math]
is a system of three equations in the three variables [math]x[/math], [math]y[/math], [math]z[/math]. A "solution" to a linear system is an assignment of numbers to the variables such that all the equations are simultaneously satisfied. A solution to the system above is given by
 [math]\begin{alignat}{2} x & = & 1 \\ y & = & 2 \\ z & = & 2 \end{alignat}[/math]
since it makes all three equations valid:^{[1]}
 [math]\begin{alignat}{7} 3(1) &&\; + \;&& 2(2) &&\;  \;&& (2) &&\; = \;&& 1 & \\ 2(1) &&\;  \;&& 2(2) &&\; + \;&& 4(2) &&\; = \;&& 2 & \\ (1) &&\; + \;&& \tfrac{1}{2} (2) &&\;  \;&& (2) &&\; = \;&& 0 & \end{alignat}[/math]
In mathematics, the theory of linear systems is a branch of linear algebra, a subject which is fundamental to modern mathematics. Computer algorithms for finding the solutions are an important part of numerical linear algebra, and such methods play a prominent role in engineering, physics, chemistry, computer science, and economics. A system of nonlinear equations can often be approximated by a linear system (see linearization), a helpful technique when making a mathematical model, computer model, or computer simulation of a relatively complex system. For complex systems, there are many equations and many variables, not just two or three. In many cases, the number of equations and variables in the system are the same. In some cases, there are more variables than equations, and the solution will be a range of different values rather than one exact solution.
Simple example
The simplest kind of linear system involves two equations and two variables:
 [math]\begin{alignat}{5} 2x &&\; + \;&& 3y &&\; = \;&& 6 & \\ 4x &&\; + \;&& 9y &&\; = \;&& 15&. \end{alignat}[/math]
One method for solving such a system is as follows. First, solve the top equation for [math]x[/math] in terms of [math]y[/math]:
 [math]x = 3  \frac{3}{2}y.[/math]
Now substitute this expression for x into the bottom equation:
 [math]4\left( 3  \frac{3}{2}y \right) + 9y = 15.[/math]
This results in a single equation involving only the variable [math]y[/math]. Solving gives [math]y = 1[/math], and substituting this back into the equation for [math]x[/math] yields [math]x = 3/2[/math]:
 [math]\begin{alignat}{5} 2\left(\frac{3}{2}\right) &&\; + \;&& 3(1) &&\; = \;&& 6 & \\ 4\left(\frac{3}{2}\right) &&\; + \;&& 9(1) &&\; = \;&& 15&. \end{alignat}[/math]
This method generalizes to systems with additional variables.
Using Matrices
Very often, all the coefficients are written in the form of a matrix A, which is called a coefficient matrix.
 [math]A = \begin{bmatrix} a_{11} & a_{12} & \cdots & a_{1n}\\ a_{21} & a_{22} & \cdots & a_{2n}\\ \vdots & \vdots & \ddots & \vdots\\ a_{m1} & a_{m2} & \cdots & a_{mn} \end{bmatrix}[/math]
In much the same way, the variables can be written in the form of a vector:
 [math]x = \begin{bmatrix} x_1\\ x_2 \\ \vdots \\ x_n\end{bmatrix};\qquad b = \begin{bmatrix} b_1\\ b_2 \\ \vdots \\ b_m\end{bmatrix} [/math].
This makes it possible to write
 [math]A \cdot x = b[/math].
Mathematically, the vector defined above is a 1byn matrix. The system of equations can then be solved using the multiplication operation defined on matrices. A, x and b are all part of the same algebraic field.
Solving a system of linear equations
There a three cases when looking for solutions to a system of linear equations:
 There is no solution
 There is exactly one solution
 There are many solutions; the exact number depends on the properties of the field. In many cases there will be an infinite number of solutions.
There are two categories of methods for solving a system of linear equations. Iterative methods use many steps to get a solution, direct methods only need one step:
 An example for a direct method is to solve the system for one variable; this variable can be eliminated and replaced by an expression that only uses other variables, or a number. Doing this for all variables of the equation will lead to a solution of the system if it exists.
 Another method is to transform two equations so that one of the sides of the equations is the same in both cases; it is then possible to write another equation, which replaces the two equations and reduces the number of equations by one.
 Gaussian elimination
 QR decomposition
 Cholesky decomposition
 Cramer's rule
Examples for iterative methods are:
 Relaxation, including the GaussSeidel and Jacobi methods
 Multigrid method
 Krylow method
There are examples such as geodesy where there many more measurements than unknowns. Such a system is almost always overdetermined and has no exact solution. Each measurement is usually inaccurate and includes some amount of error. Since the measurements are not exact, it is not possible to obtain an exact solution to the system of linear equations; methods such as Least squares can be used to compute a solution that best fits the overdetermined system. This least squares solution can often be used as a standin for an exact solution.
Solving a system of linear equations has a complexity of at most O (n^{3}). At least n^{2} operations are needed to solve a general system of n linear equations. The best algorithm known to date was developed by Don Coppersmith and Shmuel Winograd and dates from 1990. It has a complexity of n^{2.376}^{[2]} Unfortunately, it is of little practical use.
Uses
Using computers to solve systems of linear equations is used every day. For example, it is used in weather forecasting models. Hot dog factories use it to make small changes in the receipe as food ingredient prices change. College cafeterias use it to figure out how much food to cook based on past experience when the cafeteria gives students the choice between multiple entrees.
References
 ↑ Linear algebra, as discussed in this article, is a very wellestablished mathematical discipline for which there are many sources. Almost all of the material in this article can be found in Lay 2005, Meyer 2001, and Strang 2005.
 ↑ Gene Golub, Charles Van Loan: Matrix Computations, Johns Hopkins University Press, 3rd edition, 1996; ISBN 9780801854149
Textbooks
 Axler, Sheldon Jay (1997), Linear Algebra Done Right (2nd ed.), SpringerVerlag,
 Lay, David C. (August 22, 2005), Linear Algebra and Its Applications (3rd ed.), Addison Wesley,
 Meyer, Carl D. (February 15, 2001), Matrix Analysis and Applied Linear Algebra, Society for Industrial and Applied Mathematics (SIAM),
, http://www.matrixanalysis.com/DownloadChapters.html
 Poole, David (2006), Linear Algebra: A Modern Introduction (2nd ed.), Brooks/Cole,
 Anton, Howard (2005), Elementary Linear Algebra (Applications Version) (9th ed.), Wiley International
 Leon, Steven J. (2006), Linear Algebra With Applications (7th ed.), Pearson Prentice Hall
 Strang, Gilbert (2005), Linear Algebra and Its Applications
Other websites
 WebApp descriptively solving systems of linear equations with a number of methods
 Solving system linear equations online matrix calculator and tutorial.
 Online Equations Solver
 Online linear solver
 Online Calculator of System of linear equations
Related pages
