Definition
Definition 1.
A system of vectors , where is a vector space, is called a basis of if any can be uniquely expressed as a linear combination of the system.
Note
Given a vector space and a set of basis vectors, any vector in is uniquely determined by the coefficients in its decomposition in terms of the basis vectors. So, we can stack the coefficients in a column and operate on them like we do with elements of . This allows us to translate any statement about vectors in to a vector space with a given basis.
Building up to a basis
The existence and uniqueness of linear combinations requirements of bases can be analyzed separately.
Spanning systems
Definition 2.
A system of vectors is called a spanning (aka complete, generating) system in if any vector admits a representation as a linear combination of the vectors.
This differs from a basis in that it does not require the representations to be unique.
Linearly independent systems
Definition 3.
A system of vectors is called linearly independent iff the equation (with unknowns ) has only trivial solution.
By definition, a basis is a linearly independent system.
A system of vectors is called linearly dependent if can be expressed as a non-trivial linear combination of the vectors.
New, equivalent definition of basis
It is clear from the definition of a basis that a basis is both spanning and linearly independent. It can also be proved (LADW, p10) that if a set is spanning and linearly independent, it is a basis. Thus, A system of vectors is a basis if and only if it is a spanning system and linearly independent.
Any (finite) generating system contains a basis.
Suppose is a generating set. If it is linearly independent, we are done. If not, then there exists a vector which can be expressed as a linear combination of the vectors . So, any linear combination of the vectors can be represented as a linear combination of the same vectors without (just replace with its expression as a linear combination of the other vectors). Thus, can be removed from the set while retaining the spanning property of the set. If we keep repeatedly removing such vectors from the set, we must end up with a basis (we cannot reach the null set as we are preserving completeness on every removal).
Standard basis in