This book provides a solid foundation for the theory dealing with finite dimensional vector spaces. It explains in details the relation between linear transformations and matrices. One may thus use different viewpoints to manipulate a matrix instead of a one-sided approach. Although most of the examples are for real and complex matrices, a vector space over a general field is briefly discussed. Several optional sections are devoted to applications to demonstrate the power of Linear Algebra.