Matrices are two-dimensional arrangements of numbers organized into rows and columns. They have many applications, including in physics for calculations involving electrical circuits, in computer science for image projections and encryption, and in other fields like geology, economics, robotics, and representing population data. Methods for working with matrices include adding, subtracting, multiplying matrices by scalars or other matrices, taking the negative or inverse, and transposing rows and columns. Matrix multiplication is not commutative and order matters.