Matrices are arrays of numbers arranged in rows and columns. They are enclosed in brackets and referenced by letters. The order or size of a matrix is denoted by the number of rows and columns, such as a 3x4 matrix. There are several types of matrices including column matrices, row matrices, square matrices, and identity matrices. Matrices can be added, subtracted, or multiplied through scalar or element-wise operations depending on their size and type. Matrix multiplication involves multiplying the rows of the first matrix by the columns of the second.