The median is the middle value in a data set arranged in numerical order. It represents the center of the data and is less affected by outliers than the mean. To calculate the median, the data is lined up from highest to lowest and the middle value is identified. For an even number of values, the median is the average of the two middle values. The document provides an example of how outliers can significantly impact the mean but not the median of a classroom test score data set.