Horace Secrist defines statistics as a set of essential characteristics that numerical data must possess to be classified as statistics, including being an aggregate of facts, affected by multiple causes, and numerically expressed. Statistics must be systematically collected for a predetermined purpose and can be compared to provide meaningful insights. These characteristics emphasize that individual figures alone are not statistics; rather, it is the relationship and context of the aggregated data that holds significance.