The document discusses the need for memory hierarchy in computers. It explains that main memory communicates directly with the CPU, while auxiliary memory devices like magnetic tapes and disks provide backup storage. The overall goal of the memory hierarchy is to obtain the highest average access speed while minimizing total memory system costs. It achieves this through a hierarchy from slow but high-capacity auxiliary devices to faster main memory to an even smaller and faster cache memory.