The CPU contains the control unit which directs the computer using electrical signals to execute stored program instructions. It communicates with the ALU and memory. The CPU follows an execution cycle of fetching instructions from memory using the program counter and address bus, decoding and executing the instructions using registers like the accumulator and instruction register, and storing the output.