Edward L. Thorndike's experiment with a hungry cat in a puzzle box demonstrated learning through trial and error, where the cat learned to escape more efficiently with repeated attempts. He proposed key principles of learning, including the formation of connections between stimuli and responses, the incremental nature of learning, and the directness of this process without mediation by complex mental functions. Thorndike's work laid the foundation for connectionism and educational psychology.