Distributed computing is a model where independent computers work together to act as a single system, improving performance through task-sharing across a network. It includes various architectures such as client-server and peer-to-peer and offers advantages like reliability, scalability, and high performance. The system allows for efficient communication between components and supports flexibility in installing and debugging services.