Centralized computing involves all processing occurring on a mainframe computer, with terminals only functioning as input/output devices. Distributed computing emerged with personal computers, allowing independent processing on each PC and networks enabling data and resource sharing between computers. Collaborative computing builds on distributed computing by enabling computers to share processing power in addition to data through running programs on multiple computers simultaneously over a network.