Search engines use web crawlers or directories to index websites and provide relevant search results. The first search engine was Archie in 1989, while popular modern engines include Google, founded in 1998, and Yahoo, founded in 1995. Search engines use different techniques like crawlers to build databases of webpages or directories of manually organized sites. They aim to efficiently return pertinent information to users from the massive web.