Heuristic search refers to problem-solving techniques that employ a rule of thumb approach rather than exhaustive search. It can be implemented using trial and error or thumb rules to find feasible solutions. Examples of heuristic search algorithms include hill climbing, which uses mathematical optimization for local search, and best-first search, which explores graphs by expanding the most feasible nodes according to specific norms.