Graphs can represent relationships between objects. The historical problem that inspired graphs was finding a route to cross all 7 bridges in Konigsberg, Poland without crossing any bridge twice. Graphs use nodes to represent objects and edges to represent relationships between nodes, allowing problems like routes to be modeled mathematically.