Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Computer Vision as Art Historical Investigation

314 views

Published on

Paper: The Place of Discovery Symposium, University Wisconsin-Madison 2015

Published in: Art & Photos
  • Be the first to comment

  • Be the first to like this

Computer Vision as Art Historical Investigation

  1. 1. PAPER: THE PLACE OF DISCOVERY
 a symposium in honor of James Watrous
  2. 2. Computer Vision as Art Historical Investigation John Resig Chazen Museum: 1980.2386
  3. 3. Chazen Museum 1980.2569
  4. 4. Chazen Museum 1980.667
  5. 5. Chazen Museum 1980.2573
  6. 6. Chazen Museum 1980.2682
  7. 7. Chazen Museum 1980.641
  8. 8. Chazen Museum 1980.612
  9. 9. Chazen Museum 1980.613
  10. 10. Chazen Museum 1984.877
  11. 11. Chazen Museum 1980.1983
  12. 12. Chazen Museum 1980.2650
  13. 13. Chazen Museum 1980.2376
  14. 14. Chazen Museum 1980.2204a-c
  15. 15. Chazen Museum 1980.2204a-c
  16. 16. Chazen Museum 1980.2204a-c
  17. 17. How do you learn more?
  18. 18. Step 1: Acquire and read tons of expensive books.
  19. 19. Step 2: Learn to read Japanese. * Japanese from the 17th to 19th century. * You’re not going to learn this from Rosetta Stone.
  20. 20. Step 3: Look at lots and lots of prints. (virtually and in person)
  21. 21. Solution: A fast-loading, responsive, international, web site: ukiyo-e.org
  22. 22. Image Similarity
  23. 23. https://services.tineye.com/MatchEngine
  24. 24. http://pastec.io/
  25. 25. Image Similarity Search
  26. 26. Idyll: Offline Image Cropping • Crop and annotate images offline and on a mobile device. • Saves the selections back to a server.
  27. 27. http://www.ersatzlabs.com/
  28. 28. Aiding Woodblock Print Studies with Image Analysis
  29. 29. What about other art forms?
  30. 30. Yes! But works best with “multiples” (this can include photographs!)
  31. 31. Sources of “multiples” • Collaborating with the Frick Art Reference Library • Analyzing their Anonymous Italian Art Photo Archive • Also working with the Zeri Foundation at the University of Bologna in Italy • Analyzing their Italian Art Archives
  32. 32. Similar Images Different photo, same work of art.
  33. 33. Similar Images Different photo, slightly different cropping.
  34. 34. Similar Images Different photo, dramatically different lighting.
  35. 35. Alternate Images Partial Image vs. Full Image
  36. 36. Alternate Images Color vs. Black-and-White
  37. 37. Alternate Images Partial Image vs. Much Larger Image
  38. 38. Conservation
  39. 39. Conservation Repairs and possibly removal of later additions.
  40. 40. Conservation Analysis even spots dramatic conservation work.
  41. 41. Copies
  42. 42. Copies
  43. 43. Copies
  44. 44. Copies
  45. 45. Graph Analysis and
 Merging Collections
  46. 46. Frick 420 420 Zeri 1583642090 Frick 417 417 ?
  47. 47. 8132a 8132 57129 57134 57130 57138 8131a 8131 ?
  48. 48. PHAROS: An International Consortium of Photo Archives • Bibliotheca Hertziana, Rome (1,065,000) • Bildarchiv Foto Marburg, Germany (2,000,000) • Courtauld Institute of Art, London (4,173,500) • Fondazione Federico Zeri, Bologna (290,000) • Frick Art Reference Library, New York (1,346,000) • Getty Research Institute, Los Angeles (2,086,000) • Villa I Tatti, Florence (239,000) • Institut National d’Histoire de l’Art, Paris (750,000) • Kunsthistorisches Institut, Florence (650,000) • National Gallery of Art, Washington (7,600,000) • Paul Mellon Centre, London (185,000) • Rijksbureau voor Kunsthistorische Documentatie, The Hague (7,000,000) • Warburg Institute, London (3,500,000) • Yale Center for British Art, New Haven (132,000)
  49. 49. PHAROS Images: Coming June 2016
  50. 50. • http://ejohn.org/research/ • http://ukiyo-e.org/ • https://github.com/jeresig

×