Street Cat Photo Booth: ISEA2016 Work-in-Progress
•Download as PPTX, PDF•
2 likes•265 views
The document describes a photo booth that uses machine learning to automatically detect and upload photos of cats to Instagram. An IR sensor triggers the camera to take photos at 5 second intervals. The photos are then analyzed using a histogram of oriented gradients (HOG) algorithm and support vector machine (SVM) to identify any cat faces. Photos containing detected cat faces are uploaded to Instagram tagged with relevant hashtags. The goal is to create a disembodied art practice that photographs street cats without human intervention. It provides details on the technical setup and machine learning methods used as well as information on upcoming demonstrations of the photo booth.
Recommended
Recommended
More Related Content
Recently uploaded
Recently uploaded (20)
Featured
Featured (20)
Street Cat Photo Booth: ISEA2016 Work-in-Progress
- 1. Street Cat Photo Booth Machine Learning, Disembodied Practice, & Curious Cats Leigh M. Smith, leighsmith.com, LANDR Jordan Matthew Yerman, The Street Cat Project
- 5. + = ?
- 12. Automation: ● Raspberry Pi 2 + Camera + IR. ● IR Sensor controls image capture. ● 5 sec. sample interval. ● Images are queued for eval. ● Accepted images uploaded to Instagram. ● Web server displays progress and sets # tags. ● TODO: Robust Geotagging.
- 15. ● Uses a sliding window over the captured image. ● Histogram of Oriented Gradients (HOG) forms the low- level features. ● Gradients fed into a Support Vector Machine (SVM) machine learning algorithm. ● Binary classify combinations of gradients → detector. ● Identifies the number of faces in each image. ● Must be trained on a dataset of images that have cat faces at similar image distance to the booth. ● Trained 272, tested 1407 images, recall = 0.504. Cat Face Recognition: “Why must I feel like that? Why must I map the cat? Nothin’ but the HOG in me!” (apologies to George Clinton)
- 16. Street Cat Photo Booth: #CatWalks ISEA 2016 香港 #CatWalk: 19th May, 9am Alleyway Entrance: Nanking St at Reclamation St (MTR: Jordan) Map: search Twitter, Facebook for #ISEA2016 #CatWalk Tokyo 東京 2016 #CatWalk: Higashi-Ikebukuro Central Park (Metro: Higashi-Ikebukuro) May 26, early afternoon TBD
- 17. Instagram: @streetcatphotobooth Facebook: The Street Cat Project LeighSmith.com JordanMatthewYerman.com #ISEA2016 #猫
Editor's Notes
- This is Street Cat Photo Booth. It’s exactly what you think it is. We’re Leigh and Jordan.
- The Street Cat project: What it is and why I do it.
- 5,000 images in five different countries. Cats of all kinds, in various states of health. (Setup for when we talk about the machine-learning library)
- Embodied practice requires care and patience. “This is hard. Can’t these cats just… photograph themselves?”
- Idea born at ISEA2015. What would a street cat photo booth look like? How would it behave? Use what we have, but in new ways.
- Architectural echo: Tokyo’s tight, rectangular studio apartments.
- Architectural echo: Reykjavik’s bright exteriors and long periods of darkness.
- Architectural echo: Hong Kong density and tiny dwelling-spaces.
- The Raspberry Pi brain and eye of Street Cat Photo Booth.
- First day of testing: Brooklyn. Proving that street cats will explore newly-introduced spaces.
- Instagram result: What’s often considered a pest is now seen as a being of beauty and dignity. You want to meet this animal.
- The bare essentials. Test environment sans cat.
- The wide range of images informs the AI. Since some cats are missing ears, eyes, noses, etc, we accommodated for that in its training.
- Bounding boxes: Different faces, different behaviors. While Leigh did the heavy lifting on building the AI and its learning environment, Jordan drew lots of boxes around lots of cat faces!
- “Nothin’ but the HOG in me!”
- Where and when to find us! (To be updated when we find out when the f*ck we’re presenting…)
- Keep an eye on our Instagram presence for local demonstrations!