Recommended
Recommended
More Related Content
Viewers also liked
Viewers also liked (20)
Similar to What convnets look at when they look at nudity
Similar to What convnets look at when they look at nudity (20)
Recently uploaded
Recently uploaded (20)
What convnets look at when they look at nudity
- 1. What convnets look at when they look at nudity Ryan Compton ryan@clarifai.com
- 2. Disclaimer Please be advised that this presentation may contain content which some viewers may find offensive.
- 3. Disclaimer Please be advised that this presentation may contain content which some viewers may find offensive.
- 4. API Demo
- 5. 1996
- 12. Eventually someone will get real good at feature engineering and the problem will be solved, right?
- 15. SFW training data Learned low-dimensional representations are rich in semantic information
- 17. But How?
- 20. convnet Demo network for this talk (modified ZF net): 5 convolutional layers 3 fully-connected layers 2 softmax outputs (‘sfw’ and ‘nsfw’)
- 21. Train Test
- 23. Train Test Deploy to prod and everything breaks
- 24. And how does it do that?
- 28. Deconvolutional Networks • Provides way to map activations at high layers back to the input • Same operations as Convnet, but in reverse: – Unpool feature maps – Convolve unpooled maps • Filters copied from Convnet – Used here purely as a probe – Originally proposed as unsupervised learning method – No inference, no learning Input Image Convolution (learned) Unpooling Feature maps Non-linearity [Zeiler et al. CVPR’10, ICCV’11]
- 30. Wavelets, curvelets, framelets, shapelets, shearlets...
- 31. Reversible Max Pooling Pooled Feature Maps Max Locations “Switches” Pooling Unpooling Feature Map Reconstructed Feature Map
- 33. 2014
- 34. First Layer Image from Zeiler, Matthew D., and Rob Fergus. "Visualizing and understanding convolutional networks." European Conference on Computer Vision. Springer International Publishing, 2014.
- 35. Second Layer
- 36. Third Layer
- 37. Fourth Layer
- 38. Fifth Layer
- 39. conv1
- 40. conv2
- 41. conv3
- 42. conv4
- 43. conv5
- 44. fc8
- 45. https://en.wikipedia.org/wiki/Lenna Lenna or Lena is the name given to a standard test image widely used in the field of image processing since 1973.[1] It is a picture of Lena Söderberg, shot by photographer Dwight Hooker, cropped from the centerfold of the November 1972 issue of Playboy magazine.
- 46. fc8
- 47. fc8
- 48. fc8
- 49. fc8
- 50. fc8
- 52. Oh and safe stuff too...
- 54. The Future...
- 55. Context matters
- 56. Context matters
- 57. Context matters
- 58. Context matters
- 61. Data and Research Data Science ● Collect data ● Improve Models Research ● Solve problems we don’t have solutions for today
- 62. What about data? Datasets ● 100+ datasets ● Almost every vertical where there are images and videos Data ● 1B+ labelled images ● 1M+ labelled videos
- 63. The Data / Research Team You clarifai.com/jobs
- 64. Some common questions: What about publishing? Can I work remotely?
- 65. Research Collaborations: How to Apply? Where: research@clarifai.com What: ● Name ● School ● Year in Program ● Professor ● Current Focus + Future Interests ● Resume When: Accepting Applications Now!