How To Implement CapsNets using TensorFlow
•
8 likes•1,515 views
This presentation will show you how to implement a Capsule Network in TensorFlow. You will learn more about CapsNets, as well as tips & tricks on using TensorFlow more efficiently. Hope you like it!
Recommended
More Related Content
Recently uploaded
Recently uploaded (20)
Featured
Featured (20)
How To Implement CapsNets using TensorFlow
- 1. Implementing CapsNets with TensorFlow Aurélien Géron, November 2017
- 2. Aurélien Géron, 2017NIPS 2017 Paper
- 3. Aurélien Géron, 2017Jupyter Notebook
- 4. Aurélien Géron, 2017Jupyter Notebook
- 5. Aurélien Géron, 2017Input Layer
- 6. Aurélien Géron, 2017Input Layer Input Images
- 7. Aurélien Géron, 2017Input Layer Input Images
- 8. Aurélien Géron, 2017Input Layer Input Images
- 9. Aurélien Géron, 2017Primary Capsules Input Images Primary Capsules
- 10. Aurélien Géron, 2017Primary Capsules Input Images Primary Capsules 32
- 11. Aurélien Géron, 2017Primary Capsules Input Images Primary Capsules
- 12. Aurélien Géron, 2017Primary Capsules Input Images Primary Capsules
- 13. Aurélien Géron, 2017Primary Capsules Input Images Primary Capsules
- 14. Aurélien Géron, 2017Primary Capsules Input Images Primary Capsules
- 15. Aurélien Géron, 2017Primary Capsules Input Images Primary Capsules
- 16. Aurélien Géron, 2017Primary Capsules Input Images Primary Capsules
- 17. Aurélien Géron, 2017Primary Capsules Input Images Primary Capsules
- 18. Aurélien Géron, 2017Primary Capsules Input Images Primary Capsules
- 19. Aurélien Géron, 2017Digit Capsules Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1
- 20. Aurélien Géron, 2017Digit Capsules Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1
- 21. Aurélien Géron, 2017Digit Capsules > Predict Outputs Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1
- 22. Aurélien Géron, 2017Digit Capsules > Predict Outputs Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1
- 23. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 24. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 25. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 26. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 27. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 28. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 29. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 30. Aurélien Géron, 2017Digit Capsules > Predict Outputs
- 31. Aurélien Géron, 2017Digit Capsules > Predict Outputs
- 32. Aurélien Géron, 2017Digit Capsules > Predict Outputs 10
- 33. Aurélien Géron, 2017Digit Capsules > Predict Outputs =
- 34. Aurélien Géron, 2017Digit Capsules > Predict Outputs = Batch size
- 35. Aurélien Géron, 2017Digit Capsules > Predict Outputs
- 36. Aurélien Géron, 2017Digit Capsules > Predict Outputs
- 37. Aurélien Géron, 2017Digit Capsules > Predict Outputs (?, 1152, 8) Shape
- 38. Aurélien Géron, 2017Digit Capsules > Predict Outputs (?, 1152, 8) (?, 1152, 8, 1)
- 39. Aurélien Géron, 2017Digit Capsules > Predict Outputs (?, 1152, 8) (?, 1152, 8, 1) (?, 1152, 1, 8, 1)
- 40. Aurélien Géron, 2017Digit Capsules > Predict Outputs (?, 1152, 8) (?, 1152, 8, 1) (?, 1152, 1, 8, 1) (?, 1152, 10, 8, 1)
- 41. Aurélien Géron, 2017Digit Capsules > Predict Outputs
- 42. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 43. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 44. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 45. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 46. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 48. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 49. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 50. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 51. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 52. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 53. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2 =
- 54. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 55. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 56. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 57. Aurélien Géron, 2017 Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 58. Aurélien Géron, 2017Digit Capsules > Routing by Agreement
- 59. Aurélien Géron, 2017Digit Capsules > Routing by Agreement
- 60. Aurélien Géron, 2017Digit Capsules > Routing by Agreement
- 61. Aurélien Géron, 2017Digit Capsules Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 9 0 18 9
- 62. Aurélien Géron, 2017Estimated Class Probabilities Input Images Primary Capsules Digit Capsules Length 0 1 2 3 4 5 6 7 8 9 0 0 0 0 .7 0 0 .1 0 .2 0 1 0 0 8 9 .3 0
- 63. Aurélien Géron, 2017Predictions Input Images Primary Capsules Digit Capsules Length Predictions 0 1 2 3 4 5 6 7 8 9 0 0 0 0 .7 0 0 .1 0 .2 4 0 1 0 0 8 9 .3 0 3 6
- 64. Aurélien Géron, 2017Predictions Input Images Primary Capsules Digit Capsules Length Predictions 0 1 2 3 4 5 6 7 8 9 0 0 0 0 .7 0 0 .1 0 .2 4 0 1 0 0 8 9 .3 0 3 6
- 65. Aurélien Géron, 2017Predictions Input Images Primary Capsules Digit Capsules Length Predictions 7 3 4 6 7
- 66. Aurélien Géron, 2017Accuracy Input Images Primary Capsules Digit Capsules Length Predictions Labels Accuracy 7 3 4 6 1 7 3 4 6 7 80%
- 67. Aurélien Géron, 2017Accuracy Input Images Primary Capsules Digit Capsules Length Predictions Labels Accuracy 7 3 4 6 1 7 3 4 6 7 80%
- 68. Aurélien Géron, 2017Accuracy Input Images Primary Capsules Digit Capsules Length Predictions Labels Accuracy 7 3 4 6 1 7 3 4 6 7 80%
- 69. Aurélien Géron, 2017Training Input Images Primary Capsules Digit Capsules Length Predictions Labels
- 70. Aurélien Géron, 2017Margin Loss Input Images Primary Capsules Digit Capsules Length Predictions Margin Loss Labels Margin Loss Length
- 71. Aurélien Géron, 2017Margin Loss Input Images Primary Capsules Digit Capsules Length Predictions Margin Loss Labels Margin Loss Length
- 72. Aurélien Géron, 2017Decoder Input Images Primary Capsules Digit Capsules Decoder Margin Loss Labels Length Predictions
- 74. Aurélien Géron, 2017Decoder Input Images Primary Capsules Digit Capsules Decoder Margin Loss Labels Length Predictions
- 75. Aurélien Géron, 2017Reconstruction Loss Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions
- 76. Aurélien Géron, 2017Reconstruction Loss Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions
- 77. Aurélien Géron, 2017Reconstruction Loss Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions
- 78. Aurélien Géron, 2017Final Loss Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss
- 79. Aurélien Géron, 2017Final Loss Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss
- 80. Aurélien Géron, 2017Final Loss Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss
- 81. Aurélien Géron, 2017Training Operation Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation
- 82. Aurélien Géron, 2017Training Operation Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation
- 83. Aurélien Géron, 2017Training Operation Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation
- 84. Aurélien Géron, 2017Mask Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask ×
- 85. Aurélien Géron, 2017Mask Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask ×
- 86. Aurélien Géron, 2017Mask Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask ×
- 87. Aurélien Géron, 2017Mask Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask ×
- 88. Aurélien Géron, 2017Mask Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Length Predictions Loss Training Operation Mask × Mask with Labels Labels
- 89. Aurélien Géron, 2017Mask Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask × Mask with Labels
- 90. Aurélien Géron, 2017Mask Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask × Mask with Labels
- 91. Aurélien Géron, 2017Resolving Dependencies A C D F B E G
- 92. Aurélien Géron, 2017Resolving Dependencies A C D F B E G A.eval()
- 93. Aurélien Géron, 2017Resolving Dependencies A C D F B E G A.eval()
- 94. Aurélien Géron, 2017Resolving Dependencies A C D F B E G A.eval()
- 95. Aurélien Géron, 2017Resolving Dependencies A C D F B E G A.eval()
- 96. Aurélien Géron, 2017Resolving Dependencies A D F B E G A.eval() C
- 97. Aurélien Géron, 2017Resolving Dependencies A C D F B E G A.eval()
- 98. Aurélien Géron, 2017Resolving Dependencies A C D F B E G A.eval()
- 99. Aurélien Géron, 2017Resolving Dependencies A C D F B E G sess.run([A, E])
- 100. Aurélien Géron, 2017Resolving Dependencies A C D F B E G sess.run([A, E])
- 101. Aurélien Géron, 2017Resolving Dependencies A C D F B E G sess.run([A, E])
- 102. Aurélien Géron, 2017Resolving Dependencies A C D F B E G sess.run([A, E])
- 103. Aurélien Géron, 2017Resolving Dependencies A C D F B E G sess.run([A, E])
- 104. Aurélien Géron, 2017Resolving Dependencies A C D F B E G sess.run([A, E])
- 105. Aurélien Géron, 2017Resolving Dependencies A C D F B E G sess.run([A, E])
- 106. Aurélien Géron, 2017Resolving Dependencies A C D F B E sess.run([A, E]) G
- 107. Aurélien Géron, 2017Resolving Dependencies A C D F B E sess.run([A, E]) G
- 108. Aurélien Géron, 2017Resolving Dependencies mask_with_labels reconstruction_targets y y_pred
- 109. Aurélien Géron, 2017Resolving Dependencies mask_with_labels reconstruction_targets y y_pred
- 110. Aurélien Géron, 2017Resolving Dependencies mask_with_labels reconstruction_targets y y_pred
- 111. Aurélien Géron, 2017Resolving Dependencies mask_with_labels reconstruction_targets y y_pred
- 112. Aurélien Géron, 2017Resolving Dependencies mask_with_labels reconstruction_targets y y_pred
- 113. Aurélien Géron, 2017Resolving Dependencies mask_with_labels reconstruction_targets y y_pred
- 114. Aurélien Géron, 2017Resolving Dependencies mask_with_labels reconstruction_targets y y_pred True
- 115. Aurélien Géron, 2017Resolving Dependencies mask_with_labels reconstruction_targets y y_pred True Value of y
- 116. Aurélien Géron, 2017Resolving Dependencies mask_with_labels reconstruction_targets y y_pred True Value of y Evaluated for nothing
- 117. Aurélien Géron, 2017Resolving Dependencies mask_with_labels reconstruction_targets y y_pred False
- 118. Aurélien Géron, 2017Resolving Dependencies mask_with_labels reconstruction_targets y y_pred Value of y_pred False
- 119. Aurélien Géron, 2017Resolving Dependencies mask_with_labels reconstruction_targets y y_pred Value of y_pred Evaluated for nothing and needs to be fed! False
- 120. Aurélien Géron, 2017Mask Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask × Mask with Labels
- 121. Aurélien Géron, 2017Mask Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask × Mask with Labels
- 123. Aurélien Géron, 2017Predictions and Reconstructions
- 124. Aurélien Géron, 2017Predictions and Reconstructions
- 125. Aurélien Géron, 2017Predictions and Reconstructions
- 126. Aurélien Géron, 2017Tweaking Output Vectors -0.50 -0.40 -0.30 -0.20 -0.10 Original +0.10 +0.20 +0.30 +0.40 +0.50
- 130. CapsNets using