Download as PDF, PPTX
![Aurélien Géron, 2017Resolving Dependencies
A
C D
F
B
E
G
sess.run([A, E])](https://image.slidesharecdn.com/capsnetimplementation-171130154530/85/How-To-Implement-CapsNets-using-TensorFlow-99-320.jpg)
![Aurélien Géron, 2017Resolving Dependencies
A
C D
F
B
E
G
sess.run([A, E])](https://image.slidesharecdn.com/capsnetimplementation-171130154530/85/How-To-Implement-CapsNets-using-TensorFlow-100-320.jpg)
![Aurélien Géron, 2017Resolving Dependencies
A
C D
F
B
E
G
sess.run([A, E])](https://image.slidesharecdn.com/capsnetimplementation-171130154530/85/How-To-Implement-CapsNets-using-TensorFlow-101-320.jpg)
![Aurélien Géron, 2017Resolving Dependencies
A
C D
F
B
E
G
sess.run([A, E])](https://image.slidesharecdn.com/capsnetimplementation-171130154530/85/How-To-Implement-CapsNets-using-TensorFlow-102-320.jpg)
![Aurélien Géron, 2017Resolving Dependencies
A
C D
F
B
E
G
sess.run([A, E])](https://image.slidesharecdn.com/capsnetimplementation-171130154530/85/How-To-Implement-CapsNets-using-TensorFlow-103-320.jpg)
![Aurélien Géron, 2017Resolving Dependencies
A
C D
F
B
E
G
sess.run([A, E])](https://image.slidesharecdn.com/capsnetimplementation-171130154530/85/How-To-Implement-CapsNets-using-TensorFlow-104-320.jpg)
![Aurélien Géron, 2017Resolving Dependencies
A
C D
F
B
E
G
sess.run([A, E])](https://image.slidesharecdn.com/capsnetimplementation-171130154530/85/How-To-Implement-CapsNets-using-TensorFlow-105-320.jpg)
![Aurélien Géron, 2017Resolving Dependencies
A
C D
F
B
E
sess.run([A, E])
G](https://image.slidesharecdn.com/capsnetimplementation-171130154530/85/How-To-Implement-CapsNets-using-TensorFlow-106-320.jpg)
![Aurélien Géron, 2017Resolving Dependencies
A
C D
F
B
E
sess.run([A, E])
G](https://image.slidesharecdn.com/capsnetimplementation-171130154530/85/How-To-Implement-CapsNets-using-TensorFlow-107-320.jpg)
Uploaded byAurélien Géron
How To Implement CapsNets using TensorFlow
The document discusses the implementation of Capsule Networks (CapsNets) using TensorFlow, detailing the architecture including input layers, primary capsules, and digit capsules. It covers the processes of predicting outputs, routing by agreement, and calculating losses such as margin and reconstruction loss, as well as accuracy metrics. The document concludes with training operations and dependency resolutions in the model training process.
More Related Content
![SSII2021 [OS2-02] 深層学習におけるデータ拡張の原理と最新動向](https://cdn.slidesharecdn.com/ss_thumbnails/os2-03latest-210610045610-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DL輪読会]Decision Transformer: Reinforcement Learning via Sequence Modeling](https://cdn.slidesharecdn.com/ss_thumbnails/decisiontransformer20210709zhangxin-210709021501-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to How To Implement CapsNets using TensorFlow
![[PR12] Capsule Networks - Jaejun Yoo](https://cdn.slidesharecdn.com/ss_thumbnails/pr12capsulenetworks-jaejunyoo-171217144319-thumbnail.jpg?width=640&height=640&fit=bounds)
How To Implement CapsNets using TensorFlow
- 1.
- 2. Aurélien Géron, 2017NIPS2017 Paper
- 3. Aurélien Géron, 2017JupyterNotebook
- 4. Aurélien Géron, 2017JupyterNotebook
- 5.
- 6. Aurélien Géron, 2017InputLayer Input Images
- 7. Aurélien Géron, 2017InputLayer Input Images
- 8. Aurélien Géron, 2017InputLayer Input Images
- 9. Aurélien Géron, 2017PrimaryCapsules Input Images Primary Capsules
- 10. Aurélien Géron, 2017PrimaryCapsules Input Images Primary Capsules 32
- 11. Aurélien Géron, 2017PrimaryCapsules Input Images Primary Capsules
- 12. Aurélien Géron, 2017PrimaryCapsules Input Images Primary Capsules
- 13. Aurélien Géron, 2017PrimaryCapsules Input Images Primary Capsules
- 14. Aurélien Géron, 2017PrimaryCapsules Input Images Primary Capsules
- 15. Aurélien Géron, 2017PrimaryCapsules Input Images Primary Capsules
- 16. Aurélien Géron, 2017PrimaryCapsules Input Images Primary Capsules
- 17. Aurélien Géron, 2017PrimaryCapsules Input Images Primary Capsules
- 18. Aurélien Géron, 2017PrimaryCapsules Input Images Primary Capsules
- 19. Aurélien Géron, 2017DigitCapsules Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1
- 20. Aurélien Géron, 2017DigitCapsules Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1
- 21. Aurélien Géron, 2017DigitCapsules > Predict Outputs Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1
- 22. Aurélien Géron, 2017DigitCapsules > Predict Outputs Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1
- 23. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 24. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 25. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 26. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 27. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 28. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 29. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Predict Outputs
- 30. Aurélien Géron, 2017DigitCapsules > Predict Outputs
- 31. Aurélien Géron, 2017DigitCapsules > Predict Outputs
- 32. Aurélien Géron, 2017DigitCapsules > Predict Outputs 10
- 33. Aurélien Géron, 2017DigitCapsules > Predict Outputs =
- 34. Aurélien Géron, 2017DigitCapsules > Predict Outputs = Batch size
- 35. Aurélien Géron, 2017DigitCapsules > Predict Outputs
- 36. Aurélien Géron, 2017DigitCapsules > Predict Outputs
- 37. Aurélien Géron, 2017DigitCapsules > Predict Outputs (?, 1152, 8) Shape
- 38. Aurélien Géron, 2017DigitCapsules > Predict Outputs (?, 1152, 8) (?, 1152, 8, 1)
- 39. Aurélien Géron, 2017DigitCapsules > Predict Outputs (?, 1152, 8) (?, 1152, 8, 1) (?, 1152, 1, 8, 1)
- 40. Aurélien Géron, 2017DigitCapsules > Predict Outputs (?, 1152, 8) (?, 1152, 8, 1) (?, 1152, 1, 8, 1) (?, 1152, 10, 8, 1)
- 41. Aurélien Géron, 2017DigitCapsules > Predict Outputs
- 42. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 43. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 44. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 45. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 46. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 47.
- 48. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 49. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement
- 50. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 51. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 52. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 53. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2 =
- 54. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 55. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 56. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 57. Aurélien Géron, 2017 InputImages Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 98 9 0 1 Digit Capsules > Routing by Agreement > Round 2
- 58. Aurélien Géron, 2017DigitCapsules > Routing by Agreement
- 59. Aurélien Géron, 2017DigitCapsules > Routing by Agreement
- 60. Aurélien Géron, 2017DigitCapsules > Routing by Agreement
- 61. Aurélien Géron, 2017DigitCapsules Input Images Primary Capsules Digit Capsules 0 1 2 3 4 5 6 7 8 9 0 18 9
- 62. Aurélien Géron, 2017EstimatedClass Probabilities Input Images Primary Capsules Digit Capsules Length 0 1 2 3 4 5 6 7 8 9 0 0 0 0 .7 0 0 .1 0 .2 0 1 0 0 8 9 .3 0
- 63. Aurélien Géron, 2017Predictions InputImages Primary Capsules Digit Capsules Length Predictions 0 1 2 3 4 5 6 7 8 9 0 0 0 0 .7 0 0 .1 0 .2 4 0 1 0 0 8 9 .3 0 3 6
- 64. Aurélien Géron, 2017Predictions InputImages Primary Capsules Digit Capsules Length Predictions 0 1 2 3 4 5 6 7 8 9 0 0 0 0 .7 0 0 .1 0 .2 4 0 1 0 0 8 9 .3 0 3 6
- 65. Aurélien Géron, 2017Predictions InputImages Primary Capsules Digit Capsules Length Predictions 7 3 4 6 7
- 66. Aurélien Géron, 2017Accuracy InputImages Primary Capsules Digit Capsules Length Predictions Labels Accuracy 7 3 4 6 1 7 3 4 6 7 80%
- 67. Aurélien Géron, 2017Accuracy InputImages Primary Capsules Digit Capsules Length Predictions Labels Accuracy 7 3 4 6 1 7 3 4 6 7 80%
- 68. Aurélien Géron, 2017Accuracy InputImages Primary Capsules Digit Capsules Length Predictions Labels Accuracy 7 3 4 6 1 7 3 4 6 7 80%
- 69. Aurélien Géron, 2017Training InputImages Primary Capsules Digit Capsules Length Predictions Labels
- 70. Aurélien Géron, 2017MarginLoss Input Images Primary Capsules Digit Capsules Length Predictions Margin Loss Labels Margin Loss Length
- 71. Aurélien Géron, 2017MarginLoss Input Images Primary Capsules Digit Capsules Length Predictions Margin Loss Labels Margin Loss Length
- 72. Aurélien Géron, 2017Decoder InputImages Primary Capsules Digit Capsules Decoder Margin Loss Labels Length Predictions
- 73.
- 74. Aurélien Géron, 2017Decoder InputImages Primary Capsules Digit Capsules Decoder Margin Loss Labels Length Predictions
- 75. Aurélien Géron, 2017ReconstructionLoss Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions
- 76. Aurélien Géron, 2017ReconstructionLoss Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions
- 77. Aurélien Géron, 2017ReconstructionLoss Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions
- 78. Aurélien Géron, 2017FinalLoss Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss
- 79. Aurélien Géron, 2017FinalLoss Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss
- 80. Aurélien Géron, 2017FinalLoss Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss
- 81. Aurélien Géron, 2017TrainingOperation Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation
- 82. Aurélien Géron, 2017TrainingOperation Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation
- 83. Aurélien Géron, 2017TrainingOperation Input Images Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation
- 84. Aurélien Géron, 2017Mask InputImages Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask ×
- 85. Aurélien Géron, 2017Mask InputImages Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask ×
- 86. Aurélien Géron, 2017Mask InputImages Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask ×
- 87. Aurélien Géron, 2017Mask InputImages Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask ×
- 88. Aurélien Géron, 2017Mask InputImages Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Length Predictions Loss Training Operation Mask × Mask with Labels Labels
- 89. Aurélien Géron, 2017Mask InputImages Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask × Mask with Labels
- 90. Aurélien Géron, 2017Mask InputImages Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask × Mask with Labels
- 91. Aurélien Géron, 2017ResolvingDependencies A C D F B E G
- 92. Aurélien Géron, 2017ResolvingDependencies A C D F B E G A.eval()
- 93. Aurélien Géron, 2017ResolvingDependencies A C D F B E G A.eval()
- 94. Aurélien Géron, 2017ResolvingDependencies A C D F B E G A.eval()
- 95. Aurélien Géron, 2017ResolvingDependencies A C D F B E G A.eval()
- 96. Aurélien Géron, 2017ResolvingDependencies A D F B E G A.eval() C
- 97. Aurélien Géron, 2017ResolvingDependencies A C D F B E G A.eval()
- 98. Aurélien Géron, 2017ResolvingDependencies A C D F B E G A.eval()
- 99. Aurélien Géron, 2017ResolvingDependencies A C D F B E G sess.run([A, E])
- 100. Aurélien Géron, 2017ResolvingDependencies A C D F B E G sess.run([A, E])
- 101. Aurélien Géron, 2017ResolvingDependencies A C D F B E G sess.run([A, E])
- 102. Aurélien Géron, 2017ResolvingDependencies A C D F B E G sess.run([A, E])
- 103. Aurélien Géron, 2017ResolvingDependencies A C D F B E G sess.run([A, E])
- 104. Aurélien Géron, 2017ResolvingDependencies A C D F B E G sess.run([A, E])
- 105. Aurélien Géron, 2017ResolvingDependencies A C D F B E G sess.run([A, E])
- 106. Aurélien Géron, 2017ResolvingDependencies A C D F B E sess.run([A, E]) G
- 107. Aurélien Géron, 2017ResolvingDependencies A C D F B E sess.run([A, E]) G
- 108. Aurélien Géron, 2017ResolvingDependencies mask_with_labels reconstruction_targets y y_pred
- 109. Aurélien Géron, 2017ResolvingDependencies mask_with_labels reconstruction_targets y y_pred
- 110. Aurélien Géron, 2017ResolvingDependencies mask_with_labels reconstruction_targets y y_pred
- 111. Aurélien Géron, 2017ResolvingDependencies mask_with_labels reconstruction_targets y y_pred
- 112. Aurélien Géron, 2017ResolvingDependencies mask_with_labels reconstruction_targets y y_pred
- 113. Aurélien Géron, 2017ResolvingDependencies mask_with_labels reconstruction_targets y y_pred
- 114. Aurélien Géron, 2017ResolvingDependencies mask_with_labels reconstruction_targets y y_pred True
- 115. Aurélien Géron, 2017ResolvingDependencies mask_with_labels reconstruction_targets y y_pred True Value of y
- 116. Aurélien Géron, 2017ResolvingDependencies mask_with_labels reconstruction_targets y y_pred True Value of y Evaluated for nothing
- 117. Aurélien Géron, 2017ResolvingDependencies mask_with_labels reconstruction_targets y y_pred False
- 118. Aurélien Géron, 2017ResolvingDependencies mask_with_labels reconstruction_targets y y_pred Value of y_pred False
- 119. Aurélien Géron, 2017ResolvingDependencies mask_with_labels reconstruction_targets y y_pred Value of y_pred Evaluated for nothing and needs to be fed! False
- 120. Aurélien Géron, 2017Mask InputImages Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask × Mask with Labels
- 121. Aurélien Géron, 2017Mask InputImages Primary Capsules Digit Capsules Decoder Reconstruction LossMargin Loss Labels Length Predictions Loss Training Operation Mask × Mask with Labels
- 122.
- 123. Aurélien Géron, 2017Predictionsand Reconstructions
- 124. Aurélien Géron, 2017Predictionsand Reconstructions
- 125. Aurélien Géron, 2017Predictionsand Reconstructions
- 126. Aurélien Géron, 2017TweakingOutput Vectors -0.50 -0.40 -0.30 -0.20 -0.10 Original +0.10 +0.20 +0.30 +0.40 +0.50
- 127.
- 128.
- 129.
- 130.