PacSec

1. AI and Security Panel
Round 2
Intro Overview
PacSec2020
Dec 04, 2020

2. when security people look at AI
“how can AI be used in security?”
Gohsuke Takama
https://www.darpa.mil/program/cyber-grand-challenge

3. when AI people look at security
“what are the security problems against AI?”
Gohsuke Takama
https://youtu.be/SA4YEAWVpbk
https://github.com/Hyperparticle/one-pixel-attack-keras

4. we are being blasted by AI Buzzwords
• Alpha Fold
• GPT3
• BERT
• ELMo
• Word2Vec
• GAN
• AlphaGo Zero
• YOLO
• Edge AI
• AutoML
• TensorFlow
• PyTorch
• DeepFake
• Autonomous
Driving
-

5. AI isn’t a new thing
The Classics
• Perceptron 1958
• Back Propagation 1986
• Image recognition with Convolutional Neural
Network 1989
• Recommender System with Collaborative
Filtering 1994
• AlexNet 2012
• Word2Vec 2013
• Generative Adversarial Networks 2014
• Deep Q Learning 2014
• etc
-

6. Artificial Neural Network
(in text books)
Gohsuke Takama
https://towardsdatascience.com/

7. Artificial Neurons but
Gohsuke Takama
-
Multi Layer Perceptron (MLP)
Neurons

8. Neural Network types many!
• Convolutional Neural Network (CNN)
• AutoEncoder (Convolution-DeConvolution)
• Generative Adversarial Network (GAN)
• Graph Neural Network
• Recurrent Neural Network (RNN)
• Long Short Term Memory (LSTM)
• Attention Network
• Transformers
• Performers
• more to come!
-

9. Gohsuke Takama
http://www.asimovinstitute.org/neural-network-zoo/

10. Learning types which?
• Supervised Learning
• Un-Supervised Learning
• Reinforcement Learning
• Self Supervised Learning
• Transfer Learning
• One Shot Learning
• more!
-

11. AI Hardware which?
• CPU
• GPU
• FPGA
• ASIC
• Neuromorphic chip? (coming soon?)
• Bio/Silicon Hybrid? (?because Neuralink )
-

12. AI Hardware which?
CPU, GPU, FPGA, ASIC
Gohsuke Takama
-
CPU GPU FPGA ASIC
○ → →→ →→→
by Software by Software Programmable
Hardware Logic
Circuit
Hardware
Logic Circuit
Programming
Languages
Programming
Languages
on Logic
Definition
Fixed by
Design
○ ○ FeedForward
Network
oriented
Fixed by
Design
x86
ARM, etc
NVIDIA (CUDA)
AMD, etc
Xilinx (AMD),
Lattice,
Altera (Intel)
Google TPU
speed
execution
programming
design flexibility
chips

13. Development Platforms which?
• AI cloud services
• PC with GPU
• Smartphone CPU with GPU / NPU
• Single Boards:
• NVIDIA Jetson with GPU
• Google Coral with TPU ASIC
• Ultra96 with Xilinx FPGA
• Arduino + FPGA
• RISC-V + ?
-

14. Development Frameworks which?
• TensorFlow : Google
• PyTorch : Facebook
• MXNet : Amazon, Apple?
• CNTK : Microsoft (Windows)
• DL4J (Java, Android)
• CoreML (iOS)
• ONNX : Fb + MS (interoperability oriented)
• Keras (entry level friendly)
• Ludwig : Uber (code-free framework)
• Azure ML Studio : Microsoft (code-free framework)
-

15. Gohsuke Takama
http://www.slideshare.net/gohsuket