TensorFlow Lite (TF Lite) allows running trained machine learning models on mobile and edge devices. The document discusses various methods for converting TensorFlow models to the TF Lite format including quantizing weights to reduce size. It also covers frameworks like Firebase MLKit, Core ML, and MediaPipe that utilize TF Lite on Android and iOS.

1. DeepLearning (α )
!1

2. •
→ MLOps
Edge AI ( )
• ML CV (´ )
• ML
2
@cocodrips

3. Topic
• TF Lite
• Convert
• TF Lite AI framework
3

4. TF Lite

5. TensorFlow Lite
• ( ) IoT
•
5

6. TensorFlow Lite
• Weight : float16, uint8(dynamic range)
‣ float16/integer option convert
‣
• Weight Activation : uint8
‣
‣
6

7. Weight
• Tensorflow float32 Weight
‣
‣
‣
• Weight Float16 : 1/2
• Weight uint8 : 1/4, 2~3
※Activation Full integer quantization
1/4 3
7

8. 8
*1: coco-dataset, *2: open-images-v4

9. ( )
• weight float16 faiss
uint8
• uint8 Face detection
demo
9

10. Convert

11. convert
1. SavedModel convert
2. checkpoint convert
11

12. SavedModel convert
SavedModel convert ( )
‣ TF Lite
‣ Tensorflow → TensorFlow Lite
mapping
‣ or SavedModel TF Lite
12

13. Checkpoint Convert
Checkpoint+GraphDef convert
‣ TF Lite
‣ shape: -1
‣ TF ObjectDetection API Slim( )
exporter GraphDef
13

14. Convert
• Python API:
• tflite_convert:
• toco:
14

15. Python API
•
• SavedModel Keras
• option (input_shapes )
• v2 API post_training_quantize
v1 API
15

16. tflite_convert
• SavedModel Keras
•
tflite_convert
• PythonAPI TF2 install tflite_convert
TF1
16

17. toco
• tflite_convert Python API
• saved_model, graphdef
• bazel build
• convert
• checkpoint + graph def convert
•
17

18. convert
18
slim
slim exporter
freeze_graph
batch_size
toco convert
float16

19. • convert
•
19

20. 20

21. Convert
( !!)
> [Tensorflow Lite] Various Neural Network Model
quantization methods for Tensorflow Lite (Weight
Quantization, Integer Quantization, Full Integer Quantization,
Float16 Quantization, EdgeTPU). As of May 05, 2020.
slim convert
> Tensorflow TFLite convert convert
21

22. TF Lite framework

23. Firebase MLKit (β)
23
• Android / iOS SDK
• TFLite
• 10
• firebase up DL
• RemoteConfig(Firebase) AB ?

24. Core ML
• iOS SDK
• TFLite
• iOS11 OS
• Android framework
24

25. Mediapipe
• framework
‣
‣ UI
• TFLite
• Android/iOS
iOS obj-c framework
25

26. 26

27. • TensorFlow Lite
• convert & weight
• TensorFlow Lite AI Framework
• TF Lite
• TF Lite v1, v2 API
27