Tensorflow lite for microcontroller
•
8 likes•816 views
This document introduces TensorFlow Lite for Microcontrollers (TF Micro) which brings machine learning to microcontroller applications. It discusses porting TF Micro to platforms like Arduino, converting TensorFlow models to a C array format compatible with MCUs, and using the TF Micro C++ API and interpreter to perform inference on embedded devices with limited memory and compute. Examples are provided of applying TF Micro to applications like speech recognition on microcontrollers.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Tensorflow lite for microcontroller
Similar to Tensorflow lite for microcontroller (20)
More from Rouyun Pan
More from Rouyun Pan (20)
Recently uploaded
Recently uploaded (20)
Tensorflow lite for microcontroller
- 2. 引⾔ ▸ TensorFlow Lite for Microcontrollers ( TF Micro) TensorFlow Microcontroller(MCU) . ▸ ▸ TF Micro Converter ▸ TF Micro Interpreter ▸ ▸ Arduino Nano 33 BLE Sense ▸ SparkFun Edge ▸ STM32F746 Discovery kit ▸ Adafruit EdgeBadge ▸ Adafruit TensorFlow Lite for Microcontrollers Kit
- 3. TF MICRO 的移植考量 ▸ ▸ C C++ ▸ ▸
- 4. 移植時的限制 ▸ C ++ 11 ▸ 32 ▸ TensorFlow ▸ ▸ C++ API ▸ ,
- 5. 疑 ！？你還在～
- 6. TF MICRO 開發流程 ▸ Tensorflow ▸ TensorFlow Lite FlatBuffer ▸ FlatBuffer C ▸ TensorFlow Micro C++ ▸
- 7. 為何要TF MICRO 模型解釋器 ▸ ▸ ▸ ▸ - flatbuffer ▸ 缺點 ▸ , ▸ OpResolver ,
- 9. TF MICRO 的 C++函式庫 ▸ tensorflow /lite/experimental/micro/ ▸ .h ▸ all_ops_resolver.h ▸ micro_error_reporter.h debug ▸ micro_interpreter.h ▸ ▸ kernel, ▸ tools, ▸ examples,
- 10. 編譯構建系統 ▸ $ git clone https://github.com/tensorflow/tensorflow.git ▸ $ make -f tensorflow/lite/experimental/micro/tools/make/ Makefile test ▸ $ make -f tensorflow/lite/experimental/micro/tools/make/ Makefile TARGET="sparkfun_edge" micro_speech_bin
- 13. 編寫單元測試程式碼(1) ▸ tensorflow /lite/experimental/micro/testing/micro_test.h ▸ , OOXX_test.cc tensorflow/lite/experimental/micro/examples/micro_speech/example/audio_provider_test.cc
- 16. 實現錯誤回報功能 ▸ $ make -f tensorflow/lite/experimental/micro/tools/make/Makefile generate_micro_error_reporter_test_make_project ▸ tensorflow/lite/experimental/micro/tools/make/gen/ my_mcu_x86_64/prj/ micro_error_reporter_test /make/ tensorflow/lite/experimental /micro/my_mcu/ debug_log.cc
- 17. 產⽣移植平台的專案檔跟副本 ▸ make -f tensorflow/lite/experimental/micro/tools/make/Makefile TARGET=my_mcu clean ▸ make -f tensorflow/lite/experimental/micro/tools/make/ Makefile generate_projects TARGET = my_mcu 產⽣錯誤回報的測試執⾏檔 ▸ make -f tensorflow/lite/experimental/micro/tools/make/Makefile TARGET=my_mcu micro_error_reporter_test_bin 產⽣所有的測試執⾏檔 ▸ make -f tensorflow/lite/experimental/micro/tools/make/Makefile TARGET=my_mcu test
- 18. 快結束了, 再撐⼀下~
- 19. TF MICRO 模型轉換 ▸ ▸ ▸ ▸ Tensorflow PC Python . MCU . ▸ TensorFlow 800 , , . ▸ , TensorFlow Lite , TensorFlow ,
- 20. 模型轉換操作 ▸ MCU file system ▸ unix char TensorFlow Lite C $ xxd -i converted_model.tflite > model_data.cc ▸ const , .
- 21. 轉換後的C陣列格式 ▸
- 22. FLATBUFFERS 結構 ▸ , little-endian blobs C tensorflow/lite/schema/schema.fbs ▸ C ++ C Python Java . ▸ , Flash .
- 23. FLATBUFFER 格式 ▸ Flatbuffer Table tensorflow/lite/schema/schema.fbs
- 24. 如何讀取⼀個TF LITE模型(1) ▸ GetModel API, ▸ SCHEMA ▸
- 25. 如何讀取⼀個TF LITE模型(2) ▸ SubGraph , input, output, tensor tensorflow/lite/experimental/micro/micro_interpreter.cc tensorflow/lite/schema/schema.fbs
- 27. 如何讀取⼀個TF LITE模型(4) ▸ operators , Tensor
- 28. 確認 TF MICRO 中的現有運算⼦⽀援範圍 ▸ TF lite floating-point (float32) and quantized (uint8, int8) . TF Micro quantized (uint8, int8) ▸ TF Micro 54 ops, TF Lite 114 ops. tensorflow/lite/experimental/micro/kernels/all_ops_resolver.cc ▸ . ▸ TF Micro TensorFlow Lite .
- 32. 範例：使⽤TF MICRO的應⽤ (4) ▸ Tesnor ▸ TF Micro
- 33. 範例：使⽤TF MICRO的應⽤ (5) ▸ Tesnor ▸
- 35. CODE 出的去, 錢進得來
- 36. 參考 ▸ https://github.com/tensorflow/tensorflow/tree/master/ tensorflow/lite/experimental/micro/ ▸ https://www.tensorflow.org/lite/microcontrollers/overview ▸ https://learning.oreilly.com/library/view/tinyml/ 9781492052036/