Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

RedisAI 0.9 by Sherin Thomas of Tensorwerk - Redis Day Bangalore 2020

179 views

Published on

RedisAI 0.9 by Sherin Thomas - Redis Day Bengaluru 2020

Published in: Software
  • Be the first to comment

RedisAI 0.9 by Sherin Thomas of Tensorwerk - Redis Day Bangalore 2020

  1. 1. RedisAI 0.9 Sherin Thomas Developer, Tensorwerk
  2. 2. PRESENTED BY RedisAI New data type: Tensor def addsq(a, b): return (a + b)**2 TorchScript CPU GPU0 GPU1 …
  3. 3. PRESENTED BY Model Deployment AI.MODELSET model TF CPU INPUTS in1 OUTPUTS linear4 < foo.pb AI.MODELSET model TFLITE CPU < foo.tflite AI.MODELSET model TORCH GPU < foo.pt AI.MODELSET model ONNX CPU < foo.onnx 3 AI.MODELRUN model INPUTS foo OUTPUTS bar
  4. 4. PRESENTED BY Benchmarking AI Serving Developed AIBench, a tool for comparing and evaluating AI serving solutions ● Current DL solutions supported: - RedisAI - TFServing + Redis - Rest API + Redis ● Current Use Cases supported: - Creditcard-fraud from Kaggle ( 2 test cases ) - Open Source and Easily extensible 4
  5. 5. PRESENTED BY Benchmarking AI Serving TFServing and WebAPI Architectures
  6. 6. PRESENTED BY Data locality matters! Benchmarking AI Serving RedisAI Architecture
  7. 7. PRESENTED BY Benchmarking AI Serving 7more inferences RedisAI vs REST API 5.5x RedisAI vs TFServing 2.5x
  8. 8. PRESENTED BY Partners | Integrations | Ecosystem
  9. 9. PRESENTED BY Ecosystem: MLFlow Seamless integration with MLFlow ecosystem (pull/#2327) ● Available/visible inside MLFlow CLI ● Goes with the mlflow workflow - No separate model preparation phase ● Single command deployment ● Available as a pip package - mlflow_redisai 9 mlflow run . mlflow models deploy redisai create -m run:/experiment_id --model_key model
  10. 10. PRESENTED BY 10
  11. 11. PRESENTED BY 11
  12. 12. How can I get started? redisai.io
  13. 13. Thank You! tiny.cc/demoes-bengaluru

×