Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Pydata2017 11-29

3,824 views

Published on

PyTorch - 個人の戦略ツールとして

Published in: Software
  • Hello! Get Your Professional Job-Winning Resume Here - Check our website! https://vk.cc/818RFv
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Pydata2017 11-29

  1. 1. 2017-09-29@ PyData Tokyo
  2. 2. Yuta Kashino ( ) BakFoo, Inc. CEO Astro Physics /Observational Cosmology Zope / Python Realtime Data Platform for Enterprise Prototyping
  3. 3. arXiv PyCon2015 Python PyCon2016 PyCon2017 DNN PPL Edward @yutakashino Yuta Kashino ( )
  4. 4. … TensorFlow eager Dynamic: Define By Run Static: Define AND Run
  5. 5. TensorFlow eager Dynamic: Define By Run
  6. 6.
  7. 7. TensorFlow - API : tf.contrib - : ecosystem(spark, hadoop, kubenates) - : tfdbg, tensorboard - : Feature Columns - : OpenMPI+ , Horovod(uber) - : Lite, Mobile - : XLA - : TPU - : GCP
  8. 8. : DL - - - - - AI - Google, NVIDIA, Intel, AMD, Apple, Huwei, Baidu, MS, FB… - Graphcore, Groq, DeePhi, BitMain…
  9. 9. DL - - - - … - - - AI …
  10. 10. DL - TensorFlow - - - -
  11. 11. PyTorch - Torch 7 Chainer - - Adam Paszke - Sam Gross - Soumith Chintala  - NYU FBAIR - 2017 2 v0.1.6
  12. 12. PyTorch - 2017 2 v0.1.6 Google Trend
  13. 13. PyTorch - TF/Keras … Google Trend
  14. 14. - GPU(CUDA) - Define by Run: - Pythonic + python http://pytorch.org/tutorials/advanced/numpy_extensions_tutorial.html
  15. 15. autograd.Variable - - data, grad (, grad_fn) - chainer Variable - autograd.Variable Chainer fork - backward() data grad grad_fn
  16. 16. autograd.Variable data grad grad_fn x data grad grad_fn y data grad grad_fn z
  17. 17. autograd … - NLP DyNet 10 - Python addmm - ATen - v.0.3.0 autograd ATen https://twitter.com/kchonyc/status/899832376955744257 https://github.com/zdevito/aten https://goo.gl/Tujudr
  18. 18. https://github.com/ilkarman/DeepLearningFrameworks
  19. 19. NN - torcn.nn chainer.Chain chainer.links chainer.functions chainer
  20. 20. chainer.ChainList
  21. 21. GPU - CPU → GPU: Variable cuda() - GPU → CPU: cpu() chainer
  22. 22. Chainer - Chainer - GPU Chainer - Chainer - torch.optim = chainer.optimizers - … - pytorch/tnt = chainer.training - Pythonic … https://github.com/pytorch/tnt
  23. 23. Chainer
  24. 24. - PyTorch - PyTorch - Awesome-Pytorch-list, The Incredible PyTorch https://github.com/bharathgs/Awesome-pytorch-list https://github.com/ritchieng/the-incredible-pytorch
  25. 25. - → → - … → PyTorch -
  26. 26. Capsule Nets - Hinton CapculeNets 2017 10 26 - 10 29 TensorFlow/Keras/PyTorch https://github.com/timomernick/pytorch-capsule https://github.com/gram-ai/capsule-networks https://arxiv.org/abs/1710.09829 https://github.com/naturomics/CapsNet-Tensorflow https://github.com/XifengGuo/CapsNet-Keras
  27. 27. / - - CNN/RNN: torch.nn, torchvision.models - GAN - https://github.com/Cadene/pretrained-models.pytorch https://github.com/szagoruyko/functional-zoo https://github.com/wiseodd/generative-models https://github.com/znxlwm/pytorch-generative-model-collections https://github.com/aaron-xichen/pytorch-playground https://github.com/sdhnshu/pytorch-model-zoo
  28. 28. DAG - PyTorch DAG - pyro - gpytorch - CUDA FFT pytorch_fft - sequence-to-sequence fairseq-py https://github.com/uber/pyro https://github.com/jrg365/gpytorch https://github.com/locuslab/pytorch_fft https://github.com/facebookresearch/fairseq-py
  29. 29. - - StackOverFlow http://pytorch.org/tutorials/ https://discuss.pytorch.org/latest
  30. 30. - PyTorchZeroToAll - Practical Deep Learning with PyTorch on Udemy - fast.ai https://www.udemy.com/practical-deep-learning-with-pytorch http://www.fast.ai/2017/09/08/introducing-pytorch-for-fastai/ https://goo.gl/kt3uV2
  31. 31. - conda
  32. 32. DL
  33. 33. Questions kashino@bakfoo.com @yutakashino
  34. 34. BakFoo, Inc. NHK NMAPS: +
  35. 35. BakFoo, Inc. PyConJP 2015 Python
  36. 36. BakFoo, Inc.
  37. 37. BakFoo, Inc. : SNS +

×