Pydata2017 11-29

Pydata2017 11-29

1. 1. 2017-09-29@ PyData Tokyo
2. 2. Yuta Kashino ( ) BakFoo, Inc. CEO Astro Physics /Observational Cosmology Zope / Python Realtime Data Platform for Enterprise Prototyping
3. 3. arXiv PyCon2015 Python PyCon2016 PyCon2017 DNN PPL Edward @yutakashino Yuta Kashino ( )
4. 4. … TensorFlow eager Dynamic: Define By Run Static: Define AND Run
5. 5. TensorFlow eager Dynamic: Define By Run
6. 6. …
7. 7. TensorFlow - API : tf.contrib - : ecosystem(spark, hadoop, kubenates) - : tfdbg, tensorboard - : Feature Columns - : OpenMPI+ , Horovod(uber) - : Lite, Mobile - : XLA - : TPU - : GCP
8. 8. : DL - - - - - AI - Google, NVIDIA, Intel, AMD, Apple, Huwei, Baidu, MS, FB… - Graphcore, Groq, DeePhi, BitMain…
9. 9. DL - - - - … - - - AI …
10. 10. DL - TensorFlow - - - -
11. 11. PyTorch - Torch 7 Chainer - - Adam Paszke - Sam Gross - Soumith Chintala  - NYU FBAIR - 2017 2 v0.1.6
12. 12. PyTorch - 2017 2 v0.1.6 Google Trend
13. 13. PyTorch - TF/Keras … Google Trend
14. 14. - GPU(CUDA) - Define by Run: - Pythonic + python http://pytorch.org/tutorials/advanced/numpy_extensions_tutorial.html
15. 15. autograd.Variable - - data, grad (, grad_fn) - chainer Variable - autograd.Variable Chainer fork - backward() data grad grad_fn
16. 16. autograd.Variable data grad grad_fn x data grad grad_fn y data grad grad_fn z
17. 17. autograd … - NLP DyNet 10 - Python addmm - ATen - v.0.3.0 autograd ATen https://twitter.com/kchonyc/status/899832376955744257 https://github.com/zdevito/aten https://goo.gl/Tujudr
18. 18. https://github.com/ilkarman/DeepLearningFrameworks
19. 19. NN - torcn.nn chainer.Chain chainer.links chainer.functions chainer
20. 20. chainer.ChainList
21. 21. GPU - CPU → GPU: Variable cuda() - GPU → CPU: cpu() chainer
22. 22. Chainer - Chainer - GPU Chainer - Chainer - torch.optim = chainer.optimizers - … - pytorch/tnt = chainer.training - Pythonic … https://github.com/pytorch/tnt
23. 23. Chainer
24. 24. - PyTorch - PyTorch - Awesome-Pytorch-list, The Incredible PyTorch https://github.com/bharathgs/Awesome-pytorch-list https://github.com/ritchieng/the-incredible-pytorch
25. 25. - → → - … → PyTorch -
26. 26. Capsule Nets - Hinton CapculeNets 2017 10 26 - 10 29 TensorFlow/Keras/PyTorch https://github.com/timomernick/pytorch-capsule https://github.com/gram-ai/capsule-networks https://arxiv.org/abs/1710.09829 https://github.com/naturomics/CapsNet-Tensorflow https://github.com/XifengGuo/CapsNet-Keras
27. 27. / - - CNN/RNN: torch.nn, torchvision.models - GAN - https://github.com/Cadene/pretrained-models.pytorch https://github.com/szagoruyko/functional-zoo https://github.com/wiseodd/generative-models https://github.com/znxlwm/pytorch-generative-model-collections https://github.com/aaron-xichen/pytorch-playground https://github.com/sdhnshu/pytorch-model-zoo
28. 28. DAG - PyTorch DAG - pyro - gpytorch - CUDA FFT pytorch_fft - sequence-to-sequence fairseq-py https://github.com/uber/pyro https://github.com/jrg365/gpytorch https://github.com/locuslab/pytorch_fft https://github.com/facebookresearch/fairseq-py
29. 29. - - StackOverFlow http://pytorch.org/tutorials/ https://discuss.pytorch.org/latest
30. 30. - PyTorchZeroToAll - Practical Deep Learning with PyTorch on Udemy - fast.ai https://www.udemy.com/practical-deep-learning-with-pytorch http://www.fast.ai/2017/09/08/introducing-pytorch-for-fastai/ https://goo.gl/kt3uV2
31. 31. - conda
32. 32. DL
33. 33. Questions kashino@bakfoo.com @yutakashino
34. 34. BakFoo, Inc. NHK NMAPS: +
35. 35. BakFoo, Inc. PyConJP 2015 Python
36. 36. BakFoo, Inc.
37. 37. BakFoo, Inc. : SNS +