SlideShare a Scribd company logo

NIPS 2016 Overview and Deep Learning Topics

•
•
Koichi Hamada
Koichi Hamada

NIPS2016読み会の登壇資料です。NIPS2016 の、Overview、及び、Generative Adversarial Networks (GANs)、Recurrent Neural Networks (RNNs) の本会議論文に関して紹介しています。

Science
1 of 38
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. NIPS 2016 読み会 @Preferred Networks 2017/1/19 NIPS 2016 Overview and Deep Learning Topics @hamadakoichi 濱田晃一 Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved.
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 2 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
3 Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. 講師 ・TokyoWebmining 主催者 　- 機械学習の実活用コミュニティ。登録人数 1500人超。 　- 7年継続、累積59回開催 濱田晃一 (@hamadakoichi) ・執筆：Mobageを支える技術 Analytics Architect ・博士 : 量子統計場の理論 (理論物理) ・DeNA全サービスを対象とし、大規模機械学習活用したサービス開発 　- 数千万ユーザー、50億アクション/日、テキスト、画像、ソーシャルグラフ 　- 体験設計から、分散学習アルゴリズムの設計・実装まで ・Deep Learning 　- 画像表現学習・画像生成 　　 対話・キャラクター表現学習、等
4 Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
5 Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 6 NIPS 2016 ・第30回の開催 ・期間： 2016年12月5-10日 ・ICML 33回に続き長い伝統 ・チュートリアル: 5(1日) ・本会議: 5-8(4日) ・ワークショップ: 9-10(2日) ・開催地： バルセロナ(スペイン) 貼る：会場雰囲気
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 7 NIPS 2016 参加者が 6000人に増加 (2015年の1.5倍) ※Terrence Sejnowskiは NIPS foundationの President
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 8 NIPS Features ・採択の92%はポスター ・採択率: 23% ・投稿数: 2500+、採択数： 568 ・Oral(45) : 20分の口頭発表 + ポスター ・Poster(523) ： ポスターのみ ・少数トラックでの進行(最大3) （昨年までシングルトラックだったがパラレルに）
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 9 NIPS Features ・ポスター発表による活発な議論 (昨年までの19-24時の5時間ポスターからは時間縮小したが、最後まで活発な議論） ・210 min(3.5 hour)/ day ・130 Poster x 4 days
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 10 NIPS2016 Hot Topics 引用元： The review process for NIPS 2016 http://www.tml.cs.uni-tuebingen.de/team/ luxburg/misc/nips2016/index.php Deep Learning Computer Vision Large Scale Learning Learning Theory Optimization Sparsity
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 11 NIPS2016 Hot Topics Tutorial 3/9、Symposium 2/3 が Deep Learning Reinforcement Learning, Generative Adversarial Net, Recurrent Net Tutorial Symposium
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 12 NIPS2016 Hot Topics Tutorial Symposium Tutorial 3/9、Symposium 2/3 が Deep Learning Reinforcement Learning, Generative Adversarial Net, Recurrent Net 上記2トピックに関し、本会議論文をピックアップし概要紹介します (Reinforcement Learningは、このNIPS読み会での個別論文の発表も多いため)
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 13 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 14 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 15 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 16 Generative Adversarial Network (GAN) Generative Adversarial Nets(GAN) Goodfellow+, NIPS2014
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 17 Generative Adversarial Network (GAN) Generator(生成器)と Discriminator(識別器)を戦わせ 生成精度を向上させる 識別器: “本物画像”と “生成器が作った偽画像”を識別する 生成器: 生成画像を識別器に“本物画像”と誤識別させようとする (Goodfellow+, NIPS2014, Deep Learning Workshop, Presentation)
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 18 Generative Adversarial Network (GAN) Minimax Objective function Discriminator が 「本物画像」を「本物」と識別 (Goodfellow+, NIPS2014, Deep Learning Workshop, Presentation) Discriminator が 「生成画像」を「偽物」と識別する Discriminatorは 正しく識別しようとする （最大化） Generatorは Discriminator に誤識別させようとする（最小化） Generator(生成器)と Discriminator(識別器)を戦わせ 生成精度を向上させる
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 19 自然画像の表現ベクトル空間学習・演算・画像生成 ICLR16: Deep Convolutional GAN : DCGAN (Radford+) 自然画像のクリアな画像生成 画像演算 Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. Alec Radford, Luke Metz, Soumith Chintala. arXiv:1511.06434. In ICLR 2016.
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 20 ICML16: Autoencoding beyond pixels (Larsen+) Autoencoding beyond pixels using a learned similarity metric. Anders Boesen Lindbo Larsen, Søren Kaae Sønderby, Hugo Larochelle, Ole Winther. arXiv:1512.09300. In ICML 2016. 自然画像の表現ベクトル空間学習・演算・画像生成
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 21 ICML16: Generative Adversarial Text to Image Synthesis(Reed+) Generative Adversarial Text to Image Synthesis. Scott Reed, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, Honglak Lee. arXiv:1605.05396. In ICML 2016. 文章からの画像生成 文章で条件付したGAN
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 22 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 23 Generative Adversarial Text to Image Synthesis(Reed+) Learning What and Where to Draw. Scott Reed, Zeynep Akata, Santosh Mohan, Samuel Tenka, Bernt Schiele, Honglak Lee. arXiv:1610.02454. In NIPS 2016. 文章からの画像生成 表示位置情報も条件付したGAN
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 24 InfoGAN (Chen+) InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets. Xi Chen, Yan Duan, Rein Houthooft, John Schulman, Ilya Sutskever, Pieter Abbeel. arXiv:1606.03657. In NIPS 2016 Latent code c、Generator 出力との Mutual Information を加え GANで狙って表現ベクトル空間を学習
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 25 3Dモデルの表現ベクトル空間学習・演算・生成 3D GAN (Wu+) 3Dモデルの生成 3Dモデル演算 写真からの3Dモデル生成 3D VAE-GAN 3D GAN Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling. Jiajun Wu, Chengkai Zhang, Tianfan Xue, William T. Freeman, Joshua B. Tenenbaum. arXiv:1610.07584. In NIPS 2016.
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 26 Generating Videos with Scene Dynamics(Vondrick+) 動画の表現ベクトル空間学習・動画生成 Generating Videos with Scene Dynamics. Carl Vondrick, Hamed Pirsiavash, Antonio Torralba. In NIPS 2016. http://web.mit.edu/vondrick/tinyvideo/ 動画生成 1画像からその後の動画生成
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 27 f-GAN (Nowozin+) GAN目的関数を Symmetric JS-divergence から f-divergence に一般化。各Divergence を用い学習・評価 f-GAN: Training Generative Neural samplers using variational Divergence Minimization. Sebastian Nowozin, Botond Cseke, Ryota Tomioka. arXiv:1606.00709. In NIPS 2016. Kernel Density Estimation on the MNIST f-divergence LSUN
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 28 Improved Techniques for Training GANs (Salimans+) Improved Techniques for Training GANs. Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, Xi Chen. arXiv:1606.03498. In NIPS 2016. 収束が難しいGANの学習方法論 GAN半教師あり学習 1. Feature Matching 2. Minibatch discrimination 3. Historical averaging 4. One-sided label smoothing 5. Virtual batch normalization Techniques Semi-supervised learning MNIST Semi-supervised training with feature matching Semi-supervised training with feature matching and minibatch discrimination CIFAR-10 Generated samples
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 29 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 30 Extended Architectures for Generative Adversarial Nets 2016 Extended Architectures for GANs Figure by Chris Olah (2016) : https://twitter.com/ch402/status/793535193835417601 Ex) Conditional Image Synthesis With Auxiliary Classifier GANs. Augustus Odena, Christopher Olah, Jonathon Shlens. arXiv:1610.09585. Generative Adversarial Net の各種拡張
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 31 Stack GAN: Text to PhotoRealistic Image Synthesis(Zhang+2016) 1段目で文章から低解像度画像を生成 2段目で低解像度画像から高解像度画像を生成 StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks. Han Zhang, Tao Xu, Hongsheng Li, Shaoting Zhang, Xiaolei Huang, Xiaogang Wang, Dimitris Metaxas. arXiv:1612.03242.
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 32 Plug & Play Generative Networks (Nguyen+2016) 高解像度な画像生成 227 x 227 ImageNet Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space. Anh Nguyen, Jason Yosinski, Yoshua Bengio, Alexey Dosovitskiy, Jeff Clune. arXiv:1612.00005.
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 33 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 34 Phased LSTM (Neil+) 時間で開閉するGateを導入した LSTM Sensor Data 等、Event 駆動の長期系列特徴を学習 Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequences. Daniel Neil, Michael Pfeiffer, Shih-Chii Liu. arXiv:1610.09513. In NIPS 2016. LSTM Phased LSTM Phased LSTM Behavior Frequency Discrimination Task
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 35 Using Fast Weights to Attend to the Recent Past (Ba+) 早く学習・減衰する Fast Weight 追加で、系列固有の情報を扱う Slow Weight での長期特徴とあわせ、双方の系列特徴を学習 Using Fast Weights to Attend to the Recent Past. Jimmy Ba, Geoffrey Hinton, Volodymyr Mnih, Joel Z. Leibo, Catalin Ionescu. arXiv:1610.06258. In NIPS 2016. Associative Retrieval Task Classification Error Test Log Likelihood
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 36 Learning to learn by GD by GD (Andrychowicz+) LSTMを用いたOptimizer Parameterごとに 勾配系列から適切な次の更新量を算出 Learning to learn by gradient descent by gradient descent. Marcin Andrychowicz, Misha Denil, Sergio Gomez, Matthew W. Hoffman, David Pfau, Tom Schaul, Brendan Shillingford, Nando de Freitas. arXiv:1606.04474. In NIPS 2016.
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 37 Matching Network for One Shot Learning (Vinyals+) Attention Mechanism を用いた One Shot Learning 参照構造を学習しておき、新規小規模データセットでも高精度で動作 Matching Networks for One Shot Learning. Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Koray Kavukcuoglu, Daan Wierstra. arXiv:1606.04080. In NIPS 2016. Omniglot miniImageNet
Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 38 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016

Recommended

Anime Generation with AI
Anime Generation with AIAnime Generation with AI
Anime Generation with AI
Koichi Hamada
 
Generative Adversarial Networks (GANs) and Disentangled Representations @ N...
Generative Adversarial Networks (GANs) and Disentangled Representations @ N...Generative Adversarial Networks (GANs) and Disentangled Representations @ N...
Generative Adversarial Networks (GANs) and Disentangled Representations @ N...
Koichi Hamada
 
AIによるアニメ生成の挑戦
AIによるアニメ生成の挑戦AIによるアニメ生成の挑戦
AIによるアニメ生成の挑戦
Koichi Hamada
 
Generative Adversarial Networks @ ICML 2019
Generative Adversarial Networks @ ICML 2019Generative Adversarial Networks @ ICML 2019
Generative Adversarial Networks @ ICML 2019
Koichi Hamada
 
Deepfakesの生成および検出
Deepfakesの生成および検出Deepfakesの生成および検出
Deepfakesの生成および検出
Plot Hong
 
Deep Learning Jump Start
Deep Learning Jump StartDeep Learning Jump Start
Deep Learning Jump Start
Michele Toni
 
[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks
[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks
[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks
Deep Learning JP
 
Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換
Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換
Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換
Koichi Hamada
 

Recommended

Anime Generation with AI
Anime Generation with AIAnime Generation with AI
Anime Generation with AI
Koichi Hamada
 
Generative Adversarial Networks (GANs) and Disentangled Representations @ N...
Generative Adversarial Networks (GANs) and Disentangled Representations @ N...Generative Adversarial Networks (GANs) and Disentangled Representations @ N...
Generative Adversarial Networks (GANs) and Disentangled Representations @ N...
Koichi Hamada
 
AIによるアニメ生成の挑戦
AIによるアニメ生成の挑戦AIによるアニメ生成の挑戦
AIによるアニメ生成の挑戦
Koichi Hamada
 
Generative Adversarial Networks @ ICML 2019
Generative Adversarial Networks @ ICML 2019Generative Adversarial Networks @ ICML 2019
Generative Adversarial Networks @ ICML 2019
Koichi Hamada
 
Deepfakesの生成および検出
Deepfakesの生成および検出Deepfakesの生成および検出
Deepfakesの生成および検出
Plot Hong
 
Deep Learning Jump Start
Deep Learning Jump StartDeep Learning Jump Start
Deep Learning Jump Start
Michele Toni
 
[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks
[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks
[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks
Deep Learning JP
 
Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換
Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換
Generative Adversarial Networks (GAN) の学習方法進展・画像生成・教師なし画像変換
Koichi Hamada
 
Value iteration networks
Value iteration networksValue iteration networks
Value iteration networks
Fujimoto Keisuke
 
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
Shuhei Yoshida
 
Dual Learning for Machine Translation (NIPS 2016)
Dual Learning for Machine Translation (NIPS 2016)Dual Learning for Machine Translation (NIPS 2016)
Dual Learning for Machine Translation (NIPS 2016)
Toru Fujino
 
時系列データ3
時系列データ3時系列データ3
時系列データ3graySpace999
 
Fast and Probvably Seedings for k-Means
Fast and Probvably Seedings for k-MeansFast and Probvably Seedings for k-Means
Fast and Probvably Seedings for k-Means
Kimikazu Kato
 
Interaction Networks for Learning about Objects, Relations and Physics
Interaction Networks for Learning about Objects, Relations and PhysicsInteraction Networks for Learning about Objects, Relations and Physics
Interaction Networks for Learning about Objects, Relations and Physics
Ken Kuroki
 
Introduction of "TrailBlazer" algorithm
Introduction of "TrailBlazer" algorithmIntroduction of "TrailBlazer" algorithm
Introduction of "TrailBlazer" algorithm
Katsuki Ohto
 
Learning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descentLearning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descent
Hiroyuki Fukuda
 
Conditional Image Generation with PixelCNN Decoders
Conditional Image Generation with PixelCNN DecodersConditional Image Generation with PixelCNN Decoders
Conditional Image Generation with PixelCNN Decoders
suga93
 
Safe and Efficient Off-Policy Reinforcement Learning
Safe and Efficient Off-Policy Reinforcement LearningSafe and Efficient Off-Policy Reinforcement Learning
Safe and Efficient Off-Policy Reinforcement Learning
mooopan
 
Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Introduction of “Fairness in Learning: Classic and Contextual Bandits”Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Kazuto Fukuchi
 
Improving Variational Inference with Inverse Autoregressive Flow
Improving Variational Inference with Inverse Autoregressive FlowImproving Variational Inference with Inverse Autoregressive Flow
Improving Variational Inference with Inverse Autoregressive Flow
Tatsuya Shirakawa
 
[DL輪読会]Convolutional Sequence to Sequence Learning
[DL輪読会]Convolutional Sequence to Sequence Learning[DL輪読会]Convolutional Sequence to Sequence Learning
[DL輪読会]Convolutional Sequence to Sequence Learning
Deep Learning JP
 
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
Kusano Hitoshi
 
Differential privacy without sensitivity [NIPS2016読み会資料]
Differential privacy without sensitivity [NIPS2016読み会資料]Differential privacy without sensitivity [NIPS2016読み会資料]
Differential privacy without sensitivity [NIPS2016読み会資料]
Kentaro Minami
 
Matching networks for one shot learning
Matching networks for one shot learningMatching networks for one shot learning
Matching networks for one shot learning
Kazuki Fujikawa
 
ICML2016読み会　概要紹介
ICML2016読み会　概要紹介ICML2016読み会　概要紹介
ICML2016読み会　概要紹介
Kohei Hayashi
 
論文紹介 Pixel Recurrent Neural Networks
論文紹介 Pixel Recurrent Neural Networks論文紹介 Pixel Recurrent Neural Networks
論文紹介 Pixel Recurrent Neural Networks
Seiya Tokui
 
Deep Learning - The Past, Present and Future of Artificial Intelligence
Deep Learning - The Past, Present and Future of Artificial IntelligenceDeep Learning - The Past, Present and Future of Artificial Intelligence
Deep Learning - The Past, Present and Future of Artificial Intelligence
Lukas Masuch
 
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Peter Wang
 
Achieving Software Assurance with Hybrid Analysis Mapping
Achieving Software Assurance with Hybrid Analysis Mapping Achieving Software Assurance with Hybrid Analysis Mapping
Achieving Software Assurance with Hybrid Analysis Mapping
Denim Group
 
PROTEUS H2020 at Ficloud2016
PROTEUS H2020 at Ficloud2016PROTEUS H2020 at Ficloud2016
PROTEUS H2020 at Ficloud2016
Nacho García Fernández
 

More Related Content

Viewers also liked

Value iteration networks
Value iteration networksValue iteration networks
Value iteration networks
Fujimoto Keisuke
 
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
Shuhei Yoshida
 
Dual Learning for Machine Translation (NIPS 2016)
Dual Learning for Machine Translation (NIPS 2016)Dual Learning for Machine Translation (NIPS 2016)
Dual Learning for Machine Translation (NIPS 2016)
Toru Fujino
 
時系列データ3
時系列データ3時系列データ3
時系列データ3graySpace999
 
Fast and Probvably Seedings for k-Means
Fast and Probvably Seedings for k-MeansFast and Probvably Seedings for k-Means
Fast and Probvably Seedings for k-Means
Kimikazu Kato
 
Interaction Networks for Learning about Objects, Relations and Physics
Interaction Networks for Learning about Objects, Relations and PhysicsInteraction Networks for Learning about Objects, Relations and Physics
Interaction Networks for Learning about Objects, Relations and Physics
Ken Kuroki
 
Introduction of "TrailBlazer" algorithm
Introduction of "TrailBlazer" algorithmIntroduction of "TrailBlazer" algorithm
Introduction of "TrailBlazer" algorithm
Katsuki Ohto
 
Learning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descentLearning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descent
Hiroyuki Fukuda
 
Conditional Image Generation with PixelCNN Decoders
Conditional Image Generation with PixelCNN DecodersConditional Image Generation with PixelCNN Decoders
Conditional Image Generation with PixelCNN Decoders
suga93
 
Safe and Efficient Off-Policy Reinforcement Learning
Safe and Efficient Off-Policy Reinforcement LearningSafe and Efficient Off-Policy Reinforcement Learning
Safe and Efficient Off-Policy Reinforcement Learning
mooopan
 
Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Introduction of “Fairness in Learning: Classic and Contextual Bandits”Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Kazuto Fukuchi
 
Improving Variational Inference with Inverse Autoregressive Flow
Improving Variational Inference with Inverse Autoregressive FlowImproving Variational Inference with Inverse Autoregressive Flow
Improving Variational Inference with Inverse Autoregressive Flow
Tatsuya Shirakawa
 
[DL輪読会]Convolutional Sequence to Sequence Learning
[DL輪読会]Convolutional Sequence to Sequence Learning[DL輪読会]Convolutional Sequence to Sequence Learning
[DL輪読会]Convolutional Sequence to Sequence Learning
Deep Learning JP
 
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
Kusano Hitoshi
 
Differential privacy without sensitivity [NIPS2016読み会資料]
Differential privacy without sensitivity [NIPS2016読み会資料]Differential privacy without sensitivity [NIPS2016読み会資料]
Differential privacy without sensitivity [NIPS2016読み会資料]
Kentaro Minami
 
Matching networks for one shot learning
Matching networks for one shot learningMatching networks for one shot learning
Matching networks for one shot learning
Kazuki Fujikawa
 
ICML2016読み会　概要紹介
ICML2016読み会　概要紹介ICML2016読み会　概要紹介
ICML2016読み会　概要紹介
Kohei Hayashi
 
論文紹介 Pixel Recurrent Neural Networks
論文紹介 Pixel Recurrent Neural Networks論文紹介 Pixel Recurrent Neural Networks
論文紹介 Pixel Recurrent Neural Networks
Seiya Tokui
 
Deep Learning - The Past, Present and Future of Artificial Intelligence
Deep Learning - The Past, Present and Future of Artificial IntelligenceDeep Learning - The Past, Present and Future of Artificial Intelligence
Deep Learning - The Past, Present and Future of Artificial Intelligence
Lukas Masuch
 

Viewers also liked (19)

Value iteration networks
Value iteration networksValue iteration networks
Value iteration networks
 
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
InfoGAN: Interpretable Representation Learning by Information Maximizing Gen...
 
Dual Learning for Machine Translation (NIPS 2016)
Dual Learning for Machine Translation (NIPS 2016)Dual Learning for Machine Translation (NIPS 2016)
Dual Learning for Machine Translation (NIPS 2016)
 
時系列データ3
時系列データ3時系列データ3
時系列データ3
 
Fast and Probvably Seedings for k-Means
Fast and Probvably Seedings for k-MeansFast and Probvably Seedings for k-Means
Fast and Probvably Seedings for k-Means
 
Interaction Networks for Learning about Objects, Relations and Physics
Interaction Networks for Learning about Objects, Relations and PhysicsInteraction Networks for Learning about Objects, Relations and Physics
Interaction Networks for Learning about Objects, Relations and Physics
 
Introduction of "TrailBlazer" algorithm
Introduction of "TrailBlazer" algorithmIntroduction of "TrailBlazer" algorithm
Introduction of "TrailBlazer" algorithm
 
Learning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descentLearning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descent
 
Conditional Image Generation with PixelCNN Decoders
Conditional Image Generation with PixelCNN DecodersConditional Image Generation with PixelCNN Decoders
Conditional Image Generation with PixelCNN Decoders
 
Safe and Efficient Off-Policy Reinforcement Learning
Safe and Efficient Off-Policy Reinforcement LearningSafe and Efficient Off-Policy Reinforcement Learning
Safe and Efficient Off-Policy Reinforcement Learning
 
Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Introduction of “Fairness in Learning: Classic and Contextual Bandits”Introduction of “Fairness in Learning: Classic and Contextual Bandits”
Introduction of “Fairness in Learning: Classic and Contextual Bandits”
 
Improving Variational Inference with Inverse Autoregressive Flow
Improving Variational Inference with Inverse Autoregressive FlowImproving Variational Inference with Inverse Autoregressive Flow
Improving Variational Inference with Inverse Autoregressive Flow
 
[DL輪読会]Convolutional Sequence to Sequence Learning
[DL輪読会]Convolutional Sequence to Sequence Learning[DL輪読会]Convolutional Sequence to Sequence Learning
[DL輪読会]Convolutional Sequence to Sequence Learning
 
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
論文紹介 Combining Model-Based and Model-Free Updates for Trajectory-Centric Rein...
 
Differential privacy without sensitivity [NIPS2016読み会資料]
Differential privacy without sensitivity [NIPS2016読み会資料]Differential privacy without sensitivity [NIPS2016読み会資料]
Differential privacy without sensitivity [NIPS2016読み会資料]
 
Matching networks for one shot learning
Matching networks for one shot learningMatching networks for one shot learning
Matching networks for one shot learning
 
ICML2016読み会　概要紹介
ICML2016読み会　概要紹介ICML2016読み会　概要紹介
ICML2016読み会　概要紹介
 
論文紹介 Pixel Recurrent Neural Networks
論文紹介 Pixel Recurrent Neural Networks論文紹介 Pixel Recurrent Neural Networks
論文紹介 Pixel Recurrent Neural Networks
 
Deep Learning - The Past, Present and Future of Artificial Intelligence
Deep Learning - The Past, Present and Future of Artificial IntelligenceDeep Learning - The Past, Present and Future of Artificial Intelligence
Deep Learning - The Past, Present and Future of Artificial Intelligence
 

Similar to NIPS 2016 Overview and Deep Learning Topics

Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Peter Wang
 
Achieving Software Assurance with Hybrid Analysis Mapping
Achieving Software Assurance with Hybrid Analysis Mapping Achieving Software Assurance with Hybrid Analysis Mapping
Achieving Software Assurance with Hybrid Analysis Mapping
Denim Group
 
PROTEUS H2020 at Ficloud2016
PROTEUS H2020 at Ficloud2016PROTEUS H2020 at Ficloud2016
PROTEUS H2020 at Ficloud2016
Nacho García Fernández
 
Deep Learningによる超解像の進歩
Deep Learningによる超解像の進歩Deep Learningによる超解像の進歩
Deep Learningによる超解像の進歩
Hiroto Honda
 
What you need to know to start an AI company?
What you need to know to start an AI company?What you need to know to start an AI company?
What you need to know to start an AI company?
Mo Patel
 
DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...
DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...
DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...
DataStax
 
IBM Power Systems Update 2Q17
IBM Power Systems Update 2Q17IBM Power Systems Update 2Q17
IBM Power Systems Update 2Q17
David Spurway
 
NAT64/DNS64 experiments, warnings and one useful tool
NAT64/DNS64 experiments, warnings and one useful toolNAT64/DNS64 experiments, warnings and one useful tool
NAT64/DNS64 experiments, warnings and one useful tool
APNIC
 
Benchmarking Linked Data Introductory Remarks
Benchmarking Linked Data Introductory RemarksBenchmarking Linked Data Introductory Remarks
Benchmarking Linked Data Introductory Remarks
Holistic Benchmarking of Big Linked Data
 
20160809_Keynote4_WD_Sivaram
20160809_Keynote4_WD_Sivaram20160809_Keynote4_WD_Sivaram
20160809_Keynote4_WD_SivaramSiva Sivaram
 
ION Durban - NAT64/DNS64 Experiments and the NAT64Check Tool
ION Durban - NAT64/DNS64 Experiments and the NAT64Check ToolION Durban - NAT64/DNS64 Experiments and the NAT64Check Tool
ION Durban - NAT64/DNS64 Experiments and the NAT64Check Tool
Deploy360 Programme (Internet Society)
 
OpenPOWER SC16 Recap: Day 2
OpenPOWER SC16 Recap: Day 2OpenPOWER SC16 Recap: Day 2
OpenPOWER SC16 Recap: Day 2
OpenPOWERorg
 
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs ConnectDemystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
PAPIs.io
 
Meaningful User Experience
Meaningful User ExperienceMeaningful User Experience
Meaningful User Experience
Neo4j
 
Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...
Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...
Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...
Seeling Cheung
 
SAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERA
SAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERASAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERA
SAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERA
Ori Pekelman
 
Cwin16 tls-datalab for scientists
Cwin16 tls-datalab for scientistsCwin16 tls-datalab for scientists
Cwin16 tls-datalab for scientists
Capgemini
 
Image Segmentation: Approaches and Challenges
Image Segmentation: Approaches and ChallengesImage Segmentation: Approaches and Challenges
Image Segmentation: Approaches and Challenges
Apache MXNet
 
GTC Europe 2017 Keynote
GTC Europe 2017 KeynoteGTC Europe 2017 Keynote
GTC Europe 2017 Keynote
NVIDIA
 
Janus conf'19: janus client side
Janus conf'19: janus client sideJanus conf'19: janus client side
Janus conf'19: janus client side
Alexandre Gouaillard
 

Similar to NIPS 2016 Overview and Deep Learning Topics (20)

Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
Python for Data: Past, Present, Future (PyCon JP 2017 Keynote)
 
Achieving Software Assurance with Hybrid Analysis Mapping
Achieving Software Assurance with Hybrid Analysis Mapping Achieving Software Assurance with Hybrid Analysis Mapping
Achieving Software Assurance with Hybrid Analysis Mapping
 
PROTEUS H2020 at Ficloud2016
PROTEUS H2020 at Ficloud2016PROTEUS H2020 at Ficloud2016
PROTEUS H2020 at Ficloud2016
 
Deep Learningによる超解像の進歩
Deep Learningによる超解像の進歩Deep Learningによる超解像の進歩
Deep Learningによる超解像の進歩
 
What you need to know to start an AI company?
What you need to know to start an AI company?What you need to know to start an AI company?
What you need to know to start an AI company?
 
DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...
DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...
DataStax | Meaningful User Experience with Graph Data (Chris Lacava, Expero) ...
 
IBM Power Systems Update 2Q17
IBM Power Systems Update 2Q17IBM Power Systems Update 2Q17
IBM Power Systems Update 2Q17
 
NAT64/DNS64 experiments, warnings and one useful tool
NAT64/DNS64 experiments, warnings and one useful toolNAT64/DNS64 experiments, warnings and one useful tool
NAT64/DNS64 experiments, warnings and one useful tool
 
Benchmarking Linked Data Introductory Remarks
Benchmarking Linked Data Introductory RemarksBenchmarking Linked Data Introductory Remarks
Benchmarking Linked Data Introductory Remarks
 
20160809_Keynote4_WD_Sivaram
20160809_Keynote4_WD_Sivaram20160809_Keynote4_WD_Sivaram
20160809_Keynote4_WD_Sivaram
 
ION Durban - NAT64/DNS64 Experiments and the NAT64Check Tool
ION Durban - NAT64/DNS64 Experiments and the NAT64Check ToolION Durban - NAT64/DNS64 Experiments and the NAT64Check Tool
ION Durban - NAT64/DNS64 Experiments and the NAT64Check Tool
 
OpenPOWER SC16 Recap: Day 2
OpenPOWER SC16 Recap: Day 2OpenPOWER SC16 Recap: Day 2
OpenPOWER SC16 Recap: Day 2
 
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs ConnectDemystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs Connect
 
Meaningful User Experience
Meaningful User ExperienceMeaningful User Experience
Meaningful User Experience
 
Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...
Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...
Fiducia & GAD IT AG: From Fraud Detection to Big Data Platform: Bringing Hado...
 
SAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERA
SAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERASAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERA
SAAS IS THE ENEMY OF OPEN SOURCE GOOD THING THAT WE ARE IN THE POST-SAAS ERA
 
Cwin16 tls-datalab for scientists
Cwin16 tls-datalab for scientistsCwin16 tls-datalab for scientists
Cwin16 tls-datalab for scientists
 
Image Segmentation: Approaches and Challenges
Image Segmentation: Approaches and ChallengesImage Segmentation: Approaches and Challenges
Image Segmentation: Approaches and Challenges
 
GTC Europe 2017 Keynote
GTC Europe 2017 KeynoteGTC Europe 2017 Keynote
GTC Europe 2017 Keynote
 
Janus conf'19: janus client side
Janus conf'19: janus client sideJanus conf'19: janus client side
Janus conf'19: janus client side
 

More from Koichi Hamada

Generative Adversarial Networks (GAN) @ NIPS2017
Generative Adversarial Networks (GAN) @ NIPS2017Generative Adversarial Networks (GAN) @ NIPS2017
Generative Adversarial Networks (GAN) @ NIPS2017
Koichi Hamada
 
DeNAのAI活用したサービス開発
DeNAのAI活用したサービス開発DeNAのAI活用したサービス開発
DeNAのAI活用したサービス開発
Koichi Hamada
 
対話返答生成における個性の追加反映
対話返答生成における個性の追加反映対話返答生成における個性の追加反映
対話返答生成における個性の追加反映
Koichi Hamada
 
DeNAの機械学習・深層学習活用した 体験提供の挑戦
DeNAの機械学習・深層学習活用した 体験提供の挑戦DeNAの機械学習・深層学習活用した 体験提供の挑戦
DeNAの機械学習・深層学習活用した 体験提供の挑戦
Koichi Hamada
 
Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...
Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...
Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...
Koichi Hamada
 
DeNAの大規模データマイニング活用したサービス開発
DeNAの大規模データマイニング活用したサービス開発DeNAの大規模データマイニング活用したサービス開発
DeNAの大規模データマイニング活用したサービス開発
Koichi Hamada
 
『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014
『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014
『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014
Koichi Hamada
 
『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点-
『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点- 『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点-
『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点-
Koichi Hamada
 
複雑ネットワーク上の伝搬法則の数理
複雑ネットワーク上の伝搬法則の数理複雑ネットワーク上の伝搬法則の数理
複雑ネットワーク上の伝搬法則の数理
Koichi Hamada
 
データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望
データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望 データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望
データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望
Koichi Hamada
 
データマイニングCROSS 第２部－機械学習・大規模分散処理
データマイニングCROSS 第２部－機械学習・大規模分散処理データマイニングCROSS 第２部－機械学習・大規模分散処理
データマイニングCROSS 第２部－機械学習・大規模分散処理
Koichi Hamada
 
Large Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #Hadoop
Large Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #HadoopLarge Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #Hadoop
Large Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #Hadoop
Koichi Hamada
 
"Mahout Recommendation" - #TokyoWebmining 14th
"Mahout Recommendation" - #TokyoWebmining 14th"Mahout Recommendation" - #TokyoWebmining 14th
"Mahout Recommendation" - #TokyoWebmining 14th
Koichi Hamada
 
Mahout JP - #TokyoWebmining 11th #MahoutJP
Mahout JP - #TokyoWebmining 11th #MahoutJP Mahout JP - #TokyoWebmining 11th #MahoutJP
Mahout JP - #TokyoWebmining 11th #MahoutJP
Koichi Hamada
 
10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...
10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...
10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...
Koichi Hamada
 
『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011
『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011 『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011
『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011
Koichi Hamada
 
「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11
「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11
「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11
Koichi Hamada
 
Mahout Canopy Clustering - #TokyoWebmining 9
Mahout Canopy Clustering - #TokyoWebmining 9Mahout Canopy Clustering - #TokyoWebmining 9
Mahout Canopy Clustering - #TokyoWebmining 9
Koichi Hamada
 
Apache Mahout - Random Forests - #TokyoWebmining #8
Apache Mahout - Random Forests - #TokyoWebmining #8 Apache Mahout - Random Forests - #TokyoWebmining #8
Apache Mahout - Random Forests - #TokyoWebmining #8
Koichi Hamada
 
「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー
「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー
「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー
Koichi Hamada
 

More from Koichi Hamada (20)

Generative Adversarial Networks (GAN) @ NIPS2017
Generative Adversarial Networks (GAN) @ NIPS2017Generative Adversarial Networks (GAN) @ NIPS2017
Generative Adversarial Networks (GAN) @ NIPS2017
 
DeNAのAI活用したサービス開発
DeNAのAI活用したサービス開発DeNAのAI活用したサービス開発
DeNAのAI活用したサービス開発
 
対話返答生成における個性の追加反映
対話返答生成における個性の追加反映対話返答生成における個性の追加反映
対話返答生成における個性の追加反映
 
DeNAの機械学習・深層学習活用した 体験提供の挑戦
DeNAの機械学習・深層学習活用した 体験提供の挑戦DeNAの機械学習・深層学習活用した 体験提供の挑戦
DeNAの機械学習・深層学習活用した 体験提供の挑戦
 
Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...
Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...
Laplacian Pyramid of Generative Adversarial Networks (LAPGAN) - NIPS2015読み会 #...
 
DeNAの大規模データマイニング活用したサービス開発
DeNAの大規模データマイニング活用したサービス開発DeNAの大規模データマイニング活用したサービス開発
DeNAの大規模データマイニング活用したサービス開発
 
『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014
『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014
『MobageのAnalytics活用したサービス開発』 - データマイニングCROSS2014 #CROSS2014
 
『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点-
『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点- 『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点-
『Mobageの大規模データマイニング活用と 意思決定』- #IBIS 2012 -ビジネスと機械学習の接点-
 
複雑ネットワーク上の伝搬法則の数理
複雑ネットワーク上の伝搬法則の数理複雑ネットワーク上の伝搬法則の数理
複雑ネットワーク上の伝搬法則の数理
 
データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望
データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望 データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望
データマイニングCROSS 2012 Opening Talk - データマイニングの実サービス・ビジネス適用と展望
 
データマイニングCROSS 第２部－機械学習・大規模分散処理
データマイニングCROSS 第２部－機械学習・大規模分散処理データマイニングCROSS 第２部－機械学習・大規模分散処理
データマイニングCROSS 第２部－機械学習・大規模分散処理
 
Large Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #Hadoop
Large Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #HadoopLarge Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #Hadoop
Large Scale Data Mining of the Mobage Service - #PRMU 2011 #Mahout #Hadoop
 
"Mahout Recommendation" - #TokyoWebmining 14th
"Mahout Recommendation" - #TokyoWebmining 14th"Mahout Recommendation" - #TokyoWebmining 14th
"Mahout Recommendation" - #TokyoWebmining 14th
 
Mahout JP - #TokyoWebmining 11th #MahoutJP
Mahout JP - #TokyoWebmining 11th #MahoutJP Mahout JP - #TokyoWebmining 11th #MahoutJP
Mahout JP - #TokyoWebmining 11th #MahoutJP
 
10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...
10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...
10回開催記念 「データマイニング＋WEB ～データマイニング・機械学習活用による継続進化～」ー第10回データマイニング+WEB勉強会＠東京ー #Toky...
 
『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011
『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011 『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011
『モバゲーの大規模データマイニング基盤におけるHadoop活用』－Hadoop Conference Japan 2011－ #hcj2011
 
「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11
「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11
「R言語による Random Forest 徹底入門 －集団学習による分類・予測－」 - #TokyoR #11
 
Mahout Canopy Clustering - #TokyoWebmining 9
Mahout Canopy Clustering - #TokyoWebmining 9Mahout Canopy Clustering - #TokyoWebmining 9
Mahout Canopy Clustering - #TokyoWebmining 9
 
Apache Mahout - Random Forests - #TokyoWebmining #8
Apache Mahout - Random Forests - #TokyoWebmining #8 Apache Mahout - Random Forests - #TokyoWebmining #8
Apache Mahout - Random Forests - #TokyoWebmining #8
 
「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー
「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー
「樹木モデルとランダムフォレスト－機械学習による分類・予測－」－データマイニングセミナー
 

Recently uploaded

Anemia_ different types_causes_ conditions
Anemia_ different types_causes_ conditionsAnemia_ different types_causes_ conditions
Anemia_ different types_causes_ conditions
muralinath2
 
Comparative structure of adrenal gland in vertebrates
Comparative structure of adrenal gland in vertebratesComparative structure of adrenal gland in vertebrates
Comparative structure of adrenal gland in vertebrates
sachin783648
 
Viksit bharat till 2047 India@2047.pptx
Viksit bharat till 2047 India@2047.pptxViksit bharat till 2047 India@2047.pptx
Viksit bharat till 2047 India@2047.pptx
rakeshsharma20142015
 
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATIONPRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
ChetanK57
 
Hemoglobin metabolism_pathophysiology.pptx
Hemoglobin metabolism_pathophysiology.pptxHemoglobin metabolism_pathophysiology.pptx
Hemoglobin metabolism_pathophysiology.pptx
muralinath2
 
justice-and-fairness-ethics with example
justice-and-fairness-ethics with examplejustice-and-fairness-ethics with example
justice-and-fairness-ethics with example
azzyixes
 
EY - Supply Chain Services 2018_template.pptx
EY - Supply Chain Services 2018_template.pptxEY - Supply Chain Services 2018_template.pptx
EY - Supply Chain Services 2018_template.pptx
AlguinaldoKong
 
RNA INTERFERENCE: UNRAVELING GENETIC SILENCING
RNA INTERFERENCE: UNRAVELING GENETIC SILENCINGRNA INTERFERENCE: UNRAVELING GENETIC SILENCING
RNA INTERFERENCE: UNRAVELING GENETIC SILENCING
AADYARAJPANDEY1
 
Lab report on liquid viscosity of glycerin
Lab report on liquid viscosity of glycerinLab report on liquid viscosity of glycerin
Lab report on liquid viscosity of glycerin
ossaicprecious19
 
platelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptxplatelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptx
muralinath2
 
Multi-source connectivity as the driver of solar wind variability in the heli...
Multi-source connectivity as the driver of solar wind variability in the heli...Multi-source connectivity as the driver of solar wind variability in the heli...
Multi-source connectivity as the driver of solar wind variability in the heli...
Sérgio Sacani
 
Richard's entangled aventures in wonderland
Richard's entangled aventures in wonderlandRichard's entangled aventures in wonderland
Richard's entangled aventures in wonderland
Richard Gill
 
ESR_factors_affect-clinic significance-Pathysiology.pptx
ESR_factors_affect-clinic significance-Pathysiology.pptxESR_factors_affect-clinic significance-Pathysiology.pptx
ESR_factors_affect-clinic significance-Pathysiology.pptx
muralinath2
 
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Sérgio Sacani
 
insect morphology and physiology of insect
insect morphology and physiology of insectinsect morphology and physiology of insect
insect morphology and physiology of insect
anitaento25
 
In silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptxIn silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptx
AlaminAfendy1
 
SCHIZOPHRENIA Disorder/ Brain Disorder.pdf
SCHIZOPHRENIA Disorder/ Brain Disorder.pdfSCHIZOPHRENIA Disorder/ Brain Disorder.pdf
SCHIZOPHRENIA Disorder/ Brain Disorder.pdf
SELF-EXPLANATORY
 
Unveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdfUnveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdf
Erdal Coalmaker
 
Astronomy Update- Curiosity’s exploration of Mars _ Local Briefs _ leadertele...
Astronomy Update- Curiosity’s exploration of Mars _ Local Briefs _ leadertele...Astronomy Update- Curiosity’s exploration of Mars _ Local Briefs _ leadertele...
Astronomy Update- Curiosity’s exploration of Mars _ Local Briefs _ leadertele...
NathanBaughman3
 
Hemostasis_importance& clinical significance.pptx
Hemostasis_importance& clinical significance.pptxHemostasis_importance& clinical significance.pptx
Hemostasis_importance& clinical significance.pptx
muralinath2
 

Recently uploaded (20)

Anemia_ different types_causes_ conditions
Anemia_ different types_causes_ conditionsAnemia_ different types_causes_ conditions
Anemia_ different types_causes_ conditions
 
Comparative structure of adrenal gland in vertebrates
Comparative structure of adrenal gland in vertebratesComparative structure of adrenal gland in vertebrates
Comparative structure of adrenal gland in vertebrates
 
Viksit bharat till 2047 India@2047.pptx
Viksit bharat till 2047 India@2047.pptxViksit bharat till 2047 India@2047.pptx
Viksit bharat till 2047 India@2047.pptx
 
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATIONPRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
 
Hemoglobin metabolism_pathophysiology.pptx
Hemoglobin metabolism_pathophysiology.pptxHemoglobin metabolism_pathophysiology.pptx
Hemoglobin metabolism_pathophysiology.pptx
 
justice-and-fairness-ethics with example
justice-and-fairness-ethics with examplejustice-and-fairness-ethics with example
justice-and-fairness-ethics with example
 
EY - Supply Chain Services 2018_template.pptx
EY - Supply Chain Services 2018_template.pptxEY - Supply Chain Services 2018_template.pptx
EY - Supply Chain Services 2018_template.pptx
 
RNA INTERFERENCE: UNRAVELING GENETIC SILENCING
RNA INTERFERENCE: UNRAVELING GENETIC SILENCINGRNA INTERFERENCE: UNRAVELING GENETIC SILENCING
RNA INTERFERENCE: UNRAVELING GENETIC SILENCING
 
Lab report on liquid viscosity of glycerin
Lab report on liquid viscosity of glycerinLab report on liquid viscosity of glycerin
Lab report on liquid viscosity of glycerin
 
platelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptxplatelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptx
 
Multi-source connectivity as the driver of solar wind variability in the heli...
Multi-source connectivity as the driver of solar wind variability in the heli...Multi-source connectivity as the driver of solar wind variability in the heli...
Multi-source connectivity as the driver of solar wind variability in the heli...
 
Richard's entangled aventures in wonderland
Richard's entangled aventures in wonderlandRichard's entangled aventures in wonderland
Richard's entangled aventures in wonderland
 
ESR_factors_affect-clinic significance-Pathysiology.pptx
ESR_factors_affect-clinic significance-Pathysiology.pptxESR_factors_affect-clinic significance-Pathysiology.pptx
ESR_factors_affect-clinic significance-Pathysiology.pptx
 
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
 
insect morphology and physiology of insect
insect morphology and physiology of insectinsect morphology and physiology of insect
insect morphology and physiology of insect
 
In silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptxIn silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptx
 
SCHIZOPHRENIA Disorder/ Brain Disorder.pdf
SCHIZOPHRENIA Disorder/ Brain Disorder.pdfSCHIZOPHRENIA Disorder/ Brain Disorder.pdf
SCHIZOPHRENIA Disorder/ Brain Disorder.pdf
 
Unveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdfUnveiling the Energy Potential of Marshmallow Deposits.pdf
Unveiling the Energy Potential of Marshmallow Deposits.pdf
 
Astronomy Update- Curiosity’s exploration of Mars _ Local Briefs _ leadertele...
Astronomy Update- Curiosity’s exploration of Mars _ Local Briefs _ leadertele...Astronomy Update- Curiosity’s exploration of Mars _ Local Briefs _ leadertele...
Astronomy Update- Curiosity’s exploration of Mars _ Local Briefs _ leadertele...
 
Hemostasis_importance& clinical significance.pptx
Hemostasis_importance& clinical significance.pptxHemostasis_importance& clinical significance.pptx
Hemostasis_importance& clinical significance.pptx
 

NIPS 2016 Overview and Deep Learning Topics

  • 1. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. NIPS 2016 読み会 @Preferred Networks 2017/1/19 NIPS 2016 Overview and Deep Learning Topics @hamadakoichi 濱田晃一 Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved.
  • 2. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 2 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 3. 3 Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. 講師 ・TokyoWebmining 主催者 　- 機械学習の実活用コミュニティ。登録人数 1500人超。 　- 7年継続、累積59回開催 濱田晃一 (@hamadakoichi) ・執筆：Mobageを支える技術 Analytics Architect ・博士 : 量子統計場の理論 (理論物理) ・DeNA全サービスを対象とし、大規模機械学習活用したサービス開発 　- 数千万ユーザー、50億アクション/日、テキスト、画像、ソーシャルグラフ 　- 体験設計から、分散学習アルゴリズムの設計・実装まで ・Deep Learning 　- 画像表現学習・画像生成 　　 対話・キャラクター表現学習、等
  • 4. 4 Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 5. 5 Copyright (C) 2014 DeNA Co.,Ltd. All Rights Reserved. AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 6. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 6 NIPS 2016 ・第30回の開催 ・期間： 2016年12月5-10日 ・ICML 33回に続き長い伝統 ・チュートリアル: 5(1日) ・本会議: 5-8(4日) ・ワークショップ: 9-10(2日) ・開催地： バルセロナ(スペイン) 貼る：会場雰囲気
  • 7. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 7 NIPS 2016 参加者が 6000人に増加 (2015年の1.5倍) ※Terrence Sejnowskiは NIPS foundationの President
  • 8. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 8 NIPS Features ・採択の92%はポスター ・採択率: 23% ・投稿数: 2500+、採択数： 568 ・Oral(45) : 20分の口頭発表 + ポスター ・Poster(523) ： ポスターのみ ・少数トラックでの進行(最大3) （昨年までシングルトラックだったがパラレルに）
  • 9. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 9 NIPS Features ・ポスター発表による活発な議論 (昨年までの19-24時の5時間ポスターからは時間縮小したが、最後まで活発な議論） ・210 min(3.5 hour)/ day ・130 Poster x 4 days
  • 10. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 10 NIPS2016 Hot Topics 引用元： The review process for NIPS 2016 http://www.tml.cs.uni-tuebingen.de/team/ luxburg/misc/nips2016/index.php Deep Learning Computer Vision Large Scale Learning Learning Theory Optimization Sparsity
  • 11. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 11 NIPS2016 Hot Topics Tutorial 3/9、Symposium 2/3 が Deep Learning Reinforcement Learning, Generative Adversarial Net, Recurrent Net Tutorial Symposium
  • 12. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 12 NIPS2016 Hot Topics Tutorial Symposium Tutorial 3/9、Symposium 2/3 が Deep Learning Reinforcement Learning, Generative Adversarial Net, Recurrent Net 上記2トピックに関し、本会議論文をピックアップし概要紹介します (Reinforcement Learningは、このNIPS読み会での個別論文の発表も多いため)
  • 13. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 13 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 14. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 14 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 15. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 15 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 16. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 16 Generative Adversarial Network (GAN) Generative Adversarial Nets(GAN) Goodfellow+, NIPS2014
  • 17. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 17 Generative Adversarial Network (GAN) Generator(生成器)と Discriminator(識別器)を戦わせ 生成精度を向上させる 識別器: “本物画像”と “生成器が作った偽画像”を識別する 生成器: 生成画像を識別器に“本物画像”と誤識別させようとする (Goodfellow+, NIPS2014, Deep Learning Workshop, Presentation)
  • 18. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 18 Generative Adversarial Network (GAN) Minimax Objective function Discriminator が 「本物画像」を「本物」と識別 (Goodfellow+, NIPS2014, Deep Learning Workshop, Presentation) Discriminator が 「生成画像」を「偽物」と識別する Discriminatorは 正しく識別しようとする （最大化） Generatorは Discriminator に誤識別させようとする（最小化） Generator(生成器)と Discriminator(識別器)を戦わせ 生成精度を向上させる
  • 19. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 19 自然画像の表現ベクトル空間学習・演算・画像生成 ICLR16: Deep Convolutional GAN : DCGAN (Radford+) 自然画像のクリアな画像生成 画像演算 Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. Alec Radford, Luke Metz, Soumith Chintala. arXiv:1511.06434. In ICLR 2016.
  • 20. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 20 ICML16: Autoencoding beyond pixels (Larsen+) Autoencoding beyond pixels using a learned similarity metric. Anders Boesen Lindbo Larsen, Søren Kaae Sønderby, Hugo Larochelle, Ole Winther. arXiv:1512.09300. In ICML 2016. 自然画像の表現ベクトル空間学習・演算・画像生成
  • 21. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 21 ICML16: Generative Adversarial Text to Image Synthesis(Reed+) Generative Adversarial Text to Image Synthesis. Scott Reed, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, Honglak Lee. arXiv:1605.05396. In ICML 2016. 文章からの画像生成 文章で条件付したGAN
  • 22. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 22 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 23. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 23 Generative Adversarial Text to Image Synthesis(Reed+) Learning What and Where to Draw. Scott Reed, Zeynep Akata, Santosh Mohan, Samuel Tenka, Bernt Schiele, Honglak Lee. arXiv:1610.02454. In NIPS 2016. 文章からの画像生成 表示位置情報も条件付したGAN
  • 24. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 24 InfoGAN (Chen+) InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets. Xi Chen, Yan Duan, Rein Houthooft, John Schulman, Ilya Sutskever, Pieter Abbeel. arXiv:1606.03657. In NIPS 2016 Latent code c、Generator 出力との Mutual Information を加え GANで狙って表現ベクトル空間を学習
  • 25. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 25 3Dモデルの表現ベクトル空間学習・演算・生成 3D GAN (Wu+) 3Dモデルの生成 3Dモデル演算 写真からの3Dモデル生成 3D VAE-GAN 3D GAN Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling. Jiajun Wu, Chengkai Zhang, Tianfan Xue, William T. Freeman, Joshua B. Tenenbaum. arXiv:1610.07584. In NIPS 2016.
  • 26. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 26 Generating Videos with Scene Dynamics(Vondrick+) 動画の表現ベクトル空間学習・動画生成 Generating Videos with Scene Dynamics. Carl Vondrick, Hamed Pirsiavash, Antonio Torralba. In NIPS 2016. http://web.mit.edu/vondrick/tinyvideo/ 動画生成 1画像からその後の動画生成
  • 27. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 27 f-GAN (Nowozin+) GAN目的関数を Symmetric JS-divergence から f-divergence に一般化。各Divergence を用い学習・評価 f-GAN: Training Generative Neural samplers using variational Divergence Minimization. Sebastian Nowozin, Botond Cseke, Ryota Tomioka. arXiv:1606.00709. In NIPS 2016. Kernel Density Estimation on the MNIST f-divergence LSUN
  • 28. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 28 Improved Techniques for Training GANs (Salimans+) Improved Techniques for Training GANs. Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, Xi Chen. arXiv:1606.03498. In NIPS 2016. 収束が難しいGANの学習方法論 GAN半教師あり学習 1. Feature Matching 2. Minibatch discrimination 3. Historical averaging 4. One-sided label smoothing 5. Virtual batch normalization Techniques Semi-supervised learning MNIST Semi-supervised training with feature matching Semi-supervised training with feature matching and minibatch discrimination CIFAR-10 Generated samples
  • 29. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 29 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 30. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 30 Extended Architectures for Generative Adversarial Nets 2016 Extended Architectures for GANs Figure by Chris Olah (2016) : https://twitter.com/ch402/status/793535193835417601 Ex) Conditional Image Synthesis With Auxiliary Classifier GANs. Augustus Odena, Christopher Olah, Jonathon Shlens. arXiv:1610.09585. Generative Adversarial Net の各種拡張
  • 31. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 31 Stack GAN: Text to PhotoRealistic Image Synthesis(Zhang+2016) 1段目で文章から低解像度画像を生成 2段目で低解像度画像から高解像度画像を生成 StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks. Han Zhang, Tao Xu, Hongsheng Li, Shaoting Zhang, Xiaolei Huang, Xiaogang Wang, Dimitris Metaxas. arXiv:1612.03242.
  • 32. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 32 Plug & Play Generative Networks (Nguyen+2016) 高解像度な画像生成 227 x 227 ImageNet Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space. Anh Nguyen, Jason Yosinski, Yoshua Bengio, Alexey Dosovitskiy, Jeff Clune. arXiv:1612.00005.
  • 33. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 33 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016
  • 34. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 34 Phased LSTM (Neil+) 時間で開閉するGateを導入した LSTM Sensor Data 等、Event 駆動の長期系列特徴を学習 Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequences. Daniel Neil, Michael Pfeiffer, Shih-Chii Liu. arXiv:1610.09513. In NIPS 2016. LSTM Phased LSTM Phased LSTM Behavior Frequency Discrimination Task
  • 35. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 35 Using Fast Weights to Attend to the Recent Past (Ba+) 早く学習・減衰する Fast Weight 追加で、系列固有の情報を扱う Slow Weight での長期特徴とあわせ、双方の系列特徴を学習 Using Fast Weights to Attend to the Recent Past. Jimmy Ba, Geoffrey Hinton, Volodymyr Mnih, Joel Z. Leibo, Catalin Ionescu. arXiv:1610.06258. In NIPS 2016. Associative Retrieval Task Classification Error Test Log Likelihood
  • 36. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 36 Learning to learn by GD by GD (Andrychowicz+) LSTMを用いたOptimizer Parameterごとに 勾配系列から適切な次の更新量を算出 Learning to learn by gradient descent by gradient descent. Marcin Andrychowicz, Misha Denil, Sergio Gomez, Matthew W. Hoffman, David Pfau, Tom Schaul, Brendan Shillingford, Nando de Freitas. arXiv:1606.04474. In NIPS 2016.
  • 37. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 37 Matching Network for One Shot Learning (Vinyals+) Attention Mechanism を用いた One Shot Learning 参照構造を学習しておき、新規小規模データセットでも高精度で動作 Matching Networks for One Shot Learning. Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Koray Kavukcuoglu, Daan Wierstra. arXiv:1606.04080. In NIPS 2016. Omniglot miniImageNet
  • 38. Copyright (C) 2016 DeNA Co.,Ltd. All Rights Reserved. 38 AGENDA ◆Deep Learning Topics ◆NIPS 2016 Overview ◆Generative Adversarial Networks(GANs) ◆Recurrent Neural Networks(RNNs) ◆GANs ◆GANs in NIPS2016 ◆Recent GANs ◆RNNs in NIPS2016