ゼロから始める深層強化学習(NLP2018講演資料)/ Introduction of Deep Reinforcement LearningPreferred Networks
Introduction of Deep Reinforcement Learning, which was presented at domestic NLP conference.
言語処理学会第24回年次大会(NLP2018) での講演資料です。
http://www.anlp.jp/nlp2018/#tutorial
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
http://arxiv.org/abs/1609.08144
を読んでみたので、簡単にまとめました。間違い等は是非ご指摘ください。
ゼロから始める深層強化学習(NLP2018講演資料)/ Introduction of Deep Reinforcement LearningPreferred Networks
Introduction of Deep Reinforcement Learning, which was presented at domestic NLP conference.
言語処理学会第24回年次大会(NLP2018) での講演資料です。
http://www.anlp.jp/nlp2018/#tutorial
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
http://arxiv.org/abs/1609.08144
を読んでみたので、簡単にまとめました。間違い等は是非ご指摘ください。
The detailed results are described at GitHub (in English):
https://github.com/jkatsuta/exp-18-1q
(maddpg/experiments/my_notes/のexp1 ~ exp6)
立教大学のセミナー資料(前篇)です。
資料後篇:
https://www.slideshare.net/JunichiroKatsuta/ss-108099542
ブログ(動画あり):
https://recruit.gmo.jp/engineer/jisedai/blog/multi-agent-reinforcement-learning/
This document summarizes a research paper that proposes a technique called Stable Rank Normalization to improve generalization in neural networks and GANs. The technique aims to reduce the Lipschitz constant of neural networks by normalizing the stable rank of the weight matrices. The stable rank is a measure of how many effective dimensions a matrix has. Normalizing it makes networks less sensitive to certain parameter settings. The paper shows experimentally that stable rank normalization improves generalization on image recognition and GAN tasks without affecting performance.
The document summarizes a research paper that compares the performance of MLP-based models to Transformer-based models on various natural language processing and computer vision tasks. The key points are:
1. Gated MLP (gMLP) architectures can achieve performance comparable to Transformers on most tasks, demonstrating that attention mechanisms may not be strictly necessary.
2. However, attention still provides benefits for some NLP tasks, as models combining gMLP and attention outperformed pure gMLP models on certain benchmarks.
3. For computer vision, gMLP achieved results close to Vision Transformers and CNNs on image classification, indicating gMLP can match their data efficiency.
The detailed results are described at GitHub (in English):
https://github.com/jkatsuta/exp-18-1q
(maddpg/experiments/my_notes/のexp1 ~ exp6)
立教大学のセミナー資料(前篇)です。
資料後篇:
https://www.slideshare.net/JunichiroKatsuta/ss-108099542
ブログ(動画あり):
https://recruit.gmo.jp/engineer/jisedai/blog/multi-agent-reinforcement-learning/
This document summarizes a research paper that proposes a technique called Stable Rank Normalization to improve generalization in neural networks and GANs. The technique aims to reduce the Lipschitz constant of neural networks by normalizing the stable rank of the weight matrices. The stable rank is a measure of how many effective dimensions a matrix has. Normalizing it makes networks less sensitive to certain parameter settings. The paper shows experimentally that stable rank normalization improves generalization on image recognition and GAN tasks without affecting performance.
The document summarizes a research paper that compares the performance of MLP-based models to Transformer-based models on various natural language processing and computer vision tasks. The key points are:
1. Gated MLP (gMLP) architectures can achieve performance comparable to Transformers on most tasks, demonstrating that attention mechanisms may not be strictly necessary.
2. However, attention still provides benefits for some NLP tasks, as models combining gMLP and attention outperformed pure gMLP models on certain benchmarks.
3. For computer vision, gMLP achieved results close to Vision Transformers and CNNs on image classification, indicating gMLP can match their data efficiency.
This document discusses 3D printing and its applications in education. It mentions chapters 9 and 12 from a book on 3D printing. It discusses using 3D printing to teach concepts in STEM fields through hands-on projects. Examples mentioned include a website and YouTube channel for 3D printing projects for education. The document also discusses learning theories that support how 3D printing can enhance learning, such as legitimate peripheral participation and situated cognition theory.
This document is a biography and list of publications for Tonny Meng-Lun Kuo from the Institute of Learning Sciences at National Tsing Hua University. It includes Kuo's contact information and lists several publications presented at conferences between 2013-2015 related to using technology like iPads and MOOCs to facilitate language learning. The publications explore topics like selecting apps to improve English skills, using tablets to aid vocabulary learning, and examining the "flipped classroom" approach to promote active learning.
1. The document discusses using technology to assist Chinese language teaching and introduces the ASSURE instructional design model.
2. It explains each step of the ASSURE model, including analyzing learners, stating objectives, selecting strategies and tools, utilizing tools, requiring learner participation, and evaluation.
3. Examples of tools discussed include iPad apps, websites, and strategies like drill practice, simulations, and educational games. The goal is to engage students and support various learning styles.
1. Prezi is a cloud-based presentation software that uses a zooming user interface to navigate nonlinear presentations on a virtual canvas.
2. The document provides instructions on applying for a free educational Prezi account using a school email address and filling out school details.
3. An overview is given of tips for making effective Prezi slides, including brainstorming, organizing concepts, and using the zoom features to focus on or reveal relationships between points. Advantages like information visualization and online collaboration, as well as limitations such as only English interface and potential for nausea from the zooming, are highlighted.
This document provides an overview of a presentation on teaching activities for Mandarin teachers of young learners. It discusses 1) identifying the characteristics of young learners, 2) differentiating teaching methods for young and adult learners, and 3) common activity types for different proficiency levels. A variety of activity examples are also provided, including listening and speaking activities like surveys and storytelling, as well as reading and writing activities and vocabulary games. Principles for designing effective materials for young learners are emphasized.
E-learning website observation & analysis: Starfall.comTonny Kuo
This document analyzes the educational website Starfall.com. It begins with an overview and history of the site, which was launched in 2002 to provide early literacy skills to English language learners. The document then analyzes the site based on theories of web-based learning and instructional design. It finds that the site effectively uses multimedia and an intuitive interface based on principles of visual perception. However, it lacks social interaction features and personalization. The document concludes that while the site provides rich educational materials, designers should incorporate more modern features to engage digital learners.
- The document outlines learning objectives and tasks for a class on improving English skills. It includes introducing oneself, defining learning English, understanding reading and vocabulary tips, using Web 2.0 tools, identifying reading skills, listening to video clips, and setting goals. The class covers topics like the reading process, reading tips, vocabulary development, and assignments. Students are asked to introduce themselves, discuss learning experiences, participate in warm-up discussions and a listening test, and complete other tasks.
This short document in Chinese introduces several small animals - a mouse, fish, lion, and horse. It uses the term "xiǎo" which means small in front of each animal, describing them as little versions.