TEST

1. Overall research performance
Entity: Reinforcement learning; Artificial intelligence; Hierarchical reinforcement T.12457 ·
Year range: 2014 to 2019· Data source: Scopus, up to 08 Apr 2020·
AI reporting - Reinforcement learning; Artificial
intelligence; Hierarchical reinforcement
818
Scholarly Output
1.72
Field-Weighted Citation Impact
159
International Collaboration
5,793
Views Count
4,405
Citation Count
93.577
Topic Prominence percentile
100 240 1.08 1.13 21 39

2. Keyphrase analysis
Entity: Reinforcement learning; Artificial intelligence; Hierarchical reinforcement T.12457 ·
Year range: 2014 to 2019· Data source: Scopus, up to 08 Apr 2020·
A A A relevance of keyphrase | declining A A A growing (2014-2018)
Learning systems
Artificial intelligence
Public policyLearning algorithms
Agents
Natural resources exploration
Multi agent systems
Autonomous agents
Algorithms
Markov processes
Robots
Robotics
Functions
Planning
Models
Intelligent agents
Decision making
Demonstrations
Stochastic systems
Personnel training
Abstracting
Curricula
Knowledge management
Setting
Dynamics
Sampling
Navigation
Neural networks
Foundations
Behavioral research
Robot programming
Motion planning
Simulators
Bayesian networks
Computer aided instruction
Gradient methods
Association reactions
Trajectories
Iterative methods
Intelligent robots
Control
Motivation
Robot learning
Reinforcement
Inference engines Optimization
Software agents
Probability distributions
Errors

3. Scholarly Output
Entity: Reinforcement learning; Artificial intelligence; Hierarchical reinforcement T.12457 ·
Year range: 2014 to 2019· Data source: Scopus, up to 08 Apr 2020·
Citation Count
Entity: Reinforcement learning; Artificial intelligence; Hierarchical reinforcement T.12457 ·
Year range: 2014 to 2019· Data source: Scopus, up to 08 Apr 2020·
Incomplete year
Publications
Worldwide 818
Asia Pacific 217
South Korea 14
Chung-Ang University2014 2015 2016 2017 2018 2019
0
50
100
150
200
250
300
Incomplete year
Citations
Worldwide 4,405
Asia Pacific 489
South Korea 16
Chung-Ang
University
2014 2015 2016 2017 2018 2019
0
200
400
600
800
1,000
1,200
1,400

4. Outputs in Top 10% Citation Percentiles (field-weighted)
Entity: Reinforcement learning; Artificial intelligence; Hierarchical reinforcement T.12457 ·
Year range: 2014 to 2019· Data source: Scopus, up to 08 Apr 2020·
Share of publications in Reinforcement learning; Artificial intelligence; Hierarchical reinforcement that are
among the most cited publications worldwide
field-weighted
Incomplete year
Share of
publications in
top 1% most
cited publications
Share of
publications in
top 10% most
cited publications
Worldwide 3.8% 18.6%
Asia
Pacific
0.9% 7.8%
South
Korea
0.0% 7.1%
Chung-
Ang
University
2014 2015 2016 2017 2018 2019
0%
5%
10%
15%
20%
25%
30%
35%

5. Publications in Top Journal Percentiles by CiteScore Percentile
Entity: Reinforcement learning; Artificial intelligence; Hierarchical reinforcement T.12457 ·
Year range: 2014 to 2019· Data source: Scopus, up to 08 Apr 2020·
Share of publications in Reinforcement learning; Artificial intelligence; Hierarchical reinforcement that are
in the top journals by CiteScore Percentile
Incomplete year
Share of
publications in
top 1% journals
Share of
publications in
top 10% journals
Worldwide 5.6% 18.5%
Asia
Pacific
4.8% 19.2%
South
Korea
0.0% 0.0%
Chung-
Ang
University
2014 2015 2016 2017 2018 2019
0%
5%
10%
15%
20%
25%
30%
35%

6. Top countries/regions
Entity: Reinforcement learning; Artificial intelligence; Hierarchical reinforcement T.12457 ·
Year range: 2014 to 2019· Data source: Scopus, up to 08 Apr 2020·
Countries & territories
Scholarly
Output Views Count
Field-Weighted
Citation Impact
(excl. self-
citations)
Citation Count
(excl. self-
citations)
United States 330 2,006 2.61 2,637
China 103 899 0.62 257
United Kingdom 88 630 2.84 839
Canada 53 291 2.06 410
France 37 313 1.01 199
Brazil 35 323 1.34 163
Germany 32 255 1.28 111
Australia 31 305 0.90 109
Japan 31 236 0.89 57
Israel 19 135 2.37 208
Metric 1: Scholarly Output
Types of publications included: all.
Metric 2: Views Count
Metric 3: Field-Weighted Citation Impact
Types of publications included: all.
Metric 4: Citation Count
Types of publications included: all. Self-citations included: yes.

7. Top Institutions
Entity: Reinforcement learning; Artificial intelligence; Hierarchical reinforcement T.12457 ·
Year range: 2014 to 2019· Data source: Scopus, up to 08 Apr 2020·
Institution
Scholarly
Output Views Count
Field-Weighted
Citation Impact
(excl. self-
citations)
Citation Count
(excl. self-
citations)
Alphabet Inc. 51 282 5.21 901
University of California
at Berkeley
42 295 6.68 798
University of Texas at
Austin
29 224 1.92 166
Massachusetts
Institute of Technology
26 271 3.00 361
Carnegie Mellon
University
20 74 1.75 96
Stanford University 20 69 3.23 225
Universidade de São
Paulo
20 156 1.70 104
Brown University 19 157 1.74 88
McGill University 17 115 3.01 203

8. Top Institutions
Institution
Scholarly
Output Views Count
Field-Weighted
Citation Impact
(excl. self-
citations)
Citation Count
(excl. self-
citations)
OpenAI, Inc. 17 172 11.53 584
Metric 1: Scholarly Output
Types of publications included: all.
Metric 2: Views Count
Metric 3: Field-Weighted Citation Impact
Types of publications included: all.
Metric 4: Citation Count
Types of publications included: all. Self-citations included: yes.

9. Top Scopus Sources
Entity: Reinforcement learning; Artificial intelligence; Hierarchical reinforcement T.12457 ·
Year range: 2014 to 2019· Data source: Scopus, up to 08 Apr 2020·
Scopus Sources
Scholarly
Output Views Count
Field-Weighted
Citation Impact
(excl. self-
citations)
Citation Count
(excl. self-
citations)
Proceedings of the
International Joint
Conference on
Autonomous Agents and
Multiagent Systems,
AAMAS
63 171 1.17 203
IJCAI International Joint
Conference on Artificial
Intelligence
62 291 1.47 298
Advances in Neural
Information Processing
Systems
52 255 6.08 1,100
Lecture Notes in Computer
Science
47 348 0.40 59
7th International
Conference on Learning
Representations, ICLR 2019
20 29 3.44 41

10. Top Scopus Sources
Scopus Sources
Scholarly
Output Views Count
Field-Weighted
Citation Impact
(excl. self-
citations)
Citation Count
(excl. self-
citations)
36th International
Conference on Machine
Learning, ICML 2019
19 21 0.79 5
31st AAAI Conference on
Artificial Intelligence, AAAI
2017
17 80 3.36 205
Proceedings - IEEE
International Conference
on Robotics and
Automation
15 167 4.85 196
AAAI Workshop - Technical
Report
14 125 2.47 63
Proceedings of the
National Conference on
Artificial Intelligence
14 122 1.06 90

11. Top Scopus Sources
Metric 1: Scholarly Output
Types of publications included: all.
Metric 2: Views Count
Metric 3: Field-Weighted Citation Impact
Types of publications included: all.
Metric 4: Citation Count
Types of publications included: all. Self-citations included: yes.

12. Most cited publications
Entity: Reinforcement learning; Artificial intelligence; Hierarchical reinforcement T.12457 ·
Year range: 2014 to 2019· Data source: Scopus, up to 08 Apr 2020·
Publication Citations
Hierarchical deep reinforcement learning: Integrating temporal abstraction
and intrinsic motivation.
Kulkarni, T.D., Narasimhan, K.R., Saeedi, A. and 1 more
(2016) Advances in Neural Information Processing Systems, pp. 3682-3690.
152
Unifying count-based exploration and intrinsic motivation.
Bellemare, M.G., Srinivasan, S., Ostrovski, G. and 3 more
(2016) Advances in Neural Information Processing Systems, pp. 1479-1487.
148
Benchmarking deep reinforcement learning for continuous control.
Duan, Y., Chen, X., Houthooft, R. and 2 more
(2016) 33rd International Conference on Machine Learning, ICML 2016, 3, pp. 2001-2014.
132
Deep exploration via bootstrapped DQN.
Osband, I., Blundell, C., Pritzel, A. and 1 more
(2016) Advances in Neural Information Processing Systems, pp. 4033-4041.
126
VIME: Variational information maximizing exploration.
Houthooft, R., Chen, X., Duan, Y. and 3 more
(2016) Advances in Neural Information Processing Systems, 0, pp. 1117-1125.
104

13. Top Authors
Entity: Reinforcement learning; Artificial intelligence; Hierarchical reinforcement T.12457 ·
Year range: 2014 to 2019· Data source: Scopus, up to 08 Apr 2020·
Name
Scholarly
Output
Most recent
publication Citations h-index
1. Reali Costa,
Anna Helena
18 0 104 11
2. Stone, Peter 18 0 131 47
3. Taylor,
Matthew E.
16 0 93 23
4. Abbeel, Pieter 15 0 524 54
5. Hutter, Marcus 14 0 56 20
6. Brunskill,
Emma
14 0 88 17
7. Levine, Sergey 14 0 159 34
8. Mannor, Shie 13 0 189 38
9. Konidaris,
George D.
11 0 104 21
10. da Silva, Felipe
Leno
11 0 73 6