SlideShare a Scribd company logo
1 of 15
Download to read offline
Increasing Facilitations
by Extracting Concrete Discussion Structures
The 15th International Conference
on Knowledge, Information and Creativity Support Systems
Nagoya Institute of Technology, Japan
Naoki Kawamura, Shun Okuhara, Takayuki Ito
Background
Online Discussion Support System: D-Agree [1]
n The facilitator plays an important role for various participants
to make effective discussions on online forums
• To manage discussions
• To promote opinions
n D-Agree has Automated Facilitation Agent [2] to support discussions
Automated Facilitation Agent
n Automated facilitation agent could overcome limitations of human
facilitator
• The agents facilitate the ongoing discussions without rest
• The agents consider the opinions that human can not understand
n Automated facilitation agent is running, with using estimated discussion
structure
2
[1] Takayuki Ito et al. D-agree: Crowd discussion support system based on automated facilitation agent. In Proceedings of 35th AAAI
conference, volume 2020, 2020. demonstration paper.
[2] Takayuki Ito et al. Agent that facilitates crowd discussion. In Proceedings of ACM Collective Intelligence, volume 2019, 2019.
Background
Issue-Based Information System (IBIS)[3]
n An approach for structuring discussions
n The elements of the IBIS
• Issues: need to be answered
• Ideas: possible answers
• Pros: support an idea
• Cons: object to an idea
n Nodes are issues, ideas, pros, and cons
n Links are the relationships amongst
the nodes
n Automated facilitation agent adopt the IBIS in order to manage
online discussions
3
[3] Kunz, Werner, and Horst WJ Rittel. Issues as elements of information systems. Vol.
131. Berkeley, California: Institute of Urban and Regional Development, University of
California, 1970.
idea
pros cons
issues
Figure : Showing nodes and links
of IBIS structure
Problem
Issue_PN
Positive NegativeMiddle
Reason Reason
idea
pros cons
issues
What is your position on the issue?
Using IBIS Using another structure
What do you think about this opinion?
Do you agree or disagree,
about the restart of nuclear power plants?
Do you agree or disagree,
about the restart of nuclear power plants?
Abstract Facilitation Concrete Facilitation
Fail to focus on
“agree or disagree”
Success to focus on
“agree or disagree”
NO OK
Objective
Increases the number of facilitations
n IBIS structure is abstract
→ Agents could not perform more diverse facilitations
n We extract a more specific discussion structure
• Extracting nodes in a more specific structure
• Extracting links in a more specific structure
- Predicting the links amongst extracted nodes
We define a more specific structure.
We increase the number of facilitations.
Agent can be running with extracted specific discussion structure.
Define a more specific structure
Define “Oppose and IBIS structure”
n We add an “Oppose structure” to IBIS structure to get a more
specific discussion structure
n The elements of the Oppose structure
• Issue_PN: asks for agreement or disagreement
• Positive: representing position of agreement
• Middle: representing neutral position
• Negative: representing position of disagreement
• Reason: shows the reason for the position
Issue_PN
Positive NegativeMiddle
Reason Reason
Figure : Showing nodes and links of Oppose structure
Increased number of facilitations
n We can increase as many as 27 facilitations
7
IBIS Oppose and IBIS
issue 31 31
Ideas 42 42
pros 4 4
cons 3 3
Issue_PN 9
Positive 3
Middle 7
Negative 4
Reason 4
Sum 80 107
TABLE
The number of facilitations
Related Works:
Suzuki’s Extracting Nodes Approach
n Suzuki’s approach[4] employs bidirectional long short-term
memory (Bi-LSTM)[5] which is a type of recurrent neural network
(RNN) model
n Suzuki's node approach gets normalized probabilities
8
morpheme fastText
Let 0.9 0.2 … 0.8
us 0.8 0.5 … 0.2
discuss 0.6 0.1 … 0.3
town 0.2 0.9 … 0.1
development 0.3 0.2 … 0.7
with 0.7 0.3 … 0.5
IoT 0.5 0.1 … 0.8
and 0.4 0.9 … 0.2
AI 0.1 0.7 … 0.4
issues ideas pros cons
0.83 0.12 0.02 0.03
Bi-
LSTM
Dense
[4] Shota SUZUKI et al. Extrac- tion of online discussion structures for automated facilitation agent. Proceedings of
the Annual Conference of JSAI, JSAI2019:2F1E302–2F1E302, 2019.
[5] Sepp Hochreiter and Schmidhuber. Long short-term memory. Neural Comput., 9(8):1735–1780, November 1997.
Figure : Suzuki’s node extraction architecture[4]
Extracting Nodes in Our Research
Tree structure
n Tree structure is assumed to classify similar nodes
n To classify step by step, we make any classifiers
n We classify some nodes as same label in first classifier
n We classify some nodes to reveal Oppose and IBIS nodes in second classifier
Figure : structure of tree
Related Works:
Suzuki’s Extracting Links Approach
n Suzuki’s approach calculates the cosine similarities between the
output and the candidate head nodes.
10
sentence fastText
I 0.2 0.8 … 0.7
propose 0.5 0.1 … 0.2
signs 0.3 0.9 … 0.8
that 0.9 0.4 … 0.5
provide 0.4 0.3 … 0.1
information 0.1 0.7 … 0.3
Bi-LSTM
regression
0.7 0.3 … 0.9
0.9 0.1 … 0.3
0.4 0.8 … 0.1
0.2 0.6 … 0.7
0.1 0.2 … 0.2
0.5 0.7 … 0.4
0.3 0.4 … 0.6
0.2 0.9 … 0.8
0.8 0.5 … 0.5
sentence fastText
Let 0.9 0.2 … 0.8
us 0.8 0.5 … 0.2
discuss 0.6 0.1 … 0.3
town 0.2 0.9 … 0.1
development 0.3 0.2 … 0.7
with 0.7 0.3 … 0.5
IoT 0.5 0.1 … 0.8
and 0.4 0.9 … 0.2
AI 0.1 0.7 … 0.4
sentence fastText
what 0.3 0.6 … 0.5
moral 0.2 0.1 … 0.3
AI 0.7 0.1 … 0.9
should 0.4 0.7 … 0.1
have 0.3 0.5 … 0.1
0 0 … 0
0 0 … 0
0 0 … 0
0 0 … 0
sentence fastText
How 0.5 0.6 … 0.4
to 0.3 0.5 … 0.7
reduce 0.1 0.2 … 0.6
disaster 0.3 0.8 … 0.9
0 0 … 0
0 0 … 0
0 0 … 0
0 0 … 0
0 0 … 0
cosine similarity:0.34
cosine similarity:0.13
cosine similarity:0.72
choose
Let’s
discuss town development
with IoT and AI.
I propose signs that
provide information.
How to reduce disaster?
What moral AI
should have?
?
Figure : Suzuki’s link extraction architecture[4]
Extracting Links in Our Research
Restrict links
n We calculates the cosine similarities like Suzuki’s extraction links
n In this research, excluding candidate nodes that human can not
consider by restricting , unlike Suzuki’s extraction links
• It is estimated that we can extract links even if there are many
similar opinions in discussions
n We restrict links by the distance of sentences up to 20
11
Experiments
Datasets
n Online discussions with Japanese that were created in D-Agree
n 9 discussions
n The themes connected with Hamaoka Nuclear Power Plant
Num nodes
issue 70
Ideas 260
pros 100
cons 130
Issue_PN 50
Positive 130
Middle 10
Negative 170
Reason 60
Num links
idea->issue
180
pros->idea
100
cons->idea
130
Positive
->IssuePN
130
Negative
->IssuePN
170
Middle
->IssuePN
20
Reason
->Positive
19
Reason
->Negative
30
Results of Nodes Experimental
Results of the structure of tree
• 10-fold-cross-validation
• The average values of F1 score
13
Num node Tree structure Suzuki’s model
issues 70 0.73 0.73
Ideas 260 0.57 0.61
pros 100 0.45 0.48
cons 130 0.44 0.40
Issue_PN 50 0.56 0.54
Positive 130 0.43 0.38
Middle 10 0.00 0.00
Negative 170 0.45 0.43
Reason 60 0.52 0.52
Results of Links Experimental
Results of Link Extraction
• 10-fold-cross-validation
• The average values of precision
14
Num links
closeness no limit
precision Num links
closeness up to 20
precision
idea->issue 180 0.25 138 0.71
pros->idea 100 0.18 100 0.31
cons->idea 130 0.10 130 0.32
Positive->Issue PN 130 0.42 75 0.83
Negative->Issue PN 170 0.56 150 0.86
Middle->Issue PN 20 0.55 9 0.70
Reason->Positive 19 0.30 20 0.55
Reason->Negative 30 0.27 30 0.37
Conclusion
Objective
• Increasing facilitations by extracting concrete discussion structures
Define concrete discussion structures
• We define the “Oppose and IBIS structure” instead of abstract IBIS structure
→ We can increase as many as 27 facilitations
Extracting Nodes and Links in Oppose and IBIS Structure
• We make tree structure to classify similar definition nodes
• Restrict links by the distance of sentences up to 20
Experiments
• We gathered the experimental Japanese data from online discussions that
were created in D-Agree
Results
• The experimental results demonstrate the proposed approach is efficient for
extracting Oppose and IBIS
15

More Related Content

Similar to TS3-3: Naoki Kawamura from Nagoya Institute of Technology

Making feedback visible_agileee_2010
Making feedback visible_agileee_2010Making feedback visible_agileee_2010
Making feedback visible_agileee_2010Anda Abramovici
 
Yuandong Tian at AI Frontiers : Planning in Reinforcement Learning
Yuandong Tian at AI Frontiers : Planning in Reinforcement LearningYuandong Tian at AI Frontiers : Planning in Reinforcement Learning
Yuandong Tian at AI Frontiers : Planning in Reinforcement LearningAI Frontiers
 
Basic Engineering Design (Part 7): Presenting the Solution
Basic Engineering Design (Part 7): Presenting the SolutionBasic Engineering Design (Part 7): Presenting the Solution
Basic Engineering Design (Part 7): Presenting the SolutionDenise Wilson
 
Deep Learning (DL) from Scratch
Deep Learning (DL) from ScratchDeep Learning (DL) from Scratch
Deep Learning (DL) from ScratchAziz416788
 
Discover deep insights with Salesforce Einstein Analytics and Discovery
Discover deep insights with Salesforce Einstein Analytics and DiscoveryDiscover deep insights with Salesforce Einstein Analytics and Discovery
Discover deep insights with Salesforce Einstein Analytics and DiscoveryNew Delhi Salesforce Developer Group
 
The History of DevOps (and what you need to do about it)
The History of DevOps (and what you need to do about it)The History of DevOps (and what you need to do about it)
The History of DevOps (and what you need to do about it)dev2ops
 
Balancing Infrastructure with Optimization and Problem Formulation
Balancing Infrastructure with Optimization and Problem FormulationBalancing Infrastructure with Optimization and Problem Formulation
Balancing Infrastructure with Optimization and Problem FormulationAlex D. Gaudio
 
Velocity. Agility. Python. (Pycon APAC 2017)
Velocity. Agility. Python. (Pycon APAC 2017)Velocity. Agility. Python. (Pycon APAC 2017)
Velocity. Agility. Python. (Pycon APAC 2017)Sian Lerk Lau
 
Deep bidirectional transformers for online discussion understanding
Deep bidirectional transformers for online discussion understanding Deep bidirectional transformers for online discussion understanding
Deep bidirectional transformers for online discussion understanding AtsuyaSakai
 
Writing Introduction For Essay
Writing Introduction For EssayWriting Introduction For Essay
Writing Introduction For EssayRobyn Martin
 
O reilly.lean.ux.applying.lean.principles.to.improve.user.experience.2013.ret...
O reilly.lean.ux.applying.lean.principles.to.improve.user.experience.2013.ret...O reilly.lean.ux.applying.lean.principles.to.improve.user.experience.2013.ret...
O reilly.lean.ux.applying.lean.principles.to.improve.user.experience.2013.ret...Mạnh Toán
 
Dr. Sam Musa01-01-2017Network LAN Design with VoIP and Wireles.docx
Dr. Sam Musa01-01-2017Network LAN Design with VoIP and Wireles.docxDr. Sam Musa01-01-2017Network LAN Design with VoIP and Wireles.docx
Dr. Sam Musa01-01-2017Network LAN Design with VoIP and Wireles.docxkanepbyrne80830
 
Using Bets, Boards and Missions to Inspire Org-wide Agility
Using Bets, Boards and Missions to Inspire Org-wide AgilityUsing Bets, Boards and Missions to Inspire Org-wide Agility
Using Bets, Boards and Missions to Inspire Org-wide AgilityC4Media
 
How To Build Scrum Task Boards that Radiate Information
How To Build Scrum Task Boards that Radiate Information How To Build Scrum Task Boards that Radiate Information
How To Build Scrum Task Boards that Radiate Information mikedep01
 
Extended Essay International Baccalaureate
Extended Essay International BaccalaureateExtended Essay International Baccalaureate
Extended Essay International BaccalaureateLeahona Lovato
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Apa Reference Page Citation Generator. APA 6 Citation Generator
Apa Reference Page Citation Generator. APA 6 Citation GeneratorApa Reference Page Citation Generator. APA 6 Citation Generator
Apa Reference Page Citation Generator. APA 6 Citation GeneratorCrystal Nelson
 
Humorists Essay. Online assignment writing service.
Humorists Essay. Online assignment writing service.Humorists Essay. Online assignment writing service.
Humorists Essay. Online assignment writing service.Megan Sanchez
 
CIS 599 Life of the Mind/newtonhelp.com   
CIS 599 Life of the Mind/newtonhelp.com   CIS 599 Life of the Mind/newtonhelp.com   
CIS 599 Life of the Mind/newtonhelp.com   bellflower10
 

Similar to TS3-3: Naoki Kawamura from Nagoya Institute of Technology (20)

Making feedback visible_agileee_2010
Making feedback visible_agileee_2010Making feedback visible_agileee_2010
Making feedback visible_agileee_2010
 
Yuandong Tian at AI Frontiers : Planning in Reinforcement Learning
Yuandong Tian at AI Frontiers : Planning in Reinforcement LearningYuandong Tian at AI Frontiers : Planning in Reinforcement Learning
Yuandong Tian at AI Frontiers : Planning in Reinforcement Learning
 
Basic Engineering Design (Part 7): Presenting the Solution
Basic Engineering Design (Part 7): Presenting the SolutionBasic Engineering Design (Part 7): Presenting the Solution
Basic Engineering Design (Part 7): Presenting the Solution
 
Deep Learning (DL) from Scratch
Deep Learning (DL) from ScratchDeep Learning (DL) from Scratch
Deep Learning (DL) from Scratch
 
Discover deep insights with Salesforce Einstein Analytics and Discovery
Discover deep insights with Salesforce Einstein Analytics and DiscoveryDiscover deep insights with Salesforce Einstein Analytics and Discovery
Discover deep insights with Salesforce Einstein Analytics and Discovery
 
The History of DevOps (and what you need to do about it)
The History of DevOps (and what you need to do about it)The History of DevOps (and what you need to do about it)
The History of DevOps (and what you need to do about it)
 
Balancing Infrastructure with Optimization and Problem Formulation
Balancing Infrastructure with Optimization and Problem FormulationBalancing Infrastructure with Optimization and Problem Formulation
Balancing Infrastructure with Optimization and Problem Formulation
 
Velocity. Agility. Python. (Pycon APAC 2017)
Velocity. Agility. Python. (Pycon APAC 2017)Velocity. Agility. Python. (Pycon APAC 2017)
Velocity. Agility. Python. (Pycon APAC 2017)
 
Deep bidirectional transformers for online discussion understanding
Deep bidirectional transformers for online discussion understanding Deep bidirectional transformers for online discussion understanding
Deep bidirectional transformers for online discussion understanding
 
Writing Introduction For Essay
Writing Introduction For EssayWriting Introduction For Essay
Writing Introduction For Essay
 
O reilly.lean.ux.applying.lean.principles.to.improve.user.experience.2013.ret...
O reilly.lean.ux.applying.lean.principles.to.improve.user.experience.2013.ret...O reilly.lean.ux.applying.lean.principles.to.improve.user.experience.2013.ret...
O reilly.lean.ux.applying.lean.principles.to.improve.user.experience.2013.ret...
 
Dr. Sam Musa01-01-2017Network LAN Design with VoIP and Wireles.docx
Dr. Sam Musa01-01-2017Network LAN Design with VoIP and Wireles.docxDr. Sam Musa01-01-2017Network LAN Design with VoIP and Wireles.docx
Dr. Sam Musa01-01-2017Network LAN Design with VoIP and Wireles.docx
 
Lean ux
Lean uxLean ux
Lean ux
 
Using Bets, Boards and Missions to Inspire Org-wide Agility
Using Bets, Boards and Missions to Inspire Org-wide AgilityUsing Bets, Boards and Missions to Inspire Org-wide Agility
Using Bets, Boards and Missions to Inspire Org-wide Agility
 
How To Build Scrum Task Boards that Radiate Information
How To Build Scrum Task Boards that Radiate Information How To Build Scrum Task Boards that Radiate Information
How To Build Scrum Task Boards that Radiate Information
 
Extended Essay International Baccalaureate
Extended Essay International BaccalaureateExtended Essay International Baccalaureate
Extended Essay International Baccalaureate
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Apa Reference Page Citation Generator. APA 6 Citation Generator
Apa Reference Page Citation Generator. APA 6 Citation GeneratorApa Reference Page Citation Generator. APA 6 Citation Generator
Apa Reference Page Citation Generator. APA 6 Citation Generator
 
Humorists Essay. Online assignment writing service.
Humorists Essay. Online assignment writing service.Humorists Essay. Online assignment writing service.
Humorists Essay. Online assignment writing service.
 
CIS 599 Life of the Mind/newtonhelp.com   
CIS 599 Life of the Mind/newtonhelp.com   CIS 599 Life of the Mind/newtonhelp.com   
CIS 599 Life of the Mind/newtonhelp.com   
 

More from Jawad Haqbeen

KICSS2020 Invited Talk 2: Prof. Quan Bai from University of Tasmania
KICSS2020 Invited Talk 2: Prof. Quan Bai from University of TasmaniaKICSS2020 Invited Talk 2: Prof. Quan Bai from University of Tasmania
KICSS2020 Invited Talk 2: Prof. Quan Bai from University of TasmaniaJawad Haqbeen
 
Jawad Haqbeen from Nagoya Institute of Technology
Jawad Haqbeen from Nagoya Institute of Technology	Jawad Haqbeen from Nagoya Institute of Technology
Jawad Haqbeen from Nagoya Institute of Technology Jawad Haqbeen
 
TS2-1: Shoko Kimura from Japan Advanced Institute of Science and Technology
TS2-1: Shoko Kimura from Japan Advanced Institute of Science and TechnologyTS2-1: Shoko Kimura from Japan Advanced Institute of Science and Technology
TS2-1: Shoko Kimura from Japan Advanced Institute of Science and TechnologyJawad Haqbeen
 
KICSS2020 Invited Talk 1: Dr. Sanparith Marukatat from National Electronics ...
KICSS2020 Invited Talk 1:  Dr. Sanparith Marukatat from National Electronics ...KICSS2020 Invited Talk 1:  Dr. Sanparith Marukatat from National Electronics ...
KICSS2020 Invited Talk 1: Dr. Sanparith Marukatat from National Electronics ...Jawad Haqbeen
 
TS2-2: Shun Shiramatsu from Nagoya Institute of Technology
TS2-2: Shun Shiramatsu from Nagoya Institute of TechnologyTS2-2: Shun Shiramatsu from Nagoya Institute of Technology
TS2-2: Shun Shiramatsu from Nagoya Institute of TechnologyJawad Haqbeen
 
TS2-5: Jie Jiang from Japan Advanced Institute of Science and Technology
TS2-5: Jie Jiang from Japan Advanced Institute of Science and TechnologyTS2-5: Jie Jiang from Japan Advanced Institute of Science and Technology
TS2-5: Jie Jiang from Japan Advanced Institute of Science and TechnologyJawad Haqbeen
 
TS2-4: Sofia Sahab from Nagoya Institute of Technology
TS2-4: Sofia Sahab from Nagoya Institute of TechnologyTS2-4: Sofia Sahab from Nagoya Institute of Technology
TS2-4: Sofia Sahab from Nagoya Institute of TechnologyJawad Haqbeen
 
KICSS2020 Invited Talk 3: Prof. Takayuki Ito from Kyoto University
KICSS2020 Invited Talk 3: Prof. Takayuki Ito from Kyoto UniversityKICSS2020 Invited Talk 3: Prof. Takayuki Ito from Kyoto University
KICSS2020 Invited Talk 3: Prof. Takayuki Ito from Kyoto UniversityJawad Haqbeen
 
TS1-2: Xiuxia Cui from Japan Advanced Institute of Science and Technology
TS1-2: Xiuxia Cui from Japan Advanced Institute of Science and Technology TS1-2: Xiuxia Cui from Japan Advanced Institute of Science and Technology
TS1-2: Xiuxia Cui from Japan Advanced Institute of Science and Technology Jawad Haqbeen
 
Invited Talk 1: Dr. Sanparith Marukatat
Invited Talk 1:  Dr. Sanparith MarukatatInvited Talk 1:  Dr. Sanparith Marukatat
Invited Talk 1: Dr. Sanparith MarukatatJawad Haqbeen
 
Invited Talk 2: Prof. Quan Bai
Invited Talk 2: Prof. Quan BaiInvited Talk 2: Prof. Quan Bai
Invited Talk 2: Prof. Quan BaiJawad Haqbeen
 
Invited Talk 3: Prof. Takayuki Ito
Invited Talk 3: Prof. Takayuki ItoInvited Talk 3: Prof. Takayuki Ito
Invited Talk 3: Prof. Takayuki ItoJawad Haqbeen
 
Invited Talk 4: Prof. Kwei Jay Lin
Invited Talk 4: Prof. Kwei Jay LinInvited Talk 4: Prof. Kwei Jay Lin
Invited Talk 4: Prof. Kwei Jay LinJawad Haqbeen
 
TS5-3: Shohei Watanabe from Akita Prefectural University
TS5-3: Shohei Watanabe from Akita Prefectural UniversityTS5-3: Shohei Watanabe from Akita Prefectural University
TS5-3: Shohei Watanabe from Akita Prefectural UniversityJawad Haqbeen
 
TS5-4: Ming Yi from Japan Advanced Institute of Science and Technology
TS5-4: Ming Yi from Japan Advanced Institute of Science and TechnologyTS5-4: Ming Yi from Japan Advanced Institute of Science and Technology
TS5-4: Ming Yi from Japan Advanced Institute of Science and TechnologyJawad Haqbeen
 
TS5-5: Gao Wei from Japan Advanced Institute of Science and Technology
TS5-5: Gao Wei from Japan Advanced Institute of Science and TechnologyTS5-5: Gao Wei from Japan Advanced Institute of Science and Technology
TS5-5: Gao Wei from Japan Advanced Institute of Science and TechnologyJawad Haqbeen
 
TS5-7: Tessai Hayama from Nagaoka University of Technology
TS5-7: Tessai Hayama from Nagaoka University of TechnologyTS5-7: Tessai Hayama from Nagaoka University of Technology
TS5-7: Tessai Hayama from Nagaoka University of TechnologyJawad Haqbeen
 
TS5-1: Takashi Sakuma from Chiba Prefectural University of Health Sciences
TS5-1: Takashi Sakuma from Chiba Prefectural University of Health SciencesTS5-1: Takashi Sakuma from Chiba Prefectural University of Health Sciences
TS5-1: Takashi Sakuma from Chiba Prefectural University of Health SciencesJawad Haqbeen
 

More from Jawad Haqbeen (20)

KICSS2020 Invited Talk 2: Prof. Quan Bai from University of Tasmania
KICSS2020 Invited Talk 2: Prof. Quan Bai from University of TasmaniaKICSS2020 Invited Talk 2: Prof. Quan Bai from University of Tasmania
KICSS2020 Invited Talk 2: Prof. Quan Bai from University of Tasmania
 
Jawad Haqbeen from Nagoya Institute of Technology
Jawad Haqbeen from Nagoya Institute of Technology	Jawad Haqbeen from Nagoya Institute of Technology
Jawad Haqbeen from Nagoya Institute of Technology
 
TS2-1: Shoko Kimura from Japan Advanced Institute of Science and Technology
TS2-1: Shoko Kimura from Japan Advanced Institute of Science and TechnologyTS2-1: Shoko Kimura from Japan Advanced Institute of Science and Technology
TS2-1: Shoko Kimura from Japan Advanced Institute of Science and Technology
 
KICSS2020 Invited Talk 1: Dr. Sanparith Marukatat from National Electronics ...
KICSS2020 Invited Talk 1:  Dr. Sanparith Marukatat from National Electronics ...KICSS2020 Invited Talk 1:  Dr. Sanparith Marukatat from National Electronics ...
KICSS2020 Invited Talk 1: Dr. Sanparith Marukatat from National Electronics ...
 
TS2-2: Shun Shiramatsu from Nagoya Institute of Technology
TS2-2: Shun Shiramatsu from Nagoya Institute of TechnologyTS2-2: Shun Shiramatsu from Nagoya Institute of Technology
TS2-2: Shun Shiramatsu from Nagoya Institute of Technology
 
TS2-5: Jie Jiang from Japan Advanced Institute of Science and Technology
TS2-5: Jie Jiang from Japan Advanced Institute of Science and TechnologyTS2-5: Jie Jiang from Japan Advanced Institute of Science and Technology
TS2-5: Jie Jiang from Japan Advanced Institute of Science and Technology
 
TS2-4: Sofia Sahab from Nagoya Institute of Technology
TS2-4: Sofia Sahab from Nagoya Institute of TechnologyTS2-4: Sofia Sahab from Nagoya Institute of Technology
TS2-4: Sofia Sahab from Nagoya Institute of Technology
 
Kicss2020 Program
Kicss2020 ProgramKicss2020 Program
Kicss2020 Program
 
KICSS2020 Invited Talk 3: Prof. Takayuki Ito from Kyoto University
KICSS2020 Invited Talk 3: Prof. Takayuki Ito from Kyoto UniversityKICSS2020 Invited Talk 3: Prof. Takayuki Ito from Kyoto University
KICSS2020 Invited Talk 3: Prof. Takayuki Ito from Kyoto University
 
TS1-2: Xiuxia Cui from Japan Advanced Institute of Science and Technology
TS1-2: Xiuxia Cui from Japan Advanced Institute of Science and Technology TS1-2: Xiuxia Cui from Japan Advanced Institute of Science and Technology
TS1-2: Xiuxia Cui from Japan Advanced Institute of Science and Technology
 
KICSS2020
KICSS2020KICSS2020
KICSS2020
 
Invited Talk 1: Dr. Sanparith Marukatat
Invited Talk 1:  Dr. Sanparith MarukatatInvited Talk 1:  Dr. Sanparith Marukatat
Invited Talk 1: Dr. Sanparith Marukatat
 
Invited Talk 2: Prof. Quan Bai
Invited Talk 2: Prof. Quan BaiInvited Talk 2: Prof. Quan Bai
Invited Talk 2: Prof. Quan Bai
 
Invited Talk 3: Prof. Takayuki Ito
Invited Talk 3: Prof. Takayuki ItoInvited Talk 3: Prof. Takayuki Ito
Invited Talk 3: Prof. Takayuki Ito
 
Invited Talk 4: Prof. Kwei Jay Lin
Invited Talk 4: Prof. Kwei Jay LinInvited Talk 4: Prof. Kwei Jay Lin
Invited Talk 4: Prof. Kwei Jay Lin
 
TS5-3: Shohei Watanabe from Akita Prefectural University
TS5-3: Shohei Watanabe from Akita Prefectural UniversityTS5-3: Shohei Watanabe from Akita Prefectural University
TS5-3: Shohei Watanabe from Akita Prefectural University
 
TS5-4: Ming Yi from Japan Advanced Institute of Science and Technology
TS5-4: Ming Yi from Japan Advanced Institute of Science and TechnologyTS5-4: Ming Yi from Japan Advanced Institute of Science and Technology
TS5-4: Ming Yi from Japan Advanced Institute of Science and Technology
 
TS5-5: Gao Wei from Japan Advanced Institute of Science and Technology
TS5-5: Gao Wei from Japan Advanced Institute of Science and TechnologyTS5-5: Gao Wei from Japan Advanced Institute of Science and Technology
TS5-5: Gao Wei from Japan Advanced Institute of Science and Technology
 
TS5-7: Tessai Hayama from Nagaoka University of Technology
TS5-7: Tessai Hayama from Nagaoka University of TechnologyTS5-7: Tessai Hayama from Nagaoka University of Technology
TS5-7: Tessai Hayama from Nagaoka University of Technology
 
TS5-1: Takashi Sakuma from Chiba Prefectural University of Health Sciences
TS5-1: Takashi Sakuma from Chiba Prefectural University of Health SciencesTS5-1: Takashi Sakuma from Chiba Prefectural University of Health Sciences
TS5-1: Takashi Sakuma from Chiba Prefectural University of Health Sciences
 

Recently uploaded

Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfChris Hunter
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfSanaAli374401
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.christianmathematics
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.pptRamjanShidvankar
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterMateoGardella
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...christianmathematics
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Shubhangi Sonawane
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.MateoGardella
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...KokoStevan
 

Recently uploaded (20)

Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 

TS3-3: Naoki Kawamura from Nagoya Institute of Technology

  • 1. Increasing Facilitations by Extracting Concrete Discussion Structures The 15th International Conference on Knowledge, Information and Creativity Support Systems Nagoya Institute of Technology, Japan Naoki Kawamura, Shun Okuhara, Takayuki Ito
  • 2. Background Online Discussion Support System: D-Agree [1] n The facilitator plays an important role for various participants to make effective discussions on online forums • To manage discussions • To promote opinions n D-Agree has Automated Facilitation Agent [2] to support discussions Automated Facilitation Agent n Automated facilitation agent could overcome limitations of human facilitator • The agents facilitate the ongoing discussions without rest • The agents consider the opinions that human can not understand n Automated facilitation agent is running, with using estimated discussion structure 2 [1] Takayuki Ito et al. D-agree: Crowd discussion support system based on automated facilitation agent. In Proceedings of 35th AAAI conference, volume 2020, 2020. demonstration paper. [2] Takayuki Ito et al. Agent that facilitates crowd discussion. In Proceedings of ACM Collective Intelligence, volume 2019, 2019.
  • 3. Background Issue-Based Information System (IBIS)[3] n An approach for structuring discussions n The elements of the IBIS • Issues: need to be answered • Ideas: possible answers • Pros: support an idea • Cons: object to an idea n Nodes are issues, ideas, pros, and cons n Links are the relationships amongst the nodes n Automated facilitation agent adopt the IBIS in order to manage online discussions 3 [3] Kunz, Werner, and Horst WJ Rittel. Issues as elements of information systems. Vol. 131. Berkeley, California: Institute of Urban and Regional Development, University of California, 1970. idea pros cons issues Figure : Showing nodes and links of IBIS structure
  • 4. Problem Issue_PN Positive NegativeMiddle Reason Reason idea pros cons issues What is your position on the issue? Using IBIS Using another structure What do you think about this opinion? Do you agree or disagree, about the restart of nuclear power plants? Do you agree or disagree, about the restart of nuclear power plants? Abstract Facilitation Concrete Facilitation Fail to focus on “agree or disagree” Success to focus on “agree or disagree” NO OK
  • 5. Objective Increases the number of facilitations n IBIS structure is abstract → Agents could not perform more diverse facilitations n We extract a more specific discussion structure • Extracting nodes in a more specific structure • Extracting links in a more specific structure - Predicting the links amongst extracted nodes We define a more specific structure. We increase the number of facilitations. Agent can be running with extracted specific discussion structure.
  • 6. Define a more specific structure Define “Oppose and IBIS structure” n We add an “Oppose structure” to IBIS structure to get a more specific discussion structure n The elements of the Oppose structure • Issue_PN: asks for agreement or disagreement • Positive: representing position of agreement • Middle: representing neutral position • Negative: representing position of disagreement • Reason: shows the reason for the position Issue_PN Positive NegativeMiddle Reason Reason Figure : Showing nodes and links of Oppose structure
  • 7. Increased number of facilitations n We can increase as many as 27 facilitations 7 IBIS Oppose and IBIS issue 31 31 Ideas 42 42 pros 4 4 cons 3 3 Issue_PN 9 Positive 3 Middle 7 Negative 4 Reason 4 Sum 80 107 TABLE The number of facilitations
  • 8. Related Works: Suzuki’s Extracting Nodes Approach n Suzuki’s approach[4] employs bidirectional long short-term memory (Bi-LSTM)[5] which is a type of recurrent neural network (RNN) model n Suzuki's node approach gets normalized probabilities 8 morpheme fastText Let 0.9 0.2 … 0.8 us 0.8 0.5 … 0.2 discuss 0.6 0.1 … 0.3 town 0.2 0.9 … 0.1 development 0.3 0.2 … 0.7 with 0.7 0.3 … 0.5 IoT 0.5 0.1 … 0.8 and 0.4 0.9 … 0.2 AI 0.1 0.7 … 0.4 issues ideas pros cons 0.83 0.12 0.02 0.03 Bi- LSTM Dense [4] Shota SUZUKI et al. Extrac- tion of online discussion structures for automated facilitation agent. Proceedings of the Annual Conference of JSAI, JSAI2019:2F1E302–2F1E302, 2019. [5] Sepp Hochreiter and Schmidhuber. Long short-term memory. Neural Comput., 9(8):1735–1780, November 1997. Figure : Suzuki’s node extraction architecture[4]
  • 9. Extracting Nodes in Our Research Tree structure n Tree structure is assumed to classify similar nodes n To classify step by step, we make any classifiers n We classify some nodes as same label in first classifier n We classify some nodes to reveal Oppose and IBIS nodes in second classifier Figure : structure of tree
  • 10. Related Works: Suzuki’s Extracting Links Approach n Suzuki’s approach calculates the cosine similarities between the output and the candidate head nodes. 10 sentence fastText I 0.2 0.8 … 0.7 propose 0.5 0.1 … 0.2 signs 0.3 0.9 … 0.8 that 0.9 0.4 … 0.5 provide 0.4 0.3 … 0.1 information 0.1 0.7 … 0.3 Bi-LSTM regression 0.7 0.3 … 0.9 0.9 0.1 … 0.3 0.4 0.8 … 0.1 0.2 0.6 … 0.7 0.1 0.2 … 0.2 0.5 0.7 … 0.4 0.3 0.4 … 0.6 0.2 0.9 … 0.8 0.8 0.5 … 0.5 sentence fastText Let 0.9 0.2 … 0.8 us 0.8 0.5 … 0.2 discuss 0.6 0.1 … 0.3 town 0.2 0.9 … 0.1 development 0.3 0.2 … 0.7 with 0.7 0.3 … 0.5 IoT 0.5 0.1 … 0.8 and 0.4 0.9 … 0.2 AI 0.1 0.7 … 0.4 sentence fastText what 0.3 0.6 … 0.5 moral 0.2 0.1 … 0.3 AI 0.7 0.1 … 0.9 should 0.4 0.7 … 0.1 have 0.3 0.5 … 0.1 0 0 … 0 0 0 … 0 0 0 … 0 0 0 … 0 sentence fastText How 0.5 0.6 … 0.4 to 0.3 0.5 … 0.7 reduce 0.1 0.2 … 0.6 disaster 0.3 0.8 … 0.9 0 0 … 0 0 0 … 0 0 0 … 0 0 0 … 0 0 0 … 0 cosine similarity:0.34 cosine similarity:0.13 cosine similarity:0.72 choose Let’s discuss town development with IoT and AI. I propose signs that provide information. How to reduce disaster? What moral AI should have? ? Figure : Suzuki’s link extraction architecture[4]
  • 11. Extracting Links in Our Research Restrict links n We calculates the cosine similarities like Suzuki’s extraction links n In this research, excluding candidate nodes that human can not consider by restricting , unlike Suzuki’s extraction links • It is estimated that we can extract links even if there are many similar opinions in discussions n We restrict links by the distance of sentences up to 20 11
  • 12. Experiments Datasets n Online discussions with Japanese that were created in D-Agree n 9 discussions n The themes connected with Hamaoka Nuclear Power Plant Num nodes issue 70 Ideas 260 pros 100 cons 130 Issue_PN 50 Positive 130 Middle 10 Negative 170 Reason 60 Num links idea->issue 180 pros->idea 100 cons->idea 130 Positive ->IssuePN 130 Negative ->IssuePN 170 Middle ->IssuePN 20 Reason ->Positive 19 Reason ->Negative 30
  • 13. Results of Nodes Experimental Results of the structure of tree • 10-fold-cross-validation • The average values of F1 score 13 Num node Tree structure Suzuki’s model issues 70 0.73 0.73 Ideas 260 0.57 0.61 pros 100 0.45 0.48 cons 130 0.44 0.40 Issue_PN 50 0.56 0.54 Positive 130 0.43 0.38 Middle 10 0.00 0.00 Negative 170 0.45 0.43 Reason 60 0.52 0.52
  • 14. Results of Links Experimental Results of Link Extraction • 10-fold-cross-validation • The average values of precision 14 Num links closeness no limit precision Num links closeness up to 20 precision idea->issue 180 0.25 138 0.71 pros->idea 100 0.18 100 0.31 cons->idea 130 0.10 130 0.32 Positive->Issue PN 130 0.42 75 0.83 Negative->Issue PN 170 0.56 150 0.86 Middle->Issue PN 20 0.55 9 0.70 Reason->Positive 19 0.30 20 0.55 Reason->Negative 30 0.27 30 0.37
  • 15. Conclusion Objective • Increasing facilitations by extracting concrete discussion structures Define concrete discussion structures • We define the “Oppose and IBIS structure” instead of abstract IBIS structure → We can increase as many as 27 facilitations Extracting Nodes and Links in Oppose and IBIS Structure • We make tree structure to classify similar definition nodes • Restrict links by the distance of sentences up to 20 Experiments • We gathered the experimental Japanese data from online discussions that were created in D-Agree Results • The experimental results demonstrate the proposed approach is efficient for extracting Oppose and IBIS 15