SlideShare a Scribd company logo
1 of 2
Download to read offline
TASK DESCRIPTION
Golem-II+ carries out different tasks with a
generic interactive model. The model is based on
interaction protocols named Dialogue Models
(DMs). The DMs describe sets of situations in
which the expectations, intentions and actions
related to a specific task are represented. In a
DM, each situation (S) is an informational state.
To move from Si to Sj the match between an
expectation (α) and an action (ß) has to be
accomplished.
The Interaction-Oriented Cognitive Architecture
(IOCA) integrates perception, thought and action
with computational structures and processes. It
offers a flexible framework to design complex
tasks. The DMs are integrated into a cognitive
architecture in order to coordinate the robot's
capabilities and its interaction with humans.
THE GENERIC MODEL
Notation
Si Sj
α:ß
THE ROBOT
HARDWARE
- PeopleBot:
* Three 8-sensor sonar arrays
* Two protective IR sensors in the front
* Two vertical break beams
* Two protective 5-bumper arrays
* Speakers
* Internal computer VersaLogic EBX-12
- Dell Latitude E6400 laptop computer
- QuickCam Pro 9000 Webcam
- Microsoft Kinect Camera
- Hokuyo UTM-30LX Laser
- Shure Base Omnidirectional microphones x3
- RODE VideoMic directional microphone
- M-Audio Fast Track Ultra (audio interface)
- Infinity 3.5-Inch Two-Way loudspeakers x2
- Robai Cyton Veta 7DOF robotic arm
SOFTWARE
SOFTWARE LIBRARIES
JACK, PocketSphinx
SVS, OpenCV and
OpenNI
Sicstus Prolog
PulseAudio,
Festival TTS
Player/Stage
and Gearbox
MODULE
Navigation
Dialogue
Manager
Vision
Voice
Recognition
Voice
Synthesizer
Object
Manipulation Actin-SE Software
IOCA
EXTERNAL REPRESENTATIONS OR THE WORLD
Coordinator
Perceptual
Memory
Dialogue Manager
Semantic
Memory
Satisfaction
Module
Interpretation
Module
Autonomous
Reactive
System
Rendering
Devices
Recognition
Devices
IOCA
SCENARIOS
Pharmacy dispatcher
Cleaning Assistant
The RoboCup@Home competition provides
an excellent evaluation environment for the
conceptual framework and technology
developed by the Golem Group.
The robot Golem-II+ is the latest service robot
developed within the conceptual framework of
Dialogue Models, IOCA, and the following
technology:
Departamento de Ciencias
de la Computación
RoboCup German Open 2012
A generic model of coordinated
communication and action
for service robots
Universidad Nacional Autónoma de México
Instituto de Investigaciones en Matemáticas Aplicadas y en Sistemas
Departamento de Ciencias de la Computación
THE GOLEM GROUP
Luis Pineda (team leader)
Ivan Meza
Caleb Rascón
Gibran Fuentes
Mario Peña
Carlos Gershenson
Iván Sánchez
Mauricio Reyes
Arturo Rodríguez
Hernando Ortega
Miguel Salazar
Lisset Salinas
Joel Durán
Varinia Estrada
http://golem.iimas.unam.mx
The Golem Group presents a generic model
for solving service robot tasks. The model
proposes an abstract solution for the
managing of diverse kinds of behaviors in
systems based on human-robot interaction.
The model is implemented in Golem-II+, which
coordinates its multimodal capabilities to
perform communicative interactions
independently of the domain and the concrete
task. It also includes communicative strategies
for error prevention and recovery.
Golem-II+ is able to:
* listen and interpret linguistic instructions
* explain the information requested by the
user about the domain
* navigate through its environment
* visual object recognition
* grasp objects
* recover from misinterpretations
The system interacts with the user in an
intentional level. The robot's actions are
causally related to the expressed intentions
during the communication process.
golem@turing.iimas.unam.mx
THE GOLEM GROUP
GOLEM-II+

More Related Content

Viewers also liked

Кашкарова С.В. Подарок маме – своими руками (проект). — Приложение 8
Кашкарова С.В. Подарок маме – своими руками (проект). — Приложение 8Кашкарова С.В. Подарок маме – своими руками (проект). — Приложение 8
Кашкарова С.В. Подарок маме – своими руками (проект). — Приложение 8vdohnovlennye
 
Enquesta sobre adiccions v2 english (1) (1)
Enquesta sobre adiccions v2   english (1) (1)Enquesta sobre adiccions v2   english (1) (1)
Enquesta sobre adiccions v2 english (1) (1)comeniusregiopicanya
 
Congreso diputados diario de sesiones[1]
Congreso diputados diario de sesiones[1]Congreso diputados diario de sesiones[1]
Congreso diputados diario de sesiones[1]faralami
 
Os jovens e a comunicação
Os jovens e a comunicação Os jovens e a comunicação
Os jovens e a comunicação ArianeLB
 
(Certificado aeat)
(Certificado aeat)(Certificado aeat)
(Certificado aeat)faralami
 
SISTEM KOMPUER SMT 1 KELAS XI MULTIMEDIA
SISTEM KOMPUER SMT 1 KELAS XI MULTIMEDIASISTEM KOMPUER SMT 1 KELAS XI MULTIMEDIA
SISTEM KOMPUER SMT 1 KELAS XI MULTIMEDIAVivi Elinda
 
Eugenia grandet
Eugenia grandetEugenia grandet
Eugenia grandetGIna InIta
 
Համացանցը և երեխաները
Համացանցը և երեխաներըՀամացանցը և երեխաները
Համացանցը և երեխաներըSafer Internet Armenia
 
Lo que nadie ve en una ciudad patrimonio.
Lo que nadie ve en una ciudad patrimonio.Lo que nadie ve en una ciudad patrimonio.
Lo que nadie ve en una ciudad patrimonio.nuursnc
 
Mktg350 lecture 10022013
Mktg350 lecture 10022013Mktg350 lecture 10022013
Mktg350 lecture 10022013lkirkman
 
Folding Hope: How to Create a Paper Crane
Folding Hope: How to Create a Paper CraneFolding Hope: How to Create a Paper Crane
Folding Hope: How to Create a Paper CraneCarrie Brummer
 
Network Intrusion detection and Countermeasure sElection(NICE
Network Intrusion detection and Countermeasure sElection(NICENetwork Intrusion detection and Countermeasure sElection(NICE
Network Intrusion detection and Countermeasure sElection(NICEPranya Prabhakar
 
Skype for Business IoT
Skype for Business IoTSkype for Business IoT
Skype for Business IoTadachiyosuke
 

Viewers also liked (17)

Кашкарова С.В. Подарок маме – своими руками (проект). — Приложение 8
Кашкарова С.В. Подарок маме – своими руками (проект). — Приложение 8Кашкарова С.В. Подарок маме – своими руками (проект). — Приложение 8
Кашкарова С.В. Подарок маме – своими руками (проект). — Приложение 8
 
BBUS 428 Homework Oct. 2nd
BBUS 428 Homework Oct. 2ndBBUS 428 Homework Oct. 2nd
BBUS 428 Homework Oct. 2nd
 
Enquesta sobre adiccions v2 english (1) (1)
Enquesta sobre adiccions v2   english (1) (1)Enquesta sobre adiccions v2   english (1) (1)
Enquesta sobre adiccions v2 english (1) (1)
 
Congreso diputados diario de sesiones[1]
Congreso diputados diario de sesiones[1]Congreso diputados diario de sesiones[1]
Congreso diputados diario de sesiones[1]
 
Profil smk-sbi-2008-2009
Profil smk-sbi-2008-2009Profil smk-sbi-2008-2009
Profil smk-sbi-2008-2009
 
Os jovens e a comunicação
Os jovens e a comunicação Os jovens e a comunicação
Os jovens e a comunicação
 
(Certificado aeat)
(Certificado aeat)(Certificado aeat)
(Certificado aeat)
 
SISTEM KOMPUER SMT 1 KELAS XI MULTIMEDIA
SISTEM KOMPUER SMT 1 KELAS XI MULTIMEDIASISTEM KOMPUER SMT 1 KELAS XI MULTIMEDIA
SISTEM KOMPUER SMT 1 KELAS XI MULTIMEDIA
 
Eugenia grandet
Eugenia grandetEugenia grandet
Eugenia grandet
 
Համացանցը և երեխաները
Համացանցը և երեխաներըՀամացանցը և երեխաները
Համացանցը և երեխաները
 
Lo que nadie ve en una ciudad patrimonio.
Lo que nadie ve en una ciudad patrimonio.Lo que nadie ve en una ciudad patrimonio.
Lo que nadie ve en una ciudad patrimonio.
 
Mktg350 lecture 10022013
Mktg350 lecture 10022013Mktg350 lecture 10022013
Mktg350 lecture 10022013
 
Folding Hope: How to Create a Paper Crane
Folding Hope: How to Create a Paper CraneFolding Hope: How to Create a Paper Crane
Folding Hope: How to Create a Paper Crane
 
The future of async i/o in Python
The future of async i/o in PythonThe future of async i/o in Python
The future of async i/o in Python
 
Network Intrusion detection and Countermeasure sElection(NICE
Network Intrusion detection and Countermeasure sElection(NICENetwork Intrusion detection and Countermeasure sElection(NICE
Network Intrusion detection and Countermeasure sElection(NICE
 
Sabiya Khatun DOC
Sabiya Khatun DOCSabiya Khatun DOC
Sabiya Khatun DOC
 
Skype for Business IoT
Skype for Business IoTSkype for Business IoT
Skype for Business IoT
 

Similar to Triptico (Magdeburgh)

Building intelligent applications with Large Language Models
Building intelligent applications with Large Language ModelsBuilding intelligent applications with Large Language Models
Building intelligent applications with Large Language ModelsSpeck&Tech
 
Super convergence of autonomous things
Super convergence of autonomous thingsSuper convergence of autonomous things
Super convergence of autonomous thingsConference Papers
 
Conference presentation: ShaMAN - an Agent Meta-model for Computer Games (wit...
Conference presentation: ShaMAN - an Agent Meta-model for Computer Games (wit...Conference presentation: ShaMAN - an Agent Meta-model for Computer Games (wit...
Conference presentation: ShaMAN - an Agent Meta-model for Computer Games (wit...Steve Goschnick
 
SCSimulator: An Open Source, Scalable Smart City Simulator
SCSimulator: An Open Source, Scalable Smart City SimulatorSCSimulator: An Open Source, Scalable Smart City Simulator
SCSimulator: An Open Source, Scalable Smart City SimulatorEduardo Santana
 
Figure 1
Figure 1Figure 1
Figure 1butest
 
Figure 1
Figure 1Figure 1
Figure 1butest
 
Figure 1
Figure 1Figure 1
Figure 1butest
 
A Uniform Specification Of Mixed Reality Interface Components
A Uniform Specification Of Mixed Reality Interface ComponentsA Uniform Specification Of Mixed Reality Interface Components
A Uniform Specification Of Mixed Reality Interface ComponentsNicole Heredia
 
Cognitive Robotics: Merging AI and Robotics for Complex Tasks
Cognitive Robotics: Merging AI and Robotics for Complex TasksCognitive Robotics: Merging AI and Robotics for Complex Tasks
Cognitive Robotics: Merging AI and Robotics for Complex TasksIRJET Journal
 
Model driven architecture
Model driven architectureModel driven architecture
Model driven architectureBiruk Mamo
 
Copy of State of AI Report 2023 - ONLINE.pptx
Copy of State of AI Report 2023 - ONLINE.pptxCopy of State of AI Report 2023 - ONLINE.pptx
Copy of State of AI Report 2023 - ONLINE.pptxmpower4ru
 
State of AI Report 2023 - ONLINE presentation
State of AI Report 2023 - ONLINE presentationState of AI Report 2023 - ONLINE presentation
State of AI Report 2023 - ONLINE presentationssuser2750ef
 
State of AI Report 2023 - Air Street Capital
State of AI Report 2023 - Air Street CapitalState of AI Report 2023 - Air Street Capital
State of AI Report 2023 - Air Street CapitalAI Geek (wishesh)
 
Privacy and Security in Multi-modal User Interface Modeling for Social Media
Privacy and Security in Multi-modal User Interface Modeling for Social MediaPrivacy and Security in Multi-modal User Interface Modeling for Social Media
Privacy and Security in Multi-modal User Interface Modeling for Social Mediamsm2011socialcom
 
CHATBOTS IN A BOTNET WORLD
CHATBOTS IN A BOTNET WORLDCHATBOTS IN A BOTNET WORLD
CHATBOTS IN A BOTNET WORLDIJCI JOURNAL
 

Similar to Triptico (Magdeburgh) (20)

Golem-II+
Golem-II+Golem-II+
Golem-II+
 
Golem II+
Golem II+Golem II+
Golem II+
 
Building intelligent applications with Large Language Models
Building intelligent applications with Large Language ModelsBuilding intelligent applications with Large Language Models
Building intelligent applications with Large Language Models
 
robocity2013-jderobot
robocity2013-jderobotrobocity2013-jderobot
robocity2013-jderobot
 
Super convergence of autonomous things
Super convergence of autonomous thingsSuper convergence of autonomous things
Super convergence of autonomous things
 
Conference presentation: ShaMAN - an Agent Meta-model for Computer Games (wit...
Conference presentation: ShaMAN - an Agent Meta-model for Computer Games (wit...Conference presentation: ShaMAN - an Agent Meta-model for Computer Games (wit...
Conference presentation: ShaMAN - an Agent Meta-model for Computer Games (wit...
 
SCSimulator: An Open Source, Scalable Smart City Simulator
SCSimulator: An Open Source, Scalable Smart City SimulatorSCSimulator: An Open Source, Scalable Smart City Simulator
SCSimulator: An Open Source, Scalable Smart City Simulator
 
Figure 1
Figure 1Figure 1
Figure 1
 
Figure 1
Figure 1Figure 1
Figure 1
 
Figure 1
Figure 1Figure 1
Figure 1
 
A Uniform Specification Of Mixed Reality Interface Components
A Uniform Specification Of Mixed Reality Interface ComponentsA Uniform Specification Of Mixed Reality Interface Components
A Uniform Specification Of Mixed Reality Interface Components
 
Cognitive Robotics: Merging AI and Robotics for Complex Tasks
Cognitive Robotics: Merging AI and Robotics for Complex TasksCognitive Robotics: Merging AI and Robotics for Complex Tasks
Cognitive Robotics: Merging AI and Robotics for Complex Tasks
 
RIPS RoboCup@home 2013, The Netherlands
RIPS RoboCup@home 2013, The NetherlandsRIPS RoboCup@home 2013, The Netherlands
RIPS RoboCup@home 2013, The Netherlands
 
Model driven architecture
Model driven architectureModel driven architecture
Model driven architecture
 
Copy of State of AI Report 2023 - ONLINE.pptx
Copy of State of AI Report 2023 - ONLINE.pptxCopy of State of AI Report 2023 - ONLINE.pptx
Copy of State of AI Report 2023 - ONLINE.pptx
 
State of AI Report 2023 - ONLINE presentation
State of AI Report 2023 - ONLINE presentationState of AI Report 2023 - ONLINE presentation
State of AI Report 2023 - ONLINE presentation
 
State of AI Report 2023 - Air Street Capital
State of AI Report 2023 - Air Street CapitalState of AI Report 2023 - Air Street Capital
State of AI Report 2023 - Air Street Capital
 
Clei Tutorial 2010 - Texto
Clei Tutorial 2010 - TextoClei Tutorial 2010 - Texto
Clei Tutorial 2010 - Texto
 
Privacy and Security in Multi-modal User Interface Modeling for Social Media
Privacy and Security in Multi-modal User Interface Modeling for Social MediaPrivacy and Security in Multi-modal User Interface Modeling for Social Media
Privacy and Security in Multi-modal User Interface Modeling for Social Media
 
CHATBOTS IN A BOTNET WORLD
CHATBOTS IN A BOTNET WORLDCHATBOTS IN A BOTNET WORLD
CHATBOTS IN A BOTNET WORLD
 

More from Grupo Golem (DCC-IIMAS-UNAM) (9)

El proyecto golem ii+
El proyecto golem ii+El proyecto golem ii+
El proyecto golem ii+
 
Micai13 turdus migratorius (2)
Micai13   turdus migratorius (2)Micai13   turdus migratorius (2)
Micai13 turdus migratorius (2)
 
Micai 13 contextualized practical speech
Micai 13  contextualized practical speechMicai 13  contextualized practical speech
Micai 13 contextualized practical speech
 
RIPS Tornemo Mexicano de Robotica 2012
RIPS Tornemo Mexicano de Robotica 2012RIPS Tornemo Mexicano de Robotica 2012
RIPS Tornemo Mexicano de Robotica 2012
 
INTERACTION-ORIENTED COGNITIVE ARCHITECTURE IOCA
INTERACTION-ORIENTED COGNITIVE ARCHITECTURE IOCAINTERACTION-ORIENTED COGNITIVE ARCHITECTURE IOCA
INTERACTION-ORIENTED COGNITIVE ARCHITECTURE IOCA
 
The Golem Group (1998-2011)
The Golem Group (1998-2011)The Golem Group (1998-2011)
The Golem Group (1998-2011)
 
Poster: Distance Learning for Author Verification
Poster: Distance Learning for Author VerificationPoster: Distance Learning for Author Verification
Poster: Distance Learning for Author Verification
 
Concept of service robots
Concept of service robotsConcept of service robots
Concept of service robots
 
Grupo Golem
Grupo GolemGrupo Golem
Grupo Golem
 

Triptico (Magdeburgh)

  • 1. TASK DESCRIPTION Golem-II+ carries out different tasks with a generic interactive model. The model is based on interaction protocols named Dialogue Models (DMs). The DMs describe sets of situations in which the expectations, intentions and actions related to a specific task are represented. In a DM, each situation (S) is an informational state. To move from Si to Sj the match between an expectation (α) and an action (ß) has to be accomplished. The Interaction-Oriented Cognitive Architecture (IOCA) integrates perception, thought and action with computational structures and processes. It offers a flexible framework to design complex tasks. The DMs are integrated into a cognitive architecture in order to coordinate the robot's capabilities and its interaction with humans. THE GENERIC MODEL Notation Si Sj α:ß THE ROBOT HARDWARE - PeopleBot: * Three 8-sensor sonar arrays * Two protective IR sensors in the front * Two vertical break beams * Two protective 5-bumper arrays * Speakers * Internal computer VersaLogic EBX-12 - Dell Latitude E6400 laptop computer - QuickCam Pro 9000 Webcam - Microsoft Kinect Camera - Hokuyo UTM-30LX Laser - Shure Base Omnidirectional microphones x3 - RODE VideoMic directional microphone - M-Audio Fast Track Ultra (audio interface) - Infinity 3.5-Inch Two-Way loudspeakers x2 - Robai Cyton Veta 7DOF robotic arm SOFTWARE SOFTWARE LIBRARIES JACK, PocketSphinx SVS, OpenCV and OpenNI Sicstus Prolog PulseAudio, Festival TTS Player/Stage and Gearbox MODULE Navigation Dialogue Manager Vision Voice Recognition Voice Synthesizer Object Manipulation Actin-SE Software IOCA EXTERNAL REPRESENTATIONS OR THE WORLD Coordinator Perceptual Memory Dialogue Manager Semantic Memory Satisfaction Module Interpretation Module Autonomous Reactive System Rendering Devices Recognition Devices IOCA SCENARIOS Pharmacy dispatcher Cleaning Assistant The RoboCup@Home competition provides an excellent evaluation environment for the conceptual framework and technology developed by the Golem Group. The robot Golem-II+ is the latest service robot developed within the conceptual framework of Dialogue Models, IOCA, and the following technology:
  • 2. Departamento de Ciencias de la Computación RoboCup German Open 2012 A generic model of coordinated communication and action for service robots Universidad Nacional Autónoma de México Instituto de Investigaciones en Matemáticas Aplicadas y en Sistemas Departamento de Ciencias de la Computación THE GOLEM GROUP Luis Pineda (team leader) Ivan Meza Caleb Rascón Gibran Fuentes Mario Peña Carlos Gershenson Iván Sánchez Mauricio Reyes Arturo Rodríguez Hernando Ortega Miguel Salazar Lisset Salinas Joel Durán Varinia Estrada http://golem.iimas.unam.mx The Golem Group presents a generic model for solving service robot tasks. The model proposes an abstract solution for the managing of diverse kinds of behaviors in systems based on human-robot interaction. The model is implemented in Golem-II+, which coordinates its multimodal capabilities to perform communicative interactions independently of the domain and the concrete task. It also includes communicative strategies for error prevention and recovery. Golem-II+ is able to: * listen and interpret linguistic instructions * explain the information requested by the user about the domain * navigate through its environment * visual object recognition * grasp objects * recover from misinterpretations The system interacts with the user in an intentional level. The robot's actions are causally related to the expressed intentions during the communication process. golem@turing.iimas.unam.mx THE GOLEM GROUP GOLEM-II+