The document discusses virtual intelligence, which is the intersection of virtual worlds and artificial intelligence. It provides background on virtual worlds and artificial intelligence. It then discusses how virtual worlds provide a unique platform for AI beyond traditional user interfaces by allowing for visual and immersive experiences. It also discusses challenges for AI in virtual worlds like navigation, object identification, and expressing emotions.
3. Teletype Character VDU Windows Audio-Visual Virtual Worlds The immersion of virtual worlds provides a unique platform for AI beyond the traditional paradigm of past User Interfaces (UIs). What Alan Turing established as the benchmark for telling the difference between human and computerized intelligence was done void of visual influences. With today’s AI bots, virtual intelligence has evolved past the constraints of past testing into a new level of the machine's ability to demonstrate intelligence. Evolution of AI to VI
4.
5. Are we able to create an NPC within a virtual world which is indistinguishable in its complete behaviour from a player character or avatar? Second Life-based chatbot avatar for Daden Limited Web-based chatbot avatar for Daden Limited Artificial Intelligence goes Virtual
6.
7. Defense and Homeland Security Aeronautics, Engineering, and Transportation Virtual Patients and roleplay for training (Extreme Reality, Duke University, Daden, and others) VI Bots for Government NASA has developed a great deal with virtual environments and AI Northrop Grumman Cutlass Bomb Disposal Robot Government, Research, Education and Environment Second China, NPCs in Adult Learning programs by Daden for UK University for Industry and Sun Tzu for USJFCOM Health, Medical and Biotech
11. Object and avatar appearance/ disappearance (ASML) 1. Surprise & Startle vs EAD 2. Explicit vs AIML 3. Implicit vs EAD/Chat Lookup => AEML Not yet modelled 4. Fuzzy mixing of emotional states = AEML 5. Not yet modelled 6. Reason for last state stored, and accessible from AIML Avatar expressions/ gesture/movement/ chat (AAML) 2. Appraisal of Stimulus 3. Unconscious Reaction 4. Physiological Changes 5. Motivation to Act 6. Conscious Realisation (feelings) 1. Detection of Stimulus (Perception/Sensation) Developed by University of Wolverhampton. Grounded in psychology and psychology research and models. Altair Architecture
14. David Burden Daden Limited www.daden.co.uk www.converj.com/blog [email_address] Twitter: daden5 Second Life: Corro Moseley Second Life sim: Daden Prime David Fliesen Sonalysts, Inc. www.sonalystsmedia.com [email_address] Second Life: Joey Aboma Contact Information
19. libsecondlife altair #2 Second Life Servers ASML/ AAML via web service Perl API Bus Human User BotIF altair #1 Other Engines Emotion Engine Navigation Engine Discourse AIML Chatbot Engine Web Services Server (on web) (Perl) PC or Server (on web) (C#) SL Interface Discourse RDF Engine Altair Architecture - Physical
20. Personality Cognition Conation AAML/ Enaction Emotion/Mood (Short term) (Long Term) Motivation (Short term) (Long Term) Self-Monitoring /Modifying Realms - Virtual Worlds - Web - Cyberspace - Real World ASML/ Sensation V1 081125 World Model Memory Chat Engine Navigation Engine Spatial Manager Memory Manager Dreaming Embodiment/ Representation 'bot' like 'human' like “ aware” Planner Other Engines “ Low” Level Functions “ High” Level Functions Altair Architecture - Logical
Editor's Notes
(DAVID BURDEN INTRO) (DAVID FLIESEN INTRO) Hello, I’m Dave Fliesen. Over the past 20 plus years, I’ve worked in the areas of multimedia design and training for the U.S. Navy, where I served as a journalist, combat photographer, master training specialist, and public affairs officer. I’ve more recently been working in the areas of virtual worlds and artificial intelligence for the multimedia firm Sonalysts, where I designed an artificially intelligent virtual guide modeled after Sun Tzu from ancient China, and provided a virtual world demo at last fall's ModSim World in the U.S. I was the graphic designer for U.S. Joint Forces Command’s -- Joint Operating Environment – or the JOE – and designed the JOE Geodome in Second Life to provide a look into the tacit knowledge of futures research and open the future's dialogue to a wider audience – in my work on the “Whole of Society Crisis Response” with Army Research Lab, the University of Edinburgh, and Carnegie Mellon University. I’m currently working with the Institute of Electrical and Electronics Engineers (IEEE) on virtual worlds standards – as well as an Artificial Intelligence Learning Center to provide an immersive experience for learning about AI and robotics. Sonalysts has a wide range of multimedia capabilities in both government and commercial markets - everything from Top Secret to Top 40. We have a long history in the training and entertainment markets with combat simulation games released with Electronic Arts. Our latest console game “Zoo Disc Golf” was just released on June 7th for Nintendo WiiWare.
(DAVID FLIESEN SLIDE) Q - What is virtual intelligence? A – VI is basically the intersection of 2 technologies: Virtual Worlds and Artificial Intelligence. “ Virtual Intelligence is not your grandfather’s Artificial Intelligence.” With the emergence of virtual environments, the paradigm has changed and new tests need to be developed to determine what is believed to be human vice computer intelligence. The immersive features of these environments provide non verbal elements that affect the realism provided by Virtually Intelligent agents. VIRTUAL ENVIRONMENTS – these immersive 3D spaces provide greater collaboration, simulations, and role playing interactions for training. The ease at which modeling and simulation can be designed and adjusted – make these environments ideal for keeping resources and information up-to-date – at the speed of thought. Many of these virtual environments are currently being used for government and academic projects, including Second Life, VastPark, Olive, OpenSim, Oracle/Sun’ Microsystem’s Open Wonderland, Duke University’s Open Cobalt, and many others. Some of the commercial virtual worlds are also taking this technology into new directions, including the high definition virtual world Blue Mars. U.S. Congressman Randy Forbes mentioned his vision for the future of modeling and simulation – where people across the world would have M&S tools on their desktops much like many of us today have Microsoft Office. These virtual worlds provide just such a capability today for anyone in the world to conduct modeling and simulation from their desktop. ARTIFICIAL INTELLIGENCE – the field of AI has been around for more than 50 years – but has been stifled at times in its development due to misconceptions about the technology. Many movies have portrayed AI becoming “Self Aware” and taking over the world – without providing any conclusive evidence to show us if that has any kind of a factual basis. Many have speculated about the rebirth of AI into new applications. The virtual environments provide just such an application – to take AI past the simple text-based to an immersive space where non-verbals and visual cues affect not only the believability of the AI, but also the usefulness of it. Because like many things in technology, it’s not just about “does it work” but also about “how do we feel about it working.” Virtual Intelligence draws a new distinction as to how this application of AI is different due to the environment in which it operates.
(DAVID BURDEN SLIDE)
(DAVID BURDEN SLIDE)
(DAVID BURDEN SLIDE)
(DAVID BURDEN SLIDE)
(DAVID FLIESEN & DAVID BURDEN SLIDE) (1) DEFENSE AND HOMELAND SECURITY – Virtual Intelligence can be applied to find patterns in events or behaviors that are threat indicators. Northrop Grumman’s Cutlass Bomb Disposal Robot was selected as a virtual training opportunity because aof the prohibitive real world cost and dangers associated with bomb disposal -- by replicating a complicated system without having to learn advanced code. The virtual robot has no risk of damage, trainee safety hazards, or accessibility constraints. (2) AERONAUTICS, ENGINEERING, AND TRANSPORTATION - VI can be applied to operate vehicles (e.g. DARPA challenge). Natural language processors can use AI for more fluent data entry. NASA has done a great deal of work in the virtual environments and with artificial intelligence technologies. One example is the use of Cybertwin for the Phoenix rover in the virtual world Second Life. It used a programmed profile to relay information about the Phoenix rover to inform people on what it was doing and its purpose. (3) GOVERNMENT, RESEARCH, EDUCATION AND ENVIRONMENT - VI agents (like Sun Szu) can be an instructor – thereby taking the guide to the next level. VI can provide better answers than a typical agent. Research focused on reasoning and learning would enhance all applications. The University of Florida developed the "Second China" project as an immersive training experience for learning how to interact with culture and language in a foreign country. Students are immersed in an environment that provides roleplaying challenges coupled with language and cultural sensitivities magnified during country-level diplomatic missions or during times of potential conflict or regional destabilization. The virtual training provides participants with opportunities to access information, take part in guided learning scenarios, communicate, collaborate, and role-play. While China was the country for the prototype, this model can be modified for use with any culture to help better understand social and cultural interactions and see how other people think and what their actions imply. (4) HEALTH, MEDICAL, AND BIOTECH - VI can be used to provide preliminary diagnoses based on symptoms and/or tests. The one pictured here is the "Duke School of Nursing Training Simulation" from Extreme Reality using the Unity 3D game engine. This tests critical thinking with a nurse performing trained procedures to identify critical data to make decisions and performing the correct steps for intervention. Bots are programmed to response to the nurses actions as the patient with their conditions improving if the nurse performs the correct actions. The goal is to bridge the gap between classroom and physical world training by augmenting their classroom materials, not replacing them.
(DAVID BURDEN SLIDE)
(DAVID BURDEN SLIDE)
We’ll either do a live demo in Second Life of the Altair Architecture or (if Second Life connectivity is down) use the YouTube video on automated avatars at: http://www.youtube.com/watch?v=9hte2MJ54CA
(DAVID BURDEN SLIDE)
(DAVID BURDEN SLIDE)
(DAVID FLIESEN SLIDE) Here is a video on the Virtual Government – or vGov – project, which includes: U.S. Department of Agriculture - Continuity of Operations training (Teleplace) U.S. Air Force - transforming their training and education systems using geo-accurate 3D recreations of the Medical Education and Training Campus (METC) at Ft. Sam Houston (Olive) Department of Homeland Security - using 3D visualization to collaborate, train, and study cyber security National Defense University - building a virtual Community of Practice (VastPark)
(DAVID FLIESEN) Introduces contact information and mentions our avatar names in Second Life. (DAVID BURDEN) Then David Burden asks if there are any questions from the audience.