• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Designing Interactions at the Nexus of the Physical and Virtual World
 

Designing Interactions at the Nexus of the Physical and Virtual World

on

  • 186 views

Game Lecture Series

Game Lecture Series
ITU Copenhagen
2011

Statistics

Views

Total Views
186
Views on SlideShare
186
Embed Views
0

Actions

Likes
1
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Designing Interactions at the Nexus of the Physical and Virtual World Designing Interactions at the Nexus of the Physical and Virtual World Presentation Transcript

    • Ars Electronica Futurelab Research & Innovation Group
    • Definition of what I am NOT talking about com·put·er game (plural com·put·er games) noun Definition: game played on computer: a game in the form of computer software, run on a personal computer or games machine and played by one or more people using a keyboard, mouse, control pad, or joystick. Microsoft Encarta Ars Electronica Futurelab Research & Innovation Group
    • Most Computer games nevertheless … … use a handful of standardized interfaces ... are build on a very limited number of concepts … ignore context and environment Ars Electronica Futurelab Research & Innovation Group
    • The reason is obvious This is the way how to sell things efficiently. Ars Electronica Futurelab Research & Innovation Group
    • But this is what you might miss … Ars Electronica Futurelab Research & Innovation Group
    • From Immersion … … to Transmersion? Transmersion? Not about making interfaces invisible, but about transforming the interface itself to the main element for the player’s connection to the physical and social environment Ars Electronica Futurelab Research & Innovation Group
    • An alternative, preliminary Definition of Computer Game … A computer game is structured, computer-based playing with goals rules challenge and interaction goals, rules, challenge, as key components. (work in progress) Ars Electronica Futurelab Research & Innovation Group
    • Shadowgram Interactive Workshop System 2010A person stands in front of an illuminated screen and isphotographed. The result is a shadow-image in which a humansilhouette is all that can be seen. This picture is then printed out as aminiature sticker and applied to a “map” whose topography has beenderived from a cluster of topics like education, environment, healthsystem and society, whereby the body language of the silhouette, aspeech balloon containing a brief statement, and the respectivethematic cluster coalesce into a message.Shadowgram Creative Catalyst for Social Brainstorming by Shadow Ars Electronica Futurelab Research & Innovation Group
    • For instance: the person in front of the illuminated screen covers his/her ears with his/her hands while beingphotographed. This silhouette is then allocated to the environment cluster and a speech balloon containing a remarkabout noise pollution is added to it. The upshot is a highly creative, graphic mode of “social brainstorming” and thus ameans of identifying problems and bringing out potential solutions."Shadowgram" is a work by the Ars Electronica Futurelab (AT). Ars Electronica Futurelab Research & Innovation Group
    • Ars Electronica Futurelab Research & Innovation Group
    • Ars Electronica Futurelab Research & Innovation Group
    • Ars Electronica Futurelab Research & Innovation Group
    • “Robotinity” is a portmanteau word that blends robotics and humanity and thus succinctly expresses the new RoboLab’s centraltheme: emblematic examples culled from fields of art, design and science illustrate just how closely human beings and machines arealready living and working together. These highly charged facts & circumstances will serve up a foretaste of the risks and rewards ourshared future just might have in store…ROBOTINITY Exhibition Formulation of Social Contextual Ars Electronica Futurelab Research & Innovation Group Robot Studio
    • myBOT workshop“myBOT” is an entertaining way to play with identities. The first step is to take portrait photos. Next, you use a simple program toprocess them into a short stop-motion animation sequence. Then you select just the right robot body from a gallery of options andspecify its behavior. The result is a customized myBOT that might be funny or serious, offbeat or nerdy. “myBOT” enables you todesign a robot in a way that’s fun and easy.MyBOT Make your bot! Ars Electronica Futurelab Research & Innovation Group
    • Outline of this talk (St)age of Futurelab Gulliver Fab Lab Partici- World pation Ars Research Electronica Questions Introduction Case Study Future Work Back- Q&A ground Deep Geocity Intention Space CADETt0 Ars Electronica Futurelab Research & Innovation Group
    • BackgroundArs Electronica Timeline ART – TECHNOLOGY – SOCIETY Ars Electronica assembles and configures the commentary, concepts and visions of our modern, information-based society, whereby currently prevailing facts & circumstances are always taken as points of departure Festival Ars Electronica (since 1979) for speculation about where we’re headed. Festival for Art, Technology and Society In short: future manifestations that are presently in the process of Prix Ars Electronica (since 1987) emerging are what Ars Electronica is interested in. Attention is never international Competition for Cyberarts focused singularly on art, technology or society, but rather on their complex metamorphoses and interrelationships. Ars Electronica Center (since 1996) Museum of the Future Ars Electronica Futurelab Laboratory for Future Innovations New Ars Electronica Center 2004 2005 2007 2009 Extension to 6500m², Opening Jan. 2009 1979 1987 1996 Ars Electronica Gallery in Vienna (Vienna Museumsquarter) Ars Electronica international Ludwig Boltzmann Research Institute for Media Art Research and Digital Archives Ars Electronica Futurelab Research & Innovation Group
    • Center Ars Electronica is a company owned by Linz City and an internationally unique platform for digital art an media culture, consisting of Futurelab four division: Festival PrixThe annual budget of Ars Electronica: Is this an institute of Linz City?balance sheet total 2009: 14,4 Mio € Ars Electronica Linz GmbH (=limited company) is 100% owned by the City ofFunding : 60 % subsidies Linz 22 % own income 18 % 3rd party projects Is AEC managed by tax? Founding consists of subsidies (mainly City of Linz and Region UpperNumber of employee: Austria), own income (entrance fee museum, festival tickets) and 3rd party76 full time employee projects developed by Ars Electronica Futurelab96 part time employeesum: 116 full time employee equivalent Is this an independent organization? Ars Electronica is owned by the city but independent within it’s missionPartner and past examples as a collaborative research statementSiemens CT, SAP AG , Vodafone Group R&D, KANSAITV, HONDA R&D, HAKUHODO, … Ars Electronica Futurelab Research & Innovation Group
    • Futurelab: A Visual Image for a Research System Business FL Production Team (Interface and Interaction Design, Information Design, Advanced Sensing Technologies, Network & Database Technologies etc…) Experience Design Media Architecture Media PerformanceProjects FL Research & Innovation GroupInnovative ResearchBasic Research FL Fundamental Research Futurelab is one department in Ars Electronica, for conducting research and development. In this collaborative project, FL Research & Innovation Group will be conducting the research, with working FL production team. Ars Electronica Futurelab Research & Innovation Group
    • Research Topics of Research & Innovation Group Persuasive Technology Interaction Creative Functional Ecology Catalyst Aesthetic ROBOTINITYThe Research & Innovation Group focuses on key issues for socialization of media and technologies.Right now, we have five research topics and all topics formulate international research hubs in each topic.These five topics are flexibly connecting and generating fusion models to coin new concepts, through actual working models. Ars Electronica Futurelab Research & Innovation Group
    • Interaction Ecology“How to Design “Interaction” in Embodied Media Environment”OverviewThis research topic aims for a holistic and analytic approach to Interaction Design.Traditional User Centered Design commonly focuses on single user interactions between the user and an interface. To dealwith today’s increasingly complex systems, where centralized control over information on a variety of arbitrary interfaces invarying detail is essential, this is not enough.It is inevitable to find new cognitive models and metaphors to get along in these ecologies. They constitute themselves as afunctional set of artifacts, people and the surrounding environment and the rich interaction in between. We identify these as"Interaction Ecologies".Research Records and PartnersVodafone, Siemens, SAP, Microsoft, HP, BMW, CADET (Austrian Governmental Fund) Ars Electronica Futurelab Research & Innovation Group
    • Functional Aesthetic“How to Design New Communication Integrating Functions and New Materials"OverviewThis research topic focuses on the new possibilities of functions produced by new materials. Now, media technologies areintergrated to our daily lives and it needs natural and organic user interfaces.In this research topic, we search for new forms of organic communication generated by new materials.Research Records and PartnersElekit, Johannes Kepler University Linz SWITCH Ars Electronica Futurelab Research & Innovation Group
    • Robotinity“How to Coexist with Robots in the Future”OverviewRobotinity is a study how people coexist with robot. Depending on cultural backgrounds, the meaning of robot and technologyis totally different. Whats the robot? What is our humanity? Both has to be considered when we design a robot.In this research topic, we aim to search for factors how people coexist with robot.Research Records and PartnersHonda R&D, Murata Manufacturing Company, ATR, Osaka University Meet ASIMO in Deep Space Ars Electronica Futurelab Research & Innovation Group
    • Creative Catalyst“How to Create a Medium and Place for Prompting Creativities”OverviewPeople are creative. However, many things are hidden in the world.How media technologies can prompt new creativities for people? In this research topic, we research methodologies and toolsto enhance creativities.Research Records and PartnersHakuhodo, Kansai TV, Smart Technologies, STUDIOLAB (EU-FP7) Shadowgram Ars Electronica Futurelab Research & Innovation Group
    • Persuasive Technology“How to Coexist with Technologies for Sustainable Society and CultureOverviewIt is dedicated to the application-oriented research and development of persuasive technologies and Ambient Devices, aimedat raising awareness of environmentally sustainable practices at individual and societal level. Persuasion in the psychologicalprocesses are studied believe that lead the addressee to setting changes and resulted in tangible changes in behavior. Withexpertise regarding this and may also need social change processes in a positive direction can be controlled.In this research, we search for social responsibilities how new media is developed for keeping sustainable society.analysis and personalized system adaptations.Research Records and PartnersJohannes Kepler University Linz Ars Electronica Futurelab Research & Innovation Group
    • Outline of this talk (St)age of Futurelab Gulliver Fab Lab Partici- World pation Ars Research Electronica Questions Introduction Case Study Future Work Back- Q&A ground Deep Geocity Intention Space CADET Ars Electronica Futurelab Research & Innovation Group
    • Case Study: Gullivers World Hidden Gullivers Worlds Box Gullivers World Geocity Fab Lab Deep Space
    • Case Study: Gullivers World Research Topics • Digital content creation • Scene creation and non-linear story telling • Playful and metaphoric Interaction Design • Interface and tracking technologies • Virtual / mixed reality installations • Collaborative Environment • Exhibition Design
    • Case Study: Gullivers World Constraints and Demands • Visitors time: 10 to 20 minutes • Workshops with 60+ minutes • Single user as well as • Groups of up to 15+ • 70.000+ visitors / year • Visitors age: 3 to 90+ • Visitors knowledge: novice to expert • Integrate topics of broader artistic, social and/or technological concern
    • Case Study: Gullivers WorldHidden Worlds of Soundand Voice (2002)An interactive audiovisual installation whose centraltheme is the magical relationship of speech to the etherealmedium which conveys it. Participants in this exhibit areable to "see" each others voices, made visible in the formof animated graphic figurations that appear to emergefrom the participants mouths.Golan Levin, Zachary Lieberman and Ars ElectronicaFuturelab
    • Case Study: Gullivers WorldGulliver’s Box (2003)This installation represents the effort to pursue newapproaches how to deal with Mixed Reality content. Thechallenge at the core of this project was to position aninnovative medium somewhere between theater, film andinstallation. The result is an infrastructure that offersartists new opportunities to convey audiovisualinformation, and one that ought to encourage creatives inevery discipline to work with these new approaches.Adrian Cheok, Hirokazu Kato and Ars Electronica Futurelab
    • Case Study: Gullivers World Gulliver’s Box: Interaction Design
    • Case Study: Gullivers World Gulliver’s Box: visitor generated content
    • Case Study: Gullivers WorldGulliver’s World (2004)Motivated by the success of Gulliver’s Box, Futurelabtook another long look at the concept and expanded itin several directions. Important new features designedinto Gulliver’s World are that users are no longerlimited to preset environments and characters;instead, they are called upon to design the artificialworld and its components themselves. This wasaccomplished by the development of intuitive editorswith which the environment can be totally revised andcustomized anew each time.Hirokazu Kato and Ars Electronica Futurelab
    • Case Study: Gullivers World Gulliver’s World: Character Design
    • Case Study: Gullivers World Gulliver’s World: Interface Design
    • Case Study: Gullivers World Gulliver’s World: Introduction Video
    • Case Study: Gullivers World Data Distribution and Synchronisation Gulliver’s World: complex interplay of different installations
    • Case Study: Gullivers World Gulliver’s World: “Beholder” as central world simulator
    • Case Study: Gullivers World Gulliver’s World: Clay workshop and 3d Scanner
    • Case Study: Gullivers World Way from the physical into the virtual world: 12 reference pictures
    • Case Study: Gullivers World Way from the physical into the virtual world: separation and calibration
    • Case Study: Gullivers World Way from the physical into the virtual world: Visual Hull reconstruction
    • Case Study: Gullivers World Way from the physical into the virtual world: Texture recreation
    • Case Study: Gullivers World Gulliver’s World: Rotation Editor
    • Case Study: Gullivers World Gulliver’s World: Rotation Editor
    • Case Study: Gullivers World Gulliver’s World: Object carriers as physical representation for digital content
    • Case Study: Gullivers World Gulliver’s World: Paint terrains and stamp objects
    • Case Study: Gullivers World Gulliver’s World: Jigsaw puzzle metaphor for the last missing piece of a world
    • Case Study: Gullivers World Gulliver’s World: Greenbox for video recordings of visitors
    • Case Study: Gullivers World Gulliver’s World: A transparent box to carry the recorded data inside
    • Case Study: Gullivers World Gulliver’s World: Character Editor
    • Case Study: Gullivers World Gulliver’s World: Character modification influences abilities, behavior and storyline
    • Case Study: Gullivers World Gulliver’s World: The World stage is the central element of the installation
    • Case Study: Gullivers World Gulliver’s World: Collaborative virtual environment
    • Case Study: Gullivers World Gulliver’s World: Motion analysis influences characters
    • Case Study: Gullivers World Gulliver’s World: Stereoscopic Tracking of Boxes
    • Case Study: Gullivers World Gulliver’s World: Infrared reflective markers
    • Case Study: Gullivers World Gulliver’s World: Exploration through virtual expedition
    • Case Study: Gullivers World Gulliver’s World: The shelf reveals the content of the box
    • Case Study: Gullivers World Gulliver’s World: Pictures from the virtual world can be sent home
    • Case Study: Gullivers WorldCity Puzzle (2006)An interactive simulation environment visualizestechnological approaches that city planners andarchitects of the future will be working with. Thisinstallation is an expanded spin-off of “Gulliver’sWorld,” the Ars Electronica Center’s mixed realityenvironment, and uses a simple urban planningmodel as an example illustrating concreteapplication possibilities. Visitors can manipulatethe various scenarios with haptic tools.Ars Electronica Futurelab
    • Case Study: Gullivers World City Puzzle: Characters become buildings
    • Case Study: Gullivers World City Puzzle: By placing the characters the visitor starts to build a growing city
    • Case Study: Gullivers World City Puzzle: The city comes to life
    • Case Study: Gullivers World Gulliver’s World: Additional and improved haptic interfaces
    • Case Study: Gullivers World City Puzzle: New interfaces allow the exploration of the virtual world
    • Hidden Gullivers Worlds Box Gullivers WorldGeocity FabLab Deep Space Ars Electronica Futurelab Research & Innovation Group
    • Imagine a future in which you no longer buy gym shoes in a store; instead, you print them out at home, use them, and then toss theminto the recycling bin when you’re done. What now seems like a weird futuristic vision could soon be reality. The idea behind FabLab(from fabrication) is the capability of downloading objects from the internet and printing them out at home. And not just on paper; asreal stuff! A 3D printer uses a computer model to generate an actual object, and a computer-controlled laser cutter does the high-precision shaping of any chosen material. Using the internet makes it possible to disseminate designs for articles of clothing orpieces of furniture just as easily as sharing music and pictures today. What is indeed unimaginable is this technology’s impact onestablished industries.FABLAB AEC Do it your self in the future Ars Electronica Futurelab Research & Innovation Group
    • Ars Electronica Futurelab Research & Innovation Group
    • The Gallery as central element Ars Electronica Futurelab Research & Innovation Group
    • Making digital objects physical Ars Electronica Futurelab Research & Innovation Group
    • Making physical objects digital Ars Electronica Futurelab Research & Innovation Group
    • Create Digital Content Ars Electronica Futurelab Research & Innovation Group
    • Workshop and Lectures with Artists Ars Electronica Futurelab Research & Innovation Group
    • Print your personal iPhone cover Ars Electronica Futurelab Research & Innovation Group
    • Using LASER cut silhouettes … Ars Electronica Futurelab Research & Innovation Group
    • … to create little phantasy worlds Ars Electronica Futurelab Research & Innovation Group
    • Create your plushy toys Ars Electronica Futurelab Research & Innovation Group
    • Hidden Gullivers Worlds Box Gullivers WorldFabLab Geocity Deep Space Ars Electronica Futurelab Research & Innovation Group
    • It’s estimated that planet Earth will have nearly 10 billion inhabitants in 2050, more than two-thirds of them living in cities. All over the world, metropolitan areas are exploding into newmegacities. Homo sapiens is evolving into homo urbanicus, a being whose hopes—and, all toooften, disappointments—are connected more closely than ever before to the course of “life in thebig city” … “GeoCity” examines global developments and their local impactGEO CITY Discursive and participatory urban Information Environment Ars Electronica Futurelab Research & Innovation Group
    • Linz, Upper Austria Ars Electronica Futurelab Research & Innovation Group
    • Three important Locations Ars Electronica Center New City Hall Old City Hall Ars Electronica Futurelab Research & Innovation Group
    • New City Hall Ars Electronica Futurelab Research & Innovation Group
    • 1:2000 scale model Ars Electronica Futurelab Research & Innovation Group
    • Old City Hall Ars Electronica Futurelab Research & Innovation Group
    • Changing Linz Ars Electronica Futurelab Research & Innovation Group
    • Interactive surface, graspable physical objects Ars Electronica Futurelab Research & Innovation Group
    • Designing the environment Ars Electronica Futurelab Research & Innovation Group
    • Ars Electronica Futurelab Research & Innovation Group
    • SimLinz Ars Electronica Futurelab Research & Innovation Group
    • Panorama Projection Ars Electronica Futurelab Research & Innovation Group
    • Digital Booklet & PenBooklet & pen Ars Electronica Futurelab Research & Innovation Group
    • Anoto Technology Ars Electronica Futurelab Research & Innovation Group
    • Information map Ars Electronica Futurelab Research & Innovation Group
    • Data Selection Ars Electronica Futurelab Research & Innovation Group
    • Interactive Table Surface Ars Electronica Futurelab Research & Innovation Group
    • Discursive Environment Ars Electronica Futurelab Research & Innovation Group
    • Ars Electronica Futurelab Research & Innovation Group
    • Ongoing DevelopmentSimLinz mobile, 2010 Ars Electronica Futurelab Research & Innovation Group
    • Urfahraner Markt Ars Electronica Futurelab Research & Innovation Group
    • Urfahraner Markt Ars Electronica Futurelab Research & Innovation Group
    • Urfahraner Markt Ars Electronica Futurelab Research & Innovation Group
    • Urfahraner Markt Ars Electronica Futurelab Research & Innovation Group
    • Life Signs: While your heart beats Ars Electronica Futurelab Research & Innovation Group
    • Sim Linz Ars Electronica Futurelab Research & Innovation Group
    • We are Linz Ars Electronica Futurelab Research & Innovation Group
    • Shadowgram Ars Electronica Futurelab Research & Innovation Group
    • Wall topography for Linz Ars Electronica Futurelab Research & Innovation Group
    • Hidden Gullivers Worlds Box Gullivers WorldGeocity Deep Space FabLab Ars Electronica Futurelab Research & Innovation Group
    • CAVE technology was yesterday. Deep Space is right now. Experience a newdimension of travel through space and time. Immerse yourself into breathtaking 3Dstereo universes featuring jumbo-format, high-definition images that willabsolutely blow you away!DEEP SPACE Huge Immersive Environment Ars Electronica Futurelab Research & Innovation Group
    • Ars Electronica Futurelab Research & Innovation Group
    • Playing Games Ars Electronica Futurelab Research & Innovation Group
    • Exploring the Universe Ars Electronica Futurelab Research & Innovation Group
    • Concerts, 3d visualized Ars Electronica Futurelab Research & Innovation Group
    • Ars Electronica Futurelab Research & Innovation Group
    • Ars Electronica Futurelab Research & Innovation Group
    • Give Lectures Ars Electronica Futurelab Research & Innovation Group
    • Conduct Research (August 31, 2010) Honda’s humanoid robot ASIMO will make its public debut in Austria at this years Ars Electronica Festival. September 2-8 in Linz, festivalgoers will have the opportunity to experience an impressive demonstration of ASIMO’s extraordinary capabilities at Deep Space in the Ars Electronica Center. Research & Innovation Group collaborates with Honda R&D for the future vision of humanoid robot. ASIMO Project Social Experiment in Deep Space Ars Electronica Futurelab Research & Innovation Group
    • Ars Electronica Futurelab Research & Innovation Group
    • Game based Interaction Experiments Ars Electronica Futurelab Research & Innovation Group
    • Outline of this talk (St)age of Futurelab Gulliver Fab Lab Partici- World pation Ars Research Electronica Questions Introduction Case Study Future Work Back- Q&A ground Deep Geocity Intention Space CADET Ars Electronica Futurelab Research & Innovation Group
    • Multiple Participants interacting with Asimo simultaniously Ars Electronica Futurelab Research & Innovation Group
    • Triggering “Soundballs” by stepping into Visualization Ars Electronica Futurelab Research & Innovation Group
    • Tracking systems upgrade Ars Electronica Futurelab Research & Innovation Group
    • Multicamera System Ars Electronica Futurelab Research & Innovation Group
    • Stereoscopic Depth Estimation Ars Electronica Futurelab Research & Innovation Group
    • Stereoscopic Depth Estimation Ars Electronica Futurelab Research & Innovation Group
    • Playful research that doesn’t just aim to entertain is what the Center for Advances in DigitalEntertainment Technologies is all about. The mission: take the latest breakthroughs in full-body & gesture tracking, bio-signal sensor systems and 3D technology and utilize them inprojects beyond the realm of the computer game sector.Ars Electronica Futurelab and the Salzburg University of Applied Sciences’ Department ofMultimedia Technology and Multimedia Art have launched this joint research effort, funded bythe Austrian FFG.CADET Center for Advances in Digital Entertainment Technologies Ars Electronica Futurelab Research & Innovation Group
    • The Ars Electronica Futurelab is the only non-university R&D facility to be granted fundingthis year by the FWF–Austrian Science Fund’s PEEK arts development program. Beginning in2011, the Futurelab will collaborate with renowned media artist, choreographer and composerKlaus Obermaier (AT) on a three-year project that aims to develop interactive dramaticperformances.PEEK (St)age of Participation Ars Electronica Futurelab Research & Innovation Group
    • Questions Ars Electronica Futurelab Research & Innovation Group
    • Contact AddressRoland HaringArs-Electronica-Straße 14040 Linz, Austriarolandha@aec.atresearch.aec.at Ars Electronica Futurelab Research & Innovation Group