The document discusses how NASA has used virtual and augmented reality technologies over the past few decades for astronaut training and facility design. It describes some of NASA's early experiments with virtual reality in the 1980s and 1990s for astronaut training. It then outlines various projects NASA's Jet Propulsion Laboratory conducted using virtual worlds like Second Life from 2007-2010 for facility design reviews, meetings, and public engagement. It provides an example of how an virtual design review of a new Earth Science Center helped identify issues and lead to major design changes before construction.

1. From Virtual Worlds…Charles P. White, JPL1NASA PM Challenge 2011Long Beach, California9 February 2011to Real Facilities

2. 2Part 1: The technologyPart 2: What we’ve donePart 3: Facility case studyCopyright 2010 California Institute of Technology.Government sponsorship acknowledged.

3. The technology3Buzz words…Virtual RealityAugmented RealityImmersive EnvironmentsMirror WorldsHow does it all relate to facilities?

4. Virtual Reality… not so new for NASA41985ishPhoto: NASAhttp://commons.wikimedia.org/wiki/File:VPL_Eyephone_and_Dataglove.jpg

5. 5Virtual is 1. Near to 2. Close 3. AlmostVirtual Reality = Almost RealVirtual reality a part of our core businessRealism increases with higher fidelityHowever, VR systems are complicated and bulkyHard to “jump in” and use8 April 1998 --- Astronaut Jerry L. Ross, assigned as a mission specialist for NASA's STS-88 mission, uses specialized gear to train for his duties aboard the Space Shuttle Endeavour. This type virtual reality training allows each of the assigned space-walking astronauts--Ross and James H. Newman--to wear a helmet and special gloves to look at computer displays simulating actual movements around the various locations on the International Space Station (ISS) hardware with which they'll be working.Photo: NASA

6. NASA/NavyAstronaut Training6March 24, 2009 - Astronauts Tom Marshburn, left, and Dave Wolf train for a spacewalkPhoto: U.S. Navy

7. Immersive Environments7Naval Air Station (NAS) Oceana, Va. (Dec. 2, 2002) -- Lt. Cmdr. Tom Robson is the Officer-in Charge of the Landing Signals Officer (LSO) schoolPhoto: U.S. Navy

8. Role PlayingImmersive Environments8Photo: NASANASA/Ames “Future Flight Center”

9. Mirror Worldsç9NASAWorld WindGreat for campus and facility use

10. Download from Internet

11. Free… yes, freeMirror Worlds10NASA World Wind

12. Mirror Worldsç11Mars Data:Mirror worlds convey data into a meaningful format for actual places

13. Augmented Reality12CC Photo by: Lenard Low http://commons.wikimedia.org/wiki/File:Augmented_reality_-_heads_up_display_concept.jpg

14. Augmented Reality13Augmented Reality, again not new for us…Photo: U.S. Navy

15. ConsumerAugmented Reality14Public Domain http://commons.wikimedia.org/wiki/File:Augmented_GeoTravel.jpg

16. JPL iPad/iPhoneAugmented Reality15Joe Estes, JPL developer of iPad ApplicationDecember 2010

17. Simulated Environments16Allows us to see the unseen Photo: NASA

18. 17Part 1: The technologyPart 2: What we’ve donePart 3: Facility case study

19. We noticed a trend…Chart by: Bruce Stearling WoodcockUsed with permission MMOGCHART.COM

20. We jumped in…* Found an eager public* Explored collaboration* Experimented with live events* Open environment* We own the content we create

21. Explorer IslandOur real estate office was wondering why I wanted an IslandActually… the island is one rack mounted computer in a data center. The “rent” is really just a software subscription fee.

22. Avatar21Charles White and his Avatar “Jet Burns”

23. Sanity check…We presented the concept to our co-workers…Tom Soderstrom & Jeanne Holm sponsored JPL open seminar“Exploring Possibilities of Virtual Worlds”Very interestedVote to continue research

24. First Event – Space Shuttle LaunchSTS-118 August 9, 2007Commander Scott KellyTo Jet Burns (my Avatar)Grew into…Multicast w/NASA TV

25. Launch event

26. Orbit operations

27. Landing eventPost event analysisFindings…People enjoyed the event and some stated they felt like it was a “real event”Avatars posed with photograph of astronautsPerson to person interaction was highPublic wanted more!

28. Reality convergenceMixed real world/virtual world eventThe International Workshop on Managing Knowledge forSpace Missions100 real in person @ Caltech40 avatars in Second Life2 avatar presentersHow about this for Green?Forty plane trips, rental cars, and hotels not utilized= project dollars saved and insignificant emissions!

29. Meetings inVirtual WorldsNASA multi-center meetingMulti-government agenciesMixed reality eventAnalysis: “One size does not fit all”Those that can do it, love it, but others can’t seem to grasp using an Avatar at all. NASA OntologySpeakers series

30. What didn’t workThe Star Talkers ShowTalk show with science guestsMusic guestsEducational segmentLessons learned: Even though virtual it was still a big production to pull off

31. Unexpected findingAs in real life... after hours social interactionDifference was: Texas, UK, Los Angeles, Canada

32. Data convergenceParticipatory exploration of Mars Victoria CraterHistory:First use of real science data to model real life location in Second Life.“Excuse me... I'm crying... This is wonderful!”-visiting avatar

33. Getting the word outSpace Today OnlineWiredYouTubeYouTube user created video

34. 31Part 1: The technologyPart 2: What we’ve donePart 3: Facility case study

35. Explorer Island32Virtual Design Center

36. 33Customer Design

37. Start here known technology34Virtual World Goals:Reduce inception time

38. Increase “ideation” outputProcess:Use existing blueprints

39. Build skeleton VW

40. Layout initial concept

41. First meeting

42. Over the shoulder

43. Iterate in real timeImport Blueprint35Process:Import blueprint as image

44. Scale blueprint to in-world dimensionsNote:Second Life does not import models directly but soonRoom Layout Concept36

45. First up…Earth Science Center37

46. 38Earth Science CenterFirst IterationFeatures:Raised floor

47. Monitors embedded in floor

48. 3D Projector

49. Consumer flat screen monitors39What’s the avatar buy you?When using multiple Avatars in the room, the floor mounted monitors did not have the desired effect due to people looking through the legs of other people in front.

50. 40Earth Science CenterSecond IterationDesign changed for no raised floor, increased usable floor space.Less monitors on the wall to provide same effect.

51. 41Earth Science CenterVenue ChangeAs a result of our Avatar testing and visualization of the facility… a major venue change moved the entire facility to a new building, JPL 264.

52. 42Earth Science CenterThird IterationSame budget… larger space, 3d Projector, Science Globe, Science Collaboration Meeting Area, painted themed areas.

53. 43Real Time DesignAvatar allowed us to see “sight lines” and change window positions.

54. AstrobiologyCollaboration CenterDesign ReviewMultiple citizen volunteer Avatars from our CoLab effort tested the environment.Mark Adler reviews off-line screen captures of the Astrobiology Collaboration Center.

55. Final review(s)…New space required support from senior JPL management due to flight building.With an Avatar in-world allowed over the shoulder real time walk through of the facility.Charles Elachi and Dianne Evans approved the facility.“Build it”

56. Happiness is…Real results… and a good management walk through.FirouzNaderi, Tom Soderstrom and Jim Rinaldi walk through the nearly completed Mechanical Design Center.Results of all parties collaborating

57. Realized trade space

58. Actionable pre-use case scenarios