Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

IMA/Thales SceneGate Viewer for OpenSimulator Presentation at OSCC19


Published on

IMA/Thales SceneGate Viewer for OpenSimulator

Lisa Laxton, Natacha Bru, Frank Rulof, Seth Nygard

Presentation Abstract: This presentation from Infinite Metaverse Alliance® (IMA) and Thales Group discusses development of a new open source viewer for the OpenSimulator community focused on improvements in usability, accessibility, and interoperability. Development is driven by inclusive “design thinking” while adding capabilities for the future to address gaps in development aimed at the needs of new users and those with different abilities that may be digitally marginalized. The SceneGate Viewer project is one of several R&D projects integrated with decentralized OpenSimulator development supporting the mission to advance virtual worlds, virtual reality, and synthetic environments. The work of IMA and Thales is in general directed toward broadening use of the Metaverse for Public, Education, Industry and Government sectors but the community as a whole benefits from open source.

Target Audience & Outcomes: Participants from the OpenSimulator Community at large will learn about enhancements, features, and improvements IMA and Thales are working on together to deliver a new open source solution that meets the needs of a broader OpenSimulator community addressing issues related to onboarding, usability, accessibility, interoperability, performance, security, and standards.


Published in: Engineering
  • Be the first to comment

  • Be the first to like this

IMA/Thales SceneGate Viewer for OpenSimulator Presentation at OSCC19

  2. 2. 2 Do we need a new viewer for OpenSimulator? ▌ Development Gaps Use Cases: Accessibility by design is needed to combat digital marginalization - Hearing Impaired - Mobility Impaired - Vision Impaired - Cognition Impaired Use Cases: Onboarding remains a challenge for new users - Classes and Training Sessions - Meetings and Conferences - Interactive Environments
  3. 3. 3 Analysis ▌ Development Challenges Original project priorities Different stakeholders Third-party project priorities Standards compliance Documentation
  4. 4. 4 Analysis ▌ Development Solution New development team Stakeholder participation Future viewer research
  5. 5. 5 Design Scope ▌ Requirements Open Source Platform agnostic OpenSimulator agnostic Adaptable Customizable Standards compliant ▌ Primary Stakeholders New users Disabled users Grid owners Creators Educators Collaborators
  6. 6. 6 Solution ▌ Alchemy Viewer codebase selected for Project SceneGate ▌ Current Development Focus Accessibility Onboarding Performance Usability ▌ Future Development Focus EchoVoice Integration Renderer decoupling Standards Security Documentation Advanced Mode The SceneGate Viewer provides the user with a gate to a 3D scene in a virtual world.
  7. 7. 7 Project Roadmap ▌ 2018 Research Surveys Analyses and feedback Extensive testing Proof of concept Codebase selection ▌ 2019 Development Alpha Development Closed Alpha Testing Beta Development Closed Beta Testing Open Beta Testing
  8. 8. 8 Who’s Involved ▌ Participation Hypergrid users Development team members Industry interns (students) ▌ Design Collaborative approach HCI / Usability reviews Industry and usability standards
  9. 9. 9 What’s New: Accessibility Improvements ▌ New feature related to Hearing, Cognition, and Mobility Issues Listen from All Positions
  10. 10. 10 What’s New: Accessibility Improvements ▌ New feature related to Vision and Cognition Issues Default Custom Colors and Contrast Options
  11. 11. 11 What’s New: Onboarding Improvements ▌ New modes take a bulldozer to the learning curve Simplified mode presents fewer menu options
  12. 12. 12 What’s New: Onboarding Improvements ▌ New user interface layout per mode Minimal toolbar buttons in simplified mode
  13. 13. 13 What’s New: Onboarding Improvements ▌ New preferences option to change modes Extended mode for experienced users
  14. 14. 14 What’s New: Onboarding Improvements ▌ New standard avatar camera views Navigation is eased within virtual structures
  15. 15. 15 What’s New: Usability Improvements ▌ New code for grid manager error checking and management Users get immediate feedback
  16. 16. 16 What’s New: Usability Improvements ▌ New button group layout related to human computer interaction design Toolbar button groups for both modes
  17. 17. 17 What’s New: Performance Improvements ▌ Improved graphics handling Bug fix Resolves issue caused by Win 10 1903 update ▌ Dynamic texture loading time reduced Beneficial for presentation screens in-world Faster rendering of a full textured scene
  18. 18. 18 Future Viewer Viewer Render Application ObjectStore RenderInterface Viewer Data Handling OpenSimInterface OpenSim Server VoIPPlugin(s) Viewer Data Handling Application Future version of the SceneGate Viewer UserInterface Plugin UserInterface Plugin
  19. 19. 19 Future Viewer ▌ Modern Look and Feel Use gaming engines & modern UI packages, split rendering from data handling part viewer (mainly the loop over the server) - Viewer Render Application -> render engine that’s desired for a specific use - Object store <- input to the renderer - Render Interface -> to integrate the renderer with the other parts of the viewer ▌ Customizable & simplified UI (HMI) Design a new UI that allows users to customize for their needs in a simple way. Components include: - VoIP plugins(s)  different VoIP services to be connected to the viewer - User Interface Plugins  customize the User Interface for the viewer - Other plugins that can be defined in the future
  20. 20. 20 Future Viewer ▌ Maintainability Create a clear and structured documented design Refactor the SceneGate code if needed Create a package (OpenSim Interface) to handle the interface with OpenSim - Separate the internals from the OpenSim interface Design using state of the art libraries and packages to optimize security ▌ Current development State Splitting the renderer & data handling parts of the viewer 2 Student interns are working on this
  21. 21. 21 Directly Related Projects ▌ Project Echo Future EchoVoice Integration Future Text to Speech and Speech to Text R&D ▌ Project DreamGate (Firestorm fork) Future accessibility improvements Future usability improvements ▌ Project Helios Metaverse Depot R&D Grid (ADA or 508 compliance) OpenSimulator R&D
  22. 22. 22 Where IMA does R&D ▌ IMA Metaverse Depot R&D Grid IMA Projects in Decentralized Virtual Worlds
  23. 23. 23 Why is security important ? ▌ Security is a matter of TRUST > Preserve users trust by granting the safety of their data > Security is important for every user Military Civilians ▌ Currently the viewer is not secure ▌ How to improve security ?
  24. 24. 24 Login ▌ Credentials are sensible information > The viewer sends username and MD5 hash of the password to the server ▌ MD5 should not be used - Cryptographic collisions - Brute force attacks - Rainbow tables attacks ▌ How to improve security ? - SHA256 or SHA512 - Salt hashes - implement TLS
  25. 25. 25 Exchanges with the server ▌ Sensible data can be exchanged > The viewer exchanges different information with the server ▌ Currently there is no data encryption - User information - Avatar information - Video/media links - Code - Chat messages (base 64 encoded zip file) - etc. ▌ How to improve security ? - Use Transport Layer Security (TLS) - Encrypt sensible data ⚠ Server-side modifications
  26. 26. 26 Third-party libraries ▌ Usage of third-party libraries is needed > Gain of time > Better tools for development ▌ But it increases the attack surface - A lot of lines of code - libraries calling other libraries - known vulnerabilities - outdated libraries - no longer supported libraries ▌How to improve security ?
  27. 27. 27 Third-party libraries 79% 15% 6% libraries version overview old up to date unknown 1% 40% 38% 21% Risk severity repartition in third-party libraries Low Medium High Critical
  28. 28. 28 Third-party libraries ▌ Usage of third-party libraries is needed > Gain of time > Better tools for development ▌ But it increases the attack surface - A lot of lines of code - libraries calling other libraries - known vulnerabilities - outdated libraries - no longer supported libraries ▌ How to improve security ? - Update libraries - Watch for new vulnerabilities - Stay up to date
  29. 29. 29 Conclusion ▌ Changes must be done on server side and client side > No implementation of TLS = no security > Be careful of how data are sent ▌ Security is an everyday challenge > Need to watch for new vulnerabilities > Need regular updates ▌Thank you for your attention
  30. 30. 30 Expanding Development ▌ We need your help with Wiki, Testing, Contributing, and Developing Join Project SceneGate! Code repository opening soon
  31. 31. 31 Panel Q&A Thank you for your attention Panel Discussion Lisa Laxton – Natacha Bru – Frank Rulof –
  32. 32. 32 Project SceneGate Links ▌ Downloads ▌ Release Notes viewer/wiki/Release%20Notes:/Latest%20Beta%20Test%20Version ▌ Issue Tracker viewer/wiki/Policies%20and%20Procedures:/Report%20a%20Viewer%20Bug ▌ Roadmap viewer/wiki/Development%20Resources:/Project%20Roadmap ▌ Wiki Home