SBIR Final Meeting Collaboration Sensor Grid


Published on

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

SBIR Final Meeting Collaboration Sensor Grid

  1. 1. SBIR Final Meeting Collaboration Sensor Grid and Grids of Grids Information Management Anabas July 8, 2008
  2. 2. Introduction I <ul><li>Grids and Cyberinfrastructure have emerged as key technologies to support distributed activities that span scientific data gathering networks with commercial RFID or (GPS enabled) cell phone nets. This SBIR extends the Grid implementation of SaaS (Software as a Service) to SensaaS (Sensor as a service) with a scalable architecture consistent with commercial protocol standards and capabilities. The prototype demonstration supports layered sensor nets and an Earthquake science GPS analysis system with a Grid of Grids management environment that supports the inevitable system of systems that will be used in DoD’s GiG. </li></ul>
  3. 3. Introduction II <ul><li>The final delivered software both demonstrates the concept and provides a framework with which to extend both the supported sensors and core technology </li></ul><ul><li>The SBIR team was led by Anabas which provided collaboration Grid and the expertise that developed SensaaS. Indiana University provided core technology and the Earthquake science application. Ball Aerospace integrated NetOps into the SensaaS framework and provided DoD relevant sensor application. </li></ul><ul><li>Extensions to support the growing sophistication of layered sensor nets and evolving core technologies are proposed </li></ul>
  4. 4. ANABAS
  5. 5. Close-out Charts <ul><li>Background </li></ul><ul><li>Status </li></ul><ul><li>Result of the SBIR </li></ul><ul><li>Future research </li></ul><ul><li>Commercialization </li></ul><ul><li>Appendices </li></ul>ANABAS
  6. 6. Background <ul><li>Problem Statement </li></ul><ul><li>Unable to perform advanced research for multi-layered sensor Net-Centric infrastructure without an advanced, scalable grid framework that allows existing systems and new systems to interact and cooperate. </li></ul><ul><li>Information and communication have played increasingly critical roles in our nation’s security </li></ul><ul><li>Increase use of low cost sensors generate tremendous amount </li></ul><ul><li>of valuable data that needs to be managed and harnessed </li></ul><ul><li>Need rapid situation awareness to provide better intelligence </li></ul><ul><li>to enable high quality decision support </li></ul><ul><li>The GiG is not one global seamless construct </li></ul><ul><ul><li>Different pieces have different stakeholders with different missions </li></ul></ul><ul><ul><li>Each has own name and unique vision of network-centric operations </li></ul></ul><ul><ul><li>Many operations have been done independently </li></ul></ul>ANABAS
  7. 7. Background (cont’d) <ul><li>Commercial Backdrop </li></ul><ul><li>XaaS or X as a Service is dominant trend </li></ul><ul><li>X = S: Software (applications) as a Service </li></ul><ul><li>X = I: Infrastructure (data centers) as a Service </li></ul><ul><li>X = P: Platform (distributed O/S) as a Service </li></ul><ul><li>Grids are any collection of Services and manage distributed services or distributed collections of Services i.e. Grids to give Grids of Grids </li></ul><ul><li>We added </li></ul><ul><li>X = C: Collections (Grids) as a Service and </li></ul><ul><li>X = Sens: Sensors as a Service </li></ul>ANABAS
  8. 8. Background (cont’d) <ul><li>Objectives </li></ul><ul><li>Integrate Global Grid Technology with multi-layered sensor technology to provide a Collaboration Sensor Grid for Network-Centric Operations research to examine and derive warfighter requirements on the GIG. </li></ul><ul><li>Build Net Centric Core Enterprise Services compatible with GGF/OGF and Industry. </li></ul><ul><li>Add key additional services including advance collaboration services and those for sensors and GIS. </li></ul><ul><li>Support Systems of Systems by federating Grids of Grids supporting a heterogeneous software production model allowing greater sustainability and choice of vendors. </li></ul><ul><li>Build tool to allow easy construction of Grids of Grids. </li></ul><ul><li>Demonstrate the capabilities through sensor-centric applications with situational awareness. </li></ul>ANABAS
  9. 9. Background (cont’d) <ul><li>Approach </li></ul><ul><li>Investigate and leverage global and open grid technologies. </li></ul><ul><li>Design and implement a grid middleware based on a general Grids of Grids architecture with particular support for sensor-centric grid to produce a prototype collaboration sensor grid that could interoperate with other grids. </li></ul><ul><li>Integrate and demonstrate with Ball NetOps to provide collaboration sensor grid situational awareness. </li></ul><ul><li>Demonstrate for Earthquake Science applications. </li></ul><ul><li>Use sensor grid for warfighter GIG research. </li></ul>ANABAS
  10. 10. Background (cont’d) <ul><li>Challenges </li></ul><ul><li>Adapt the technologies so that valid experiments and demonstrations of fundamental GIG infrastructure requirements can be realized. </li></ul><ul><li>Follow the rapidly evolving best practice in commercial and academic Grid technologies and standards </li></ul><ul><li>Discover derived requirements for intelligence exploitation, decision support and advanced collaboration on the GIG. </li></ul><ul><li>Perforate multi-layered sensor stovepipes to enable GIG operations without re-factoring existing software. </li></ul>ANABAS
  11. 11. Background (cont’d) <ul><li>Technologies </li></ul><ul><li>Anabas Impromptu Collaboration Framework </li></ul><ul><li>Indiana University NaradaBrokering Messaging System </li></ul><ul><li>Ball Aerospace & Technology’s NetOps (Network Operations) Situational Awareness technology </li></ul><ul><li>Sun Microsystems Java platform </li></ul><ul><li>Haskell Programming Language (Ball) </li></ul><ul><li>Low cost sensors (e.g. Wii Remote sensor, RFID reader and tags, GPS sensors, accelerometer, gyroscope, compass, ultrasonic, temperature, audio/video recorders, etc.) </li></ul>ANABAS
  12. 12. Status <ul><li>Schedule </li></ul><ul><li>The spiral development methodology of design, development, testing and re-factoring led to the completion of a demonstrable Grids of Grids architecture with a distributed Grid Builder management tool prototype that supports Collaborative Sensor-Centric Grid and User-defined Operation Pictures and Common Operating Pictures in June 2008. </li></ul><ul><li>Funding </li></ul><ul><li>The SBIR Phase 2 project is completed within budget. </li></ul><ul><li>Publication </li></ul><ul><li>Paper on this SBIR presented at CTS2008 and published in proceedings Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan A Collaborative Sensor Grids Framework 2008 International Symposium on Collaborative Technologies and Systems (CTS 2008) at The Hyatt Regency Irvine , California, USA May 19-23, 2008 </li></ul>ANABAS
  13. 13. <ul><li>Results of the SBIR </li></ul><ul><li>Key Software Systems and Modules </li></ul><ul><li>Ready For Use </li></ul><ul><li>An Enabling and Extensible Collaborative Sensor-Centric Grid Framework that supports UDOP/COP using SensaaS (Sensor as a Service). </li></ul><ul><li>An API for third-party legacy or new applications to easily acquire grid situational awareness. </li></ul><ul><li>An API for sensor developers to easily integrate sensors with collaboration sensor grid to enhancement situational awareness. </li></ul><ul><li>A Grid Builder Management System to build, deployment, management, monitor sensor and general grids. </li></ul><ul><li>Examples of integrating filter (compute) and collaboration grids with Sensor Grids in Grid of Grids scenario </li></ul><ul><li>A NetOps Situational Awareness Sensor-Grid Demo Client. </li></ul><ul><li>An Impromptu Sensor-Grid Demo Client with support for UDOP and Earthquake Science. </li></ul>ANABAS
  14. 14. Typical Sensor Grid Interface
  15. 15. Component Grids Integrated <ul><li>Sensor display and control </li></ul><ul><ul><li>A sensor is a time-dependent stream of information with a geo-spatial location. </li></ul></ul><ul><ul><li>A static electronic entity is a broken sensor with a broken GPS! i.e. a sensor architecture applies to everything </li></ul></ul><ul><li>Filters for GPS and video analysis (Compute or Simulation Grids) </li></ul><ul><li>Earthquake forecasting </li></ul><ul><li>Collaboration Services </li></ul><ul><li>NetOps Situational Awareness Service </li></ul>ANABAS
  16. 16. ANABAS UDOP Architecture User Defined Operation Picture
  17. 17. Edge Detection Filter on Video Sensors
  18. 18. QuakeSim Grid of Grids with RDAHMM Filter (Compute) Grid
  19. 19. Grid Builder Service Management Interface
  20. 20. Technology Evolution <ul><li>During course of SBIR, there was substantial technology evolution in especially mainstream commercial Grid applications </li></ul><ul><li>These evolved from (Globus) Grids to clouds allowing enterprise data centers of 100x current scale </li></ul><ul><li>This would impact Grid components supporting background data processing and simulation as these need not be distributed </li></ul><ul><li>However Sensors and their real time interpretation are naturally distributed and need traditional Grid systems </li></ul><ul><li>Experience has simplified protocols and deprecated use of some complex Web Service technologies </li></ul>
  21. 21. <ul><li>Results of the SBIR (cont’d) </li></ul><ul><li>Key Lessons Learned I </li></ul><ul><li>Grid technology supports layered sensor networks with high performance using approximately MN/1000 brokers for M small (in terms of message size) sensors producing an average of N messages per second </li></ul><ul><li>The Sensor Grid can be integrated with a collaborative decision support environment </li></ul><ul><li>General filters can be defined as Grid services </li></ul><ul><li>The Grid framework supports a broad definition of sensor that includes any device that receives and returns information; demonstrated devices include environmental sensors, GPS, RFID, Robot and Game controllers and audio/video devices </li></ul>ANABAS
  22. 22. <ul><li>Results of the SBIR (cont’d) </li></ul><ul><li>Key Lessons Learned II </li></ul><ul><li>The Sensor Grid can be integrated with the NetOps Network Operations tool; this integration is possible through well defined service interfaces </li></ul><ul><li>The SensaaS (Sensor as a Service) approach is successful allowing architectural integration of sensors in Grids with SaaS (Software as a Service) used for other capabilities </li></ul><ul><li>We successfully followed the significant changes in commercial distributed middleware and correctly focused on key concepts (use of services and message oriented middleware) that are still central </li></ul>ANABAS
  23. 23. <ul><li>Results of the SBIR (cont’d) </li></ul><ul><li>Key Lessons Learned III </li></ul><ul><li>We identified importance of hierarchical topics in the publish-subscribe infrastructure and implemented in core technology but not in Sensor Grid </li></ul><ul><li>We were able to integrate portable VPN software to mitigate impact of firewalls and provide additional security; limitations in current open source VPN software prevented useful deployment in sensor Grid </li></ul><ul><li>Sensor grids of similar architecture can support DoD layered sensors as well as non military applications such as Earthquake and Environmental sensor networks </li></ul>ANABAS
  24. 24. <ul><li>Results of the SBIR (cont’d) </li></ul><ul><li>Key Lessons Learned IV </li></ul><ul><li>Security model developed and tested in point to messaging with modest overheads. However we did not tackle collective security for optimal support of layered sensors </li></ul><ul><li>It is straightforward to integrate Geographical Information Systems including Google and Microsoft clients as well as OGC (Open Geospatial Consortium) services such as WFS Web Feature Service which we extended from batch to streaming mode </li></ul><ul><li>Our current deployments do not have sufficient data traffic to stress our Grids, We have developed several performance enhancements for OGC services that could be important in future </li></ul>ANABAS
  25. 25. <ul><li>Results of the SBIR (cont’d) </li></ul><ul><li>Key Lessons Learned V </li></ul><ul><li>Two key enhancements developed for Impromptu collaboration grid </li></ul><ul><li>1) Collaborative groups supporting sub grids and communities of interest </li></ul><ul><li>2) Hybrid shared display allowing dynamic choice of codec to be used when sharing applications </li></ul><ul><li>These technologies are described in Appendices </li></ul>ANABAS
  26. 26. Illustration of Hybrid Shared Display on the sharing of a browser window with a fast changing region. ANABAS
  27. 27. Screen capturing Region finding Video encoding SD screen data encoding Network transmission ( RTP ) Network transmission ( TCP ) Video Decoding (H.261) SD screen data decoding Rendering Rendering Screen display HSD Flow Presenter Participants Through NaradaBrokering VSD CSD ANABAS
  28. 29. Future Research ANABAS <ul><li>The Anabas Grid of Grids Net-centric framework prototype for building, </li></ul><ul><li>deploying and managing general sub-grids has been developed with the </li></ul><ul><li>successful delivery of an enabling collaborative sensor-centric </li></ul><ul><li>grid middleware as a testbed to support the exploration and operational </li></ul><ul><li>demonstration of the vision of Layered Sensing with robust collaboration </li></ul><ul><li>and trust capabilities. </li></ul><ul><li>The collaborative sensor-grid middleware enables easy integration </li></ul><ul><li>with any systems or systems of systems on one end and </li></ul><ul><li>extensibility of sensor and computational services on the other for </li></ul><ul><li>flexible aggregation and collaboration of multi-dimensional global </li></ul><ul><li>operational pictures and trustworthiness. </li></ul>
  29. 30. Future Research (cont’d) ANABAS <ul><li>Layered Sensor Grid (i.e. collections of sensors) </li></ul><ul><li>Extend current point to point security model to support collections and layers of sensors </li></ul><ul><li>Investigate collective trust algorithms and services that use cross validation to enhance trust and concatenate trust, reliability and other data from sensors. One important set of services involves a database of trust metrics (as a set of time series) linked to services to analyze them (say using Hidden Markov methods) to give an estimate of current trust and projected reliability i.e. future trust. </li></ul><ul><li>Design and develop sensor management services that can be used to task coordinated groups of sensors. These would use Grid workflow for coordination. </li></ul><ul><li>Exploit new hierarchical topics in secure messaging subsystem </li></ul><ul><li>Integrate other related systems such as NetOps and XCAT with layered sensors as a particular Grid within the Grid of Grids. </li></ul><ul><li>Investigate a Web 2.0 style interface for users to define layering and additional resources of interest for their UDOP </li></ul>
  30. 31. Future Research (cont’d) ANABAS <ul><li>Trusted Sensing (at level of individual sensors) </li></ul><ul><li>Work with AFRL on extending capabilities of existing sensors such as RFID, GPS, Lego Robot-based, Wii, Nokia N8xx, Web-cams. Explore addition of other generic (non military) types such as cell phones, RSS/Atom feeds, Blogs and Twitter. </li></ul><ul><li>Work with AFRL on supporting new sensors and new trust mechanisms with associated services and metadata. Extend the Anabas sensor framework SensaaS as needed and support implementation of sensors in testbed. This work includes extension of capabilities of current sensors. We expect most work on individual sensors and their trust will be performed by others and our responsibility will be common collective services (number 2 in Layered Sensor Grid) and supporting the integration of this other work into Grid of Grids </li></ul><ul><li>Identify new sensor related services of interest to AFRL; for example particular data fusion or analysis algorithms for sensor types of interest. </li></ul>
  31. 32. Future Research (cont’d) ANABAS <ul><li>Grid of Grids </li></ul><ul><li>Investigate security architecture needed to support trusted sensor grid including cloud deployment. Deploy enhanced framework. </li></ul><ul><li>Investigate fault tolerance architecture needed to support trusted sensor grid including cloud deployment. Deploy enhanced framework. </li></ul><ul><li>Investigate systematic use of virtual machine technology (Xen, VMware) for Grid service deployment. This complements Grids that virtualize system by virtualizing hosting nodes and allow a more powerful Grid builder model. The performance implications would be initial research </li></ul><ul><li>Research Cloud Implementations of Grid Components I: Extend Grid Builder to deploy Grid Components on Clouds – including Amazon EC2 and small NSF TeraGrid cloud available to us. </li></ul><ul><li>Research Cloud Implementations of Grid Components II: Measure and evaluate performance impact of cloud – especially on messaging substrate. Look at impact of federated clouds with different components of a given Grid deployed on different clouds. </li></ul>
  32. 33. Future Research (cont’d) ANABAS <ul><li>Grid of Grids </li></ul><ul><li>Add high performance metadata service based on WS-Context to those supported by Grid Builder. </li></ul><ul><li>Quantify with AFRL guidance the “timeliness” of systems i.e. the performance of system measured in a simulated environment with characteristics similar to that expected in DoD use. The initial task here is defining and implementing the simulated environment with realistic bandwidth and latency characteristics. Measuring impact of trust mechanisms on performance would be a focus. </li></ul><ul><li>Develop an Intranet Web 2.0 annotation service allowing tagging of services and electronic resources developing a rich user customizable environment. This environment can be searched to retrieve services and documents of interest to user. Tags are stored as part of system metadata. The Grid Builder will deploy Grids based on discovered services and electronic resources. Provide a secure Facebook style user profile compatible with Open Social Interface. </li></ul>
  33. 34. Future Research (cont’d) ANABAS <ul><li>Grid of Grids </li></ul><ul><li>Deploy a small cloud attached to AFRL Testbed. This involves investigating various IaaS (Infrastructure as a Service) and PaaS (Platform as a Service) software environments and installing on a small 4-8 node cluster. </li></ul><ul><li>Develop a report surveying sensor nets, webs and grids in other communities including commercial (e.g. Microsoft Ocean network, Nokia cell phone), government (e.g. Ubiquitous City project in Korea) and academic projects (as many NASA sensor web projects, personal health monitoring). </li></ul><ul><li>Support AFRL with needed project reports and presentations. </li></ul>
  34. 35. Commercialization ANABAS <ul><li>Three-prong strategy: </li></ul><ul><li>Work with Ball and AFRL to get input for DoD application requirements for an integrable Grid situational awareness product. </li></ul><ul><li>Harden SBIR result prototype to seek In-Q-Tel type of funding to commericalize and customize the prototype for Home Land Security applications. </li></ul><ul><li>Commercial mobile solution applications for social networks with large number of sensors like the iPhone or Google phone. </li></ul>
  35. 36. Appendix A: Summary Description of Collaborative Senor-Centric Grid Framework ANABAS
  36. 37. ANABAS <ul><li>Collaborative Sensor-Centric Grid Framework is </li></ul><ul><li>designed to enable easy </li></ul><ul><li>development </li></ul><ul><li>deployment </li></ul><ul><li>management </li></ul><ul><li>real-time visualization </li></ul><ul><li>organization </li></ul><ul><li>presentation </li></ul><ul><li>of collaborative geo-coded sensor grid applications with </li></ul><ul><li>UDOP/COP capabilities. </li></ul>
  37. 38. <ul><li>Motivation </li></ul><ul><li>Making accurate decisions in a stressful operational </li></ul><ul><li>environment involves many processes including but </li></ul><ul><li>not limited to </li></ul><ul><ul><li>collecting, decomposing, analyzing, </li></ul></ul><ul><ul><li>visualizing, organizing, sharing of information, and </li></ul></ul><ul><ul><li>deriving new information </li></ul></ul><ul><li>UDOP - User-Defined Operational Pictures </li></ul><ul><ul><li>Enables situational awareness and facilitates a user </li></ul></ul><ul><ul><li>to easily choose, create, visualize and present </li></ul></ul><ul><ul><li>decision-focused views of an operation or mission </li></ul></ul><ul><li>COP – Common Operational Pictures </li></ul><ul><ul><li>Enables sharing of situational awareness operational </li></ul></ul><ul><ul><li>pictures with relevant personnel </li></ul></ul>ANABAS
  38. 39. ANABAS Distributed Architecture for Data Access
  39. 40. ANABAS UDOP Architecture
  40. 41. Sensor-Centric Grid Middleware Management System (SCGMMS) SCGMMS API allows application developers to retrieve sensor data and metadata about sensors. The SCGMMS SSAL facilitates sensor developers to define sensor metadata for application-level filtering and expose sensor services to applications. ANABAS
  41. 43. ANABAS <ul><li>  </li></ul><ul><li>Defining the properties of sensors </li></ul><ul><li>Deploying sensors according to defined properties </li></ul><ul><li>Monitoring deployment status of sensors </li></ul><ul><li>Remote Management - Allow management irrespective of the location of the sensors </li></ul><ul><li>Distributed Management – Allow management irrespective of the location of the manager / user </li></ul>Grid Builder (GB) GB is a sensor management module which provides services for
  42. 44. ANABAS Grid Builder (GB) <ul><li>GB is originally designed for managing Grids of Grids. </li></ul><ul><li>GB is extended to support sensor-centric grid. </li></ul><ul><li>The Grid which GB manages is arranged hierarchically </li></ul><ul><li>into multi-layer domains. </li></ul><ul><li>Each domain is typically a PC which manages local </li></ul><ul><li>sensors. </li></ul><ul><li>Sensors can be deployed in any domain and accessible </li></ul><ul><li>from any domains. </li></ul>
  43. 45. ANABAS Grid Builder (GB) <ul><li>Domains have some basic components </li></ul><ul><li>Managers and Resources </li></ul><ul><ul><li>Each resource is wrapped in a Service Adapter </li></ul></ul><ul><li>Bootstrapping Service </li></ul><ul><ul><li>Ensures the current domains are up and running. </li></ul></ul><ul><ul><li>It periodically spawns a health check manager </li></ul></ul><ul><ul><li>that checks the health of the system. </li></ul></ul><ul><li>Registry </li></ul><ul><ul><li>All data about registered services and SA are </li></ul></ul><ul><ul><li>stored in Registry. WS-Context is used for </li></ul></ul><ul><ul><li>persistency. </li></ul></ul><ul><ul><li>Processes messages for managing SA and update </li></ul></ul><ul><ul><li>SA status. </li></ul></ul>