Testing of                                                             Sensor Observation Service                         ...
Outline Introduction What is SOS SOS Packages Specifications Test Scenarios Data Simulation Test Environment Experi...
Introduction A Sensor Network is a computer accessible network of many,  spatially distributed devices using sensors to m...
Introduction OGC Sensor Web Enablement Framework:The models, encodings, and services of the SWE architectureenable implem...
Introduction          SWE Data Models and Service Interfaces, created by tagxedo.com
What is SOS Standard web service interface for requesting, filtering,  and retrieving observations and sensor system  inf...
SOS Packages Specifications                                52North SOS                  Deegree SOS            MapServer S...
Test Scenarios Postal codes as sensors Test parameters:     BBOX (1 ha, 47.8 ha, 264.7 ha, and 759.6 ha)     Time (1 h...
Data Simulation 101 postal codes (of Calgary) were   randomly selected Time period: 15 min in 1 month for   each sensor...
Test Environment Server specifications:Hardware Acer Aspire 3970 (Host)             VMware (VM)CPU        Intel Core i7 3...
Test Environment      All tests have been done from a remote client      Apache JMeter was used to test      Average of...
Experimental ResultsGetObservation (No. of Sensors)                         1 Sensor   5 Sensors   20 Sensors   60 Sensors...
Experimental ResultsGetObservation (No. of Sensors)                         1 Sensor   5 Sensors   20 Sensors   60 Sensors...
Experimental ResultsGetObservation (Time Series)                         1 Hour   1 Day   1 Week    1 Month         52Nort...
Experimental ResultsGetObservation (Time Series)                         1 Hour   1 Day   1 Week    1 Month         52Nort...
Experimental ResultsGetObservation (BBOX)                        Level 1   Level 2   Level 3   Level 4        52North SOS ...
Experimental ResultsGetObservation (BBOX)                        Level 1   Level 2   Level 3   Level 4        52North SOS ...
Experimental ResultsGetObservation (Time-BBOX)
Experimental ResultsGetObservation (Time-BBOX)
Experimental ResultsGetObservation (Time-BBOX)
Conclusions Deegree SOS performs the best in terms of response time, especially when   data requests cover larger areas, ...
Thank YouAny Question?
Upcoming SlideShare
Loading in …5
×

Testing of Sensor Observation Services: A Performance Evaluation

572 views

Published on

M. E. Poorazizi, A. J. S. Hunter and S. H. L. Liang, Testing of Sensor Observation Services: A Performance Evaluation, In Proceedings of the First ACM SIGSPATIAL International Workshop on Sensor Web Enablement 2012 (SWE2012), Redondo Beach, CA, US, 6-9 November 2012.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
572
On SlideShare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
17
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Testing of Sensor Observation Services: A Performance Evaluation

  1. 1. Testing of Sensor Observation Service ImplementationsEbrahim Poorazizi, Steve Liang, Andrew Hunter{mepooraz, steve.liang, ahunter}@ucalgary.ca A Performance EvaluationDepartment of Geomatics Engineering, University of Calgary
  2. 2. Outline Introduction What is SOS SOS Packages Specifications Test Scenarios Data Simulation Test Environment Experimental Results Conclusions
  3. 3. Introduction A Sensor Network is a computer accessible network of many, spatially distributed devices using sensors to monitor conditions at different locations, such as temperature, sound, vibration, pressure, motion or pollutants. A Sensor Web refers to web accessible sensor networks and archived sensor data that can be discovered and accessed using standard protocols and APIs.
  4. 4. Introduction OGC Sensor Web Enablement Framework:The models, encodings, and services of the SWE architectureenable implementation of interoperable and scalable service-oriented networks of heterogeneous sensor systems and clientapplications. Discovery of Sensors Subscription to and Access to Publish of Sensors Alerts SWE Tasking Retrieval of Sensors Sensors Obs.
  5. 5. Introduction SWE Data Models and Service Interfaces, created by tagxedo.com
  6. 6. What is SOS Standard web service interface for requesting, filtering, and retrieving observations and sensor system information Client SOS GetCapabilities Capabilities DescribeSensor Sensor Description (SensorML) GetObservation Observations (O&M) SOS 1.0.0 mandatory operations
  7. 7. SOS Packages Specifications 52North SOS Deegree SOS MapServer SOSDevelopment Platform Java Java C++License Open Source Open Source Open SourceSOS 1.0.0 – core Supported Supported SupportedSOS 1.0.0 – optional GetFeatureOfInterest GetFeatureOfInterest - GetResult RegisterSensor InsertObservationDatabase PostgreSQL/PostGIS PostgreSQL/PostGIS PostgreSQL/PostGIS MS SQL Server MS SQL Server MySQL MySQL ArcSDE Oracle Oracle ESRI GeodatabaseService Servlet Servlet CGIDCP Request GET/POST GET/POST GET52North SOS: A 52°North Initiative (Geospatial Open Source Software GmbH)Deegree SOS: A project for Open Source Geospatial FoundationMapServer SOS: A project for Open Source Geospatial Foundation
  8. 8. Test Scenarios Postal codes as sensors Test parameters:  BBOX (1 ha, 47.8 ha, 264.7 ha, and 759.6 ha)  Time (1 hour, 1 day, 1 week, 1 month)  BBOX-Time (16 levels)  Number of Sensors (1, 5, 20, 60, 101) BBOX #1 BBOX #2 BBOX #3 BBOX #4
  9. 9. Data Simulation 101 postal codes (of Calgary) were randomly selected Time period: 15 min in 1 month for each sensor Total number of observations: 4*24*30*101 = 290880 Database size:  188MB for PostgreSQL (52North SOS)  46MB for PostgreSQL (Deegree SOS)  39MB for PostgreSQL (MapServer SOS)
  10. 10. Test Environment Server specifications:Hardware Acer Aspire 3970 (Host) VMware (VM)CPU Intel Core i7 3.4 GHz 4 Cores of 8RAM 8 GB 2 GBHDD 1.5 TB 20 GBOS Windows 7 Home Premium (64-bit) Ubuntu 11.10 (64-bit) Each SOS package was installed on a separate VM Client specifications:Hardware Dell OptiPlex 990CPU Intel Core i5 3.1 GHzRAM 8 GBHDD 500 GBOS Windows 7 Professional(64-bit)
  11. 11. Test Environment  All tests have been done from a remote client  Apache JMeter was used to test  Average of 30 requests for each test case were measured WWW Client @ Trailer H Server @ GeoSensor Web Lab
  12. 12. Experimental ResultsGetObservation (No. of Sensors) 1 Sensor 5 Sensors 20 Sensors 60 Sensors 101 Sensors 52North SOS 131.0 471.3 1,803.8 4,834.3 12,590.1 Deegree SOS 105.1 294.1 995.3 2,452.7 3,448.0 MapServer SOS 323.2 1,012.9 3,553.3 10,171.2 16,623.0
  13. 13. Experimental ResultsGetObservation (No. of Sensors) 1 Sensor 5 Sensors 20 Sensors 60 Sensors 101 Sensors 52North SOS 104.5 518.5 2,071.0 6,210.8 10,454.1 Deegree SOS 94.5 469.7 1,876.9 5,629.2 9,475.3 MapServer SOS 69.9 344.1 1,372.3 4,114.2 6,924.7
  14. 14. Experimental ResultsGetObservation (Time Series) 1 Hour 1 Day 1 Week 1 Month 52North SOS 213.1 482.5 2,230.9 11,444.3 Deegree SOS 126.7 257.2 1,023.8 2,897.7 MapServer SOS 270.6 444.9 1,983.5 16,032.8
  15. 15. Experimental ResultsGetObservation (Time Series) 1 Hour 1 Day 1 Week 1 Month 52North SOS 293.3 618.5 2,653.5 10,369.3 Deegree SOS 165.6 463.5 2,328.1 9,475.3 MapServer SOS 168.1 384.3 1,737.5 6,924.7
  16. 16. Experimental ResultsGetObservation (BBOX) Level 1 Level 2 Level 3 Level 4 52North SOS 191.1 2,024.7 3,271.8 4,459.1 Deegree SOS 178.8 713.3 954.6 1,355.9 MapServer SOS 407.2 4,098.1 4,819.7 8,706.8
  17. 17. Experimental ResultsGetObservation (BBOX) Level 1 Level 2 Level 3 Level 4 52North SOS 180.4 2,422.9 4,127.1 5,713.9 Deegree SOS 191.8 2,280.1 3,432.5 4,993.7 MapServer SOS 111.0 1,692.3 2,016.6 3,730.5
  18. 18. Experimental ResultsGetObservation (Time-BBOX)
  19. 19. Experimental ResultsGetObservation (Time-BBOX)
  20. 20. Experimental ResultsGetObservation (Time-BBOX)
  21. 21. Conclusions Deegree SOS performs the best in terms of response time, especially when data requests cover larger areas, and longer temporal intervals. MapServer SOS returns the smallest volume of data to the client. 52North SOS showed competitive performance across all types of queries, but does not scale quite as well as Deegree SOS. Response time could be improved by reducing the size of the response document.
  22. 22. Thank YouAny Question?

×