Daidalos Integration Framework TridentCom 2007

681 views
606 views

Published on

Presentation of the paper by F. Cleary Grant, M. Ponce de Leon, Marta GARCÍA MORENO, Antonio ROMERO VICENTE, Mark Roddy, Czeslaw Jedrzejek, Daidalos Framework for Successful Testbed Integration, Tridentcom 2007, May 2007

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
681
On SlideShare
0
From Embeds
0
Number of Embeds
57
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • With the Daidalos Architecture consisting of 3 technical work packages WP2 “ Network Integration” WP3 “Service and Network Management” WP4 “ Pervasive Systems” WP5 “Integrated System Evaluation” aim was to materialise the achievements of work packages into practical assessment to allow for concept validation.
  • With the Daidalos Architecture consisting of 3 technical work packages WP2 “ Network Integration” WP3 “Service and Network Management” WP4 “ Pervasive Systems” WP5 “Integrated System Evaluation” aim was to materialise the achievements of work packages into practical assessment to allow for concept validation.
  • Other task forces were also created as required , for example inventory control checkers task force.
  • With the Daidalos Architecture consisting of 3 technical work packages WP2 “ Network Integration” WP3 “Service and Network Management” WP4 “ Pervasive Systems” WP5 “Integrated System Evaluation” aim was to materialise the achievements of work packages into practical assessment to allow for concept validation.
  • Other task forces were also created as required , for example inventory control checkers task force.
  • Other task forces were also created as required , for example inventory control checkers task force.
  • Other task forces were also created as required , for example inventory control checkers task force.
  • The problems identified in 1st validation could only produce very high-level results (i.e. pass/fail of test cases). After these issues were resolved we were able to validate the demonstrator at a much lower level of detail, which has produced significant input to the technical work-packages Phase2. In a conformance session in Aveiro up to 120 test cases were planned based on the Nidaros Test case specifications. These covered the execution of multiple tests varying from step -1 to step 6 of the Nidaros scenario. Within in the first testing iteration 89 test cases were executed with 59 being successful.
  • Unstable Mobile IP hindered conformance testing initially in Sophia, this was rectified in the Aveiro test bed by switching from Mandrake to Debian-based Ubunto Linux. Specific machines crashing and rebooting proved to be very time consuming. Minor Errors encountered, led many times to major complications in the whole Daidalos system due to the large amount of Daidalos components and their interconnections. Undocumented initial steps and configurations unforeseen prior to the testing phase, eroded into valuable scheduled testing allocated time, as these required configurations and steps had to be figured out and setup correctly for the test case to be executed.
  • Unstable Mobile IP hindered conformance testing initially in Sophia, this was rectified in the Aveiro test bed by switching from Mandrake to Debian-based Ubunto Linux. Specific machines crashing and rebooting proved to be very time consuming. Minor Errors encountered, led many times to major complications in the whole Daidalos system due to the large amount of Daidalos components and their interconnections. Undocumented initial steps and configurations unforeseen prior to the testing phase, eroded into valuable scheduled testing allocated time, as these required configurations and steps had to be figured out and setup correctly for the test case to be executed.
  • Communication was one of the main issues encountered during Daidalos Phase I integration, In phase I the integration wiki was not as effective as it should have been. It can be a powerful tool if used effectively and would have great potential for Phase II. Following the change from Mandrake to Ubunto in Aveiro , MIPv6 became a lot more stable, and it was possible to complete further testing than was previously capable in Sophia Antipolis conformance iteration. A key point realised is the importance for developers to meet iteration delivery deadlines, leading to early fault detection. Scenario step planning contributed positively to the integration process. The First successful integrated testing utilising all Work packages took place at Aveiro, demonstrating overall successful interoperability and integration.
  • Daidalos Integration Framework TridentCom 2007

    1. 1. Daidalos Framework for successful Testbed Integration Frances Cleary Grant Miguel Ponce de Leon TSSG – Waterford Institute of Technology Ireland
    2. 2. Daidalos WP5 <ul><li>Daidalos (49 partners), integration was an immense task </li></ul><ul><li>co-ordinated and implemented by WP5. </li></ul><ul><li>Steps leading to Integration </li></ul><ul><li>Integration Tasks </li></ul><ul><li>Defining Integration Processes and Models </li></ul><ul><li>Defining conformance test Specifications </li></ul><ul><li>Test Site Planning,Deployment and Integration </li></ul><ul><li>Test planning/scheduling/status report documentation </li></ul><ul><li>Test case execution, fault detection, result reporting. </li></ul>
    3. 3. Nidaros Scenario WP2 Innovations WP3 Innovations WP4 Innovations The Integration of WP innovations were completed through the selected ‘Nidaros’ Scenario.
    4. 4. Nidaros scenario <ul><li>Describe nidaros scenario </li></ul>
    5. 5. Daidalos WP5 Task Forces <ul><li>To evolve and implement this </li></ul><ul><li>scenario, task forces were created </li></ul><ul><li>Scene analysis Task Force </li></ul><ul><li>(Input from all WP’s) </li></ul><ul><li>Scene Step analysis Task Force </li></ul><ul><li>(Input from WP5 step responsible) </li></ul><ul><li>Mapping and Deployment Task Force </li></ul>
    6. 6. Daidalos Integration Model <ul><li>Due to the complexity of the Daidalos Architecture, the integration model addressed the following main areas </li></ul><ul><li>Integrated Testbed (2 integrated test sites) </li></ul><ul><ul><li>Sophia Antopolis,France </li></ul></ul><ul><ul><li>Aveiro, Portugal </li></ul></ul><ul><li>Integration-oriented developments </li></ul><ul><ul><li>Intra work package integration activities </li></ul></ul><ul><ul><li>Formalisation of Integration roles and processes </li></ul></ul><ul><ul><li>Identification of best Integration and Testing strategy (i.e. sandwich testing) </li></ul></ul><ul><li>Conformance Test Specification </li></ul><ul><ul><li>Identification of Nidaros specific WP interfaces </li></ul></ul><ul><ul><li>Definition of Scenario specific Conformance tests </li></ul></ul><ul><ul><li>Test Case Definition : Test Case Naming (e.g. N3:01), test summary, API’s & interfaces involved, initial conditions </li></ul></ul><ul><ul><li>Test Report : Verdicts, person executed test, any closure actions and impacts, </li></ul></ul><ul><li>comments and possible actions to be performed if test fails. </li></ul>
    7. 7. Daidalos Testbed <ul><li>Daidalos Testbed </li></ul><ul><ul><li>Daidalos Physical Testbed </li></ul></ul><ul><ul><li>Visualisation activities </li></ul></ul><ul><ul><li>Validation activities and conclusions </li></ul></ul>
    8. 8. Daidalos Physical Deployment
    9. 9. <ul><li>For European based conferences the daidalos testbed was setup in a mobile Science Truck which demonstrated Daidalos Innovations. </li></ul>Daidalos Mobile Testbed
    10. 10. Daidalos Visualisation <ul><li>Virtualisation Tool (DLR) </li></ul>Figure 8 we have shown the layout for the CarPC view (a similar view was prepared for the PDA view) after some messages have been passed. It shows the simulated status of the network components and the messages from the major WP4 subsystems and third party services. The colour of the arrows indicates the presence of recent message traffic over these connections.
    11. 11. Daidalos Visualisation <ul><li>Lucent Virtualisation Tool </li></ul>
    12. 12. Daidalos Integration Testing <ul><li>Validation of the Nidaros Integrated Demonstrator conformance tests </li></ul><ul><li>Sophia Antopolis in November 2005 , Aveiro in March 2006. </li></ul><ul><li>The 1st validation could only produce very high-level results (i.e. pass/fail of TC). </li></ul><ul><li>- Problems related to network layer, Mobile IP and WP2 network drivers which were unstable </li></ul><ul><li>As issues were resolved we were able to validate the demonstrator at a much lower level of detail. </li></ul><ul><li>Conformance session in Aveiro up to 120 test cases were planned, based on the Nidaros Test case specifications. </li></ul>
    13. 13. Integration Testing <ul><li>Example Test Case </li></ul>Bart is driving on the motorway, which triggers the launch of the Traffic information Service. Bart arrives at the airport, and continues to drive towards the car parking area of the airport. His car system screen shows the airport information carrousel. Information about all flights will be shown. Bart parks and leaves his car, taking his PDA with him. A transfer is invoked on the transferring components in the old service and starts the new service on PDA and stops the old service on CarPC. The airport arrivals information can now be seen on Barts PDA as he enters the airport arrival terminal.
    14. 14. Integration Issues Encountered <ul><li>Unstable MIPv6, switch from Mandrake to Ubuntu </li></ul><ul><li>Machines crashing and rebooting became time consuming. </li></ul><ul><li>Minor Errors encountered, led many times to major complications. </li></ul><ul><li>Initial steps and configurations unforeseen eroded into valuable scheduled testing allocated time. </li></ul>
    15. 15. Conclusion and Results <ul><li>All tests performed on the test-bed successfully used Mobile IP, which remained very stable on Ubuntu in comparison to earlier attempts at using mobile IP on top of Mandrake. </li></ul><ul><li>WP2 WLAN drivers were relatively stable compared to their earlier performance in Sophia. </li></ul><ul><li>Route Optimisation worked over Mobile IP, with very noticeable performance improvements as compared to earlier tests on WP4 standalone test-beds. </li></ul><ul><li>Registration module and several other components were dummy’s because of lack of integration on Ubuntu (previously worked under Mandrake). </li></ul><ul><li>Communication was a main issue encountered during integration </li></ul><ul><li>Key point - developers to meet iteration delivery deadlines </li></ul><ul><li>Scenario step planning contributed positively to the integration process. </li></ul><ul><li>The 1st successful integrated testing utilising all Work packages took place at Aveiro. </li></ul>
    16. 16. <ul><li>End Of Presentation </li></ul><ul><li> Thank You For Your Time </li></ul><ul><li> </li></ul><ul><li>Contact details : Frances Cleary Grant, Miguel Ponce de Leon </li></ul><ul><li>Organisation: TSSG , Waterford Institute Of Technology </li></ul>

    ×