Keynote Presentation


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Keynote Presentation

  1. 1. TESTNET- Integration of Testing Methodologies Ana Cavalli (GET/INT) Manuel Nunez (Univ. Complutense-Madrid) Edgardo Montes de Oca (Consultant)
  2. 2. European Commission 6th FP <ul><li>EC initiated the 6th FP with new instruments to organize research activities: </li></ul><ul><ul><li>Integrated Projects (IP) </li></ul></ul><ul><ul><li>Network of Excellence (NoE) </li></ul></ul><ul><li>The programme started in 2002, and we have submitted an expression of interest to constitute a NoE, TESTNET, in June 2002 </li></ul>
  3. 3. Networks of Excellence Call of the IST priority: June 17 2002 Submission deadline: October 15 2003 Budget: €1070 Millions All documents for IST can be found at: NoE description:
  4. 4. A network of excellence (NoE) <ul><li>What is a NoE? </li></ul><ul><li>A set of research institutions (academic or industrial) excellent in a domain, that work together in a research topic </li></ul><ul><li>This set has the critical mass to carry out the proposed activities </li></ul>
  5. 5. Key Elements <ul><li>A durable structuring </li></ul><ul><ul><li>Structuring effect: </li></ul></ul><ul><ul><li>R educe overlapping in research by coordination, </li></ul></ul><ul><ul><li>e.g. “Virtual Center of Excellence” concept </li></ul></ul><ul><ul><li>Sustainable: </li></ul></ul><ul><ul><li>Long term commitments from the institutes, labs,…; </li></ul></ul><ul><ul><li>e.g. by structuring their research with respect to the NoE </li></ul></ul>
  6. 6. Key Elements <ul><li>Network of Excellence (NoE): build around a “Joint Program of Activities” (JPA) </li></ul><ul><ul><li>Aimed primarily at creating durable integration of the research capacities of network partners </li></ul></ul><ul><ul><li>While at the same time advancing knowledge on the topic </li></ul></ul>
  7. 7. Key Elements <ul><li>Strengthen excellence by tackling fragmentation </li></ul><ul><ul><li>Excellence </li></ul></ul><ul><ul><li>Publications, conference organization, awards, patents, expertise for public and private organizations, project leadership, … </li></ul></ul><ul><ul><li>Integration </li></ul></ul><ul><ul><li>S how how the network will be structured, </li></ul></ul><ul><ul><li>e.g. how coordination and cooperation is facilitated </li></ul></ul>
  8. 8. Structuring Effect Partner 2 Partner 3 Partner 4 Partner 3 Partner 1 Partner 1 Partner 2 Partner 4 Integration Activities Binding Today Coordination NoE Target
  9. 9. The Heart of The NoE <ul><li>Integrating activities </li></ul><ul><ul><li>coordination and adaptation of participants research activities </li></ul></ul><ul><ul><li>sharing of platforms/tools/facilities: coordination of software development, integration of tools, joint use of infrastructures, … </li></ul></ul><ul><ul><li>staff mobility and exchanges </li></ul></ul><ul><ul><li>integrated management of knowledge </li></ul></ul><ul><ul><li>reinforced electronic communication networks: development of tools and infrastructure to share information </li></ul></ul><ul><ul><li>Virtual Center of Excellence </li></ul></ul><ul><ul><li>Joint Program of Activities </li></ul></ul>
  10. 10. The Heart of The NoE <ul><li>Jointly executed research </li></ul><ul><ul><li>a strong program of joint research: Define joint research projects, establish working groups, … </li></ul></ul><ul><ul><li>co-advising of thesis, e.g. Ph.Ds , M.Sc., … </li></ul></ul><ul><ul><li>joint participation in Integrated Projects </li></ul></ul><ul><ul><li>Joint Program of Activities </li></ul></ul>
  11. 11. The Heart of The NoE <ul><li>Activities to spread excellence </li></ul><ul><ul><li>training of researchers and other key staff: Summer schools, joint lectures, etc … </li></ul></ul><ul><ul><li>dissemination and communication; networking activities to assist knowledge transfer: workshops, conferences, participating in standard bodies, etc … </li></ul></ul><ul><ul><li>Training SMEs researchers </li></ul></ul><ul><ul><li>Building relationship with other groups </li></ul></ul><ul><ul><li>Joint Program of Activities </li></ul></ul>
  12. 12. Hints for Success <ul><li>Address all evaluation criteria </li></ul><ul><ul><li>Excellence of the participants </li></ul></ul><ul><ul><li>Relevance to the objectives of the program </li></ul></ul><ul><ul><li>Potential impact on strengthening Europe’s excellence </li></ul></ul><ul><ul><li>Extent, depth and lasting nature of the integration </li></ul></ul><ul><ul><li>Joint Program of Activities </li></ul></ul><ul><ul><li>Contribution to spreading excellence </li></ul></ul><ul><ul><li>Organization, Management and governance of the network </li></ul></ul><ul><li>An NoE should last after the contract: It should be more difficult to disband it than to continue it </li></ul>
  13. 13. Hints for Success <ul><li>Research as such is not funded: </li></ul><ul><ul><li>show links with other projects, e.g. European or national projects, grants </li></ul></ul><ul><li>Negotiation will be difficult: </li></ul><ul><ul><li>financing, technical content </li></ul></ul><ul><li>Develop a clear Consortium agreement </li></ul><ul><li>Review your ideas with Commission officials </li></ul>
  14. 14. What is the critical mass? <ul><li>Concerning expertise: </li></ul><ul><li>the network must assemble the critical mass needed to achieve ambitious goals </li></ul><ul><ul><li>gather the major European researchers in this area </li></ul></ul><ul><li>Concerning duration of Community support: </li></ul><ul><li>5 years or more, if needed, to create a durable integration </li></ul><ul><li>Critical mass doesn‘t mean everybody </li></ul>
  15. 15. Financial Regime (General Principles) <ul><li>Concept of an incentive to integration </li></ul><ul><ul><li>will take the form of a fixed “grant for integration” </li></ul></ul><ul><ul><li>calculated on basis of total number of researchers </li></ul></ul><ul><li>Example (by European commission): </li></ul><ul><ul><li>a network of 200 researchers supported over 5 years would receive a fixed grant of €17.5 million </li></ul></ul><ul><ul><li>approx. 17.5 K€ per researcher </li></ul></ul>
  16. 16. Flexibility and autonomy <ul><li>E ach year the NoE proposes a detailed program for the forthcoming 18 months </li></ul><ul><li>Freedom to distribute funds between partners and between activities </li></ul><ul><li>T he partnership may itself decide to take in new partners (though without additional financing) </li></ul><ul><li>T he Commission may decide to launch calls to add partners (with additional financing) </li></ul>
  17. 17. Why TESTNET ? <ul><li>Humans have created complex systems that put themselves and their environment at risk </li></ul><ul><li>Human-made catastrophes have increased in frequency and magnitude with industrialization </li></ul><ul><li>Testing, the process of checking that a system possesses a set of desired properties and behavior, </li></ul><ul><ul><li>contributes to reduce the risk of failures and to guarantee the quality and reliability of the software used </li></ul></ul><ul><ul><li>is an integral part of innovation, production and operation of systems </li></ul></ul>
  18. 18. Why TESTNET ? <ul><li>Testing is already a flourishing area with the active participation of a large community of researchers and experts </li></ul><ul><li>There is also an awareness of an increasing need: </li></ul><ul><ul><li>to automate the testing activity in all application areas </li></ul></ul><ul><ul><li>that testing should be taken in consideration in all phases of the software and system life cycle </li></ul></ul>
  19. 19. Different communities <ul><li>Different testing communities use different methods: testing of software and testing of communication systems </li></ul><ul><li>Almost no interactions between them </li></ul><ul><li>Both communities have realized the need to unify their research efforts to define a common framework </li></ul>
  20. 20. Application in industry <ul><li>Existing techniques and tools for testing: </li></ul><ul><ul><li>are not adequately applied in industry </li></ul></ul><ul><li>Testing activities are: </li></ul><ul><ul><li>still very expensive </li></ul></ul><ul><ul><li>relegated to the last stages of development, so when time and resources start to be scarce, they are often partially sacrificed </li></ul></ul><ul><li>Make the testing activities more cost/effective: </li></ul><ul><ul><li>by developing better tools </li></ul></ul><ul><ul><li>by defining techniques seamlessly integrated into the development process </li></ul></ul>
  21. 21. Necessity of a NoE <ul><li>Research is reflected in: </li></ul><ul><ul><li>international conferences:IFIP TESTCOM, IFIP-FORTE/PSTV, IEEE-ICNP, ASE, ISSTA, IEEE-COMPSAC, IFIP CFIP, etc. </li></ul></ul><ul><ul><li>standard bodies: ETSI, ISEB, ITU-T, ISO, IETF </li></ul></ul><ul><li>But these instruments lack the structuring effect that would arise from the organization of an European NoE </li></ul><ul><li>These are the reasons why we propose TESTNET: </li></ul><ul><ul><li>to undertake the past, on-going and necessary future activities in the area of testing as well as the importance of it in all applications domains (communication services, nuclear power, transport, aeronautics, etc.) </li></ul></ul>
  22. 22. TESTNET <ul><li>The network will mobilise researchers and experts in the field of testing mobile communications , consumer electronics , embedded software and systems , aeronautics and nuclear energy </li></ul><ul><ul><li>To assure that Europe remains a leader in the field and continue to offer innovative, integrated and adapted methods and techniques to tackle the growing complexity of software and communication systems </li></ul></ul><ul><ul><li>To prevent economic failures (maintaining cost-efficiency) or social catastrophes (maintaining reliability) </li></ul></ul>
  23. 23. Issues to be addressed <ul><li>To automate the testing procedure to reduce time to market and to improve software quality at the same time </li></ul><ul><li>To define best practices that take into account different existing techniques in different domains that are applicable for industry </li></ul><ul><li>Testing is not always taken into consideration in industrial environments as it should be </li></ul><ul><li>Universities and other educational institutions often do not include it in their curricula </li></ul>
  24. 24. TESTNET Objectives <ul><li>Co-ordinate and bring together major European research groups from different testing communities and domains to strengthen and develop the collaboration in the area at the European level </li></ul><ul><ul><li>by stimulating technological transfer and sharing of experience </li></ul></ul><ul><ul><li>by coordinating research activities and defining its roadmap (medium and long term strategy) </li></ul></ul><ul><ul><li>by adapting activities to integrate their competencies taking advantage of the multi-disciplinary character of participants </li></ul></ul>
  25. 25. TESTNET Objectives <ul><li>Integrate testing through all software life cycle </li></ul><ul><li>Promote testing as a well-defined and important activity in education, research, software engineering and industry </li></ul><ul><li>Promote the integration of different testing techniques and development tools. Stimulate the creation of open tool environments so that different test and development tools can be seamlessly connected </li></ul><ul><li>Promote innovation and take-up of new technologies through small and medium enterprises (SMEs) and through the organisation of Integrated Projects </li></ul>
  26. 26. Planned activities <ul><li>Creation of working groups: </li></ul><ul><ul><li>WG1: Interoperability and conformance testing platforms and application to heterogeneous networks (e.g., next generation communication networks, mobile and wireless communication systems) </li></ul></ul><ul><ul><li>WG2: Testing of embedded software and fault-tolerant and safety-critical systems (e.g., aeronautics and railway control) </li></ul></ul><ul><ul><li>WG3: Languages for systems and test description (e.g., UML, SDL, B, Z, MSC, TTCN) </li></ul></ul><ul><ul><li>WG4: Techniques and processes for the new paradigms of software development (e.g., component-based software testing and testing of product lines) </li></ul></ul><ul><ul><li>WG5: Theoretical foundations of testing (e.g., measures for quality of testing and quality of software) </li></ul></ul><ul><ul><li>WG6: Platforms for testing of industrial applications </li></ul></ul>
  27. 27. Cross- working group actions <ul><li>Roadmap for testing : elaboration of a strategy for research and development </li></ul><ul><li>Education and training : elaboration of new curricula to integrate testing methodologies into university degrees </li></ul><ul><li>Elaborate best practices applicable globally, but also specifically for each area, for obtaining reliable software and hardware </li></ul><ul><li>Participation in the definition of standards : ETSI, ISO, ITU-T, ISEB, IETF, etc </li></ul><ul><li>Promotion of common activities with enterprises , with special emphasis on SME. In particular, creation of academia-industry laboratories in the countries having the necessary critical mass </li></ul>
  28. 28. Other complementary activities <ul><li>Organisation of joint workshops (i.e. including all the working groups) as well as open workshops (i.e. including participants outside the network). </li></ul><ul><li>Organisation of summer schools covering the different aspects and communities of testing. </li></ul>
  29. 29. Partners <ul><li>40 academic partners </li></ul><ul><li>20 entreprises </li></ul><ul><li>Countries: </li></ul><ul><ul><li>Denmark, Finland, France, Germany, Great Britain, Hungary, Israel, Italy, The Netherlands, Poland, Russia, Spain, Sweden </li></ul></ul>
  30. 30. Other information <ul><li>Strong competition </li></ul><ul><ul><li>the axe « Open development platforms for software and services » has 55 Meuros </li></ul></ul><ul><ul><li>they expect to finance 2-3 IP ’s and 2-3 NoE ’s </li></ul></ul><ul><li>High level management is expected </li></ul><ul><ul><li>a key point to obtain the financial support </li></ul></ul>
  31. 31. Other information <ul><li>The Joint Program of Activities is the most important part </li></ul><ul><ul><li>they expect a real and strong commitment of the participants organizations </li></ul></ul><ul><ul><li>national projects should be integrated in the network </li></ul></ul><ul><ul><li>international projects with non European countries should collaborate with the network </li></ul></ul>
  32. 32. Conclusion <ul><li>Our strong points: </li></ul><ul><ul><li>integration of testing of software and testing of communication systems communities </li></ul></ul><ul><ul><li>excellence of the consortium: includes theoretical and practical experience </li></ul></ul>