IBBT iLab
     Tara Shrimpton-Smith
     Pieter Ballon
     Brecht Vermeulen
iLab structure

                             IBBT

                    iLab
                                         Research groups
    Technical test center
                             iLab
    Usability lab            forum

    Open innovation centre            Research projects




 Support for basic research
 iLab doesn’t disturb the market (commercial tests)
                                                           2
iLab Technical test center
      Brecht Vermeulen
Overview




           4
Equipment: platforms and measurement tools


 xDSL, cable, ethernet, fibre channel, infiniband, wireless
 Servers, terminals, handheld devices, storage
 Interactive TV: Myrio, MHP
 Measurement:
     L2-L3 traffic generation: smartbits, Testcenter, N2X
     L1-L3 traffic analysis: Fluke Optiview, xDSL tracespan
     L4-L7 generation & analysis: Spirent Avalanche
     Voice quality tester Opticom opera




                                                           5
Telenet to Skynet (Skype P2P and direct): 24h

                                    4,5
                                              MOS                                               2500
                                                                                                         Delay
                                     4




                                          4
                                                                                                2000
                                    3,5




                                                                                                          2000ms
                                     3

                                                                                                1500

                                    2,5                                                                                  Delay Max (within 1
                        MOS Score




                                                                                   Delay (ms)
                                                                                                                         conversation) [ms]
                                                                                                                         Delay Avg (within 1




                                          3
                                                                                                                         conversation) [ms]
                                     2                                                                                   Delay Min (within 1
                                                                                                1000                     conversation) [ms]


                                    1,5




                                     1




P2P
                                                                                                 500


                                    0,5



                                     0
                                                       T ime
                                                                                                   0
                                                                                                          1000ms
                                                                                                              T ime




             4,5                                                            2500



              4



                                                                            2000
             3,5




                                          4
              3


                                                                            1500


                                                                                                         2000ms
             2,5




                                                               Delay (ms)
 MOS Score




                                                                                                                      Delay Max (within 1
                                                                                                                      conversation) [ms]



                                          3
              2
                                                                                                                      Delay Avg (within 1
                                                                            1000                                      conversation) [ms]

             1,5                                                                                                      Delay Min (within 1
                                                                                                                      conversation) [ms]


              1
                                                                             500




Direct       0,5                                                                                        1000ms
              0                                                                0

                                               T ime                                                   Time




                                                                                                                              6
TCP offloading network cards




             8 Gb/s            100%


 MTU MTU
 1500 9000
             4 Gb/s            50%
 Chelsio
 Chelsio
  Intel
  Intel




                                      7
iLab
Open innovation center
     Pieter Ballon
iLab open innovation centre (1/3)

Why support and take part in Open Innovation?

 Open Innovation
     Shorter time-to-market for more ideas
     Using the innovative capabilities at the edges of the value chain: non-ICT companies,
       SMEs, semi-professionals, consumers, policy makers
 Systemic Failure in ICT Innovation
     Too little or too much interaction, danger of lock-in
     Early intervention in innovation process required
 Involving Policy Makers
      Societal innovation
      Constructive Technology Assessment
 Involving Companies and Public Organisations
      Demonstrate advantages of open and multi-stakeholder
        process
      Experiment with new business / PPP models in trusted
        context
 Involving End Users
      End users domesticate new technologies
      End users create new value and adopt new roles
                                                                                              9
iLab open innovation centre (2/3)

 What is the iLab open innovation centre?

 The IBBT lab for policy and strategy research and experimentation
 Important Policy and Strategy Issues
     Stimulating open innovation
     Building strong partnerships and networks
     Reaping rewards from Web 2.0 innovations
     Closing the digital divide
     Safeguarding privacy and trust
 Methods
     Experimental, multi-stakeholder analysis and co-design with policy and
      business partners
     Use of various simulation tools and Living Lab settings, including a
      wireless broadband campus network in Brussels

                                                                               10
iLab open innovation centre (3/3)

National and international dimension

 Expertise in national and international projects
    Policy impact of ICT innovations
    Foresight for policy and strategy
    Open innovation business models
    Living Lab experimentation
 European Network of Living Labs
    Established November 2006 in Helsinki, Finland
    20 Members selected as forerunners of European Living Labs
    Open Innovation Centre selected as member of first wave of
     European Living Labs


                                                                  11
iLab
Usability lab
      Tara Shrimpton-Smith
Advantages of lab testing

   Easier for products in development
   Video-recordings improve analysis
   Usability expert takes notes without disturbing the user
   Other people can follow and comment the test without
    disturbing the user
   Possibility for extension with extra equipment
   Validation test
   Comparing test




                                                               13
Disadvantages of lab testing


 Test user intimidated by environment
 Distance between usability expert and user
 In-house usability lab kan leiden tot sociaal wenselijke
  antwoorden-> goeie vertaling gewenst ;-)
 Cost and maintenance of equipment




                                                             14
Stationary usability lab




Observation and control room
separated by view-through mirror and
cameras
   Evaluation software “Noldus The
   Observer”
   Controlled environment

                                       15
Portable usability lab




Same facilities but on location
   Possibility to test in natural
   environment




                                    16
Mobile usability lab




Testing of handheld devices
Natural environment




                              17
Eyetracking




Heat maps, hot spots, gaze time
Controlled environment



                                  18
iLab
Demo Usability lab
     Tara Shrimpton-Smith

Brokerage 2007 presentation ilab

  • 1.
    IBBT iLab Tara Shrimpton-Smith Pieter Ballon Brecht Vermeulen
  • 2.
    iLab structure IBBT iLab Research groups Technical test center iLab Usability lab forum Open innovation centre Research projects  Support for basic research  iLab doesn’t disturb the market (commercial tests) 2
  • 3.
    iLab Technical testcenter Brecht Vermeulen
  • 4.
  • 5.
    Equipment: platforms andmeasurement tools  xDSL, cable, ethernet, fibre channel, infiniband, wireless  Servers, terminals, handheld devices, storage  Interactive TV: Myrio, MHP  Measurement:  L2-L3 traffic generation: smartbits, Testcenter, N2X  L1-L3 traffic analysis: Fluke Optiview, xDSL tracespan  L4-L7 generation & analysis: Spirent Avalanche  Voice quality tester Opticom opera 5
  • 6.
    Telenet to Skynet(Skype P2P and direct): 24h 4,5 MOS 2500 Delay 4 4 2000 3,5 2000ms 3 1500 2,5 Delay Max (within 1 MOS Score Delay (ms) conversation) [ms] Delay Avg (within 1 3 conversation) [ms] 2 Delay Min (within 1 1000 conversation) [ms] 1,5 1 P2P 500 0,5 0 T ime 0 1000ms T ime 4,5 2500 4 2000 3,5 4 3 1500 2000ms 2,5 Delay (ms) MOS Score Delay Max (within 1 conversation) [ms] 3 2 Delay Avg (within 1 1000 conversation) [ms] 1,5 Delay Min (within 1 conversation) [ms] 1 500 Direct 0,5 1000ms 0 0 T ime Time 6
  • 7.
    TCP offloading networkcards 8 Gb/s 100% MTU MTU 1500 9000 4 Gb/s 50% Chelsio Chelsio Intel Intel 7
  • 8.
  • 9.
    iLab open innovationcentre (1/3) Why support and take part in Open Innovation?  Open Innovation  Shorter time-to-market for more ideas  Using the innovative capabilities at the edges of the value chain: non-ICT companies, SMEs, semi-professionals, consumers, policy makers  Systemic Failure in ICT Innovation  Too little or too much interaction, danger of lock-in  Early intervention in innovation process required  Involving Policy Makers  Societal innovation  Constructive Technology Assessment  Involving Companies and Public Organisations  Demonstrate advantages of open and multi-stakeholder process  Experiment with new business / PPP models in trusted context  Involving End Users  End users domesticate new technologies  End users create new value and adopt new roles 9
  • 10.
    iLab open innovationcentre (2/3) What is the iLab open innovation centre?  The IBBT lab for policy and strategy research and experimentation  Important Policy and Strategy Issues  Stimulating open innovation  Building strong partnerships and networks  Reaping rewards from Web 2.0 innovations  Closing the digital divide  Safeguarding privacy and trust  Methods  Experimental, multi-stakeholder analysis and co-design with policy and business partners  Use of various simulation tools and Living Lab settings, including a wireless broadband campus network in Brussels 10
  • 11.
    iLab open innovationcentre (3/3) National and international dimension  Expertise in national and international projects  Policy impact of ICT innovations  Foresight for policy and strategy  Open innovation business models  Living Lab experimentation  European Network of Living Labs  Established November 2006 in Helsinki, Finland  20 Members selected as forerunners of European Living Labs  Open Innovation Centre selected as member of first wave of European Living Labs 11
  • 12.
    iLab Usability lab Tara Shrimpton-Smith
  • 13.
    Advantages of labtesting  Easier for products in development  Video-recordings improve analysis  Usability expert takes notes without disturbing the user  Other people can follow and comment the test without disturbing the user  Possibility for extension with extra equipment  Validation test  Comparing test 13
  • 14.
    Disadvantages of labtesting  Test user intimidated by environment  Distance between usability expert and user  In-house usability lab kan leiden tot sociaal wenselijke antwoorden-> goeie vertaling gewenst ;-)  Cost and maintenance of equipment 14
  • 15.
    Stationary usability lab Observationand control room separated by view-through mirror and cameras Evaluation software “Noldus The Observer” Controlled environment 15
  • 16.
    Portable usability lab Samefacilities but on location Possibility to test in natural environment 16
  • 17.
    Mobile usability lab Testingof handheld devices Natural environment 17
  • 18.
    Eyetracking Heat maps, hotspots, gaze time Controlled environment 18
  • 19.
    iLab Demo Usability lab Tara Shrimpton-Smith