SlideShare a Scribd company logo
Why should I trust in FIWARE?
Quality Assurance in FIWARE
0
Clara Pezuela – Atos
Málaga, 15 December 2016
Table of contents
 The motivation: why QA is needed in FIWARE?
 The purpose: what does it mean Quality Assurance in FIWARE?
 The team: who was doing the QA?
 The methodology: how was the testing process?
 The tests: what was tested and which were the obtained results?
 The assessment: what the conclusions of performed tests?
 The labelling: how to rapidly check the GEs quality?
 The publication: how can I find the QA work and results?
 The future: how QA task will evolve?
 Why should I trust in FIWARE?
 Q&A (10’)
1
The motivation
 FIWARE is rapidly moving from experimental to production
environments in which the platform must scale up in reliable and real
workload conditions
• FIWARE GEs must work at an adequate quality, reliability and
performance level
 Support FIWARE users with high-quality support for installation,
configuration and operation of FIWARE technology
• Improving the FIWARE user experience in general
 Practical approach with focus on improving quality and transparency
• Light and agile methodology very operative
2
The purpose (I)
 To test FIWARE GEs, addressing functional and non-functional
testing
3
The purpose (II)
 To test FIWARE GEs, addressing functional testing
 Curation of GEs documentation (functional testing):
• to check the completeness, consistency, soundness and usability of
documentation for specification, implementation and installation of the
Ges
• to test the training efficiency by analyzing the Academy courses
 Verification of the GE specification (functional testing):
• developing the appropriate test cases to assess if the GEs
implementation corresponds to what is defined in the specification.
• validating the APIs
• integration tests of common bundles
4
The purpose (III)
 To test FIWARE GEs, addressing non-functional testing
 Assessment of performance, stability and scalability (non-
functional testing):
• Defining and executing test scenarios to find the limits of a GE
• Comparing with reference values of usual execution
• Replicating environments of intensive workload
5
The QA team
 Clara Pezuela, Atos, task coordinator
 Miguel A. Ramirez, Atos, non-functional testing
 Carlos Lucena, Atos, non-functional testing
 Riccardo Zanetti, ENG, non-functional testing
 Andrea La Porta, ENG, functional testing
 Annamaria Cappa, ENG, functional testing
 Carmen Mac Williams, GAR, research testing
 Franck Le Gall, EGM, research on testing
 Peter Murynshkin, Fraunhofer, research on testing
6
 Professional units of testing in Atos and
Engineering
 Research groups especialized in testing
methods (EGM, Fraunhofer, Grassroot)
The methodology: for functional testing
7
Bundle
Testing
APIs
verification
Documentatio
n
Testing
Bug Tracker system (Jira)
bug bug bug
28 GEs from Catalogue
Training
courses
testing
recommendation
8 GEs most used
GE
owners
The methodology: for stress testing
8
Identity Management – KeyRock
Authorization PDP – AuthZForce
PEP Proxy – Wilma
Context Broker - Orion
Complex Event Processing (CEP) – Proton
Stream Oriented – Kurento
Backend Device Management – IDAS
IoT Broker – Aeron
IoT Data Edge Consolidation – Cepheus
Policy Manager - Bosun
The results: curation of documentation and
verification
 Live dashboard collects and maintains
the assessment information
 Near 95% of the high priority GEs
has passed successfully the
documentation and verification tests.
 The medium and low priority GEs
are around 80% of success but they
are working on solving the issues.
 In average, more than 90% of GEs
have passed the tests
9
Data obtained in September 2016
The results: training courses
 32 courses were tested
 6 were Good (18%)
 8 were To improve (25%)
 18 were Sufficient (56%)
10
Data obtained in September 2016
The results: stress testing (GEs)
11
Data obtained in September 2016
GE name Reliability (errors
rate)
Performance in stress condition (num requests,
response time, bit rate)
Stability (crashes)
IDAS 0% 140 updates /second, 200 threads No crash
IoT Broker 44% for
SubscribeContext
30 requests/s generated by 16 concurrent threads with
an average response time of 468 ms
Crashed
AuthZForce 0% AV RT around 11 ms; 4376 requests per second No crash
KeyRock 0 % Authorisation max load with AV RT<1s= 220 requests/s
Authentication max load with AV RT<1s=22 requests/s
No crash
Wilma 0% up to 839 requests/sec No crash
Orion 0% 5160 attribute updates/sec Crashed
Proton 0,39% 500 requests/sec; 950 creating definitions/sec Crashed
Bosun 3,5% 160 simultaneous threads , 26 HTTP responses/sec for
Cloto and 30 for Facts
Crashed
Kurento 0% Good for less than 50 simultaneuos users and low quality
video
No crash
Cepheus 42% for Broker Test 100 requests/sec Crashed
The results: stress testing (bundles)
12
Data obtained in September 2016
Bundle Reliability
(errors rate)
Performance in stress condition (num
requests, response time)
Stability (crashes)
AuthZForce+Wilma+KeyRock 0% 99 requests/second No crash
Orion+IDAS+Cygnus 0% 280 requests/second/ 300 Threads No crash
The results: research activities
 Model based testing (MBT) for generating automating tests to verify
the compliance of FIWARE GEs APIs with NGSI standard
 Continous integration testing (some trials)
 Automatic online documentation testing (Catalogue)
• Require two sets of metrics:
□ derived from the Compliance Guide Catalogue (optimal text length, context
relevant concepts,…)
□ common language metrics to ensure good style and legibility of online
documentation (average sentence length, lexical complexity,…)
13
GE Executed tests Failed test NGSI compliance
Orion 30 3 (10%) High
IoTBroker 30 9 (30%) Medium-high
Cepheus 30 21 (70%) Light
The assessment (I): overall work
 Hard starting…
• Pressure in setting up the task very fast for public events
• Business teams never worked before together
• Heterogeneity of the GEs, different testing environments settings
• Lack of reference values and test cases in some GEs
 But progressively improving…
• GE owners collaboration and responsiveness increased
• Better obtained results in consecutive releases
• Homogeneity in reporting was increased
• Joint labelling process for functional and non-functional testing
14
The assessment (II): GEs quality status
 Documentation testing
• Most of GEs manual allows installing the components
• But the documentation is not always clear, readily and available from the
links.
 APIs testing
• The installed software package implements the APIs declared into Open
Specification.
• The main failures concern the missing information on documentation.
 Bundle Integration tests
• Simulation of a parking sensors scenario
• Using Orion, Wilma, CEP, IDAS, AuthZForce, SpagoBI, KeyRock
• 4 out of 22 tested cases failed
 Academy courses testing
• 60% of the academy courses are sufficient
• Many tips were reported on Jira tool to help the GE owner improving the
training. 15
The assessment (III): GEs quality status
16
 In scalability, all GEs behave very good except one
 In performance, 4 out of 10 GEs are providing values that could be
improved in next releases
 In stability, half of the GEs are not managing properly the memory or
CPU resources
The labelling (I)
 Quick at a glance mechanism to check the assessed GEs’
quality
 Following the EU energy label system
 Sub-label per each tested aspect (usability, reliability,
efficiency, scalability, performance and stability)
 Global label as average of all sub-labels
 Initial pilot with 10 GEs
17
Identity Management – KeyRock
Authorization PDP – AuthZForce
PEP Proxy – Wilma
Context Broker - Orion
Complex Event Processing (CEP) – Proton
Stream Oriented – Kurento
Backend Device Management – IDAS
IoT Broker – Aeron
IoT Data Edge Consolidation – Cepheus
Policy Manager - Bosun
Labels assigned in September 2016
The labelling: meaning of values
18
how complete is the
GE documentation?
how sound is the GE
documentation?
how many GE APIs
were failed over the
tested ones?
how many bugs in
average by priority
have been detected?
how long does GE
take to answer the
issues? how long does GE
take to fix the issues?
Depend on GE type:
• how many updated attributes/second?
• how many complex events/second?
• which bit rate per user is acceptable?
• how many requests/second?
how well are memory/CPU
managed?
how the response time
is growing as long as
number of concurrent
threads is growing?
The labelling (II): meaning of labels
 Qualitative and quantitative values (ranges)
 Same metrics for all GEs, except for performance, which depends on
type of app
19
The labelling (III): resulting labels
20
Labels assigned in September 2016
The publication
 Public document:
https://www.fiware.org/wp-
content/uploads/2016/10/QA_publ
ic_document.pdf
 QA wiki page:
https://forge.fiware.org/plugins/me
diawiki/wiki/fiware/index.php/FIW
ARE_QA_Activities
 Brochure
 Blog post:
https://www.fiware.org/2016/09/20
/assessing-fiware-ges-quality/
21
The future
 Upon the continuation of presented activities…
 Enlarge the set of tests to be more complete and extensive to all
GEs and bundles
 Automate as much as possible the tests and the labelling process
 Integration of tests with FIWARE development process
22
Why should I trust in FIWARE?
 Because…
 we are continously testing all GEs
• including documentation, APIs and performance among others
 we are publishing all the performed tests and obtained results
• in a transparent and open way (GitHub, Docman)
• guidelines for replicating the tests
 we are providing recommendations to the GE owners
• to improve their functionality and behaviour
23
Thank you!
http://fiware.org
Follow @FIWARE on Twitter
24

More Related Content

What's hot

Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
DevOps.com
 
Comparison of Current Service Mesh Architectures
Comparison of Current Service Mesh ArchitecturesComparison of Current Service Mesh Architectures
Comparison of Current Service Mesh Architectures
Mirantis
 
Spring boot microservice metrics monitoring
Spring boot   microservice metrics monitoringSpring boot   microservice metrics monitoring
Spring boot microservice metrics monitoring
Oracle Korea
 
Devops Enterprise Summit: My Great Awakening: 
Top “Ah-ha” Moments As Former ...
Devops Enterprise Summit: My Great Awakening: 
Top “Ah-ha” Moments As Former ...Devops Enterprise Summit: My Great Awakening: 
Top “Ah-ha” Moments As Former ...
Devops Enterprise Summit: My Great Awakening: 
Top “Ah-ha” Moments As Former ...
cornelia davis
 
Demystifying AuthN/AuthZ Using OIDC & OAuth2
Demystifying AuthN/AuthZ Using OIDC & OAuth2Demystifying AuthN/AuthZ Using OIDC & OAuth2
Demystifying AuthN/AuthZ Using OIDC & OAuth2
NGINX, Inc.
 
apidays LIVE New York 2021 - APIOps: automating API operations for speed and ...
apidays LIVE New York 2021 - APIOps: automating API operations for speed and ...apidays LIVE New York 2021 - APIOps: automating API operations for speed and ...
apidays LIVE New York 2021 - APIOps: automating API operations for speed and ...
apidays
 
CV
CVCV
Cisco Spark and Tropo and the Programmable Web
Cisco Spark and Tropo and the Programmable WebCisco Spark and Tropo and the Programmable Web
Cisco Spark and Tropo and the Programmable Web
Cisco DevNet
 
Docker Birthday #5 Meetup Cluj - Presentation
Docker Birthday #5 Meetup Cluj - PresentationDocker Birthday #5 Meetup Cluj - Presentation
Docker Birthday #5 Meetup Cluj - Presentation
Alex Vranceanu
 
12 Factor, or Cloud Native Apps – What EXACTLY Does that Mean for Spring Deve...
12 Factor, or Cloud Native Apps – What EXACTLY Does that Mean for Spring Deve...12 Factor, or Cloud Native Apps – What EXACTLY Does that Mean for Spring Deve...
12 Factor, or Cloud Native Apps – What EXACTLY Does that Mean for Spring Deve...
cornelia davis
 
.NET Fest 2019. Андрей Винда. Создание REST API с поддержкой высокой нагрузки
.NET Fest 2019. Андрей Винда. Создание REST API с поддержкой высокой нагрузки.NET Fest 2019. Андрей Винда. Создание REST API с поддержкой высокой нагрузки
.NET Fest 2019. Андрей Винда. Создание REST API с поддержкой высокой нагрузки
NETFest
 
Removing Barriers Between Dev and Ops
Removing Barriers Between Dev and OpsRemoving Barriers Between Dev and Ops
Removing Barriers Between Dev and Ops
cornelia davis
 
Webinar by ZNetLive & Plesk- Winning the Game for WebOps and DevOps
Webinar by ZNetLive & Plesk- Winning the Game for WebOps and DevOps Webinar by ZNetLive & Plesk- Winning the Game for WebOps and DevOps
Webinar by ZNetLive & Plesk- Winning the Game for WebOps and DevOps
ZNetLive
 
Build bundles in the cloud - How Cloudyle PaaS+ helps creating OSGi applicati...
Build bundles in the cloud - How Cloudyle PaaS+ helps creating OSGi applicati...Build bundles in the cloud - How Cloudyle PaaS+ helps creating OSGi applicati...
Build bundles in the cloud - How Cloudyle PaaS+ helps creating OSGi applicati...
mfrancis
 
Red Hat Agile integration workshop - Atlanta
Red Hat Agile integration workshop - AtlantaRed Hat Agile integration workshop - Atlanta
Red Hat Agile integration workshop - Atlanta
Judy Breedlove
 
SpringOne2GX 2014 Splunk Presentation
SpringOne2GX 2014 Splunk PresentationSpringOne2GX 2014 Splunk Presentation
SpringOne2GX 2014 Splunk Presentation
Damien Dallimore
 
In Search of Segmentation
In Search of SegmentationIn Search of Segmentation
In Search of Segmentation
Adrian Cockcroft
 
Continuous Performance Testing: The New Standard
Continuous Performance Testing: The New StandardContinuous Performance Testing: The New Standard
Continuous Performance Testing: The New Standard
TechWell
 
Testing a Microservices Architecture
Testing a Microservices ArchitectureTesting a Microservices Architecture
Testing a Microservices Architecture
Parasoft
 
Implementing Enterprise Identity and Access Management in a microservices wor...
Implementing Enterprise Identity and Access Management in a microservices wor...Implementing Enterprise Identity and Access Management in a microservices wor...
Implementing Enterprise Identity and Access Management in a microservices wor...
Judy Breedlove
 

What's hot (20)

Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
 
Comparison of Current Service Mesh Architectures
Comparison of Current Service Mesh ArchitecturesComparison of Current Service Mesh Architectures
Comparison of Current Service Mesh Architectures
 
Spring boot microservice metrics monitoring
Spring boot   microservice metrics monitoringSpring boot   microservice metrics monitoring
Spring boot microservice metrics monitoring
 
Devops Enterprise Summit: My Great Awakening: 
Top “Ah-ha” Moments As Former ...
Devops Enterprise Summit: My Great Awakening: 
Top “Ah-ha” Moments As Former ...Devops Enterprise Summit: My Great Awakening: 
Top “Ah-ha” Moments As Former ...
Devops Enterprise Summit: My Great Awakening: 
Top “Ah-ha” Moments As Former ...
 
Demystifying AuthN/AuthZ Using OIDC & OAuth2
Demystifying AuthN/AuthZ Using OIDC & OAuth2Demystifying AuthN/AuthZ Using OIDC & OAuth2
Demystifying AuthN/AuthZ Using OIDC & OAuth2
 
apidays LIVE New York 2021 - APIOps: automating API operations for speed and ...
apidays LIVE New York 2021 - APIOps: automating API operations for speed and ...apidays LIVE New York 2021 - APIOps: automating API operations for speed and ...
apidays LIVE New York 2021 - APIOps: automating API operations for speed and ...
 
CV
CVCV
CV
 
Cisco Spark and Tropo and the Programmable Web
Cisco Spark and Tropo and the Programmable WebCisco Spark and Tropo and the Programmable Web
Cisco Spark and Tropo and the Programmable Web
 
Docker Birthday #5 Meetup Cluj - Presentation
Docker Birthday #5 Meetup Cluj - PresentationDocker Birthday #5 Meetup Cluj - Presentation
Docker Birthday #5 Meetup Cluj - Presentation
 
12 Factor, or Cloud Native Apps – What EXACTLY Does that Mean for Spring Deve...
12 Factor, or Cloud Native Apps – What EXACTLY Does that Mean for Spring Deve...12 Factor, or Cloud Native Apps – What EXACTLY Does that Mean for Spring Deve...
12 Factor, or Cloud Native Apps – What EXACTLY Does that Mean for Spring Deve...
 
.NET Fest 2019. Андрей Винда. Создание REST API с поддержкой высокой нагрузки
.NET Fest 2019. Андрей Винда. Создание REST API с поддержкой высокой нагрузки.NET Fest 2019. Андрей Винда. Создание REST API с поддержкой высокой нагрузки
.NET Fest 2019. Андрей Винда. Создание REST API с поддержкой высокой нагрузки
 
Removing Barriers Between Dev and Ops
Removing Barriers Between Dev and OpsRemoving Barriers Between Dev and Ops
Removing Barriers Between Dev and Ops
 
Webinar by ZNetLive & Plesk- Winning the Game for WebOps and DevOps
Webinar by ZNetLive & Plesk- Winning the Game for WebOps and DevOps Webinar by ZNetLive & Plesk- Winning the Game for WebOps and DevOps
Webinar by ZNetLive & Plesk- Winning the Game for WebOps and DevOps
 
Build bundles in the cloud - How Cloudyle PaaS+ helps creating OSGi applicati...
Build bundles in the cloud - How Cloudyle PaaS+ helps creating OSGi applicati...Build bundles in the cloud - How Cloudyle PaaS+ helps creating OSGi applicati...
Build bundles in the cloud - How Cloudyle PaaS+ helps creating OSGi applicati...
 
Red Hat Agile integration workshop - Atlanta
Red Hat Agile integration workshop - AtlantaRed Hat Agile integration workshop - Atlanta
Red Hat Agile integration workshop - Atlanta
 
SpringOne2GX 2014 Splunk Presentation
SpringOne2GX 2014 Splunk PresentationSpringOne2GX 2014 Splunk Presentation
SpringOne2GX 2014 Splunk Presentation
 
In Search of Segmentation
In Search of SegmentationIn Search of Segmentation
In Search of Segmentation
 
Continuous Performance Testing: The New Standard
Continuous Performance Testing: The New StandardContinuous Performance Testing: The New Standard
Continuous Performance Testing: The New Standard
 
Testing a Microservices Architecture
Testing a Microservices ArchitectureTesting a Microservices Architecture
Testing a Microservices Architecture
 
Implementing Enterprise Identity and Access Management in a microservices wor...
Implementing Enterprise Identity and Access Management in a microservices wor...Implementing Enterprise Identity and Access Management in a microservices wor...
Implementing Enterprise Identity and Access Management in a microservices wor...
 

Viewers also liked

How to Contribute to FIWARE
How to Contribute to FIWAREHow to Contribute to FIWARE
How to Contribute to FIWARE
FIWARE
 
Schema.fiware.org: FIWARE Harmonized Data Models
Schema.fiware.org: FIWARE Harmonized Data ModelsSchema.fiware.org: FIWARE Harmonized Data Models
Schema.fiware.org: FIWARE Harmonized Data Models
FIWARE
 
Building Your Own IoT Platform using FIWARE GEis
Building Your Own IoT Platform using FIWARE GEisBuilding Your Own IoT Platform using FIWARE GEis
Building Your Own IoT Platform using FIWARE GEis
FIWARE
 
Welcome to the 1st FIWARE Summit
Welcome to the 1st FIWARE SummitWelcome to the 1st FIWARE Summit
Welcome to the 1st FIWARE Summit
FIWARE
 
Vanilla JS
Vanilla JSVanilla JS
Vanilla JS
Mario Mendonça
 
Colores.odt
Colores.odtColores.odt
Colores.odt
Juanbusan
 
Increasing Third Party margins on Frames with VSP
Increasing Third Party margins on Frames with VSPIncreasing Third Party margins on Frames with VSP
Increasing Third Party margins on Frames with VSP
Mark Clark ABOC
 
12 Reasons to use YouTube in schools and organizations.
12 Reasons to use YouTube in schools and organizations.12 Reasons to use YouTube in schools and organizations.
12 Reasons to use YouTube in schools and organizations.
EduTechNia
 
The Golden Slipper
The Golden SlipperThe Golden Slipper
The Golden Slipper
4thGradePanthers
 
Presentation skills 2016
Presentation skills 2016Presentation skills 2016
Presentation skills 2016
Emma Olohan, PRII
 
Republic act no.7836
Republic act no.7836Republic act no.7836
Republic act no.7836
Ben Parish
 
Deploy Mediawiki Using FIWARE Lab Facilities
Deploy Mediawiki Using FIWARE Lab FacilitiesDeploy Mediawiki Using FIWARE Lab Facilities
Deploy Mediawiki Using FIWARE Lab Facilities
FIWARE
 
Magija Virdžinije Satir Moj put ka Samoliderstvu - Ljiljana Rsumovic
 Magija Virdžinije SatirMoj put ka Samoliderstvu - Ljiljana Rsumovic Magija Virdžinije SatirMoj put ka Samoliderstvu - Ljiljana Rsumovic
Magija Virdžinije Satir Moj put ka Samoliderstvu - Ljiljana Rsumovic
NLP Centar Beograd
 
How to Deploy Spark Instance Using Ansible 2.0 in FIWARE Lab
How to Deploy Spark Instance Using Ansible 2.0 in FIWARE LabHow to Deploy Spark Instance Using Ansible 2.0 in FIWARE Lab
How to Deploy Spark Instance Using Ansible 2.0 in FIWARE Lab
FIWARE
 
How to Install & Configure Your Own Identity Manager GE
How to Install & Configure Your Own Identity Manager GEHow to Install & Configure Your Own Identity Manager GE
How to Install & Configure Your Own Identity Manager GE
FIWARE
 
Agenda FIWARE at 4YFN
Agenda FIWARE at 4YFNAgenda FIWARE at 4YFN
Agenda FIWARE at 4YFN
FIWARE
 
FIWARE Developers Week_BootcampWeBUI_presentation2
FIWARE Developers Week_BootcampWeBUI_presentation2FIWARE Developers Week_BootcampWeBUI_presentation2
FIWARE Developers Week_BootcampWeBUI_presentation2
FIWARE
 
201410 1 fiware-overview
201410 1 fiware-overview201410 1 fiware-overview
201410 1 fiware-overview
FIWARE
 
Quickstrat bootstrap
Quickstrat bootstrapQuickstrat bootstrap
Quickstrat bootstrap
Deni Ywn
 
FIWARE Developers Week_ Introduction to Managing Context Information at Large...
FIWARE Developers Week_ Introduction to Managing Context Information at Large...FIWARE Developers Week_ Introduction to Managing Context Information at Large...
FIWARE Developers Week_ Introduction to Managing Context Information at Large...
FIWARE
 

Viewers also liked (20)

How to Contribute to FIWARE
How to Contribute to FIWAREHow to Contribute to FIWARE
How to Contribute to FIWARE
 
Schema.fiware.org: FIWARE Harmonized Data Models
Schema.fiware.org: FIWARE Harmonized Data ModelsSchema.fiware.org: FIWARE Harmonized Data Models
Schema.fiware.org: FIWARE Harmonized Data Models
 
Building Your Own IoT Platform using FIWARE GEis
Building Your Own IoT Platform using FIWARE GEisBuilding Your Own IoT Platform using FIWARE GEis
Building Your Own IoT Platform using FIWARE GEis
 
Welcome to the 1st FIWARE Summit
Welcome to the 1st FIWARE SummitWelcome to the 1st FIWARE Summit
Welcome to the 1st FIWARE Summit
 
Vanilla JS
Vanilla JSVanilla JS
Vanilla JS
 
Colores.odt
Colores.odtColores.odt
Colores.odt
 
Increasing Third Party margins on Frames with VSP
Increasing Third Party margins on Frames with VSPIncreasing Third Party margins on Frames with VSP
Increasing Third Party margins on Frames with VSP
 
12 Reasons to use YouTube in schools and organizations.
12 Reasons to use YouTube in schools and organizations.12 Reasons to use YouTube in schools and organizations.
12 Reasons to use YouTube in schools and organizations.
 
The Golden Slipper
The Golden SlipperThe Golden Slipper
The Golden Slipper
 
Presentation skills 2016
Presentation skills 2016Presentation skills 2016
Presentation skills 2016
 
Republic act no.7836
Republic act no.7836Republic act no.7836
Republic act no.7836
 
Deploy Mediawiki Using FIWARE Lab Facilities
Deploy Mediawiki Using FIWARE Lab FacilitiesDeploy Mediawiki Using FIWARE Lab Facilities
Deploy Mediawiki Using FIWARE Lab Facilities
 
Magija Virdžinije Satir Moj put ka Samoliderstvu - Ljiljana Rsumovic
 Magija Virdžinije SatirMoj put ka Samoliderstvu - Ljiljana Rsumovic Magija Virdžinije SatirMoj put ka Samoliderstvu - Ljiljana Rsumovic
Magija Virdžinije Satir Moj put ka Samoliderstvu - Ljiljana Rsumovic
 
How to Deploy Spark Instance Using Ansible 2.0 in FIWARE Lab
How to Deploy Spark Instance Using Ansible 2.0 in FIWARE LabHow to Deploy Spark Instance Using Ansible 2.0 in FIWARE Lab
How to Deploy Spark Instance Using Ansible 2.0 in FIWARE Lab
 
How to Install & Configure Your Own Identity Manager GE
How to Install & Configure Your Own Identity Manager GEHow to Install & Configure Your Own Identity Manager GE
How to Install & Configure Your Own Identity Manager GE
 
Agenda FIWARE at 4YFN
Agenda FIWARE at 4YFNAgenda FIWARE at 4YFN
Agenda FIWARE at 4YFN
 
FIWARE Developers Week_BootcampWeBUI_presentation2
FIWARE Developers Week_BootcampWeBUI_presentation2FIWARE Developers Week_BootcampWeBUI_presentation2
FIWARE Developers Week_BootcampWeBUI_presentation2
 
201410 1 fiware-overview
201410 1 fiware-overview201410 1 fiware-overview
201410 1 fiware-overview
 
Quickstrat bootstrap
Quickstrat bootstrapQuickstrat bootstrap
Quickstrat bootstrap
 
FIWARE Developers Week_ Introduction to Managing Context Information at Large...
FIWARE Developers Week_ Introduction to Managing Context Information at Large...FIWARE Developers Week_ Introduction to Managing Context Information at Large...
FIWARE Developers Week_ Introduction to Managing Context Information at Large...
 

Similar to Why Should I Trust on FIWARE?

How to Guarantee Continuous Value from your Test Automation
How to Guarantee Continuous Value from your Test AutomationHow to Guarantee Continuous Value from your Test Automation
How to Guarantee Continuous Value from your Test Automation
Perfecto by Perforce
 
QA metrics in Agile (GUIDE)
QA metrics in Agile (GUIDE)QA metrics in Agile (GUIDE)
QA metrics in Agile (GUIDE)
Vladimir Primakov (Volodymyr Prymakov)
 
Quality at the speed of digital
Quality   at the speed of digitalQuality   at the speed of digital
Quality at the speed of digital
rajni singh
 
Creating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran KinsbrunerCreating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran Kinsbruner
QA or the Highway
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software Quality
Anand Prabhala
 
Keeping Your Continuous Test Automation Continuously Valuable
Keeping Your Continuous Test Automation Continuously ValuableKeeping Your Continuous Test Automation Continuously Valuable
Keeping Your Continuous Test Automation Continuously Valuable
Perfecto by Perforce
 
Neotys PAC 2018 - Gayatree Nalwadad
Neotys PAC 2018 - Gayatree NalwadadNeotys PAC 2018 - Gayatree Nalwadad
Neotys PAC 2018 - Gayatree Nalwadad
Neotys_Partner
 
Best Practices In Load And Stress Testing Cmg Seminar[1]
Best Practices In Load And Stress Testing Cmg Seminar[1]Best Practices In Load And Stress Testing Cmg Seminar[1]
Best Practices In Load And Stress Testing Cmg Seminar[1]
Munirathnam Naidu
 
(Technologies) AI, Machine Learning, Predictive Analytics, IIOT, Cloud,Web-fr...
(Technologies) AI, Machine Learning, Predictive Analytics, IIOT, Cloud,Web-fr...(Technologies) AI, Machine Learning, Predictive Analytics, IIOT, Cloud,Web-fr...
(Technologies) AI, Machine Learning, Predictive Analytics, IIOT, Cloud,Web-fr...
Farhan Tariq
 
Building functional Quality Gates with ReportPortal
Building functional Quality Gates with ReportPortalBuilding functional Quality Gates with ReportPortal
Building functional Quality Gates with ReportPortal
Dmitriy Gumeniuk
 
Introducing automated GUI testing and observing its benefits: an industrial c...
Introducing automated GUI testing and observing its benefits: an industrial c...Introducing automated GUI testing and observing its benefits: an industrial c...
Introducing automated GUI testing and observing its benefits: an industrial c...
Vahid Garousi
 
quality-assurance_best_practice_guide_4 0
quality-assurance_best_practice_guide_4 0quality-assurance_best_practice_guide_4 0
quality-assurance_best_practice_guide_4 0
Andrei Hortúa
 
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity Software Ireland
 
Automation Deployments and Gudielines.pptx
Automation Deployments and Gudielines.pptxAutomation Deployments and Gudielines.pptx
Automation Deployments and Gudielines.pptx
NikhileshSathyavarap
 
Choosing right-automation-tool
Choosing right-automation-toolChoosing right-automation-tool
Choosing right-automation-tool
BabuDevanandam
 
User Acceptance Testing in the Testing Center of Excellence
User Acceptance Testing in the Testing Center of ExcellenceUser Acceptance Testing in the Testing Center of Excellence
User Acceptance Testing in the Testing Center of Excellence
TechWell
 
How to Clean Up Your Continuous Testing Suites for Web & Mobile
How to Clean Up Your Continuous Testing Suites for Web & MobileHow to Clean Up Your Continuous Testing Suites for Web & Mobile
How to Clean Up Your Continuous Testing Suites for Web & Mobile
Perfecto by Perforce
 
TEA Presentation V 0.3
TEA Presentation V 0.3TEA Presentation V 0.3
TEA Presentation V 0.3
Ian McDonald
 
Zero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOpsZero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOps
TaUB Solutions
 
Software Test Engineer with 3.6 years of experience
Software Test Engineer with 3.6 years of experienceSoftware Test Engineer with 3.6 years of experience
Software Test Engineer with 3.6 years of experience
vijaya lakshmi
 

Similar to Why Should I Trust on FIWARE? (20)

How to Guarantee Continuous Value from your Test Automation
How to Guarantee Continuous Value from your Test AutomationHow to Guarantee Continuous Value from your Test Automation
How to Guarantee Continuous Value from your Test Automation
 
QA metrics in Agile (GUIDE)
QA metrics in Agile (GUIDE)QA metrics in Agile (GUIDE)
QA metrics in Agile (GUIDE)
 
Quality at the speed of digital
Quality   at the speed of digitalQuality   at the speed of digital
Quality at the speed of digital
 
Creating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran KinsbrunerCreating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran Kinsbruner
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software Quality
 
Keeping Your Continuous Test Automation Continuously Valuable
Keeping Your Continuous Test Automation Continuously ValuableKeeping Your Continuous Test Automation Continuously Valuable
Keeping Your Continuous Test Automation Continuously Valuable
 
Neotys PAC 2018 - Gayatree Nalwadad
Neotys PAC 2018 - Gayatree NalwadadNeotys PAC 2018 - Gayatree Nalwadad
Neotys PAC 2018 - Gayatree Nalwadad
 
Best Practices In Load And Stress Testing Cmg Seminar[1]
Best Practices In Load And Stress Testing Cmg Seminar[1]Best Practices In Load And Stress Testing Cmg Seminar[1]
Best Practices In Load And Stress Testing Cmg Seminar[1]
 
(Technologies) AI, Machine Learning, Predictive Analytics, IIOT, Cloud,Web-fr...
(Technologies) AI, Machine Learning, Predictive Analytics, IIOT, Cloud,Web-fr...(Technologies) AI, Machine Learning, Predictive Analytics, IIOT, Cloud,Web-fr...
(Technologies) AI, Machine Learning, Predictive Analytics, IIOT, Cloud,Web-fr...
 
Building functional Quality Gates with ReportPortal
Building functional Quality Gates with ReportPortalBuilding functional Quality Gates with ReportPortal
Building functional Quality Gates with ReportPortal
 
Introducing automated GUI testing and observing its benefits: an industrial c...
Introducing automated GUI testing and observing its benefits: an industrial c...Introducing automated GUI testing and observing its benefits: an industrial c...
Introducing automated GUI testing and observing its benefits: an industrial c...
 
quality-assurance_best_practice_guide_4 0
quality-assurance_best_practice_guide_4 0quality-assurance_best_practice_guide_4 0
quality-assurance_best_practice_guide_4 0
 
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
 
Automation Deployments and Gudielines.pptx
Automation Deployments and Gudielines.pptxAutomation Deployments and Gudielines.pptx
Automation Deployments and Gudielines.pptx
 
Choosing right-automation-tool
Choosing right-automation-toolChoosing right-automation-tool
Choosing right-automation-tool
 
User Acceptance Testing in the Testing Center of Excellence
User Acceptance Testing in the Testing Center of ExcellenceUser Acceptance Testing in the Testing Center of Excellence
User Acceptance Testing in the Testing Center of Excellence
 
How to Clean Up Your Continuous Testing Suites for Web & Mobile
How to Clean Up Your Continuous Testing Suites for Web & MobileHow to Clean Up Your Continuous Testing Suites for Web & Mobile
How to Clean Up Your Continuous Testing Suites for Web & Mobile
 
TEA Presentation V 0.3
TEA Presentation V 0.3TEA Presentation V 0.3
TEA Presentation V 0.3
 
Zero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOpsZero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOps
 
Software Test Engineer with 3.6 years of experience
Software Test Engineer with 3.6 years of experienceSoftware Test Engineer with 3.6 years of experience
Software Test Engineer with 3.6 years of experience
 

More from FIWARE

Behm_Herne_NeMo_akt.pptx
Behm_Herne_NeMo_akt.pptxBehm_Herne_NeMo_akt.pptx
Behm_Herne_NeMo_akt.pptx
FIWARE
 
Katharina Hogrebe Herne Digital Days.pdf
 Katharina Hogrebe Herne Digital Days.pdf Katharina Hogrebe Herne Digital Days.pdf
Katharina Hogrebe Herne Digital Days.pdf
FIWARE
 
Christoph Mertens_IDSA_Introduction to Data Spaces.pptx
Christoph Mertens_IDSA_Introduction to Data Spaces.pptxChristoph Mertens_IDSA_Introduction to Data Spaces.pptx
Christoph Mertens_IDSA_Introduction to Data Spaces.pptx
FIWARE
 
Behm_Herne_NeMo.pptx
Behm_Herne_NeMo.pptxBehm_Herne_NeMo.pptx
Behm_Herne_NeMo.pptx
FIWARE
 
Evangelists + iHubs Promo Slides.pptx
Evangelists + iHubs Promo Slides.pptxEvangelists + iHubs Promo Slides.pptx
Evangelists + iHubs Promo Slides.pptx
FIWARE
 
Lukas Künzel Smart City Operating System.pptx
Lukas Künzel Smart City Operating System.pptxLukas Künzel Smart City Operating System.pptx
Lukas Künzel Smart City Operating System.pptx
FIWARE
 
Pierre Golz Der Transformationsprozess im Konzern Stadt.pptx
Pierre Golz Der Transformationsprozess im Konzern Stadt.pptxPierre Golz Der Transformationsprozess im Konzern Stadt.pptx
Pierre Golz Der Transformationsprozess im Konzern Stadt.pptx
FIWARE
 
Dennis Wendland_The i4Trust Collaboration Programme.pptx
Dennis Wendland_The i4Trust Collaboration Programme.pptxDennis Wendland_The i4Trust Collaboration Programme.pptx
Dennis Wendland_The i4Trust Collaboration Programme.pptx
FIWARE
 
Ulrich Ahle_FIWARE.pptx
Ulrich Ahle_FIWARE.pptxUlrich Ahle_FIWARE.pptx
Ulrich Ahle_FIWARE.pptx
FIWARE
 
Aleksandar Vrglevski _FIWARE DACH_OSIH.pptx
Aleksandar Vrglevski _FIWARE DACH_OSIH.pptxAleksandar Vrglevski _FIWARE DACH_OSIH.pptx
Aleksandar Vrglevski _FIWARE DACH_OSIH.pptx
FIWARE
 
Water Quality - Lukas Kuenzel.pdf
Water Quality - Lukas Kuenzel.pdfWater Quality - Lukas Kuenzel.pdf
Water Quality - Lukas Kuenzel.pdf
FIWARE
 
Cameron Brooks_FGS23_FIWARE Summit_Keynote_Cameron.pptx
Cameron Brooks_FGS23_FIWARE Summit_Keynote_Cameron.pptxCameron Brooks_FGS23_FIWARE Summit_Keynote_Cameron.pptx
Cameron Brooks_FGS23_FIWARE Summit_Keynote_Cameron.pptx
FIWARE
 
FiWareSummit.msGIS-Data-to-Value.2023.06.12.pptx
FiWareSummit.msGIS-Data-to-Value.2023.06.12.pptxFiWareSummit.msGIS-Data-to-Value.2023.06.12.pptx
FiWareSummit.msGIS-Data-to-Value.2023.06.12.pptx
FIWARE
 
Boris Otto_FGS2023_Opening- EU Innovations from Data_PUB_V1_BOt.pptx
Boris Otto_FGS2023_Opening- EU Innovations from Data_PUB_V1_BOt.pptxBoris Otto_FGS2023_Opening- EU Innovations from Data_PUB_V1_BOt.pptx
Boris Otto_FGS2023_Opening- EU Innovations from Data_PUB_V1_BOt.pptx
FIWARE
 
Bjoern de Vidts_FGS23_Opening_athumi - bjord de vidts - personal data spaces....
Bjoern de Vidts_FGS23_Opening_athumi - bjord de vidts - personal data spaces....Bjoern de Vidts_FGS23_Opening_athumi - bjord de vidts - personal data spaces....
Bjoern de Vidts_FGS23_Opening_athumi - bjord de vidts - personal data spaces....
FIWARE
 
Abdulrahman Ibrahim_FGS23 Opening - Abdulrahman Ibrahim.pdf
Abdulrahman Ibrahim_FGS23 Opening - Abdulrahman Ibrahim.pdfAbdulrahman Ibrahim_FGS23 Opening - Abdulrahman Ibrahim.pdf
Abdulrahman Ibrahim_FGS23 Opening - Abdulrahman Ibrahim.pdf
FIWARE
 
FGS2023_Opening_Red Hat Keynote Andrea Battaglia.pdf
FGS2023_Opening_Red Hat Keynote Andrea Battaglia.pdfFGS2023_Opening_Red Hat Keynote Andrea Battaglia.pdf
FGS2023_Opening_Red Hat Keynote Andrea Battaglia.pdf
FIWARE
 
HTAG_Skalierung_Plattform_lokal_final_versand.pptx
HTAG_Skalierung_Plattform_lokal_final_versand.pptxHTAG_Skalierung_Plattform_lokal_final_versand.pptx
HTAG_Skalierung_Plattform_lokal_final_versand.pptx
FIWARE
 
WE_LoRaWAN _ IoT.pptx
WE_LoRaWAN  _ IoT.pptxWE_LoRaWAN  _ IoT.pptx
WE_LoRaWAN _ IoT.pptx
FIWARE
 
EU Opp_Clara Pezuela - German chapter.pptx
EU Opp_Clara Pezuela - German chapter.pptxEU Opp_Clara Pezuela - German chapter.pptx
EU Opp_Clara Pezuela - German chapter.pptx
FIWARE
 

More from FIWARE (20)

Behm_Herne_NeMo_akt.pptx
Behm_Herne_NeMo_akt.pptxBehm_Herne_NeMo_akt.pptx
Behm_Herne_NeMo_akt.pptx
 
Katharina Hogrebe Herne Digital Days.pdf
 Katharina Hogrebe Herne Digital Days.pdf Katharina Hogrebe Herne Digital Days.pdf
Katharina Hogrebe Herne Digital Days.pdf
 
Christoph Mertens_IDSA_Introduction to Data Spaces.pptx
Christoph Mertens_IDSA_Introduction to Data Spaces.pptxChristoph Mertens_IDSA_Introduction to Data Spaces.pptx
Christoph Mertens_IDSA_Introduction to Data Spaces.pptx
 
Behm_Herne_NeMo.pptx
Behm_Herne_NeMo.pptxBehm_Herne_NeMo.pptx
Behm_Herne_NeMo.pptx
 
Evangelists + iHubs Promo Slides.pptx
Evangelists + iHubs Promo Slides.pptxEvangelists + iHubs Promo Slides.pptx
Evangelists + iHubs Promo Slides.pptx
 
Lukas Künzel Smart City Operating System.pptx
Lukas Künzel Smart City Operating System.pptxLukas Künzel Smart City Operating System.pptx
Lukas Künzel Smart City Operating System.pptx
 
Pierre Golz Der Transformationsprozess im Konzern Stadt.pptx
Pierre Golz Der Transformationsprozess im Konzern Stadt.pptxPierre Golz Der Transformationsprozess im Konzern Stadt.pptx
Pierre Golz Der Transformationsprozess im Konzern Stadt.pptx
 
Dennis Wendland_The i4Trust Collaboration Programme.pptx
Dennis Wendland_The i4Trust Collaboration Programme.pptxDennis Wendland_The i4Trust Collaboration Programme.pptx
Dennis Wendland_The i4Trust Collaboration Programme.pptx
 
Ulrich Ahle_FIWARE.pptx
Ulrich Ahle_FIWARE.pptxUlrich Ahle_FIWARE.pptx
Ulrich Ahle_FIWARE.pptx
 
Aleksandar Vrglevski _FIWARE DACH_OSIH.pptx
Aleksandar Vrglevski _FIWARE DACH_OSIH.pptxAleksandar Vrglevski _FIWARE DACH_OSIH.pptx
Aleksandar Vrglevski _FIWARE DACH_OSIH.pptx
 
Water Quality - Lukas Kuenzel.pdf
Water Quality - Lukas Kuenzel.pdfWater Quality - Lukas Kuenzel.pdf
Water Quality - Lukas Kuenzel.pdf
 
Cameron Brooks_FGS23_FIWARE Summit_Keynote_Cameron.pptx
Cameron Brooks_FGS23_FIWARE Summit_Keynote_Cameron.pptxCameron Brooks_FGS23_FIWARE Summit_Keynote_Cameron.pptx
Cameron Brooks_FGS23_FIWARE Summit_Keynote_Cameron.pptx
 
FiWareSummit.msGIS-Data-to-Value.2023.06.12.pptx
FiWareSummit.msGIS-Data-to-Value.2023.06.12.pptxFiWareSummit.msGIS-Data-to-Value.2023.06.12.pptx
FiWareSummit.msGIS-Data-to-Value.2023.06.12.pptx
 
Boris Otto_FGS2023_Opening- EU Innovations from Data_PUB_V1_BOt.pptx
Boris Otto_FGS2023_Opening- EU Innovations from Data_PUB_V1_BOt.pptxBoris Otto_FGS2023_Opening- EU Innovations from Data_PUB_V1_BOt.pptx
Boris Otto_FGS2023_Opening- EU Innovations from Data_PUB_V1_BOt.pptx
 
Bjoern de Vidts_FGS23_Opening_athumi - bjord de vidts - personal data spaces....
Bjoern de Vidts_FGS23_Opening_athumi - bjord de vidts - personal data spaces....Bjoern de Vidts_FGS23_Opening_athumi - bjord de vidts - personal data spaces....
Bjoern de Vidts_FGS23_Opening_athumi - bjord de vidts - personal data spaces....
 
Abdulrahman Ibrahim_FGS23 Opening - Abdulrahman Ibrahim.pdf
Abdulrahman Ibrahim_FGS23 Opening - Abdulrahman Ibrahim.pdfAbdulrahman Ibrahim_FGS23 Opening - Abdulrahman Ibrahim.pdf
Abdulrahman Ibrahim_FGS23 Opening - Abdulrahman Ibrahim.pdf
 
FGS2023_Opening_Red Hat Keynote Andrea Battaglia.pdf
FGS2023_Opening_Red Hat Keynote Andrea Battaglia.pdfFGS2023_Opening_Red Hat Keynote Andrea Battaglia.pdf
FGS2023_Opening_Red Hat Keynote Andrea Battaglia.pdf
 
HTAG_Skalierung_Plattform_lokal_final_versand.pptx
HTAG_Skalierung_Plattform_lokal_final_versand.pptxHTAG_Skalierung_Plattform_lokal_final_versand.pptx
HTAG_Skalierung_Plattform_lokal_final_versand.pptx
 
WE_LoRaWAN _ IoT.pptx
WE_LoRaWAN  _ IoT.pptxWE_LoRaWAN  _ IoT.pptx
WE_LoRaWAN _ IoT.pptx
 
EU Opp_Clara Pezuela - German chapter.pptx
EU Opp_Clara Pezuela - German chapter.pptxEU Opp_Clara Pezuela - German chapter.pptx
EU Opp_Clara Pezuela - German chapter.pptx
 

Recently uploaded

[HUN][hackersuli] Red Teaming alapok 2024
[HUN][hackersuli] Red Teaming alapok 2024[HUN][hackersuli] Red Teaming alapok 2024
[HUN][hackersuli] Red Teaming alapok 2024
hackersuli
 
学位认证网(DU毕业证)迪肯大学毕业证成绩单一比一原版制作
学位认证网(DU毕业证)迪肯大学毕业证成绩单一比一原版制作学位认证网(DU毕业证)迪肯大学毕业证成绩单一比一原版制作
学位认证网(DU毕业证)迪肯大学毕业证成绩单一比一原版制作
zyfovom
 
一比一原版(USYD毕业证)悉尼大学毕业证如何办理
一比一原版(USYD毕业证)悉尼大学毕业证如何办理一比一原版(USYD毕业证)悉尼大学毕业证如何办理
一比一原版(USYD毕业证)悉尼大学毕业证如何办理
k4ncd0z
 
成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理
成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理
成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理
ysasp1
 
留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理
留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理
留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理
uehowe
 
重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理
重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理
重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理
vmemo1
 
假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理
假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理
假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理
cuobya
 
制作原版1:1(Monash毕业证)莫纳什大学毕业证成绩单办理假
制作原版1:1(Monash毕业证)莫纳什大学毕业证成绩单办理假制作原版1:1(Monash毕业证)莫纳什大学毕业证成绩单办理假
制作原版1:1(Monash毕业证)莫纳什大学毕业证成绩单办理假
ukwwuq
 
HijackLoader Evolution: Interactive Process Hollowing
HijackLoader Evolution: Interactive Process HollowingHijackLoader Evolution: Interactive Process Hollowing
HijackLoader Evolution: Interactive Process Hollowing
Donato Onofri
 
快速办理(新加坡SMU毕业证书)新加坡管理大学毕业证文凭证书一模一样
快速办理(新加坡SMU毕业证书)新加坡管理大学毕业证文凭证书一模一样快速办理(新加坡SMU毕业证书)新加坡管理大学毕业证文凭证书一模一样
快速办理(新加坡SMU毕业证书)新加坡管理大学毕业证文凭证书一模一样
3a0sd7z3
 
7 Best Cloud Hosting Services to Try Out in 2024
7 Best Cloud Hosting Services to Try Out in 20247 Best Cloud Hosting Services to Try Out in 2024
7 Best Cloud Hosting Services to Try Out in 2024
Danica Gill
 
manuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaal
manuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaalmanuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaal
manuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaal
wolfsoftcompanyco
 
留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理
留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理
留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理
bseovas
 
Search Result Showing My Post is Now Buried
Search Result Showing My Post is Now BuriedSearch Result Showing My Post is Now Buried
Search Result Showing My Post is Now Buried
Trish Parr
 
国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理
国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理
国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理
zoowe
 
办理毕业证(NYU毕业证)纽约大学毕业证成绩单官方原版办理
办理毕业证(NYU毕业证)纽约大学毕业证成绩单官方原版办理办理毕业证(NYU毕业证)纽约大学毕业证成绩单官方原版办理
办理毕业证(NYU毕业证)纽约大学毕业证成绩单官方原版办理
uehowe
 
Azure EA Sponsorship - Customer Guide.pdf
Azure EA Sponsorship - Customer Guide.pdfAzure EA Sponsorship - Customer Guide.pdf
Azure EA Sponsorship - Customer Guide.pdf
AanSulistiyo
 
不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作
不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作
不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作
bseovas
 
办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理
办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理
办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理
uehowe
 
Should Repositories Participate in the Fediverse?
Should Repositories Participate in the Fediverse?Should Repositories Participate in the Fediverse?
Should Repositories Participate in the Fediverse?
Paul Walk
 

Recently uploaded (20)

[HUN][hackersuli] Red Teaming alapok 2024
[HUN][hackersuli] Red Teaming alapok 2024[HUN][hackersuli] Red Teaming alapok 2024
[HUN][hackersuli] Red Teaming alapok 2024
 
学位认证网(DU毕业证)迪肯大学毕业证成绩单一比一原版制作
学位认证网(DU毕业证)迪肯大学毕业证成绩单一比一原版制作学位认证网(DU毕业证)迪肯大学毕业证成绩单一比一原版制作
学位认证网(DU毕业证)迪肯大学毕业证成绩单一比一原版制作
 
一比一原版(USYD毕业证)悉尼大学毕业证如何办理
一比一原版(USYD毕业证)悉尼大学毕业证如何办理一比一原版(USYD毕业证)悉尼大学毕业证如何办理
一比一原版(USYD毕业证)悉尼大学毕业证如何办理
 
成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理
成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理
成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理
 
留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理
留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理
留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理
 
重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理
重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理
重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理
 
假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理
假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理
假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理
 
制作原版1:1(Monash毕业证)莫纳什大学毕业证成绩单办理假
制作原版1:1(Monash毕业证)莫纳什大学毕业证成绩单办理假制作原版1:1(Monash毕业证)莫纳什大学毕业证成绩单办理假
制作原版1:1(Monash毕业证)莫纳什大学毕业证成绩单办理假
 
HijackLoader Evolution: Interactive Process Hollowing
HijackLoader Evolution: Interactive Process HollowingHijackLoader Evolution: Interactive Process Hollowing
HijackLoader Evolution: Interactive Process Hollowing
 
快速办理(新加坡SMU毕业证书)新加坡管理大学毕业证文凭证书一模一样
快速办理(新加坡SMU毕业证书)新加坡管理大学毕业证文凭证书一模一样快速办理(新加坡SMU毕业证书)新加坡管理大学毕业证文凭证书一模一样
快速办理(新加坡SMU毕业证书)新加坡管理大学毕业证文凭证书一模一样
 
7 Best Cloud Hosting Services to Try Out in 2024
7 Best Cloud Hosting Services to Try Out in 20247 Best Cloud Hosting Services to Try Out in 2024
7 Best Cloud Hosting Services to Try Out in 2024
 
manuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaal
manuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaalmanuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaal
manuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaal
 
留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理
留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理
留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理
 
Search Result Showing My Post is Now Buried
Search Result Showing My Post is Now BuriedSearch Result Showing My Post is Now Buried
Search Result Showing My Post is Now Buried
 
国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理
国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理
国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理
 
办理毕业证(NYU毕业证)纽约大学毕业证成绩单官方原版办理
办理毕业证(NYU毕业证)纽约大学毕业证成绩单官方原版办理办理毕业证(NYU毕业证)纽约大学毕业证成绩单官方原版办理
办理毕业证(NYU毕业证)纽约大学毕业证成绩单官方原版办理
 
Azure EA Sponsorship - Customer Guide.pdf
Azure EA Sponsorship - Customer Guide.pdfAzure EA Sponsorship - Customer Guide.pdf
Azure EA Sponsorship - Customer Guide.pdf
 
不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作
不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作
不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作
 
办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理
办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理
办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理
 
Should Repositories Participate in the Fediverse?
Should Repositories Participate in the Fediverse?Should Repositories Participate in the Fediverse?
Should Repositories Participate in the Fediverse?
 

Why Should I Trust on FIWARE?

  • 1. Why should I trust in FIWARE? Quality Assurance in FIWARE 0 Clara Pezuela – Atos Málaga, 15 December 2016
  • 2. Table of contents  The motivation: why QA is needed in FIWARE?  The purpose: what does it mean Quality Assurance in FIWARE?  The team: who was doing the QA?  The methodology: how was the testing process?  The tests: what was tested and which were the obtained results?  The assessment: what the conclusions of performed tests?  The labelling: how to rapidly check the GEs quality?  The publication: how can I find the QA work and results?  The future: how QA task will evolve?  Why should I trust in FIWARE?  Q&A (10’) 1
  • 3. The motivation  FIWARE is rapidly moving from experimental to production environments in which the platform must scale up in reliable and real workload conditions • FIWARE GEs must work at an adequate quality, reliability and performance level  Support FIWARE users with high-quality support for installation, configuration and operation of FIWARE technology • Improving the FIWARE user experience in general  Practical approach with focus on improving quality and transparency • Light and agile methodology very operative 2
  • 4. The purpose (I)  To test FIWARE GEs, addressing functional and non-functional testing 3
  • 5. The purpose (II)  To test FIWARE GEs, addressing functional testing  Curation of GEs documentation (functional testing): • to check the completeness, consistency, soundness and usability of documentation for specification, implementation and installation of the Ges • to test the training efficiency by analyzing the Academy courses  Verification of the GE specification (functional testing): • developing the appropriate test cases to assess if the GEs implementation corresponds to what is defined in the specification. • validating the APIs • integration tests of common bundles 4
  • 6. The purpose (III)  To test FIWARE GEs, addressing non-functional testing  Assessment of performance, stability and scalability (non- functional testing): • Defining and executing test scenarios to find the limits of a GE • Comparing with reference values of usual execution • Replicating environments of intensive workload 5
  • 7. The QA team  Clara Pezuela, Atos, task coordinator  Miguel A. Ramirez, Atos, non-functional testing  Carlos Lucena, Atos, non-functional testing  Riccardo Zanetti, ENG, non-functional testing  Andrea La Porta, ENG, functional testing  Annamaria Cappa, ENG, functional testing  Carmen Mac Williams, GAR, research testing  Franck Le Gall, EGM, research on testing  Peter Murynshkin, Fraunhofer, research on testing 6  Professional units of testing in Atos and Engineering  Research groups especialized in testing methods (EGM, Fraunhofer, Grassroot)
  • 8. The methodology: for functional testing 7 Bundle Testing APIs verification Documentatio n Testing Bug Tracker system (Jira) bug bug bug 28 GEs from Catalogue Training courses testing recommendation 8 GEs most used GE owners
  • 9. The methodology: for stress testing 8 Identity Management – KeyRock Authorization PDP – AuthZForce PEP Proxy – Wilma Context Broker - Orion Complex Event Processing (CEP) – Proton Stream Oriented – Kurento Backend Device Management – IDAS IoT Broker – Aeron IoT Data Edge Consolidation – Cepheus Policy Manager - Bosun
  • 10. The results: curation of documentation and verification  Live dashboard collects and maintains the assessment information  Near 95% of the high priority GEs has passed successfully the documentation and verification tests.  The medium and low priority GEs are around 80% of success but they are working on solving the issues.  In average, more than 90% of GEs have passed the tests 9 Data obtained in September 2016
  • 11. The results: training courses  32 courses were tested  6 were Good (18%)  8 were To improve (25%)  18 were Sufficient (56%) 10 Data obtained in September 2016
  • 12. The results: stress testing (GEs) 11 Data obtained in September 2016 GE name Reliability (errors rate) Performance in stress condition (num requests, response time, bit rate) Stability (crashes) IDAS 0% 140 updates /second, 200 threads No crash IoT Broker 44% for SubscribeContext 30 requests/s generated by 16 concurrent threads with an average response time of 468 ms Crashed AuthZForce 0% AV RT around 11 ms; 4376 requests per second No crash KeyRock 0 % Authorisation max load with AV RT<1s= 220 requests/s Authentication max load with AV RT<1s=22 requests/s No crash Wilma 0% up to 839 requests/sec No crash Orion 0% 5160 attribute updates/sec Crashed Proton 0,39% 500 requests/sec; 950 creating definitions/sec Crashed Bosun 3,5% 160 simultaneous threads , 26 HTTP responses/sec for Cloto and 30 for Facts Crashed Kurento 0% Good for less than 50 simultaneuos users and low quality video No crash Cepheus 42% for Broker Test 100 requests/sec Crashed
  • 13. The results: stress testing (bundles) 12 Data obtained in September 2016 Bundle Reliability (errors rate) Performance in stress condition (num requests, response time) Stability (crashes) AuthZForce+Wilma+KeyRock 0% 99 requests/second No crash Orion+IDAS+Cygnus 0% 280 requests/second/ 300 Threads No crash
  • 14. The results: research activities  Model based testing (MBT) for generating automating tests to verify the compliance of FIWARE GEs APIs with NGSI standard  Continous integration testing (some trials)  Automatic online documentation testing (Catalogue) • Require two sets of metrics: □ derived from the Compliance Guide Catalogue (optimal text length, context relevant concepts,…) □ common language metrics to ensure good style and legibility of online documentation (average sentence length, lexical complexity,…) 13 GE Executed tests Failed test NGSI compliance Orion 30 3 (10%) High IoTBroker 30 9 (30%) Medium-high Cepheus 30 21 (70%) Light
  • 15. The assessment (I): overall work  Hard starting… • Pressure in setting up the task very fast for public events • Business teams never worked before together • Heterogeneity of the GEs, different testing environments settings • Lack of reference values and test cases in some GEs  But progressively improving… • GE owners collaboration and responsiveness increased • Better obtained results in consecutive releases • Homogeneity in reporting was increased • Joint labelling process for functional and non-functional testing 14
  • 16. The assessment (II): GEs quality status  Documentation testing • Most of GEs manual allows installing the components • But the documentation is not always clear, readily and available from the links.  APIs testing • The installed software package implements the APIs declared into Open Specification. • The main failures concern the missing information on documentation.  Bundle Integration tests • Simulation of a parking sensors scenario • Using Orion, Wilma, CEP, IDAS, AuthZForce, SpagoBI, KeyRock • 4 out of 22 tested cases failed  Academy courses testing • 60% of the academy courses are sufficient • Many tips were reported on Jira tool to help the GE owner improving the training. 15
  • 17. The assessment (III): GEs quality status 16  In scalability, all GEs behave very good except one  In performance, 4 out of 10 GEs are providing values that could be improved in next releases  In stability, half of the GEs are not managing properly the memory or CPU resources
  • 18. The labelling (I)  Quick at a glance mechanism to check the assessed GEs’ quality  Following the EU energy label system  Sub-label per each tested aspect (usability, reliability, efficiency, scalability, performance and stability)  Global label as average of all sub-labels  Initial pilot with 10 GEs 17 Identity Management – KeyRock Authorization PDP – AuthZForce PEP Proxy – Wilma Context Broker - Orion Complex Event Processing (CEP) – Proton Stream Oriented – Kurento Backend Device Management – IDAS IoT Broker – Aeron IoT Data Edge Consolidation – Cepheus Policy Manager - Bosun Labels assigned in September 2016
  • 19. The labelling: meaning of values 18 how complete is the GE documentation? how sound is the GE documentation? how many GE APIs were failed over the tested ones? how many bugs in average by priority have been detected? how long does GE take to answer the issues? how long does GE take to fix the issues? Depend on GE type: • how many updated attributes/second? • how many complex events/second? • which bit rate per user is acceptable? • how many requests/second? how well are memory/CPU managed? how the response time is growing as long as number of concurrent threads is growing?
  • 20. The labelling (II): meaning of labels  Qualitative and quantitative values (ranges)  Same metrics for all GEs, except for performance, which depends on type of app 19
  • 21. The labelling (III): resulting labels 20 Labels assigned in September 2016
  • 22. The publication  Public document: https://www.fiware.org/wp- content/uploads/2016/10/QA_publ ic_document.pdf  QA wiki page: https://forge.fiware.org/plugins/me diawiki/wiki/fiware/index.php/FIW ARE_QA_Activities  Brochure  Blog post: https://www.fiware.org/2016/09/20 /assessing-fiware-ges-quality/ 21
  • 23. The future  Upon the continuation of presented activities…  Enlarge the set of tests to be more complete and extensive to all GEs and bundles  Automate as much as possible the tests and the labelling process  Integration of tests with FIWARE development process 22
  • 24. Why should I trust in FIWARE?  Because…  we are continously testing all GEs • including documentation, APIs and performance among others  we are publishing all the performed tests and obtained results • in a transparent and open way (GitHub, Docman) • guidelines for replicating the tests  we are providing recommendations to the GE owners • to improve their functionality and behaviour 23