The document discusses Grid-QCM, a quality certification model for grid computing. It aims to automate quality assurance processes to reduce costs and effort for organizations. The model defines metrics for static analysis, coding style, testing, and standards compliance. It outputs a final score and certification that objects, not entire processes or organizations. The model is being validated through the ETICS project and aims to standardize quality assurance for grid computing.
Chapter 7 of the famous saga "the DO-254 for Dummies" from James BEZAMAT director of DMAP
subject : IP and verification process
More : dmap.fr
contact : contact@dmap.fr
For informative discussions on software testing please see. http://forum.360logica.com/
Please see description below
360logica is an independent software and application testing services company which provides wide range of testing solutions to our partners based on domain, technology and business solutions including software product testing, quality assurance of software, automation in testing, finance testing, mobile software and applications testing. 360logica offers full range of software testing which include Software Product Testing, Test Automation, Performance Test Engineering, Finance Application Testing, Healthcare App Testing and SaaS Product Testing. We work closely with our partners to tailor a program of support which meets their needs and ensures our systems achieve the quality levels demanded by our partners, especially in financial testing
Chapter 7 of the famous saga "the DO-254 for Dummies" from James BEZAMAT director of DMAP
subject : IP and verification process
More : dmap.fr
contact : contact@dmap.fr
For informative discussions on software testing please see. http://forum.360logica.com/
Please see description below
360logica is an independent software and application testing services company which provides wide range of testing solutions to our partners based on domain, technology and business solutions including software product testing, quality assurance of software, automation in testing, finance testing, mobile software and applications testing. 360logica offers full range of software testing which include Software Product Testing, Test Automation, Performance Test Engineering, Finance Application Testing, Healthcare App Testing and SaaS Product Testing. We work closely with our partners to tailor a program of support which meets their needs and ensures our systems achieve the quality levels demanded by our partners, especially in financial testing
Reducing Cycle Time for iDEN Releases – A Development and Test PerspectivePraveen Srivastava
iDEN system releases have been taking longer time from M8 (System Requirements allocated and project scope is baseline) to M3 (Ready For Controlled Introduction) when it is first commercially deployed. For a typical iDEN system release, the duration between M8 and M3 is close to 18 months. The current releases are posing new challenges to product development and requires comparatively shorter cycle time. This paper talks about such an iDEN release which was done and ready for deployment in less than 9 months. This paper analyzes the techniques and strategy used by development and test team to achieve this and proposes techniques & strategies which can be used by future iDEN releases.
Combining requirements engineering and testing in agile. SYSQA BV
Agile Testing Days Berlin, november 2012
Projects that use agile have small, multidisciplinary teams. When every discipline has its own specialist in the team, the team becomes bigger and bigger leading to more communication, coordination and more need for documentation. Combining programming and testing is not a wise decision but combining requirements engineering and testing is very well possible. It even turns out that a lot of communication, documentation and coordination is not necessary. So a lot of time and effort can be saved. During his presentation Jan Jaap tells why testers are excellent requirements engineers (and vice versa) and what the advantages of combining requirements engineering and testing can be. He also addresses what testers should do to get this combined role. With agile becoming more and more popular this can be a possible future for testers.
The idea of combining requirements engineering and testing started with a vision. By now we have enough practical experience to show that is actually works! During the presentation Jan Jaap shares vision and practical experiences.
CODEX Validation Group is a consulting company with broad experience in the cGMP, compliance, automation, and validation for the Pharmaceutical, Biotechnology and Medical Device industries committed to follow the highest ethical standards as we work with our customers.
Calibration Excellence: Intelligent Application of Smart Technology is Just t...Emerson Exchange
Presented by GSK's Don Brady and Emerson's Richard Barnes at the 2011 Emerson Exchange conference in Nashville, TN USA.
Abstract: The project for an innovative integrated PlantWeb asset and calibration management solution went live in Nov 2010 at GSK’s Cork facility, a primary API production plant. This workshop presents GSK’s Calibration Excellence program and the significant improvements in business operations and management of regulatory compliance that it is delivering in support of GSK’ s world class manufacturing program. This system forms part of the GSK global engineering strategy.
The author has received the GSK Excellence Recognition Award in acknowledgement of the importance and success of this project.
Overview of DO-254: Design Assurance Guidance For Airborne Electronic HardwareOak Systems
To provide design assurance guidance for the development of airborne electronic hardware such that it safely performs its intended function, in its specified environments.
Understanding DO-178: Importance and How It Affects Your CompanyAversan Inc.
Learn DO-178: Why is it important? How can it affect your company? These questions and more will be answered in this presentation, including information regarding the purpose of DO-178, Design Assurance Levels (DAL), objectives, and integral processes.
Questions? Email bd@aversan.com for more information.
Reducing Cycle Time for iDEN Releases – A Development and Test PerspectivePraveen Srivastava
iDEN system releases have been taking longer time from M8 (System Requirements allocated and project scope is baseline) to M3 (Ready For Controlled Introduction) when it is first commercially deployed. For a typical iDEN system release, the duration between M8 and M3 is close to 18 months. The current releases are posing new challenges to product development and requires comparatively shorter cycle time. This paper talks about such an iDEN release which was done and ready for deployment in less than 9 months. This paper analyzes the techniques and strategy used by development and test team to achieve this and proposes techniques & strategies which can be used by future iDEN releases.
Combining requirements engineering and testing in agile. SYSQA BV
Agile Testing Days Berlin, november 2012
Projects that use agile have small, multidisciplinary teams. When every discipline has its own specialist in the team, the team becomes bigger and bigger leading to more communication, coordination and more need for documentation. Combining programming and testing is not a wise decision but combining requirements engineering and testing is very well possible. It even turns out that a lot of communication, documentation and coordination is not necessary. So a lot of time and effort can be saved. During his presentation Jan Jaap tells why testers are excellent requirements engineers (and vice versa) and what the advantages of combining requirements engineering and testing can be. He also addresses what testers should do to get this combined role. With agile becoming more and more popular this can be a possible future for testers.
The idea of combining requirements engineering and testing started with a vision. By now we have enough practical experience to show that is actually works! During the presentation Jan Jaap shares vision and practical experiences.
CODEX Validation Group is a consulting company with broad experience in the cGMP, compliance, automation, and validation for the Pharmaceutical, Biotechnology and Medical Device industries committed to follow the highest ethical standards as we work with our customers.
Calibration Excellence: Intelligent Application of Smart Technology is Just t...Emerson Exchange
Presented by GSK's Don Brady and Emerson's Richard Barnes at the 2011 Emerson Exchange conference in Nashville, TN USA.
Abstract: The project for an innovative integrated PlantWeb asset and calibration management solution went live in Nov 2010 at GSK’s Cork facility, a primary API production plant. This workshop presents GSK’s Calibration Excellence program and the significant improvements in business operations and management of regulatory compliance that it is delivering in support of GSK’ s world class manufacturing program. This system forms part of the GSK global engineering strategy.
The author has received the GSK Excellence Recognition Award in acknowledgement of the importance and success of this project.
Overview of DO-254: Design Assurance Guidance For Airborne Electronic HardwareOak Systems
To provide design assurance guidance for the development of airborne electronic hardware such that it safely performs its intended function, in its specified environments.
Understanding DO-178: Importance and How It Affects Your CompanyAversan Inc.
Learn DO-178: Why is it important? How can it affect your company? These questions and more will be answered in this presentation, including information regarding the purpose of DO-178, Design Assurance Levels (DAL), objectives, and integral processes.
Questions? Email bd@aversan.com for more information.
P2Cinfotech is one of the leading, Online IT Training facilities and Job Consultant, spread all over the world. We have successfully conducted online classes on various Software Technologies that are currently in Demand. To name a few, we provide quality online training for QA, QTP, Manual Testing, HP LoadRunner, BA, Java Technologies.
Unique Features of P2Cinfotech:
1. All online software Training Batches will Be handled by Real time working Professionals only.
2. Live online training like Real time face to face, Instructor ? student interaction.
3. Good online training virtual class room environment.
4. Special Exercises and Assignments to make you self-confident on your course subject.
5. Interactive Sessions to update students with latest Developments on the particular course.
6. Flexible Batch Timings and proper timetable.
7. Affordable, decent and Flexible fee structure.
8. Extended Technical assistance even after completion of the course.
9. 100% Job Assistance and Guidance.
Courses What we cover:
Quality Assurance
Business Analsis
QTp
JAVA
Apps Devlepoment Training
Register for Free DEMO:
www.p2cinfotech.com p2cinfotech@gmail.com +1-732-546-3607 (USA)
Quality in a Square. K8s-native Quality Assurance of Microservices with TestkubeQAware GmbH
Jfokus 2023, Februar 2023, Stockholm, Schweden, Mario-Leander Reimer (@LeanderReimer, CTO @QAware).
== Dokument bitte herunterladen, falls unscharf! Please download slides if blurred! ==
Continuous delivery is everywhere. Really?! Many teams still struggle to deliver well-tested product increments on a regular basis. Usually with the same old excuse: the (non)-functional tests are too complex and too expensive to implement thoroughly. But exactly the opposite is the case! In this talk, we briefly review the importance of early and regular testing of cloud-native applications and explain why monolithic CI pipelines are a dead end. We then show how easy it is to run integration, performance, security and acceptance tests continuously using Testkube directly on your Kubernetes cluster, fully integrated with a GitOps approach.
JavaLand 2023, März 2023, Mario-Leander Reimer(@LeanderReimer, Principal Software Architect bei QAware).
== Dokument bitte herunterladen, falls unscharf! Please download slides if blurred! ==
Continuous Delivery ist allgegenwärtig. Wirklich?
Viele Teams straucheln immer noch dabei, regelmäßig gut getestete Produktinkremente zu liefern. Normalerweise mit der gleichen alten Ausrede: die (nicht)-funktionalen Tests seien zu aufwändig und zu teuer umzusetzen. Doch genau das Gegenteil ist der Fall!
In diesem Vortrag gehen wir kurz auf die Bedeutung früher und regelmäßiger (nicht)-funktionale Tests von Cloud-nativen Anwendungen ein und erläutern, warum monolithische CI-Pipelines eine Sackgasse sind.
Anschließend zeigen wir, wie einfach es ist, kontinuierliche Integrations-, Performance-, Security- und Akzeptanz-Tests mithilfe von Testkube zu integrieren und direkt im Cluster auszuführen.
In this presentation from IVT's GMP Week, Journal of Validation Technology Editor-in-Chief, Paul Pluta, Ph.D., asks "can compliance be improved by using quality by design [QbD] concepts?" Pluta discussed the QbD application, development of validation master plans, and the lifecycle approach to process validation. Furthermore, he discusses how to incorporate these essential parts of the validation process to implement effective, and efficient, compliance by design into the quality system.
Continuous Delivery presents a compelling vision of builds that are automatically deployed and tested until ready for production.
Most teams aren't there yet. Some never want to go that far. Others want to push the envelope further.
This deck presents a model for scoring yourself on the continuum and examples of how companies can decide what parts of CD to adopt first, later and not at all.
Presentation on the promises and pitfalls of applying Agile in a Quality Management System. How do you get the benefits of agile while maintaining quality and regulatory compliance?
ArianeGroup benefits from a 184% Return of Investment when using PLC Checker thanks to quicker commissioning and easier maintenance.
Find out more about the use of PLC Checker for the quality control of PLC programs in the aerospace, defence, and security industries in our ArianeGroup success story.
1. INFSOM-RI-1234567
Grid-QCM
Automation in Quality Assurance
OGF 23 Adriano Rippa
Quality for Grid & Grid for Quality: sharing experiences
and perspectives of Grid and Open Source communities Engineering Ingegneria Informatica S.p.A.
Barcelona, 2nd June 2008
2. INFSOM-RI-1234567
Summary
• The project
• Introduction to QA concepts
• The starting point of the study
• The Grid Quality Certification Model (Grid-QCM)
• The Grid-QCM dissemination timeline
• Some FAQs
• Grid-QCM adoption in a CMMi lev.3 organization
• Conclusions
Grid-QCM
Automation in Quality Assurance
Open Grid 2
3. INFSOM-RI-1234567
The ETICS2 project
Grid-QCM
Automation in Quality Assurance
Open Grid 3
4. INFSOM-RI-1234567
ETICS2
The ETICS second phase
Started in March 2008
Duration: 2 years
Funded by the European Commission
Extended name:
• “eInfrastructure for Testing Integration and Configuration of
Software 2”
Purpose:
• Automate the way a software is built, tested and certified.
It provides
• Fully automatic build, test and certification tools
• A repository for the artefacts
• A Grid based solution optimal performances and multiple
platform and test options
Grid-QCM
Automation in Quality Assurance
Open Grid 4
5. INFSOM-RI-1234567
Introduction to QA concepts
Grid-QCM
Automation in Quality Assurance
Open Grid 5
6. INFSOM-RI-1234567
Grid-QCM focus
Product VS Process
Quality refers to several concepts like:
• Quality of the Implementation process
• Quality of the requirements management
• Quality of the service
• Quality of the software
Grid-QCM
Automation in Quality Assurance
Open Grid 6
7. INFSOM-RI-1234567
Terminology
Product VS Process
According to ISO 9126 documentation we can define:
• Measure: the number or category assigned to an attribute of an
entity by making a measurement (sometimes used as
synonymous of metric)
• Metric: The defined method to measure an attribute and the
scale
• Measurement: The use of a metric to assign a value (which may
be a number or category) from a scale to an attribute of an entity)
Grid-QCM
Automation in Quality Assurance
Open Grid 7
8. INFSOM-RI-1234567
The starting point
Grid-QCM
Automation in Quality Assurance
Open Grid 8
9. INFSOM-RI-1234567
State of the Art
We have tons of stuff in the SoA!
State of the art provides
• Hundreds of metrics
• Approaches to define user’s own metrics
• Many standards to asses the quality of processes and products
So, what’s the matter?!?
Grid-QCM
Automation in Quality Assurance
Open Grid 9
10. INFSOM-RI-1234567
The matter
Effort and resources
QA means initial investments and
Managing QA means devote resources to it
Many companies (e.g. SMEs) cannot afford the initial effort and
do not recognise the promised increase of value.
• Only ~70 companies in the world are CMMi lev.5 certified
• 50 of them are in India
• source: Gartner
• Just 25% of the companies in the world are CMMi lev.2 or above
• source: Kulik, Weber: “Software Metrics Best Practices – 2001”
and “Software Metrics State of the Art – 2000”
Grid-QCM
Automation in Quality Assurance
Open Grid 10
11. INFSOM-RI-1234567
Current standards issues
Why studying for one more QA certification model
Current quality assurance standards are useful but
• They need lot of time to be applied.
• People need training
• Certification needs inspections to be achieved
• What for the short-lived consortia?
• They provide only theoretical guidelines which need to be
adapted and implemented. What for homogeneity and
comparability of results?
• It’s hard to systematically verify goodness of results: managing
tools needed
Grid-QCM
Automation in Quality Assurance
Open Grid 11
12. INFSOM-RI-1234567
The Grid Quality
Certification Model
Grid-QCM
Automation in Quality Assurance
Open Grid 12
13. INFSOM-RI-1234567
Grid-Quality Certification Model
Our proposal to help developers
Grid-QCM is
• fully automatable in measuring and verifying activities to reduce
investments and management effort
• not subjective, to certify the object not the process nor the
organization
• product oriented, not process oriented
• easily adoptable within short-lived Projects
Grid-QCM
Automation in Quality Assurance
Open Grid 13
14. INFSOM-RI-1234567
Grid-Quality Certification Model
preliminary remarks
Grid-QCM has been developed according to
• The feedback received from expert people and potential users
• ISO standards guidelines:
• Grid-QCM has been described according to ISO 25000, 14598
• Grid-QCM has been structured according to ISO 25041
• Quality attributes has been named according to ISO 9126
Grid-QCM
Automation in Quality Assurance
Open Grid 14
15. INFSOM-RI-1234567
Grid-Quality Certification Model
The ETICS vision
Allows
Grid-QCM Test
Allows
automation
ETICS
Defines
Software
metrics
ETICS grid
Runs
infrastructure
measures
Grid-QCM
Automation in Quality Assurance
Open Grid 15
16. INFSOM-RI-1234567
The structure
Evaluation modules
Grid-QCM is structured in Evaluation Modules (EM).
The set of evaluation techniques are grouped in families. Every
family is an Evaluation Module
5 Evaluation Modules:
• Static analysis
• Coding style
• Structural testing
• Functional testing
• Standards compliance
Grid-QCM
Automation in Quality Assurance
Open Grid 16
17. INFSOM-RI-1234567
Evaluation Modules 1/2
Static analysis
• Quality characteristics:
• Reliability – maturity
• Maintainability – analysability
• Maintainability – changeability
• Maintainability – testability
• Static analysis of classes. Statistics on measures are used as
predictor of quality characteristics.
Coding style
• Quality characteristics:
• Maintainability – analysability
• Static analysis of the source code.
Grid-QCM
Automation in Quality Assurance
Open Grid 17
18. INFSOM-RI-1234567
Evaluation Modules 2/2
Structural testing
• Quality characteristics:
• Functionality – accuracy
• Reliability – maturity
• Structural testing to classes identified more likely to have many
errors.
Functional testing
• Quality characteristics:
• Functionality – accuracy
• Functionality – interoperability
• Reliability – maturity
• Portability – adaptability
• Portability - installability
• Platform compliance and to functional abilities of the software
Standards compliance
• Quality characteristics:
Grid-QCM • Functionality – standards compliance
Automation in Quality Assurance
Open Grid 18
19. INFSOM-RI-1234567
Grid-QCM: Final Score
Final score will consist in:
• A table summarizing the results with several possible views
• A list of passed and failed tests
• All the important information as:
• Software product
• Platform
• Quality characteristics
• Standard compliance
• Identification of evaluation report
• Identification of certification body (organization, contact
information)
• Certification data (dates, certification number)
• Electronic signature of certification record
Grid-QCM
Automation in Quality Assurance
Open Grid 19
20. INFSOM-RI-1234567
The Grid-QCM
dissemination timeline
Grid-QCM
Automation in Quality Assurance
Open Grid 20
21. INFSOM-RI-1234567
Grid-QCM worldwide
Since 2007
EGEE ’07 ESA 3rd GRID & e-
1-5 Oct Collaboration Workshop
16-17 Jan 2008
ECHOGRID/EUChinagrid Budapest (Hun)
Frascati (IT)
Conference 24-25 April
Beijing (CHINA) OGF 21
OGF 23
15-19 Oct
2-6 June
Seattle (USA)
Barcelona (SPA)
MAY DEC JAN ‘08
JUNE
FEB ‘07 OCT
EELA 3° Conference Now
3-5 Dec 2007
Catania (IT)
ETICS review
OGF 20/EGEE UF Belief Conference QUALIPSO 15 Feb
7-11 May 25-28 June Conference Geneva (CH)
Manchester (UK) Rio de Janeiro (BRA) 16-17 Jan 2008
Grid-QCM Rome (IT)
Automation in Quality Assurance
Open Grid 21
22. INFSOM-RI-1234567
Some FAQs
Grid-QCM
Automation in Quality Assurance
Open Grid 22
23. INFSOM-RI-1234567
Some Questions and Answers
Yes, but…
What’s good about Grid-QCM for my project?
• This model (and the capability of automation) reduces the effort
in performing continuous build and test activities (e.g. coverage
tests) on different SW releases.
What are the costs?
• Using the ETICS tool people can have the model integrated in
the build and test application free of charge
My organisation is certified ISO/CMMI can I use Grid-QCM?
• The model is a standalone quality certification model.
• However it can be easily integrated in yet ISO/CMMI certified
organisations.
Grid-QCM
Automation in Quality Assurance
Open Grid 23
24. INFSOM-RI-1234567
Grid-QCM in a
CMMi lev.3 organisation
Grid-QCM
Automation in Quality Assurance
Open Grid 24
25. INFSOM-RI-1234567
Grid-QCM in a CMMi lev.3 certified company
The Engineering experience
Engineering Ingegneria Informatica S.p.A is certified as follows:
• CMMi lev. 3
• For all production divisions
• ISO 9001
• For all the ICT sector in which the organization is involved
• Since 1994 ( ISO9001:2000 from December 2002)
• NATO AQAP 2110/160
• Since December 1996 (from 1996 to 2005 there were different
rules)
The whole Grid-QCM work is born from internal needs of
• The research area
• The production area
Grid-QCM
Automation in Quality Assurance
Open Grid 25
26. INFSOM-RI-1234567
Engineering QA tools
Keeping the certification
Engineering tools to reach and maintain the CMMi lev. 3
certification:
Spago4Q (www.spago4q.org)
• measures processes, performances and bugs through the
integration with other tools
• Internally developed and available for free
• Examples of calculated metrics:
• Test Coverage
• Anomalies distribution
• Effort used to solve anomalies
• Cost of not founded anomalies
• Metrics about requirements
• Metrics about risk management
• …
Grid-QCM
Automation in Quality Assurance
Open Grid 26
27. INFSOM-RI-1234567
It is not enough…
What ETICS and Grid-QCM can do for ENG
…Some quality aspects are not covered
Grid-QCM + the ETICS suite
• Measures other quality aspects such as:
• Quality of the code
• Compliance with standards
• Compliance with OS
• …
• Can be integrated with the Spago4Q suite
So, Engineering is managing the activities to make Grid-QCM
+ ETICS a tool to keep the CMMi lev.3 certification
Grid-QCM
Automation in Quality Assurance
Open Grid 27
28. INFSOM-RI-1234567
Conclusions
Grid-QCM
Automation in Quality Assurance
Open Grid 28
29. INFSOM-RI-1234567
Conclusions
And further steps
Grid-QCM is a certification model
• Automatable
• Implemented by default in the ETICS tool
• Ready to interact with classical standards
Adopting Grid-QCM requires little human effort
During the ETICS 2 project
• Grid-QCM is going to be validated on-the-field with at first two
(Dec. ‘08) and then four projects (Dec. ’09)
• Grid-QCM will be proposed for the ISO standardisation (2009)
Grid-QCM
Automation in Quality Assurance
Open Grid 29
30. INFSOM-RI-1234567
E-mail addresses
We wish Grid-QCM and ETICS to be as simple and effective as
possible to use.
For this we need your feedback
adriano.rippa@eng.it
Grid-QCM
Automation in Quality Assurance
Open Grid 30