This document discusses research on software quality assurance based on software quality standards and technology management. It explores how to ensure software quality through software quality standards, quality assessment, and test process management. The document outlines China's software industry development, key quality standards, and the relationships between standards, validation, and evaluation in assuring software quality. It also describes software testing technologies and the importance of test process management in finding defects and evaluating software quality. The researchers tested intelligent frequency conversion control software using the standards and process, finding the software met functional requirements without errors.

1. Research on Software Quality Assurance Based
on Software Quality Standards and Technology
Management
Peng Shen
Colleage of Computer and
Information Science
Southwest University
ChongQing, China
312184646@qq.com
Xiaoming Ding
Colleage of Computer and
Information Science
Southwest University
ChongQing, China
2366268114@qq.com
Wenjun Ren
Colleage of Computer and
Information Science
Southwest University
ChongQing, China
1453155741@qq.com
Chujun Yang
Colleage of Computer and
Information Science
Southwest University
ChongQing, China
342768063@qq.com
Abstract—This paper focuses on the relationship between
software quality standards and software quality assurance.
According to the software engineering international standard
ISO/IEC 25000 series localization process in China, how to
ensure the software quality by software standard and technology
management is explored. It is pointed out that software quality
needs to be guaranteed by software quality standard, software
quality assessment and software test process management
mechanism.
Keywords—software quality standard, quality assurance, test
process management
With the development of computer technology, the position
of software in production and life is becoming more and more
important. More and more tasks are handled by the software
system, and the quality of the software system determines the
success or failure of this task. Therefore, we must attach great
importance to software's high reliability and high quality
guarantee. A defective software system will not only cause
serious property loss, but also threaten the safety of personnel.
I. THE DEVELOPMENT OF CHINA'S SOFTWARE INDUSTRY
Software and hardware are inseparable, and the
implementation of software functions must be based on
hardware carriers. In the information age, the manpower is
gradually reduced, which is replaced by the intelligent machine
controlled by the software. In a set of intelligent machine
systems, the function achieved by software has reached more
than 80%, far more than the hardware. "The China Telecom
CTNet2025 network architecture white paper" points out that
the China Telecom will realize the 80% network functions as
software. This shows the importance of the software.
In order to meet the needs of production and life, the
number of software has grown explosively in recent years.
Take China's mobile software, for example, in 2017, the
number of APP in the Chinese market was over 4 million 60
thousand. Among them, the number of APP of the local third
party application stores is 2 million 350 thousand, and
the
number of APP in the apple store (China) is over 1 million 710
thousand. In 2017, the number of mobile phone users in China
was 1 billion 365 million, the total number of 4G users reached
888 million, and the fixed broadband users reached 322
million. There are at least 1 billion 300 million users in contact
and use of software. The authoritative data of China's Ministry
of Industry and Information Technology show that the income
of engineers engaged in software industry and software
creation in China is increasing significantly, which is shown in
Table I. Moreover, in the future, with the improvement of
China's overall economy and the support of the government to
the software industry, the market prospect of the software
industry will be better in the face of such a huge population
base.
TABLE I. THE NATIONAL SOFTWARE AND INFORMATION TECHNOLOGY
SERVICE INDUSTRY MAIN INDICATOR EXPRESS IN 2017
The index name unit 2017
Year-on-year
growth rate(%)
Number of enterprises — 35774 —
Software business
income
billion yuan 55037 13.9
Among them:
1.Software product
income
billion yuan 17241 11.9
2.Information
technology service
income
billion yuan 29318 16.8
3. Embedded system
software revenue
billion yuan 8478 8.9
Total profit billion yuan 7020 15.8
Software business
export
billion dollars 538 3.4
Average number of
employees
Ten thousand
people
600 3.4
The flourishing development of the software industry
brings the profits to the enterprise, while the quality and safety
of the software cannot be ignored. As early as 1960s, American
engineers put forward the warning of the "software crisis".
Therefore, the software standardization and reusability have
been highly valued by the industry, which plays an important
978-1-5386-5889-5/18/$31.00 ©2018 IEEE
SNPD 2018, June 27-29, 2018, Busan, Korea
385

2. role in avoiding duplication of labor and alleviating the
software crisis[1].
II. QUALITY STANDARD
The current standard in China for software quality and
testing is: GB / T 25000 "Systems and software engineering -
Systems and software Quality Requirements and Evaluation
(SQuaRE)". It is to amend the international standard ISO / IEC
25000 series to form the Chinese national standard. The series
of standard has 21 parts. It mainly includes planning and
management, system and software quality model, data quality
model, measurement reference model and guide, quality
measure elements, measurement of quality in use,
measurement of system and software product quality,
measurement of data quality, quality requirements, evaluation
process, evaluation guide for developers, acquirers and
independent evaluators, evaluation module, evaluation module
for recoverability, requirements for quality of ready to use
software product (RUSP) and instructions for testing.
These parts of the series of standards cover all aspects of
management, model, measurement, requirements, evaluation,
data, characteristics, and instructions for testing related to the
quality of software products. Among them, GBT 25000.10
defines the software product quality model and quality in use
model[2], and describes the eight major characteristics of the
quality model and the five major characteristics of software use
quality. The two contain a total of 50 sub-characteristics. GBT
25000.51 develops detailed instructions for testing[3] for the
sub-characteristics of these quality models GBT 25000.10. The
product quality model is shown in Fig. 1, and the quality in use
model is shown in Fig. 2.
Fig. 1. Product quality model
Fig. 2. Quality in use model
III. THE RELATIONSHIP BETWEEN SOFTWARE QUALITY
STANDARD AND SOFTWARE QUALITY ASSURANCE
A. Specification relationship
The software defines the world, and the standard
standardizes the quality of the software. According to the
property and needs of software products, the appropriate
standards from the GBT 25000 series standards can be
selected to write a software requirement specification
document and evaluation document for the internal quality
of software products, the external quality of information
system and the quality of business system. This allows the
software development process from the first stage to
follow the software quality standards, and from the initial
stage, the software project development team has a clear
goal and specification to ensure the quality of software to
carry out the development. The quality of the system or the
System/Software Product
Quality
Functional
Suitability
Performance
efficiency
Compatibility Usability Reliability Security Maintainability Portability
Functional
completeness
Functional
correctness
Functional
appropriateness
Time-behaviour
Resource
utilization
Capacity
Appropriateness
recognisability
Learnability
Operability
User error
protection
User interface
Aesthetics
Accessibility
Maturity
Availability
Fault tolerance
Recoverability
Confidentiality
Integrity
Non-Repudiation
Accountability
Authenticity
Co-existence
Interoperability
Modularity
Reusability
Analysability
Modifiability
Testability
Adaptability
Installability
Replaceability
Quality In
Use
Effectiveness Efficiency Satisfaction
Freedom from
risk
Context
coverage
Effectiveness Efficiency Usefulness
Trust
Pleasure
Comfort
Economic risk
mitigation
Health and
safety risk
mitigation
Environmental
risk mitigation
Context
completeness
Flexibility
386

3. finished product of the software is bound to play a good
normative role. SquaRE series standards general reference
model is shown in Fig. 3.
Fig. 3. SquaRE series standards general reference model
B. Validation relationship
The software defines the world, and the standard validates
software quality. The implementation of system and software
quality requires a process similar to the development of a
system and software: requirements, implementations, and
results validation[4]. The software development team writes
software quality requirements according to the software quality
standard, standardizing the development operation according to
the quality requirements, and implements the software products
by quality in use requirements, the system quality requirements
and the software product quality requirements. Then the quality
requirements of the product are verified by the quality of the
product and the quality of its use. The internal quality validates
the performance of the product in real time, the external quality
estimates the quality in use, and thequality in use is used for
the product evaluation. Only through the standard to validate
software products, the quality of software can be better
guaranteed. The system/software quality life cycle model is
shown in Fig. 4.
C. Evaluation relationship
Software defines the world, and standards evaluate the
quality of the software. The implementation of software quality
standards means that there must be a set of mechanisms for
assessing these standards[5]. Software quality evaluation is to
assess the target values of the system or software products that
have been identified and suitable for the quality characteristics
by using appropriate techniques or methods[6]. In the actual
situation, the software behavior data is first analyzed and
measured according to the quality defined in the software
quality standard[7]. Then combine the reality to select the
measures that meet the needs. Finally, according to a certain
quality evaluation process model, combined with specific user
quality requirements, we measure the quality state of software,
and provide a basis for software development team to evaluate
software quality and make decisions.
The data captured in the evaluation process should be
analyzed using appropriate tools and methods (such as
economic or statistical analysis tools). We can determine the
software quality model, the quality measurement model and the
measurement analysis method, and carry out the specific
measurement and analysis to evaluate the software quality. But
each attribute in the software quality model is sometimes
difficult to find the specific value[8], so the quality evaluation
of the software system can be assessed by fuzzy level[9]. The
process of software quality evaluation includes seven parts[10]:
the determination of system and software quality evaluation
requirements, the determination of system and software quality
evaluation objectives, the establishment of quality evaluation
requirements, the specification of quality evaluation, the design
of quality evaluation, the implementation of quality evaluation,
and the analysis of quality evaluation results.
Software quality standard and software quality evaluation
are all a constraint and judgment for software quality. Whether
there are defects or errors in software must be deeply explored
by means of software testing technology.
IV. SOFTWARE TESTING PROCESS MANAGEMENT
MECHANISM
A. Software testing technology
Software is mainly composed of programs and data. In
order to ensure the final user experience, before the software is
delivered to the user, the development team must adopt
effective software test method and appropriate test case[11,12]
to find the defects, as far as possible to find out the defects in
the software system, and Combined with test case
prioritization[13] then as soon and good as possible to deal
with, to avoid these defects when final users using
software[14]. Software testing is a process based on multi
stage, multi angle, professional test thinking, user thinking and
the use of a variety of technical means to find more software
system defects. Software testing methods are often divided into
the following four categories[15].
1) Classification according to the operation of the
software: Static test method and dynamic test method.
2) Classification according to the degree of transparency
within the software: White box test, black box test and grey
box test.
3) Classification according to the software testing stage:
Unit test, integrated test and system integration test.
4) Classification according to the testers: Internal test,
third party test and user acceptance test (UAT).
But most of the literature's test classifications are lacking in
production testing, and production tests should actually be
classified as stage tests. The software product developed by the
software development team is ultimately required to be used by
the customer. The model of customers using the software is the
production model. There are many uncertain factors in the
production environment of software products, such as user
sense, concurrent number, software function defect and so on.
These defects must be discovered by production test. Some of
Requirements
specification Evaluation
Software product
Internal software
quality
External software
quality
Quality in use
SquaRE series
standards
Information system
Business system
387

4. these software testing methods can be implemented by
professional static or dynamic software testing tools, such as
logiscope software, macabe software, purify series software,
team test software, loadrunner software and so on. With the
help of special software testing tools, the cost and time can not
only be greatly reduced, but also the precision of the software
testing process can be greatly improved.
Fig. 4. System/Software Quality Life Cycle Model
B. Software testing process management
The development and progress of software testing method
and software test model[16] and software defect prediction
model based on machine learning[17,18] is a powerful
supplement to the development of software engineering testing
branches, and a powerful complement to software engineering.
However, the development of software testing theory must be
applied to practice, so a complete and reasonable software
testing process management mechanism is needed to apply it.
No matter what software testing methods and test models are,
we must have a complete set of software test process
management[19]. A set of software products must be tested
with a specified test method or model before going online,
such as SIT, UAT, and production testing. The method of
testing must be carried out in the framework of the software
test process management mechanism[20]. Software testing
process management generally includes the following four
parts.
1) Requirements for test documentation: the test plan, the
test description, and tests results.
2) Requirements for the test plan: pass/fail criteria,
software test environment, schedule, risk, human resource,
tool and equipment resource, and communication.
3) Requirements for the testing description: test case
description and test procedures. Test procedures are related to
the repeatability and reproducibility of the test, and the
importance of the test procedure cannot be ignored. Test
procedures include the following parts:
• The test preparation.
• The actions necessary to begin and to execute the test.
• The actions necessary to record the test results.
• The conditions and actions to stop and eventually
restart the tests.
4) Requirements for the test results: execution report,
anormaly report, and assessment of the test results.
Because the test of a single person is often missed, the test
results need to be cross checked. The test documents must be
signed by the tester, the checker, the auditor and the approver
before submission.
V. CASE ANALYSIS AND EXPERIMENTAL RESULTS
In order to verify the role of software quality standards
and software testing process management mechanisms in
software quality assurance, the software standard GB/T
25000.51 is mainly used as a basis for measuring software
quality, and is used to match the above-mentioned software
testing process management mechanism as a test method and
test the quality of the intelligent frequency conversion control
software delivered by a company.The test report is partially
intercepted in Table II.
System Quality In
Use Model
(System and
software) Product
Quality Model
System Quality In Use
Requirements
System Quality In Use
Computer System Quality
Requirements
Computer System Quality
Software Product Quality
Requirements
Software Product Quality
Isused for
Isused for
Isused for
Requirements Products
Validation
Verification
Validation
Verification
Validation
Quality In Use
Needs
Implementation
388

5. TABLE II. TEST REPORT PARTIALLY INTERCEPTED
Test project Technical indicator Test fact Test conclusion
Functional
suitability
Functional
completeness
Indicator basis: GB/T
25000.51-2016 5.3.1.1 5.3.1.2 5.3.1.3
Indicator description: Interface presentation and document
description functions should all be executable; the software should
meet all the requirements in any requirements document applied to
the product description.
All interface presentation and
document description functions
have been implemented.
Pass
Functional
correctness
Indicator basis: GB/T 25000.51-2016 5.3.1.4 5.3.1.5
Indicator description: Software should not be self-contradictory;
software does not contradict product descriptions and user
documentation sets; software behavior should be consistent with the
user's reasonable control intent.
The software has the functions
of password verification, start,
stop, frequency conversion, start
of a fixed period, shutdown, and
record of failure times. No error
was found in the function item.
Pass
Reliability Fault tolerance Indicator basis: GB/T 25000.51-2016 5.3.5.4
Indicator description:
Description of the indicator: The software has the ability to block
illegal operations; it does not allow illegal operations to cause
programs to crash, etc.; software function items can block system or
development environment error messages under illegal operations.
The function items tested in this
test process all give error
prompts under the wrong input
and illegal operation, and block
illegal operations.
Pass
Recoverability Indicator basis: GB/T 25000.51-2016 5.3.5.3
Indicator description:
No inrecoverability crashes (data loss or data unrecoverable) occur
during long-running software operations; recoverability crashes
can't be more than exceptions; no operation restarts the system.
When the system shuts down
abnormally during this test, data
loss during operation cannot be
recovered.
Fail
From the test report, it can be seen that the items to be
tested are not randomly selected, but are based on the
definitions given in the software quality standards, and
correspond to the specified specifications one by one. The
indicator basis in the technical indicator are based on the
specific definitions in the quality standards. In the description
of the test facts, the test results obtained by the technical
management mechanism can be known.The test conclusion is
an evaluation under the joint action of software standards and
technical management mechanisms.
Experiments mainly focused on software functiona
suitability, reliability, security, usability, portability, Chinese
compliance, and user documentation. The test quickly
discovered the problem and informed the company of a re-
examination of the software code, which successfully
guaranteed the software quality.
VI. CONCLUSION
With the continuous development and progress of the
times, the software quality standard has made great
contributions to the development and improvement of software
engineering, and has created favorable conditions for software
quality assurance. The high quality assurance of software
needs our scientific researchers to refine and improve the
standard of software quality standard continuously. Not only
do we need to mine software testing methods, create
automated software testing tools, and constantly improve the
testing process management mechanism, but also the
development of software engineering must conform to the
software quality standards that are constantly developing and
updating in today's society. Only in such a perfect software
engineering mechanism can high quality software be
developed.
REFERENCES
[1] Xu Junhua. Design and implementation of student apartment
management system [D]. University of electronic technology, 2011.
[2] ISO/IEC 25010:2011, Systems and software engineering -- Systems and
software Quality Requirements and Evaluation (SQuaRE) -- System and
software quality models.
[3] ISO/IEC 25051:2014, Software engineering -- Systems and software
Quality Requirements and Evaluation (SQuaRE) -- Requirements for
quality of Ready to Use Software Product (RUSP) and instructions for
testing.
[4] Xie Qian, Gao Lin, Yang Jianjun, and so on. Domestic basic software
standardization - interactive [J]. information technology and
standardization with R & D, testing and application, 2008 (6): 4-8.
[5] Wang Hua, Xiang Gang, Chen Yan. [C]// technology and method of
software quality evaluation of the reliability of Physics Symposium
2007.
[6] Wang Rui. Measurement and evaluation of the quality of software
products [J]. China management information, 2017, 20 (4): 70-72. Xie
Qian, Gao Lin, Yang Jianjun, and so on. Domestic basic software
standardization - interactive [J]. information technology and
standardization with R & D, testing and application, 2008 (6): 4-8.
[7] LAN Yuqing, Gao Jing. Software quality measurement and software
process measurement [J]. computer system application, 2003, 12(9):69-
72.
[8] Chen Weiwei. Research on fuzzy comprehensive evaluation strategy for
computer software quality [J]. automation and instrumentation, 2017
(5): 1-2.
[9] Hong Liu, Huang Haibo, Jia Chunhui, et al. Research on fuzzy
comprehensive evaluation method of software quality based on external
quality characteristics [J]. modern computer, 2015 (10): 6-9.
[10] ISO/IEC 25001:2014, Systems and Software engineering--Systems and
software Quality Requirements and Evaluation(SQuaRE)— Planning
and management.
[11] Chen T Y, Kuo F C, Liu H. Adaptive random testing based on
distribution metrics[M]. Elsevier Science Inc. 2009.
[12] Shahbazi A, Tappenden A F, Miller J. Centroidal Voronoi
Tessellations—A New Approach to Random Testing[M]. IEEE Press,
2013.
[13] Jiang B, Chan W K. Input-based adaptive randomized test case
prioritization: A local beam search approach[J]. Journal of Systems &
Software, 2015, 105(C):91-106.
[14] He Xingui. A summary of software testing technology [J]. Journal of
China Jiliang University, 2008, 19 (3): 187-193.
[15] Nie Changhai. Some thoughts on software testing: [J]. computer
science, 2011, 38 (2): 1-3.
389

6. [16] Wang Qing, Wu Shujian, Li Mingshu. Journal of software defect
prediction, [J]. software technology, 2008, 19 (7): 1565-1580.
[17] Chen Xiang, Gu Qing, Liu Wangshu, et al. Research on static software
defect prediction method research [J]. software journal, 2016, 27 (1): 1-
25.
[18] Liao Shengping, Xu Ling, Yan Meng. Software defect prediction
method of semi supervised SVM based on sampling [J]. Computer
Engineering and applications, 2017, 53 (14): 161-166.
[19] Feng Songtao. Research on software testing process management [D].
China University of Geosciences (Wuhan), 2013.
[20] Wang Xianggang. [J]. software design and implementation of software
testing process management tool, 2014 (2): 96-97.
390