The document is the 2016-17 Turkey Software Quality Report published by the Turkish Testing Board. It provides an executive summary and analysis of survey results on topics related to test data management in the Turkish software industry. Some of the key findings from the surveys include:
- Over 70% of organizations report that software testers are responsible for test data generation.
- Over half of organizations spend between 11-50% of their testing efforts on test data management activities.
- The top challenges in creating test data are having up-to-date and consistent data that resembles real production data.
- Most organizations manually generate test data or use subsets of production data for testing. Very few use full database virtualization.
-
Insights Success is The Best Business Magazine in the world for enterprises. Being a platform, it focuses distinctively on emerging as well as leading fastest growing companies, their confrontational style of doing businesses and the way of delivering effective and collaborative solutions to strengthen market share. Here, we talk about the leader’s viewpoints & ideas, latest products/services, etc. Insights Success magazine reaches out to all the ‘C’ Level Professionals, VPs, Consultants, VCs, Managers, and HRs of various industries.
2009 North Bridge Future of Open Source StudyNorth Bridge
2009 Future of Open Source study; presented at InfoWorld Open Source Business Conference Keynote Panel: Dries Buytaert, Founder & CTO- Acquia;Ron Hovsepian, CEO Novell;John Lilly, CEO Mozilla; Mårten Mickos, SVP Sun Microsystems; John Roberts, CEO SugarCRM. The panel was chaired by North Bridge. The study, collected from 435 respondents, bring to light a variety of significant issues and topics surrounding open source software, such as the impact of the economic recession, key market drivers, and predictions regarding the types of companies that will drive the next wave of commercial open source success.
Disruptive business models are maturing in large markets like Web Content Management and Social Publishing, making it an attractive investment area for the team at North Bridge. However what the survey also shows is that much work remains to evangelize these benefits and establish a credible ecosystem to bring open source solutions to mainstream IT buyers.
The working conditions survey interviewed 1,202 members of SAK-affiliated trade unions by telephone in February and March 2018. The SAK Good Job Barometer gauges the quality of working conditions by measuring employment essentials and elements of a smooth working experience.
This partial report of the working conditions survey concerning digitisation was produced as part of the SAK Time of Opportunities project.
Insights Success is The Best Business Magazine in the world for enterprises. Being a platform, it focuses distinctively on emerging as well as leading fastest growing companies, their confrontational style of doing businesses and the way of delivering effective and collaborative solutions to strengthen market share. Here, we talk about the leader’s viewpoints & ideas, latest products/services, etc. Insights Success magazine reaches out to all the ‘C’ Level Professionals, VPs, Consultants, VCs, Managers, and HRs of various industries.
2009 North Bridge Future of Open Source StudyNorth Bridge
2009 Future of Open Source study; presented at InfoWorld Open Source Business Conference Keynote Panel: Dries Buytaert, Founder & CTO- Acquia;Ron Hovsepian, CEO Novell;John Lilly, CEO Mozilla; Mårten Mickos, SVP Sun Microsystems; John Roberts, CEO SugarCRM. The panel was chaired by North Bridge. The study, collected from 435 respondents, bring to light a variety of significant issues and topics surrounding open source software, such as the impact of the economic recession, key market drivers, and predictions regarding the types of companies that will drive the next wave of commercial open source success.
Disruptive business models are maturing in large markets like Web Content Management and Social Publishing, making it an attractive investment area for the team at North Bridge. However what the survey also shows is that much work remains to evangelize these benefits and establish a credible ecosystem to bring open source solutions to mainstream IT buyers.
The working conditions survey interviewed 1,202 members of SAK-affiliated trade unions by telephone in February and March 2018. The SAK Good Job Barometer gauges the quality of working conditions by measuring employment essentials and elements of a smooth working experience.
This partial report of the working conditions survey concerning digitisation was produced as part of the SAK Time of Opportunities project.
Putting Wearables to Work (via Salesforce.com)Ian Gertler
What's the state of wearble technology in business? Salesforce.com explored this with early adopters and enterprise organizations to see where things are heading and what the future trends could be.
Gain new visibility in your DevOps teamAbhishek Sood
DevOps implementation too often focuses only on communication between dev teams and their business counterparts, but fails to adequately loop in downstream testing and operations teams. A lack of visibility for operations teams leads to delaying rollouts and going live with buggy code.
Check this Forrester Consulting report to see what strategies DevOps teams are using to maximize visibility, speed, and agility.
Emerging Trends in Testing - Conclusions from the 2013-2014 World Quality ReportTEST Huddle
View webinar: http://www.eurostarconferences.com/community/member/webinar-archive/webinar-82-emerging-trends-in-testing---conclusions-from-the-2013-2014-world-quality-report
How does your company stack up to the industry in software quality and testing? For instance, did you know that, despite the rapid rise in mobile testing (from 31% in 2012 to 55% in 2013), close to half of respondents this year report that they still lack mobile testing experts...
Mark your calendar for a dynamic 30-minute discussion with Capgemini and HP where we'll share results from the World Quality Report. This report is the industry's most comprehensive annual research study focused on insights about the latest trends and best practices in application quality assurance, testing methodologies, tools, and QA processes. The report is based on more than 1,500 telephone interviews with CIOs, CFOs, IT directors and managers and QA directors across 25 countries.
During this event you'll hear actionable highlights of the findings on topics including:
• Testing in the cloud
• Mobility & security testing
• Managing Agile distributed testing organizations and testing CoEs
• Test automation
• Quality metrics
• ReportingMike Cooper
This insightful discussion co-author of the World Quality Report, Makarand Teje, Senior Vice President, Applications, Capgemini is joined by Michael Cooper, HP Software QA and Testing Evangelist.
Data Quality Doesn’t Just Happen: And Here’s What Some of the Industry’s Most...InsightInnovation
Data quality isn’t always the sexiest topic, but it’s critical and one that buyers and suppliers often neglect to have. The ramifications of ignoring it can cost millions of dollars. Some of the industry’s largest buyers and suppliers have found a simple solution though and it’s one that is available to everyone else too. Come here about how the issue of data quality concerns haven’t gone away, and what others are doing to make sure they and their insights are protected.
Technology - It's position and impact on Surveying 2020 Report - May 2020Anthony Walker
The RICS, SCSI , TSA and GoReport worked together to produce a report which looked at the position and impact of Technology on the surveying profession also see https://lnkd.in/gFgbVTw
Putting Wearables to Work (via Salesforce.com)Ian Gertler
What's the state of wearble technology in business? Salesforce.com explored this with early adopters and enterprise organizations to see where things are heading and what the future trends could be.
Gain new visibility in your DevOps teamAbhishek Sood
DevOps implementation too often focuses only on communication between dev teams and their business counterparts, but fails to adequately loop in downstream testing and operations teams. A lack of visibility for operations teams leads to delaying rollouts and going live with buggy code.
Check this Forrester Consulting report to see what strategies DevOps teams are using to maximize visibility, speed, and agility.
Emerging Trends in Testing - Conclusions from the 2013-2014 World Quality ReportTEST Huddle
View webinar: http://www.eurostarconferences.com/community/member/webinar-archive/webinar-82-emerging-trends-in-testing---conclusions-from-the-2013-2014-world-quality-report
How does your company stack up to the industry in software quality and testing? For instance, did you know that, despite the rapid rise in mobile testing (from 31% in 2012 to 55% in 2013), close to half of respondents this year report that they still lack mobile testing experts...
Mark your calendar for a dynamic 30-minute discussion with Capgemini and HP where we'll share results from the World Quality Report. This report is the industry's most comprehensive annual research study focused on insights about the latest trends and best practices in application quality assurance, testing methodologies, tools, and QA processes. The report is based on more than 1,500 telephone interviews with CIOs, CFOs, IT directors and managers and QA directors across 25 countries.
During this event you'll hear actionable highlights of the findings on topics including:
• Testing in the cloud
• Mobility & security testing
• Managing Agile distributed testing organizations and testing CoEs
• Test automation
• Quality metrics
• ReportingMike Cooper
This insightful discussion co-author of the World Quality Report, Makarand Teje, Senior Vice President, Applications, Capgemini is joined by Michael Cooper, HP Software QA and Testing Evangelist.
Data Quality Doesn’t Just Happen: And Here’s What Some of the Industry’s Most...InsightInnovation
Data quality isn’t always the sexiest topic, but it’s critical and one that buyers and suppliers often neglect to have. The ramifications of ignoring it can cost millions of dollars. Some of the industry’s largest buyers and suppliers have found a simple solution though and it’s one that is available to everyone else too. Come here about how the issue of data quality concerns haven’t gone away, and what others are doing to make sure they and their insights are protected.
Technology - It's position and impact on Surveying 2020 Report - May 2020Anthony Walker
The RICS, SCSI , TSA and GoReport worked together to produce a report which looked at the position and impact of Technology on the surveying profession also see https://lnkd.in/gFgbVTw
When testing new software functionality, it is important to have access to high-quality test data. This can be challenging due to large data volumes or different sources of data with varying permissions.
New technologies are being brought to the world every day, leading to new testing approaches. Here are a few software testing trends that will rise in 2019.
Multidimensional Challenges and the Impact of Test Data ManagementCognizant
Test data management (TDM) is vital for quality assurance (QA) functions to best handle the many cha;l;enges associated with data security, release management, batch processing, data masking and fencing.
The Vital Role of Test Data Management in Software Development.pdfRohitBhandari66
In today’s digital age, businesses rely heavily on software applications to streamline operations, enhance customer experiences, and gain a competitive edge. However, ensuring the quality and reliability of these applications is paramount. One decisive aspect of software testing that often goes overlooked is test data management.
Learn statistics and expert opinions on the state of the market regarding data quality in 2023.
Learn about:
- statistics and expert opinions
- the key focus of data quality in 2023
- the Data Maturity Model
- DevOps for data and CI/CD pipelines
- data validation and ETL testing
- test automation
While Healthcare organizations are focusing their attention on HIPAA and HITECH compliance, they may be missing an important data risk in their lower environments. Read our whitepaper.
What’s happening in Banking World?
The entire landscape is very competitive and banks today are evolving. Banks are relying more and more on technology to reach customers and deliver services in short span of time. It is becoming important for them to be consistent and deliver quality customer services using technology to reach, expand and deliver faster and better services.
Adding additional services and transactions via technology, integrating with legacy systems and delivering using new delivery methods are becoming a norm. The banking industry is embracing newer technology to grow their market share. With technology, banks today are global players and no more local.
Challenges
Challenges in the multiple industries are similar but in Banking, there are specific challenges, which makes it unique, which are
• Frequently changing market and regulatory requirements
• High data confidentiality requirements
• Complex system landscapes including legacy systems
• Newer technologies such as mobile and web services
• Enterprise banking integration – Core banking, Corporate Banking and Retail Banking
• Application performance – Internal and External
Approaches to meet the challenges
It is very important that banks and financial establishments conduct regression tests over the entire application lifecycle for every release and also maintain test suites for each release using effective version control system linked to requirements, test cases, test scenarios and realistic test data. Based on this, an effective testing approach can be taken individually or by combination of the following to achieve the desired results:
• Risk-based testing
• Automation - Legacy, Web, Mobile
• Test data management
• Compliance / Statutory testing
• Performance and Capacity engineering
• Off-shoring
Whitepaper des Herstellers zum Thema Collect, Transform,Generate and Test
MetaSuite and HP Quality Center Enterprise, generating Test Data
from any data source from any platform, including mainframe
Kontakt: http://www.Minerva-SoftCare.de
Cuneiform engineering solutions have geared up to revolutionize business giants. Our passionate team works tirelessly to solve today’s and tomorrow’s digital business challenges. we also deal with innovative digital platforms that
Leveraging Automated Data Validation to Reduce Software Development Timeline...Cognizant
Our enterprise solution for automating data validation - called dataTestPro - facilitates quality assurance (QA) by managing heterogeneous data testing, improving test scheduling, increasing data testing speed and reducing data -validation errors drastically.
An Empirical Study of SQA Function Effectiveness in CMMI Certified Companies ...zillesubhan
The most vital component for any software development process is, “quality”, as it ensures the reliability and effectiveness of new software. Software Quality Assurance (SQA) techniques as well as a standardized qualitative metric known as Capability Maturity Model Integration (CMMI) are used to ensure this quality. The purposes of both the practices are same as both make efforts for end product’s quality. In spite of this, CMMI certified organizations have SQA function, but face a lot of issues, which resulted in lowering the quality of the products. Standards usually provide documentation, but SQA consider testing as a chief element and also documentation only for authentication and appraisals. The relationship of the SQA function with CMMI has not attended much in common literatures. This paper is centered on investigation conducted through data collection from diverse CMMI certified software development firm to check the practice of SQA function.
Poster presentation of the thesis conducted on the topic Data Security in Pharmaceutical and Healthcare: Analysis of Necessary Web Application Security Testing Tools.
From Data to Insights: How IT Operations Data Can Boost QualityCognizant
By leveraging highly-analyzed operational data - the voice of customers, machines and tests - quality assurance (QA) and IT groups can derive major gains in quality of apps and in user experience.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
GridMate - End to end testing is a critical piece to ensure quality and avoid...ThomasParaiso2
End to end testing is a critical piece to ensure quality and avoid regressions. In this session, we share our journey building an E2E testing pipeline for GridMate components (LWC and Aura) using Cypress, JSForce, FakerJS…
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
5. FOREWORD
Turkish Testing Board (TTB - turkishtestingboard.org) is pleased to bring you the 2016-17 edition
of the Turkey Software Quality Report (TSQR). TSQR 2016’s focus is on test data management.
Apart from traditional testing surveys which solely focus on the technical side of testing, we have
tried to put emphasis also on the business side of testing. You will find tips and trends in the test
data management area.
The report is designed to help organizations to make paradigm shifts in their mindsets. It not
only draws a clear picture of the current situation in the Turkish market but also sets the de-facto
standards and trends for future information technology (IT) projects. We hope this report will be
a reference point for all decision makers.
With the help of TSQR, we are trying to lay down the foundations of a healthy discussion platform
for improvement in Turkish IT market. TSQR will be presented at the opening ceremony speech of
TestIstanbul 2016 (testistanbul.org) on April 26th initiating a series of keynotes, presentations
and discussions.
Turkish Testing Board
03TURKEY SOFTWARE QUALITY REPORT 2016-17
6. EXECUTIVE
SUMMARY
IT organizations are inevitably focusing on the collection
and organization of data for their testing processes. The
ability to control process and use test data has become
the key competitive advantage for IT organizations,
because the benefits gained by the implementation of
these mechanisms will worth the investment.
04 TURKEY SOFTWARE QUALITY REPORT 2016-17
7. Testing is a very critical part of high quality software
development; nevertheless test data management
gets only minimum attention in organizations. This
report mainly provides practical recommendations
(test data ownership, test data security, test data
generation techniques, etc.) for test data management
initiatives. The further aim of this report is to highlight
the most essential needs of test data management
process so as to be applicable to any IT organization
attempting to build or improve its test data management
methodologies.
As IT organizations deeply rely on data-driven test
activities; accurateness and effectiveness of data is
more critical than ever. Any misusage of them carries
the risk of reputational damage, such as the loss of
customer trust, therefore it raises the level of data
confidentiality requirements in many industries.
No matter which approach is chosen to overcome
unique challenges of test data management in any IT
organization, basic prerequisites to be successful are;
combination of good test cases and test data, along with
the proper usage of tools to help automate extraction,
cleansing and management of the data being used.
You can access the softcopy of this, and previous reports
at turkishtestingboard.org and hope to see you at
TestIstanbul 2016 Conference on April 26th to discuss
our further findings.
Turkish Testing Board
05TURKEY SOFTWARE QUALITY REPORT 2016-17
8. IN YOUR ORGANIZATION,
WHO IS RESPONSIBLE FOR TEST DATA
GENERATION?
73% 26%
5%
22%
5%6%
4%
Software Testers Business Analysts
Database Administrators
Software Developers
Infrastructure Architecture
Teams
Business Units / Operations
Third Parties
06 TURKEY SOFTWARE QUALITY REPORT 2016-17
* multiple selection was allowed
9. ANALYSIS OF THE CURRENT SITUATION
According to the results, software testers have a
significantly larger proportion of data generation
responsibility in their organizations. It is fairly
predictable to see software testers’ share as 73%,
mainly because this role is also responsible for design
and execution of test scenarios. On the other hand,
test data generation is an integrated part of the
test design process since specific scenarios reveal
required data sets.
Business analysts and software developers seem
to share a similar ratio of responsibility. However,
it is worth to mention that their area of expertise
would be different in data generation tasks. We may
assume that business analysts are more familiar
with the preconditions, requirements and the scope
of user scenarios (and determine the required
data specifications) whereas developers are better
equipped to find quick and effective methods to
actually generate the test data.
FUTURE PREDICTIONS
It would be fair to assume that similar ratios in
test. With the involvement of more and advanced
automation in test data management, testers with
more coding and technical skills like technical
testers and test architects will take place in the
process.
07TURKEY SOFTWARE QUALITY REPORT 2016-17
10. HOW DO YOU
GENERATE TEST DATA?
64% 40% 28%
17%
Manually populated data Subset of production data Full copy of production data
Database virtualization
ANALYSIS OF THE CURRENT SITUATION
Manually creating necessary test data seems to be
the most widespread method chosen with a 64%
ratio. Even though all manual processes take longer
time than others, they may be considered as quick-
and-dirty methods, since test data are reviewed by a
real person and usually created from scratch. It may
also be easier to immediately start generating the
test data along with the test scenarios and even just
before test execution. However, what usually prevents
organizations from using some form of automated
procedures, tools or virtualization for test data
generation is the lack of expertise or resources within
the teams.
Taking a subset of production data is also popular
with a 40%. When production data is used as test
data, (whether it is a subset or a full copy) it would
have to be masked or somehow protected. As
long as security is the primary concern in many
organizations, this method is definitely faster and the
representation of datasets more reliable.
FUTURE PREDICTIONS
Database virtualization enables the test data to be
separately prepared and maintained ready for test
execution. In the future, we may expect this ratio
of 17% to increase solidly, since it is more effective
and efficient. If software testers acquire more
technical skillsets in time, they will be attempting
similar test data preparation efforts but with faster
and more dominant control over their test data sets.
08 TURKEY SOFTWARE QUALITY REPORT 2016-17
* multiple selection was allowed
11. WHAT PERCENTAGE OF YOUR TEST
EFFORTS ARE CONSUMED FOR TEST
DATA MANAGEMENT?
11% 19% 32% 26% 12%
0-5%
of efforts
6-10%
of efforts
11-25%
of efforts
26-50%
of efforts
>50%
of efforts
ANALYSIS OF THE CURRENT SITUATION
Quality of any software product heavily depends on
the quality of software testing. Testing on the other
hand, depends on the test data that is being used.
Several researches reveal that lots of testing projects
are cancelled/failed due to poor test data quality
and these projects are more costly than successful
projects of the same size and type.
According to the results, more than half of the
participants are spending around 30% of their testing
efforts for test data management activities. Besides,
around 10% of the respondents are even dedicating
more than half of their testing efforts to test data
management. Ultimately, we may easily conclude
that test data management are amongst the most
important testing activities and test teams seem
to be unaware of the fact that they are spending
considerable amounts of time on these tasks.
FUTURE PREDICTIONS
Awareness on using high quality test data
may shift test efforts to more value added and
automated test data management activities
rather than unreliable and expensive manual
solutions. Organizations, that has more time-to-
market focus and that are operating in regulatory
environments will be more willing to invest in
intelligent test data management solutions.
09TURKEY SOFTWARE QUALITY REPORT 2016-17
12. 10 TURKEY SOFTWARE QUALITY REPORT 2016-17
WHAT ARE YOUR TOP CHALLENGES
WHILE CREATING TEST DATA?
44%
26%
42%
22%
37%
21%
31%
18%
28%
17% 15%
Up to date (timely)
Privacy
Consistency Resemblance of real data
Skilled staff
* multiple selection was allowed
Data size
Security
Conformance to regulatory
compliance
Undefined data relations
Lack of tools Bureaucratic permission
processes
13. ANALYSIS OF THE CURRENT SITUATION
Lack of production-like data, in several
circumstances, may prevent test teams to achieve
reliable test results. Unsurprisingly, the most
critical issue is still not having the most up-to-
date production-like data for testing purposes and
sustaining the consistency within those data. Almost
half of the participants agree that using up-to-date
data is the top challenge they are currently facing
with. Other challenges can be listed as the timeliness
and security of the test data and the capability of the
test data to reflect live data characterictics.
FUTURE PREDICTIONS
Lack of production-like data will probably
continue to be the most important issue for
upcoming years. By investing on powerful
test data management tools and establishing
solid processes, test teams may lower these
proportions. In addition, software testers working
closely with DBAs (Database Administrators),
may lower the effects of inconsistent and
undefined data relations but will not eliminate the
challenges 100%.
11TURKEY SOFTWARE QUALITY REPORT 2016-17
14. HOW DO YOU PROTECT SENSITIVE DATA
IN TEST ENVIRONMENTS?
51% 27% 22%
19% 18%
Masking data Generating synthetic data Shuffling data
Relying on personal integrity We don’t protect sensitive test data
ANALYSIS OF THE CURRENT SITUATION
Survey results indicate that, majority of the
organizations are trying to secure their test data
systematically. Particularly in finance, banking and
insurance sectors, legal and regulatory obligations
force enterprises to protect their sensitive data.
In order to achieve the best protection, most of the
organizations are masking their test data (51%), they
are generating synthetic test data (27%) and they
shuffle sensitive data (22%) to make anonymous
test data sets. On the other hand, around 20% of
the organizations still rely on personal integrity on
protecting their sensitive data, and around 18% of
respondents indicate that there exist no defined
procedures for protecting their sensitive data. This
means more risks are carried for no reward.
FUTURE PREDICTIONS
Trend is promising. Day by day, test data
management is seen as an independent activity.
With the newest advancements in Big Data,
organizations will focus more on protecting
their test data. Power of analytics will make
organizations more able to foresee deterministic
behaviors of their users, and predict non-
deterministic outcomes.
12 TURKEY SOFTWARE QUALITY REPORT 2016-17
* multiple selection was allowed
15. 13TURKEY SOFTWARE QUALITY REPORT 2016-17
WHICH ONE BEST DESCRIBES YOUR
TEST DATA QUALITY?
53%
15%
13%
19%
Poor
We don’t have
sufficient
test data
in our test
environment
Incomplete
There exists
inconsistencies
between
production and
test databases
Improving
Essential
test data is
standardized
but there are
still problems
Good
Continuous
data
improvement
processes are
in place
ANALYSIS OF THE CURRENT SITUATION
Test Data Management is the new hot topic of
software testing industry without any doubt. Many
organizations have started to invest in this area and
even some have observed satisfactory results. More
than two thirds of the participants indicate that, they
have standardized their test data processes with few
problems. On the contrary, some organizations still
suffer from data inconsistencies and shortages in
test environments.
Although there might be a plenty of different causes,
problems seem rooted in architectural deficiencies.
These problems are distinctly rare among well-
defined engineering processes.
FUTURE PREDICTIONS
Distance covered so far, especially in the lastest
few years, points that upcoming improvements in
sense of test data management will happen in a
short time. With the development of new software
engineering patterns, such as micro-services,
obstacles impeding can be removed and processes
can be defined.
It should be always remembered that better
testing increases software development quality,
while proper data boosts test quality.
16. WHAT PERCENTAGE OF YOUR TEST DATA
MANAGEMENT EFFORTS ARE AUTOMATED?
59% 20% 17% 4%
0-20%
of efforts
21-50%
of efforts 51-75%
of efforts
76-100%
of efforts
ANALYSIS OF THE CURRENT SITUATION
Survey shows that many organizations do not have
any automated processes for test data management.
Instead, they still have manual processes on-board to
handle test data management needs. As the survey
indicates, only 4% of the organizations have fully
automated their test data management processes
which are supported by a commercial tool or at least
the data scripts are in place. When there’s lack of
automation or tooling in test data management
processes, testers focus more on preparing test data
instead of executing tests. Besides, testers working
with insufficient test data, focus more on “happy-
path” scenarios where the benefits of negative
testing is not realized.
FUTURE PREDICTIONS
In today’s world, the number of IT projects grow
very rapidly and the need of testing is higher than
it was before. In order to conduct high quality
testing, test data quality seems to be an important
driver. To be able to testing the applications
rigorously, organizations should provision high
quality ‘fit for purpose’ test data, regardless of
which methodologies or tools they use. In practice,
there are constraints and challenges to manage
test data manually. For those reasons, it is
expected that number of organizations investing
more on test data management activities will
increase drastically.
14 TURKEY SOFTWARE QUALITY REPORT 2016-17
17. 15TURKEY SOFTWARE QUALITY REPORT 2016-17
HOW DO YOU MANAGE DATA USED
BY AUTOMATED FUNCTIONAL TESTS?
41%
18%
17%
24%
Manual maintenance (Integrated data)
Data-driven approach (External data source)
Dynamic data generation (Just-in-time data
manipulation)
Database manipulation (Before and After Scripts)
ANALYSIS OF THE CURRENT SITUATION
Survey indicates that 41% of the organizations which
are automating their test cases, have manually
inserted test data into their test scripts. 24% of the
organizations seem to refresh their test database
before and after the automated test execution.
Database refresh is realized by the help of DB
scripts to create a clean data set and to rollback
the ‘dirty/used’ data after the test runs. 18% of
the organizations are using external data sources
like csv’s or properties files and the rest of the
participants are creating dynamic data sets for their
automation scripts to have brand new data set for
their test runs.
FUTURE PREDICTIONS
In today’s environment of shorter SDLCs, test
automation becomes an increasingly critical and
strategical necessity. A good test automation
framework can be achieved by the separation of
test data and test scripts. As some organizations
see the potential benefits of test data abstraction,
they will try to adopt Data-Driven Test Automation
framework into their test automation logic. As
a consequence, they will achieve more reusable
test scripts. Besides, test maintenance costs
will be less and test coverage will be better. With
the rise of the automation, it is also expected to
see decreases on database manipulation that
demands qualified workforce.
18. 16 TURKEY SOFTWARE QUALITY REPORT 2016-17
WHAT ARE YOUR
TOP THREE TEST LEVELS/TYPES
THAT YOU NEED
TO GENERATE YOUR TEST DATA?
* multiple selection was allowed
19. 14%
Security
Test
91%
Functional
Test
45%
Performance
Test
63%
Integration
Test
30%
Unit
Test
57%
Regression
Test
ANALYSIS OF THE CURRENT SITUATION
As it can be clearly observed from the results, almost
all the critical testing activities require test data.
Functional testing has the most hits, since it is one of
the most commonly used test types among different
industries and domains. Furthermore, integration
testing, security testing, performance testing and
unit testing seem to be other high priority technical
testing activities in which reliable and consistent test
data is essentially required.
FUTURE PREDICTIONS
With the increasing importance and necessity
of test data in any software testing activity;
test experts will focus more on identifying test
data requirements and test data management
solutions will provide more flexible solutions for
test management tool integrations. By the help
of these potential evolvements, technical test
activities and especially regression testing will
catch up with functional testing and top three test
types/levels will be head-to-head.
17TURKEY SOFTWARE QUALITY REPORT 2016-17
20. 18 TURKEY SOFTWARE QUALITY REPORT 2016-17
ANALYSIS OF THE CURRENT SITUATION
One of the most important questions that the
respondent are concerned with is the use of live data
during software testing activities. Referring to the
answers given on this issue, we observe that nearly
half of the institutions are testing with live data. Even
during these tests, another important indicator that
needs to be considered is that the live data is used
without masking/de-sensitizing of sensitive data.
FUTURE PREDICTIONS
Although the Banking, Finance, Insurance,
Telecommunications and Defense Industry
sectors are regulated by supervisory institutions
for the use of sensitive data, though, still data to
be used in many sectors in the testing process
is transported from the live environments with
unplanned and unstructured processes. Ultimately,
in the near future it is anticipated that; laws and
regulations affecting the IT organizations will
be more widespread among different industries.
Moreover, these regulations will gain more
maturity and they will grow in a way that affect all
organizations that handle sensitive data.
DO YOU USE UNMASKED LIVE DATA
IN YOUR TESTS?
40% Yes No60%
21. 19TURKEY SOFTWARE QUALITY REPORT 2016-17
CONTRIBUTORS
Berk Dülger
Keytorc
Merve İçöz
TTB
Sera Seren
TTB
Canberk Akduygu
Keytorc
Koray Yitmen
TTB (Chair)
Emine Çelik
Turkcell Global Bilgi
Tolga Mırmırık
WeBeYou
Halit Özdemir
OdeaBank
Besim Kosova
Keytorc
Kadir Herkiloğlu
Havelsan
Duygu Onaral Fatma Molu
Kuveyt Türk
Okan Coşkun
Scala Mice
Emrah Yayıcı
BA-Works
Pınar Cinali
BA-Works
Ahmet İzgi
Logo
Barış Sarıalioğlu
Keytorc
Vilma Orancı
TEB
22. 20 TURKEY SOFTWARE QUALITY REPORT 2016-17
ABOUT
Turkish Testing Board (TTB) is the regional body representing and supporting
software testing professionals in Turkey. The TTB was constituted in Istanbul in
September 2006 as a non-profit organization and a member of the International
Software Testing Qualifications Board (ISTQB).
TTB is responsible for certification of testing professionals to the standards and
syllabi laid down by the ISTQB. TTB also acts to generate public awareness of the
economic and risk mitigation benefits that professional software testing practice
offers.
www.turkishtestingboard.org
TestIstanbul is the largest conference in South East Europe and Middle East on
software testing. TestIstanbul introduces the region not only to the advancements
in software testing but also to the advancements in other streams of SDLC
like business analysis, design, development and usability. With its almost 400
participants from all over the world every year, TestIstanbul creates a healthy
discussion and networking platform for IT professionals and organizations.
www.testistanbul.org
ISTQBisaglobal,non-profitorganizationresponsibleforenablingtestprofessionals,
through globally accepted software testing certification standards to support their
career development. As of June 2015, ISTQB has issued over 410.000 certifications
in more than 100 countries.
www.istqb.org