The presentation on The way to recover the issue faced in IoT regression Testing was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author. Author and presenter : Anuradha Band

1. #ATAGTR2017
16th 17th March
The way to recover the issue faced
in IoT regression Testing
Anuradha Band

2. Agile Testing Alliance Global Testing Retreat 2017
IoT :
Wikipedia
The Internet of Things refers to the interconnection of uniquely identifiable
embedded computing like devices with the existing Internet infrastructure.
Issues in IoT testing :
Some of the issue listed below :
 It is expensive to replicate the environment required for IoT testing and
demands too much of effort.
 In order to obtain the right test data among different systems, Substantial
effort is required.
Here we will discuss on the 2nd issue mentioned above.

3. Agile Testing Alliance Global Testing Retreat 2017
Business Case :
Machine needs maintenance. Fluid level simply helps machine operator to do
maintenance actions (like add / change the oil). The issue is that without the oil
machine "blades" may break up.
So ideally here we need to automate the maintenance follow-up and make possible
to run machines longer without damages as machine produces more profit when it
has less amount of time down.
Measuring the fluid level was only one issue that is measured from the machine.
CNC
machine

4. Agile Testing Alliance Global Testing Retreat 2017
Scenario :
To capture the fluid level on a oil tank, we need to use the level sensors.
So, Initially we used real level sensors to make sure that measured values are shown
correctly on frontend. This takes 2-3 days by phyiscally going to laboratory.
We have regression tests for this,hence frequently going to laboratory is not
feasible choice.
Scenario Description:
The sensors reading is required to measure the fluid level on a oil tank.
If we use real sensors, testing time is increased not because of actual testing but due to
the activity performed for testing(like physically going and performing actions)

5. Agile Testing Alliance Global Testing Retreat 2017
Solution :
 As a part of regression testing ,using real sensors will not work as it will ultimately
effect the Testing performance .
 To take out the solution over this , after brainstorming, We decided to have more
reasonable approach that , to create a sensor simulator that provides similar values
like real sensors.
 This will results in getting actual values from the simulated sensors to the backend
and eventually to the frontend.
 Also the 2-3 days will be ustilise to have testing earlier than the actual time
currently had.

6. Agile Testing Alliance Global Testing Retreat 2017
Simulate the Sensors :
There are different sensors we know like Temperature sensor, Humidity sensor,
Pressure sensor .
To Simulte the sensors :
 Collect the data that real sensor provides.
 Make a Python script/selenium test case / Quick test pro test case that
submits messages like real sensor does.

7. Agile Testing Alliance Global Testing Retreat 2017
Briefly :
 Create a small tool which simulates the sensors so that it will submit similar
values like real sensors.
 Configure continuous integration system to fetch the source code from
version management system and build it to binary after each commit.
 Design and implement a python script / selenium test case / Quick test pro
test case that automates the test in order to check the interface functionality
correctness.
 Add test to continuous integration system and configure CI to run test set
after each commit to the version management system.

8. Agile Testing Alliance Global Testing Retreat 2017
Benefits :
 Reduced manual Effort
 Sensors costs reduced
 Less time to Market

9. Agile Testing Alliance Global Testing Retreat 2017