IoT testing: How to overcome 5 big challenges
•Download as PPTX, PDF•
1 like•256 views
Effective testing is critical. But what's the best approach? Here are some considerations for testing IoT devices, and some tips that you can use to help you address them.
Recommended
Recommended
More Related Content
Similar to IoT testing: How to overcome 5 big challenges
Similar to IoT testing: How to overcome 5 big challenges (20)
Recently uploaded
Recently uploaded (20)
IoT testing: How to overcome 5 big challenges
- 2. Israel Rogoza IoT Testing Overcoming the challenges I_ROGOZA
- 3. About me
- 4. 7 years of experience in enterprise software development and testing About me
- 5. 7 years of experience in enterprise software development and testing Inbound Product Manager at HPE About me
- 8. About me
- 9. About me
- 10. About me
- 11. New technology, Same issues
- 12. ”20 billion IoT devices will be in use in 2027…” Gartner, Newsroom, Egham, U.K., February 7, 2017
- 14. Challenges
- 15. • Can’t stop work because of missing dataChallenges
- 16. • Can’t stop work because of missing data • Security testing scope is critical Challenges
- 17. • Can’t stop work because of missing data • Security testing scope is critical • It’s only the beginning Challenges
- 18. • Can’t stop work because of missing data • Security testing scope is critical • It’s only the beginning • Non-standard ways of communication Challenges
- 19. Getting Started
- 20. • Don’t change the way you workGetting Started
- 21. • Don’t change the way you work • Don’t neglect the Automation Getting Started
- 22. • Don’t change the way you work • Don’t neglect the Automation • Focus on usability and integration tests Getting Started
- 23. • Don’t change the way you work • Don’t neglect the Automation • Focus on usability and integration tests • Keep performance high across all devices Getting Started
- 25. “More than 70% of IoT devices are currently vulnerable to security threats” “Securityweek” By Eduard Kovacs on July 29, 2014
- 26. Security – It’s not nice to have It’s a must !
- 30. So how can we test it?
- 31. So how can we test it? • Network virtualization
- 32. So how can we test it? • Network virtualization • Metrics virtualization
- 33. So how can we test it? • Network virtualization • Metrics virtualization • Service virtualization
- 34. Use case example
- 35. Let’s summarize
- 36. Don’t panic, keep working
- 37. Don’t panic, keep working
- 38. Security
- 39. Security
- 42. Usability
- 43. Usability
- 46. IoT is the future…
- 47. And the future is here
- 49. Thank you for listening! @I_Rogoza https://il.linkedin.com/in/israelrogoza rogozai@gmail.com
Editor's Notes
- Thank you mike. Hello everyone, good afternoon My name is israel rogoZA and I'm very excited to be here today and take part in this wonderful convention. (אם מישהו יציג אותך לפני, חשוב שתדע איך קוראים לו ולהגיד לו ט׳נק יו פור הבינג מי איר)
- Crazy about football and Huge fan of 80 and 90 football clubs and players
- Owns an Alfa Romeo and love everything that is related to this brand
- And addicted to Apple products
- My own story
- Gartner says that more than 6.4 billion Internet of things (IOT) devices will be in use in 2017. That number will grow to more than 20 billion by 2027 overcoming this huge testing scope is a challenge
- It’s a whole new world today From smart watch that monitor you blood pressure to smart cars and industrial Someone need to test those software and hardware
- So what are some of the challenges we are facing?
- Gathering information from your end users might be difficult Usage analytics of new IoT products are an unknown factor
- Testing scope is huge but must be tested, potential harm is on the raise
- Testing all possible usage scenarios is more complex. Clear requirements, detailed test plan, unit testing, continuous integration and good communication should be a part of your test strategy
- NFC,BT,wifi - are only one the 3 most common but each IOT suppliers may have his own framework, this may require to coordinate and test those framework together and see that they can talk
- So how can overcome those challenges?
- Agile methodologies and continuous delivery, are well equipped for dealing with the demands of IOT Agile methods also support the use of automating the software delivery pipeline: from software builds, testing, and all the way through deployments and product updates. This is useful in the world of IOT
- The need for automated regression testing is present from the beginning of product development. , sheer volume Firmware change very fast, new versions released , you will need to keep track without breaking your product many IoT applications are front-ended by existing applications, and the service layer is existing APIs, you can test them without actually interacting with the device but when it comes to the IoT application itself consider using a Mock approach.
- what happens offline for a example, you will need a strong test strategy To design effective test cases, you have to understand the architecture, the OS, third party hardware, apps, firmware, new connectivity protocols and hardware device Think test first , IoT is successful if the Integration test plan is accurate and robust enough to catch flaws in the system. You will need advanced tools, consoles, viewers and simulators or your test effort will be severely hampered.המפארד
- Ddos Abuse of IOT devices – DDOS Someone else invites products Steal your credit card Taking abuse of the refrigerator sources Suddenly less cool
- According to security week: devices don't encrypt Internet and local network communications, half of their applications lacking transport encryption. manufacturers haven't ensured that software updates are downloaded in a secure manner, In October last year there was a attack on Dyn, a company that is a major provider of DNS services to other companies. In this attack hackers directing huge amounts of bogus traffic at targeted servers made it hard for major websites to work properly, including Twitter, GitHub, Tumblr, Spotify, PayPal, Verizon,PlayStation network
- Manufacturers are rushing to add features which require connection to the internet. In their rush to market these companies are bound to overlook the complications of hardware and software security design In the race of releasing the newest and coolest working function at lowest cost.
- So how we can test it? Those devices should be installed by my mother in less then 5 min’ How can we get inside the hacker head trying to avoid the next security bridged
- Self driving cars We cant give each QA a car We cant take the risk of a defect in the middle of the highway The cost is huge
- Network – simulate how your IOT behavierin different network conditions – example in the car. What happens if there's no signal
- Device metrics – imagine an error appear, “your car expiring a high cpu issue, please try again in a few minutes” or you are missing a turn because of a memory leak
- Service Virtualization can speed up things significantly enabling testers to be less dependent on test infrastructures, evading the glitches of interconnectivity. It emulates only the behavior of the specific dependent component. Instead of virtualizing an entire database, you monitor how the application interacts with the database and then replicate the related database behavior.
- MC – SV – NV Simulate the car in the manufacture app using NV. The appection is using the sim card inside the multimedia system to speak with the appection. Coffee machine
- Keep your daily work, the basic is very similar, make the needed adjustments
- Pay attention to Security and Performance
- Pay attention to Security and Performance
- Pay attention to Security and Performance
- Pay attention to Security and Performance The IoT isn’t exactly obscure anymore, and many devices have large customer bases. Don’t wait till there is a headline news story to understand your products’ security short comings. Performance must be consistently high across all devices and exceed user expectations
- Focus on Usability and Integration
- Focus on Usability and Integration
- Focus on Usability and Integration
- Focus on Usability and Integration If your software isn’t easy to use, then there will be problems. Check integration from the begging with other products/ protocols and other integration aspects from the begging
- The IoT is still a developing market; things are going to change a lot in the next few years