Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Charla TestingUy 2019 - Inteligencia Artificial y Testing: ¿Qué está pasando?

98 views

Published on

Expositor: Guillermo Skrilec

Resumen: Hemos sido invadidos por software que utiliza Inteligencia Artificial para resolver problemas donde antes se necesitaba una persona para hacerlo. Recibimos mucha información de distintas herramientas que están usando Inteligencia Artificial para probar aplicaciones automáticamente. Tenemos que entender lo que está pasando con Inteligencia Artificial en el mundo del Testing, este es el objetivo de la charla.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Charla TestingUy 2019 - Inteligencia Artificial y Testing: ¿Qué está pasando?

  1. 1. @gskrilec| @QAlifiedUy | #testinguy Artificial Intelligence and Testing: What’s going on? Guillermo Skrilec gskrilec@qalified.com @gskrilec 13 y 14 de mayo, 2019 testinguy.org @testinguy | #testinguy CHARLA
  2. 2. @gskrilec| @QAlifiedUy | #testinguy Understanding AI Testing AI Applications AI applied to Testing
  3. 3. @gskrilec| @QAlifiedUy | #testinguy Non-AI Systems SYSTEM Output USER DEVELOPER DETERMINISTIC LOGIC
  4. 4. @gskrilec| @QAlifiedUy | #testinguy AI Systems PROBABILISTIC LOGIC USER DEVELOPER SYSTEM Output “Defines rules” LEARNING ALGORITHM Train
  5. 5. @gskrilec| @QAlifiedUy | #testinguy Deep Learning (Supervised Learning) Define problem Collect data Define model Training Testing - Selection - Labeled - Pre-processing - Validation
  6. 6. @gskrilec| @QAlifiedUy | #testinguy Testing AI Applications
  7. 7. @gskrilec| @QAlifiedUy | #testinguy Critical Challenge for AI Training Data Learning Process Learned Function This is a dog (p = 0.93) When do you fail? When can I trust you? How do I correct an error? ¿? Why did you do that? Why not something else? When do you succeed?
  8. 8. @gskrilec| @QAlifiedUy | #testinguy What do Neural Networks see? http://scs.ryerson.ca/~aharley/vis/conv/flat.html
  9. 9. @gskrilec| @QAlifiedUy | #testinguy Data Biases
  10. 10. @gskrilec| @QAlifiedUy | #testinguy Data Biases
  11. 11. @gskrilec| @QAlifiedUy | #testinguy Data Biases
  12. 12. @gskrilec| @QAlifiedUy | #testinguy https://twitter.com/michaelbolton/status/1095802062099632131
  13. 13. @gskrilec| @QAlifiedUy | #testinguy “We must keep laser-focused on problems in code, training data, testing data, and ethics, lest AI becomes Arrogant Incompetence and Amplified Injustice.” Michael Bolton
  14. 14. @gskrilec| @QAlifiedUy | #testinguy AI is not explainable + Data biases = Bugs
  15. 15. @gskrilec| @QAlifiedUy | #testinguy Training
  16. 16. @gskrilec| @QAlifiedUy | #testinguy Training Underfitting Appropriate Overfitting A wrong answer might be OK?
  17. 17. @gskrilec| @QAlifiedUy | #testinguy Recall vs Precision
  18. 18. @gskrilec| @QAlifiedUy | #testinguy Testing AI Applications Recap Bugs: Recall or Precision? AI is Not Explainable ¿? Data defines Success
  19. 19. @gskrilec| @QAlifiedUy | #testinguy AI applied to Testing
  20. 20. @gskrilec| @QAlifiedUy | #testinguy Test Automation Click shopping cart
  21. 21. @gskrilec| @QAlifiedUy | #testinguy Test Automation AI -> Object detection https://cloud.google.com/vision/ Still didn’t find that shopping cart… Google can’t find it. How can we? We build our “own” ML for testing.
  22. 22. @gskrilec| @QAlifiedUy | #testinguy Test Automation
  23. 23. @gskrilec| @QAlifiedUy | #testinguy Test Automation Model Training 2 hours later…
  24. 24. @gskrilec| @QAlifiedUy | #testinguy Test Automation Click shopping cart
  25. 25. @gskrilec| @QAlifiedUy | #testinguy Test Automation https://github.com/testdotai/appium-classifier-plugin https://medium.com/testdotai/adding-ai-to-appium-f8db38ea4fac
  26. 26. @gskrilec| @QAlifiedUy | #testinguy Jason Arbon “People fear automation, but I fear the distracted driver. I also fear emotion-driven regulation and testing practices based on anecdotes instead of statistics and fact.”
  27. 27. @gskrilec| @QAlifiedUy | #testinguy
  28. 28. @gskrilec| @QAlifiedUy | #testinguy
  29. 29. @gskrilec| @QAlifiedUy | #testinguy
  30. 30. @gskrilec| @QAlifiedUy | #testinguy
  31. 31. @gskrilec| @QAlifiedUy | #testinguy
  32. 32. @gskrilec| @QAlifiedUy | #testinguy
  33. 33. @gskrilec| @QAlifiedUy | #testinguy https://twitter.com/michaelbolton/status/1123939393721511944
  34. 34. @gskrilec| @QAlifiedUy | #testinguy Test Autonomy Levels
  35. 35. @gskrilec| @QAlifiedUy | #testinguy
  36. 36. @gskrilec| @QAlifiedUy | #testinguy Guillermo Skrilec gskrilec@qalified.com @gskrilec 13 y 14 de mayo, 2019 testinguy.org | @testinguy | #testinguy ¿PREGUNTAS? ¡MUCHAS GRACIAS!

×