AI is the new buzzword, everybody is talking about it and how it will change and influence our lives. When we talk about AI we talk about machines learning from data, exactly like a child is learning from his/her family or the experiences he/she makes. Humans though, while they grow up, can develop biases. Could this happen to an AI too? Starting from a real story, what would happen if a machine learning algorithm learns from a toys catalog?

1. guenda-sciancalepore
TechShivaWolf
@Guenda_s
Cloud Solution Architect – Data & AI
Guenda Sciancalepore

2. What if AI was your daughter?

3. My studies…

4. I’m an aunt!

5. What should I buy
her?

7. The toys…

8. Can I create a machine learning model to categorize toys?
Step 0:
the question

9. Cropping the pictures from toys catalogs.
Step 1:
pre-processing

10. Azure Cognitive Services
The most comprehensive pre-trained AI
Vision Speech Search Language Decision

11. Step 2:
custom vision
Creating a model able to recognize my categories:
• Boy toys’ vs girl toys’
• Creative vs no-creative toys

12. Demo:
CUSTOM VISION
customvision.ai

13. Step 3:
Evaluate the model
Checking the model performance.

14. Results
• The model learned to categorize boy toys vs girl toys;
• The model learned that all boy toys are blue and all girl toys are pink;
• Another model learned to categorize creative toys vs non-creative toys;
• None of the toys tagged for girls and sent to the other model were tagged as creative;
• From the dataset the model (and I) learned that scientific toys aren’t meant for girls.

15. Sorry, what?
• Can’t a girl be creative?
• Can’t a girl love other colors?
• Can’t a girl be a scientist?

17. Actually….

18. And again...

19. Last but not least…

20. We all have unconscious bias.
Are we really?

21. Learned stereotypes that are
automatic, unintentional, deeply
engrained, universal and able to
influence behavior.
Unconscious bias

22. Jennifer Eberhardt
“Implicit bias is not a new way of calling someone a racist. In fact, you
don’t have to be a racist at all to be influenced by it. Implicit bias is a
kind of distorting lens that’s a product of both the architecture of our
brain and the disparities in our society.”

23. Implicit
Test
Association

24. So, what if AI was your
daughter?

25. Satya Nadella
“It is not just having the representation. It is how is the culture of
your organization is going to help people who come from diverse
backgrounds do their very best work.”

26. Thanks and …
See you soon!
Thanks also to the sponsors.
Without whom this would not have been posible.
O R G A N I Z A T I O N
P L A T I N U M S P O N S O R S
C O L L A B O R A T O R S

27. guenda-sciancalepore
TechShivaWolf
@Guenda_s
Cloud Solution Architect – Data & AI
Guenda Sciancalepore
Questions?