This presentation gives an introduction to computer vision and some introduction to Microsoft Azure vision API. This was presented in a tech talk (Tech Mela) on May 28,2016

1. Computer Vision
(Machine Learning for
Developers)
Rachhek Shrestha
Software Developer
Microsoft Innovation Center Nepal

5. “Making Sense
of what you see”

6. ▪Most advanced computers still
struggle at “making sense”
▪What if machines could see?

8. “Collectively we as a society
are blind because our
smartest machines are blind.”
-Fei-Fei Li
Director of Standford’s AI
Lab

9. “Our ultimate goal is to
make computers see
just as we do.”

11. “Khagendra”
Carpet
Standing
on
Cake
Happy
• Naming Objects
• Identifying People
• 3D Geometry
• Understanding
• Relations
• Emotions
• Actions
• Intentions

12. How do you teach a
computer to see an
object?

13. OutputInput
In Simple terms, imagine showing training
Images to learn from
Create a training model

14. Cat
In this example a cat

15. How
hard can
this be?

16. Mathematically
a cat has a
round face, two
pointy ears,
chubby body
and a long tail

17. Cat

22. Instead of creating object
models, hundreds of
thousands of pictures were
collected from the internet
and an algorithm was used.

27. 24 M nodes, 140 M parameters
15 B connections

29. Machine Learning Example

30. Machine Learning Example

31. Machine Learning Example
Need for an algorithm that
can write the rules for us so
that we don’t have to write it
by hand.

32. Machine Learning Example
Train a Classifier(Function)
Classifier takes some data as input and assigns label to it as output

33. Machine Learning Example
Example of Classifying

35. Machine Learning Example

37. Microsoft’s Machine
Learning APIs
Microsoft Cognitive Services

38. Microsoft Emotion API
https://www.microsoft.com/cognitive-services/en-us/emotion-api

39. Microsoft Emotion API
https://www.microsoft.com/cognitive-services/en-us/emotion-api

40. Microsoft Vision API
https://www.microsoft.com/cognitive-services/en-us/vision-api
Extract rich information from images to categorize and process visual data

41. Microsoft Vision API
https://www.microsoft.com/cognitive-services/en-us/vision-api
Extract rich information from images to categorize and process visual data

42. Microsoft Face API
https://www.microsoft.com/cognitive-services/en-us/face-api
Extract rich information from images to categorize and process visual data

44. Interesting Apps
Microsoft Cognitive Services

45. Captionbot.ai
Extract rich information from images to categorize and process visual data

46. Mimicker Alarm

47. How-old.net

48. Thank you !
References
▪ Fei-Fei Li: How we're teaching
computers to understand pictures
– http://www.ted.com/talks/fei_fei_li_how_we_r
e_teaching_computers_to_understand_pictur
es
▪ Microsoft Cognitive services
▪ https://www.youtube.com/user/Google
Developers