Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

SharePoint Saturday Zurich 2018 21st century lunchbell


Published on

Office365 Cognitive Services Azure IoT SharePoint Community

Published in: Technology
  • Be the first to comment

  • Be the first to like this

SharePoint Saturday Zurich 2018 21st century lunchbell

  1. 1. Integrate the 21st Century Lunch Bell into your Modern Workplace Thomas Gölles - @thomyg Stephan Bisser - @cloudguy_pro SharePoint Saturday Zurich 26.5.2018
  2. 2. Thanks to our Sponsors <3
  3. 3. Thomy Head of Modern Workplace Solutions Co-Organizer of SharePoint Saturday Vienna (#SPSVIE), Office 365 Meetup Graz, Office 365 Meetup Vienna @thomyg
  4. 4. Stephan • Consultant @SOLVION (O365 & Azure) • Microsoft AI MVP • P-TSP @Microsoft for Azure • AI (Cognitive Services & Bots) • Azure & O365 • Soccer @cloudguy_pro AskCloudguy
  5. 5. Agenda 1 Little bit of background 2 “Bussiness Problem” 3 Tech geek out 4 DEMO
  6. 6. Our Office in Graz, Austria
  7. 7. This was Thomy‘s view before he switched rooms
  8. 8. Lunchtime at our office (around 10:45)
  9. 9. Yummy
  10. 10. This is Thomy‘s view after he switched rooms (now)
  11. 11. Possible solutions • Create a recurrent event in Outlook • “Ping” a colleague everyday • Stand up and have a look • Use technology to solve the problem
  12. 12. MOCADESYMO was born • Penny: Well, you know, it’s the Cheesecake Factory. People order cheesecake, and I bring it to them. • Leonard: So, you sort of act as a Carbohydrate Delivery System. • Penny: Yeah, call it whatever you want, I get minimum wage. Mobile Monitor
  13. 13. MOCADESYMO
  14. 14. MOCADESYMO‘s view
  15. 15. 1. Raspberry PI camera takes photo of food truck, after it has arrived 2. Paspberry PI uploads the taken image into an Azure Blob Storage 3. Raspberry PI triggers an Azure Function after the image has been uploaded successfully 4. Azure Function calls the Custom Vision API in order to check wether the food truck is present or not 5. If the Custom Vision API responds with a high probability that the food truck has arrived, the Azure Function sends a notification to Teams 6. Users can ask the Lunchbell Bot in Teams wether the food truck has arrived or not or if it is still present 7. Azure Bot Service checks the entries in an Azure Table Storage where the arrival and departure time is stored Architecture of the 21st century lunchbell
  16. 16. Bots & Cognitive Services
  17. 17. Chatbots 101 “a computer program designed to have a conversation with a human being, especially over the internet” * *
  18. 18. Microsoft Bot Framework
  19. 19. Microsoft Cognitive Services
  20. 20. Custom Vision Service • Upload images • Upload your own labeled images, or use Custom Vision Service to quickly tag any unlabeled images • Train • Use your labeled images to teach Custom Vision Service the concepts you want it to learn • Evaluate • Use simple REST API calls to quickly tag images with your new custom computer vision model • Active learning • Images evaluated through your custom vision model become part of a feedback loop you can use to keep improving your classifier Normal State98,53 % True100 % True99,9 % True
  21. 21. Language Understanding [ $LunchBell.Object ] [ $LunchBell.Operation ] „Has the food truck arrived?“ Has the food truck arrived? Intent = CheckArrivalState
  22. 22. LUIS
  23. 23. SharePoint Portal
  24. 24. Demo Case
  25. 25. Evaluation Form This survey is anonymous, but you can voluntarily enter your name and email address for a chance to win a license of Nintex Workflow Cloud. Consent is necessary to participate to the lottery.
  26. 26. Thank you for attending!