Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

.NET Fest 2019. Олександр Краковецький. Knowledge mining with Azure Search

30 views

Published on

Uncover latent insights from all your content — documents, images, and media – with Azure Search. Using the only cloud search service with built-in AI capabilities, discover patterns and relationships in your content, understand the sentiment, extract key phrases and more. In this presentation, you will learn more about Azure Search, Forms Recognizer, Cognitive Skills and how to improve understanding of your data. This presentation will be interesting for developers and architects, DevOps, and Data Scientists.

Published in: Education
  • Be the first to comment

  • Be the first to like this

.NET Fest 2019. Олександр Краковецький. Knowledge mining with Azure Search

  1. 1. Тема доклада Тема доклада Тема доклада KYIV 2019 Oleksandr Krakovetskyi, Ph.D. Knowledge mining with Azure Search .NET CONFERENCE #1 IN UKRAINE
  2. 2. “Microsoft AI Inner Circle Program” member Ukrainian IT Awards
  3. 3. Тема доклада Тема доклада Тема доклада .NET LEVEL UP The new era of data chaos .NET CONFERENCE #1 IN UKRAINE KYIV 2019 80% of business relevant information is unstructured
  4. 4. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Levels of Understanding .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  5. 5. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Definition of Knowledge Mining .NET CONFERENCE #1 IN UKRAINE KYIV 2019 Extraction of interesting (previously unknown and potentially useful) models from data in large databases. See also: Data Mining, Insights Extracting
  6. 6. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Linked Data .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  7. 7. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Microsoft Graph .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  8. 8. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Microsoft Academic Graph .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  9. 9. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Azure Search .NET CONFERENCE #1 IN UKRAINE KYIV 2019 Search-as-a-Service management free keyword search faceting language analyzers geospatial support suggestions/auto-complete customizable scoring proximity search synonyms, etc.
  10. 10. TIFF HTML … JPG
  11. 11. Тема доклада Тема доклада Тема доклада KYIV 2019 A Quick Intro to Azure Cognitive Services .NET CONFERENCE #1 IN UKRAINE
  12. 12. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Cognitive Services capabilities .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  13. 13. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Extract information from text .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  14. 14. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Extract information from text .NET CONFERENCE #1 IN UKRAINE KYIV 2019 Description Values LANGUAGES English KEY PHRASES money laundering, criminal charges, prime minister, Exchange, country, development, Malaysia's capital, Kuala Lumpur, abuse of power, MDB financial controversy, showpiece skyscraper SENTIMENT Positive NAMED ENTITIES Malaysia [Location] Kuala Lumpur [Location] 106 [Quantity-Number] first [Quantity-Ordinal] December [DateTime-DateRange] skyscraper [Location] 1Malaysia Development Berhad [Organization]
  15. 15. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Language understanding .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  16. 16. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Data recognition in images .NET CONFERENCE #1 IN UKRAINE KYIV 2019 JPG Scott Guthrie Title: Executive Vice President, C+E Company: Microsoft accent color: blue?
  17. 17. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Extract information from images .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  18. 18. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Generate captions from images .NET CONFERENCE #1 IN UKRAINE KYIV 2019 "captions": [ { "text": "a view of Sagrada Família", "confidence": 0.9284265 } ]
  19. 19. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Optical character recognition (OCR) in images .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  20. 20. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Recognize digital ink and handwriting .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  21. 21. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Celebrity recognition in images .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  22. 22. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Celebrity recognition in images .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  23. 23. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Emotion recognition in images .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  24. 24. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Landmark recognition in images .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  25. 25. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Form recognizer .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  26. 26. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Form recognizer .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  27. 27. Тема доклада Тема доклада Тема доклада KYIV 2019 Cognitive Search Architecture .NET CONFERENCE #1 IN UKRAINE
  28. 28. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Cognitive Search Architecture .NET CONFERENCE #1 IN UKRAINE KYIV 2019 Annotated Documents Search Index INGEST ENRICH EXPLORE
  29. 29. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Cognitive Search Architecture .NET CONFERENCE #1 IN UKRAINE KYIV 2019 Annotated Documents Search Index INGEST ENRICH EXPLORE
  30. 30. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Document Cracking .NET CONFERENCE #1 IN UKRAINE KYIV 2019 Different types of data sources • Blob Storage • Azure SQL • Cosmos DB • Azure Tables • MySQL • Azure Files File formats supported in blob storage: PDF, XML, PNG, RTF, JSON, HTML, DOC(X), PPT(X), XLS(X)
  31. 31. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Cognitive Search Architecture .NET CONFERENCE #1 IN UKRAINE KYIV 2019 Annotated Documents Search Index INGEST ENRICH EXPLORE
  32. 32. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Introducing Skillset .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  33. 33. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Sample Skillset .NET CONFERENCE #1 IN UKRAINE KYIV 2019 OCR (text recognition)
  34. 34. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Cognitive Skills .NET CONFERENCE #1 IN UKRAINE KYIV 2019 Built-in skills Azure Databricks Machine Learning VMs Azure Machine Learning Custom skills Your custom skill goes here!
  35. 35. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Custom skill requirements .NET CONFERENCE #1 IN UKRAINE KYIV 2019 https Custom translation skill { "values": [ { "recordId": "7cad2", "data": { "value1": "I owe you 5 grand" } }, { "recordId": "7cad3", "data": { "value1": "Just my 2 cents", } }, … ] } { "values": [ { "recordId": "7cad2", "data": { "myOuput1": "Te debo cinco mil" } }, { "recordId": "7cad3", "data": { "myOutput1": "Solo mis 2 centavos" } }, … ] }
  36. 36. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Knowledge Mining .NET CONFERENCE #1 IN UKRAINE KYIV 2019
  37. 37. Skillset Pipelines .NET CONFERENCE #1 IN UKRAINE KYIV 2019 OCR (text recognition) redaction classifier cryptonym extraction handwritten text recognition face detection face detection
  38. 38. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Document Annotations .NET CONFERENCE #1 IN UKRAINE KYIV 2019 /document /content /normalized_images /organizations /1 /2 /… /n /1 /2 /n organizationId organizationId organizationId organizationId /… /mylanguagecode
  39. 39. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Cognitive Search Architecture .NET CONFERENCE #1 IN UKRAINE KYIV 2019 Annotated Documents Search Index INGEST ENRICH EXPLORE
  40. 40. Тема доклада Тема доклада Тема доклада .NET LEVEL UP Search Index .NET CONFERENCE #1 IN UKRAINE KYIV 2019 • Define data sources • Create Indexes • Add custom cognitive skills • Get REST API url
  41. 41. Тема доклада Тема доклада Тема доклада KYIV 2019 Demos .NET CONFERENCE #1 IN UKRAINE
  42. 42. Тема доклада Тема доклада Тема доклада .NET LEVEL UP JFK Files .NET CONFERENCE #1 IN UKRAINE KYIV 2019 In 2017, more than 34,000 pages related to the JFK assassination were released. It would take researchers months to read through this volume of documents. How can we take in all this information and any new info that’s released? https://jfkfiles2.azurewebsites.net/
  43. 43. Тема доклада Тема доклада Тема доклада KYIV 2019 Questions? alex.krakovetskiy@devrain.com .NET CONFERENCE #1 IN UKRAINE

×