The document discusses capabilities of Microsoft Cognitive Services in extracting information from text and images, including features like OCR, emotion recognition, and language detection. It highlights the importance of managing unstructured data and includes references to relevant technologies and partners. Additionally, it features keywords and examples relevant to data analytics and cognitive skills within Azure.

1. http://devrain.com
https://www.linkedin.com/in/sashaeve/
https://www.facebook.com/alex.krakovetskiy

2. “Microsoft AI Inner Circle Program” member
Microsoft Silver Partner (Data Analytics)
Ukrainian IT Awards

7. 80%
of business relevant information is
unstructured

8. management free
keyword search
faceting language analyzers
geospatial support
suggestions/auto-complete
customizable scoring
proximity search
synonyms, etc.

9. TIFF HTML
…
JPG

10. JPG
Scott Guthrie
Title:
Executive Vice President,
C+E
Company: Microsoft
accent color: blue?

11. Cognitive Services capabilities
Infuse your apps, websites, and bots with human-like intelligence

12. Тема доклада
Тема доклада
Тема доклада
Extract information from text
Text Analytics

13. Extract information from text
Extract information from text
Description Values
LANGUAGES English
KEY PHRASES money laundering, criminal charges, prime
minister, Exchange, country, development,
Malaysia's capital, Kuala Lumpur, abuse of power,
MDB financial controversy, showpiece skyscraper
SENTIMENT Positive
NAMED ENTITIES Malaysia [Location]
Kuala Lumpur [Location]
106 [Quantity-Number]
first [Quantity-Ordinal]
December [DateTime-DateRange]
skyscraper [Location]
1Malaysia Development Berhad [Organization]

14. Extract information from text
Extract information from images

15. Extract information from text
Generate captions from images
"captions": [ {
"text": "a view of Sagrada Família",
"confidence": 0.9284265
} ]

16. Extract information from text
Optical character recognition (OCR) in images

17. Extract information from text
Recognize digital ink and handwriting

18. Extract information from text
Celebrity recognition in images

19. Extract information from text
Emotion recognition in images

20. Extract information from text
Landmark recognition in images

21. Extract information from text
Form recognizer

22. Extract information from text
Form recognizer

23. INGEST
Data in any
format, any
Azure store
ENRICH EXPLORE
Annotations
Cognitive skills
Search

24. Annotated
Documents
Customer
Data
Search
Index
INGEST ENRICH EXPLORE

25. Annotated
Documents
Customer
Data
Search
Index
INGEST ENRICH EXPLORE

27. Annotated
Documents
Customer
Data
Search
Index
INGEST ENRICH EXPLORE

29. Built-in skills
Azure
Databricks
Machine Learning
VMs
Azure Machine
Learning
Custom skills
Your custom
skill goes here!

30. OCR (text
recognition)

31. OCR (text
recognition)
redaction
classifier
cryptonym
extraction
handwritten
text recognition
face
detection
face
detection

32. https
Custom
translation
skill
{
"values": [
{
"recordId": "7cad2",
"data":
{
"value1":
"I owe you 5 grand"
}
},
{
"recordId": "7cad3",
"data":
{
"value1":
"Just my 2 cents",
}
},
…
]
}
{
"values": [
{
"recordId": "7cad2",
"data":
{
"myOuput1":
"Te debo cinco mil"
}
},
{
"recordId": "7cad3",
"data":
{
"myOutput1":
"Solo mis 2 centavos"
}
},
…
]
}

33. /document
/content
/normalized_images
/1
/2
/…
/n

34. "skills": [
{
"@odata.type": "#Microsoft.Skills.Text.LanguageDetectionSkill",
"inputs":
[
{ "name": "text", "source": "/document/content" }
],
"outputs":
[
{ "name": "languageCode", "targetName": "myLanguageCode" },
{ "name": "languageName", "targetName": "myLanguageName" }
]
},

35. …,
{
"@odata.type": "#Microsoft.Skills.Text.NamedEntityRecognitionSkill",
"categories": [ "Organization" ],
"defaultLanguageCode": "en",
"inputs":
[
{ "name": "text", "source": "/document/content" },
"name" "languageCode" "source" "/document/myLanguageCode"
],
"outputs":
[
{ "name": "organizations", "targetName": "organizations" }
]
},

36. /document
/content
/normalized_images
/1
/2
/…
/n
/myLanguageCode

37. /organizations
/1
/2
/n
/…
/document
/content
/normalized_images
/1
/2
/…
/n
/mylanguagecode

38. Annotated
Documents
Customer
Data
Search
Index
INGEST ENRICH EXPLORE

39. /document
/keyPhrases
/0
/1
/…
/n
/organizations
/0
/1
/…
/n
organizationId
organizationId
organizationId
organizationId
/images
/0
/1
/…
/n
tags
tags
tags
tags
Option 1: Flatten the data
{
…
"outputFieldMappings":
[
{
"sourceFieldName":
"/document/organizations/*/organizationId",
"targetFieldName":
"myClients"
} ,
…
]
}

41. https://azure.microsoft.com/en-us/services/search/
https://github.com/Azure-Samples/azure-search-
knowledge-mining
https://github.com/Azure/LearnAI-
KnowledgeMiningBootcamp