.NET Fest 2019. Олександр Краковецький. Knowledge mining with Azure Search

Тема доклада
KYIV 2019
Oleksandr Krakovetskyi, Ph.D.
Knowledge mining with Azure Search
.NET CONFERENCE #1 IN UKRAINE

“Microsoft AI Inner Circle Program” member
Ukrainian IT Awards

.NET LEVEL UP
The new era of data chaos
.NET CONFERENCE #1 IN UKRAINE KYIV 2019
80% of business relevant information is unstructured

.NET LEVEL UP
Levels of Understanding

.NET LEVEL UP
Definition of Knowledge Mining
Extraction of interesting (previously unknown
and potentially useful) models from data in
large databases.
See also: Data Mining, Insights Extracting

.NET LEVEL UP
Linked Data

.NET LEVEL UP
Microsoft Graph

.NET LEVEL UP
Microsoft Academic Graph

.NET LEVEL UP
Azure Search
Search-as-a-Service
management free
keyword search
faceting language analyzers
geospatial support
suggestions/auto-complete
customizable scoring
proximity search
synonyms, etc.

KYIV 2019
A Quick Intro to
Azure Cognitive Services

.NET LEVEL UP
Cognitive Services capabilities

.NET LEVEL UP
Extract information from text

.NET LEVEL UP
Extract information from text
Description Values
LANGUAGES English
KEY PHRASES money laundering, criminal charges, prime
minister, Exchange, country, development,
Malaysia's capital, Kuala Lumpur, abuse of power,
MDB financial controversy, showpiece skyscraper
SENTIMENT Positive
NAMED ENTITIES Malaysia [Location]
Kuala Lumpur [Location]
106 [Quantity-Number]
first [Quantity-Ordinal]
December [DateTime-DateRange]
skyscraper [Location]
1Malaysia Development Berhad [Organization]

.NET LEVEL UP
Language understanding

.NET LEVEL UP
Data recognition in images
JPG
Scott Guthrie
Title:
Executive Vice President,
C+E
Company: Microsoft
accent color: blue?

.NET LEVEL UP
Extract information from images

.NET LEVEL UP
Generate captions from images
"captions": [ {
"text": "a view of Sagrada Família",
"confidence": 0.9284265
} ]

.NET LEVEL UP
Optical character recognition (OCR) in images

.NET LEVEL UP
Recognize digital ink and handwriting

.NET LEVEL UP
Celebrity recognition in images

.NET LEVEL UP
Emotion recognition in images

.NET LEVEL UP
Landmark recognition in images

.NET LEVEL UP
Form recognizer

KYIV 2019
Cognitive Search
Architecture

.NET LEVEL UP
Cognitive Search Architecture
Annotated
Documents
Search
Index
INGEST ENRICH EXPLORE

.NET LEVEL UP
Document Cracking
Different types of data sources
• Blob Storage
• Azure SQL
• Cosmos DB
• Azure Tables
• MySQL
• Azure Files
File formats supported in
blob storage: PDF, XML, PNG, RTF,
JSON, HTML, DOC(X), PPT(X), XLS(X)

.NET LEVEL UP
Introducing Skillset

.NET LEVEL UP
Sample Skillset
OCR (text
recognition)

.NET LEVEL UP
Cognitive Skills
Built-in skills
Azure
Databricks
Machine Learning
VMs
Azure Machine
Learning
Custom skills
Your custom
skill goes here!

.NET LEVEL UP
Custom skill requirements
https
Custom
translation
skill
{
"values": [
{
"recordId": "7cad2",
"data":
{
"value1":
"I owe you 5 grand"
}
},
{
"data":
{
"value1":
"Just my 2 cents",
}
},
…
]
}
{
"values": [
{
"data":
{
"myOuput1":
"Te debo cinco mil"
}
},
{
"data":
{
"myOutput1":
"Solo mis 2 centavos"
}
},
…
]
}

.NET LEVEL UP
Knowledge Mining

Skillset Pipelines
OCR (text
recognition)
redaction
classifier
cryptonym
extraction
handwritten
text recognition
face
detection
face
detection

.NET LEVEL UP
Document Annotations
/document
/content
/normalized_images
/organizations
/1
/2
/…
/n
/1
/2
/n
organizationId
organizationId
organizationId
organizationId
/…
/mylanguagecode

.NET LEVEL UP
Search Index
• Define data sources
• Create Indexes
• Add custom cognitive skills
• Get REST API url

KYIV 2019
Demos

.NET LEVEL UP
JFK Files
In 2017, more than 34,000 pages related
to the JFK assassination were
released. It would take researchers
months to read through this volume
of documents. How can we take in
all this information and any new info
that’s released?
https://jfkfiles2.azurewebsites.net/

KYIV 2019
Questions?
alex.krakovetskiy@devrain.com

.NET Fest 2019. Олександр Краковецький. Knowledge mining with Azure Search

.NET Fest 2019. Олександр Краковецький. Knowledge mining with Azure Search

Recommended

More Related Content

More from NETFest

More from NETFest(20)

Recently uploaded

Recently uploaded(7)

.NET Fest 2019. Олександр Краковецький. Knowledge mining with Azure Search