This AI session presented the power of both Azure Cognitive Services and Azure Search Service to extract, search and visualise meaning from a large set of unstructured documents.

1. UsingAzureCognitiveSearch
toDiveintotheCIAArchives

2. Azure AI + Data
• Azure Bot Service
• Azure Cognitive Services
Intelligent
Apps + Agents
• Azure Databricks
• Azure Machine Learning
Machine Learning
• Azure Cognitive SearchKnowledge Mining

3. Knowledge mining + Azure Cognitive Search
• The intelligent act of creating
actionable, structured information
from unstructured, large data such
as text, media and images
• Use of AI to help with automating
processes, ensuring safety or
improving search
Knowledge Mining
• The AI features for knowledge
mining in Azure Search
• Enrichment of content in the
indexing pipeline through skills
such as image analysis, OCR and
text analysis
Azure Cognitive Search

4. How Azure Cognitive Search works
2 Enrich1 Ingest 3 Explore
Cracked documents Enriched documentsSkillsData source
Indexer Query
Index Query
Blob Storage
TableStorage
Cosmos DB
SQL DB
Built-in
Custom
Searchable
Orderable
Filterable
Facetable
Azure Search SDK
Azure SearchAPI
CSV, Office, EML,
HTML, JSON, PDF,
RTF,TXT,XML,
ZIP

5. Built-in skills
For preset models
• Image analysis
• Printed OCR
• Handwritten OCR
• Language detection
• Entity linking
• Named entity recognition
• Key phrase analysis
• Sentiment analysis
• Merger
• Splitter
• Shaper
Cognitive skills Utility skills

6. Custom skills
For bring-your-own APIs
POST /api/count HTTP/1.1
Host: https://<my-api-app>.azurewebsites.net
Content-Type: application/json
x-functions-key: <my-api-key>
{
"values": [
{
"recordId": "0",
"data": {
"text": "Este es un contrato en Inglés",
"language": "es",
"countOf": "words"
}
}
]
}
HTTP/1.1 200 OK
Content-Length: 153
Content-Type: application/json
{
"values": [
{
"recordId": "0",
"data": {
"count": 6
},
"errors": [],
"warnings": []
}
]
}
POST or
PUT https
only
The batch
size
Any HTTP
headers
Data can
be shaped

7. Example: President’s Daily Reports
Cracked
documents
OCR
skill
Entity Recognition
skill
Enriched
documents
Image
(.TIFF)
per
page
{
"categories": [
"locations",
"organizations",
"persons"
]
}
{
“algorithm":"printed“
}
Custom
skill
metadata_storage_path
content
merged_text
hocr_data
locations
organizations
persons
PDF documents PDF pages
Index
Query
Custom
skill
PDF pages
hOCRJPEGPDF

8. Pricing
• A preview feature of the Azure Search service in 15 regions including
Australia East
• Free for a small workload
• Can attach to an Azure Cognitive Services resource for a larger workload
• Built-in skills are charged at the Azure Cognitive Search pay-as-you-go price

9. Resources
• JFK Files
https://www.ailab.microsoft.com/experiments/jfk-files
Demos
• Knowledge Mining Bootcamp
https://azure.github.io/LearnAI-KnowledgeMiningBootcamp/
Labs
• AI and Azure Search for knowledge mining
https://azure.microsoft.com/en-
gb/resources/videos/azuresearchcognitivesearchmicrosoftignite2018/
Videos