In this session I talk about how to leverage pre-built AI models to help improve how businesses operate, bringing value to both customers and employees.
4. “What is success?
To laugh often and much; to win the respect of intelligent
people and the affection of children; to earn the
appreciation of honest critics and endure the betrayal of
false friends; to appreciate the beauty; to find the best in
others; to leave the world a bit better, whether by a healthy
child, a garden patch Or a redeemed social condition; to
know even one life has breathed easier because you have
lived. This is to have succeeded!”
― Bessie Anderson Stanley
re-worked by Ralph Waldo Emerson
5.
6.
7.
8. Cognitive Services
Infuse your apps, websites, and bots with human-like intelligence
Speech Language Knowledge SearchVision
Speech to text (Speech
Transcription)
Speaker ID and
authentication
Customized speech
Transcription (complex
word, noisy
environment)
Real-time speech
translation
Spell checking
Contextual language
understanding –
customized intent
analysis
Sentiment analysis,
key phrase detection
text translation up to
60+ languages
Customized decision
making with
reinforcement learning
Q&A service and bot
training with
personality
Visual Search with
object detection
Comprehensive news,
image, and video results
Custom Search
Tailored and
customized search
experiences
Image Tagging,
Thumbnails
OCR, Handwriting
recognition
Customized image
recognition
Face detection
Video insights - people
detection, visual search,
keyframe detection, object
recognition
Image and video
moderation
Text Moderation
Emotion recognition
Text to speech
Automatic search
suggestions
Entity information
augmentation
9. IT Automation
Customer Intelligence
& Recommendations
Research
& Discovery
Market
Intelligence
Predictive Maintenance
& Resource
Optimization
Fraud Analysis &
Investigation
Customer-facing
Chatbots
Retail
Intelligence
Edge Surveillance
& Security
Smart
Networking
Business Process
Automation
& Internal bots
Intelligent
Search
Supply Chain
Management
Diagnosis &
Treatment Systems
Adaptive
Learning
Regulatory
Intelligence
10. Business Process
Automation or
IT Optimization
Automate those tasks that are manually
intensive and find paths to optimize the
business process
Azure
Storage
Power
BI
Azure
Search
App
Insights
App
Service
Dynamics
365
Other Azure services that enable this scenario
Computer
Vision
Face
(with emotion)
Custom
Vision Service
Cognitive Services that enable this scenario
LUIS Text
Analytics
Translator Bing
Speech
Custom
Speech
Service
o Image Creation & Selection
(Keyframes, Thumbnails)
o Adult Content Detection & Filtering
(nudity/profanity)
o Handwriting Analysis
Continuous Monitoring Detection or Access Control Supply Chain Optimization
Content
Moderator
o Dashboards (Call Center, Online
Services, etc.)
o Automated Online Publishing
o Content Redaction
o Translation Services
o Transcription
o Captioning
o Summarization
o Document Review and Routing
o Comprehensive data center
management of security and access
o Video analysis
o Reputation Management
o Fraud Detection
o Keyword Identification
o Highlights Creation
(image/video/audio)
o Image Tagging & Classification*
21. Seattle, WA
Microsoft Campus
47.61164, -122.3331
Buenos Aires, Argentina
Web Document Update
28.532270, -81.380906
Tokyo, Japan
Twitter Feed Update
35.699441, 139.683795
Brisbane, AU
Web Document Update
-27.481616, 152.971464
22. Bing APIs let you
leverage insights from a
world of knowledge
Leverage Bing’s understanding of
the world to build rich AI driven
scenarios for your customers.
Make use of Bing’s powerful index
to embed the world’s knowledge
in your applications.
23. Bing Web Search API
• Get relevant web and all the other answer results with one API call.
*screenshots show actual search results on bing.com
https://api.cognitive.microsoft.com/bing/v7.0/search?q=nasa
{
“answerType”:”WebPages”,
“resultIndex”:0,…
},
{
“answerType”:”News”,
“resultIndex”:1,…
}
Ranking Response
{
“_type”: “SearchResponse”,
“queryContent”: {…},
“webPages”: {…},
“news”: {…},
“images”: {…},
“videos”: {…},
“relatedSearches”: {…},
“rankingResponse”: {…}
}
Search Response
Web
Results
Deep
Links
(1st Algo)
News
Results
Image
Results
Video
Results
Related
Searches
24.
25.
26.
27. • Read barcodes and QR codes, and derive annotations/related searches for products.
Related searches
Yellow living room furniture,
Modern living room furniture,
Small living room rustic,
Cottage style living room furniture, …
Annotations
Living room furniture,
Wood Chair,
Home design furniture,
Yellow living room furniture, …
Visual Search – Barcode/QR code, Web Annotations
Barcode readingWeb Annotations
Contoso.comContoso.com
28. Bing Custom Search
A fast and easy-to-use, ad-free search product that lets you deliver the results you want for your company.
• Custom Web Search
• Custom Image Search
• Custom Autosuggest
• Control Ranking
• Stage Changes
• Multiple Admin Logins
• Bing Statistics
We have been working over the last year to transform our Cognitive Services into enterprise-grade solutions that can solve our leading customers’ and partners’ business and IT challenges. And that’s exactly the evolution we would like to share with you today. Cognitive Services are intelligent, business-ready, and easy to deploy services that can be customized for your specific business scenario. The APIs can be combined, like building blocks, to infuse your business with AI, and rapidly accelerate time to market.
We are going to demonstrate how you can get started today, using our advanced artificial intelligence technology to solve the complex, real-world business and IT challenges many of you face. With Microsoft Cognitive Services, you can build the way you want to build and customize AI for your business.
We have been working over the last year to transform our Cognitive Services into enterprise-grade solutions that can solve our leading customers’ and partners’ business and IT challenges. And that’s exactly the evolution we would like to share with you today. Cognitive Services are intelligent, business-ready, and easy to deploy services that can be customized for your specific business scenario. The APIs can be combined, like building blocks, to infuse your business with AI, and rapidly accelerate time to market.
We are going to demonstrate how you can get started today, using our advanced artificial intelligence technology to solve the complex, real-world business and IT challenges many of you face. With Microsoft Cognitive Services, you can build the way you want to build and customize AI for your business.
Today’s presentation will cover two main things:
Message: We are going to show you two things: what scenarios you and other top customers are building, and how Microsoft Cognitive services can be used to enable these solutions
One , this is what our many of you and our additional top customers are doing today. We have spoken with the leading organizations who have implemented Cognitive Services in the last year to understand the use cases they are enabling. We have further spoken with our top Azure customers to understand the AI initiatives they are focused on in the near term. And, we have a network of early access program partners looking to use our MSFT Cog Svs for a number of initiatives. The scenarios that we have prioritized represent the most frequent requests from our top customers in our ecosystem.
Second, these solutions can be built using the tools and services we have in our portfolio today. We have a portfolio of intelligent, powerful, enterprise-ready, Cognitive Services. The scenarios we are focused on today will harness the existing capabilities of Cognitive Services, enabling us to easily build any of this solutions this year. In addition, the scenarios discussed today will combine Cognitive Services with other Azure services, further uniting our ecosystem and creating a unified experience for you – our customers.
This session will focus on how you can customize Cognitive Services for your unique business scenario
anyone can slap AI on their website and call it machine learning. It’s like seeing the word “natural” on a food label. You have to be sure to read the ingredient list first.
What is redaction?
Meeting
Demo of JFK, who has seen this?
Enter a search-NEXT
It scans typed, written and photos to find the word – Oswald in this case
Black instead of Yellow
George, test to find a credit card
Not a word or synonym, we needed to find a pattern
Extend the existing IP to solve the problem
CC are generated to pass or fail the algorithm
Sometimes in a certain zone like on the left
Can be written anywhere on the document
Can be manually redacted and rescanned (but still visible)
Can be on a sticky note scanned on top of the page
Numerous forms, 1-20 pages, scanned with other private info, millions of forms
Took about 2 days, demo is very close to what we had at that time
Search for CC, could be extended for SIN, Passport numbers, other PII.
Enough background, Who wants to see a demo?
This slide and the next slide is about telling the story that in just the few moments that the speaker was talking millions of updates are taking place to facts, documents on the web, twitter updates spanning the entire planet. And How Bing was able to index the content and keep it up to date for users…
So here is the solution
Its so easy that I make you this promise - come to our booth near theater 3 and we will setup custom search for your company in 30 seconds
Set up in a few minutes
Powerful ranking
Global-scale search index
Pin or Block results
Hosted UI