Let's talk about what Microsoft has to offer as a platform to help you build an Internet of Things solution. Mainly about Azure cloud but also Machine Learning, Cognitive Services, Windows, Hololens, Open Source
This is how things are running for the last two decades and it’s not close to an end.
Consumer Devices + best OS for IoT + appsWindows has been though with information consumption in mind. Modern design focus on content. Live tiles give a overview of your things.
Business From the prototype to the Cloud Microsoft is an IoT player for decades now. A lot of ATM, gaz stations, etc. are running on Windows Embedded. We embraced the modern IoT challenges with Azure, our Cloud solution, simplifying how to store and deal with huge volume of data (Storage, SQL, HDInsight/Hadoop), extract information (BI) and bring intelligence to the story (Machine Learning). Azure has solutions for small set of devices (Azure Mobiles Services) to the most demanding scenarios of thousands devices (EventHub, Devices and apps create the link to the business
Azure meets a broad set of international and industry-specific compliance standards, such as ISO 27001, HIPAA, FedRAMP, SOC 1 and SOC 2, as well as country-specific standards including Australia IRAP, UK G-Cloud, and Singapore MTCS. Azure cloud services, with independently verified compliance, give you the foundation to achieve compliance for the infrastructure and applications you run in Azure. Azure is subjected to rigorous audits by independent organizations and the results are available to you as a part of Microsoft's commitment to transparency. Microsoft was also the first to adopt the uniform international code of practice for cloud privacy, ISO/IEC 27018, which governs the processing of personal information by cloud service providers.
Why this Slide: You need some reference to come back to after the IaaS demo because now you are transitioning to PaaS. You want to focus the attention to the building blocks that you will show in the next demo – a web app, SQLDB, Storage and CDN.
Key Points: We already said that your mental model of this picture is IT Lego – building blocks you provision and use. Your job is to work out what you need and to glue them together. Illustrate on the slide the 4 parts of the app you will use. Reinforce PaaS – the SERVICE looks after everything for you. The responsibility to keep these services working is now Azure’s – NOT yours (as it is with software you run in a VM). DON’T SPEND TOO MUCH TIME HERE – it’s a brief transition slide to the DEMO…
Transition to NEXT Slide: Let’s see PaaS in action
Let’s dive a little deeper in to what makes Azure Machine Learning unique—it’s easy to manage and monitor solutions right from the Azure portal.
If you’re not already using Azure, your IT team can set up an Azure subscription in seconds with the help of a set-up wizard Then they can quickly enable data scientists by creating ML Studio workspaces. All you need is a Windows Live ID, and you can provision a Studio account. The data scientist then doesn’t need to mess with the Azure portal, she receives an email saying she’s ready to get started. Then right from the Azure Portal, your Azure ops team can predict expenses by monitoring storage and CPU usage of workspaces and web services with a near real-time view And when your data scientists are ready to deploy a model to production, or update an existing model, the team will receive alerts
Smart Contracts are unable to access external data or events based on time or market conditions. Calling code or data outside of a Smart Contract or blockchain breaks the general trust barrier and authenticity of transactions. Cryptlets will allow the blockchain to access external data securely, while maintaining the integrity of the blockchain.
Last year the United States Postal Service processed 150 Billion pieces of mail – far to much for efficient human sorting, but as recently as 1997, only 10% of all the hand-addressed mail was sorted automatically. Why?
Because this is a tough problem – the type of problem machine learning is designed to solve. It has taken so many years to automate the sorting of the mail because reading handwriting is hard due to all the variables involved. Even humans have trouble reading other humans’ handwriting, if you can imagine the thousands of ways someone can write a name or address, this is a huge machine learning problem to solve. How can we teach the machine to read the mail and how can the machine learn and get better over time?
The answer is by providing feedback both in terms of humans training the machine learning models and the machine learning from the patterns in the data over time. By providing feedback, the Postal Service was able to train computers to accurately read human handwriting. This is where the “learning” part of machine learning comes in. Data scientists created a model based on all the data they had on how people can write addresses. Then they train the model as more data comes in, correcting attempts at reading handwriting when they’re off, until the model has enough of a history to draw from that it can accurately read handwriting.
Today, with the help of machine learning, over 98% of all mail is successfully processed by machines.
Back in the 90s when the post office was wrestling with this issue, we were also working on Machine Learning, starting in 1991 when Microsoft Research was formed.
As early as 1999 they were using it to help create email filters by predicting which emails were junk, and which were relevant. And as John Platt mentions—it’s a key technology that Microsoft uses to develop its own software. In 2004. Machine learning was part of Microsoft’s search engine It is also used in Bing Maps as part of the traffic prediction service. And many people know about how it was a key technology to make Kinect a reality, letting computers track people’s gestures and sort through what’s relevant and what’s not. Like filtering out a dog in the background to see a player’s movements. And today, this technology that has been developed over decades is becoming available commercially as part of Azure
It’s this depth of experience with machine learning, testing and refining over years, using it to develop pretty much all Microsoft products, that makes Microsoft’s solution so robust.
The beauty of simulation is that we can evaluate algorism or models without any engineering resource. Matchbox is an algorithm-based recommender developed by Microsoft Research in Cambridge, UK. Matchbox is offered as an out-of-the-box machine learning algorithm in Microsoft Azure Machine Learning Platform, which makes it easy to do predictive analytics of big data.
Go to Demo.
Animation set to loop (replace /Build walk in ?), Add session id to top
Bot Framework provides everything you need to build and connect intelligent bots that interact naturally wherever your users are talking, from text/sms to Skype, Slack, Office 365 mail and other popular services.
Bot Framework consists of three main components: Bot Connector, Bot Builder, and Bot Directory
Microsoft is delivering the technologies for MPC as a platform for the first time in Windows 10
The MPC technologies for developers are identity, holograms, speech, touch, and ink
These technologies are part of the Windows core, and will be available in the full landscape of Windows 10 device, including HoloLens
“Do you remember your first real computer? Mine was Tandy TRS 80. It was monochrome and had two floppy drives. I only started using a mouse after my sister gave me an IBM PC clone that ran Windows 3.1.
In just over forty years we’ve gone from punch cards and dip switches to playing games with the Kinect and using our fingerprints to unlock our phones. We’re starting to use the natural interactions that we’ve had since birth to engage our computers.
The idea behind HoloLens was to create a computer that would bridge our digital and real worlds using holograms. We call this new experience mixed-reality.
We wanted mixed reality to feel completely natural, so we used the same natural interactions that we use in the real world. On the left you see the natural inputs, on the right the natural outputs. This is why the human technologies of more personal computing are at the core of Windows 10. We created the most natural and intuitive interactions possible, available to the whole landscape of Windows 10 devices.”
VR and MR exist at the opposite ends of a continuum VR and MR offer something unique, both are more valuable than AR, which sits between them on the continuum Microsoft believes MR offers the most benefits across the most scenarios
“To understand why mixed reality has such potential to transform the way we work, let’s talk about what makes it different from virtual reality and augmented reality.
VR delivers immersive experiences. These can be really exciting, especially when playing games. But VR’s immersiveness is also limiting, because it takes over all your senses and isolates you from the world around you. VR completely obscures your vision, so you can’t move around in the real world. And because you can’t see, you can’t use your hands to interact with things in the real world. One way to think about immersive VR is that it’s similar to 3D movies or TV. It’s powerful and can use useful, but infrequently so due to its limitations.
Augmented reality places digital information, usually visual, over your perception of the world around you. Whether you experience AR using apps on your smartphone or a device like Google Glass, AR is limited because it has no ability to comprehend the world around it, which means it can’t integrate the real and digital worlds. AR has no holographic capabilities, so you can’t directly engage with any of the overlays it puts over your world.
We wanted mixed reality with HoloLens to be more useful. We needed to be able to explore the world and use our hands to do stuff. To do that, we didn’t isolate you from the real world, we integrated digital experiences into the real world.
With HoloLens you move freely, so you can explore mixed reality in your spaces. And because you retain full use of your hands and vision, it is possible to do some amazing things. With mixed reality we can deliver spatial context and insight that you can’t get from either VR or AR.
Holograms are the next evolution in computing. With this vision in mind, hardware, software, and user design engineers came together to create a new canvas for creators and developers. Microsoft HoloLens, together with Windows 10, introduces a powerful new holographic platform. The era of holographic computing is here.
Microsoft HoloLens is truly something revolutionary.
By blending holograms with reality it opens up entirely new ways to create, learn, collaborate, and visualize.
You see your creations come to life in the world around you. And, it is powered by Windows 10.
IoT & Azure, the field of possibilities
IoT & Azure
the field of possibilities
Alex Danvy @danvy
-> sensor data
Clients : Dash board,
Objects : Sensors, UX,
Servers : Store data,
Configuration, Business logic,
Windows Server, SQL
-> sensor data
Clients : Dash board,
Remote control, Gateway
Objects : Sensors, UX,
Servers : Store data, Configuration,
Business logic, Business
Phone, XBOX, wearable
Public Cloud :
Store data (BigData), Configuration, Business logic,
Business Intelligence, Machine learning
Windows Server, SQL Server,
Office 365, Azure, HD
Insight/Hadoop, ML, ISS
(as a Service)
(as a Service)
(as a Service)
Why the cloud?
Rapidly setup environments to drive business priorities
Scale to meet peak demands
Increase daily activities, efficiency and reduced cost.
The Azure Cloud Platform
More than AWS and
Google Cloud combined
4 more announced
New Azure customer
Messages per week
processed by Azure IoT
Azure Active Directory
Developers registered with Visual
Studio Team Services
Start-ups and ISVs
Batch Remote App
Fabric Visual Studio
VM Image Gallery
& VM Depot
What’s in the Cloud ?
DB / NoSQL
IaaS-Open Source Software
Connectivity & Management
Hot Path Analytics
Azure Stream Analytics, Azure Storm
Presentation & Business
Websites, Mobile Services
Dynamics, BizTalk Services,
OPC UA Integration into Azure IoT Suite
OPC API & Client
Hot Path Business Logic
Service Fabric & Actor Framework
from simple ledgers, to cryptlets that
fetch trusted and agreed-upon
external data needed to execute
What is Machine Learning?
Methods and Systems that …
The United States Postal Service
processed over 150 billion pieces of
mail in 2013—far too much for
efficient human sorting.
But as recently as 1997, only 10% of
hand-addressed mail was
successfully sorted automatically.
The challenge in automation is
enabling computers to interpret
endless variation in handwriting.
By providing feedback, the Postal
Service was able to train computers
to accurately read human
Today, with the help of machine
learning, over 98% of all mail is
successfully processed by machines.
work on users
ships with ML
Microsoft & Machine Learning
20 years of realizing innovation
Distinguished scientist at
1999 201220082004 201420102005
Machine learning is pervasive throughout
Microsoft products.“ ”
Azure Machine Learning
1. Pick & drop
models. No need to
2. Uploaded data tables
6. Evaluate models,
Visualize result or
5. Specific settings to fine
tune the models
Easily turn data into intelligent action
Big Data Stores
Data Lake Store
Give your solutions
a human side
Windows 10 IoT Enterprise
Desktop Shell, Win32 apps, Universal Windows Apps and Drivers
1 GB RAM, 16 GB Storage
Windows 10 IoT Mobile Enterprise
Modern Shell, Universal Windows Apps and Drivers
512 MB RAM, 4 GB storage
Windows 10 IoT Core
No Shell, Universal Windows Apps and Drivers
256MB RAM, 2GB storage
X86 or ARM
Windows for Industry Devices
Microsoft HoloLens Microsoft Confidential
A computer’s simulated version of reality
Massive, immersive FOV
Occlusion limits mobility, usefulness
Gaming and focused uses
Data notifications tied to the real world
Overlays data, doesn’t integrate
Navigation, light communication
Your real and digital worlds integrated, enhanced with holograms
Integrates your real and digital worlds seamlessly
Not constrained by size of 2D, rectangular displays
Intuitive, natural interactions
Digital content is wherever you need it
Complete Windows 10 computer