1
TOPIC
2
TOPIC
Implement traffic
control system
with Big Data
Architecture
Who I am
@marcopozzan.it
www.marcopozzan.it
https://www.linkedin.com/in/marcopozzan/
Marco Pozzan
• Consultant and trainer in business intelligence, predictive analytics
• Since 2002, the main activities are related to the design of relational data warehouse and multidimensional design with
Microsoft tools.
• Since 2017 I deal with modern data warehousing and big data architectures
• Teacher at the University of Pordenone in the course of data analysis and data modelling.
• Community Lead of 1nn0va (www.innovazionefvg.net)
Agenda
Demo
Event Hub
Stream Analytics
Blob Storage
Data Lake
Service Bus
Power BI
REAL TIME ANALYTICS INFRASTRUCTURE
Lambda architecture
DEMO 1
REAL TIME ANALYTICS INFRASTRUCTURE
For the first phase of the
project, you will start building
the traffic surveillance system
to provide information on
average speeds in various
locations.
In this demo, a stream
analytics job will be created
that captures speed camera
data sent to an event hub
from a Visual Studio
application
(SpeedCameraDevice).
You will configure the a
stream analytics job to send
data to a Power BI dashboard
and Azure Data Lake
DEMO 2
REAL TIME ANALYTICS INFRASTRUCTURE
We will now add the
positions of the police
patrol cars to the traffic
surveillance system.
In this demo, a second
stream analytics job will
be created that acquires
data on the location of
patrol cars from an IoT
hub (using a Visual Studio
application,
PatrolCarDevice, to
generate the raw data).
We will configure the
Stream Analytics job to
send data to a Power BI
report and to Data Lake
DEMO 3
REAL TIME ANALYTICS INFRASTRUCTURE
The next requirement for the
traffic surveillance system is the
addition of a function for
checking vehicles registered by
speed cameras against a list of
stolen vehicles.
In this exercise, you will modify
the stream analytics job
(TrafficAnalytics) to detect if a
vehicle observed in a speed
camera has been stolen.
We will create an Azure
Storage BLOB and upload a file
containing vehicle theft records
to be used in the a stream
analytics job (in addition to
speed camera data)
DEMO 4
REAL TIME ANALYTICS INFRASTRUCTURE
Any patrol car located less
than eight kilometers from
the location most recently
reported by the stolen or
speeding vehicle could
then be dispatched to that
location.
The message must contain
the ID of the patrol car, the
registration number of the
stolen vehicle and the
coordinates of the place
where the vehicle was
observed.
In this demo, we will create
a service bus to send
warning messages to patrol
cars on stolen vehicles
Thanks
Questions?
www.marcopozzan.it @marcopozzan.it https://www.linkedin.co
m/in/marcopozzan/

REAL TIME ANALYTICS INFRASTRUCTURE WITH AZURE

  • 1.
  • 2.
  • 3.
    Who I am @marcopozzan.it www.marcopozzan.it https://www.linkedin.com/in/marcopozzan/ MarcoPozzan • Consultant and trainer in business intelligence, predictive analytics • Since 2002, the main activities are related to the design of relational data warehouse and multidimensional design with Microsoft tools. • Since 2017 I deal with modern data warehousing and big data architectures • Teacher at the University of Pordenone in the course of data analysis and data modelling. • Community Lead of 1nn0va (www.innovazionefvg.net)
  • 4.
    Agenda Demo Event Hub Stream Analytics BlobStorage Data Lake Service Bus Power BI
  • 5.
    REAL TIME ANALYTICSINFRASTRUCTURE
  • 6.
  • 7.
  • 8.
    REAL TIME ANALYTICSINFRASTRUCTURE For the first phase of the project, you will start building the traffic surveillance system to provide information on average speeds in various locations. In this demo, a stream analytics job will be created that captures speed camera data sent to an event hub from a Visual Studio application (SpeedCameraDevice). You will configure the a stream analytics job to send data to a Power BI dashboard and Azure Data Lake
  • 9.
  • 10.
    REAL TIME ANALYTICSINFRASTRUCTURE We will now add the positions of the police patrol cars to the traffic surveillance system. In this demo, a second stream analytics job will be created that acquires data on the location of patrol cars from an IoT hub (using a Visual Studio application, PatrolCarDevice, to generate the raw data). We will configure the Stream Analytics job to send data to a Power BI report and to Data Lake
  • 11.
  • 12.
    REAL TIME ANALYTICSINFRASTRUCTURE The next requirement for the traffic surveillance system is the addition of a function for checking vehicles registered by speed cameras against a list of stolen vehicles. In this exercise, you will modify the stream analytics job (TrafficAnalytics) to detect if a vehicle observed in a speed camera has been stolen. We will create an Azure Storage BLOB and upload a file containing vehicle theft records to be used in the a stream analytics job (in addition to speed camera data)
  • 13.
  • 14.
    REAL TIME ANALYTICSINFRASTRUCTURE Any patrol car located less than eight kilometers from the location most recently reported by the stolen or speeding vehicle could then be dispatched to that location. The message must contain the ID of the patrol car, the registration number of the stolen vehicle and the coordinates of the place where the vehicle was observed. In this demo, we will create a service bus to send warning messages to patrol cars on stolen vehicles
  • 15.