Developing and testing Stream Analytics Jobs and ASA on IoT edge device with Visual Studio 2017. Visual Studio Saturday Pordenone 2018

1. saturday 2018
Visual Studio for IoT Solutions Alessio Biasiutti
#vssatpn

2. ALESSIO BIASIUTTI
Azure Solution Architect
Microsoft P-TSP
alessiobiasiutti
abiasiutti@altitudo.com

3. AGENDA
▪ Azure Stream Analytics
 Concepts
▪ Visual Studio Stream Analytics Tools
 Developing
 Running
 Unit Testing
▪ Azure Stream Analytics Edge
 Concepts
▪ Visual Studio Stream Analytics Tools
 Developing
 Running
▪ Visual Studio Code IoT Hub

4. VISUAL STUDIO - STREAM ANALYTICS

5. CONCEPTS
▪ Event-processing engine
▪ In memory cluster
▪ PaaS - Serverless
▪ SQL Like programming
language
▪ JavaScript per UDF/UDA
▪ Availability 99,9%
▪ Scale-Up/Down

6. INPUT
EventHub
EventProcessedUtcTime, EventEnqueuedUtcTime, PartitionId
IoT Hub
IoTHub.MessageId, IoTHub.CorrelationId…..
BlobStorage
Blob vengono presi in considerazione ogni secondo e solo una volta
Pattern cluster1/logs/{date}/{time}/{partition}
Reference Data
Pattern products/{date}/{time}/product-list.csv

7. QUERY LANGUAGE
SELECT
Make,
System.TimeStamp AS Time,
COUNT(*) AS [Count]
INTO
AlertOutput
FROM
Input TIMESTAMP BY Time
GROUP BY
Make,
TumblingWindow(second, 10)
HAVING
[Count] >= 3
▪ Aggregate Functions (SUM, AVG…)
▪ Analytic Functions (LAG, LAST, ISFIRST…)
▪ Array Functions
▪ Conversion Functions (TRY_CAST, GetType)
▪ Date Time Functions (DATEADD, DATEDIFF, DAY, MONTH…)
▪ GeoSpatial Functions (ST_DISTANCE, ST_WITHIN…)
▪ Mathematical Functions (ABS, SIGN…)
▪ Record Functions (GetRecordPropertyValue…)
▪ String Functions (LEN, SUBSTRING, CONCAT…)

8. OUTPUT
Data Lake Store
SQL Database (NO SQL Server su VM)
Blob Storage
Table Storage
Cosmos DB
ServiceBus Queue / Topic
Event Hub
Functions
Power BI

9. ASA PROJECT

10. RUN LOCALLY

11. LAB
Input
Output
Jobs
Run Locally

12. MONITORING

13. MONITORING

14. LAB Deploy
Monitoring

15. «UNIT» TESTING
Install-Package Microsoft.Azure.StreamAnalytics.CICD
(Version >1.4.0)
Create Local Test Case File (CSV, JSON)
SA.exe localrun -Project [ProjectFullPath]
Check Generated Output File
Asserts

16. LAB «Unit» testing
Danilo Fruttaldo

17. STREAM ANALYTICS ON IOT EDGE
▪ Low-latency command and
control
▪ Limited connectivity to the
cloud
▪ Limited bandwidth
▪ Compliance

18. STREAM ANALYTICS ON IOT EDGE
▪ ASA on IoT Edge offers a cross-platform
solution running on Docker containers
Linux or Windows
▪ Multiple architectures (Intel or ARM
CPUs)
▪ Raspberry Pi
▪ Industrial PCs
▪ Dedicated field gateways
▪ Servers

19. CONCEPTS
▪ IoT Edge Runtime
▪ IoT Edge Hub
▪ ioT Edge Agent
▪ Module input/output
▪ Module communication
▪ Routes

20. QUERY LANGUAGE
▪ Most SQL query language features are already supported.
▪ Following feature are NOT yet supported:
▪ User-defined functions
▪ Azure ML functions
▪ Using more than 14 aggregates in a single step
▪ AVRO format for input/output
▪ Geospatial operators
▪ PARTITION BY
▪ GetMetadataPropertyValue

21. ASA ON IOT EDGE PROJECT

22. C# UDF CODE BEHIND

23. FUNCTIONS
▪ .NET Standard Library
▪ public static method
▪ Not supported in the
Azure portal
▪ Debug

24. IOT EDGE DEVICE DEFINITION

25. IOT EDGE SOLUTION
tempSensor
IoT Edge Runtime
ASA Edge
reset
telemetry
telemetry
deployment
config
ASA edge

26. LAB
IoT Hub Visual Studio Code
ASA Edge Visual Studio 2017
Debugging C# UDF

27. Q&A

28. THANK YOU