SlideShare a Scribd company logo
AWS IoT, AWS Greengrass For Time Series Analysis

“Measuring & Predicting the fine
dust(PM2.5) data.”
@aniotmaker
정보통신설비 고급감리/Consulting/Firmware Engineer/Back-end Developer
• Available Programming: Node.JS, JavaScript, SQL, Node-RED, Python, C&C++
• Seoul Weather Twitter Leader (https://twitter.com/aniotmaker)
• AWS-IoT User Group Leader (https://www.facebook.com/groups/awsiot)
• Node-RED User Group Leader (https://www.facebook.com/pg/nodereduser)
Haesung Lee
2019. 5. 14.
Contents
• Introduction

• Stacks For Seoul Weather Twitter 

• Seoul Weather Architecture

• IoT Sensors with JSON format

• AWS IoT Core

• AWS QuickSight

• AWS IoT Analytics on SageMaker

• Tableau Analytics

• Spark Zeppline Analytics

• Twitter-bot

• Line-bot

• AWS CloudWatch

• PM2.5 dust sensor with Prediction

• Twitter-bot for Seoul weather

• Conclusion

• References

• Q & A
@aniotmaker
Introduction
!3
@aniotmaker
Ref. https://www.sciencemag.org/news/2017/01/brain-pollution-evidence-builds-dirty-air-causes-alzheimer-s-dementia
AWS IoT
Core
AWS
Greengrass
Amazon
QuickSight
Open
Weather Map
APIs
AWS SageMaker
@aniotmakerStacks For Seoul Weather Twitter
https://twitter.com/aniotmaker
!4
Amazon
EMR
Amazon

Athena
Amazon
CloudWatch
Amazon
EC2 Amazon

S3
AWS Glue
Amazon

Athena
Amazon
Kinesis
Firehose
Amazon
Redshift*
Lambda
function
Seoul Weather Architecture
AWS IoT
Core
AWS
Greengrass
Door
Sensor
Amazon
CloudWatch
Amazon
QuickSight
AWS IoT Analytics
Dust
Sensor
Open
Weather Map
APIs
Amazon
EC2
Time Series Analysis,

Weather & Dust

Information

!5
+
Train Model
https://twitter.com/aniotmaker
AWS SageMaker
@aniotmaker
Amazon

S3
+
Amazon
Kinesis
Firehose
AWS Glue
ETL
(Data Lake)
Sensors Unit
IoT (ML, Lamda / MQTT, TLS) Unit
Big Data Processing Unit
BI Visualisations Unit
Social Networks Unit
Amazon
Redshift*
(DataWarehouse)
Amazon
EMR
(Hadoop/ Spark)
MQTT
Lambda
function
IoT Sensors with JSON format
!6
A Dust Sensor A Door Sensor Open Weather API
@aniotmaker
AWS IoT Core
!7
AWS IoT
Core
AWS
Greengrass
Dust
Sensor
Amazon QuickSight
!8
AWS IoT
Core
AWS
Greengrass
Amazon
QuickSight
Dust
Sensor
AWS IoT Analytics on SageMaker
!9
AWS IoT Analytics
+
Train Model
AWS SageMakerAWS IoT
Core
AWS
Greengrass
Dust
Sensor
Amazon

S3
+
Apache Zeppline Analytics
AWS IoT
Core
AWS
Greengrass
Dust
Sensor Amazon

S3
!10
Tableau Analytics
!11
AWS IoT
Core
AWS
Greengrass
Dust
Sensor Amazon

S3
Twitter-bot
• AWS-IoT + Twitter API
• How To Predict the time of outside exercising?
!12
@aniotmaker
Line-bot
!13
• AWS-IoT + Line API
@aniotmaker
AWS CloudWatch
!14
@aniotmaker
PM2.5 dust sensor with Prediction
!15
@aniotmaker
Twitter-bot for Seoul weather @aniotmaker
!16
Conclusion @aniotmaker
As you can see, my purpose is to implement time series analysis with AWS IoT.
As much as possible to avoid fine dust
and time to find the best outdoor exercise timing.
Twitter would give you the best outdoor walking and exercise timing for your health
Red-Coloured line
Is prediction data
!17
References
• Designing MQTT Topics for AWS IoT Core (White Paper): https://d1.awsstatic.com/whitepapers/Designing_MQTT_Topics_for_AWS_IoT_Core.pdf

• Using Node-RED Library To Wire Telemetry Data From IoT Devices To The Cloud: https://labs.eleks.com/2019/01/node-red-library-iot-cloud.html

• Using AWS IoT Analytics to Prepare Data for QuickSight Time-Series Visualizations: https://aws.amazon.com/blogs/iot/using-aws-iot-analytics-to-
prepare-data-for-quicksight-time-series-visualizations/

• AWS IoT Analytics 기반 시계열 데이터 QuickSight 시각화 방법: https://aws.amazon.com/ko/blogs/korea/using-aws-iot-analytics-to-prepare-data-for-
quicksight-time-series-visualizations/

• AWS Docs: https://docs.aws.amazon.com/index.html

• What Is AWS IoT Greengrass? https://docs.aws.amazon.com/greengrass/latest/developerguide/what-is-gg.html 

• 서버리스 실시간 데이터 처리 애플리케이션 구축: https://aws.amazon.com/getting-started/projects/build-serverless-real-time-data-processing-app-
lambda-kinesis-s3-dynamodb-cognito-athena/?trk=gs_card 

• AWS 기반 지속 가능한 데이터 분석 플랫폼 구축하기 - 소성운, 지그재그 :: AWS Summit Seoul 2019 : https://www.slideshare.net/awskorea/aws-aws-
summit-seoul-2019-141290115 

• AWS 기반 지속 가능한 데이터 분석하기 GitHub: https://github.com/awskrug/datascience-group/tree/master/workshop-sustainable_data_analysis

• Spark Streaming: IoT with Amazon Kinesis and Visualizing with Qubole Notebooks: https://www.qubole.com/blog/spark-streaming-iot-amazon-
kinesis-visualizing-qubole-notebooks/

@aniotmaker
!18
Q & A
@aniotmaker
서울날씨 @aniotmaker
@aniotmaker
!19

More Related Content

Similar to AWS IoT, AWS Greengrass For Time Series Analysis [English Ver.]

An Overview of AWS IoT (November 2016)
An Overview of AWS IoT (November 2016)An Overview of AWS IoT (November 2016)
An Overview of AWS IoT (November 2016)
Julien SIMON
 
Iot meets Serverless
Iot meets ServerlessIot meets Serverless
Iot meets Serverless
Narendran R
 
Open Sensor Networks
Open Sensor NetworksOpen Sensor Networks
Open Sensor Networks
Just van den Broecke
 
AWS re:Invent 2016: IoT: Build, Test, and Securely Scale (GPST302)
AWS re:Invent 2016: IoT: Build, Test, and Securely Scale (GPST302)AWS re:Invent 2016: IoT: Build, Test, and Securely Scale (GPST302)
AWS re:Invent 2016: IoT: Build, Test, and Securely Scale (GPST302)
Amazon Web Services
 
Gustavo Zastrow - Introduction to AWS IoT Core and MQTT
Gustavo Zastrow - Introduction to AWS  IoT Core and MQTTGustavo Zastrow - Introduction to AWS  IoT Core and MQTT
Gustavo Zastrow - Introduction to AWS IoT Core and MQTT
GustavoRuizZastrow
 
AWS Webcast - Splunk and Autodesk
AWS Webcast - Splunk and AutodeskAWS Webcast - Splunk and Autodesk
AWS Webcast - Splunk and Autodesk
Amazon Web Services
 
Global Azure Bootcamp 2016 - Real-world Internet of Things Backend with Azure...
Global Azure Bootcamp 2016 - Real-world Internet of Things Backend with Azure...Global Azure Bootcamp 2016 - Real-world Internet of Things Backend with Azure...
Global Azure Bootcamp 2016 - Real-world Internet of Things Backend with Azure...
Andri Yadi
 
Welcome + CloudStack News
Welcome + CloudStack NewsWelcome + CloudStack News
Welcome + CloudStack News
ShapeBlue
 
Assisting IoT Projects and Developers in Designing Interoperable Semantic Web...
Assisting IoT Projects and Developers in Designing Interoperable Semantic Web...Assisting IoT Projects and Developers in Designing Interoperable Semantic Web...
Assisting IoT Projects and Developers in Designing Interoperable Semantic Web...
Amélie Gyrard
 
Azure IoT Platform services - The modern IoT developer toolbox
Azure IoT Platform services - The modern IoT developer toolboxAzure IoT Platform services - The modern IoT developer toolbox
Azure IoT Platform services - The modern IoT developer toolbox
Microsoft Tech Community
 
Asset Monitoring with Beacons, Lora, NodeJS and IoT Cloud
Asset Monitoring with Beacons, Lora,  NodeJS and IoT CloudAsset Monitoring with Beacons, Lora,  NodeJS and IoT Cloud
Asset Monitoring with Beacons, Lora, NodeJS and IoT Cloud
Robert van Mölken
 
IoT cloud system implemented based on Azure services
IoT cloud system implemented based on Azure servicesIoT cloud system implemented based on Azure services
IoT cloud system implemented based on Azure services
Szymon Włodarczyk
 
modeveast 2012 Appcelerator Alloy & Cloud Services Presentation
modeveast 2012 Appcelerator Alloy & Cloud Services Presentationmodeveast 2012 Appcelerator Alloy & Cloud Services Presentation
modeveast 2012 Appcelerator Alloy & Cloud Services Presentation
Aaron Saunders
 
QuantiQ Manufacturing Cloud workshop
QuantiQ Manufacturing Cloud workshopQuantiQ Manufacturing Cloud workshop
QuantiQ Manufacturing Cloud workshop
QuantiQ Technology
 
AWS IoT: From Testing to Scaling
AWS IoT: From Testing to ScalingAWS IoT: From Testing to Scaling
AWS IoT: From Testing to Scaling
Neel Sendas
 
Self-Service Supercomputing
Self-Service SupercomputingSelf-Service Supercomputing
Self-Service Supercomputing
Amazon Web Services
 
Azure IOT
Azure IOTAzure IOT
Scalable Open-Source IoT Solutions on Microsoft Azure
Scalable Open-Source IoT Solutions on Microsoft AzureScalable Open-Source IoT Solutions on Microsoft Azure
Scalable Open-Source IoT Solutions on Microsoft Azure
Maxim Ivannikov
 
Bangalore Open Weather network - Open data meet 2016, Bangalore, India
Bangalore Open Weather network - Open data meet 2016, Bangalore, IndiaBangalore Open Weather network - Open data meet 2016, Bangalore, India
Bangalore Open Weather network - Open data meet 2016, Bangalore, India
Yuktix Technologies Pvt Ltd
 
Getting started with AWS IoT on Raspberry Pi
Getting started with AWS IoT on Raspberry PiGetting started with AWS IoT on Raspberry Pi
Getting started with AWS IoT on Raspberry Pi
Ian Massingham
 

Similar to AWS IoT, AWS Greengrass For Time Series Analysis [English Ver.] (20)

An Overview of AWS IoT (November 2016)
An Overview of AWS IoT (November 2016)An Overview of AWS IoT (November 2016)
An Overview of AWS IoT (November 2016)
 
Iot meets Serverless
Iot meets ServerlessIot meets Serverless
Iot meets Serverless
 
Open Sensor Networks
Open Sensor NetworksOpen Sensor Networks
Open Sensor Networks
 
AWS re:Invent 2016: IoT: Build, Test, and Securely Scale (GPST302)
AWS re:Invent 2016: IoT: Build, Test, and Securely Scale (GPST302)AWS re:Invent 2016: IoT: Build, Test, and Securely Scale (GPST302)
AWS re:Invent 2016: IoT: Build, Test, and Securely Scale (GPST302)
 
Gustavo Zastrow - Introduction to AWS IoT Core and MQTT
Gustavo Zastrow - Introduction to AWS  IoT Core and MQTTGustavo Zastrow - Introduction to AWS  IoT Core and MQTT
Gustavo Zastrow - Introduction to AWS IoT Core and MQTT
 
AWS Webcast - Splunk and Autodesk
AWS Webcast - Splunk and AutodeskAWS Webcast - Splunk and Autodesk
AWS Webcast - Splunk and Autodesk
 
Global Azure Bootcamp 2016 - Real-world Internet of Things Backend with Azure...
Global Azure Bootcamp 2016 - Real-world Internet of Things Backend with Azure...Global Azure Bootcamp 2016 - Real-world Internet of Things Backend with Azure...
Global Azure Bootcamp 2016 - Real-world Internet of Things Backend with Azure...
 
Welcome + CloudStack News
Welcome + CloudStack NewsWelcome + CloudStack News
Welcome + CloudStack News
 
Assisting IoT Projects and Developers in Designing Interoperable Semantic Web...
Assisting IoT Projects and Developers in Designing Interoperable Semantic Web...Assisting IoT Projects and Developers in Designing Interoperable Semantic Web...
Assisting IoT Projects and Developers in Designing Interoperable Semantic Web...
 
Azure IoT Platform services - The modern IoT developer toolbox
Azure IoT Platform services - The modern IoT developer toolboxAzure IoT Platform services - The modern IoT developer toolbox
Azure IoT Platform services - The modern IoT developer toolbox
 
Asset Monitoring with Beacons, Lora, NodeJS and IoT Cloud
Asset Monitoring with Beacons, Lora,  NodeJS and IoT CloudAsset Monitoring with Beacons, Lora,  NodeJS and IoT Cloud
Asset Monitoring with Beacons, Lora, NodeJS and IoT Cloud
 
IoT cloud system implemented based on Azure services
IoT cloud system implemented based on Azure servicesIoT cloud system implemented based on Azure services
IoT cloud system implemented based on Azure services
 
modeveast 2012 Appcelerator Alloy & Cloud Services Presentation
modeveast 2012 Appcelerator Alloy & Cloud Services Presentationmodeveast 2012 Appcelerator Alloy & Cloud Services Presentation
modeveast 2012 Appcelerator Alloy & Cloud Services Presentation
 
QuantiQ Manufacturing Cloud workshop
QuantiQ Manufacturing Cloud workshopQuantiQ Manufacturing Cloud workshop
QuantiQ Manufacturing Cloud workshop
 
AWS IoT: From Testing to Scaling
AWS IoT: From Testing to ScalingAWS IoT: From Testing to Scaling
AWS IoT: From Testing to Scaling
 
Self-Service Supercomputing
Self-Service SupercomputingSelf-Service Supercomputing
Self-Service Supercomputing
 
Azure IOT
Azure IOTAzure IOT
Azure IOT
 
Scalable Open-Source IoT Solutions on Microsoft Azure
Scalable Open-Source IoT Solutions on Microsoft AzureScalable Open-Source IoT Solutions on Microsoft Azure
Scalable Open-Source IoT Solutions on Microsoft Azure
 
Bangalore Open Weather network - Open data meet 2016, Bangalore, India
Bangalore Open Weather network - Open data meet 2016, Bangalore, IndiaBangalore Open Weather network - Open data meet 2016, Bangalore, India
Bangalore Open Weather network - Open data meet 2016, Bangalore, India
 
Getting started with AWS IoT on Raspberry Pi
Getting started with AWS IoT on Raspberry PiGetting started with AWS IoT on Raspberry Pi
Getting started with AWS IoT on Raspberry Pi
 

Recently uploaded

Self-Control of Emotions by Slidesgo.pptx
Self-Control of Emotions by Slidesgo.pptxSelf-Control of Emotions by Slidesgo.pptx
Self-Control of Emotions by Slidesgo.pptx
iemerc2024
 
Swimming pool mechanical components design.pptx
Swimming pool  mechanical components design.pptxSwimming pool  mechanical components design.pptx
Swimming pool mechanical components design.pptx
yokeleetan1
 
spirit beverages ppt without graphics.pptx
spirit beverages ppt without graphics.pptxspirit beverages ppt without graphics.pptx
spirit beverages ppt without graphics.pptx
Madan Karki
 
Tutorial for 16S rRNA Gene Analysis with QIIME2.pdf
Tutorial for 16S rRNA Gene Analysis with QIIME2.pdfTutorial for 16S rRNA Gene Analysis with QIIME2.pdf
Tutorial for 16S rRNA Gene Analysis with QIIME2.pdf
aqil azizi
 
一比一原版(Otago毕业证)奥塔哥大学毕业证成绩单如何办理
一比一原版(Otago毕业证)奥塔哥大学毕业证成绩单如何办理一比一原版(Otago毕业证)奥塔哥大学毕业证成绩单如何办理
一比一原版(Otago毕业证)奥塔哥大学毕业证成绩单如何办理
dxobcob
 
Understanding Inductive Bias in Machine Learning
Understanding Inductive Bias in Machine LearningUnderstanding Inductive Bias in Machine Learning
Understanding Inductive Bias in Machine Learning
SUTEJAS
 
sieving analysis and results interpretation
sieving analysis and results interpretationsieving analysis and results interpretation
sieving analysis and results interpretation
ssuser36d3051
 
Recycled Concrete Aggregate in Construction Part III
Recycled Concrete Aggregate in Construction Part IIIRecycled Concrete Aggregate in Construction Part III
Recycled Concrete Aggregate in Construction Part III
Aditya Rajan Patra
 
Online aptitude test management system project report.pdf
Online aptitude test management system project report.pdfOnline aptitude test management system project report.pdf
Online aptitude test management system project report.pdf
Kamal Acharya
 
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
zwunae
 
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
ydteq
 
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
obonagu
 
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressions
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressionsKuberTENes Birthday Bash Guadalajara - K8sGPT first impressions
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressions
Victor Morales
 
Building Electrical System Design & Installation
Building Electrical System Design & InstallationBuilding Electrical System Design & Installation
Building Electrical System Design & Installation
symbo111
 
Hierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power SystemHierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power System
Kerry Sado
 
[JPP-1] - (JEE 3.0) - Kinematics 1D - 14th May..pdf
[JPP-1] - (JEE 3.0) - Kinematics 1D - 14th May..pdf[JPP-1] - (JEE 3.0) - Kinematics 1D - 14th May..pdf
[JPP-1] - (JEE 3.0) - Kinematics 1D - 14th May..pdf
awadeshbabu
 
PROJECT FORMAT FOR EVS AMITY UNIVERSITY GWALIOR.ppt
PROJECT FORMAT FOR EVS AMITY UNIVERSITY GWALIOR.pptPROJECT FORMAT FOR EVS AMITY UNIVERSITY GWALIOR.ppt
PROJECT FORMAT FOR EVS AMITY UNIVERSITY GWALIOR.ppt
bhadouriyakaku
 
Technical Drawings introduction to drawing of prisms
Technical Drawings introduction to drawing of prismsTechnical Drawings introduction to drawing of prisms
Technical Drawings introduction to drawing of prisms
heavyhaig
 
ACEP Magazine edition 4th launched on 05.06.2024
ACEP Magazine edition 4th launched on 05.06.2024ACEP Magazine edition 4th launched on 05.06.2024
ACEP Magazine edition 4th launched on 05.06.2024
Rahul
 
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
thanhdowork
 

Recently uploaded (20)

Self-Control of Emotions by Slidesgo.pptx
Self-Control of Emotions by Slidesgo.pptxSelf-Control of Emotions by Slidesgo.pptx
Self-Control of Emotions by Slidesgo.pptx
 
Swimming pool mechanical components design.pptx
Swimming pool  mechanical components design.pptxSwimming pool  mechanical components design.pptx
Swimming pool mechanical components design.pptx
 
spirit beverages ppt without graphics.pptx
spirit beverages ppt without graphics.pptxspirit beverages ppt without graphics.pptx
spirit beverages ppt without graphics.pptx
 
Tutorial for 16S rRNA Gene Analysis with QIIME2.pdf
Tutorial for 16S rRNA Gene Analysis with QIIME2.pdfTutorial for 16S rRNA Gene Analysis with QIIME2.pdf
Tutorial for 16S rRNA Gene Analysis with QIIME2.pdf
 
一比一原版(Otago毕业证)奥塔哥大学毕业证成绩单如何办理
一比一原版(Otago毕业证)奥塔哥大学毕业证成绩单如何办理一比一原版(Otago毕业证)奥塔哥大学毕业证成绩单如何办理
一比一原版(Otago毕业证)奥塔哥大学毕业证成绩单如何办理
 
Understanding Inductive Bias in Machine Learning
Understanding Inductive Bias in Machine LearningUnderstanding Inductive Bias in Machine Learning
Understanding Inductive Bias in Machine Learning
 
sieving analysis and results interpretation
sieving analysis and results interpretationsieving analysis and results interpretation
sieving analysis and results interpretation
 
Recycled Concrete Aggregate in Construction Part III
Recycled Concrete Aggregate in Construction Part IIIRecycled Concrete Aggregate in Construction Part III
Recycled Concrete Aggregate in Construction Part III
 
Online aptitude test management system project report.pdf
Online aptitude test management system project report.pdfOnline aptitude test management system project report.pdf
Online aptitude test management system project report.pdf
 
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
 
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
 
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
 
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressions
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressionsKuberTENes Birthday Bash Guadalajara - K8sGPT first impressions
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressions
 
Building Electrical System Design & Installation
Building Electrical System Design & InstallationBuilding Electrical System Design & Installation
Building Electrical System Design & Installation
 
Hierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power SystemHierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power System
 
[JPP-1] - (JEE 3.0) - Kinematics 1D - 14th May..pdf
[JPP-1] - (JEE 3.0) - Kinematics 1D - 14th May..pdf[JPP-1] - (JEE 3.0) - Kinematics 1D - 14th May..pdf
[JPP-1] - (JEE 3.0) - Kinematics 1D - 14th May..pdf
 
PROJECT FORMAT FOR EVS AMITY UNIVERSITY GWALIOR.ppt
PROJECT FORMAT FOR EVS AMITY UNIVERSITY GWALIOR.pptPROJECT FORMAT FOR EVS AMITY UNIVERSITY GWALIOR.ppt
PROJECT FORMAT FOR EVS AMITY UNIVERSITY GWALIOR.ppt
 
Technical Drawings introduction to drawing of prisms
Technical Drawings introduction to drawing of prismsTechnical Drawings introduction to drawing of prisms
Technical Drawings introduction to drawing of prisms
 
ACEP Magazine edition 4th launched on 05.06.2024
ACEP Magazine edition 4th launched on 05.06.2024ACEP Magazine edition 4th launched on 05.06.2024
ACEP Magazine edition 4th launched on 05.06.2024
 
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
 

AWS IoT, AWS Greengrass For Time Series Analysis [English Ver.]

  • 1. AWS IoT, AWS Greengrass For Time Series Analysis “Measuring & Predicting the fine dust(PM2.5) data.” @aniotmaker 정보통신설비 고급감리/Consulting/Firmware Engineer/Back-end Developer • Available Programming: Node.JS, JavaScript, SQL, Node-RED, Python, C&C++ • Seoul Weather Twitter Leader (https://twitter.com/aniotmaker) • AWS-IoT User Group Leader (https://www.facebook.com/groups/awsiot) • Node-RED User Group Leader (https://www.facebook.com/pg/nodereduser) Haesung Lee 2019. 5. 14.
  • 2. Contents • Introduction • Stacks For Seoul Weather Twitter • Seoul Weather Architecture • IoT Sensors with JSON format • AWS IoT Core • AWS QuickSight • AWS IoT Analytics on SageMaker • Tableau Analytics • Spark Zeppline Analytics • Twitter-bot • Line-bot • AWS CloudWatch • PM2.5 dust sensor with Prediction • Twitter-bot for Seoul weather • Conclusion • References • Q & A @aniotmaker
  • 4. AWS IoT Core AWS Greengrass Amazon QuickSight Open Weather Map APIs AWS SageMaker @aniotmakerStacks For Seoul Weather Twitter https://twitter.com/aniotmaker !4 Amazon EMR Amazon
 Athena Amazon CloudWatch Amazon EC2 Amazon
 S3 AWS Glue Amazon
 Athena Amazon Kinesis Firehose Amazon Redshift* Lambda function
  • 5. Seoul Weather Architecture AWS IoT Core AWS Greengrass Door Sensor Amazon CloudWatch Amazon QuickSight AWS IoT Analytics Dust Sensor Open Weather Map APIs Amazon EC2 Time Series Analysis, Weather & Dust Information !5 + Train Model https://twitter.com/aniotmaker AWS SageMaker @aniotmaker Amazon
 S3 + Amazon Kinesis Firehose AWS Glue ETL (Data Lake) Sensors Unit IoT (ML, Lamda / MQTT, TLS) Unit Big Data Processing Unit BI Visualisations Unit Social Networks Unit Amazon Redshift* (DataWarehouse) Amazon EMR (Hadoop/ Spark) MQTT Lambda function
  • 6. IoT Sensors with JSON format !6 A Dust Sensor A Door Sensor Open Weather API @aniotmaker
  • 7. AWS IoT Core !7 AWS IoT Core AWS Greengrass Dust Sensor
  • 9. AWS IoT Analytics on SageMaker !9 AWS IoT Analytics + Train Model AWS SageMakerAWS IoT Core AWS Greengrass Dust Sensor Amazon
 S3 +
  • 10. Apache Zeppline Analytics AWS IoT Core AWS Greengrass Dust Sensor Amazon
 S3 !10
  • 12. Twitter-bot • AWS-IoT + Twitter API • How To Predict the time of outside exercising? !12 @aniotmaker
  • 13. Line-bot !13 • AWS-IoT + Line API @aniotmaker
  • 15. PM2.5 dust sensor with Prediction !15 @aniotmaker
  • 16. Twitter-bot for Seoul weather @aniotmaker !16
  • 17. Conclusion @aniotmaker As you can see, my purpose is to implement time series analysis with AWS IoT. As much as possible to avoid fine dust and time to find the best outdoor exercise timing. Twitter would give you the best outdoor walking and exercise timing for your health Red-Coloured line Is prediction data !17
  • 18. References • Designing MQTT Topics for AWS IoT Core (White Paper): https://d1.awsstatic.com/whitepapers/Designing_MQTT_Topics_for_AWS_IoT_Core.pdf • Using Node-RED Library To Wire Telemetry Data From IoT Devices To The Cloud: https://labs.eleks.com/2019/01/node-red-library-iot-cloud.html • Using AWS IoT Analytics to Prepare Data for QuickSight Time-Series Visualizations: https://aws.amazon.com/blogs/iot/using-aws-iot-analytics-to- prepare-data-for-quicksight-time-series-visualizations/ • AWS IoT Analytics 기반 시계열 데이터 QuickSight 시각화 방법: https://aws.amazon.com/ko/blogs/korea/using-aws-iot-analytics-to-prepare-data-for- quicksight-time-series-visualizations/ • AWS Docs: https://docs.aws.amazon.com/index.html • What Is AWS IoT Greengrass? https://docs.aws.amazon.com/greengrass/latest/developerguide/what-is-gg.html • 서버리스 실시간 데이터 처리 애플리케이션 구축: https://aws.amazon.com/getting-started/projects/build-serverless-real-time-data-processing-app- lambda-kinesis-s3-dynamodb-cognito-athena/?trk=gs_card • AWS 기반 지속 가능한 데이터 분석 플랫폼 구축하기 - 소성운, 지그재그 :: AWS Summit Seoul 2019 : https://www.slideshare.net/awskorea/aws-aws- summit-seoul-2019-141290115 • AWS 기반 지속 가능한 데이터 분석하기 GitHub: https://github.com/awskrug/datascience-group/tree/master/workshop-sustainable_data_analysis • Spark Streaming: IoT with Amazon Kinesis and Visualizing with Qubole Notebooks: https://www.qubole.com/blog/spark-streaming-iot-amazon- kinesis-visualizing-qubole-notebooks/ @aniotmaker !18
  • 19. Q & A @aniotmaker 서울날씨 @aniotmaker @aniotmaker !19