SlideShare a Scribd company logo
1 of 14
Download to read offline
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Spatio-temporal analysis of flows
in CDC 2013 data
Gennady Andrienko
Natalia Andrienko
http://geoanalytics.net
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Data processing procedures
1. Initial processing in Database
• Eliminating duplicates (same ID and time stamp)
• Eliminating stationary points (speed<2km/h)
• Dividing into days (by 3AM)
• Further dividing by 30min stops and 1km gaps
• Eliminating trajectories consisting of less than 5 points, shorter than 5
minutes, within 100m bounding rectangle
2. Further processing attempts in main memory
• Removing segments with speed > 75km/h
• Removing segments with high tortuosity (>2 over 1min), sinuosity (>5
over 1min) or being within 100m radius over 10-15 minutes
3. Still, the data are far from being perfect
• Wrong hardware / software / settings?
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Data quality
• Jumping around stops;
• Systematically wrong positions
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Summarization and aggregation of trajectories
• Density-driven Voronoi polygons, r=100m: 14,033 polygons country-wide
• Correctly reflect the street network
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Flows between adjacent polygons
• 14,033 polygons => 26,094 directed connections
• 5,723 used by at least 5 different trajectories
• Attribute “N different trajectories” compensates for “hairball” structures @stops
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Hourly time series of flows: transformation and clustering
• Only connections used by
at least 5 trajectories
1. Hourly time series
2. Smoothing by 3 hours
windows
3. Mean-normalization of
each time series
4. Clustering by k-Means
with different K
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Major clusters
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Cluster 5
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Cluster 3
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Cluster 1
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Cluster 2
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Cluster 4
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Conclusions
• Different roads have different temporal signatures
• Especially bridges
• Too few trajectories per person / per road segment for more sophisticated
analysis
• Data quality issues
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
What we can do:
• Analysis of flows and their temporal dynamics
Times
Locations
Movers
Spatial events
Spatial event data Spatial time series
Movement data Local time series
Spatial distributions
Trajectories
Details:
Visual Analytics of Movement: an Overview of
Methods, Tools, and Procedures
Information Visualization, 12(1), pp.3-24, 2013
and
Visual Analytics of Movement
Springer-Verlag 2013
ISBN 978-3-642-37582-8
Due: July 5, 2013

More Related Content

Similar to Spatio temporal analysis of flows in cdc 2013 data

OSMC 2016 | Friends and foes in API Monitoring by Heinrich Hartmann
OSMC 2016 | Friends and foes in API Monitoring by Heinrich HartmannOSMC 2016 | Friends and foes in API Monitoring by Heinrich Hartmann
OSMC 2016 | Friends and foes in API Monitoring by Heinrich HartmannNETWAYS
 
OSMC 2016 - Friends and foes by Heinrich Hartmann
OSMC 2016 - Friends and foes by Heinrich HartmannOSMC 2016 - Friends and foes by Heinrich Hartmann
OSMC 2016 - Friends and foes by Heinrich HartmannNETWAYS
 
Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)Vincenzo Gulisano
 
Improving Traffic Prediction Using Weather Data with Ramya Raghavendra
Improving Traffic Prediction Using Weather Data  with Ramya RaghavendraImproving Traffic Prediction Using Weather Data  with Ramya Raghavendra
Improving Traffic Prediction Using Weather Data with Ramya RaghavendraSpark Summit
 
The data streaming processing paradigm and its use in modern fog architectures
The data streaming processing paradigm and its use in modern fog architecturesThe data streaming processing paradigm and its use in modern fog architectures
The data streaming processing paradigm and its use in modern fog architecturesVincenzo Gulisano
 
MC Lecture 8 67875667767777775677887.pptx
MC Lecture 8 67875667767777775677887.pptxMC Lecture 8 67875667767777775677887.pptx
MC Lecture 8 67875667767777775677887.pptxBinyamBekeleMoges
 
Tsinghua University: Two Exemplary Applications in China
Tsinghua University: Two Exemplary Applications in ChinaTsinghua University: Two Exemplary Applications in China
Tsinghua University: Two Exemplary Applications in ChinaDataStax Academy
 
SharkFest16_Palm_Online
SharkFest16_Palm_OnlineSharkFest16_Palm_Online
SharkFest16_Palm_OnlineBrad Palm
 
Network visibility and control using industry standard sFlow telemetry
Network visibility and control using industry standard sFlow telemetryNetwork visibility and control using industry standard sFlow telemetry
Network visibility and control using industry standard sFlow telemetrypphaal
 
A Deep Learning use case for water end use detection by Roberto Díaz and José...
A Deep Learning use case for water end use detection by Roberto Díaz and José...A Deep Learning use case for water end use detection by Roberto Díaz and José...
A Deep Learning use case for water end use detection by Roberto Díaz and José...Big Data Spain
 
An Introduction to Distributed Data Streaming
An Introduction to Distributed Data StreamingAn Introduction to Distributed Data Streaming
An Introduction to Distributed Data StreamingParis Carbone
 
Improving Traffic Prediction Using Weather Datawith Ramya Raghavendra
Improving Traffic Prediction Using Weather Datawith Ramya RaghavendraImproving Traffic Prediction Using Weather Datawith Ramya Raghavendra
Improving Traffic Prediction Using Weather Datawith Ramya RaghavendraSpark Summit
 
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...Tal Lavian Ph.D.
 
Khatibi lecture cov.uni
Khatibi lecture cov.uniKhatibi lecture cov.uni
Khatibi lecture cov.uniRahman Khatibi
 
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...Tal Lavian Ph.D.
 
2014-04-easteros
2014-04-easteros2014-04-easteros
2014-04-easterosJack Wang
 

Similar to Spatio temporal analysis of flows in cdc 2013 data (20)

OSMC 2016 | Friends and foes in API Monitoring by Heinrich Hartmann
OSMC 2016 | Friends and foes in API Monitoring by Heinrich HartmannOSMC 2016 | Friends and foes in API Monitoring by Heinrich Hartmann
OSMC 2016 | Friends and foes in API Monitoring by Heinrich Hartmann
 
OSMC 2016 - Friends and foes by Heinrich Hartmann
OSMC 2016 - Friends and foes by Heinrich HartmannOSMC 2016 - Friends and foes by Heinrich Hartmann
OSMC 2016 - Friends and foes by Heinrich Hartmann
 
Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)
 
Strel streaming
Strel streamingStrel streaming
Strel streaming
 
Av 738 - Adaptive Filtering Lecture 1 - Introduction
Av 738 - Adaptive Filtering Lecture 1 - IntroductionAv 738 - Adaptive Filtering Lecture 1 - Introduction
Av 738 - Adaptive Filtering Lecture 1 - Introduction
 
Improving Traffic Prediction Using Weather Data with Ramya Raghavendra
Improving Traffic Prediction Using Weather Data  with Ramya RaghavendraImproving Traffic Prediction Using Weather Data  with Ramya Raghavendra
Improving Traffic Prediction Using Weather Data with Ramya Raghavendra
 
The data streaming processing paradigm and its use in modern fog architectures
The data streaming processing paradigm and its use in modern fog architecturesThe data streaming processing paradigm and its use in modern fog architectures
The data streaming processing paradigm and its use in modern fog architectures
 
MC Lecture 8 67875667767777775677887.pptx
MC Lecture 8 67875667767777775677887.pptxMC Lecture 8 67875667767777775677887.pptx
MC Lecture 8 67875667767777775677887.pptx
 
Tsinghua University: Two Exemplary Applications in China
Tsinghua University: Two Exemplary Applications in ChinaTsinghua University: Two Exemplary Applications in China
Tsinghua University: Two Exemplary Applications in China
 
Chap2 slides
Chap2 slidesChap2 slides
Chap2 slides
 
L4 volume studies
L4 volume studiesL4 volume studies
L4 volume studies
 
SharkFest16_Palm_Online
SharkFest16_Palm_OnlineSharkFest16_Palm_Online
SharkFest16_Palm_Online
 
Network visibility and control using industry standard sFlow telemetry
Network visibility and control using industry standard sFlow telemetryNetwork visibility and control using industry standard sFlow telemetry
Network visibility and control using industry standard sFlow telemetry
 
A Deep Learning use case for water end use detection by Roberto Díaz and José...
A Deep Learning use case for water end use detection by Roberto Díaz and José...A Deep Learning use case for water end use detection by Roberto Díaz and José...
A Deep Learning use case for water end use detection by Roberto Díaz and José...
 
An Introduction to Distributed Data Streaming
An Introduction to Distributed Data StreamingAn Introduction to Distributed Data Streaming
An Introduction to Distributed Data Streaming
 
Improving Traffic Prediction Using Weather Datawith Ramya Raghavendra
Improving Traffic Prediction Using Weather Datawith Ramya RaghavendraImproving Traffic Prediction Using Weather Datawith Ramya Raghavendra
Improving Traffic Prediction Using Weather Datawith Ramya Raghavendra
 
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
 
Khatibi lecture cov.uni
Khatibi lecture cov.uniKhatibi lecture cov.uni
Khatibi lecture cov.uni
 
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
 
2014-04-easteros
2014-04-easteros2014-04-easteros
2014-04-easteros
 

More from cdc2013workshop

Tracking daily mobilities: GPS based bicycle data collection, processing, and...
Tracking daily mobilities: GPS based bicycle data collection, processing, and...Tracking daily mobilities: GPS based bicycle data collection, processing, and...
Tracking daily mobilities: GPS based bicycle data collection, processing, and...cdc2013workshop
 
Cycling in ghent objective and subjective evaluation of civitas policy measures
Cycling in ghent objective and subjective evaluation of civitas policy measuresCycling in ghent objective and subjective evaluation of civitas policy measures
Cycling in ghent objective and subjective evaluation of civitas policy measurescdc2013workshop
 
Application of gps tracking in bicycle research
Application of gps tracking in bicycle researchApplication of gps tracking in bicycle research
Application of gps tracking in bicycle researchcdc2013workshop
 
Relating mobility patterns to socio demographic profiles
Relating mobility patterns to socio demographic profilesRelating mobility patterns to socio demographic profiles
Relating mobility patterns to socio demographic profilescdc2013workshop
 
Analyzing cyclists’ behaviors and exploring the environments from cycling tracks
Analyzing cyclists’ behaviors and exploring the environments from cycling tracksAnalyzing cyclists’ behaviors and exploring the environments from cycling tracks
Analyzing cyclists’ behaviors and exploring the environments from cycling trackscdc2013workshop
 
Reconstructing movement traces throug a hybrid map matching algorithm
Reconstructing movement traces throug a hybrid map matching algorithmReconstructing movement traces throug a hybrid map matching algorithm
Reconstructing movement traces throug a hybrid map matching algorithmcdc2013workshop
 
Extraction of bicycle commuter trips from day long gps trajectories
Extraction of bicycle commuter trips from day long gps trajectoriesExtraction of bicycle commuter trips from day long gps trajectories
Extraction of bicycle commuter trips from day long gps trajectoriescdc2013workshop
 
Cyclist's waiting: identifying road signal patterns
Cyclist's waiting: identifying road signal patternsCyclist's waiting: identifying road signal patterns
Cyclist's waiting: identifying road signal patternscdc2013workshop
 

More from cdc2013workshop (8)

Tracking daily mobilities: GPS based bicycle data collection, processing, and...
Tracking daily mobilities: GPS based bicycle data collection, processing, and...Tracking daily mobilities: GPS based bicycle data collection, processing, and...
Tracking daily mobilities: GPS based bicycle data collection, processing, and...
 
Cycling in ghent objective and subjective evaluation of civitas policy measures
Cycling in ghent objective and subjective evaluation of civitas policy measuresCycling in ghent objective and subjective evaluation of civitas policy measures
Cycling in ghent objective and subjective evaluation of civitas policy measures
 
Application of gps tracking in bicycle research
Application of gps tracking in bicycle researchApplication of gps tracking in bicycle research
Application of gps tracking in bicycle research
 
Relating mobility patterns to socio demographic profiles
Relating mobility patterns to socio demographic profilesRelating mobility patterns to socio demographic profiles
Relating mobility patterns to socio demographic profiles
 
Analyzing cyclists’ behaviors and exploring the environments from cycling tracks
Analyzing cyclists’ behaviors and exploring the environments from cycling tracksAnalyzing cyclists’ behaviors and exploring the environments from cycling tracks
Analyzing cyclists’ behaviors and exploring the environments from cycling tracks
 
Reconstructing movement traces throug a hybrid map matching algorithm
Reconstructing movement traces throug a hybrid map matching algorithmReconstructing movement traces throug a hybrid map matching algorithm
Reconstructing movement traces throug a hybrid map matching algorithm
 
Extraction of bicycle commuter trips from day long gps trajectories
Extraction of bicycle commuter trips from day long gps trajectoriesExtraction of bicycle commuter trips from day long gps trajectories
Extraction of bicycle commuter trips from day long gps trajectories
 
Cyclist's waiting: identifying road signal patterns
Cyclist's waiting: identifying road signal patternsCyclist's waiting: identifying road signal patterns
Cyclist's waiting: identifying road signal patterns
 

Recently uploaded

GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdfChristopherTHyatt
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 

Recently uploaded (20)

GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 

Spatio temporal analysis of flows in cdc 2013 data

  • 1. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Spatio-temporal analysis of flows in CDC 2013 data Gennady Andrienko Natalia Andrienko http://geoanalytics.net
  • 2. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Data processing procedures 1. Initial processing in Database • Eliminating duplicates (same ID and time stamp) • Eliminating stationary points (speed<2km/h) • Dividing into days (by 3AM) • Further dividing by 30min stops and 1km gaps • Eliminating trajectories consisting of less than 5 points, shorter than 5 minutes, within 100m bounding rectangle 2. Further processing attempts in main memory • Removing segments with speed > 75km/h • Removing segments with high tortuosity (>2 over 1min), sinuosity (>5 over 1min) or being within 100m radius over 10-15 minutes 3. Still, the data are far from being perfect • Wrong hardware / software / settings?
  • 3. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Data quality • Jumping around stops; • Systematically wrong positions
  • 4. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Summarization and aggregation of trajectories • Density-driven Voronoi polygons, r=100m: 14,033 polygons country-wide • Correctly reflect the street network
  • 5. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Flows between adjacent polygons • 14,033 polygons => 26,094 directed connections • 5,723 used by at least 5 different trajectories • Attribute “N different trajectories” compensates for “hairball” structures @stops
  • 6. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Hourly time series of flows: transformation and clustering • Only connections used by at least 5 trajectories 1. Hourly time series 2. Smoothing by 3 hours windows 3. Mean-normalization of each time series 4. Clustering by k-Means with different K
  • 7. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Major clusters
  • 8. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Cluster 5
  • 9. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Cluster 3
  • 10. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Cluster 1
  • 11. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Cluster 2
  • 12. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Cluster 4
  • 13. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Conclusions • Different roads have different temporal signatures • Especially bridges • Too few trajectories per person / per road segment for more sophisticated analysis • Data quality issues
  • 14. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS What we can do: • Analysis of flows and their temporal dynamics Times Locations Movers Spatial events Spatial event data Spatial time series Movement data Local time series Spatial distributions Trajectories Details: Visual Analytics of Movement: an Overview of Methods, Tools, and Procedures Information Visualization, 12(1), pp.3-24, 2013 and Visual Analytics of Movement Springer-Verlag 2013 ISBN 978-3-642-37582-8 Due: July 5, 2013