InnoConnect: Big data analysis
•
0 likes•96 views
This document summarizes a presentation about using big geo-data and data visualization techniques to transform raw data into useful information. It discusses using the WebGLayer JavaScript library to interactively visualize large datasets of up to 1.5 million data points in under 100ms in a web browser. Examples are given of visualizing traffic accidents in Flanders and crime data in Chicago. Potential applications discussed include analyzing criminality, traffic, parking, and water usage data. Upcoming developments include visualizing traffic flow data from Flanders and Plzeň and criminal offenses data from Plzeň.
Report
Share
Report
Share
Download to read offline
Recommended
A New Data Landscape: Delivering Open Data for the City of Glasgow - Steven R...
A New Data Landscape: Delivering Open Data for the City of Glasgow - Steven R...Association for Geographic Information (AGI)
This document outlines plans for the City of Glasgow to release open data and create a new open data website at OPEN.glasgow.gov.uk. It discusses four themes for open data including empowering citizens with data, making city infrastructure data available, linking asset data, and demonstrating data collection. The goals are to make more city data freely available and linkable in order to engage citizens and community organizations to find innovative solutions for the city using open data.Ibm infosphere mgarren
IBM InfoSphere Streams is a scalable stream processing platform that can be used to build real-time intelligent transportation systems. It allows processing of both structured and unstructured data streams from multiple sensors in real-time. The stream processing is done through a data flow graph of streaming data objects and processing elements using the SPADE processing engine. A pilot project in Stockholm used InfoSphere Streams to monitor current traffic by comparing real-time GPS data to historical data to estimate travel times and compute shortest paths, providing visualizations to end users. The system was able to process over 1,000 GPS readings per second from various vehicles.
An effective joint prediction model for travel demands and traffic flows
This document summarizes a research paper that presents DeepTP, a joint prediction model for travel demands and traffic flows. DeepTP uses four modules: 1) a future spatio-temporal encoding module, 2) a past traffic sequence encoding module, 3) a graph-based correlation encoding module, and 4) a final estimation module. It encodes three types of embeddings - past traffic data, region-level correlations, and temporal periodicity - to capture inter-traffic correlations, region-level similarities, and periodic patterns in demand and flow. The model was evaluated on real-world traffic datasets from two cities and was shown to outperform other baselines in joint demand and flow prediction.
Data storytelling via augmented reality - Andy Hudson-Smith - Jisc Digital Fe...
The document discusses Andy Hudson-Smith's work using new technologies like augmented reality, the Oculus Rift, and the Internet of Things to tell stories with city data. Some of his projects involved 3D visualizations of air pollution data in a virtual 2005 London and creating a city dashboard with live London data for the mayor's office. The document also briefly outlines Hudson-Smith's research exploring new ways to visualize and interact with city data, including using EEG devices and gaming technologies to augment policy documents.
The Micromobility Policy Playbook by Regina Clewlow
Regina Clewlow, CEO & Co-Founder, Populus, gave this presentation at Forth's webinar on November 12, 2019
URBAN TRAFFIC DATA HACK - ROLAND MAJOR
Roland is currently working with TfL on the Surface Intelligent Transport System, which is looking to improve the insight available from existing and new data sources. Have worked on event driven architectures for many years and across many sectors although with a primary focus on Transport.
Mapping mobility Piyushimita Thakuriah
The document discusses using big data and new technologies to improve transport planning and operations. It provides examples of collecting lifelogging data through wearable sensors to analyze travel behavior, crowdsourced bicyclist data to evaluate infrastructure investments, and using various data sources to examine links between transport and labor market outcomes. The document emphasizes that transport systems need to be re-evaluated in some areas to better match changing job locations and needs of workers.
Intro to Big Data in Urban GIS Research
Urban big data are increasingly being used in urban GIS research. This presentation, developed for an introductory GIS course, introduces the seven V's of big data: volume, variety, velocity, veracity, value, visualization, and variability. Major sources of urban big data include sensor systems, user-generated content, administrative systems, private sector data, humanities data, and hybrid data. These categories and the seven V's are illustrated with six examples of cutting-edge urban big data research: the Array of Things sensing network, Austin bike data, analysis of London's transport network, scraping Craigslist to analyze rental housing, the Mapping Inequality Project, and the EPA Smart Locations Database. The presentation concludes with a discussion of critiques surrounding the use of big data.
Recommended
A New Data Landscape: Delivering Open Data for the City of Glasgow - Steven R...
A New Data Landscape: Delivering Open Data for the City of Glasgow - Steven R...Association for Geographic Information (AGI)
This document outlines plans for the City of Glasgow to release open data and create a new open data website at OPEN.glasgow.gov.uk. It discusses four themes for open data including empowering citizens with data, making city infrastructure data available, linking asset data, and demonstrating data collection. The goals are to make more city data freely available and linkable in order to engage citizens and community organizations to find innovative solutions for the city using open data.Ibm infosphere mgarren
IBM InfoSphere Streams is a scalable stream processing platform that can be used to build real-time intelligent transportation systems. It allows processing of both structured and unstructured data streams from multiple sensors in real-time. The stream processing is done through a data flow graph of streaming data objects and processing elements using the SPADE processing engine. A pilot project in Stockholm used InfoSphere Streams to monitor current traffic by comparing real-time GPS data to historical data to estimate travel times and compute shortest paths, providing visualizations to end users. The system was able to process over 1,000 GPS readings per second from various vehicles.
An effective joint prediction model for travel demands and traffic flows
This document summarizes a research paper that presents DeepTP, a joint prediction model for travel demands and traffic flows. DeepTP uses four modules: 1) a future spatio-temporal encoding module, 2) a past traffic sequence encoding module, 3) a graph-based correlation encoding module, and 4) a final estimation module. It encodes three types of embeddings - past traffic data, region-level correlations, and temporal periodicity - to capture inter-traffic correlations, region-level similarities, and periodic patterns in demand and flow. The model was evaluated on real-world traffic datasets from two cities and was shown to outperform other baselines in joint demand and flow prediction.
Data storytelling via augmented reality - Andy Hudson-Smith - Jisc Digital Fe...
The document discusses Andy Hudson-Smith's work using new technologies like augmented reality, the Oculus Rift, and the Internet of Things to tell stories with city data. Some of his projects involved 3D visualizations of air pollution data in a virtual 2005 London and creating a city dashboard with live London data for the mayor's office. The document also briefly outlines Hudson-Smith's research exploring new ways to visualize and interact with city data, including using EEG devices and gaming technologies to augment policy documents.
The Micromobility Policy Playbook by Regina Clewlow
Regina Clewlow, CEO & Co-Founder, Populus, gave this presentation at Forth's webinar on November 12, 2019
URBAN TRAFFIC DATA HACK - ROLAND MAJOR
Roland is currently working with TfL on the Surface Intelligent Transport System, which is looking to improve the insight available from existing and new data sources. Have worked on event driven architectures for many years and across many sectors although with a primary focus on Transport.
Mapping mobility Piyushimita Thakuriah
The document discusses using big data and new technologies to improve transport planning and operations. It provides examples of collecting lifelogging data through wearable sensors to analyze travel behavior, crowdsourced bicyclist data to evaluate infrastructure investments, and using various data sources to examine links between transport and labor market outcomes. The document emphasizes that transport systems need to be re-evaluated in some areas to better match changing job locations and needs of workers.
Intro to Big Data in Urban GIS Research
Urban big data are increasingly being used in urban GIS research. This presentation, developed for an introductory GIS course, introduces the seven V's of big data: volume, variety, velocity, veracity, value, visualization, and variability. Major sources of urban big data include sensor systems, user-generated content, administrative systems, private sector data, humanities data, and hybrid data. These categories and the seven V's are illustrated with six examples of cutting-edge urban big data research: the Array of Things sensing network, Austin bike data, analysis of London's transport network, scraping Craigslist to analyze rental housing, the Mapping Inequality Project, and the EPA Smart Locations Database. The presentation concludes with a discussion of critiques surrounding the use of big data.
Open Data, Research, & the Internet of Things
The document discusses the city of Chicago's open data portal and its use of sensors and IoT technologies. It describes how Chicago makes vast amounts of city data openly available online, including data on traffic, water quality, 311 calls and more. This data is powering new civic applications and is also being used by the University of Chicago to build an "Array of Things" project that involves deploying sensors around the city to continuously monitor environmental and other conditions. Finally, the document discusses challenges around analyzing large volumes of city data and extracting useful insights from it.
Lesson3 esa summer_school_brovelli
This document discusses several citizen science and crowdsourcing projects conducted by Politecnico di Milano's Geomatics Laboratory. It summarizes three main applications: 1) Sensing slow mobility in Lombardy region by analyzing geotagged social media data to identify popular locations, 2) A webGIS platform to collect and visualize European land use/cover maps and allow users to add photos, 3) Several applications to visualize and analyze social media and telecommunications big data from Milan, including filtering data by date and land use and visualizing patterns over time.
Integrating Sensor and Social Data for Understanding City Events
Integrating Sensor and Social Data for Understanding City EventsArtificial Intelligence Institute at UofSC
The document discusses integrating sensor and social data to understand city events. It describes collecting data from multiple sources, including sensors and social media. Statistical models are used to analyze the sensor data and identify anomalies, which are then correlated with events extracted from social media using spatial and temporal proximity. The approach is evaluated on traffic data from San Francisco, integrating data from traffic sensors and Twitter to extract and corroborate traffic events.A Data Scientist Exploration in the World of Heterogeneous Open Geospatial Data
We present the challenges faced by a Data Scientist in exploring and analyzing heterogeneous Open Geospatial Data. This work is aimed at explaining the initial steps of a data exploration process, specifically aimed at discovering similarities and differences conveyed by diverse sources and resulting from their correlation analysis; we also explore the influence of spatial resolution on the dependence strength between heterogeneous urban sources, to pave the way to a meaningful information fusion.
La telefonía móvil como fuente de información para el estudio de la movilidad...
Existe una multitud de sectores donde es necesario disponer de datos que permitan entender los patrones de comportamiento de la población: la planificación y la operación de los sistemas de transporte requiere información precisa, fiable y actualizada sobre la demanda de viajes; los patrones de actividad y movilidad de los turistas tienen profundas implicaciones para la planificación de infraestructuras, el desarrollo de la oferta turística y las estrategias de marketing turístico; entender el comportamiento espacial de los clientes es clave para optimizar las estrategias de distribución, comercialización y publicidad, determinar la localización de un nuevo comercio o punto de venta, o maximizar el retorno de la inversión en acciones de marketing. Las fuentes de datos tradicionales, basadas fundamentalmente en encuestas y registros administrativos, proporcionan información muy valiosa, pero no están exentas de inconvenientes. En general, las encuestas resultan caras y lentas de realizar, lo que limita el tamaño de la muestra y la frecuencia de actualización de la información, a lo que hay que añadir otras limitaciones intrínsecas, como las respuestas incorrectas e imprecisas, o la dependencia de la disposición a responder de los entrevistados. En los últimos años, la generalización del uso de dispositivos móviles ha abierto nuevas oportunidades para superar muchas de estas limitaciones. La posibilidad de recoger datos geolocalizados sobre la actividad de las personas, de manera dinámica y a un coste sensiblemente inferior al de los métodos tradicionales, abre la puerta a infinidad de aplicaciones. Las más evidentes son quizá las relacionadas con el transporte y la movilidad, pero el abanico es mucho más amplio, abarcando casi cualquier área que requiera información sobre los patrones de actividad y movilidad de la población. Las nuevas fuentes de datos plantean asimismo importantes retos, desde la necesidad de desarrollar nuevas metodologías de análisis, hasta la protección de la privacidad.
Vídeo de la ponencia: https://youtu.be/5PKC5Qm0eHM
Lizette Lancaster - Institute for Security Studies (Annex)
The document describes the features and components of the Crime and Justice Information and Analysis Hub, including an online website with crime statistics, maps, documents and multimedia. It has an advanced viewer with interactive crime maps, community profiles and crime modeling. The hub aims to provide data, analysis and resources on crime and justice in Africa.
OpenStreetMap and CycleStreets: collaborative map-making and cartography in t...
Abstract: The arrival of web-based mapping from Google and others has revolutionised, in the space of only five years, the way many people interact with maps and map data. And the success of projects such as Wikipedia highlight how collation of small amounts of information from large numbers of people - an approach called 'crowdsourcing' - can challenge traditional models of data collection and ownership. Bringing these concepts together is OpenStreetMap, a collaborative project to create a free editable map of the world. Well-established enterprises such as the Ordnance Survey are coming under increased pressure from this new model, and large companies such as MapQuest and Microsoft are starting to use and invest in it. Martin Lucas-Smith, Webmaster in the Department, and one of two main developers of the leading UK-wide cycle journey planner website, CycleStreets, will discuss OpenStreetMap, its use within a wide range of systems (from cartography, routing, and even its central role helping deal with the Haiti disaster) and discuss the challenges it poses to traditional forms of cartography and data collection.
Multimodal Mopbility Planning Using Big Data in Toronto
With collaborations with various City divisions and private service providers (in this case Streetlight data providers), our North York mobility innovation team uncovered several surprising suburban travel behaviour, patterns and distributions of trips that lead to meaningful and quantitative multimodal mobility planning. This presentation is a summary of project experiences and describes the key findings.
Chicago Crime Dataset Project Proposal
- The document proposes a machine learning project using the Chicago Crime dataset to build a web application providing insights into crime patterns.
- It will include geospatial analysis and visualizations of crime hotspots and trends over time using ArcGIS maps, as well as statistical analysis and prediction of future crimes.
- The project involves preprocessing the large dataset, performing feature engineering, dividing Chicago into crime clusters, and building prediction models for each cluster to be deployed via REST API and integrated into the web application. Tools include Python, Docker, Azure ML, ArcGIS, and Java for the frontend.
191008 kafka meetup_liebig
This document discusses challenges and opportunities for situation-aware traffic control using predictive routing and real-time mobility data. It outlines several challenges, including ensuring privacy and participation with heterogeneous devices, validating models in a closed feedback loop, and developing solutions that can apply over the long term with changing environments and data sources. Decentralized and open approaches are proposed to address issues of data integration, expandability, and cross-border coordination. The goal is to improve urban transport efficiency through predictive models while protecting individual privacy and enabling participation.
2018 Information Forum - Bob Bennett
Title: 21st Century Communities for 21st Century Citizens
As Bloomington-Normal and McLean County gear up to redefine our economy, we must recognise the drastic effects of technology on the future of our cities. And the future is now. Technology integration is especially challenging as it is ever evolving and impacting a wide array of services and infrastructure. More than ever before, many different organizations - public and private - will need to come together to help transform our cities to 21st century communities.
During the keynote, you will hear about how Kansas City, Missouri is collaborating with community, business, academic and technology stakeholders to integrate ever evolving technologies to create an open government and improve citizen services and engagement.
This years topic speaks to the core of BN Advantage - collaborative economic development efforts to create a vibrant and sustainable regional economy in Bloomington-Normal and McLean County.
SC4 Workshop 2: Josep Maria Salanova - Pilot in Thessaloniki
The document describes a big data transport pilot project in Thessaloniki, Greece. The project utilizes several sources of probe data including static Bluetooth sensors, a fleet of over 1,200 taxis and buses that provide real-time location data, and social media check-ins. This data is used to estimate traffic conditions, travel times, mobility patterns and more. The pilot aims to test processing techniques like travel time estimation, traffic prediction, and data expansion. Lessons learned from the first phase will be applied to improve the algorithms and integrate additional data sources in future pilots.
CitySDK Linked Data API
The document discusses the City Service Development Kit (CitySDK), an open source platform that collects, annotates, links, and distributes city data as linked open data. The CitySDK aims to facilitate sharing best practices across cities by providing common service interfaces and guidelines. It describes several use cases where the CitySDK has helped make city data more accessible and interoperable for developers, researchers, citizens and other stakeholders. Examples of applications that have been built using CitySDK data and APIs are also mentioned.
Smart City Next Steps
This document discusses various smart city initiatives around the world. It begins by outlining the drivers for smart cities like urbanization, quality of life, and talent attraction. Examples of smart city projects are then provided from London (transportation), Malaysia (high-speed internet backbone), Korea (access to government services), Boston (energy efficiency), Vienna (quality of life focus), Delhi (cane for blind navigation), Barcelona (smart trash collection), Dearborn (autonomous vehicles testing), New York (free public WiFi), Singapore (integrated mapping platform), Helsinki (mobility as a service), Japan (child tracking project), Netherlands (motion-detecting streetlights), San Francisco (integrated street lighting), Detroit (gunshot
Case Studies in Managing Traffic in a Developing Country with Privacy-Preserv...
Simulation is known to be an effective technique to understand
and manage traffic in cities of developed countries. However, in developing countries, traffic management is lacking due to a wide diversity of vehicles on the road, their chaotic movement, little instrumentation to sense traffic state and limited funds to create IT and physical infrastructure to ameliorate the situation. Under these conditions, in this paper, we present our approach of using the Megaffic traffic simulator as a service to gain actionable insights for two use-cases and cities in India, a first. Our approach is general to be readily used in other use cases and cities; and our results give new insights: (a) using demographics data, traffic demand can be reduced if timings of government offices are altered in Delhi, (b) using a mobile company’s Call
Data Record (CDR) data to mine trajectories anonymously,
one can take effective traffic actions while organizing events
in Mumbai at local scale.
URBANITE, Decision making in the urban transformation field using disruptive...
URBANITE was presented jointly with URBANAGE, DECIDO and PolicyCLOUD projects in Data Week 2022 in session: Disruptive technologies empowering decision-making in the public sector.
Traffic data fusion methodology
1) The document discusses the development of a traffic data fusion methodology that intelligently combines multiple data sources to obtain more accurate and complete traffic information than any single source can provide alone.
2) Different data sources have strengths and weaknesses depending on traffic conditions, and understanding these strengths and weaknesses helps to resolve differences between sources.
3) Intelligent data fusion using quality measures from multiple sources can provide near-complete traffic coverage and high quality information, improving transport network management and planning.
Urban Computing in LarKC
Joint Work with Emanuele Della Valle
emanuele.dellavalle@polimi.it.
Presentation of the results of the Urban Computing use case of the LarKC project. Speech at the ITN Expo event (http://www.itnexpo.it/) on October 16th, 2009.
Transport for London: Using data to keep London moving
This talk was presented by Sriskandarajah Suhothayan (WSO2) and Roland Major (Transport for London) at the Strata Data Conference in London, May 23 2017.
Transport for London (TfL) uses a wide range of data for operational purposes, but the underlying data is typically held in multiple disconnected systems. Freedom of Information requests have helped prove the value of sharing this data. TfL is embarking on a journey to make more of this data open and available in real time.
TfL and WSO2 have been working together on broader integration projects. Roland Major and Sriskandarajah Suhothayan share the evolving big data and IoT architectures and services TfL is building to pull together these diverse datasets to better support operational teams and accelerate the identification and classification of disruption to improve response times for incidents. In particular, they explore WSO2’s solution, which emerged from the Data in Motion hackathon organized by TfL, AWS, and Geovation. The solution innovates TfL’s heterogeneous data sources through the combination of the TfL Unified API and its operational data sources, including traffic sensor, air quality, and passenger flow data, to provide better travel time and transit suggestions for Londoners and tourists using the WSO2 Data Analytics Server, WSO2 Complex Event Processor, and WSO2 API Manager, bringing together IoT and big data techniques to feed a real-time dashboard of current and predicted transport network status.
EDF2014: Ralf-Peter Schaefer, Head of Traffic Product Unit, TomTom, Germany: ...
Industry Keynote Talk by Ralf-Peter Schaefer, Head of Traffic Product Unit, TomTom, Germany at the European Data Forum 2014, 20 March 2014 in Athens, Greece: Probe Data Analytics and Processing for Traffic Information, Traffic Planning and Traffic Management.
Presentation of the OECD Artificial Intelligence Review of Germany
Consult the full report at https://www.oecd.org/digital/oecd-artificial-intelligence-review-of-germany-609808d6-en.htm
More Related Content
Similar to InnoConnect: Big data analysis
Open Data, Research, & the Internet of Things
The document discusses the city of Chicago's open data portal and its use of sensors and IoT technologies. It describes how Chicago makes vast amounts of city data openly available online, including data on traffic, water quality, 311 calls and more. This data is powering new civic applications and is also being used by the University of Chicago to build an "Array of Things" project that involves deploying sensors around the city to continuously monitor environmental and other conditions. Finally, the document discusses challenges around analyzing large volumes of city data and extracting useful insights from it.
Lesson3 esa summer_school_brovelli
This document discusses several citizen science and crowdsourcing projects conducted by Politecnico di Milano's Geomatics Laboratory. It summarizes three main applications: 1) Sensing slow mobility in Lombardy region by analyzing geotagged social media data to identify popular locations, 2) A webGIS platform to collect and visualize European land use/cover maps and allow users to add photos, 3) Several applications to visualize and analyze social media and telecommunications big data from Milan, including filtering data by date and land use and visualizing patterns over time.
Integrating Sensor and Social Data for Understanding City Events
Integrating Sensor and Social Data for Understanding City EventsArtificial Intelligence Institute at UofSC
The document discusses integrating sensor and social data to understand city events. It describes collecting data from multiple sources, including sensors and social media. Statistical models are used to analyze the sensor data and identify anomalies, which are then correlated with events extracted from social media using spatial and temporal proximity. The approach is evaluated on traffic data from San Francisco, integrating data from traffic sensors and Twitter to extract and corroborate traffic events.A Data Scientist Exploration in the World of Heterogeneous Open Geospatial Data
We present the challenges faced by a Data Scientist in exploring and analyzing heterogeneous Open Geospatial Data. This work is aimed at explaining the initial steps of a data exploration process, specifically aimed at discovering similarities and differences conveyed by diverse sources and resulting from their correlation analysis; we also explore the influence of spatial resolution on the dependence strength between heterogeneous urban sources, to pave the way to a meaningful information fusion.
La telefonía móvil como fuente de información para el estudio de la movilidad...
Existe una multitud de sectores donde es necesario disponer de datos que permitan entender los patrones de comportamiento de la población: la planificación y la operación de los sistemas de transporte requiere información precisa, fiable y actualizada sobre la demanda de viajes; los patrones de actividad y movilidad de los turistas tienen profundas implicaciones para la planificación de infraestructuras, el desarrollo de la oferta turística y las estrategias de marketing turístico; entender el comportamiento espacial de los clientes es clave para optimizar las estrategias de distribución, comercialización y publicidad, determinar la localización de un nuevo comercio o punto de venta, o maximizar el retorno de la inversión en acciones de marketing. Las fuentes de datos tradicionales, basadas fundamentalmente en encuestas y registros administrativos, proporcionan información muy valiosa, pero no están exentas de inconvenientes. En general, las encuestas resultan caras y lentas de realizar, lo que limita el tamaño de la muestra y la frecuencia de actualización de la información, a lo que hay que añadir otras limitaciones intrínsecas, como las respuestas incorrectas e imprecisas, o la dependencia de la disposición a responder de los entrevistados. En los últimos años, la generalización del uso de dispositivos móviles ha abierto nuevas oportunidades para superar muchas de estas limitaciones. La posibilidad de recoger datos geolocalizados sobre la actividad de las personas, de manera dinámica y a un coste sensiblemente inferior al de los métodos tradicionales, abre la puerta a infinidad de aplicaciones. Las más evidentes son quizá las relacionadas con el transporte y la movilidad, pero el abanico es mucho más amplio, abarcando casi cualquier área que requiera información sobre los patrones de actividad y movilidad de la población. Las nuevas fuentes de datos plantean asimismo importantes retos, desde la necesidad de desarrollar nuevas metodologías de análisis, hasta la protección de la privacidad.
Vídeo de la ponencia: https://youtu.be/5PKC5Qm0eHM
Lizette Lancaster - Institute for Security Studies (Annex)
The document describes the features and components of the Crime and Justice Information and Analysis Hub, including an online website with crime statistics, maps, documents and multimedia. It has an advanced viewer with interactive crime maps, community profiles and crime modeling. The hub aims to provide data, analysis and resources on crime and justice in Africa.
OpenStreetMap and CycleStreets: collaborative map-making and cartography in t...
Abstract: The arrival of web-based mapping from Google and others has revolutionised, in the space of only five years, the way many people interact with maps and map data. And the success of projects such as Wikipedia highlight how collation of small amounts of information from large numbers of people - an approach called 'crowdsourcing' - can challenge traditional models of data collection and ownership. Bringing these concepts together is OpenStreetMap, a collaborative project to create a free editable map of the world. Well-established enterprises such as the Ordnance Survey are coming under increased pressure from this new model, and large companies such as MapQuest and Microsoft are starting to use and invest in it. Martin Lucas-Smith, Webmaster in the Department, and one of two main developers of the leading UK-wide cycle journey planner website, CycleStreets, will discuss OpenStreetMap, its use within a wide range of systems (from cartography, routing, and even its central role helping deal with the Haiti disaster) and discuss the challenges it poses to traditional forms of cartography and data collection.
Multimodal Mopbility Planning Using Big Data in Toronto
With collaborations with various City divisions and private service providers (in this case Streetlight data providers), our North York mobility innovation team uncovered several surprising suburban travel behaviour, patterns and distributions of trips that lead to meaningful and quantitative multimodal mobility planning. This presentation is a summary of project experiences and describes the key findings.
Chicago Crime Dataset Project Proposal
- The document proposes a machine learning project using the Chicago Crime dataset to build a web application providing insights into crime patterns.
- It will include geospatial analysis and visualizations of crime hotspots and trends over time using ArcGIS maps, as well as statistical analysis and prediction of future crimes.
- The project involves preprocessing the large dataset, performing feature engineering, dividing Chicago into crime clusters, and building prediction models for each cluster to be deployed via REST API and integrated into the web application. Tools include Python, Docker, Azure ML, ArcGIS, and Java for the frontend.
191008 kafka meetup_liebig
This document discusses challenges and opportunities for situation-aware traffic control using predictive routing and real-time mobility data. It outlines several challenges, including ensuring privacy and participation with heterogeneous devices, validating models in a closed feedback loop, and developing solutions that can apply over the long term with changing environments and data sources. Decentralized and open approaches are proposed to address issues of data integration, expandability, and cross-border coordination. The goal is to improve urban transport efficiency through predictive models while protecting individual privacy and enabling participation.
2018 Information Forum - Bob Bennett
Title: 21st Century Communities for 21st Century Citizens
As Bloomington-Normal and McLean County gear up to redefine our economy, we must recognise the drastic effects of technology on the future of our cities. And the future is now. Technology integration is especially challenging as it is ever evolving and impacting a wide array of services and infrastructure. More than ever before, many different organizations - public and private - will need to come together to help transform our cities to 21st century communities.
During the keynote, you will hear about how Kansas City, Missouri is collaborating with community, business, academic and technology stakeholders to integrate ever evolving technologies to create an open government and improve citizen services and engagement.
This years topic speaks to the core of BN Advantage - collaborative economic development efforts to create a vibrant and sustainable regional economy in Bloomington-Normal and McLean County.
SC4 Workshop 2: Josep Maria Salanova - Pilot in Thessaloniki
The document describes a big data transport pilot project in Thessaloniki, Greece. The project utilizes several sources of probe data including static Bluetooth sensors, a fleet of over 1,200 taxis and buses that provide real-time location data, and social media check-ins. This data is used to estimate traffic conditions, travel times, mobility patterns and more. The pilot aims to test processing techniques like travel time estimation, traffic prediction, and data expansion. Lessons learned from the first phase will be applied to improve the algorithms and integrate additional data sources in future pilots.
CitySDK Linked Data API
The document discusses the City Service Development Kit (CitySDK), an open source platform that collects, annotates, links, and distributes city data as linked open data. The CitySDK aims to facilitate sharing best practices across cities by providing common service interfaces and guidelines. It describes several use cases where the CitySDK has helped make city data more accessible and interoperable for developers, researchers, citizens and other stakeholders. Examples of applications that have been built using CitySDK data and APIs are also mentioned.
Smart City Next Steps
This document discusses various smart city initiatives around the world. It begins by outlining the drivers for smart cities like urbanization, quality of life, and talent attraction. Examples of smart city projects are then provided from London (transportation), Malaysia (high-speed internet backbone), Korea (access to government services), Boston (energy efficiency), Vienna (quality of life focus), Delhi (cane for blind navigation), Barcelona (smart trash collection), Dearborn (autonomous vehicles testing), New York (free public WiFi), Singapore (integrated mapping platform), Helsinki (mobility as a service), Japan (child tracking project), Netherlands (motion-detecting streetlights), San Francisco (integrated street lighting), Detroit (gunshot
Case Studies in Managing Traffic in a Developing Country with Privacy-Preserv...
Simulation is known to be an effective technique to understand
and manage traffic in cities of developed countries. However, in developing countries, traffic management is lacking due to a wide diversity of vehicles on the road, their chaotic movement, little instrumentation to sense traffic state and limited funds to create IT and physical infrastructure to ameliorate the situation. Under these conditions, in this paper, we present our approach of using the Megaffic traffic simulator as a service to gain actionable insights for two use-cases and cities in India, a first. Our approach is general to be readily used in other use cases and cities; and our results give new insights: (a) using demographics data, traffic demand can be reduced if timings of government offices are altered in Delhi, (b) using a mobile company’s Call
Data Record (CDR) data to mine trajectories anonymously,
one can take effective traffic actions while organizing events
in Mumbai at local scale.
URBANITE, Decision making in the urban transformation field using disruptive...
URBANITE was presented jointly with URBANAGE, DECIDO and PolicyCLOUD projects in Data Week 2022 in session: Disruptive technologies empowering decision-making in the public sector.
Traffic data fusion methodology
1) The document discusses the development of a traffic data fusion methodology that intelligently combines multiple data sources to obtain more accurate and complete traffic information than any single source can provide alone.
2) Different data sources have strengths and weaknesses depending on traffic conditions, and understanding these strengths and weaknesses helps to resolve differences between sources.
3) Intelligent data fusion using quality measures from multiple sources can provide near-complete traffic coverage and high quality information, improving transport network management and planning.
Urban Computing in LarKC
Joint Work with Emanuele Della Valle
emanuele.dellavalle@polimi.it.
Presentation of the results of the Urban Computing use case of the LarKC project. Speech at the ITN Expo event (http://www.itnexpo.it/) on October 16th, 2009.
Transport for London: Using data to keep London moving
This talk was presented by Sriskandarajah Suhothayan (WSO2) and Roland Major (Transport for London) at the Strata Data Conference in London, May 23 2017.
Transport for London (TfL) uses a wide range of data for operational purposes, but the underlying data is typically held in multiple disconnected systems. Freedom of Information requests have helped prove the value of sharing this data. TfL is embarking on a journey to make more of this data open and available in real time.
TfL and WSO2 have been working together on broader integration projects. Roland Major and Sriskandarajah Suhothayan share the evolving big data and IoT architectures and services TfL is building to pull together these diverse datasets to better support operational teams and accelerate the identification and classification of disruption to improve response times for incidents. In particular, they explore WSO2’s solution, which emerged from the Data in Motion hackathon organized by TfL, AWS, and Geovation. The solution innovates TfL’s heterogeneous data sources through the combination of the TfL Unified API and its operational data sources, including traffic sensor, air quality, and passenger flow data, to provide better travel time and transit suggestions for Londoners and tourists using the WSO2 Data Analytics Server, WSO2 Complex Event Processor, and WSO2 API Manager, bringing together IoT and big data techniques to feed a real-time dashboard of current and predicted transport network status.
EDF2014: Ralf-Peter Schaefer, Head of Traffic Product Unit, TomTom, Germany: ...
Industry Keynote Talk by Ralf-Peter Schaefer, Head of Traffic Product Unit, TomTom, Germany at the European Data Forum 2014, 20 March 2014 in Athens, Greece: Probe Data Analytics and Processing for Traffic Information, Traffic Planning and Traffic Management.
Similar to InnoConnect: Big data analysis (20)
Integrating Sensor and Social Data for Understanding City Events
Integrating Sensor and Social Data for Understanding City Events
A Data Scientist Exploration in the World of Heterogeneous Open Geospatial Data
A Data Scientist Exploration in the World of Heterogeneous Open Geospatial Data
La telefonía móvil como fuente de información para el estudio de la movilidad...
La telefonía móvil como fuente de información para el estudio de la movilidad...
Lizette Lancaster - Institute for Security Studies (Annex)
Lizette Lancaster - Institute for Security Studies (Annex)
OpenStreetMap and CycleStreets: collaborative map-making and cartography in t...
OpenStreetMap and CycleStreets: collaborative map-making and cartography in t...
Multimodal Mopbility Planning Using Big Data in Toronto
Multimodal Mopbility Planning Using Big Data in Toronto
SC4 Workshop 2: Josep Maria Salanova - Pilot in Thessaloniki
SC4 Workshop 2: Josep Maria Salanova - Pilot in Thessaloniki
Case Studies in Managing Traffic in a Developing Country with Privacy-Preserv...
Case Studies in Managing Traffic in a Developing Country with Privacy-Preserv...
URBANITE, Decision making in the urban transformation field using disruptive...
URBANITE, Decision making in the urban transformation field using disruptive...
Transport for London: Using data to keep London moving
Transport for London: Using data to keep London moving
EDF2014: Ralf-Peter Schaefer, Head of Traffic Product Unit, TomTom, Germany: ...
EDF2014: Ralf-Peter Schaefer, Head of Traffic Product Unit, TomTom, Germany: ...
Recently uploaded
Presentation of the OECD Artificial Intelligence Review of Germany
Consult the full report at https://www.oecd.org/digital/oecd-artificial-intelligence-review-of-germany-609808d6-en.htm
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
Video Streaming: Then, Now, and in the Future
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
Artificial Intelligence for XMLDevelopment
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
Full-RAG: A modern architecture for hyper-personalization
Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
Best 20 SEO Techniques To Improve Website Visibility In SERP
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
Infrastructure Challenges in Scaling RAG with Custom AI models
Building Retrieval-Augmented Generation (RAG) systems with open-source and custom AI models is a complex task. This talk explores the challenges in productionizing RAG systems, including retrieval performance, response synthesis, and evaluation. We’ll discuss how to leverage open-source models like text embeddings, language models, and custom fine-tuned models to enhance RAG performance. Additionally, we’ll cover how BentoML can help orchestrate and scale these AI components efficiently, ensuring seamless deployment and management of RAG systems in the cloud.
みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...
ここ3000字までしか入らないけどタイトルの方がたくさん文字入ると思います。
Removing Uninteresting Bytes in Software Fuzzing
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
UiPath Test Automation using UiPath Test Suite series, part 5
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.
HCL Notes and Domino License Cost Reduction in the World of DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
Programming Foundation Models with DSPy - Meetup Slides
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
Climate Impact of Software Testing at Nordic Testing Days
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
Recently uploaded (20)
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...
みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
InnoConnect: Big data analysis
- 1. Big Geo-Data Analysis 'Transforming DATA into INFORMATION' Jiří Bouchal Big & Open Data and Open Software Workshop January 2018 Novotného lávka, Praha, Czechia
- 2. Transforming Data into Information „The purpose of visualization is insight, not pictures“ - Ben Shneiderman, 1994
- 3. 3 Acting on data-driven insights There is a big difference between raw data and information
- 4. Big Data Visualization with WebGLayer • JavaScript library (open source) • Big data visualisation through web browser • Visualisation of point and linear data
- 5. Features • Interactive visualisation of up to 1.5 mil data records • Response time below 100ms • Compatible with 3rd party map API (Leaflet, Google maps) ✓ Interactivity ✓ Scalability ✓ Responsiveness ✓ Web-based, no specific GIS software
- 6. Outperforming Competitors 6 Test Results ● Datasets of up to 1.5M points tested on usual laptop ● ArcGIS Online fails to load more then 100K points ● Google Maps API loads 1M points after 6.5s. Leaflet after 2s ● WebGL loads 1.5M points in 0.1s
- 7. 7 UK 1.5 million traffic accidents
- 8. Fast Interactions Linked views: dynamic data filtering and zooming
- 9. Live Demonstration Flanders 9 Flanders ● identification of traffic accident hotspots nearby schools on weekdays between 7- 9h ● Discover deadly accidents in the Antwerp area by applying polygon filter(amount, locations, times) http://innoconnect.net/apps/flanders- traffic-accidents/
- 10. Live Demonstration: Traffic 10 Turnhout, Belgium ● Traffic flow recorded by one camera ● Driving patterns among cameras http://innoconnect.net/development/mac q-uc3/
- 11. Live Demonstration Chicago 11 ● See the distribution of crimes over time and space (e.g. prostitution, homicide, interference with p.off.) ● Chicago (600 homicides in 10 month/population 2.7M) vs. Czechia 150 homicides a year/10M) ● Prostitution 600 (all arrested) vs. homicides 600 (only 100 arrested) ● Discover districts and streets with high risk of certain crime type (car theft, drugs, burglary etc.) ● Identify patterns: e.g. weapons, narcotics, gambling and prostitution in same areas ● 50k+ thefts. Most in downtown (6k+) ● Battery, robbery and assault (40+10+15k) – west and south ● Identify downtown nightlife areas with highest criminality
- 12. Wide Range of Potential Use 12 ● Criminality data - discovering risky areas ○ Parking offenses ○ Thefts, burglaries, robberies ○ Gambling ○ Motor vehicles thefts ○ Public peace violations etc. ● Traffic accidents analysis
- 13. Wide Range of Potential Use 13 ● Traffic intensity data from road sensors and cameras ● Parking occupancy analysis and availability prediction ● Water management companies ○ Water usage ○ Water losses caused by pipe leaks and failures
- 14. Next Developments 14 Traffic flow visualisation - Flanders Traffic accidents - Belgium Traffic intensity - Plzeň ? Criminal offenses - Plzeň
- 16. New Features 16 New Colour Schemes for Heatmaps