SlideShare a Scribd company logo
1 of 1
Reporting / Analysis
•Data aggregated to station level
•Released annually (12-month reporting period)
•NMVDP Format reported to project stakeholders
•TMG Format exported to FHWA TMAS system
•Data used for analysis:
• Hourly, Daily, Monthly, and Seasonal Patterns
• Factor and Volume Groupings
•Statistics summarized using AASHTO Method:
• Annual Average Daily Bicycle Traffic (AADBT)
• Annual Average Daily Pedestrian Traffic (AADPT)
• Assess site
characteristics
• Predict activity patterns
• Minimize site-specific
data collection issues
Pre-Installation
Site Selection
Virtual and In-field
Site Inspection
Short Duration Count
Procurement
Station Layout Diagrams
Equipment Configurations
Matched to Station
EquipmentSet-Up
Installation
Data Gathering for
Onboarding
Equipment Installation
Procedures
Equipment Testing and
Troubleshooting
Onboarding
Equipment Inventory
Installed Equipment
Diagrams
Station ID’s
Defined Data Streams for
Download
Phase I of North Carolina’s Non-Motorized
Volume Data Program (NMVDP) was
conducted in NCDOT Divisions 7 and 9 in
the Triad/Piedmont region of NC.
Continuous Count Stations (CCS) to monitor
bicyclist and pedestrian traffic at twelve
locations went live in late 2014. These stations
cover a mix of sites across different land uses,
travel patterns, and volume groups.
The following programmatic elements
(indicated in RED in the diagram) were piloted
to select, install, and ensure data quality for the
twelve CCS stations.
Introduction
Kristy Jackson
Research Associate
knjackso@ncsu.edu
Sarah Searcy
Research Assistant
sesearcy@ncsu.edu
The authors would like to thank the project manager Sarah O’Brien from ITRE
and Lauren Blackburn from the Division of Bicycle and Pedestrian
Transportation at NCDOT for their oversight and guidance of this project.
Acknowledgements
• Ensure quality data
streams
• Provide accurate
labeling and metadata
• Minimize installation
errors
• Ensure functional
equipment at onset
• Document inputs for
onboarding station
Training for Program
Partners
Ownership and
Maintenance Agreements
Coordination of
Roles and Responsibilities
On-Site Routine
Maintenance Training
•INVALID data examined
to determine potential
equipment
malfunctions
•Maintenance is
scheduled in timely
manner
•Maintenance may
occur as a result of
findings of equipment
validation process
•Revalidation occurs if
necessary
itre.ncsu.edu/focus/bike-ped
D E V E L O P M E N T O F Q A / Q C P R O C E S S E S
FO R B I C YC L E A N D P E D EST R I A N DATA
AgencyCoordination
EquipmentValidationDataHandling
• Data is downloaded quarterly (Phase I protocol)
• As collected from Continuous Count Station (CCS)
• Minimal data manipulation occurs to prepare data for
QA/QC checks
QA/QC Checks
Applied :
 Gap Check
 Consecutive
Zero
 Directional
Distribution
 Range Check
Checked
• Data is checked quarterly
• Data is flagged for potential equipment malfunctions
• Processes are automated to the extent possible
• Flagged data is reviewed and marked as VALID,
ATYPICAL, or INVALID
• INVALID data may initiate maintenance
Cleaned
• Data is cleaned quarterly
• INVALID data days are removed from dataset
• Cleaning protocols followed
• Processes are automated to the extent possible
Corrected
• Aggregated to daily data with hourly intervals by mode
and site
• Application of correction factors from validation process
• Determine corrected Directional Distribution
Raw Data
Raw Data
• Ground-truthing of raw data
• Video data collection
• Accuracy analysis through comparison
of automated counts to manual counts
EquipmentMaintenance
• Balance budgetary
constraints and program
outcomes
The accuracy of non-motorized data collected by Continuous Count Stations
(CCS) is important to be able to create sound estimates of walking and bicycling
volumes and factor data from Short Duration Count (SDC) locations. Data
quality is important for any application because it affects the credibility and
usability of the data for agency decisions.
In a volume data program, there are numerous points at which Quality
Assurance and Quality Control (QA/QC) processes or procedures can be
applied before, during, and after data is collected. The diagram shows the actions
taken to ensure data quality for the NMVDP.
Methods
Selected sites were installed with assistance from local agency staff in the following NC municipalities: Carrboro, Chapel
Hill, Greensboro, and Winston-Salem. Data was monitored for the 12-month reporting period and invalid days were
removed from the data. The equipment at each CCS underwent a validation process to ground-truth each stream of
non-motorized count data and correct it for errors related to data collection. A data summary is provided for each
station based on the resulting count data, with days of missing data and data related to equipment errors removed.
Results
NMVDP Naming Format:
Mode
City
Side of Street
Direction of Travel
Location
Bicycle and Pedestrian Program
Institute for Transportation Research & Education
North Carolina State University
N O R T H C A R O L I N A N O N - M O T O R I Z E D V O L U M E D A T A P R O G R A M
Table 1 Summary Volume Statistics
(1) (2) (3)
Durham, NC – American Tobacco Trail (12/01/2014 – 11/30/2015)
Pedestrians
Highest Volume Lowest Volume
Season Spring Winter
Month May February
Day of Week Saturday Friday
Date Sun. Feb 8, 2015 (1,056) NA
Peak Period Weekends 8AM-5PM
12 Month Pedestrian Count 101,720
Annual Average Daily Pedestrian Traffic 349 AADPT
Bicyclists
Highest Volume Lowest Volume
Season Summer Winter
Month August February
Day of Week Sunday Thursday
Date Mon. May 25, 2015 (1,038) NA
Peak Period Sundays 10AM-4PM
120
128
12 Month Bicycle Count 92,480
128Annual Average Daily Bicycle Traffic 260 AADBT
North American Travel Monitoring Exposition and Conference
Bike and Pedestrian Data: Data Wrangling and Access
May 1, 2016 - Miami, Florida

More Related Content

What's hot

2040 Metropolitan Transportation Plan and Downtown Huntington Access Study
2040 Metropolitan Transportation Plan and Downtown Huntington Access Study2040 Metropolitan Transportation Plan and Downtown Huntington Access Study
2040 Metropolitan Transportation Plan and Downtown Huntington Access Studypyoungkyova
 
Oarc slides c02 assessment workshop
Oarc slides c02 assessment workshop  Oarc slides c02 assessment workshop
Oarc slides c02 assessment workshop pyoungkyova
 
Application of Cumulative Axle Model To Impute Missing Traffic Data in Defect...
Application of Cumulative Axle Model To Impute Missing Traffic Data in Defect...Application of Cumulative Axle Model To Impute Missing Traffic Data in Defect...
Application of Cumulative Axle Model To Impute Missing Traffic Data in Defect...IJERDJOURNAL
 
Congestion management process presentation updated
Congestion management process presentation updatedCongestion management process presentation updated
Congestion management process presentation updatedpyoungkyova
 
Performance Measures for Highway Capacity Decision Making
Performance Measures forHighway Capacity Decision MakingPerformance Measures forHighway Capacity Decision Making
Performance Measures for Highway Capacity Decision Makingpyoungkyova
 
City bench iswc_2015
City bench iswc_2015City bench iswc_2015
City bench iswc_2015Ali Intizar
 
Traffic Signals Safety and Efficiency Project – Stage Two Implementation
Traffic Signals Safety and Efficiency Project – Stage Two ImplementationTraffic Signals Safety and Efficiency Project – Stage Two Implementation
Traffic Signals Safety and Efficiency Project – Stage Two ImplementationJumpingJaq
 
Air Quality and the DMRB
Air Quality and the DMRBAir Quality and the DMRB
Air Quality and the DMRBMark Chapman
 
Access Northeast Pipeline Project - Dec 2016 Update
Access Northeast Pipeline Project - Dec 2016 UpdateAccess Northeast Pipeline Project - Dec 2016 Update
Access Northeast Pipeline Project - Dec 2016 UpdateMarcellus Drilling News
 
Transport: South African government fleet case study
Transport: South African government fleet case studyTransport: South African government fleet case study
Transport: South African government fleet case studyTristan Wiggill
 
Total road asset management
Total road asset managementTotal road asset management
Total road asset managementsuhaimi talib
 
Developing Energy Metrics at the Chicago Transit Authority (CTA)
Developing Energy Metrics at the Chicago Transit Authority (CTA)Developing Energy Metrics at the Chicago Transit Authority (CTA)
Developing Energy Metrics at the Chicago Transit Authority (CTA)Sonya Dekhtyar
 
Changing the narrative: from counting infrastructure to monitoring services
Changing the narrative: from counting infrastructure to monitoring servicesChanging the narrative: from counting infrastructure to monitoring services
Changing the narrative: from counting infrastructure to monitoring servicesInternational WaterCentre
 

What's hot (15)

2040 Metropolitan Transportation Plan and Downtown Huntington Access Study
2040 Metropolitan Transportation Plan and Downtown Huntington Access Study2040 Metropolitan Transportation Plan and Downtown Huntington Access Study
2040 Metropolitan Transportation Plan and Downtown Huntington Access Study
 
Oarc slides c02 assessment workshop
Oarc slides c02 assessment workshop  Oarc slides c02 assessment workshop
Oarc slides c02 assessment workshop
 
Application of Cumulative Axle Model To Impute Missing Traffic Data in Defect...
Application of Cumulative Axle Model To Impute Missing Traffic Data in Defect...Application of Cumulative Axle Model To Impute Missing Traffic Data in Defect...
Application of Cumulative Axle Model To Impute Missing Traffic Data in Defect...
 
Congestion management process presentation updated
Congestion management process presentation updatedCongestion management process presentation updated
Congestion management process presentation updated
 
Performance Measures for Highway Capacity Decision Making
Performance Measures forHighway Capacity Decision MakingPerformance Measures forHighway Capacity Decision Making
Performance Measures for Highway Capacity Decision Making
 
City bench iswc_2015
City bench iswc_2015City bench iswc_2015
City bench iswc_2015
 
Tx dot gps applications fuegner
Tx dot gps applications   fuegnerTx dot gps applications   fuegner
Tx dot gps applications fuegner
 
Traffic Signals Safety and Efficiency Project – Stage Two Implementation
Traffic Signals Safety and Efficiency Project – Stage Two ImplementationTraffic Signals Safety and Efficiency Project – Stage Two Implementation
Traffic Signals Safety and Efficiency Project – Stage Two Implementation
 
Air Quality and the DMRB
Air Quality and the DMRBAir Quality and the DMRB
Air Quality and the DMRB
 
Access Northeast Pipeline Project - Dec 2016 Update
Access Northeast Pipeline Project - Dec 2016 UpdateAccess Northeast Pipeline Project - Dec 2016 Update
Access Northeast Pipeline Project - Dec 2016 Update
 
Transport: South African government fleet case study
Transport: South African government fleet case studyTransport: South African government fleet case study
Transport: South African government fleet case study
 
Total road asset management
Total road asset managementTotal road asset management
Total road asset management
 
National Performance Management Measures
National Performance Management MeasuresNational Performance Management Measures
National Performance Management Measures
 
Developing Energy Metrics at the Chicago Transit Authority (CTA)
Developing Energy Metrics at the Chicago Transit Authority (CTA)Developing Energy Metrics at the Chicago Transit Authority (CTA)
Developing Energy Metrics at the Chicago Transit Authority (CTA)
 
Changing the narrative: from counting infrastructure to monitoring services
Changing the narrative: from counting infrastructure to monitoring servicesChanging the narrative: from counting infrastructure to monitoring services
Changing the narrative: from counting infrastructure to monitoring services
 

Similar to NATMEC2016 - Development of QAQC Processes for BikePed Data

ATS-16: Making Data Count, Krista Nordback
ATS-16: Making Data Count, Krista NordbackATS-16: Making Data Count, Krista Nordback
ATS-16: Making Data Count, Krista NordbackBTAOregon
 
Bicycle and Pedestrian Safety Monitoring Data
Bicycle and Pedestrian Safety Monitoring DataBicycle and Pedestrian Safety Monitoring Data
Bicycle and Pedestrian Safety Monitoring DataNY_Bicycling
 
Disruptions on Road Networks: Impact on traffic characteristics
Disruptions on Road Networks: Impact on traffic characteristicsDisruptions on Road Networks: Impact on traffic characteristics
Disruptions on Road Networks: Impact on traffic characteristicsJumpingJaq
 
NREL Drive cycle data focused tools- matching the right tech to the right app
NREL Drive cycle data focused tools- matching the right tech to the right appNREL Drive cycle data focused tools- matching the right tech to the right app
NREL Drive cycle data focused tools- matching the right tech to the right appCALSTART
 
Traffic volume study
Traffic volume studyTraffic volume study
Traffic volume studyZawad khalil
 
EPA Nonpoint Oil and Gas Emission Estimation Tool
EPA Nonpoint Oil and Gas Emission Estimation ToolEPA Nonpoint Oil and Gas Emission Estimation Tool
EPA Nonpoint Oil and Gas Emission Estimation ToolJennifer Sharp
 
Improving Traffic Prediction Using Weather Data with Ramya Raghavendra
Improving Traffic Prediction Using Weather Data  with Ramya RaghavendraImproving Traffic Prediction Using Weather Data  with Ramya Raghavendra
Improving Traffic Prediction Using Weather Data with Ramya RaghavendraSpark Summit
 
Trip Generation Study of Drive-through Coffee Outlets
Trip Generation Study of Drive-through Coffee OutletsTrip Generation Study of Drive-through Coffee Outlets
Trip Generation Study of Drive-through Coffee OutletsJumpingJaq
 
Development of On-Road Emissions for the 2011 National Emissions Inventory
Development of On-Road Emissions for the 2011 National Emissions InventoryDevelopment of On-Road Emissions for the 2011 National Emissions Inventory
Development of On-Road Emissions for the 2011 National Emissions InventoryJennifer Sharp
 
Traffic volume study
Traffic volume studyTraffic volume study
Traffic volume studyKalpataru Das
 
Slide share countingbikes&peds6
Slide share countingbikes&peds6Slide share countingbikes&peds6
Slide share countingbikes&peds6sogoss
 
What Can Technology Do For You
What Can Technology Do For YouWhat Can Technology Do For You
What Can Technology Do For YouNebraska Transit
 
Improving Traffic Prediction Using Weather Datawith Ramya Raghavendra
Improving Traffic Prediction Using Weather Datawith Ramya RaghavendraImproving Traffic Prediction Using Weather Datawith Ramya Raghavendra
Improving Traffic Prediction Using Weather Datawith Ramya RaghavendraSpark Summit
 
TAMS Traffic Accounts Management System 23.04.2023.pptx
TAMS Traffic Accounts Management System 23.04.2023.pptxTAMS Traffic Accounts Management System 23.04.2023.pptx
TAMS Traffic Accounts Management System 23.04.2023.pptxNageswara Rao M
 
Traffic data fusion methodology
Traffic data fusion methodologyTraffic data fusion methodology
Traffic data fusion methodologyJumpingJaq
 
Requirements for the Next-Generation Autonomous Vehicle Ecosystem
Requirements for the Next-Generation Autonomous Vehicle EcosystemRequirements for the Next-Generation Autonomous Vehicle Ecosystem
Requirements for the Next-Generation Autonomous Vehicle EcosystemM. Ilhan Akbas
 

Similar to NATMEC2016 - Development of QAQC Processes for BikePed Data (20)

ATS-16: Making Data Count, Krista Nordback
ATS-16: Making Data Count, Krista NordbackATS-16: Making Data Count, Krista Nordback
ATS-16: Making Data Count, Krista Nordback
 
Bicycle and Pedestrian Safety Monitoring Data
Bicycle and Pedestrian Safety Monitoring DataBicycle and Pedestrian Safety Monitoring Data
Bicycle and Pedestrian Safety Monitoring Data
 
Disruptions on Road Networks: Impact on traffic characteristics
Disruptions on Road Networks: Impact on traffic characteristicsDisruptions on Road Networks: Impact on traffic characteristics
Disruptions on Road Networks: Impact on traffic characteristics
 
NREL Drive cycle data focused tools- matching the right tech to the right app
NREL Drive cycle data focused tools- matching the right tech to the right appNREL Drive cycle data focused tools- matching the right tech to the right app
NREL Drive cycle data focused tools- matching the right tech to the right app
 
Nmc ussls charter 2012
Nmc ussls charter 2012Nmc ussls charter 2012
Nmc ussls charter 2012
 
Traffic volume study
Traffic volume studyTraffic volume study
Traffic volume study
 
EPA Nonpoint Oil and Gas Emission Estimation Tool
EPA Nonpoint Oil and Gas Emission Estimation ToolEPA Nonpoint Oil and Gas Emission Estimation Tool
EPA Nonpoint Oil and Gas Emission Estimation Tool
 
Improving Traffic Prediction Using Weather Data with Ramya Raghavendra
Improving Traffic Prediction Using Weather Data  with Ramya RaghavendraImproving Traffic Prediction Using Weather Data  with Ramya Raghavendra
Improving Traffic Prediction Using Weather Data with Ramya Raghavendra
 
Trip Generation Study of Drive-through Coffee Outlets
Trip Generation Study of Drive-through Coffee OutletsTrip Generation Study of Drive-through Coffee Outlets
Trip Generation Study of Drive-through Coffee Outlets
 
Development of On-Road Emissions for the 2011 National Emissions Inventory
Development of On-Road Emissions for the 2011 National Emissions InventoryDevelopment of On-Road Emissions for the 2011 National Emissions Inventory
Development of On-Road Emissions for the 2011 National Emissions Inventory
 
Traffic volume study
Traffic volume studyTraffic volume study
Traffic volume study
 
Slide share countingbikes&peds6
Slide share countingbikes&peds6Slide share countingbikes&peds6
Slide share countingbikes&peds6
 
What Can Technology Do For You
What Can Technology Do For YouWhat Can Technology Do For You
What Can Technology Do For You
 
Presentation 1
Presentation 1Presentation 1
Presentation 1
 
Summer Program on Transportation Statistics, Statistical Challenges for Advan...
Summer Program on Transportation Statistics, Statistical Challenges for Advan...Summer Program on Transportation Statistics, Statistical Challenges for Advan...
Summer Program on Transportation Statistics, Statistical Challenges for Advan...
 
Improving Traffic Prediction Using Weather Datawith Ramya Raghavendra
Improving Traffic Prediction Using Weather Datawith Ramya RaghavendraImproving Traffic Prediction Using Weather Datawith Ramya Raghavendra
Improving Traffic Prediction Using Weather Datawith Ramya Raghavendra
 
TAMS Traffic Accounts Management System 23.04.2023.pptx
TAMS Traffic Accounts Management System 23.04.2023.pptxTAMS Traffic Accounts Management System 23.04.2023.pptx
TAMS Traffic Accounts Management System 23.04.2023.pptx
 
Traffic data fusion methodology
Traffic data fusion methodologyTraffic data fusion methodology
Traffic data fusion methodology
 
Creating a Safer System Through State Pedestrian and Bicycle Safety Campaigns...
Creating a Safer System Through State Pedestrian and Bicycle Safety Campaigns...Creating a Safer System Through State Pedestrian and Bicycle Safety Campaigns...
Creating a Safer System Through State Pedestrian and Bicycle Safety Campaigns...
 
Requirements for the Next-Generation Autonomous Vehicle Ecosystem
Requirements for the Next-Generation Autonomous Vehicle EcosystemRequirements for the Next-Generation Autonomous Vehicle Ecosystem
Requirements for the Next-Generation Autonomous Vehicle Ecosystem
 

NATMEC2016 - Development of QAQC Processes for BikePed Data

  • 1. Reporting / Analysis •Data aggregated to station level •Released annually (12-month reporting period) •NMVDP Format reported to project stakeholders •TMG Format exported to FHWA TMAS system •Data used for analysis: • Hourly, Daily, Monthly, and Seasonal Patterns • Factor and Volume Groupings •Statistics summarized using AASHTO Method: • Annual Average Daily Bicycle Traffic (AADBT) • Annual Average Daily Pedestrian Traffic (AADPT) • Assess site characteristics • Predict activity patterns • Minimize site-specific data collection issues Pre-Installation Site Selection Virtual and In-field Site Inspection Short Duration Count Procurement Station Layout Diagrams Equipment Configurations Matched to Station EquipmentSet-Up Installation Data Gathering for Onboarding Equipment Installation Procedures Equipment Testing and Troubleshooting Onboarding Equipment Inventory Installed Equipment Diagrams Station ID’s Defined Data Streams for Download Phase I of North Carolina’s Non-Motorized Volume Data Program (NMVDP) was conducted in NCDOT Divisions 7 and 9 in the Triad/Piedmont region of NC. Continuous Count Stations (CCS) to monitor bicyclist and pedestrian traffic at twelve locations went live in late 2014. These stations cover a mix of sites across different land uses, travel patterns, and volume groups. The following programmatic elements (indicated in RED in the diagram) were piloted to select, install, and ensure data quality for the twelve CCS stations. Introduction Kristy Jackson Research Associate knjackso@ncsu.edu Sarah Searcy Research Assistant sesearcy@ncsu.edu The authors would like to thank the project manager Sarah O’Brien from ITRE and Lauren Blackburn from the Division of Bicycle and Pedestrian Transportation at NCDOT for their oversight and guidance of this project. Acknowledgements • Ensure quality data streams • Provide accurate labeling and metadata • Minimize installation errors • Ensure functional equipment at onset • Document inputs for onboarding station Training for Program Partners Ownership and Maintenance Agreements Coordination of Roles and Responsibilities On-Site Routine Maintenance Training •INVALID data examined to determine potential equipment malfunctions •Maintenance is scheduled in timely manner •Maintenance may occur as a result of findings of equipment validation process •Revalidation occurs if necessary itre.ncsu.edu/focus/bike-ped D E V E L O P M E N T O F Q A / Q C P R O C E S S E S FO R B I C YC L E A N D P E D EST R I A N DATA AgencyCoordination EquipmentValidationDataHandling • Data is downloaded quarterly (Phase I protocol) • As collected from Continuous Count Station (CCS) • Minimal data manipulation occurs to prepare data for QA/QC checks QA/QC Checks Applied :  Gap Check  Consecutive Zero  Directional Distribution  Range Check Checked • Data is checked quarterly • Data is flagged for potential equipment malfunctions • Processes are automated to the extent possible • Flagged data is reviewed and marked as VALID, ATYPICAL, or INVALID • INVALID data may initiate maintenance Cleaned • Data is cleaned quarterly • INVALID data days are removed from dataset • Cleaning protocols followed • Processes are automated to the extent possible Corrected • Aggregated to daily data with hourly intervals by mode and site • Application of correction factors from validation process • Determine corrected Directional Distribution Raw Data Raw Data • Ground-truthing of raw data • Video data collection • Accuracy analysis through comparison of automated counts to manual counts EquipmentMaintenance • Balance budgetary constraints and program outcomes The accuracy of non-motorized data collected by Continuous Count Stations (CCS) is important to be able to create sound estimates of walking and bicycling volumes and factor data from Short Duration Count (SDC) locations. Data quality is important for any application because it affects the credibility and usability of the data for agency decisions. In a volume data program, there are numerous points at which Quality Assurance and Quality Control (QA/QC) processes or procedures can be applied before, during, and after data is collected. The diagram shows the actions taken to ensure data quality for the NMVDP. Methods Selected sites were installed with assistance from local agency staff in the following NC municipalities: Carrboro, Chapel Hill, Greensboro, and Winston-Salem. Data was monitored for the 12-month reporting period and invalid days were removed from the data. The equipment at each CCS underwent a validation process to ground-truth each stream of non-motorized count data and correct it for errors related to data collection. A data summary is provided for each station based on the resulting count data, with days of missing data and data related to equipment errors removed. Results NMVDP Naming Format: Mode City Side of Street Direction of Travel Location Bicycle and Pedestrian Program Institute for Transportation Research & Education North Carolina State University N O R T H C A R O L I N A N O N - M O T O R I Z E D V O L U M E D A T A P R O G R A M Table 1 Summary Volume Statistics (1) (2) (3) Durham, NC – American Tobacco Trail (12/01/2014 – 11/30/2015) Pedestrians Highest Volume Lowest Volume Season Spring Winter Month May February Day of Week Saturday Friday Date Sun. Feb 8, 2015 (1,056) NA Peak Period Weekends 8AM-5PM 12 Month Pedestrian Count 101,720 Annual Average Daily Pedestrian Traffic 349 AADPT Bicyclists Highest Volume Lowest Volume Season Summer Winter Month August February Day of Week Sunday Thursday Date Mon. May 25, 2015 (1,038) NA Peak Period Sundays 10AM-4PM 120 128 12 Month Bicycle Count 92,480 128Annual Average Daily Bicycle Traffic 260 AADBT North American Travel Monitoring Exposition and Conference Bike and Pedestrian Data: Data Wrangling and Access May 1, 2016 - Miami, Florida