The document presents a method called iBAT (Isolation-Based Anomalous Trajectory detection) to detect anomalous taxi trajectories from GPS traces. iBAT transforms the problem into an easier isolation-based problem and proposes a novel approach using isolation forests to detect anomalies. It evaluates iBAT on a real-world GPS dataset from over 7,600 taxis in Hangzhou, China, achieving remarkable detection rates of up to 90% for anomalous trajectories with low false alarm rates of only 2%. iBAT provides a computationally efficient way to detect fraud and road network changes from taxi GPS data.
Updated Traffic Analysis Tools for Complete StreetsWSP
Incorporating Pedestrian Level of Service into Traffic Analysis for Improved Decision-Making
Presented by Paul Tétreault, Eng., Urb., P.Eng., M.U.P. and François Bélisle, Eng., B.Sc., M.A. from WSP | Parsons Brinckerhoff at the 2015 Transportation Association of Canada (TAC) Conference & Exhibition, from September 27 to 30.
Calibration and Validation of Micro-Simulation ModelsWSP
Calibration and Validation of Micro-Simulation Models is a presentation delivered by François Bélisle, Eng., B.Sc., M.Sc., WSP | Parsons Brinckerhoff, Laurent Gauthier, Polytechnique Montréal and Nicolas Saunier, Polytechnique Montréal at the 2015 Transportation Association of Canada (TAC) Conference & Exhibition, from September 27 to 30.
Transit Signalisation Priority (TSP) - A New Approach to Calculate GainsWSP
Presentation by François Bélisle, Eng. , B.Sc., M.A. and Stephan Kellner, Eng., P.Eng., MS delivered at the 2015 Transportation Association of Canada (TAC) Conference & Exhibition, from September 27 to 30.
Heading Estimation Flow Chart
Heading Classifier for Pedestrian Movements
Experiment Scenario
Definition of ANN features for heading classifier
Results
Conclusion and Future work
Updated Traffic Analysis Tools for Complete StreetsWSP
Incorporating Pedestrian Level of Service into Traffic Analysis for Improved Decision-Making
Presented by Paul Tétreault, Eng., Urb., P.Eng., M.U.P. and François Bélisle, Eng., B.Sc., M.A. from WSP | Parsons Brinckerhoff at the 2015 Transportation Association of Canada (TAC) Conference & Exhibition, from September 27 to 30.
Calibration and Validation of Micro-Simulation ModelsWSP
Calibration and Validation of Micro-Simulation Models is a presentation delivered by François Bélisle, Eng., B.Sc., M.Sc., WSP | Parsons Brinckerhoff, Laurent Gauthier, Polytechnique Montréal and Nicolas Saunier, Polytechnique Montréal at the 2015 Transportation Association of Canada (TAC) Conference & Exhibition, from September 27 to 30.
Transit Signalisation Priority (TSP) - A New Approach to Calculate GainsWSP
Presentation by François Bélisle, Eng. , B.Sc., M.A. and Stephan Kellner, Eng., P.Eng., MS delivered at the 2015 Transportation Association of Canada (TAC) Conference & Exhibition, from September 27 to 30.
Heading Estimation Flow Chart
Heading Classifier for Pedestrian Movements
Experiment Scenario
Definition of ANN features for heading classifier
Results
Conclusion and Future work
Stephan Kellner, Eng., P.Eng., MS and François Bélisle, Eng., B.Sc., M.Sc. discuss transit signal priority impacts on intersection efficiency and safety for all users.
Presented at the 2015 Transportation Association of Canada Conference and Exhibition in Charlottetown, Canada from September 27-30.
International Journal of Engineering and Science Invention (IJESI) is an international journal intended for professionals and researchers in all fields of computer science and electronics. IJESI publishes research articles and reviews within the whole field Engineering Science and Technology, new teaching methods, assessment, validation and the impact of new technologies and it will continue to provide information on the latest trends and developments in this ever-expanding subject. The publications of papers are selected through double peer reviewed to ensure originality, relevance, and readability. The articles published in our journal can be accessed online.
Presentation delivered at the 2015 Transportation Association of Canada (TAC) Conference & Exhibition, from September 27 to 30, during the session entitled Goods Movement - Reaching Destinations Safely and Efficiently.
Prepared by
François Bélisle, Eng., B. Sc., M.A.
Marilyne Brosseau, Eng., M.Eng.
Steve Careau, Eng.
Philippe Mytofir, techn.
Validated by:
Stephan Kellner, Eng., M.Eng.
Presentation on Spot Speed Study Analysis for the course CE 454nazifa tabassum
This presentation describes the process of Spot Speed Study Analysis, how it can be performed and how the findings from such studies can help to improve road design in urban areas.
How Long to Wait? Predicting Bus Arrival Time With Mobile Phone Based Partici...WMLab,NCU
Regular meeting paper presentation.
About how to use cellular tower to locate buses' position, and use a more energy-friendly way to let querying user get buses' information.
routing table ,What is routing ? , what is static routing , what is dynamic routing , types of routing , routing protocols , routing strategy , Download Routing pdf , Download routing ppt , download routing notes , paper on routing
To Download Complete Documentation Visit My Blog
http://studyofcs.blogspot.com/2015/06/what-is-routerwhat-is-routing.html
Download completer BS Computer Science Degree Study Data
http://studyofcs.blogspot.com/p/bs.html
Stephan Kellner, Eng., P.Eng., MS and François Bélisle, Eng., B.Sc., M.Sc. discuss transit signal priority impacts on intersection efficiency and safety for all users.
Presented at the 2015 Transportation Association of Canada Conference and Exhibition in Charlottetown, Canada from September 27-30.
International Journal of Engineering and Science Invention (IJESI) is an international journal intended for professionals and researchers in all fields of computer science and electronics. IJESI publishes research articles and reviews within the whole field Engineering Science and Technology, new teaching methods, assessment, validation and the impact of new technologies and it will continue to provide information on the latest trends and developments in this ever-expanding subject. The publications of papers are selected through double peer reviewed to ensure originality, relevance, and readability. The articles published in our journal can be accessed online.
Presentation delivered at the 2015 Transportation Association of Canada (TAC) Conference & Exhibition, from September 27 to 30, during the session entitled Goods Movement - Reaching Destinations Safely and Efficiently.
Prepared by
François Bélisle, Eng., B. Sc., M.A.
Marilyne Brosseau, Eng., M.Eng.
Steve Careau, Eng.
Philippe Mytofir, techn.
Validated by:
Stephan Kellner, Eng., M.Eng.
Presentation on Spot Speed Study Analysis for the course CE 454nazifa tabassum
This presentation describes the process of Spot Speed Study Analysis, how it can be performed and how the findings from such studies can help to improve road design in urban areas.
How Long to Wait? Predicting Bus Arrival Time With Mobile Phone Based Partici...WMLab,NCU
Regular meeting paper presentation.
About how to use cellular tower to locate buses' position, and use a more energy-friendly way to let querying user get buses' information.
routing table ,What is routing ? , what is static routing , what is dynamic routing , types of routing , routing protocols , routing strategy , Download Routing pdf , Download routing ppt , download routing notes , paper on routing
To Download Complete Documentation Visit My Blog
http://studyofcs.blogspot.com/2015/06/what-is-routerwhat-is-routing.html
Download completer BS Computer Science Degree Study Data
http://studyofcs.blogspot.com/p/bs.html
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!SOFTTECHHUB
As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
How to Get CNIC Information System with Paksim Ga.pptxdanishmna97
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Communications Mining Series - Zero to Hero - Session 1DianaGray10
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
Communications Mining Series - Zero to Hero - Session 1
iBAT: Detecting Anomalous Taxi Trajectories from GPS Traces
1. iBAT: Detecting Anomalous Taxi
Trajectories from GPS Traces
DAQING ZHANG, NAN LI, ZHI-HUA ZHOU, CHAO
CHEN, LIN SUN, SHIJIAN LI
2. Introduction
• Taxis have been equipped with GPS devices
• Gathering and analyzing large-scale GPS traces reveal the hidden
facts
- City dynamics
- Human behaviors
3. Potential Applications
1. Fraud detection
- Greedy taxi drivers overcharge passenger by taking unnecessary
retours
- Often manually verified upon passenger complain
- In most case frauds are not even noticed by passengers
2. Road network change detection
- Urban road network often change with time. E.g. new road, blocked
road
- Need to update the changes in digital map
- Done manually by digital map providers
4. Example
• Source : S
• Destination : D
• Three clusters of trajectories
• Four trajectories (t0, t1, t2, t3) are considered as anomalies
5. Challenges
• There will be different set of normal trajectories between a pair of
source and destination. E.g. 3 clusters
• Traditional anomaly detection techniques based on distance are not
sufficient. E.g. t3
• Detect an emerging cluster of anomalous trajectories and incorporate
the changes
• Traditional method often requires fixed length feature vectors
6. Solution
• Novel anomalous driving trajectory detection approach
• Contribution
1. Transform the problem into an easy-to-solve problem
2. Propose an Isolation-Based Anomalous Trajectory (iBAT) detection
method
3. Evaluate iBAT with real-world GPS traces
4. Achieves remarkable detection rate with low processing time
7. Related work
• Anomalous trajectory detection
1. Outlier detection using sub-trajectories using distance and density
[1]
2. Outlier detection using direction and density [2]
3. Clustering techniques [3]
4. Discover abnormal traffic change [4]
5. Learning based approaches [5]
8. Related work
• Anomalous detection methods not designed for trajectory data
1. Distance-based approach [6]
2. Density-based approach [7]
3. Isolation-based approach - iForest [8]
9. iForest
• Anomalies are few and different
• No distance or density measures
• State-of-the-art performance for outlier detection
• Lower run time and space complexity
• Fixed-length feature vectors
10. Problem Statement
• GPS Point
- latitude and longitude
- Timestamp
- Estimated speed
- Operation status
11. Problem Statement
• Taxi trajectory
Sequence of GPS points to an occupied taxi ride
t : p1 -> p2 -> …… -> pn
p1 : source
pn : destination
• Problem
Given a set of Trajectories T = {t1, t2,….. , tn} between two locations S
and D, find those in T that are significantly different from the major
13. Augmenting(preprocessing)
• Split the city map into grid-cells of equal size
•Map the taxi trajectory to the cell grid - sequence of traversed
cells
•Augment missing cells by inserting pseudo cells
14. Indexing(preprocessing)
• Given a source-destination cell-pair, find all the related taxi
trajectories
• For given period of time, there may be insufficient trajectories
between a source and destination
• Add all the taxi trajectories which pass through the source-
destination cell pair to solve the issue
• Construct inverted index mechanism for trajectory retrieval
15. Indexing(preprocessing)
• Example:
- Two trajectories
- Create the inverted index as follows
- Source p1 and destination p5: retrieve t1 and t2
- Source p1 and p3: retrieve t1
16. Adapting iForest
• Begin with all the trajectories
• Pick one grid cell at a time
• Partition trajectories based on the grid cell
- Trajectory contains the grid cell : Left
- Otherwise : Right
• Continue until all the instances are isolated
- Either there is only one trajectory to divide
- Or all the trajectories contain same set of grid cells
• Produces short paths for anomalies and long paths for normal
instances
18. iBAT
• Lazy learning
- Do not train a model until presented with a test sample
• Keep one trajectory as test t
• Select one grid cell from t randomly and remove trajectories
from train which do not contain the selected cell
• Repeat until no trajectory is left or all the trajectories left
contains cells same as test trajectory
• No of cells required to isolate t, n(t) decides anomalous
21. iBAT
• Since the process is completely random, average of n(t) is
considered
• Example: random isolation process for 200 times
22. iBAT
• Calculate the anomaly score for t
s(t, N) = 2-E(n(t))/c(N)
N : Number of trajectories from which we separate t
E(n(t)) : Average number of cells used
c(N): 2H(N-1) - 2(N-1)/N
H(i): Harmonic number, estimated as ln(i) + 0.57721566
• E(n(t)) -> 0, s(t, N) -> 1 : Anomalous trajectory
• s(t, N) < 0.5 : t is categorized as normal trajectory
23. iBAT
• In practice, training set will be large
• Use sub-sample of the training data
• Two additional parameter
m : running trails (100)
ψ : sub-sample size (256)
24. Evaluation
• Real-word taxi GPS dataset collected from the large city of China,
Hangzhou
• More than 7600 taxis
• One record contains:
- latitude
- longitude
- passenger status
- timestamp
• Area is discretized into 100*200 grid cells, each corresponding to
a 250m*250m square
25. Evaluation
• Five source-destination cell-pair is picked
• Trajectories are manually labeled by three volunteers
• If one volunteer thinks a trajectory is anomalous, it is labeled to
be anomalous
26. Evaluation
• Density-based method is taken as the baseline for comparison
- density of a trajectory is average density of all its cells
- density of a cell is the number of trajectories that pass through
it
• Evaluation criteria
- detection rate : The fraction of anomalous trajectories that are
successfully detected
- false alarm rate: The fraction of normal ones that are
wrongly predicted detected as anomalous
- AUC: Area Under ROC Curve
Probability that a randomly chosen anomalous trajectory
is ranked higher than the randomly chosen normal one
28. Evaluation
• ROC curve of iBAT
• High detection rate with small false alarm rate
• 90% of anomalous detected at 2% false alarm rate
• For T-4, 100% detection rate with false alarm rate less than 1%
29. Evaluation
• AUC values compared with density-based method
• AUC values are greater than 0.99 for all the datasets
• Density-based method achieves lower AUC values
- less than 0.95 in four datasets
- 0.97 in dataset T-4 as there are less anomalous trajectories
that detour on high-density cells
30. Evaluation
• AUC value and processing time change with m (ψ = 256), and ψ
(m = 100)
• Processing time is about 100 secs, about 0.07 second per
trajectory when m=100
31. Taxi Driving Fraud
• Long-distance detours may correspond to taxi driving frauds
• Detecting anomalous taxi trajectories can help building taxi
driving fraud detection systems
• Challenges
- Some drivers may be truly unfamiliar with the routes
- Some may argue that reason for the detour is due to accident
or traffic
32. Road Network Change
• If more similar anomalous trajectories are accumulating, it may
be an indication of new or blocked road
• 160 trajectories similar to t0
34. Weakness
• Run the algorithm for each trajectory again and again
• Handling temporal trajectories are not explained well
• Only density-based approach is compared in the evaluation
35. Future Work
• Implement the fraud detection system on top of this application
• Use other information associated with a GPS trace such as
driving speed
36. References
[1] J.-G. Lee, J. Han, and X. Li. Trajectory outlier detection: A partition-and-detect framework. In
Proc. ICDE 2008, pages 140–149, 2008.
[2] Y. Ge, H. Xiong, Z.-H. Zhou, H. Ozdemir, J. Yu, and K. C. Lee. Top-Eye: Top-k evolving trajectory
outlier detection. In Proc. CIKM 2010, pages 1733–1736, 2010
[3] Y. Bu, L. Chen, A. W.-C. Fu, and D. Liu. Efficient anomaly monitoring over moving object
trajectory streams. In Proc. KDD 2009, pages 159–168, 2009.
[4] B. Li, D. Zhang, L. Sun, C. Chen, S. Li, G. Qi, and Q. Yang. Hunting or waiting? discovering
passenger-finding strategies from a large-scale real-world taxi dataset. In MUCS’11 in conjunction
with PerCom 2011, pages 63–68, 2011.
[5] Z. Liao, Y. Yu, and B. Chen. Anomaly detection in GPS data based on visual analytics. In Proc.
VAST 2010, pages 51–58, 2010.