SlideShare a Scribd company logo
Multi-Robot Systems CSCI 7000-006 Friday, September 11, 2009 NikolausCorrell
So far Reactive vs. Deliberative Algorithms Both approaches are probabilistic for noisy sensors and actuators Robustness/Deterministic behavior can be increased by Combining different sensors Information exchange Actively validating hypothesis Redundancy
Today Exact and approximative algorithms Centralized vs. Distributed Systems Market-based algorithms
Exact Algorithms Find always the best solution Search the entire solution space Determine what “best” means (fitness function) Enumerate all solutions Pick best solution Some problems: dynamic programming Finding the best solution can be very time-consuming/impossible for NP-hard problems
Example: Traveling Salesman Problem Traveling Salesman Problem Find the shortest route connecting n cities Never visit any city twice Computational representation: sequence Brute force algorithm: calculate length of all possible permutations 60 cities -> 4.2 * 10^81 permutations  NP hard, exact better than brute-force solutions exist (e.g. dynamic programming)
Course Question Come up with a reactive algorithm for solving the TSP. Hint: ants.
Reactive Algorithm for the TSP Use a population of ant-like agents starting at random cities Each ant randomly select a city that it has not yet visited on this tour (repeat until all cities are visited) Each ant calculates the length of this path and deploys an inverse amount of “pheromones” on the path In following iterations, ants are programmed to select paths from city i to city j with a higher likelihood Algorithm converges to a local optimum
Lessons from this example Exact problems can be very hard to solve Also “pure” CS offers a wide range of algorithmic solutions The design problem trades off provable optimality with speed In robotics algorithmic choice is constrained by sensors, actuators, computation and communication
Coverage example (Wednesday) Exact algorithm for single robot Approximative algorithm for multiple robots Robots might find the optimal solution Worst case: every robot covers everything
Course Question Come up with an exact algorithm for covering M cells with N robots as fast as possible. Hints: The problem reduces to allocate a subset of cells to each robot to minimize the maximum number of cells allocated to one robot. Identify sub-problems / algorithms
Possible Solution Enumerate all possible sets of allocations Calculate the cost of each allocation Cost: TSP path over all cells NP-Hard  Stirling numbers of the 2nd kind for 3 and 4 cells and up to 4 robots. © Mathworld
Centralized vs. Distributed Algorithms Finding the best solution requires knowing all parameters of the system Usually requires “leader” or centralized agent Course Question: What problems do you expect in a centralized system?
Centralized Systems Information needs to be sent to a central unit Commands need to be sent to each robot Problems Information get lost both ways Process needs to be repeated when individuals fail Individual failure needs to be detected …
How to distribute an algorithm? Smart way: using the optimal substructure of the problem (dynamic programming) Not all problems can be efficiently distributed Robust: Every robot solves the whole problem for the entire team Problem: ambiguous solutions Resolution: conflict resolution rules, e.g. lower id goes first Example: Market-based task allocation
Market-based task allocation Tasks are offered by auctioneer Every robot bids with the cost that it would need to do the task Robot with the lowest cost gets the job Simplest auction: greedy, non-optimal ordering Variations: bidding on all possible permutations
Example: Box Pushing Two tasks: watch the box, push the box Three robots, only one can watch the box Watch the box requires LMS Watcher auctions off “push left” and “push right” tasks "Sold!: Auction methods for multi-robot coordination". Brian P. Gerkey and Maja J Mataric´. IEEE Transactions on Robotics and Automation, Special Issue on Multi-robot Systems, 18(5):758-768, October 2002.
Example: Coverage Robots calculate cost for covering a blade by solving the TSP Sequential biddingapproximates near optimal Deterministic bid evaluation allows for decentralized auction-closing Re-Allocation upon error P. Amstutz, N. Correll, and A. Martinoli. Distributed Boundary Coverage with a Team of Networked Miniature Robots using a Robust Market-Based Algorithm. Annals of Mathematics and Artifcial Intelligence. Special Issue on Coverage, Exploration, and Search, Gal Kaminka and Amir Shapiro, editors, 52(2-4):307-333, 2009.
Re-Auctioning example Bids during auction Robot 1 “slips”
9/20/2007 Nikolaus Correll 19
Results DFS/A* No collaboration Market-based coordination DFS/A* Information exchange
Summary The better you plan, the better the performance Noise requires you to re-plan all the time Feasible algorithms determined by robot capabilities: sensors, actuators, computation and communication Algorithmic complexity exponential for NP hard problems Potentially very high cost for marginal improvements!
Outlook Control-based approaches (in two weeks) Modeling: examining resource trade-offs on paper (in three weeks) Next week: building week

More Related Content

Viewers also liked

December 2, Projects
December 2, ProjectsDecember 2, Projects
December 2, Projects
University of Colorado at Boulder
 
Template classes and ROS messages
Template classes and ROS messagesTemplate classes and ROS messages
Template classes and ROS messages
University of Colorado at Boulder
 
December 4, Project
December 4, ProjectDecember 4, Project
November 30, Projects
November 30, ProjectsNovember 30, Projects
November 30, Projects
University of Colorado at Boulder
 
Vishal Verma: Rapidly Exploring Random Trees
Vishal Verma: Rapidly Exploring Random TreesVishal Verma: Rapidly Exploring Random Trees
Vishal Verma: Rapidly Exploring Random Trees
University of Colorado at Boulder
 
Lecture 02: Locomotion
Lecture 02: LocomotionLecture 02: Locomotion
Lecture 02: Locomotion
University of Colorado at Boulder
 
Lecture 05
Lecture 05Lecture 05
September 21, Modeling of Gradient-Based Controllers I
September 21, Modeling of Gradient-Based Controllers ISeptember 21, Modeling of Gradient-Based Controllers I
September 21, Modeling of Gradient-Based Controllers I
University of Colorado at Boulder
 
November 9, Planning and Control of Unmanned Aircraft Systems in Realistic C...
November 9, Planning and Control of Unmanned Aircraft Systems  in Realistic C...November 9, Planning and Control of Unmanned Aircraft Systems  in Realistic C...
November 9, Planning and Control of Unmanned Aircraft Systems in Realistic C...
University of Colorado at Boulder
 
October 19, Probabilistic Modeling III
October 19, Probabilistic Modeling IIIOctober 19, Probabilistic Modeling III
October 19, Probabilistic Modeling III
University of Colorado at Boulder
 

Viewers also liked (10)

December 2, Projects
December 2, ProjectsDecember 2, Projects
December 2, Projects
 
Template classes and ROS messages
Template classes and ROS messagesTemplate classes and ROS messages
Template classes and ROS messages
 
December 4, Project
December 4, ProjectDecember 4, Project
December 4, Project
 
November 30, Projects
November 30, ProjectsNovember 30, Projects
November 30, Projects
 
Vishal Verma: Rapidly Exploring Random Trees
Vishal Verma: Rapidly Exploring Random TreesVishal Verma: Rapidly Exploring Random Trees
Vishal Verma: Rapidly Exploring Random Trees
 
Lecture 02: Locomotion
Lecture 02: LocomotionLecture 02: Locomotion
Lecture 02: Locomotion
 
Lecture 05
Lecture 05Lecture 05
Lecture 05
 
September 21, Modeling of Gradient-Based Controllers I
September 21, Modeling of Gradient-Based Controllers ISeptember 21, Modeling of Gradient-Based Controllers I
September 21, Modeling of Gradient-Based Controllers I
 
November 9, Planning and Control of Unmanned Aircraft Systems in Realistic C...
November 9, Planning and Control of Unmanned Aircraft Systems  in Realistic C...November 9, Planning and Control of Unmanned Aircraft Systems  in Realistic C...
November 9, Planning and Control of Unmanned Aircraft Systems in Realistic C...
 
October 19, Probabilistic Modeling III
October 19, Probabilistic Modeling IIIOctober 19, Probabilistic Modeling III
October 19, Probabilistic Modeling III
 

Similar to September 11, Deliberative Algorithms II

Thesis Presentation
Thesis PresentationThesis Presentation
Thesis Presentation
Spondon Saha
 
Introduction to algorithmic aspect of auction theory
Introduction to algorithmic aspect of auction theoryIntroduction to algorithmic aspect of auction theory
Introduction to algorithmic aspect of auction theory
Abner Chih Yi Huang
 
Algorithms And Optimization Techniques For Solving TSP
Algorithms And Optimization Techniques For Solving TSPAlgorithms And Optimization Techniques For Solving TSP
Algorithms And Optimization Techniques For Solving TSP
Carrie Romero
 
Segment_1_New computer algorithm for cse.pptx
Segment_1_New computer algorithm for cse.pptxSegment_1_New computer algorithm for cse.pptx
Segment_1_New computer algorithm for cse.pptx
fahmidasetu
 
This is a heavily data-oriented
This is a heavily data-orientedThis is a heavily data-oriented
This is a heavily data-oriented
butest
 
This is a heavily data-oriented
This is a heavily data-orientedThis is a heavily data-oriented
This is a heavily data-oriented
butest
 
Combinatorial optimization and deep reinforcement learning
Combinatorial optimization and deep reinforcement learningCombinatorial optimization and deep reinforcement learning
Combinatorial optimization and deep reinforcement learning
민재 정
 
September 2, Reactive Algorithms II
September 2, Reactive Algorithms IISeptember 2, Reactive Algorithms II
September 2, Reactive Algorithms II
University of Colorado at Boulder
 
October 26, Optimization
October 26, OptimizationOctober 26, Optimization
October 26, Optimization
University of Colorado at Boulder
 
Two methods for optimising cognitive model parameters
Two methods for optimising cognitive model parametersTwo methods for optimising cognitive model parameters
Two methods for optimising cognitive model parameters
University of Huddersfield
 
The Most Important Algorithms
The Most Important AlgorithmsThe Most Important Algorithms
The Most Important Algorithms
wensheng wei
 
Quantum inspired evolutionary algorithm for solving multiple travelling sales...
Quantum inspired evolutionary algorithm for solving multiple travelling sales...Quantum inspired evolutionary algorithm for solving multiple travelling sales...
Quantum inspired evolutionary algorithm for solving multiple travelling sales...
eSAT Publishing House
 
August 27, Introduction to Multi-Robot Systems
August 27, Introduction to Multi-Robot SystemsAugust 27, Introduction to Multi-Robot Systems
August 27, Introduction to Multi-Robot Systems
University of Colorado at Boulder
 
A frugal-bidding-procedurefor-replicating-www-content
A frugal-bidding-procedurefor-replicating-www-contentA frugal-bidding-procedurefor-replicating-www-content
A frugal-bidding-procedurefor-replicating-www-content
Cemal Ardil
 
whhhhhhhhhhhhhhhhhhhhhhhhhhhhheek 8 Cc.pdf
whhhhhhhhhhhhhhhhhhhhhhhhhhhhheek 8 Cc.pdfwhhhhhhhhhhhhhhhhhhhhhhhhhhhhheek 8 Cc.pdf
whhhhhhhhhhhhhhhhhhhhhhhhhhhhheek 8 Cc.pdf
hassankhan978073
 
Cluster head election using imperialist competitive algorithm (chei) for wire...
Cluster head election using imperialist competitive algorithm (chei) for wire...Cluster head election using imperialist competitive algorithm (chei) for wire...
Cluster head election using imperialist competitive algorithm (chei) for wire...
ijmnct
 
C:\Documents And Settings\User\桌面\Sciece Talk投影片\Science Talk 100111 陸行
C:\Documents And Settings\User\桌面\Sciece Talk投影片\Science Talk 100111 陸行C:\Documents And Settings\User\桌面\Sciece Talk投影片\Science Talk 100111 陸行
C:\Documents And Settings\User\桌面\Sciece Talk投影片\Science Talk 100111 陸行
guestf4730f1
 
Science Talk-100111-陸行
Science Talk-100111-陸行Science Talk-100111-陸行
Science Talk-100111-陸行
nccuscience
 
Discrete structure ch 3 short question's
Discrete structure ch 3 short question'sDiscrete structure ch 3 short question's
Discrete structure ch 3 short question's
hammad463061
 
September 30, Probabilistic Modeling
September 30, Probabilistic ModelingSeptember 30, Probabilistic Modeling
September 30, Probabilistic Modeling
University of Colorado at Boulder
 

Similar to September 11, Deliberative Algorithms II (20)

Thesis Presentation
Thesis PresentationThesis Presentation
Thesis Presentation
 
Introduction to algorithmic aspect of auction theory
Introduction to algorithmic aspect of auction theoryIntroduction to algorithmic aspect of auction theory
Introduction to algorithmic aspect of auction theory
 
Algorithms And Optimization Techniques For Solving TSP
Algorithms And Optimization Techniques For Solving TSPAlgorithms And Optimization Techniques For Solving TSP
Algorithms And Optimization Techniques For Solving TSP
 
Segment_1_New computer algorithm for cse.pptx
Segment_1_New computer algorithm for cse.pptxSegment_1_New computer algorithm for cse.pptx
Segment_1_New computer algorithm for cse.pptx
 
This is a heavily data-oriented
This is a heavily data-orientedThis is a heavily data-oriented
This is a heavily data-oriented
 
This is a heavily data-oriented
This is a heavily data-orientedThis is a heavily data-oriented
This is a heavily data-oriented
 
Combinatorial optimization and deep reinforcement learning
Combinatorial optimization and deep reinforcement learningCombinatorial optimization and deep reinforcement learning
Combinatorial optimization and deep reinforcement learning
 
September 2, Reactive Algorithms II
September 2, Reactive Algorithms IISeptember 2, Reactive Algorithms II
September 2, Reactive Algorithms II
 
October 26, Optimization
October 26, OptimizationOctober 26, Optimization
October 26, Optimization
 
Two methods for optimising cognitive model parameters
Two methods for optimising cognitive model parametersTwo methods for optimising cognitive model parameters
Two methods for optimising cognitive model parameters
 
The Most Important Algorithms
The Most Important AlgorithmsThe Most Important Algorithms
The Most Important Algorithms
 
Quantum inspired evolutionary algorithm for solving multiple travelling sales...
Quantum inspired evolutionary algorithm for solving multiple travelling sales...Quantum inspired evolutionary algorithm for solving multiple travelling sales...
Quantum inspired evolutionary algorithm for solving multiple travelling sales...
 
August 27, Introduction to Multi-Robot Systems
August 27, Introduction to Multi-Robot SystemsAugust 27, Introduction to Multi-Robot Systems
August 27, Introduction to Multi-Robot Systems
 
A frugal-bidding-procedurefor-replicating-www-content
A frugal-bidding-procedurefor-replicating-www-contentA frugal-bidding-procedurefor-replicating-www-content
A frugal-bidding-procedurefor-replicating-www-content
 
whhhhhhhhhhhhhhhhhhhhhhhhhhhhheek 8 Cc.pdf
whhhhhhhhhhhhhhhhhhhhhhhhhhhhheek 8 Cc.pdfwhhhhhhhhhhhhhhhhhhhhhhhhhhhhheek 8 Cc.pdf
whhhhhhhhhhhhhhhhhhhhhhhhhhhhheek 8 Cc.pdf
 
Cluster head election using imperialist competitive algorithm (chei) for wire...
Cluster head election using imperialist competitive algorithm (chei) for wire...Cluster head election using imperialist competitive algorithm (chei) for wire...
Cluster head election using imperialist competitive algorithm (chei) for wire...
 
C:\Documents And Settings\User\桌面\Sciece Talk投影片\Science Talk 100111 陸行
C:\Documents And Settings\User\桌面\Sciece Talk投影片\Science Talk 100111 陸行C:\Documents And Settings\User\桌面\Sciece Talk投影片\Science Talk 100111 陸行
C:\Documents And Settings\User\桌面\Sciece Talk投影片\Science Talk 100111 陸行
 
Science Talk-100111-陸行
Science Talk-100111-陸行Science Talk-100111-陸行
Science Talk-100111-陸行
 
Discrete structure ch 3 short question's
Discrete structure ch 3 short question'sDiscrete structure ch 3 short question's
Discrete structure ch 3 short question's
 
September 30, Probabilistic Modeling
September 30, Probabilistic ModelingSeptember 30, Probabilistic Modeling
September 30, Probabilistic Modeling
 

More from University of Colorado at Boulder

Three-dimensional construction with mobile robots and modular blocks
 Three-dimensional construction with mobile robots and modular blocks Three-dimensional construction with mobile robots and modular blocks
Three-dimensional construction with mobile robots and modular blocks
University of Colorado at Boulder
 
NLP for Robotics
NLP for RoboticsNLP for Robotics
Indoor Localization Systems
Indoor Localization SystemsIndoor Localization Systems
Indoor Localization Systems
University of Colorado at Boulder
 
Lecture 10: Summary
Lecture 10: SummaryLecture 10: Summary
Lecture 09: SLAM
Lecture 09: SLAMLecture 09: SLAM
Lecture 08: Localization and Mapping II
Lecture 08: Localization and Mapping IILecture 08: Localization and Mapping II
Lecture 08: Localization and Mapping II
University of Colorado at Boulder
 
Lecture 07: Localization and Mapping I
Lecture 07: Localization and Mapping ILecture 07: Localization and Mapping I
Lecture 07: Localization and Mapping I
University of Colorado at Boulder
 
Lecture 06: Features and Uncertainty
Lecture 06: Features and UncertaintyLecture 06: Features and Uncertainty
Lecture 06: Features and Uncertainty
University of Colorado at Boulder
 
Lecture 04
Lecture 04Lecture 04
Lecture 03 - Kinematics and Control
Lecture 03 - Kinematics and ControlLecture 03 - Kinematics and Control
Lecture 03 - Kinematics and Control
University of Colorado at Boulder
 
Lecture 01
Lecture 01Lecture 01
Lectures 11+12: Debates
Lectures 11+12: DebatesLectures 11+12: Debates
Lectures 11+12: Debates
University of Colorado at Boulder
 
Lecture 09: Localization and Mapping III
Lecture 09: Localization and Mapping IIILecture 09: Localization and Mapping III
Lecture 09: Localization and Mapping III
University of Colorado at Boulder
 
Lecture 10: Navigation
Lecture 10: NavigationLecture 10: Navigation
Lecture 10: Navigation
University of Colorado at Boulder
 
Lecture 08: Localization and Mapping II
Lecture 08: Localization and Mapping IILecture 08: Localization and Mapping II
Lecture 08: Localization and Mapping II
University of Colorado at Boulder
 
Lecture 07: Localization and Mapping I
Lecture 07: Localization and Mapping ILecture 07: Localization and Mapping I
Lecture 07: Localization and Mapping I
University of Colorado at Boulder
 
Lecture 06: Features
Lecture 06: FeaturesLecture 06: Features
Lecture 06: Features
University of Colorado at Boulder
 
Lecture 05: Vision
Lecture 05: VisionLecture 05: Vision
Lecture 04: Sensors
Lecture 04: SensorsLecture 04: Sensors
Lecture 03: Kinematics
Lecture 03: KinematicsLecture 03: Kinematics
Lecture 03: Kinematics
University of Colorado at Boulder
 

More from University of Colorado at Boulder (20)

Three-dimensional construction with mobile robots and modular blocks
 Three-dimensional construction with mobile robots and modular blocks Three-dimensional construction with mobile robots and modular blocks
Three-dimensional construction with mobile robots and modular blocks
 
NLP for Robotics
NLP for RoboticsNLP for Robotics
NLP for Robotics
 
Indoor Localization Systems
Indoor Localization SystemsIndoor Localization Systems
Indoor Localization Systems
 
Lecture 10: Summary
Lecture 10: SummaryLecture 10: Summary
Lecture 10: Summary
 
Lecture 09: SLAM
Lecture 09: SLAMLecture 09: SLAM
Lecture 09: SLAM
 
Lecture 08: Localization and Mapping II
Lecture 08: Localization and Mapping IILecture 08: Localization and Mapping II
Lecture 08: Localization and Mapping II
 
Lecture 07: Localization and Mapping I
Lecture 07: Localization and Mapping ILecture 07: Localization and Mapping I
Lecture 07: Localization and Mapping I
 
Lecture 06: Features and Uncertainty
Lecture 06: Features and UncertaintyLecture 06: Features and Uncertainty
Lecture 06: Features and Uncertainty
 
Lecture 04
Lecture 04Lecture 04
Lecture 04
 
Lecture 03 - Kinematics and Control
Lecture 03 - Kinematics and ControlLecture 03 - Kinematics and Control
Lecture 03 - Kinematics and Control
 
Lecture 01
Lecture 01Lecture 01
Lecture 01
 
Lectures 11+12: Debates
Lectures 11+12: DebatesLectures 11+12: Debates
Lectures 11+12: Debates
 
Lecture 09: Localization and Mapping III
Lecture 09: Localization and Mapping IIILecture 09: Localization and Mapping III
Lecture 09: Localization and Mapping III
 
Lecture 10: Navigation
Lecture 10: NavigationLecture 10: Navigation
Lecture 10: Navigation
 
Lecture 08: Localization and Mapping II
Lecture 08: Localization and Mapping IILecture 08: Localization and Mapping II
Lecture 08: Localization and Mapping II
 
Lecture 07: Localization and Mapping I
Lecture 07: Localization and Mapping ILecture 07: Localization and Mapping I
Lecture 07: Localization and Mapping I
 
Lecture 06: Features
Lecture 06: FeaturesLecture 06: Features
Lecture 06: Features
 
Lecture 05: Vision
Lecture 05: VisionLecture 05: Vision
Lecture 05: Vision
 
Lecture 04: Sensors
Lecture 04: SensorsLecture 04: Sensors
Lecture 04: Sensors
 
Lecture 03: Kinematics
Lecture 03: KinematicsLecture 03: Kinematics
Lecture 03: Kinematics
 

Recently uploaded

Must Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during MigrationMust Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during Migration
Mydbops
 
Introducing BoxLang : A new JVM language for productivity and modularity!
Introducing BoxLang : A new JVM language for productivity and modularity!Introducing BoxLang : A new JVM language for productivity and modularity!
Introducing BoxLang : A new JVM language for productivity and modularity!
Ortus Solutions, Corp
 
AI in the Workplace Reskilling, Upskilling, and Future Work.pptx
AI in the Workplace Reskilling, Upskilling, and Future Work.pptxAI in the Workplace Reskilling, Upskilling, and Future Work.pptx
AI in the Workplace Reskilling, Upskilling, and Future Work.pptx
Sunil Jagani
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Antonios Katsarakis
 
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green MasterplanJavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
Miro Wengner
 
Poznań ACE event - 19.06.2024 Team 24 Wrapup slidedeck
Poznań ACE event - 19.06.2024 Team 24 Wrapup slidedeckPoznań ACE event - 19.06.2024 Team 24 Wrapup slidedeck
Poznań ACE event - 19.06.2024 Team 24 Wrapup slidedeck
FilipTomaszewski5
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
DanBrown980551
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
Pablo Gómez Abajo
 
ScyllaDB Tablets: Rethinking Replication
ScyllaDB Tablets: Rethinking ReplicationScyllaDB Tablets: Rethinking Replication
ScyllaDB Tablets: Rethinking Replication
ScyllaDB
 
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
AlexanderRichford
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
Javier Junquera
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
Ivo Velitchkov
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
Neo4j
 
Discover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched ContentDiscover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched Content
ScyllaDB
 
Christine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptxChristine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptx
christinelarrosa
 
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin..."$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
Fwdays
 
Principle of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptxPrinciple of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptx
BibashShahi
 
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
Getting the Most Out of ScyllaDB Monitoring: ShareChat's TipsGetting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
ScyllaDB
 
Day 2 - Intro to UiPath Studio Fundamentals
Day 2 - Intro to UiPath Studio FundamentalsDay 2 - Intro to UiPath Studio Fundamentals
Day 2 - Intro to UiPath Studio Fundamentals
UiPathCommunity
 

Recently uploaded (20)

Must Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during MigrationMust Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during Migration
 
Introducing BoxLang : A new JVM language for productivity and modularity!
Introducing BoxLang : A new JVM language for productivity and modularity!Introducing BoxLang : A new JVM language for productivity and modularity!
Introducing BoxLang : A new JVM language for productivity and modularity!
 
AI in the Workplace Reskilling, Upskilling, and Future Work.pptx
AI in the Workplace Reskilling, Upskilling, and Future Work.pptxAI in the Workplace Reskilling, Upskilling, and Future Work.pptx
AI in the Workplace Reskilling, Upskilling, and Future Work.pptx
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
 
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green MasterplanJavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
 
Poznań ACE event - 19.06.2024 Team 24 Wrapup slidedeck
Poznań ACE event - 19.06.2024 Team 24 Wrapup slidedeckPoznań ACE event - 19.06.2024 Team 24 Wrapup slidedeck
Poznań ACE event - 19.06.2024 Team 24 Wrapup slidedeck
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
 
ScyllaDB Tablets: Rethinking Replication
ScyllaDB Tablets: Rethinking ReplicationScyllaDB Tablets: Rethinking Replication
ScyllaDB Tablets: Rethinking Replication
 
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
 
Discover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched ContentDiscover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched Content
 
Christine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptxChristine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptx
 
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin..."$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
 
Principle of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptxPrinciple of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptx
 
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
Getting the Most Out of ScyllaDB Monitoring: ShareChat's TipsGetting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
 
Day 2 - Intro to UiPath Studio Fundamentals
Day 2 - Intro to UiPath Studio FundamentalsDay 2 - Intro to UiPath Studio Fundamentals
Day 2 - Intro to UiPath Studio Fundamentals
 

September 11, Deliberative Algorithms II

  • 1. Multi-Robot Systems CSCI 7000-006 Friday, September 11, 2009 NikolausCorrell
  • 2. So far Reactive vs. Deliberative Algorithms Both approaches are probabilistic for noisy sensors and actuators Robustness/Deterministic behavior can be increased by Combining different sensors Information exchange Actively validating hypothesis Redundancy
  • 3. Today Exact and approximative algorithms Centralized vs. Distributed Systems Market-based algorithms
  • 4. Exact Algorithms Find always the best solution Search the entire solution space Determine what “best” means (fitness function) Enumerate all solutions Pick best solution Some problems: dynamic programming Finding the best solution can be very time-consuming/impossible for NP-hard problems
  • 5. Example: Traveling Salesman Problem Traveling Salesman Problem Find the shortest route connecting n cities Never visit any city twice Computational representation: sequence Brute force algorithm: calculate length of all possible permutations 60 cities -> 4.2 * 10^81 permutations NP hard, exact better than brute-force solutions exist (e.g. dynamic programming)
  • 6. Course Question Come up with a reactive algorithm for solving the TSP. Hint: ants.
  • 7. Reactive Algorithm for the TSP Use a population of ant-like agents starting at random cities Each ant randomly select a city that it has not yet visited on this tour (repeat until all cities are visited) Each ant calculates the length of this path and deploys an inverse amount of “pheromones” on the path In following iterations, ants are programmed to select paths from city i to city j with a higher likelihood Algorithm converges to a local optimum
  • 8. Lessons from this example Exact problems can be very hard to solve Also “pure” CS offers a wide range of algorithmic solutions The design problem trades off provable optimality with speed In robotics algorithmic choice is constrained by sensors, actuators, computation and communication
  • 9. Coverage example (Wednesday) Exact algorithm for single robot Approximative algorithm for multiple robots Robots might find the optimal solution Worst case: every robot covers everything
  • 10. Course Question Come up with an exact algorithm for covering M cells with N robots as fast as possible. Hints: The problem reduces to allocate a subset of cells to each robot to minimize the maximum number of cells allocated to one robot. Identify sub-problems / algorithms
  • 11. Possible Solution Enumerate all possible sets of allocations Calculate the cost of each allocation Cost: TSP path over all cells NP-Hard Stirling numbers of the 2nd kind for 3 and 4 cells and up to 4 robots. © Mathworld
  • 12. Centralized vs. Distributed Algorithms Finding the best solution requires knowing all parameters of the system Usually requires “leader” or centralized agent Course Question: What problems do you expect in a centralized system?
  • 13. Centralized Systems Information needs to be sent to a central unit Commands need to be sent to each robot Problems Information get lost both ways Process needs to be repeated when individuals fail Individual failure needs to be detected …
  • 14. How to distribute an algorithm? Smart way: using the optimal substructure of the problem (dynamic programming) Not all problems can be efficiently distributed Robust: Every robot solves the whole problem for the entire team Problem: ambiguous solutions Resolution: conflict resolution rules, e.g. lower id goes first Example: Market-based task allocation
  • 15. Market-based task allocation Tasks are offered by auctioneer Every robot bids with the cost that it would need to do the task Robot with the lowest cost gets the job Simplest auction: greedy, non-optimal ordering Variations: bidding on all possible permutations
  • 16. Example: Box Pushing Two tasks: watch the box, push the box Three robots, only one can watch the box Watch the box requires LMS Watcher auctions off “push left” and “push right” tasks "Sold!: Auction methods for multi-robot coordination". Brian P. Gerkey and Maja J Mataric´. IEEE Transactions on Robotics and Automation, Special Issue on Multi-robot Systems, 18(5):758-768, October 2002.
  • 17. Example: Coverage Robots calculate cost for covering a blade by solving the TSP Sequential biddingapproximates near optimal Deterministic bid evaluation allows for decentralized auction-closing Re-Allocation upon error P. Amstutz, N. Correll, and A. Martinoli. Distributed Boundary Coverage with a Team of Networked Miniature Robots using a Robust Market-Based Algorithm. Annals of Mathematics and Artifcial Intelligence. Special Issue on Coverage, Exploration, and Search, Gal Kaminka and Amir Shapiro, editors, 52(2-4):307-333, 2009.
  • 18. Re-Auctioning example Bids during auction Robot 1 “slips”
  • 20. Results DFS/A* No collaboration Market-based coordination DFS/A* Information exchange
  • 21. Summary The better you plan, the better the performance Noise requires you to re-plan all the time Feasible algorithms determined by robot capabilities: sensors, actuators, computation and communication Algorithmic complexity exponential for NP hard problems Potentially very high cost for marginal improvements!
  • 22. Outlook Control-based approaches (in two weeks) Modeling: examining resource trade-offs on paper (in three weeks) Next week: building week

Editor's Notes

  1. Optimal Substructure: solution can be constructed from solutions to its subproblemsOverlapping subproblems: solutions to subproblems can be used multiple times in finding the solution