Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Programming Robots


Published on

Programming robots using visualisation, concurrency and coordination, using the Microsoft Robotics Developer Studio and the Visual Robotic Development Kit prototype held for the British Computer Society (BCS) in Cambridge, UK in 2006.

Published in: Technology, Business
  • Be the first to comment

Programming Robots

  1. 1. ERO Technology Group Presented byProgramming Robots Andreas Heil DateProgramming with Visualisation, 08. November 2006Concurrency and Coordination
  2. 2. Definition: Robot A robot is an electro-mechanical device that can perform autonomous or preprogrammed tasks. A robot may act under the direct control of a human (eg. the Canadarm on the space shuttle) or autonomously under the control of a programmed computer. Wikipedia 1. Mechanical device programmed to perform tasks any machine that can be programmed to carry out instructions and perform particular duties, especially one that can take over tasks normally done by people. 2. Imaginary machine like human a machine that resembles a human in appearance and can function like a human, especially in science fiction 3. Person like a machine somebody who works or behaves mechanically, showing little or no emotion and often responding to orders without question 4. Traffic light South Africa a set of automatic traffic light Encarta Dictionary
  3. 3. Definition: Robot A robot is a device, hard- or software with the capability of sensing and (re)acting.
  4. 4. Robotics Market PotentialService and consumer markets just emerging• Remote assistance/presence• Assistive Worldw ide Robotics Market Grow th• Facilities maintenance• Security• Education• Entertainment 70000000 Home Mediacal/WelfareMore applications are required to improve the 60000000 Public Sectormarket 50000000 Bio-Industrial Market Size $1,000s Manufacturing 40000000• A lack of reusability keeps robot developers endlessly re-solving the same 30000000 software problems 20000000 10000000• Concentrating on the mechanics of 0 robotics rather than the science of robotics 1995 2000 2005 2010 2025 Year• Concurrency and complexity plague all software engineering and especially robotics * Source Japan Robotics Association• Development requires too much effort and knowledge
  5. 5. Robotics Market Potential Worldw ide Robotics Market Grow th 70000000 Home Mediacal/Welfare 60000000 Public Sector 50000000 Bio-Industrial Market Size $1,000s Manufacturing 40000000 30000000 20000000 10000000 0 1995 2000 2005 2010 2025 Year * Source Japan Robotics Association
  6. 6. 3 2 1 20 05 Real vacuum cleaner Filtering unnecessary Information Household Devices (Microwave, Fridge) 20 Robot with integrated Communication Capabilities1 07 Robot loading Dishwasher2 20 10 Tourguide3 Development Trend Robot adapting to individual Needs Gaming Robots Learning about new Environments by giving a Tour to it, after that it can re-give that tour. 20 Robot helping handicapped People 15 Increasing Software Challenges Ironing Robot Proactive Robots Robots understanding human Activities 20 20 24h Assistant Companion for elderly People* Source EURON Workshop 2005
  7. 7. Microsoft & Robotics Experience Groups Systems Microsoft Research • PC Ecosystem (desktop, web, • Enabling Technologies mobile, home) • Human Robot Interaction • XP, XP Embedded, CE (real-time) • Personal Robotics • Educational Robotics Development environment and tools • Programming Environments • Programming IDE Microsoft Robotics Groups • Debugging and Opmization • Microsoft Robotics Group Existing applicable Technologies Redmond • Center for Innovative Robotics • Speech SDK Carnegie Mellon University • Real-time Communications SDK • External Research Office • RFID SDK Cambridge
  8. 8. New RequirementsNew Requirements• Ultra Heterogeneity• Distributed environments• Dynamic Configuration• Context-Awareness• Personalization• Extensibility• Reliability• Security• Privacy protection• Usability• Autonomy• …Ubiquitous computing environments should be deployed incrementally• Living space is not a demonstration room• We like to replace existing objectsHow can software infrastructures help to decrease the complexities?
  9. 9. Challenges to AddressFuture Applications• Support & Care, Education, EntertainmentPersonal Robotics• Human-robotics Interaction• Mediator between digital/real world• Natural and affective interaction (speech, gestures, emotions) From nature to software modelsNew programming paradigms• Body inspired software architecture (Pisa)• Meta-programming models (Berlin, Stuttgart) What is needed that robots could be successfully integrated in our everyday life? What are key technical issues?
  10. 10. A typical first Approach• Build a (another) middleware• Abstract from the underlying hardware (HAL) > i.e. classes for sensors, actuators, and communication• Unique programming model Control Application > Can use every concept the runtime provides Robot API• Use the .NET CLR and API CLR Sensors and Actuators Controller
  11. 11. This wont always work!Things that work fine on a PC don’t scale down• Thread switches on a smart-phone or PDA are costly• Some hardware controller don’t support threads at all• Hardware not capable enough for a middleware (CPU, memory, battery, …)• Even though PDAs/Smartphones are fairly powerful, CF has some several restrictions (good for some reasons, but not for us)Now think of even smaller devices• Embedded controllers, wrist-watches, sensor networks, smart dust
  12. 12. VRDK – A Research Prototype• Building a compelling & engaging programmable environment• Innovative, very easy, flexible programming environment for Robot control applications• Accessible to non technical audience (children, nurse, elderly, machine operator)• Enables a ‘Path’ from very simple (beginner, child) to professional (using Visual Studio) Abstracting complexity on different levels Source Code Visual
  13. 13. Model-driven Development Approach Platform-independent Model of the Program Same programming model (VRDK Language) for different devices Transformation Transformation Platform-specific .NET .NET CF XYZ realization of the program Generation Generation Executable or interpreter Executable Executable Executable on target platform
  14. 14. VRDK API Structure Controller (e.g., fischertechnik) Actuators Sensors Analog Sensor Digital Sensor(e.g., Motors) (e.g., Heat Sensor) (e.g., Touch Sensor)
  15. 15. Full Tool Chain Code Generation VRDK Editor VS.NET Deploy and Run Deploy and Run The gentle Shortcut Target Devices
  16. 16. Demo
  17. 17. Domain Specific Language Visual N# Users can switch between• Domain-specific both notations graphical language• Extension of VRDK• Easy to design Code Translator N# • Domain-specific textual language • Easy to read and write C# / VB.NET • General purpose programming language • Don’t write code anymore
  18. 18. N# - A Textual Notation for Visual N#ambient MyAmbient @ Person where filter ($1.Company == „Microsoft Research“), filter($1.Location == „Cambridge"), filter($1.SecurityLevel > 2) { discover Lights @ Light where distance(a), filter($1.Color == „green"); process OnLampAdd @ l = Lights.Added { l.On(); } process OnLampRemove @ l = Lights.Removed { l.Off(); } a = 100;}
  19. 19. Demo
  20. 20. The Microsoft Robotics StudioA lightweight concurrency and services oriented runtime• Handling of sensory input and controlling actuators• Based on synchronous message passing• Decentralized System Services (DSS) facilitating tasks and basic services such as debugging, logging, monitoring, security, discovery, and data persistenceAuthoring/development tools• Visual programming editor• Simulation• Message debuggingTechnology libraries and basic algorithms• Code samples and documentation
  21. 21. Open PlatformSupported manufacturers• Robotics Connection Applications and tools• Mobile Robots• Coroware• KUKA• LEGO Authoring Tools• fischertechnik• Robosoft Visual Studio Technology libraries Robot models• WhiteBox Robotics Device services• Lynxmotions Runtime Environment (OEM, ISV, IRV)• Phidgets Robotic Application• iRobot Roomba• … Runtime• Community platforms
  22. 22. Development Model Application model Application Model • Build complex systems from smaller, simpler decentralized services Distribution Distribution model Model • Applications are a collection of distributed services • Discovery of functionality via contract and categories Programming • Self-organizing Model • Interaction via Messaging Programming model • Coordination of messages • No manual creation of threads, locks, semaphores
  23. 23. Robotics Studio Architecture Orchestration Orchestration Application Decentralized System Services Robotic Services Services Concurrency and Coordination Device Services Library Services Activation Discovery Robot Model Runtime Device 1 VisionServices Diagnostics Storage Vis/Sim Device 2 SLAM … … Terminal UX Messaging Transport Signal Processing SPL Hardware Abstraction Layer HAL
  24. 24. Layered and Distributed Application “Learns” and begins to favors specific behavioral characteristics. Interacts with the orchestration layer to achieve the favored patterns. Behavior Control Layer Defines and facilitates communication patterns that coordinate information processing amongst lower level services. Orchestration Layer Provides functionality abstraction, computational encapsulation, failure isolation, distributed and concurrent execution, via software services . Services Layer Executes algorithms that require near real-time computation and deterministic time control. Signal Processing Layer Directly interfaces with the physical robotics hardware - Sensors and Actuators. Hardware Abstraction Layer
  25. 25. Service Composition • Services aren’t just for devices • Services can be compose to form other services • Services can represent passive or non-existent devices > Fused sensory data can be re-exposed as an independent service Trajectory Drive Pose Motor Encoder Services Steering Servo Robot Model ServiceRobot Model Wheel Base Geometry
  26. 26. Runtime EnvironmentAn application is a composition of loosely-coupled services concurrently executing acrossscopes• Interactions described using service contacts• Components are networked• Provides isolation between components > Reliability – ability to restart independently, replaceable/updatable > Parallelism y UI un dar Main Port n Bo io icat A ppl Main Port Service Private Port Code State Main Port Service Main Port Code Main PortPrivate Port State Private Port Service Service Code Service Code State Code State State H/W H/W* Example: Model car + sensors
  27. 27. Communication & Coordination Port<int> p = new Port<int>();• Typed Ports ;• Messages sent to ports• Arbiter handle messages > Persistent > Batch > Choice > Join > … Activate ( Arbiter.CreateReceiver(false, p, delegate(int i) { Console.WriteLine(i) ; } ) );
  28. 28. Runtime Reliability• Reliability > Reservations > Guarantueed CPU bandwith• Number of fixed threads in dispatcher > Set during creation of dispatcher > Not using CLR threadpool > Less overhead• No Priorities for threads > Hard to persuade developer not to use priorities > So, priorities introduced for dispatcher• FIFO Ports > 90,000 SOAP messages/s within a node (=multiple services) > > 3,000 SOAP messages/s among nodes
  29. 29. Service Development vs. Application Development Runtime Environment Main Port Private Port Decentralized System Service Services Code Concurrency and Coordination State Runtime• Done only once• Driver related• Done by manufacturer• Distribute & reuse
  30. 30. Authoring EnvironmentStandalone & Visual StudiointegratedScales with programmer skill Visual Studio• Helps beginners with drag/drop programming IDE• Assists advanced developer with service orchestration Robot Package Robot Model Designer Code Generator• Conceptually consistent with conventional programming Tool Box Application Designer Debugging services languages Packages Visualization and• Context based toolbox Service Contract Designer SimulationSupport Rapid Application Deployment Designer Code DownloaderDevelopment via visualprogramming, simulation andvisualization.Supports programming ofdistributed scenariosExtensible to support otherhardware
  31. 31. Visual Programming LanguageRobots as first class objectsData flow and orchestration• Easy for novices• Rapid prototyping for experts Activity Message link Activity• Implicit parallelism• Generates C# code• Formal checking of protocol interactions• Deadlock detection, state exploration
  32. 32. Demo
  33. 33. Simulation Capabilities
  34. 34. Supported KUKA robot
  35. 35. Community: Robot Swarm Heading Target Area
  36. 36. Community: Robot Swarm Simulation
  37. 37. Community: Maze Simulator
  38. 38. Outlook• VRDK > Research prototype – not developed anymore• Microsoft Robotics Studio > Available as CTP (November CTP, today at 5.00 am) > Improved visualisation > Package based deployment > Wrap up for final version > CCR / DSS maybe available as separate DL >• N# > Ongoing research > Publications etc. > Visual Studio integration in progress
  39. 39. Thank you or your attention.