TULIPP: Bringing energy efficiency from chip level to system level
•Download as PPTX, PDF•
1 like•403 views
The Nottingham Trent University held the Smart Industry 4 Workshop from the 9 to 11 of January of 2019. The aim of the Smart Industry 4 Workshop is to present rigorous scientific advances accompanied by real-world applications in the areas of Industrial Digitisation, Robotics and Automation. In a smart industry, devices not only react to events through sensing, interpretation and service provision but also learn and adapt their operation and services over time. These embodiments employ contextual information when available, as well as offering unobtrusive and intuitive interfaces. Sundance delivered a 1h 30 minute hands-on workshop where researchers had the opportunity to test the new Sundance state-of-the-art VCS-1 that was specially designed for Robotic applications.
Recommended
Recommended
More Related Content
What's hot
Similar to TULIPP: Bringing energy efficiency from chip level to system level
Similar to TULIPP: Bringing energy efficiency from chip level to system level (20)
More from Sundance Multiprocessor Technology Ltd.
More from Sundance Multiprocessor Technology Ltd. (20)
Recently uploaded
Recently uploaded (20)
TULIPP: Bringing energy efficiency from chip level to system level
- 1. This project has received funding from the European Union’s Horizon 20 20 research and innovation programme under grant agreement No 688403 www.tulipp.eu TULIPP Title : Place : Date : Smart-4-Industry Workshop - NTU Towards Ubiquitous Low-power Image Processing Platform – Project Overview Nottingham, United Kingdom 11th of January 2019 Flemming CHRISTENSEN @ Sundance
- 2. What is TULIPP? Tulipp: Bringing energy efficiency from chip level to system level Intensive Image Processing Embedded Constraints Time-to-market / Cost- sensitive Source: http://www.lnci.org.au
- 3. The Reference Platform Processor IO Memory Component tools Operating System Toolchain CPU What is TULIPP? (the concept) Methodology to select the best suitable components for build power-efficient image-processing platforms
- 4. How we proceed WP7: Management, Coordination LABEL : Marketing, Ecosystem and Pre-normalisation WP6: IP protection, Dissemination, Communication, Advisory Board and Exploitation preparation WP1: Reference platform definition (Interfaces & implementation Rules) Instantiations WP2: Hardware WP4: Programming Toolchain WP3: Runtime, API, Libraries & OS feedback WP5 : Usecases description and Integration and platform validation
- 5. The Reference Platform in a book Methodology captured in a book + Guidelines to provide expert hints on common issues & valuable implementation clues
- 7. The Starter kit: how it works Goal-oriented Advice Instantiation Recommended Implementation Methods Project Applications Platform Instance
- 8. Focus on the TULIPP Starter-Kit • H/W based on Xilinx Zynq UltraScale+ • Power aware RT operating system • Toolchain support for efficient implementation • Sample applications • The TULIPP Handbook
- 9. A TULIPP hardware platform
- 10. The TULIPP Operating System: HIPPEROS
- 11. STHEM: The TULIPP Tool-chain Status: • Xilinx SDSoC has been extended to support the current platform • Support for HIPPEROS OS is underway Insights: • Significant effort has been invested into the development of vendor tools • STHEM fills the productivity gaps between existing tools Support uTilities for Heterogeneous Embedded image processing (STHEM) •Supports development for all platform components •Map source files of the application to the appropriate tool chain •Retrieve OS configuration from the developer Development and Mapping •Boot OS with selected configuration (if needed due to changed configuration) •Update files (binaries, bitfiles, etc.) •Initialise the reconfigurable logic (if needed) •Start the application with the requested instrumentation Runner •Analyses performance results and presents findings to the developer Analyser
- 12. The Generic Development Process Connect and abstract STHEM = Supporting uTilities for Heterogeneous Embedded image processing platforms Support for TULIPP platform instances
- 13. end product dependent Several Instances from same reference
- 14. Advanced Driver Assistance Systems • Pedestrian detection for collision avoidance • Based on Viola-Jones object detection • Operates on 640x480 24-bit images Original C/C++ code Adapted C/C++ code Accelerated on the Tulipp Platform (Xilinx ZU3) PC platform 150 W 10 s/frame 15 W 66 ms/frame
- 15. Unmanned Aerial Vehicle 𝐼left, 𝐼right Obstacle avoidance Disparity estimation 𝐷 Original C/C++ code Adapted C/C++ code Accelerated on the Tulipp Platform (Xilinx ZU3) 15 W 29 frame/s 29ms latency
- 16. UAV Demo
- 17. Medical Use Case Original C/C++ code Adapted C/C++ code Accelerated on the Tulipp Platform (Xilinx ZU3) 15 W 29 frame/s 29ms latency • X-ray video for surgery • Embedded on the sensor • Lower radiation doses by factor 4 • Image denoise & enhancement • 1024x1024 24-bit images sensor
- 18. Join the Handbook Effort Leave a legacy ! Take the Survey! http://bit.ly/Tulipp_Survey
Editor's Notes
- The team came up with the Tulipp concept to solve this equation
- Explain how we got from use case specific description (in WP5) to a more generic model (in WP1). This generic model is called the reference platform and is used by WP2+3+4 to produce instances that are then used by WP5 to check if it helps achieving the goal. The KPI mesurement tells WP1 how far we get to the needs.
- The reference handbook is used both to produce platform instances AND for application developeprs to develop efficient implementations on the selected platform.
- Introduce the Starter KIT which is then described in the presentation: - the reference handbook - the hardware platform - the operating system - the STEM tool chain