Creating Touchless HMIs Using Computer Vision for Gesture InteractionICS
Touchscreens are everywhere in public spaces, from grocery store express checkouts to airline check-in counters. As COVID-19 has made people hesitant to touch public surfaces, which can act as vectors for the virus, you may wish to embrace contactless user interfaces for your customer-facing products. In this engineering-focused webinar, we’ll offer technical insight on how to emulate the touch experience via computer vision and gesture technology, and explain best practices to incorporate AirTouch into multimodal interfaces.
Speed & Agility of Innovation with Docker & KubernetesICS
Docker and Kubernetes pave the way for running federated, scalable and redundant systems on the Cloud and on the Edge with the same technology. In this introductory webinar we will go over the history, fundamentals and usage of Docker and Kubernetes and present key takeaways for CTOs and developers. We'll also cover the key benefits of using this technology in both the development and deployment of Qt applications.
We'll discuss:
Short history Docker and Kubernetes
Why are containers suddenly so popular?
The benefits of using Docker with Qt applications
Kubernetes for the Cloud and for the Edge
Moving to containers and Kubernetes: How and Why
Leveraging Artificial Intelligence Processing on Edge DevicesICS
The introduction of low-cost, high-performance embedded processors coupled with improvements in Neural Network model optimization lay the foundation for AI and Computer Vision at the edge. Moving intelligence from the cloud to the edge offers many advantages including the reduction of network traffic, predicable ML inference times, and data security to name a few. Challenges exist as many development teams do not have data scientist or AI development engineers. What is needed are practical AI solutions including ML development tools, optimized inference engines and reference platforms that will abstract out the development complexities to stream line prototyping and development.
In this joint webinar with Au-Zone Technologies we will discuss:
- Development challenges and solutions which can be use to enable AI/ML at the edge to implement object detection, classification and tracking for medical and industrial use-cases
- Visualization techniques for activity monitoring and object detection
Loosely-Coupled Architecture - how to get rid of the domino effectRadosław Maziarka
Traditionally, while creating our system, you don't focus on creating our components separated from each other. As a result, one problem can lead you to the domino effect - the whole system stops working. How to counteract it?
"Loosely coupled architecture" is recognized as the main factor to create a highly-scalable system. It allows you to make changes in your application which won't effect on their other part. See yourself what are the criteria of this architecture to be able to introduce it to your solution from the very beginning.
Successful touch devices appear deceptively simple to the user. In reality, they’re highly complex and challenging to build. But GreenHouse by ICS is changing that.
GreenHouse is a smarter way to build embedded devices. Built on the popular Qt framework, GreenHouse eliminates much of the complexity associated with product development — delivering better results in substantially less time.
In this webinar, we’ll introduce you to GreenHouse by ICS and describe in detail its UX-focused approach and best-in-class layered software architecture. GreenHouse shrinks your product development risk while delivering high-quality software in less time and at lower cost than traditional development approaches. Find out how GreenHouse can support and empower your software team!
Improving User Experience with Ubiquitous QuickBootICS
In this webinar, we will introduce QuickBoot and show how it can solve slow cold boot times. You will: • Learn the difference from other fast boot techniques on Linux or Android devices. • Get technical details of QuickBoot. • See a demonstration of a real-world embedded application illustrating the boot time performance.
Driving Down Automotive Costs for Richer HMIs with Qt & i.MX RT1170Qt
Automotive HMI solutions traditionally require complicated hardware and extensive architecture to accomplish every goal. In the world of microcontrollers (MCU), we can create dedicated systems to fit the requirements together with richer and snappier graphical user interfaces (GUIs). This reduces development time, cost and also distributes specialized parts of the system into separate hardware units.
Join us to start creating richer UIs with specialized parts of the system with a dual-core architecture.
We will cover:
- An introduction to Qt for MCUs, Qt Quick Ultralite runtime
- APIs to accelerate your next scalable HMI application
- Challenges creating vehicle solutions and why NXP i.MX RT1170 MCUs
- Rapid prototyping embedded GUIs on the hardware
- Distribution of system responsibilities between two cores
- Handling CAN bus on secondary core and passing the data between two cores.
Attendees will find the final dual-core architecture design using Qt for MCUs running on NXP i.MX RT1170 for optimized speed and power consumption. Take a sneak peek!
Speakers:
Aurindam Jana, Product Director, The Qt Company
Marcin Lisowski, C++/Embedded Software Engineer, Siili_Auto
Creating Touchless HMIs Using Computer Vision for Gesture InteractionICS
Touchscreens are everywhere in public spaces, from grocery store express checkouts to airline check-in counters. As COVID-19 has made people hesitant to touch public surfaces, which can act as vectors for the virus, you may wish to embrace contactless user interfaces for your customer-facing products. In this engineering-focused webinar, we’ll offer technical insight on how to emulate the touch experience via computer vision and gesture technology, and explain best practices to incorporate AirTouch into multimodal interfaces.
Speed & Agility of Innovation with Docker & KubernetesICS
Docker and Kubernetes pave the way for running federated, scalable and redundant systems on the Cloud and on the Edge with the same technology. In this introductory webinar we will go over the history, fundamentals and usage of Docker and Kubernetes and present key takeaways for CTOs and developers. We'll also cover the key benefits of using this technology in both the development and deployment of Qt applications.
We'll discuss:
Short history Docker and Kubernetes
Why are containers suddenly so popular?
The benefits of using Docker with Qt applications
Kubernetes for the Cloud and for the Edge
Moving to containers and Kubernetes: How and Why
Leveraging Artificial Intelligence Processing on Edge DevicesICS
The introduction of low-cost, high-performance embedded processors coupled with improvements in Neural Network model optimization lay the foundation for AI and Computer Vision at the edge. Moving intelligence from the cloud to the edge offers many advantages including the reduction of network traffic, predicable ML inference times, and data security to name a few. Challenges exist as many development teams do not have data scientist or AI development engineers. What is needed are practical AI solutions including ML development tools, optimized inference engines and reference platforms that will abstract out the development complexities to stream line prototyping and development.
In this joint webinar with Au-Zone Technologies we will discuss:
- Development challenges and solutions which can be use to enable AI/ML at the edge to implement object detection, classification and tracking for medical and industrial use-cases
- Visualization techniques for activity monitoring and object detection
Loosely-Coupled Architecture - how to get rid of the domino effectRadosław Maziarka
Traditionally, while creating our system, you don't focus on creating our components separated from each other. As a result, one problem can lead you to the domino effect - the whole system stops working. How to counteract it?
"Loosely coupled architecture" is recognized as the main factor to create a highly-scalable system. It allows you to make changes in your application which won't effect on their other part. See yourself what are the criteria of this architecture to be able to introduce it to your solution from the very beginning.
Successful touch devices appear deceptively simple to the user. In reality, they’re highly complex and challenging to build. But GreenHouse by ICS is changing that.
GreenHouse is a smarter way to build embedded devices. Built on the popular Qt framework, GreenHouse eliminates much of the complexity associated with product development — delivering better results in substantially less time.
In this webinar, we’ll introduce you to GreenHouse by ICS and describe in detail its UX-focused approach and best-in-class layered software architecture. GreenHouse shrinks your product development risk while delivering high-quality software in less time and at lower cost than traditional development approaches. Find out how GreenHouse can support and empower your software team!
Improving User Experience with Ubiquitous QuickBootICS
In this webinar, we will introduce QuickBoot and show how it can solve slow cold boot times. You will: • Learn the difference from other fast boot techniques on Linux or Android devices. • Get technical details of QuickBoot. • See a demonstration of a real-world embedded application illustrating the boot time performance.
Driving Down Automotive Costs for Richer HMIs with Qt & i.MX RT1170Qt
Automotive HMI solutions traditionally require complicated hardware and extensive architecture to accomplish every goal. In the world of microcontrollers (MCU), we can create dedicated systems to fit the requirements together with richer and snappier graphical user interfaces (GUIs). This reduces development time, cost and also distributes specialized parts of the system into separate hardware units.
Join us to start creating richer UIs with specialized parts of the system with a dual-core architecture.
We will cover:
- An introduction to Qt for MCUs, Qt Quick Ultralite runtime
- APIs to accelerate your next scalable HMI application
- Challenges creating vehicle solutions and why NXP i.MX RT1170 MCUs
- Rapid prototyping embedded GUIs on the hardware
- Distribution of system responsibilities between two cores
- Handling CAN bus on secondary core and passing the data between two cores.
Attendees will find the final dual-core architecture design using Qt for MCUs running on NXP i.MX RT1170 for optimized speed and power consumption. Take a sneak peek!
Speakers:
Aurindam Jana, Product Director, The Qt Company
Marcin Lisowski, C++/Embedded Software Engineer, Siili_Auto
[Webinar] Automotive Media Management in Future IVI SystemsICS
The challenge for automotive IVI implementations is that most people’s media — their music, videos, audiobooks, podcasts and television — exist in a multitude of forms and originate from many disparate sources. In addition, as the nature of personal transportation is changing and ride-sharing is becoming more common, new requirements for infotainment emerge.
In this webinar, co-hosted with The Qt Company, we outline an architecture for automotive media management that addresses these challenges and we demonstrate a Qt based implementation.
Microcontrollers, or MCUs, are transforming consumer goods, industrial automation, infrastructure and more — essentially reshaping how we interact with the world around us. With MCUs you can easily control everything from your refrigerator to your thermostat. At ICS, a quarter of the projects we work on include at least one MCU and most projects incorporate several — so we understand the potential MCUs hold. We’ve designed this webinar to introduce you to this tiny technology and show how it can be implemented using various approaches.
Accelerate Time to Market by Pipelining UX with Development - Part 2ICS
In Part 2 of this 2 part webinar we share real-world success stories highlighting projects we’ve designed and built using a pipelining approach, as well as show you what it means to integrate pipelining into your own product development process.
Introduction to Qt cross-platform application and UI framework. Explaining what Qt does, some historical background, hybrid Internet Applications with Qt Webkit and the future with Qt Quick.
KDE Plasma in your pocket.
Presentation by Alexis Menard held during Bossa Conference 2010 in Manaus.
Read more at http://labs.trolltech.com/blogs/2010/02/28/tokamak-4-the-kde-plasma-meeting/
http://qt.nokia.com
http://www.bossaconference.indt.org/
For the full video of this presentation, please visit:
https://www.embedded-vision.com/platinum-members/embedded-vision-alliance/embedded-vision-training/videos/pages/sep-2019-alliance-vitf-cocoonhealth
For more information about embedded vision, please visit:
http://www.embedded-vision.com
Pavan Kumar, Co-founder and CTO of Cocoon Health (formerly Cocoon Cam), delivers the presentation "Edge/Cloud Tradeoffs and Scaling a Consumer Computer Vision Product" at the Embedded Vision Alliance's September 2019 Vision Industry and Technology Forum. Kumar explains how his company is evolving its use of edge and cloud vision computing in continuing to bring new capabilities to the product category of baby monitors.
Design and Optimize your code for high-performance with Intel® Advisor and I...Tyrone Systems
For all that we’re unable to attend or would like to recap our live webinar Unleash the Secrets of Performance Profiling with Intel® oneAPI Profiling Tools, all the resources you need are available to you!
Learn about locating and removing bottlenecks is an inherent challenge for every application developer. And it’s made more complex when porting an app to a new platform (say, from a CPU to a GPU). Developers must not only identify bottlenecks; they must figure out which parts of the code will benefit from offloading in the first place. This webinar will focus on how to do just that using two profiling tools from Intel: Intel® VTune Amplifier and Intel Advisor.
CE-4114, Screen Mirror, a unified screen mirroring solution that utilizes AMD...AMD Developer Central
Presentation CE-4114, Screen Mirror, a unified screen mirroring solution that utilizes AMD technologies such as DEM and VCE, by Nao Yoshikawa, at the AMD Developer Summit (APU13) November 11-13, 2013.
Whether you are an AI, HPC, IoT, Graphics, Networking or Media developer, visit the Intel Developer Zone today to access the latest software products, resources, training, and support. Test-drive the latest Intel hardware and software products on DevCloud, our online development sandbox, and use DevMesh, our online collaboration portal, to meet and work with other innovators and product leaders. Get started by joining the Intel Developer Community @ software.intel.com.
It’s surprisingly straightforward to migrate feature code from the CPU to the DSP – and determine the resulting benefits to the end application. In this session we’ll demonstrate Qualcomm® Hexagon™ SDK installation, code generation, profiling and execution of dynamic code modules on a Qualcomm® Snapdragon™ hardware target, and you’ll learn how to analyze the resulting performance benefits. Qualcomm Snapdragon and Qualcomm Hexagon are products of Qualcomm Technologies, Inc.
Learn more about Hexagon SDK: https://developer.qualcomm.com/hexagon
Watch this presentation on YouTube:
https://www.youtube.com/watch?v=x6mKEWLzJM0
Shipping Mobile Applications Using Qt for Symbianaccount inactive
Presentation by Espen Riskedal held during Bossa Conference 2010 in Manaus.
Read more at http://labs.trolltech.com/blogs/2010/03/08/hi-from-bossa-conference-and-bossatetrix/
http://qt.nokia.com
http://www.bossaconference.indt.org/
For the full video of this presentation, please visit:
https://www.edge-ai-vision.com/2020/03/opencv-past-present-and-future-a-presentation-from-opencv-org/
For more information about edge AI and vision, please visit:
http://www.edge-ai-vision.com
Gary Bradski, the President and CEO of OpenCV.org, delivers the presentation “OpenCV: Past, Present and Future” at the Edge AI and Vision Alliance’s March 2020 Vision Industry and Technology Forum. Bradski shares the latest developments in the OpenCV open source library for computer vision and deep learning applications, as well as where OpenCV is heading.
As artificial intelligence sweeps across the technology landscape, NVIDIA unveiled today at its annual GPU Technology Conference a series of new products and technologies focused on deep learning, virtual reality and self-driving cars.
Qt in depth - presentation for Symbian expo 2009Nokia
Comprehensive presentation about Qt with special focus on Symbian. Close to a training material so if you wanna know what Qt is, have a look at the ~150 slides.
Held in www.see2009.org/ 27.10.2009
The session combines live demos, how-to info and third-party presentations on how they’ve taken advantage of powerful audio capabilities in the Qualcomm® Snapdragon™ processor, a product of Qualcomm Technologies, Inc. Learn how to use hardware/software integration to provide pro-quality audio processing solutions customized for differentiated listening experiences.
View this presentation on YouTube: https://www.youtube.com/watch?v=bPrqdqUVyyw&list=PLxeazpXYyqtNm2EnCbfSzy7aKOkHjiaSi&index=18
Ernest Mueller, Karthik Gaekwad, and James Wickett, the Agile Admins (http://theagileadmin.com) delivered this presentation on what's hot in DevOps in 2015 for the BrightTALK Summit. The video is online at https://www.brighttalk.com/webcast/5742/154715
[2015/2016] Software systems engineering PRINCIPLESIvano Malavolta
This presentation is about a lecture I gave within the "Software systems and services" immigration course at the Gran Sasso Science Institute, L'Aquila (Italy): http://cs.gssi.infn.it/.
http://www.ivanomalavolta.com
[Webinar] Automotive Media Management in Future IVI SystemsICS
The challenge for automotive IVI implementations is that most people’s media — their music, videos, audiobooks, podcasts and television — exist in a multitude of forms and originate from many disparate sources. In addition, as the nature of personal transportation is changing and ride-sharing is becoming more common, new requirements for infotainment emerge.
In this webinar, co-hosted with The Qt Company, we outline an architecture for automotive media management that addresses these challenges and we demonstrate a Qt based implementation.
Microcontrollers, or MCUs, are transforming consumer goods, industrial automation, infrastructure and more — essentially reshaping how we interact with the world around us. With MCUs you can easily control everything from your refrigerator to your thermostat. At ICS, a quarter of the projects we work on include at least one MCU and most projects incorporate several — so we understand the potential MCUs hold. We’ve designed this webinar to introduce you to this tiny technology and show how it can be implemented using various approaches.
Accelerate Time to Market by Pipelining UX with Development - Part 2ICS
In Part 2 of this 2 part webinar we share real-world success stories highlighting projects we’ve designed and built using a pipelining approach, as well as show you what it means to integrate pipelining into your own product development process.
Introduction to Qt cross-platform application and UI framework. Explaining what Qt does, some historical background, hybrid Internet Applications with Qt Webkit and the future with Qt Quick.
KDE Plasma in your pocket.
Presentation by Alexis Menard held during Bossa Conference 2010 in Manaus.
Read more at http://labs.trolltech.com/blogs/2010/02/28/tokamak-4-the-kde-plasma-meeting/
http://qt.nokia.com
http://www.bossaconference.indt.org/
For the full video of this presentation, please visit:
https://www.embedded-vision.com/platinum-members/embedded-vision-alliance/embedded-vision-training/videos/pages/sep-2019-alliance-vitf-cocoonhealth
For more information about embedded vision, please visit:
http://www.embedded-vision.com
Pavan Kumar, Co-founder and CTO of Cocoon Health (formerly Cocoon Cam), delivers the presentation "Edge/Cloud Tradeoffs and Scaling a Consumer Computer Vision Product" at the Embedded Vision Alliance's September 2019 Vision Industry and Technology Forum. Kumar explains how his company is evolving its use of edge and cloud vision computing in continuing to bring new capabilities to the product category of baby monitors.
Design and Optimize your code for high-performance with Intel® Advisor and I...Tyrone Systems
For all that we’re unable to attend or would like to recap our live webinar Unleash the Secrets of Performance Profiling with Intel® oneAPI Profiling Tools, all the resources you need are available to you!
Learn about locating and removing bottlenecks is an inherent challenge for every application developer. And it’s made more complex when porting an app to a new platform (say, from a CPU to a GPU). Developers must not only identify bottlenecks; they must figure out which parts of the code will benefit from offloading in the first place. This webinar will focus on how to do just that using two profiling tools from Intel: Intel® VTune Amplifier and Intel Advisor.
CE-4114, Screen Mirror, a unified screen mirroring solution that utilizes AMD...AMD Developer Central
Presentation CE-4114, Screen Mirror, a unified screen mirroring solution that utilizes AMD technologies such as DEM and VCE, by Nao Yoshikawa, at the AMD Developer Summit (APU13) November 11-13, 2013.
Whether you are an AI, HPC, IoT, Graphics, Networking or Media developer, visit the Intel Developer Zone today to access the latest software products, resources, training, and support. Test-drive the latest Intel hardware and software products on DevCloud, our online development sandbox, and use DevMesh, our online collaboration portal, to meet and work with other innovators and product leaders. Get started by joining the Intel Developer Community @ software.intel.com.
It’s surprisingly straightforward to migrate feature code from the CPU to the DSP – and determine the resulting benefits to the end application. In this session we’ll demonstrate Qualcomm® Hexagon™ SDK installation, code generation, profiling and execution of dynamic code modules on a Qualcomm® Snapdragon™ hardware target, and you’ll learn how to analyze the resulting performance benefits. Qualcomm Snapdragon and Qualcomm Hexagon are products of Qualcomm Technologies, Inc.
Learn more about Hexagon SDK: https://developer.qualcomm.com/hexagon
Watch this presentation on YouTube:
https://www.youtube.com/watch?v=x6mKEWLzJM0
Shipping Mobile Applications Using Qt for Symbianaccount inactive
Presentation by Espen Riskedal held during Bossa Conference 2010 in Manaus.
Read more at http://labs.trolltech.com/blogs/2010/03/08/hi-from-bossa-conference-and-bossatetrix/
http://qt.nokia.com
http://www.bossaconference.indt.org/
For the full video of this presentation, please visit:
https://www.edge-ai-vision.com/2020/03/opencv-past-present-and-future-a-presentation-from-opencv-org/
For more information about edge AI and vision, please visit:
http://www.edge-ai-vision.com
Gary Bradski, the President and CEO of OpenCV.org, delivers the presentation “OpenCV: Past, Present and Future” at the Edge AI and Vision Alliance’s March 2020 Vision Industry and Technology Forum. Bradski shares the latest developments in the OpenCV open source library for computer vision and deep learning applications, as well as where OpenCV is heading.
As artificial intelligence sweeps across the technology landscape, NVIDIA unveiled today at its annual GPU Technology Conference a series of new products and technologies focused on deep learning, virtual reality and self-driving cars.
Qt in depth - presentation for Symbian expo 2009Nokia
Comprehensive presentation about Qt with special focus on Symbian. Close to a training material so if you wanna know what Qt is, have a look at the ~150 slides.
Held in www.see2009.org/ 27.10.2009
The session combines live demos, how-to info and third-party presentations on how they’ve taken advantage of powerful audio capabilities in the Qualcomm® Snapdragon™ processor, a product of Qualcomm Technologies, Inc. Learn how to use hardware/software integration to provide pro-quality audio processing solutions customized for differentiated listening experiences.
View this presentation on YouTube: https://www.youtube.com/watch?v=bPrqdqUVyyw&list=PLxeazpXYyqtNm2EnCbfSzy7aKOkHjiaSi&index=18
Ernest Mueller, Karthik Gaekwad, and James Wickett, the Agile Admins (http://theagileadmin.com) delivered this presentation on what's hot in DevOps in 2015 for the BrightTALK Summit. The video is online at https://www.brighttalk.com/webcast/5742/154715
[2015/2016] Software systems engineering PRINCIPLESIvano Malavolta
This presentation is about a lecture I gave within the "Software systems and services" immigration course at the Gran Sasso Science Institute, L'Aquila (Italy): http://cs.gssi.infn.it/.
http://www.ivanomalavolta.com
Introduction to Microservices Architecture - SECCOMP 2020Rodrigo Antonialli
This presentation gives an high-level overview of what is a Microservices Architecture, as a summary from well-known sources about the topic regarding it's characteristics, advantages and challenges, along with some enabling technologies.
Following topics will be addressed into presentation:
Motivation and goals of splitting monolith application
Criteria and markers to start splitting process. Is it necessary at all?
Optimal order of extracting microservices
How organize the whole process in closed iterative steps?
What can be done with common libraries and shared code?
Options for technology and deployment of target microservices
How organize and motivate the teams and convince management?
Speaker Bio
Andrei is a Software Architect in VMWare Tanzu Labs. The areas of his interest are REST API design, Microservices, Cloud, resilient distributed systems, security and agile development. Andrei is PMC and committer of Apache CXF and committer of Syncope projects.
Presentazione dello speech tenuto da Carmine Spagnuolo (Postdoctoral Research Fellow - Università degli Studi di Salerno/ ACT OR) dal titolo "Technology insights: Decision Science Platform", durante il Decision Science Forum 2019, il più importante evento italiano sulla Scienza delle Decisioni.
Data Science in Production: Technologies That Drive Adoption of Data Science ...Nir Yungster
Critical to a data science team’s ability to drive impact is its effectiveness in incorporating its solutions into new or existing products. When collaborating with other engineering teams, and especially when solutions must operate at scale, technological choices can be critical factors in determining what type of outcome you'll have. We walk through strategies and specific technologies - Airflow, Docker, Kubernetes - that can help promote successful collaboration between data science and engineering.
The talk was given at OReilly Strata Data Conference September 2018 in NYC
All the conferences and thought leaders have been painting a vision of the businesses of the future being powered by data, but if we’re honest with ourselves, the vast majority of our massive data science investments are being deployed to PowerPoint or maybe a business dashboard. Productionizing your machine learning (ML) portfolio is the next big step on the path to ROI from AI.
You probably started out years ago on a “big data” initiative: You collected and cleaned your data and built data warehouses, and when those filled up you upgraded to data lakes. You hired data engineers and data scientists, and around the organization, everyone brushed up their SQL querying skills and got some licenses to Tableau and PowerBI.
Then you saw what Google, Uber, Facebook, and Amazon were doing with machine learning to automate business processes and customer interactions. To not get broadsided, you hired more data scientists and machine learning engineers. They were put on your teams and started using your big data investments to train models. But what you probably found is that your tech stack and DevOps processes don’t fit ML models. Unlike most of your systems, ML models require short spikes of massive compute; they are often written in different languages than your core code; they need different hardware to perform well; one model probably has applications across many teams; and the people making the models often don’t have the engineering experience to write production code but need to iterate faster than traditional engineers. Expecting your engineering and DevOps teams to deploy ML models well is like showing up to Seaworld with a giraffe since they are already handling large mammals.
There is a path forward. Almost five years ago Algorithmia launched a marketplace for models, functions, and algorithms. Today 65,000 developers are on the platform deploying 4,500 models—the result has been a layer of tools and best practices to make deploying ML models frictionless, scalable, and low maintenance. The company refers to it as the “AI layer.”
Drawing on this experience, Diego Oppenheimer covers the strategic and technical hurdles each company must overcome and the best practices developed while deploying over 4,000 ML models for 70,000 engineers.
Topics include:
Best practices for your organization
Continuous model deployment
Varying languages (Your code base probably isn’t in Python or R, but your ML models probably are.)
Managing your portfolio of ML models
Standardize versioning
Enabling models across your organization
Analytics on how and where models are being used
Maintaining auditability
Edge can be divided into the Device Edge and the Infrastructure Edge. This presentation discusses how to leverage the Infrastructure edge in modern software architecture.
Microservices as an evolutionary architecture: lessons learnedLuram Archanjo
Over the years the architecture of microservices has been widely adopted, since it provides numerous advantages such as: technological heterogeneity, scalability, decoupling and so on.
In this sense the microservices architecture meets the definitions of an evolutionary architecture, that is, an architecture designed for incremental changes even changes of languages.
In this lecture, we will discuss the decisions to adopt frameworks and techniques such as: Spring, Vert.x, gRPC, Event-driven Architecture in an architecture for a payment medium solution in which throughput and response time is crucial for the survival of the business .
Develop, deploy, and operate services at reddit scale oscon 2018Gregory Taylor
The last few years have been a period of tremendous growth for Reddit. Process, tooling, and culture have all had to adapt to an organization that has tripled in size and ambition. Greg Taylor discusses Reddit's evolution and explains how one of the world’s busiest sites develops, deploys, and operates services at significant scale.
Presented at OSCON 2018 in Portland, Oregon
Service oriented space-infrastructures_brown_university_2014_lisiMarco Lisi
My presentation "From Systems to Services: Creating a Service-oriented, Space-Based Infrastructure" during the Space Horizons 2014 Workshop at Brown University.
Kubernetes, Toolbox to fail or succeed for beginners - Demi Ben-Ari, VP R&D @...Demi Ben-Ari
Talk that specifies the history and the reasons to start using Kubernetes and implementing a microservices architecture. Talking about Docker, Kubernetes basic terms and some of the pitfalls that you can get too while implementing it.
Also mentioning the use case of Panorays.
Docker microservices and the service meshDocker, Inc.
The nature of containerized, cloud-native applications is rapidly advancing with a fundamentally different architecture that will rely on service meshes with smarter proxies, traffic management, and enhanced observability for cooperating microservices, serverless functions, and complex workflows. In this session we will highlight the features that characterize this architectural transformation in the Docker cloud-native ecosystem.
Introducing Usability Concerns Early in the DSL Development Cycle: FlowSL Ex...Ankica Barisic
Domain-Specific Languages (DSLs) developers aim to narrow the gap between the level of abstraction used by domain users and the one provided by the DSL, in order to help taming the increased complexity of computer systems and real-world problems. The quality in use of a DSL is essential for its successful adoption. We illustrate how a usability evaluation process can be weaved into the development process of a concrete DSL - FlowSL - used for specifying humanitarian campaign processes lead by an international Non-Governmental Organization. FlowSL is being developed following an agile process using Model-Driven Development (MDD) tools, to cope with vague and poorly understood requirements at the beginning of the development process.
Bridging the Gap: from Data Science to ProductionFlorian Wilhelm
A recent but quite common observation in industry is that although there is an overall high adoption of data science, many companies struggle to get it into production. Huge teams of well-payed data scientists often present one fancy model after the other to their managers but their proof of concepts never manifest into something business relevant. The frustration grows on both sides, managers and data scientists.
In my talk I elaborate on the many reasons why data science to production is such a hard nut to crack. I start with a taxonomy of data use cases in order to easier assess technical requirements. Based thereon, my focus lies on overcoming the two-language-problem which is Python/R loved by data scientists vs. the enterprise-established Java/Scala. From my project experiences I present three different solutions, namely 1) migrating to a single language, 2) reimplementation and 3) usage of a framework. The advantages and disadvantages of each approach is presented and general advices based on the introduced taxonomy is given.
Additionally, my talk also addresses organisational as well as problems in quality assurance and deployment. Best practices and further references are presented on a high-level in order to cover all facets of data science to production.
With my talk I hope to convey the message that breakdowns on the road from data science to production are rather the rule than the exception, so you are not alone. At the end of my talk, you will have a better understanding of why your team and you are struggling and what to do about it.
How to Choose an Integration Platform Vendor for Your BusinessWSO2
Learn about the key aspects that need to be considered when selecting an integration platform for your business regardless of the business domain you are in.
Similar to Leveraging Open Standards to Build Highly Extensible Autonomous Systems (20)
A Deep Dive into Secure Product Development Frameworks.pdfICS
We tackle the question of what is a SPDF for medical device cybersecurity. We look to provide actionable advice that clarifies implementation, and you can apply in your day-to-day tasks.
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
A great deal of attention in medical devices has shifted towards cybersecurity with the ratification of section 524B of the FD&C act. This new law enables the FDA to enforce cybersecurity controls in any medical device that is capable of networked communications or that has software. In this webinar we will recap the process for managing vulnerabilities, identify categories of vulnerabilities and solutions and more.
Practical Advice for FDA’s 510(k) Requirements.pdfICS
Don’t miss this important webinar with partners BG Networks and Trustonic, which serves as a roadmap for medical device manufacturers to navigate the complex landscape of FDA requirements and implement effective cybersecurity measures.
Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...ICS
Join us for a detailed look at how ICS used its rapid, low-code development toolkit, Greenhouse by ICS, to help Miller Electric create a new industrial welding product on a short timeline. In this webinar, we’ll cover Miller Electric’s vision for the product and the pressure of their looming deadline. And we’ll explore the facets of Greenhouse, which includes everything needed to quickly build a quality touch device.
CMake is an open-source, cross-platform family of tools designed to build, test and package software. It is intended to be used in conjunction with the native build environment, which differentiates CMake from many cross-platform systems. CMake is widely used because it allows developers to more easily create, tailor and test software by simplifying some of the most challenging aspects of the process, including system introspection and executing complex builds.
While building with CMake can be fun and rewarding, you may encounter a few obstacles along your path that stall your progress. This webinar will teach you how to interpret CMake errors and explore some of the most common configuration issues you may encounter when trying to build a CMake project. We’ll deliver actionable troubleshooting tips to help you overcome, even avoid, these obstacles.
Enhancing Quality and Test in Medical Device Design - Part 2.pdfICS
Join us for the second installment of our webinar series, during which we explore the interesting and controversial aspects of quality and test solutions used in engineering for medical devices.
In this session, we'll weigh the pros, cons, motivations and alternatives for the canonical forms of software tests.
We'll also differentiate Medical Device Verification from other forms of testing to ensure you don't pay twice for the same result. And, we'll discuss how the concept of "reliability" in medical devices has evolved for software, and how "durability" might have more value.
If you’re developing medical devices and are trying to improve the value and efficacy of your quality budget, this session is a can't-miss!
Designing and Managing IoT Devices for Rapid Deployment - Webinar.pdfICS
The Internet of Things (IoT) is revolutionizing the way we interact with the world, from smart homes to industrial automation to life-saving medical devices. However, the design and deployment of a fleet of IoT devices is a complex process. In this webinar, we will discuss best practices for designing IoT devices for rapid deployment and how to streamline fleet management at scale.
We will provide insight on when it’s right to build your own custom system versus investing in a fleet management platform as well as look at some of the key features of the platforms available and a live demo of Balena’s solution.
Quality and Test in Medical Device Design - Part 1.pdfICS
In this webinar we will scrutinize quality and test solutions used in engineering for medical devices. With a focus on practical application and balancing the tradeoffs when using mainstream tools, we'll provide you with actionable information to optimize your approach to quality and testing in your medical devices.
Creating Digital Twins Using Rapid Development Techniques.pdfICS
In this webinar, we will walk you through ICS’ well-defined process for quickly creating medical device digital twins, including exploring the benefits of a layered architecture approach and examining appropriate use cases for our rapid development technique.
Secure Your Medical Devices From the Ground Up ICS
The Food and Drug Administration (FDA) has recently released new guidance on cybersecurity for medical devices. This presentation will provide an overview of this guidance and review what is required for 510(k) submissions. We will also discuss the upcoming European Union (EU) cybersecurity regulations and how they compare to the FDA guidance.
This webinar with ICS and partner RTI, the largest software framework company for autonomous systems, will focus on threat modeling and cybersecurity risk assessments in light of the new guidance, and how these activities impact design requirements for medical devices. You will learn common pitfalls and mistakes to avoid when establishing organizational best practices in cybersecurity.
We will also discuss the challenges to securing data in motion for connected medical devices and describe how a data-centric software framework based on open standards, addresses the design requirements for highly reliable, scalable and secure systems.
Attendees will gain an understanding of the current regulatory expectations, best practices for cybersecurity risk assessments, and standards-based solutions for secure data connectivity.
Cybersecurity and Software Updates in Medical Devices.pdfICS
Justin is a Senior Consulting Engineer and Qt Certified Instructor at Integrated Computer Solutions, Inc. (ICS). He has taught Qt and Qt Quick/QML material for both public and on-site courses for many years. He has also written and conducted seminars on Object-Oriented GUI Design techniques. Justin earned his bachelor’s degree in Computer Engineering Technology from Northeastern University.
MDG Panel - Creating Expert Level GUIs for Complex Medical DevicesICS
Graphical User Interfaces are so pervasive and have so many different design intents that it can be hard to see the norms and evolution of norms being applied over the past couple of decades. In medical devices, more than most, tradeoffs between safety, effectiveness and pleasure-to-use, dominate the design efforts.
.
Much focus and debate has been applied to paradigms of “simple yet effective” in GUI design. The most commonly cited ideals in the Apple eco-system and skeuomorphic design concern themselves with the novice user and technology adoption. But not all products are designed for the novice user.
.
For UIs that expose advanced or unstructured feature sets to the user, the normative approach has been to compromise on the simplicity to extend the functionality. But such an approach can be incremental and muddled where a better approach might be cogent redesign.
.
We will explore the evolution of a life-saving lung transplant medical device from Tevosol that implements an expert-level GUI for clinical users. Focus will be on lessons learned and the design principles ultimately chosen.
How to Craft a Winning IOT Device Management SolutionICS
Join Jose Neto, Lead Cloud Architect for ICS, who will help inform your journey to understand IoT device fleet management, how it can benefit your organization and how you can identify the best solution.
Bridging the Gap Between Development and Regulatory TeamsICS
Download for this webinar for medical device professionals hosted by DeviceTalks Tuesday and hear a frank depiction of the collision of regulatory and development practices, and how to focus on remedies in the form of processes, tools, and approaches, that bridge the gap between the two.
IoT Device Fleet Management: Create a Robust Solution with AzureICS
This webinar, presented by ICS’ fleet management and cloud experts, will give you a better understanding of Azure, which allows you to connect, monitor and control your IoT assets. We’ll explore the Visual Studio code environment, integration plugins, modular design with containerization, device provisioning and critical aspects of IoT device security.
Are you a QMake user who has not yet familiarized yourself with CMake? If so, this webinar is for you — it’s aimed at anyone using QMake who wants to learn more about CMake and the pros and cons of each. We will:
Provide an introduction to CMake
Discuss the differences in the two build systems and the benefits of using one over the other
Set up a basic project and review some of the potential issues you may run into when starting your new project in CMake or converting from existing QMake projects
Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...ICS
Updating device software has always been a complicated process. Today, widespread use of connected IoT device fleets, along with escalating concern over cybersecurity, has made that process even more complex. Fortunately, there are a number of well-established open source solutions to help you address software update needs. But, with so many options, how do you determine which solution is right for your device?
This webinar will provide the foundation you need to make an informed decision. We’ll examine several different industry approaches, including A/B updates with a dual-redundant scheme, delta updates, container-based updates and combined strategies, as well as the leading technologies that support these approaches. Open source technologies such as Mender, RAUC and libostree-based solutions implement these strategies and provide tools to manage updates of multiple devices.
We’ll also review a variety of open source Linux software update technologies, and offer practical examples for integrating them using the Yocto Project and OpenEmbedded. In order to help you better understand the strengths and weaknesses of each technology, we’ll deep dive into various real-world use cases, including leveraging CAAM (Cryptographic Accelerator and Assurance Module) hardware on Freescale i.MX6 hardware for encrypted and signed updates and using Microsoft Azure IoT to host software updates from the cloud.
This upcoming webinar will explore functions that assist developers in both packaging and deploying their Qt applications on the desktop. We will present the Qt Installer Framework and the Qt Desktop deployment tools as well as ways to customize an installer and tools that keep your Qt application continuously updated online.
We will also expand on the subject with a concrete example and illustrate the ease of use of CPack, presenting common tricks to debug, customize both an offline and online installer, ensure that we provide an adequate uninstaller and write to Windows Registry.
Bridging the Gap Between Development and Regulatory TeamsICS
This webinar provides a frank depiction on the collision of regulatory and development practices, and focuses on remedies in the form of processes, tools and approaches, that bridge the gap between the two.
Overcome Hardware And Software Challenges - Medical Device Case StudyICS
In this webinar presented with leading System-on-Module designer and ICS partner Variscite, we will present a real example of a medical device featuring the DART-MX8M-PLUS, i.MX8 Plus-based System on Module. Walking through this case study will allow us to showcase specific challenges that characterize the medical field as well as common software challenges.
As a webinar attendee, you will:
Gain tools that will help you choose the hardware that best suits your project needs.
Receive useful software tips that will help you get your project off the ground.
Accelerate Enterprise Software Engineering with PlatformlessWSO2
Key takeaways:
Challenges of building platforms and the benefits of platformless.
Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience.
How Choreo enables the platformless experience.
How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo.
Demo of an end-to-end app built and deployed on Choreo.
Unleash Unlimited Potential with One-Time Purchase
BoxLang is more than just a language; it's a community. By choosing a Visionary License, you're not just investing in your success, you're actively contributing to the ongoing development and support of BoxLang.
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Anthony Dahanne
Les Buildpacks existent depuis plus de 10 ans ! D’abord, ils étaient utilisés pour détecter et construire une application avant de la déployer sur certains PaaS. Ensuite, nous avons pu créer des images Docker (OCI) avec leur dernière génération, les Cloud Native Buildpacks (CNCF en incubation). Sont-ils une bonne alternative au Dockerfile ? Que sont les buildpacks Paketo ? Quelles communautés les soutiennent et comment ?
Venez le découvrir lors de cette session ignite
Code reviews are vital for ensuring good code quality. They serve as one of our last lines of defense against bugs and subpar code reaching production.
Yet, they often turn into annoying tasks riddled with frustration, hostility, unclear feedback and lack of standards. How can we improve this crucial process?
In this session we will cover:
- The Art of Effective Code Reviews
- Streamlining the Review Process
- Elevating Reviews with Automated Tools
By the end of this presentation, you'll have the knowledge on how to organize and improve your code review proces
Check out the webinar slides to learn more about how XfilesPro transforms Salesforce document management by leveraging its world-class applications. For more details, please connect with sales@xfilespro.com
If you want to watch the on-demand webinar, please click here: https://www.xfilespro.com/webinars/salesforce-document-management-2-0-smarter-faster-better/
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Shahin Sheidaei
Games are powerful teaching tools, fostering hands-on engagement and fun. But they require careful consideration to succeed. Join me to explore factors in running and selecting games, ensuring they serve as effective teaching tools. Learn to maintain focus on learning objectives while playing, and how to measure the ROI of gaming in education. Discover strategies for pitching gaming to leadership. This session offers insights, tips, and examples for coaches, team leads, and enterprise leaders seeking to teach from simple to complex concepts.
Software Engineering, Software Consulting, Tech Lead.
Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Security,
Spring Transaction, Spring MVC,
Log4j, REST/SOAP WEB-SERVICES.
Developing Distributed High-performance Computing Capabilities of an Open Sci...Globus
COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among public health practitioners, mathematical modelers, and scientific computing specialists, while revealing critical gaps in exploiting advanced computing systems to support urgent decision making. Informed by our team’s work in applying high-performance computing in support of public health decision makers during the COVID-19 pandemic, we present how Globus technologies are enabling the development of an open science platform for robust epidemic analysis, with the goal of collaborative, secure, distributed, on-demand, and fast time-to-solution analyses to support public health.
How to Position Your Globus Data Portal for Success Ten Good PracticesGlobus
Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.
We describe the deployment and use of Globus Compute for remote computation. This content is aimed at researchers who wish to compute on remote resources using a unified programming interface, as well as system administrators who will deploy and operate Globus Compute services on their research computing infrastructure.
Cyaniclab : Software Development Agency Portfolio.pdfCyanic lab
CyanicLab, an offshore custom software development company based in Sweden,India, Finland, is your go-to partner for startup development and innovative web design solutions. Our expert team specializes in crafting cutting-edge software tailored to meet the unique needs of startups and established enterprises alike. From conceptualization to execution, we offer comprehensive services including web and mobile app development, UI/UX design, and ongoing software maintenance. Ready to elevate your business? Contact CyanicLab today and let us propel your vision to success with our top-notch IT solutions.
A Comprehensive Look at Generative AI in Retail App Testing.pdfkalichargn70th171
Traditional software testing methods are being challenged in retail, where customer expectations and technological advancements continually shape the landscape. Enter generative AI—a transformative subset of artificial intelligence technologies poised to revolutionize software testing.
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...informapgpstrackings
Keep tabs on your field staff effortlessly with Informap Technology Centre LLC. Real-time tracking, task assignment, and smart features for efficient management. Request a live demo today!
For more details, visit us : https://informapuae.com/field-staff-tracking/
Large Language Models and the End of ProgrammingMatt Welsh
Talk by Matt Welsh at Craft Conference 2024 on the impact that Large Language Models will have on the future of software development. In this talk, I discuss the ways in which LLMs will impact the software industry, from replacing human software developers with AI, to replacing conventional software with models that perform reasoning, computation, and problem-solving.
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfJay Das
With the advent of artificial intelligence or AI tools, project management processes are undergoing a transformative shift. By using tools like ChatGPT, and Bard organizations can empower their leaders and managers to plan, execute, and monitor projects more effectively.
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteGoogle
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
👉👉 Click Here To Get More Info 👇👇
https://sumonreview.com/ai-pilot-review/
AI Pilot Review: Key Features
✅Deploy AI expert bots in Any Niche With Just A Click
✅With one keyword, generate complete funnels, websites, landing pages, and more.
✅More than 85 AI features are included in the AI pilot.
✅No setup or configuration; use your voice (like Siri) to do whatever you want.
✅You Can Use AI Pilot To Create your version of AI Pilot And Charge People For It…
✅ZERO Manual Work With AI Pilot. Never write, Design, Or Code Again.
✅ZERO Limits On Features Or Usages
✅Use Our AI-powered Traffic To Get Hundreds Of Customers
✅No Complicated Setup: Get Up And Running In 2 Minutes
✅99.99% Up-Time Guaranteed
✅30 Days Money-Back Guarantee
✅ZERO Upfront Cost
See My Other Reviews Article:
(1) TubeTrivia AI Review: https://sumonreview.com/tubetrivia-ai-review
(2) SocioWave Review: https://sumonreview.com/sociowave-review
(3) AI Partner & Profit Review: https://sumonreview.com/ai-partner-profit-review
(4) AI Ebook Suite Review: https://sumonreview.com/ai-ebook-suite-review
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus
As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.
3. The Problem
Technology in the field of marine robotics is currently extremely fragmented.
Unlike in many other fields of robotics, such as unmanned aerial and ground
systems, there are few, if any, vehicle platforms, software frameworks, and
commonly used standards upon which to build.
The result?
● Excessive reinventing of the wheel
● “Build it from scratch” or “Settle for less” decision-making
● Higher development costs and barriers to entry
● Products and systems that do not interoperate
● Slower pace of innovation and a 10-20 year lag behind similar fields
3
4. Our Team
Highly cross-functional with extensive experience in marine, aerospace, and ground systems
4
Brian Grau
CEO
Mechanical Engineer and
production specialist who
has been building and
shipping ROV systems
around the world for the
last ten years.
Charles Cross
CTO
Walt Holm
Director of Engineering
Software Engineer
specializing in robotics with
an emphasis on creating
modular, extensible, and
connected systems.
Electrical Engineer with a
diverse background solving
instrumentation challenges
in aerospace, marine, and
medical fields.
John Clauss
Operations
Lifetime of marine
operations experience,
including extensive
archaeological work,
particularly in the Lake
Tahoe area.
5. The Mission
Unify and Expand Marine Technology
Interoperability and extensibility can be achieved through the use of open standards and the creation of electronics and software
solutions that are inherently designed with these goals in mind.
Empower Domain Experts, Fuel Innovation
We want companies and individuals to spend their time answering important questions and solving unique problems, not fighting with
their tools or otherwise having to waste their time and talent solving previously solved problems.
Remove Distance as a Barrier
By leveraging advances in both autonomy and connectivity, we seek to move past the traditional models of one-to-one and
many-to-one operations, instead opting for a future where one operator can direct many systems, even those halfway around the
world.
5
6. ROV and AUV Systems as a Case-Study
ROV (Remotely Operated Vehicle):
● Traditional name within the industry for what you might call a manually piloted underwater drone
● Many size-classes and specifications, from backpackable observation-class to ship-bound work-class
● Within the last 10 years, great strides in the creation of low-cost vehicles (under $10K)
AUV (Autonomous Underwater Vehicle):
● Often long, torpedo-shaped, in form factor
● Typically used for long range surveys
● Generally expensive, with few “low-cost” solutions
6
Riptide™ AUV WHOI’s REMUS AUV
Trident™ Underwater Drone Customized BlueROV™ WHOI’s Jason ROV
7. Past Lessons Learned
Over time, one of the biggest lessons learned working in this space is that there is
no one-size-fits-all solution when it comes to the many tasks that underwater
vehicles perform.
For any particular job you may need:
● A different vehicle type (ROV vs AUV)
● A different thruster configuration/vehicle layout
● Different actuator and sensor payloads
● Tethered vs untethered system
● Operation in turbid vs clear water
● Large carrying/lifting capacity
● Zero to many cameras arranged in various ways
● Hot-swappable power/batteries or power-from-topside
● Etc...
7
8. Who are the Users?
Three customer segments that we are working to serve:
● Developers
● Create novel technology and focus on innovation
● New vehicle concepts
● New sensor, actuator, and communication products
● New software capabilities (computer vision, ML, etc)
● Target specific problem domains (i.e. coral reef restoration, seafloor mapping, etc.)
● System Integrators
● Integrate existing off-the-shelf products into bespoke, ready-to-go vehicles
● Often target specific customers, industries, and geographic regions
● Understand their needs very well!
● Are often not in the business of electronics or software development
● End-Users
● Own and/or use the end vehicle/robot to perform a task or service (inspection, salvage, etc.)
● Likely to extend and upgrade their systems by purchasing COTS products
8
9. “How do I…”
Both in our discussions with customers and potential customers, as well within
popular forums and communities, we hear often hear the same questions posed:
“How do I…”
● … add more cameras?
● … add a new sensor/actuator to the vehicle?
● … create a new sensor/actuator that can be integrated?
● … deploy custom software to the vehicle?
● … modify the pilot application to do or show X?
● … synchronize the recorded data in time?
● … use a different microcontroller/embedded computer?
● … display data on multiple monitors and machines?
● … communicate with the MCU from the app processor?
● … control X programmatically?
9
10. Some Underlying Causes
Some of the reasons these questions come up time and again include…
● Lack of shared comm/API standards across the ecosystem
● Historical constraints and limitations from project origins
● Extensibility and developer friendliness are not core user stories
● Existing solutions are designed around manual 1-to-1 operations
● Communication and power distribution underwater is tough
Unfortunately, the answer users often get back is:
“Everything is open source, so you should be able to read and modify it to suit your needs”
There is no consistent, general approach to adding new capabilities, because the systems are not
modular or flexible enough. Also, though open source, there is a steep learning curve!
10
11. Where does that leave us?
The results of these issues include...
● Vendors creating walled gardens
● “All of our products work together”
● Often black boxed and still provide no path for user development
● Higher cost tier
● Adopters of open source stacks trudging forward
● Hacks and workarounds to extend and improve systems
● Reqs and conventions of non-marine systems a lasting constraint
● Improvements outside the conventions cannot be upstreamed
● Technology becoming fragmented
● Everyone develops in isolation, taping systems together orthogonally
● Ex. Sonar systems communicating over entirely separate lines with different apps
11
12. A Path Forward
We believe that one of the most effective solutions to the aforementioned issues
is to adopt open standards and frameworks that have become common across
the rest of the robotics industry.
12
● DDS (Data Distribution Service)
● An open middleware standard for real-time, publish-subscribe,
peer-to-peer communication.
● ROS2 (Robot Operating System)
● From ros.org: “...a flexible framework for writing robot
software. It is a collection of tools, libraries, and conventions
that aim to simplify the task of creating complex and robust
robot behavior across a wide variety of robotic platforms.”
● Built on top of DDS
13. DDS Quick Summary
● Completely peer-to-peer
● No server/broker required for communication between applications/machines
● Supports dynamic discovery of peers within a system/network (no need to specify endpoints!)
● Topic-oriented communication
● A topic consists of a name and a type description
● Datawriters publish data samples to topics
● Datareaders subscribe to topics
● Datawriters and Datareaders are loosely coupled - Datawriters don’t care who or how many subscribe
● Quality of Service
● Applications must specify not only what data is available, but also how it is to be transmitted
● Datawriters and Datareaders must agree upon Quality of Service (QOS) policy to be used
● QOS policies specify aspects like reliability, historical caching, late-joiner behavior, and more
● Communication fully specified by combination of Data Types, Topics, and QOS
● Software written by two or more parties can interoperate with well-defined behavior
● Encourages modular system design and discourages vendor lock
13
15. ROS2 Quick Summary
● Introduces a layer of abstraction around the middleware
● Simplifies development for users
● Reduces DDS-specific learning curve by providing rational defaults and patterns for common use-cases
● Provides utilities, libraries, and data types common to many robotics use-cases
● Scheduling
● Multi-threading
● Data recording and logging
● Coordinate systems and transformations
● Simulation tools
● Common data types (geometry, point clouds, images, GPS, time, common sensor data, and much more)
● Command line utilities for introspection and debugging
● Etc…
● Allows users to package and share their software components
● Nodes - individual applications that can be composed to form complex behaviors and systems
● Libraries - reusable library elements that can be used across ROS projects
● Messages - Data type specifications used between nodes
15
16. Common Robotic System Architecture Example
16
● One or more microcontrollers
○ Often running an RTOS
○ Real-time tasks
○ Flexible I/O interfaces
○ Sensor/actuator control
○ Sub-MCUs
● One primary App Processor
○ Often running Linux
○ Soft real-time tasks
○ Compute intensive tasks
○ High-bandwidth I/O
○ System coordination
● One or more remote C&C devices
○ Laptop, mobile device, etc.
○ Control & monitoring tasks
17. Putting it all Together - The MR Approach
Hardware Development Approach
● Drop-in replacement for commercially available vehicle platforms/ecosystems
● Designed for ROVs and AUVs, but adaptable to other types of systems
● Dramatically improved image quality, latency, and increased camera count
● Improved processing performance (support CV/ML and other intensive tasks)
● Additional space in enclosure for accessories
● Improved overall ease of use; reduced manual labor
● Expanded I/O and flexible power architecture to support add-ons
● Enabling of onboard data and telemetry recording
17
18. Putting it all Together - The MR Approach
Software Development Approach
● Provide a system that works out of the box with little to no configuration
● Support existing components within the ecosystem (sensors, cameras, etc)
● Build out complete OS distribution that takes care of common needs
○ Application scheduling
○ Recording & Playback
○ Software and Firmware Updates
○ Plug-and-play discovery/management of common devices (like cameras)
○ Fault and system resource monitoring
○ Remote access
○ Configuration Management (OS, Network, Vehicle settings, User Software settings, etc)
● Implement all external interfaces and APIs using DDS and ROS2
● Provide an SDK and complete development environment that allows day-1 deployments
● Create a flexible GUI application that supports user extensibility
18
19. Hardware Overview
Features:
● Integrated motherboard
● Recent generation of MCU
● Support for various App Processor models
● New cameras
● Superior low-light performance
● 130ms glass-to-glass latency standard config
● 70ms glass-to-glass ultralow-latency mode
● High-speed onboard storage
● Additional space for user hardware
● Additional connectorized I/O interfaces
● Flexible power management architecture
● 3.3V, 5V, and 12V buses
● Switchable rails for failsafing/load-shedding
● RTC for tracking real-world time
● Low-power warning system
19
23. Software Overview
Features:
● Docker-based embedded Linux platform
● Read-only Host OS running application containers
● Main container running Mission Robotics OS
● Additional containers dedicated to private User software
● OTA updates and remote fleet management capabilities
● DDS and ROS2 communication
● Vehicle and Client software implement both standalone DDS and ROS2 APIs
● mrSDK* available to simplify and accelerate development of user applications (both vehicle and client)
● Board/driver support for latest Nvidia platforms, designed for autonomous vehicles
● Hardware acceleration, computer vision, and machine learning features
● Complete set of services providing standard functionality
● Can be disabled by users if they wish to implement their own
23
*placeholder name
24. Developer Tools
24
● Docker based dev & deployment environment
○ Simplifies building, testing, and deploying software
○ Isolation of components from different vendors
● CI/CD
○ Full build, test, and deploy pipeline ready on day one
● CLI tools
● Example codebase
○ Python & C++ DDS & ROS2 starter applications
○ Arduino & STM32F example code for MCU apps
● Remote vehicle connectivity and monitoring
26. Options for Extensibility
26
There are five key paths to extend the system:
● Certain plug-and-play features are already built-in
● V4L2 and other supported cameras are automatically detected and brought up (configurable)
● MCUs that implement supported protocols are automatically bridged to the DDS bus
● Explicitly supported devices with mrOS* drivers automatically brought up
● Create and deploy custom ROS2/DDS applications to the vehicle user containers
● Or any applications/protocols, if desired
● Create and deploy custom ROS2/DDS topside applications that interact via the public API
● Create plugins for the Qt piloting application
● Create standalone MCU + sensor/actuator devices that are tunneled to both the DDS bus and Qt app
*placeholder name
27. “How do I…”
“… Add more cameras?”
Two main approaches:
● If the camera is already supported by mrOS, plug it in and configure if needed
● Camera Supervisor will automatically bring driver up for camera
● Camera data will be made available over ROS2/DDS
● Qt App will automatically discover new camera and allow streaming/control
● If the camera is not already supported, user can do one of two things:
● Write a plugin library for the Camera Supervisor to allow it to bring the camera up
● Must implement way to find/access the device, acquire frames, change settings
● Write a standalone ROS2/DDS application that handles the camera on their own
● By following the established type/topic API conventions, it should just work
27
29. “How do I…”
“... create a new sensor/actuator that can be integrated?”
If the device can be controlled using I/O available on App Processor, write a new ROS2/DDS node.
If more I/O is required, user can use an additional MCU, such as an Arduino:
● Write an Arduino sketch that can interact with the sensor/actuator
● Add some code that implements the public API over the serial interface
● We provide a ready to go library and examples to make this easy
● Two API paths:
● Use MicroROS/DDS XRCE to implement API directly on the existing databus
● Use a simplified JSON-based API that will be forwarded directly to the Qt app
As an example, let’s consider the user adding a custom light module via Arduino...
29
30. 30
● Arduino sketch sends messages to App Processor
○ Messages conform to a simple JSON-based API
■ Contains unique message name, fields, field types, and field values
● MCU supervisor running on App Processor detects user MCU
○ A bridge service is created for each user MCU
● Bridge directly forwards the messages to Qt App on special DDS topic
○ Also creates an “input” topic for messages to travel back to user’s MCU
31. “How do I…”
“... modify the pilot application to do or show X?”
● Introspect the fields and convert them into a dynamic model representing the “backend” for the device
● Backend contains a property map for input values and output values
● Backend provides hints about the data it contains to choose an appropriate display widget
● Signals emitted upon value changes received
● Use the model as a data source/sink for frontend elements
● User can configure the Pilot activity or any customizable screen to adjust the layout
● The new data sources/sinks will be shown, along with “suggested display elements” based on hints
● App is pre-packaged with a number of common components: labels, dials, sliders, buttons, etc.
● Upon instantiating the display component based on configuration, inputs and outputs will be connected
31
32. Custom User Components
While the app comes pre-packaged with common components, we want to
provide a way for the user to create an entirely new widget/component that can be
created during runtime without the need to compile anything and without any prior
knowledge of the user’s data types built into the app.
● User creates a plugin containing:
● One or more QML file that encompasses a “Component”
● A metadata file that describes the signals/slots of the component and any accepted hints
● This plugin is loaded via a utility in the Qt app
● Or simply place the plugin folder into a specified location where the app will find it
● The new component is made available within the layout config
● At this point, user can drop the new component into various screens
● The signals/slots will be automatically connected, allowing real-time bidirectional updates
32
33. Resources
● ROS2 Resources and Documentation
● https://docs.ros.org/en/galactic/
● https://micro.ros.org/
● DDS Tutorials and Learning Materials
● http://www.laas.fr/files/SLides-A_Corsaro.pdf
● https://www.dre.vanderbilt.edu/~schmidt/PDF/dds-sos.pdf
● https://www.youtube.com/watch?v=GGqcrccWfeE
● ROS2, micro-ROS, and DDS in aerial drone systems (PX4/Dronecode)
● https://www.youtube.com/watch?v=lZ8crGI16qA
33
34. How to Add Actuator/Sensor Data and Associated
UI to a Closed-Source Qt/QML App?
34
Qt App
“Ground Station”
(closed source)
Actuators
Sensors
Vehicle
QML User Interface
User-Defined Controls
User-Defined
Environment
Telemetry
Commands
35. What is Qt?
35
Application development framework (not just user interface)
Two user interface frameworks: widgets (desktop) and QML (touch)
Open Source
Cross platform (Windows, Linux, Mac, Android, iOS...)
“Write once, compile anywhere”
Triple licenced: GPL, LGPL, and commercial (recommended)
C++ but other language bindings exist e.g. Python
Actively developed by The Qt Company with services provided by ICS (ics.com)