Presentation to the OMG MARS Task Force from March of 2010 on the "Extensible and Dynamic Topic Types for DDS" (DDS-XTypes) specification. Following this presentation, the Task Force voted to recommend the adoption of this specification.
Extensible and Dynamic Topic Types for DDSRick Warren
Presentation to a Technical Meeting of the Object Management Group (OMG) describing a revised response to an RFP for improvements to the DDS type system in December 2009.
This presentation "replaces" my earlier presentation http://www.slideshare.net/rickbwarren/extensible-and-dynamic-topic-types-for-dds.
Multiple protocols have been positioned as “the” application-layer messaging protocol for the Internet of Things (IoT) and Machine-to-Machine (M2M) communication. In fact, these protocols address different aspects of IoT messaging and are complementary more than competitive (other than for mindshare). This presentation compares two of these protocols, MQTT and DDS, and shows how they are designed and optimized for different communication requirements.
Distributed Systems: How to connect your real-time applicationsJaime Martin Losa
This document provides an overview of distributed systems and how to connect real-time applications using the Data Distribution Service (DDS) standard. It introduces DDS and its architecture, including topics, instances, keys, quality of service policies. It then demonstrates how to create a basic "hello world" publisher/subscriber example in both eProsima Fast RTPS and RTI Connext DDS middleware in 3 steps: defining the data type, generating code, and building/running the publisher and subscriber.
Java 5 PSM for DDS: Revised Submission (out of date)Rick Warren
Presentation given to the Object Management Group's MARS Task Force in September, 2010 about a proposal to improve the Java API for the OMG's Data Distribution Service (DDS). See also http://code.google.com/p/datadistrib4j/.
This presentation is obsoleted by a later one: http://www.slideshare.net/rickbwarren/java-psm-revisedsubmission2presentationmars20101222.
Extensible and Dynamic Topic Types For DDS (out of date)Rick Warren
Presentation to a Technical Meeting of the Object Management Group (OMG) describing a revised response to an RFP for improvements to the DDS type system in September 2009.
This presentation is superseded by later ones on the same subject.
The document proposes a high integrity profile for the OMG Data Distribution Service (DDS) standard to address its complexity and lack of real-time and priority support for use in safety-critical systems. It defines restrictions and refinements to the DDS specification to reduce optional complexity. It also defines a hierarchical priority model and multicast data dissemination technique. The profile is implemented on the Real-Time Specification for Java platform using patterns to support the priority model while achieving certification standards for high integrity systems. Evaluation shows the implementation meets deterministic and bounded latency requirements.
Java 5 PSM for DDS: Initial Submission (out of date)Rick Warren
Presentation to the OMG's MARS Task Force in June, 2010 on proposed improvements to the Java API to the OMG's Data Distribution Service specification (DDS).
The document discusses object-oriented (OO) design and patterns. It defines OO design as organizing software around objects rather than functions, using techniques like abstraction, encapsulation, inheritance, and polymorphism. C++ supports these OO mechanisms, making it an OO language. Classes in C++ enable abstraction and encapsulation. Inheritance and polymorphism allow modeling "is-a" relationships and enable code reuse. Common design patterns like singleton, factory, and observer are also discussed. The key to OO project success is identifying the right abstractions.
Extensible and Dynamic Topic Types for DDSRick Warren
Presentation to a Technical Meeting of the Object Management Group (OMG) describing a revised response to an RFP for improvements to the DDS type system in December 2009.
This presentation "replaces" my earlier presentation http://www.slideshare.net/rickbwarren/extensible-and-dynamic-topic-types-for-dds.
Multiple protocols have been positioned as “the” application-layer messaging protocol for the Internet of Things (IoT) and Machine-to-Machine (M2M) communication. In fact, these protocols address different aspects of IoT messaging and are complementary more than competitive (other than for mindshare). This presentation compares two of these protocols, MQTT and DDS, and shows how they are designed and optimized for different communication requirements.
Distributed Systems: How to connect your real-time applicationsJaime Martin Losa
This document provides an overview of distributed systems and how to connect real-time applications using the Data Distribution Service (DDS) standard. It introduces DDS and its architecture, including topics, instances, keys, quality of service policies. It then demonstrates how to create a basic "hello world" publisher/subscriber example in both eProsima Fast RTPS and RTI Connext DDS middleware in 3 steps: defining the data type, generating code, and building/running the publisher and subscriber.
Java 5 PSM for DDS: Revised Submission (out of date)Rick Warren
Presentation given to the Object Management Group's MARS Task Force in September, 2010 about a proposal to improve the Java API for the OMG's Data Distribution Service (DDS). See also http://code.google.com/p/datadistrib4j/.
This presentation is obsoleted by a later one: http://www.slideshare.net/rickbwarren/java-psm-revisedsubmission2presentationmars20101222.
Extensible and Dynamic Topic Types For DDS (out of date)Rick Warren
Presentation to a Technical Meeting of the Object Management Group (OMG) describing a revised response to an RFP for improvements to the DDS type system in September 2009.
This presentation is superseded by later ones on the same subject.
The document proposes a high integrity profile for the OMG Data Distribution Service (DDS) standard to address its complexity and lack of real-time and priority support for use in safety-critical systems. It defines restrictions and refinements to the DDS specification to reduce optional complexity. It also defines a hierarchical priority model and multicast data dissemination technique. The profile is implemented on the Real-Time Specification for Java platform using patterns to support the priority model while achieving certification standards for high integrity systems. Evaluation shows the implementation meets deterministic and bounded latency requirements.
Java 5 PSM for DDS: Initial Submission (out of date)Rick Warren
Presentation to the OMG's MARS Task Force in June, 2010 on proposed improvements to the Java API to the OMG's Data Distribution Service specification (DDS).
The document discusses object-oriented (OO) design and patterns. It defines OO design as organizing software around objects rather than functions, using techniques like abstraction, encapsulation, inheritance, and polymorphism. C++ supports these OO mechanisms, making it an OO language. Classes in C++ enable abstraction and encapsulation. Inheritance and polymorphism allow modeling "is-a" relationships and enable code reuse. Common design patterns like singleton, factory, and observer are also discussed. The key to OO project success is identifying the right abstractions.
The variety of available data formats, e.g., CDF, netCDF, HDF, etc., has been a problem for scientist because data of their interest must be translated into the format they understand before they can analyze data, and it will continue to be a problem for years to come. In a bid to make data format differences transparent to the end users, the CDF office has employed the XML / SOAP technology.
Dynamic Object-Oriented Requirements System (DOORS)David Groff
This document provides an overview of requirements management (RM) and the IBM Rational DOORS tool. It discusses what RM is, who uses it, and what DOORS is and how it can be used. It describes the key components and architecture of DOORS, including modules, objects, attributes, and links. It also covers security roles, configurations, scripting with DXL, and integrations with other tools.
The OMG DDS standard has recently received an incredible level of attention and press coverage due to its relevance for Consumer and Industrial IoT applications and its adoption as part of the Industrial Internet Consortium Reference Architecture. The main reason for the excitement in DDS stems from its data-centricity, efficiency, Internet-wide scalability, high-availability and configurability.
Although DDS provides a very feature rich platform for architecting distributed systems, it focuses on doing one thing well — namely data-sharing. As such it does not provide first-class support for abstractions such as distributed mutual exclusion, distributed barriers, leader election, consensus, atomic multicast, distributed queues, etc.
As a result, many architects tend to devise by themselves – assuming the DDS primitives as a foundation – the (hopefully correct) algorithms for classical problems such as fault-detection, leader election, consensus, distributed mutual exclusion, distributed barriers, atomic multicast, distributed queues, etc.
This Webcast explores DDS-based distributed algorithms for many classical, yet fundamental, problems in distributed systems. By attending the webcast you will learn how recurring problems arising in the design of distributed systems can be addressed using algorithm that are correct and perform well.
Easing Integration of Large-Scale Real-Time Systems with DDSRick Warren
Webcast (sorry, audio not included) on system integration design patterns from July of 2010 pertaining mostly (but not exclusively) to Data-Distribution Service (DDS) technology.
Automating System-Level Data-Interchange Software through a System Interface ...Martin Tapp
This document presents a PhD thesis defense by Martin Tapp on automating system-level data-interchange software through a system interface description language (SIDL). The thesis proposes SIDL as a domain-specific language to formally describe system interfaces and data exchanges in a machine-processable way. SIDL addresses challenges in system integration and interoperability such as data compatibility, representation compatibility, and interface evolution. It captures multi-architecture considerations and enables automation of data-interchange software generation from SIDL descriptions through a two-stage modeling and code generation workflow. The thesis is validated using representative test cases and experimental results demonstrate the generation of fully functional data-interchange software from SIDL models.
The document discusses the DICOM WG-23 proposal to separate medical imaging application development from infrastructure provision. It aims to minimize redundant application development by providing common infrastructure through a hosting system. Hosted applications would focus on processing and analysis, communicating with the hosting system through standardized interfaces. The eXtensible Imaging Platform is presented as an open source reference implementation of the WG-23 Application Hosting interfaces.
The document discusses IBM Cognos 8's mashup service which allows integrating Cognos reports and analytics into applications. It can enhance applications with business intelligence and extend the reach of applications. The mashup service uses REST and SOAP APIs to access Cognos reports, filters, prompts and drill capabilities from partner applications. It also describes how the mashup service can be discovered using WSIL to get WSDL URLs for individual reports.
This document provides information about getting fully solved assignments by emailing or calling a provided contact. It includes sample questions and answers on topics like ISDN connections, validating XML with DTDs, writing DTD files, internal and external DTDs, validating parsers, and the NMTOKEN and NMTOKENS type. It also defines XSL-FO and explains the purpose of XSL Formatting Objects and XSL-FO documents and processors. Students are instructed to provide their semester and specialization to receive solved assignments.
This document provides an overview of XML (eXtensible Markup Language) including:
- XML defines the syntax for tagging data but not the vocabulary or document structures.
- An XML toolkit allows data to be processed and viewed across different systems using parsers, stylesheets, and DTDs.
- An XML demonstration shows how a data file can be tagged and then viewed in different styles using the XML toolkit components.
- Open questions are discussed around who will develop standard XML vocabularies and how existing EDI standards like X12 will transition to XML.
The document discusses Flex 2 Data Services (FDS) and how it can be used with ColdFusion. FDS allows for server-side security, high performance, testing, collaboration, paging of large data volumes, data pushing, client synchronization, and real-time data delivery. Examples are provided for using FDS with ColdFusion for accessing CFCs remotely, enabling two-way data sharing in real-time, and building dashboards with automatically updating charts from submitted order data.
Presentation on the OMG Data-Distribution Service (DDS) Interoperability demo held during the Santa Clara OMG meeting on December 8, 2010.
Four vendors demonstrated the wire-protocol interoperability of their DDS Implementations: RTI, PrismTech, Gallium Visual Systems, and Twin Oaks Computing.
This is a demonstration of the use of the DDS Interoperability Wire Protocol standard (DDS-RTPS)
This document discusses how ISOcat, a data category registry that implements ISO 12620, can be used within CMDI (Component Metadata Infrastructure) to provide standardized semantics for metadata elements and values. It describes how CMD components, elements, and items can link to standardized data category concepts in ISOcat to clarify their meaning. The status of the ISOcat metadata thematic domain group and standardization process is provided. Trust in the data category registry and individual data categories is addressed. Upcoming features for ISOcat like a user forum and improved standardization support are outlined.
The document summarizes a DDS interoperability demo between multiple vendors in December 2010. It describes the history and specifications of DDS, the participating vendors (Gallium Visual Systems, TwinOaks Computing, Real-Time Innovations, PrismTech), and the scenarios that were demonstrated showing interoperability between the vendors across different platforms, data types, QoS policies, and filtering capabilities. The conclusions were that DDS interoperability works across the vendors, more scenarios will continue to be developed, and the DDS standards enable complete interoperability.
D4Science scientific data infrastructure promoting interoperability by embrac...FAO
D4Science aims to promote interoperability across different data sources and computing platforms by embracing heterogeneity. It provides solutions to abstract over differences in location, protocols, and models, allowing resources to be virtually accessible in a common ecosystem. D4Science offers various tools and patterns to deliver interoperability, connecting heterogeneous digital content, repositories, and computation platforms. This reduces costs and barriers for users while supporting many existing standards.
D4 science scientific data infrastructure promoting interoperability by embra...FAO
D4Science aims to promote interoperability across different data sources and computing platforms by embracing heterogeneity. It provides solutions to abstract over differences in location, protocols, and models, allowing resources to be virtually accessible in a common ecosystem. D4Science offers various tools and patterns to deliver interoperability, connecting heterogeneous digital content, repositories, and computation platforms. This reduces costs and barriers for users while supporting many existing standards.
DDS Advanced Tutorial - OMG June 2013 Berlin MeetingJaime Martin Losa
An extended, in-depth tutorial explaining how to fully exploit the standard's unique communication capabilities.Presented at the OMG June 2013 Berlin Meeting.
Users upgrading to DDS from a homegrown solution or a legacy-messaging infrastructure often limit themselves to using its most basic publish-subscribe features. This allows applications to take advantage of reliable multicast and other performance and scalability features of the DDS wire protocol, as well as the enhanced robustness of the DDS peer-to-peer architecture. However, applications that do not use DDS's data-centricity do not take advantage of many of its QoS-related, scalability and availability features, such as the KeepLast History Cache, Instance Ownership and Deadline Monitoring. As a consequence some developers duplicate these features in custom application code, resulting in increased costs, lower performance, and compromised portability and interoperability.
This tutorial will formally define the data-centric publish-subscribe model as specified in the OMG DDS specification and define a set of best-practice guidelines and patterns for the design and implementation of systems based on DDS.
This chapter discusses XML and its use for data exchange. XML allows definition of custom tags to represent structured data with nested elements and attributes. XML provides a standardized format for data interchange that is self-describing and supports complex nested structures. The chapter describes XML syntax and structure, and how XML schemas like DTDs constrain the structure and elements of valid XML documents to ensure consistent interpretation.
The document describes the D-Bus specification, which defines a system for low-latency, low-overhead interprocess communication. It outlines the message protocol, including type signatures, marshaling, message format, and message types. It also describes the authentication protocol and standard interfaces defined by D-Bus. Finally, it discusses server addresses, transports, naming conventions, introspection data format, the message bus specification, and provides a glossary of terms.
Praveen Srivatsa discusses how SQL Server supports non-relational data like documents, images, and videos through features like XML, CLR, FileStream, and spatial data types. SQL Server can store relational and non-relational data together to enable integrated business scenarios. New data types like HierarchyID and improvements to XML and spatial data types in SQL Server 2008 help developers work with hierarchical and location-based data. SQL Server provides reliability, security, and programming interfaces for working with non-relational data alongside relational data and queries.
A smattering of brief intermediate topics regarding the Git version control system, including branching strategies, interactive rebasing, and migration from Subversion.
Building Scalable Stateless Applications with RxJavaRick Warren
RxJava is a lightweight open-source library, originally from Netflix, that makes it easy to compose asynchronous data sources and operations. This presentation is a high-level intro to this library and how it can fit into your application.
More Related Content
Similar to Extensible and Dynamic Topic Types for DDS
The variety of available data formats, e.g., CDF, netCDF, HDF, etc., has been a problem for scientist because data of their interest must be translated into the format they understand before they can analyze data, and it will continue to be a problem for years to come. In a bid to make data format differences transparent to the end users, the CDF office has employed the XML / SOAP technology.
Dynamic Object-Oriented Requirements System (DOORS)David Groff
This document provides an overview of requirements management (RM) and the IBM Rational DOORS tool. It discusses what RM is, who uses it, and what DOORS is and how it can be used. It describes the key components and architecture of DOORS, including modules, objects, attributes, and links. It also covers security roles, configurations, scripting with DXL, and integrations with other tools.
The OMG DDS standard has recently received an incredible level of attention and press coverage due to its relevance for Consumer and Industrial IoT applications and its adoption as part of the Industrial Internet Consortium Reference Architecture. The main reason for the excitement in DDS stems from its data-centricity, efficiency, Internet-wide scalability, high-availability and configurability.
Although DDS provides a very feature rich platform for architecting distributed systems, it focuses on doing one thing well — namely data-sharing. As such it does not provide first-class support for abstractions such as distributed mutual exclusion, distributed barriers, leader election, consensus, atomic multicast, distributed queues, etc.
As a result, many architects tend to devise by themselves – assuming the DDS primitives as a foundation – the (hopefully correct) algorithms for classical problems such as fault-detection, leader election, consensus, distributed mutual exclusion, distributed barriers, atomic multicast, distributed queues, etc.
This Webcast explores DDS-based distributed algorithms for many classical, yet fundamental, problems in distributed systems. By attending the webcast you will learn how recurring problems arising in the design of distributed systems can be addressed using algorithm that are correct and perform well.
Easing Integration of Large-Scale Real-Time Systems with DDSRick Warren
Webcast (sorry, audio not included) on system integration design patterns from July of 2010 pertaining mostly (but not exclusively) to Data-Distribution Service (DDS) technology.
Automating System-Level Data-Interchange Software through a System Interface ...Martin Tapp
This document presents a PhD thesis defense by Martin Tapp on automating system-level data-interchange software through a system interface description language (SIDL). The thesis proposes SIDL as a domain-specific language to formally describe system interfaces and data exchanges in a machine-processable way. SIDL addresses challenges in system integration and interoperability such as data compatibility, representation compatibility, and interface evolution. It captures multi-architecture considerations and enables automation of data-interchange software generation from SIDL descriptions through a two-stage modeling and code generation workflow. The thesis is validated using representative test cases and experimental results demonstrate the generation of fully functional data-interchange software from SIDL models.
The document discusses the DICOM WG-23 proposal to separate medical imaging application development from infrastructure provision. It aims to minimize redundant application development by providing common infrastructure through a hosting system. Hosted applications would focus on processing and analysis, communicating with the hosting system through standardized interfaces. The eXtensible Imaging Platform is presented as an open source reference implementation of the WG-23 Application Hosting interfaces.
The document discusses IBM Cognos 8's mashup service which allows integrating Cognos reports and analytics into applications. It can enhance applications with business intelligence and extend the reach of applications. The mashup service uses REST and SOAP APIs to access Cognos reports, filters, prompts and drill capabilities from partner applications. It also describes how the mashup service can be discovered using WSIL to get WSDL URLs for individual reports.
This document provides information about getting fully solved assignments by emailing or calling a provided contact. It includes sample questions and answers on topics like ISDN connections, validating XML with DTDs, writing DTD files, internal and external DTDs, validating parsers, and the NMTOKEN and NMTOKENS type. It also defines XSL-FO and explains the purpose of XSL Formatting Objects and XSL-FO documents and processors. Students are instructed to provide their semester and specialization to receive solved assignments.
This document provides an overview of XML (eXtensible Markup Language) including:
- XML defines the syntax for tagging data but not the vocabulary or document structures.
- An XML toolkit allows data to be processed and viewed across different systems using parsers, stylesheets, and DTDs.
- An XML demonstration shows how a data file can be tagged and then viewed in different styles using the XML toolkit components.
- Open questions are discussed around who will develop standard XML vocabularies and how existing EDI standards like X12 will transition to XML.
The document discusses Flex 2 Data Services (FDS) and how it can be used with ColdFusion. FDS allows for server-side security, high performance, testing, collaboration, paging of large data volumes, data pushing, client synchronization, and real-time data delivery. Examples are provided for using FDS with ColdFusion for accessing CFCs remotely, enabling two-way data sharing in real-time, and building dashboards with automatically updating charts from submitted order data.
Presentation on the OMG Data-Distribution Service (DDS) Interoperability demo held during the Santa Clara OMG meeting on December 8, 2010.
Four vendors demonstrated the wire-protocol interoperability of their DDS Implementations: RTI, PrismTech, Gallium Visual Systems, and Twin Oaks Computing.
This is a demonstration of the use of the DDS Interoperability Wire Protocol standard (DDS-RTPS)
This document discusses how ISOcat, a data category registry that implements ISO 12620, can be used within CMDI (Component Metadata Infrastructure) to provide standardized semantics for metadata elements and values. It describes how CMD components, elements, and items can link to standardized data category concepts in ISOcat to clarify their meaning. The status of the ISOcat metadata thematic domain group and standardization process is provided. Trust in the data category registry and individual data categories is addressed. Upcoming features for ISOcat like a user forum and improved standardization support are outlined.
The document summarizes a DDS interoperability demo between multiple vendors in December 2010. It describes the history and specifications of DDS, the participating vendors (Gallium Visual Systems, TwinOaks Computing, Real-Time Innovations, PrismTech), and the scenarios that were demonstrated showing interoperability between the vendors across different platforms, data types, QoS policies, and filtering capabilities. The conclusions were that DDS interoperability works across the vendors, more scenarios will continue to be developed, and the DDS standards enable complete interoperability.
D4Science scientific data infrastructure promoting interoperability by embrac...FAO
D4Science aims to promote interoperability across different data sources and computing platforms by embracing heterogeneity. It provides solutions to abstract over differences in location, protocols, and models, allowing resources to be virtually accessible in a common ecosystem. D4Science offers various tools and patterns to deliver interoperability, connecting heterogeneous digital content, repositories, and computation platforms. This reduces costs and barriers for users while supporting many existing standards.
D4 science scientific data infrastructure promoting interoperability by embra...FAO
D4Science aims to promote interoperability across different data sources and computing platforms by embracing heterogeneity. It provides solutions to abstract over differences in location, protocols, and models, allowing resources to be virtually accessible in a common ecosystem. D4Science offers various tools and patterns to deliver interoperability, connecting heterogeneous digital content, repositories, and computation platforms. This reduces costs and barriers for users while supporting many existing standards.
DDS Advanced Tutorial - OMG June 2013 Berlin MeetingJaime Martin Losa
An extended, in-depth tutorial explaining how to fully exploit the standard's unique communication capabilities.Presented at the OMG June 2013 Berlin Meeting.
Users upgrading to DDS from a homegrown solution or a legacy-messaging infrastructure often limit themselves to using its most basic publish-subscribe features. This allows applications to take advantage of reliable multicast and other performance and scalability features of the DDS wire protocol, as well as the enhanced robustness of the DDS peer-to-peer architecture. However, applications that do not use DDS's data-centricity do not take advantage of many of its QoS-related, scalability and availability features, such as the KeepLast History Cache, Instance Ownership and Deadline Monitoring. As a consequence some developers duplicate these features in custom application code, resulting in increased costs, lower performance, and compromised portability and interoperability.
This tutorial will formally define the data-centric publish-subscribe model as specified in the OMG DDS specification and define a set of best-practice guidelines and patterns for the design and implementation of systems based on DDS.
This chapter discusses XML and its use for data exchange. XML allows definition of custom tags to represent structured data with nested elements and attributes. XML provides a standardized format for data interchange that is self-describing and supports complex nested structures. The chapter describes XML syntax and structure, and how XML schemas like DTDs constrain the structure and elements of valid XML documents to ensure consistent interpretation.
The document describes the D-Bus specification, which defines a system for low-latency, low-overhead interprocess communication. It outlines the message protocol, including type signatures, marshaling, message format, and message types. It also describes the authentication protocol and standard interfaces defined by D-Bus. Finally, it discusses server addresses, transports, naming conventions, introspection data format, the message bus specification, and provides a glossary of terms.
Praveen Srivatsa discusses how SQL Server supports non-relational data like documents, images, and videos through features like XML, CLR, FileStream, and spatial data types. SQL Server can store relational and non-relational data together to enable integrated business scenarios. New data types like HierarchyID and improvements to XML and spatial data types in SQL Server 2008 help developers work with hierarchical and location-based data. SQL Server provides reliability, security, and programming interfaces for working with non-relational data alongside relational data and queries.
Similar to Extensible and Dynamic Topic Types for DDS (20)
A smattering of brief intermediate topics regarding the Git version control system, including branching strategies, interactive rebasing, and migration from Subversion.
Building Scalable Stateless Applications with RxJavaRick Warren
RxJava is a lightweight open-source library, originally from Netflix, that makes it easy to compose asynchronous data sources and operations. This presentation is a high-level intro to this library and how it can fit into your application.
Letters from the Trenches: Lessons Learned Taking MongoDB to ProductionRick Warren
eHarmony moved one family of business-critical back-end applications to MongoDB several months ago. In this presentation, I discuss some of the important lessons we learned along the way about how to provision, scale, manage, and troubleshoot MongoDB.
This document discusses patterns of data distribution that are commonly used when building distributed systems and applications. It identifies three main patterns: publish-subscribe, point-to-point, and request-reply. The document argues that middleware platforms typically implement these patterns in a rigid way, whereas a better approach is for platforms to be built using fundamental "super-patterns" that can be constrained or composed to derive the common patterns. This allows platforms to be more flexible and performant while still providing familiar patterns to application developers. The document also discusses challenges for platform builders in areas like system architecture, performance, and application interfaces.
Engineering Interoperable and Reliable SystemsRick Warren
The features of a communication technology that yield the properties of interoperability and reliability can be visualized in layers: technical (at the level of bytes), syntactic (at the level of messages), semantic (at the level of data, i.e. what the messages refer to), and so on. Real-world systems require at least data-level interoperability and reliability. The question is: will you acquire something that already supports those capabilities, or will you build it atop something that doesn't? This talk compares and contrasts DDS and AMQP as technology exemplars in each category.
Scaling DDS to Millions of Computers and DevicesRick Warren
I gave this presentation at an Object Management Group (OMG) workshop in Arlington, VA in March, 2010. It describes some of the concerns that will impact DDS as it is scaled to very large, geographically distributed systems. It also describes possible ways these challenges can be addressed.
This presentation gives a brief, semi-technical introduction to Data Distribution Service (DDS) technology from the Object Management Group. The focus is on the business benefits of the technology generally, not on RTI's implementation in particular.
Java 5 Language PSM for DDS: Final SubmissionRick Warren
This presentation describes the specification "Java 5 Language PSM for DDS." It was given to the MARS Task Force on Tuesday, December 7, 2010. The specification was recommended for adoption later in the week. The specification improves code portability, usability, and performance for applications that use Data Distribution Service (DDS) technology. See also http://code.google.com/p/datadistrib4j/.
Presentation from September, 2010 about the RTI proposal to improve the C++ API for the OMG's Data Distribution Service specification (DDS). See also http://code.google.com/p/dds-psm-cxx/.
Large-Scale System Integration with DDS for SCADA, C2, and FinanceRick Warren
Presentation to the OMG Real-Time Workshop in May 2010 on system integration patterns, especially (but not exclusively) with respect to OMG Data Distribution Service (DDS) technology.
Data-Centric and Message-Centric System ArchitectureRick Warren
Presentation from April, 2010 summarizing the principles of data-centric design and how they apply to DDS technology. Message-centric design is presented by way of contrast.
Presentation to a Technical Meeting of the Object Management Group (OMG) proposing the issuance of an RFP for an improved Java API for DDS in December 2009. Following this presentation, the RFP was voted for issuance.
This presentation has been superseded by later ones on the same subject.
Presentation to the Robotics Task Force of the Object Management Group (OMG) introducing the members to the Data Distribution Service (DDS), another OMG-standard technology.
Proposed Java 5 API for DDS (out of date)Rick Warren
Presentation to a Technical Meeting of the Object Management Group (OMG) proposing the issuance of an RFP for an improved Java API for DDS in September 2009.
This presentation has been superseded by more recent ones on the same subject.
From the Tactical Edge to the Enterprise: Integrating DDS and JMSRick Warren
Presentation to a Real-Time Workshop of the Object Management Group (OMG) describing concerns, approaches, and best practices for integrating systems based on DDS and JMS middleware in July, 2009.
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...Alex Pruden
Folding is a recent technique for building efficient recursive SNARKs. Several elegant folding protocols have been proposed, such as Nova, Supernova, Hypernova, Protostar, and others. However, all of them rely on an additively homomorphic commitment scheme based on discrete log, and are therefore not post-quantum secure. In this work we present LatticeFold, the first lattice-based folding protocol based on the Module SIS problem. This folding protocol naturally leads to an efficient recursive lattice-based SNARK and an efficient PCD scheme. LatticeFold supports folding low-degree relations, such as R1CS, as well as high-degree relations, such as CCS. The key challenge is to construct a secure folding protocol that works with the Ajtai commitment scheme. The difficulty, is ensuring that extracted witnesses are low norm through many rounds of folding. We present a novel technique using the sumcheck protocol to ensure that extracted witnesses are always low norm no matter how many rounds of folding are used. Our evaluation of the final proof system suggests that it is as performant as Hypernova, while providing post-quantum security.
Paper Link: https://eprint.iacr.org/2024/257
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3Data Hops
Free A4 downloadable and printable Cyber Security, Social Engineering Safety and security Training Posters . Promote security awareness in the home or workplace. Lock them Out From training providers datahops.com
Monitoring and Managing Anomaly Detection on OpenShift.pdfTosin Akinosho
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/temporal-event-neural-networks-a-more-efficient-alternative-to-the-transformer-a-presentation-from-brainchip/
Chris Jones, Director of Product Management at BrainChip , presents the “Temporal Event Neural Networks: A More Efficient Alternative to the Transformer” tutorial at the May 2024 Embedded Vision Summit.
The expansion of AI services necessitates enhanced computational capabilities on edge devices. Temporal Event Neural Networks (TENNs), developed by BrainChip, represent a novel and highly efficient state-space network. TENNs demonstrate exceptional proficiency in handling multi-dimensional streaming data, facilitating advancements in object detection, action recognition, speech enhancement and language model/sequence generation. Through the utilization of polynomial-based continuous convolutions, TENNs streamline models, expedite training processes and significantly diminish memory requirements, achieving notable reductions of up to 50x in parameters and 5,000x in energy consumption compared to prevailing methodologies like transformers.
Integration with BrainChip’s Akida neuromorphic hardware IP further enhances TENNs’ capabilities, enabling the realization of highly capable, portable and passively cooled edge devices. This presentation delves into the technical innovations underlying TENNs, presents real-world benchmarks, and elucidates how this cutting-edge approach is positioned to revolutionize edge AI across diverse applications.
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...Jason Yip
The typical problem in product engineering is not bad strategy, so much as “no strategy”. This leads to confusion, lack of motivation, and incoherent action. The next time you look for a strategy and find an empty space, instead of waiting for it to be filled, I will show you how to fill it in yourself. If you’re wrong, it forces a correction. If you’re right, it helps create focus. I’ll share how I’ve approached this in the past, both what works and lessons for what didn’t work so well.
Fueling AI with Great Data with Airbyte WebinarZilliz
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API?
Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose?
Which one is cheapest? Which one is fastest? Which one will scale to meet our needs?
Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!
"Choosing proper type of scaling", Olena SyrotaFwdays
Imagine an IoT processing system that is already quite mature and production-ready and for which client coverage is growing and scaling and performance aspects are life and death questions. The system has Redis, MongoDB, and stream processing based on ksqldb. In this talk, firstly, we will analyze scaling approaches and then select the proper ones for our system.
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/how-axelera-ai-uses-digital-compute-in-memory-to-deliver-fast-and-energy-efficient-computer-vision-a-presentation-from-axelera-ai/
Bram Verhoef, Head of Machine Learning at Axelera AI, presents the “How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-efficient Computer Vision” tutorial at the May 2024 Embedded Vision Summit.
As artificial intelligence inference transitions from cloud environments to edge locations, computer vision applications achieve heightened responsiveness, reliability and privacy. This migration, however, introduces the challenge of operating within the stringent confines of resource constraints typical at the edge, including small form factors, low energy budgets and diminished memory and computational capacities. Axelera AI addresses these challenges through an innovative approach of performing digital computations within memory itself. This technique facilitates the realization of high-performance, energy-efficient and cost-effective computer vision capabilities at the thin and thick edge, extending the frontier of what is achievable with current technologies.
In this presentation, Verhoef unveils his company’s pioneering chip technology and demonstrates its capacity to deliver exceptional frames-per-second performance across a range of standard computer vision networks typical of applications in security, surveillance and the industrial sector. This shows that advanced computer vision can be accessible and efficient, even at the very edge of our technological ecosystem.
Dandelion Hashtable: beyond billion requests per second on a commodity serverAntonios Katsarakis
This slide deck presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block request processing in three cases. First, most hashtables block while waiting for data to be retrieved from memory. Second, open-addressing designs, which represent the current state-of-the-art, either cannot free index slots on deletes or must block all requests to do so. Third, index resizes block every request until all objects are copied to the new index. Defying folklore wisdom, DLHT forgoes open-addressing and adopts a fully-featured and memory-aware closed-addressing design based on bounded cache-line-chaining. This design offers lock-free index operations and deletes that free slots instantly, (2) completes most requests with a single memory access, (3) utilizes software prefetching to hide memory latencies, and (4) employs a novel non-blocking and parallel resizing. In a commodity server and a memory-resident workload, DLHT surpasses 1.6B requests per second and provides 3.5x (12x) the throughput of the state-of-the-art closed-addressing (open-addressing) resizable hashtable on Gets (Deletes).
Your One-Stop Shop for Python Success: Top 10 US Python Development Providersakankshawande
Simplify your search for a reliable Python development partner! This list presents the top 10 trusted US providers offering comprehensive Python development services, ensuring your project's success from conception to completion.
Lots of material in a short amount of time, so here’s the format:If I’m not clear, let me know right away.If you have a quick question, go ahead and ask itIf you have a longer question of discussion point, we’ll talk about it at the end.
DDS is unique among pub-sub systems in providing interoperable static type safety.Applications that use data already expect certain contents; by making expectations explicit, enable: type-aware integration (e.g. relational mapping) compact network representation.
Many systems are already committed to, deployed on DDS 1.2, RTPS 2 (such as, many international navies). Breaking compatibility with those specs makes integration really hard, costs a lot of time and money for users an vendors alike. Don’t do it.People choose DDS for its performance. Don’t break that either.
Already, DDS conformance and RTPS conformance are independent. This spec pertains to both programming APIs and network representation, so it makes the same distinction.
Remember why we decided to use parameterized encoding for discovery in the first place:We knew it would change in future versions.We knew vendors would add extensions.But we created a special enclave: built-in topic data types are extensible, but no one else.This spec generalizes the model that has proven itself over a decade.
Nothing very new here: IDL WSDL let you do this before. Now it’s official.
C, C++, Java covers almost all DDS users.Ada is a tiny fraction.Scripting languages are covered by Web-Enabled.
This is one common use case. After we talk about the different pieces, we’ll see how to accomplish it.
“DECLARED” is the default for conforming implementations. Call get_default_qos and you will get this.When a conforming implementation talks to a non-conforming implementation, this policy will be missing, so according to the type defaulting rules, it will assume “EXACT_TYPE.”