This talk introduces a realistic real-time geospatial drone delivery demonstration application using two complementary open-source technologies working at different timescales – Uber’s Cadence (for long-running/scheduled workflows) and Apache Kafka (for fast streaming data). With up to 2,000 (simulated) drones and deliveries in progress at once this application generates a vast flow of spatiotemporal data. The second part of the talk uses this platform and data to explore Machine Learning over streaming data from Kafka. We will explore some of the challenges and solutions of incremental Machine Learning over fast-moving data, particularly when the data is spatiotemporal with concept drifts, and reveal how well a selection of open-source Kafka Machine Learning frameworks perform and scale at this demanding task.
Talk in the Geospatial track at Community over Code Halifax 2023 https://communityovercode.org/schedule-list/#GEO006
Spinning Your Drones with Cadence Workflows, Apache Kafka and TensorFlowAll Things Open
Presented at All Things Open 2023
Presented by Paul Brebner - Instaclustr (by Spot by NetApp)
Title: Spinning Your Drones with Cadence Workflows, Apache Kafka and TensorFlow
Abstract: In this talk we’ll build a Drone delivery application, and then use it to do some Machine Learning “on the fly”.
In the 1st part of the talk, we'll build a real-time Drone Delivery demonstration application using a combination of two open-source technologies: Uber’s Cadence (for stateful, scheduled, long-running workflows), and Apache Kafka (for fast streaming data).
With up to 2,000 (simulated) drones and deliveries in progress at once this application generates a vast flow of spatio-temporal data.
In the 2nd part of the talk, we'll use this platform to explore Machine Learning (ML) over streaming and drifting Kafka data with TensorFlow to try and predict which shops will be busy in advance.
Find more info about All Things Open:
On the web: https://www.allthingsopen.org/
Twitter: https://twitter.com/AllThingsOpen
LinkedIn: https://www.linkedin.com/company/all-things-open/
Instagram: https://www.instagram.com/allthingsopen/
Facebook: https://www.facebook.com/AllThingsOpen
Mastodon: https://mastodon.social/@allthingsopen
Threads: https://www.threads.net/@allthingsopen
2023 conference: https://2023.allthingsopen.org/
Spinning Your Drones with Cadence Workflows, Apache Kafka and TensorFlowPaulBrebner2
This document discusses using Cadence workflows, Apache Kafka, and TensorFlow to orchestrate drone deliveries and perform machine learning on streaming delivery data.
Part 1 describes how Cadence workflows can be used to orchestrate drone delivery tasks and coordinate with order workflows, using Kafka for asynchronous communication. Part 2 discusses using Kafka streams to aggregate delivery data and send it to TensorFlow for incremental machine learning to predict busy shops in real-time. The document provides examples of how these technologies can be integrated and addresses challenges of streaming machine learning.
Spinning your Drones with Cadence Workflows and Apache KafkaPaul Brebner
The rapid rise in Big Data use cases over the last decade has been accelerated by popular massively scalable open-source technologies such as Apache Cassandra® for storage, Apache Kafka® for streaming, and OpenSearch® for search. Now there’s a new member of the peloton, Cadence, for orchestration - code-based scalable fault-tolerant workflow orchestration. To illustrate the most important Cadence concepts (and more) we’ll build a realistic drone delivery service demonstration application. We’ll also explore what happens when orchestration meets choreography, and use the drone application to illustrate different ways to integrate Cadence with Apache Kafka, including reusing Kafka microservices. But how scalable is Cadence in practice? We’ll fill the sky with drones - how many drones can we get flying at once?
apidays Australia 2022 - Spinning Your Drones with Cadence Workflows and Apac...apidays
apidays Australia 2022 - Enabling Business Networks
September 14 & 15, 2022
Spinning Your Drones with Cadence Workflows and Apache Kafka
Paul Brebner, Technology Evangelist at Instaclustr
------------
Check out our conferences at https://www.apidays.global/
Do you want to sponsor or talk at one of our conferences?
https://apidays.typeform.com/to/ILJeAaV8
Learn more on APIscene, the global media made by the community for the community:
https://www.apiscene.io
Explore the API ecosystem with the API Landscape:
https://apilandscape.apiscene.io/
Deep dive into the API industry with our reports:
https://www.apidays.global/industry-reports/
Subscribe to our global newsletter:
https://apidays.typeform.com/to/i1MPEW
Fast Open Source Software - Without The FuryPaulBrebner2
Developing fast scalable Big Data applications has been made significantly easier over the last decade with horizontally scalable open-source databases and streaming technologies such as Apache Cassandra and Apache Kafka. Cloud-native trends have also accelerated the uptake and ease of use of these technologies, and they are available as managed services on multiple cloud platforms.
But maybe it has become too easy to embark on building complex distributed applications using multiple massively scalable open-source technologies, as there are still many performance and scalability issues to be aware of. In this talk, I will give a high-level overview of some of the performance and scalability challenges I’ve overcome over the last six years building realistic demonstration applications using Apache Cassandra and Apache Kafka (and more), supplemented with performance insights from our operation of thousands of production clusters. Keynote talk for the Performance Engineering track at Community Over Code Halifax 2023, https://communityovercode.org/schedule-list/#PE001
A Review: Metaheuristic Technique in Cloud ComputingIRJET Journal
This document reviews various meta-heuristic techniques that have been applied to problems in cloud computing, such as task scheduling, load balancing, ant colony optimization (ACO), particle swarm optimization (PSO), and gravitational search algorithm (GSA). It first provides background on cloud computing and defines common cloud computing concepts. It then surveys literature applying meta-heuristics like ACO, GA, PSO, and GSA to solve problems related to load balancing and scheduling in cloud environments. The document concludes that meta-heuristic techniques are effective for optimizing resource utilization and management in cloud computing systems.
Open source IoT gateway: Tale of Eclipse Kura, Apache Camel and RhiotHenryk Konsek
This document summarizes a presentation about integrating Apache Camel with Eclipse Kura to enable message routing capabilities for IoT gateways. Eclipse Kura is an OSGi-based IoT gateway framework, while Apache Camel is a message routing framework. The presentation discusses how Camel provides many connectors that are useful for Kura, and how Camel's Enterprise Integration Patterns can help with common routing needs like throttling, routing, and load balancing. Examples are provided showing how to define Camel routes within Kura that can invoke REST APIs, display WiFi networks, and start data syncing based on network connectivity.
Building a real-time data processing pipeline using Apache Kafka, Kafka Conne...Paul Brebner
With the rapid onset of the global Covid-19 Pandemic from the start of this year the USA Centers for Disease Control and Prevention (CDC) had to quickly implement a new Covid-19 specific pipeline to collect testing data from all of the USA’s states and territories, and carry out other critical steps including integration, cleaning, checking, enrichment, analysis, and enforcing data governance and privacy etc. The pipeline then produces multiple consumable results for federal and public agencies. They did this in under 30 days, using Apache Kafka. In this presentation we'll build a similar (but simpler) pipeline for ingesting, integrating, indexing, searching/analysing and visualising some publicly available tidal data. We'll briefly introduce each technology and component, and walk through the steps of using Apache Kafka, Kafka Connect, Elasticsearch and Kibana to build the pipeline and visualise the results.
Spinning Your Drones with Cadence Workflows, Apache Kafka and TensorFlowAll Things Open
Presented at All Things Open 2023
Presented by Paul Brebner - Instaclustr (by Spot by NetApp)
Title: Spinning Your Drones with Cadence Workflows, Apache Kafka and TensorFlow
Abstract: In this talk we’ll build a Drone delivery application, and then use it to do some Machine Learning “on the fly”.
In the 1st part of the talk, we'll build a real-time Drone Delivery demonstration application using a combination of two open-source technologies: Uber’s Cadence (for stateful, scheduled, long-running workflows), and Apache Kafka (for fast streaming data).
With up to 2,000 (simulated) drones and deliveries in progress at once this application generates a vast flow of spatio-temporal data.
In the 2nd part of the talk, we'll use this platform to explore Machine Learning (ML) over streaming and drifting Kafka data with TensorFlow to try and predict which shops will be busy in advance.
Find more info about All Things Open:
On the web: https://www.allthingsopen.org/
Twitter: https://twitter.com/AllThingsOpen
LinkedIn: https://www.linkedin.com/company/all-things-open/
Instagram: https://www.instagram.com/allthingsopen/
Facebook: https://www.facebook.com/AllThingsOpen
Mastodon: https://mastodon.social/@allthingsopen
Threads: https://www.threads.net/@allthingsopen
2023 conference: https://2023.allthingsopen.org/
Spinning Your Drones with Cadence Workflows, Apache Kafka and TensorFlowPaulBrebner2
This document discusses using Cadence workflows, Apache Kafka, and TensorFlow to orchestrate drone deliveries and perform machine learning on streaming delivery data.
Part 1 describes how Cadence workflows can be used to orchestrate drone delivery tasks and coordinate with order workflows, using Kafka for asynchronous communication. Part 2 discusses using Kafka streams to aggregate delivery data and send it to TensorFlow for incremental machine learning to predict busy shops in real-time. The document provides examples of how these technologies can be integrated and addresses challenges of streaming machine learning.
Spinning your Drones with Cadence Workflows and Apache KafkaPaul Brebner
The rapid rise in Big Data use cases over the last decade has been accelerated by popular massively scalable open-source technologies such as Apache Cassandra® for storage, Apache Kafka® for streaming, and OpenSearch® for search. Now there’s a new member of the peloton, Cadence, for orchestration - code-based scalable fault-tolerant workflow orchestration. To illustrate the most important Cadence concepts (and more) we’ll build a realistic drone delivery service demonstration application. We’ll also explore what happens when orchestration meets choreography, and use the drone application to illustrate different ways to integrate Cadence with Apache Kafka, including reusing Kafka microservices. But how scalable is Cadence in practice? We’ll fill the sky with drones - how many drones can we get flying at once?
apidays Australia 2022 - Spinning Your Drones with Cadence Workflows and Apac...apidays
apidays Australia 2022 - Enabling Business Networks
September 14 & 15, 2022
Spinning Your Drones with Cadence Workflows and Apache Kafka
Paul Brebner, Technology Evangelist at Instaclustr
------------
Check out our conferences at https://www.apidays.global/
Do you want to sponsor or talk at one of our conferences?
https://apidays.typeform.com/to/ILJeAaV8
Learn more on APIscene, the global media made by the community for the community:
https://www.apiscene.io
Explore the API ecosystem with the API Landscape:
https://apilandscape.apiscene.io/
Deep dive into the API industry with our reports:
https://www.apidays.global/industry-reports/
Subscribe to our global newsletter:
https://apidays.typeform.com/to/i1MPEW
Fast Open Source Software - Without The FuryPaulBrebner2
Developing fast scalable Big Data applications has been made significantly easier over the last decade with horizontally scalable open-source databases and streaming technologies such as Apache Cassandra and Apache Kafka. Cloud-native trends have also accelerated the uptake and ease of use of these technologies, and they are available as managed services on multiple cloud platforms.
But maybe it has become too easy to embark on building complex distributed applications using multiple massively scalable open-source technologies, as there are still many performance and scalability issues to be aware of. In this talk, I will give a high-level overview of some of the performance and scalability challenges I’ve overcome over the last six years building realistic demonstration applications using Apache Cassandra and Apache Kafka (and more), supplemented with performance insights from our operation of thousands of production clusters. Keynote talk for the Performance Engineering track at Community Over Code Halifax 2023, https://communityovercode.org/schedule-list/#PE001
A Review: Metaheuristic Technique in Cloud ComputingIRJET Journal
This document reviews various meta-heuristic techniques that have been applied to problems in cloud computing, such as task scheduling, load balancing, ant colony optimization (ACO), particle swarm optimization (PSO), and gravitational search algorithm (GSA). It first provides background on cloud computing and defines common cloud computing concepts. It then surveys literature applying meta-heuristics like ACO, GA, PSO, and GSA to solve problems related to load balancing and scheduling in cloud environments. The document concludes that meta-heuristic techniques are effective for optimizing resource utilization and management in cloud computing systems.
Open source IoT gateway: Tale of Eclipse Kura, Apache Camel and RhiotHenryk Konsek
This document summarizes a presentation about integrating Apache Camel with Eclipse Kura to enable message routing capabilities for IoT gateways. Eclipse Kura is an OSGi-based IoT gateway framework, while Apache Camel is a message routing framework. The presentation discusses how Camel provides many connectors that are useful for Kura, and how Camel's Enterprise Integration Patterns can help with common routing needs like throttling, routing, and load balancing. Examples are provided showing how to define Camel routes within Kura that can invoke REST APIs, display WiFi networks, and start data syncing based on network connectivity.
Building a real-time data processing pipeline using Apache Kafka, Kafka Conne...Paul Brebner
With the rapid onset of the global Covid-19 Pandemic from the start of this year the USA Centers for Disease Control and Prevention (CDC) had to quickly implement a new Covid-19 specific pipeline to collect testing data from all of the USA’s states and territories, and carry out other critical steps including integration, cleaning, checking, enrichment, analysis, and enforcing data governance and privacy etc. The pipeline then produces multiple consumable results for federal and public agencies. They did this in under 30 days, using Apache Kafka. In this presentation we'll build a similar (but simpler) pipeline for ingesting, integrating, indexing, searching/analysing and visualising some publicly available tidal data. We'll briefly introduce each technology and component, and walk through the steps of using Apache Kafka, Kafka Connect, Elasticsearch and Kibana to build the pipeline and visualise the results.
Modern DevOps with Spinnaker/Concourse and MicrometerJesse Tate Pulfer
Learn how you can leverage the recent addition of Micrometer to the Spring ecosystem and Cloud Foundry to the Spinnaker ecosystem to help you deliver code quickly and safely. Some highlights include:
Micrometer’s real-time application monitoring capabilities
Spinnaker’s visibility into what is going on in the system
Spinnaker’s safety of deployments and rollbacks
Spinnaker’s deployment scalability
Observability & Continuous Deployment, The Big Picture with Adib Saikali
10:15-11:00am Micrometer: Four Key Performance Indicators for Every Java Service with Jon Schneider
11:00-11:15am Micrometer & PCF with Victor Szoltysek
11:15-11:25am Break
11:25-12:15pm Spinnaker 101 with Olga Kundzich
12:15-12:45pm Lunch
12:45-1:30pm Concourse 101: Container Based CI with Concourse with Jamil Shamy
1:30-1:40pm Break
1:40-2:40pm Putting all the tools together Continuous Deployment with Concourse / Spinnaker / Micrometer & PCF with Jon Schneider
2:40-2:50pm Break
2:50-3:30pm Panel with Concourse / Spinnaker & Micrometer Team
3:30pm Wrap Up
Integrating Cloud Services in Behaviour Programming for Autonomous RobotsCorrado Santoro
This document discusses integrating cloud services into behavior programming for autonomous robots. It introduces PROFETA, a framework for programming robot behaviors using a BDI model. PROFETA allows defining behaviors with rules but synchronous execution can cause issues for slow cloud services. CLEPTA is introduced as a decoupling layer to asynchronously execute cloud service sensors and actions. It uses service invokers and proxies asynchronous sensors and actions. This allows a robot to respond to voice commands using asynchronous cloud text-to-speech and speech-to-text services.
Realtà aumentata ed Azure, un binomio imbattibileAlessio Iafrate
1) The document discusses how augmented reality and Azure are an unbeatable combination. It provides examples of how AR can be used for wayfinding, collaborative design reviews using persistent multi-user virtual content, and empowering firstline workers and those with low vision.
2) The cloud plays a role in AR by providing secure storage and scalable processing for a digital copy of the real world that can be accessed by any user from any device for shared AR content.
3) The document then discusses an example solution architecture for shared AR notes using Azure Spatial Anchors, an Azure App Service, Azure Cosmos DB and a sharing service.
1. Nebula is NASA's open source cloud computing platform built using OpenStack that provides on-demand access to computing resources and storage for large datasets.
2. It allows NASA researchers to run computationally intensive tasks in virtual machines and store huge datasets over 100 terabytes in size.
3. The document discusses Nebula's architecture, services, and case studies of its use at various NASA research centers to support activities like processing images from Mars missions.
Building a Reactive System with Akka - Workshop @ O'Reilly SAConf NYCKonrad Malawski
Intense 3 hour workshop covering Akka Actors, Cluster, Streams, HTTP and more. Including very advanced patterns.
Presented with Henrik Engstrom at O'Reilly Software Architecture Conference in New York City in 2017
End-to-end IoT solutions with Java and Eclipse IoTBenjamin Cabé
This document discusses using Java and the Eclipse IoT project for end-to-end IoT solutions. It describes how Java can be used for sensors/actuators, gateways to connect devices to networks, and cloud backends for device management. It also outlines how the Eclipse IoT projects like Kura, Paho, Californium, and Moquette can be used at each level of a typical IoT solution.
To facilitate a variety of usage scenarios and gradually scale to larger number of users, Galaxy supports deployment on systems ranging from a laptop to a supercomputer to clouds. In this talk, real-world examples of two different models for harnessing a variety of resources will be presented: (1) a centralized Galaxy utilizing a set of geographically distributed resources in support of a large user base, and (2) a model of easily deploying multiple standalone instances of Galaxy to support high resource demands or customizations by a smaller groups. Together, these models showcase the capacity of Galaxy to support a variety of usage scenarios and a variable number of users with a variety of needs.
OpenStack is an open-source cloud computing platform that provides software for building private and public clouds. It was initiated in 2010 by Rackspace and NASA and now has over 100 supporting companies. The document provides an overview of OpenStack, including descriptions of its core modules like Compute (Nova), Object Storage (Swift), Block Storage (Cinder), Networking (Neutron), Dashboard (Horizon), Identity (Keystone), Image Service (Glance), Telemetry (Ceilometer), Orchestration (Heat), and Database (Trove). It discusses the evolution and growth of OpenStack over time through different releases, new features in the current Icehouse release, and how to use the OpenStack APIs.
OpenStack is an open-source cloud computing platform that provides common services for both public and private clouds. It was launched in 2010 by Rackspace and NASA as a joint project. OpenStack provides APIs and tools to provision resources like compute, storage, and networking. It allows building clouds on top of heterogeneous data center hardware. Customers choose OpenStack because it is open source, low cost, customizable, has community support, and is compatible with AWS APIs. Major companies like BMW, Disney, and Walmart use OpenStack in production environments.
FIWARE Wednesday Webinars - Short Term History within Smart SystemsFIWARE
FIWARE Wednesday Webinar - Short Term History within Smart Systems (2nd April 2020)
Corresponding webinar recording: https://youtu.be/fX_YAc7G4Dk
This webinar will show how to utilise times series components and monitor and display trends within FIWARE applications.
Chapter: Core Context
Difficulty: 3
Audience: Any Technical
Presenter: Jason Fox (Senior Technical Evangelist, FIWARE Foundation)
The document discusses using spot instances with Druid for cost savings. It describes that spot instances provide lower costs but less availability than on-demand instances. The document outlines how Druid is configured to use Terraform and Helm for infrastructure setup and deployment. It also discusses how Druid's stateless architecture and redundancy across middle managers and historical nodes allows it to withstand spot instance interruptions without data loss.
Change Data Capture (CDC) With Kafka Connect® and the Debezium PostgreSQL Sou...Paul Brebner
Modern event-based/streaming distributed systems embrace the idea that change is inevitable and actually desirable! Without being change-aware, systems are inflexible, can’t evolve or react, and are simply incapable of keeping up with real-time real-world data. But how can we speed up an “Elephant” (PostgreSQL) to be as fast as a “Cheetah” (Kafka)? In this talk, we'll introduce the Debezium PostgreSQL Connector, and explain how to deploy, configure and run it on a Kafka Connect cluster, explore the semantics and format of the change data events (including Schemas and Table/Topic mapping), and test the performance. Finally, we'll show how to stream the change data events into an example downstream system, Elasticsearch, using an open source sink connector.
Presentation for PostgresConf.CN and PGConf.Asia 2021 https://www.highgo.ca/2022/01/19/2021-pg-asia-conference-delivered-another-successful-online-conference-again/
Introduction to Streaming Distributed Processing with StormBrandon O'Brien
Contact:
https://www.linkedin.com/in/brandonjobrien
@hakczar
Introducing streaming data concepts, Storm cluster architecture, Storm topology architecture, and demonstrate working example of a WordCount topology for SIGKDD Seattle chapter meetup.
Presented by Brandon O'Brien
Code example: https://github.com/OpenDataMining/brandonobrien
Meetup: http://www.meetup.com/seattlesigkdd/events/222955114/
Enabling Microservices Frameworks to Solve Business ProblemsKen Owens
Opening keynote at Mesoscon 2015 with announcements on creating an ecosystem for developing solutions to business problems leveraging Mesos, Mantl.io, Mesosphere Infinity, ZoomData, and Project Calico to create Fog nodes for IoE use cases.
Addressing data plane performance measurement on OpenStack clouds using VMTPSuhail Syed
VMTP is an open source tool released by Cisco that measures data plane performance on OpenStack clouds. It automates the process of measuring VM throughput, latency, and CPU usage for different network traffic flows like intra-tenant, inter-tenant, and north-south traffic. VMTP addresses the need for simple and automated performance measurement on Neutron, the OpenStack networking component, to help with the migration from Nova networking to Neutron. It generates results stored in MongoDB and can create charts from multiple test runs for easy analysis.
OpenStack Collaboration made in heaven with Heat, Mistral, Neutron and more..Trinath Somanchi
Cross-project collaboration is something OpenStack community has embraced for a long time. Common libraries like Oslo reduces the time and effort to build a new service. Another way this manifests is in new OpenStack services getting built using existing services to solve an higher level use-case.
In this talk we are present how the band of projects comprising of Mistral, Tacker, Neutron, Heat, TOSCA-parser and Barbican came together to build an industry leading ETSI NFV Orchestrator that leveraged the best of these projects. Each of these projects brought in critical functionalities needed towards the final product. You will learn how, when strung together, this solution follows the classic Microservices design pattern that the industry is rapidly adopting.
Better Information Faster: Programming the ContinuumIan Foster
This document discusses the computing continuum and efforts to enable better information faster through computation. It provides examples of how techniques like executing tasks closer to data sources or on specialized hardware can significantly accelerate applications. Programming models and managed services are explored for specifying and executing workloads across diverse infrastructure. There are still open questions around optimizing networks, algorithms, and applications for the computing continuum.
The document discusses OpenStack, a open-source cloud computing software framework. It then describes Ostrato cloudSM, a cloud management platform that provides user provisioning of cloud services, API abstraction for integration with IT tools, and governance/reporting capabilities. cloudSM allows users to control all their cloud resources from a single interface. The presentation argues that cloudSM can help OpenStack users by translating templates between formats and providing capabilities beyond typical cloud service provider consoles.
Winning the Lottery with Spring: A Microservices Case Study for the Dutch Lot...VMware Tanzu
SpringOne 2021
Session Title: Winning the Lottery with Spring: A Microservices Case Study for the Dutch Lotteries
Speaker: Joris Kuipers, CTO at Trifork
This document summarizes a presentation about open source IoT solutions using Eclipse Kura and Apache Camel. It discusses the architecture of IoT systems using messaging, describes how Kura provides an OSGi-based gateway for connecting devices, and how Camel can be used within Kura for message routing and integration with backends. Examples are given of how Camel routes could be used in Kura to integrate devices and send data to backends.
WWDC 2024 Keynote Review: For CocoaCoders AustinPatrick Weigel
Overview of WWDC 2024 Keynote Address.
Covers: Apple Intelligence, iOS18, macOS Sequoia, iPadOS, watchOS, visionOS, and Apple TV+.
Understandable dialogue on Apple TV+
On-device app controlling AI.
Access to ChatGPT with a guest appearance by Chief Data Thief Sam Altman!
App Locking! iPhone Mirroring! And a Calculator!!
Modern DevOps with Spinnaker/Concourse and MicrometerJesse Tate Pulfer
Learn how you can leverage the recent addition of Micrometer to the Spring ecosystem and Cloud Foundry to the Spinnaker ecosystem to help you deliver code quickly and safely. Some highlights include:
Micrometer’s real-time application monitoring capabilities
Spinnaker’s visibility into what is going on in the system
Spinnaker’s safety of deployments and rollbacks
Spinnaker’s deployment scalability
Observability & Continuous Deployment, The Big Picture with Adib Saikali
10:15-11:00am Micrometer: Four Key Performance Indicators for Every Java Service with Jon Schneider
11:00-11:15am Micrometer & PCF with Victor Szoltysek
11:15-11:25am Break
11:25-12:15pm Spinnaker 101 with Olga Kundzich
12:15-12:45pm Lunch
12:45-1:30pm Concourse 101: Container Based CI with Concourse with Jamil Shamy
1:30-1:40pm Break
1:40-2:40pm Putting all the tools together Continuous Deployment with Concourse / Spinnaker / Micrometer & PCF with Jon Schneider
2:40-2:50pm Break
2:50-3:30pm Panel with Concourse / Spinnaker & Micrometer Team
3:30pm Wrap Up
Integrating Cloud Services in Behaviour Programming for Autonomous RobotsCorrado Santoro
This document discusses integrating cloud services into behavior programming for autonomous robots. It introduces PROFETA, a framework for programming robot behaviors using a BDI model. PROFETA allows defining behaviors with rules but synchronous execution can cause issues for slow cloud services. CLEPTA is introduced as a decoupling layer to asynchronously execute cloud service sensors and actions. It uses service invokers and proxies asynchronous sensors and actions. This allows a robot to respond to voice commands using asynchronous cloud text-to-speech and speech-to-text services.
Realtà aumentata ed Azure, un binomio imbattibileAlessio Iafrate
1) The document discusses how augmented reality and Azure are an unbeatable combination. It provides examples of how AR can be used for wayfinding, collaborative design reviews using persistent multi-user virtual content, and empowering firstline workers and those with low vision.
2) The cloud plays a role in AR by providing secure storage and scalable processing for a digital copy of the real world that can be accessed by any user from any device for shared AR content.
3) The document then discusses an example solution architecture for shared AR notes using Azure Spatial Anchors, an Azure App Service, Azure Cosmos DB and a sharing service.
1. Nebula is NASA's open source cloud computing platform built using OpenStack that provides on-demand access to computing resources and storage for large datasets.
2. It allows NASA researchers to run computationally intensive tasks in virtual machines and store huge datasets over 100 terabytes in size.
3. The document discusses Nebula's architecture, services, and case studies of its use at various NASA research centers to support activities like processing images from Mars missions.
Building a Reactive System with Akka - Workshop @ O'Reilly SAConf NYCKonrad Malawski
Intense 3 hour workshop covering Akka Actors, Cluster, Streams, HTTP and more. Including very advanced patterns.
Presented with Henrik Engstrom at O'Reilly Software Architecture Conference in New York City in 2017
End-to-end IoT solutions with Java and Eclipse IoTBenjamin Cabé
This document discusses using Java and the Eclipse IoT project for end-to-end IoT solutions. It describes how Java can be used for sensors/actuators, gateways to connect devices to networks, and cloud backends for device management. It also outlines how the Eclipse IoT projects like Kura, Paho, Californium, and Moquette can be used at each level of a typical IoT solution.
To facilitate a variety of usage scenarios and gradually scale to larger number of users, Galaxy supports deployment on systems ranging from a laptop to a supercomputer to clouds. In this talk, real-world examples of two different models for harnessing a variety of resources will be presented: (1) a centralized Galaxy utilizing a set of geographically distributed resources in support of a large user base, and (2) a model of easily deploying multiple standalone instances of Galaxy to support high resource demands or customizations by a smaller groups. Together, these models showcase the capacity of Galaxy to support a variety of usage scenarios and a variable number of users with a variety of needs.
OpenStack is an open-source cloud computing platform that provides software for building private and public clouds. It was initiated in 2010 by Rackspace and NASA and now has over 100 supporting companies. The document provides an overview of OpenStack, including descriptions of its core modules like Compute (Nova), Object Storage (Swift), Block Storage (Cinder), Networking (Neutron), Dashboard (Horizon), Identity (Keystone), Image Service (Glance), Telemetry (Ceilometer), Orchestration (Heat), and Database (Trove). It discusses the evolution and growth of OpenStack over time through different releases, new features in the current Icehouse release, and how to use the OpenStack APIs.
OpenStack is an open-source cloud computing platform that provides common services for both public and private clouds. It was launched in 2010 by Rackspace and NASA as a joint project. OpenStack provides APIs and tools to provision resources like compute, storage, and networking. It allows building clouds on top of heterogeneous data center hardware. Customers choose OpenStack because it is open source, low cost, customizable, has community support, and is compatible with AWS APIs. Major companies like BMW, Disney, and Walmart use OpenStack in production environments.
FIWARE Wednesday Webinars - Short Term History within Smart SystemsFIWARE
FIWARE Wednesday Webinar - Short Term History within Smart Systems (2nd April 2020)
Corresponding webinar recording: https://youtu.be/fX_YAc7G4Dk
This webinar will show how to utilise times series components and monitor and display trends within FIWARE applications.
Chapter: Core Context
Difficulty: 3
Audience: Any Technical
Presenter: Jason Fox (Senior Technical Evangelist, FIWARE Foundation)
The document discusses using spot instances with Druid for cost savings. It describes that spot instances provide lower costs but less availability than on-demand instances. The document outlines how Druid is configured to use Terraform and Helm for infrastructure setup and deployment. It also discusses how Druid's stateless architecture and redundancy across middle managers and historical nodes allows it to withstand spot instance interruptions without data loss.
Change Data Capture (CDC) With Kafka Connect® and the Debezium PostgreSQL Sou...Paul Brebner
Modern event-based/streaming distributed systems embrace the idea that change is inevitable and actually desirable! Without being change-aware, systems are inflexible, can’t evolve or react, and are simply incapable of keeping up with real-time real-world data. But how can we speed up an “Elephant” (PostgreSQL) to be as fast as a “Cheetah” (Kafka)? In this talk, we'll introduce the Debezium PostgreSQL Connector, and explain how to deploy, configure and run it on a Kafka Connect cluster, explore the semantics and format of the change data events (including Schemas and Table/Topic mapping), and test the performance. Finally, we'll show how to stream the change data events into an example downstream system, Elasticsearch, using an open source sink connector.
Presentation for PostgresConf.CN and PGConf.Asia 2021 https://www.highgo.ca/2022/01/19/2021-pg-asia-conference-delivered-another-successful-online-conference-again/
Introduction to Streaming Distributed Processing with StormBrandon O'Brien
Contact:
https://www.linkedin.com/in/brandonjobrien
@hakczar
Introducing streaming data concepts, Storm cluster architecture, Storm topology architecture, and demonstrate working example of a WordCount topology for SIGKDD Seattle chapter meetup.
Presented by Brandon O'Brien
Code example: https://github.com/OpenDataMining/brandonobrien
Meetup: http://www.meetup.com/seattlesigkdd/events/222955114/
Enabling Microservices Frameworks to Solve Business ProblemsKen Owens
Opening keynote at Mesoscon 2015 with announcements on creating an ecosystem for developing solutions to business problems leveraging Mesos, Mantl.io, Mesosphere Infinity, ZoomData, and Project Calico to create Fog nodes for IoE use cases.
Addressing data plane performance measurement on OpenStack clouds using VMTPSuhail Syed
VMTP is an open source tool released by Cisco that measures data plane performance on OpenStack clouds. It automates the process of measuring VM throughput, latency, and CPU usage for different network traffic flows like intra-tenant, inter-tenant, and north-south traffic. VMTP addresses the need for simple and automated performance measurement on Neutron, the OpenStack networking component, to help with the migration from Nova networking to Neutron. It generates results stored in MongoDB and can create charts from multiple test runs for easy analysis.
OpenStack Collaboration made in heaven with Heat, Mistral, Neutron and more..Trinath Somanchi
Cross-project collaboration is something OpenStack community has embraced for a long time. Common libraries like Oslo reduces the time and effort to build a new service. Another way this manifests is in new OpenStack services getting built using existing services to solve an higher level use-case.
In this talk we are present how the band of projects comprising of Mistral, Tacker, Neutron, Heat, TOSCA-parser and Barbican came together to build an industry leading ETSI NFV Orchestrator that leveraged the best of these projects. Each of these projects brought in critical functionalities needed towards the final product. You will learn how, when strung together, this solution follows the classic Microservices design pattern that the industry is rapidly adopting.
Better Information Faster: Programming the ContinuumIan Foster
This document discusses the computing continuum and efforts to enable better information faster through computation. It provides examples of how techniques like executing tasks closer to data sources or on specialized hardware can significantly accelerate applications. Programming models and managed services are explored for specifying and executing workloads across diverse infrastructure. There are still open questions around optimizing networks, algorithms, and applications for the computing continuum.
The document discusses OpenStack, a open-source cloud computing software framework. It then describes Ostrato cloudSM, a cloud management platform that provides user provisioning of cloud services, API abstraction for integration with IT tools, and governance/reporting capabilities. cloudSM allows users to control all their cloud resources from a single interface. The presentation argues that cloudSM can help OpenStack users by translating templates between formats and providing capabilities beyond typical cloud service provider consoles.
Winning the Lottery with Spring: A Microservices Case Study for the Dutch Lot...VMware Tanzu
SpringOne 2021
Session Title: Winning the Lottery with Spring: A Microservices Case Study for the Dutch Lotteries
Speaker: Joris Kuipers, CTO at Trifork
This document summarizes a presentation about open source IoT solutions using Eclipse Kura and Apache Camel. It discusses the architecture of IoT systems using messaging, describes how Kura provides an OSGi-based gateway for connecting devices, and how Camel can be used within Kura for message routing and integration with backends. Examples are given of how Camel routes could be used in Kura to integrate devices and send data to backends.
Similar to Spinning your Drones with Cadence Workflows, Apache Kafka, and TensforFlow (20)
WWDC 2024 Keynote Review: For CocoaCoders AustinPatrick Weigel
Overview of WWDC 2024 Keynote Address.
Covers: Apple Intelligence, iOS18, macOS Sequoia, iPadOS, watchOS, visionOS, and Apple TV+.
Understandable dialogue on Apple TV+
On-device app controlling AI.
Access to ChatGPT with a guest appearance by Chief Data Thief Sam Altman!
App Locking! iPhone Mirroring! And a Calculator!!
What is Master Data Management by PiLog Groupaymanquadri279
PiLog Group's Master Data Record Manager (MDRM) is a sophisticated enterprise solution designed to ensure data accuracy, consistency, and governance across various business functions. MDRM integrates advanced data management technologies to cleanse, classify, and standardize master data, thereby enhancing data quality and operational efficiency.
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Łukasz Chruściel
No one wants their application to drag like a car stuck in the slow lane! Yet it’s all too common to encounter bumpy, pothole-filled solutions that slow the speed of any application. Symfony apps are not an exception.
In this talk, I will take you for a spin around the performance racetrack. We’ll explore common pitfalls - those hidden potholes on your application that can cause unexpected slowdowns. Learn how to spot these performance bumps early, and more importantly, how to navigate around them to keep your application running at top speed.
We will focus in particular on tuning your engine at the application level, making the right adjustments to ensure that your system responds like a well-oiled, high-performance race car.
OpenMetadata Community Meeting - 5th June 2024OpenMetadata
The OpenMetadata Community Meeting was held on June 5th, 2024. In this meeting, we discussed about the data quality capabilities that are integrated with the Incident Manager, providing a complete solution to handle your data observability needs. Watch the end-to-end demo of the data quality features.
* How to run your own data quality framework
* What is the performance impact of running data quality frameworks
* How to run the test cases in your own ETL pipelines
* How the Incident Manager is integrated
* Get notified with alerts when test cases fail
Watch the meeting recording here - https://www.youtube.com/watch?v=UbNOje0kf6E
Measures in SQL (SIGMOD 2024, Santiago, Chile)Julian Hyde
SQL has attained widespread adoption, but Business Intelligence tools still use their own higher level languages based upon a multidimensional paradigm. Composable calculations are what is missing from SQL, and we propose a new kind of column, called a measure, that attaches a calculation to a table. Like regular tables, tables with measures are composable and closed when used in queries.
SQL-with-measures has the power, conciseness and reusability of multidimensional languages but retains SQL semantics. Measure invocations can be expanded in place to simple, clear SQL.
To define the evaluation semantics for measures, we introduce context-sensitive expressions (a way to evaluate multidimensional expressions that is consistent with existing SQL semantics), a concept called evaluation context, and several operations for setting and modifying the evaluation context.
A talk at SIGMOD, June 9–15, 2024, Santiago, Chile
Authors: Julian Hyde (Google) and John Fremlin (Google)
https://doi.org/10.1145/3626246.3653374
Unveiling the Advantages of Agile Software Development.pdfbrainerhub1
Learn about Agile Software Development's advantages. Simplify your workflow to spur quicker innovation. Jump right in! We have also discussed the advantages.
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j
Dr. Jesús Barrasa, Head of Solutions Architecture for EMEA, Neo4j
Découvrez les dernières innovations de Neo4j, et notamment les dernières intégrations cloud et les améliorations produits qui font de Neo4j un choix essentiel pour les développeurs qui créent des applications avec des données interconnectées et de l’IA générative.
8 Best Automated Android App Testing Tool and Framework in 2024.pdfkalichargn70th171
Regarding mobile operating systems, two major players dominate our thoughts: Android and iPhone. With Android leading the market, software development companies are focused on delivering apps compatible with this OS. Ensuring an app's functionality across various Android devices, OS versions, and hardware specifications is critical, making Android app testing essential.
Flutter is a popular open source, cross-platform framework developed by Google. In this webinar we'll explore Flutter and its architecture, delve into the Flutter Embedder and Flutter’s Dart language, discover how to leverage Flutter for embedded device development, learn about Automotive Grade Linux (AGL) and its consortium and understand the rationale behind AGL's choice of Flutter for next-gen IVI systems. Don’t miss this opportunity to discover whether Flutter is right for your project.
UI5con 2024 - Keynote: Latest News about UI5 and it’s EcosystemPeter Muessig
Learn about the latest innovations in and around OpenUI5/SAPUI5: UI5 Tooling, UI5 linter, UI5 Web Components, Web Components Integration, UI5 2.x, UI5 GenAI.
Recording:
https://www.youtube.com/live/MSdGLG2zLy8?si=INxBHTqkwHhxV5Ta&t=0
Software Engineering, Software Consulting, Tech Lead, Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Transaction, Spring MVC, OpenShift Cloud Platform, Kafka, REST, SOAP, LLD & HLD.
UI5con 2024 - Boost Your Development Experience with UI5 Tooling ExtensionsPeter Muessig
The UI5 tooling is the development and build tooling of UI5. It is built in a modular and extensible way so that it can be easily extended by your needs. This session will showcase various tooling extensions which can boost your development experience by far so that you can really work offline, transpile your code in your project to use even newer versions of EcmaScript (than 2022 which is supported right now by the UI5 tooling), consume any npm package of your choice in your project, using different kind of proxies, and even stitching UI5 projects during development together to mimic your target environment.
Graspan: A Big Data System for Big Code AnalysisAftab Hussain
We built a disk-based parallel graph system, Graspan, that uses a novel edge-pair centric computation model to compute dynamic transitive closures on very large program graphs.
We implement context-sensitive pointer/alias and dataflow analyses on Graspan. An evaluation of these analyses on large codebases such as Linux shows that their Graspan implementations scale to millions of lines of code and are much simpler than their original implementations.
These analyses were used to augment the existing checkers; these augmented checkers found 132 new NULL pointer bugs and 1308 unnecessary NULL tests in Linux 4.4.0-rc5, PostgreSQL 8.3.9, and Apache httpd 2.2.18.
- Accepted in ASPLOS ‘17, Xi’an, China.
- Featured in the tutorial, Systemized Program Analyses: A Big Data Perspective on Static Analysis Scalability, ASPLOS ‘17.
- Invited for presentation at SoCal PLS ‘16.
- Invited for poster presentation at PLDI SRC ‘16.
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeAftab Hussain
Understanding variable roles in code has been found to be helpful by students
in learning programming -- could variable roles help deep neural models in
performing coding tasks? We do an exploratory study.
- These are slides of the talk given at InteNSE'23: The 1st International Workshop on Interpretability and Robustness in Neural Software Engineering, co-located with the 45th International Conference on Software Engineering, ICSE 2023, Melbourne Australia
Transform Your Communication with Cloud-Based IVR SolutionsTheSMSPoint
Discover the power of Cloud-Based IVR Solutions to streamline communication processes. Embrace scalability and cost-efficiency while enhancing customer experiences with features like automated call routing and voice recognition. Accessible from anywhere, these solutions integrate seamlessly with existing systems, providing real-time analytics for continuous improvement. Revolutionize your communication strategy today with Cloud-Based IVR Solutions. Learn more at: https://thesmspoint.com/channel/cloud-telephony