Presentation at Southern California Linux Expo (SCaLE 15x). Discussion on what happens when you take a Software-based Storage platform integrated with Container Schedulers and moving that into the Cloud.
ContainerCon EU 2016 - Software-Defined Storage and Container SchedulersDavid vonThenen
Presentation at ContainerCon EU 2016. Discussing how Software-Defined Storage and Container Schedulers can compliment each other. Discuss the idea of building a Software-Defined Storage Framework for Mesos.
How Container Schedulers and Software-based Storage will Change the CloudDavid vonThenen
Persistent applications can be complex to manage and operate at scale but tend to be perfect for modern schedulers like Apache Mesos. The current trend in Containers is taking their ephemeral nature and turning it upside-down by running databases, key/value stores, WordPress, and etc within them. Internal direct attached storage and external storage are both options in running your long-running, persistent applications. The problem is how do you run these applications and containers in production environments?
This talk outlines how 2 Layer Scheduling, as known as the Offer-Accept model, found in Mesos and Software-based Storage enables deployment of managed frameworks and tasks while maintaining high availability, scale-out growth, and automation. This combination of technology will help build a "Skynet" like architecture for persistent applications and containers in the cloud.
Taking Care of Business at Office Depot with Elastic Cloud Enterprise Elasticsearch
Learn how Office Depot consolidated and migrated stand-alone Elasticsearch clusters into Elastic Cloud Enterprise to minimize compute costs while improving overall performance and time to market.
A New Centralized Volume Storage Solution for Docker and Container Cloud by W...Docker, Inc.
I would like to introduce Elara, which is a centralized storage solution for building a huge container-based cloud platform and it can work as a Docker volume plugin.
Elara can work with openstack (Cinder, Manila, Swift) and storages such as SAN and NAS, it has several advantages:
- No central control node (Decentralized)
- Microservice architecture
- Supports Docker volume plugin with extended volume operations (snapshot, migration, QoS etc.)
- Supports different kinds of backend storage including block device, filesystem storage and object storage
- Supports storage resource scheduler (storage pools)
- Easy to install and use
How Class Data Sharing Can Speed up Your Jakarta EE Application StartupRudy De Busscher
Java Byte code is OS independent, which means that your application's startup takes more time than a native image. Using the Class Data Sharing functionality introduced in more recent versions of the JVM, you can prepare your application so that it will load very fast.
In this presentation, I'll go into more detail what Class Data Sharing is and the differences between the OpenJDK and OpenJ9 versions. With some Jakarta EE demo applications, you will see gains that you can achieve and reduce memory footprint a lot in Docker containers by sharing memory.
Microservices architecture has many benefits. But it comes at a cost. Running microservices and monitoring what’s going on is tedious. That’s why MicroProfile adopts monitoring as a first-class concept. In this session, learn how MicroProfile runtimes collect metrics and how to seamlessly collect them with tools like Prometheus and Grafana. Learn how MicroProfile makes it easy to connect information about interrelated service calls, how to gather the information and analyze system bottlenecks, how to deploy and scale MicroProfile applications with Kubernetes and how to react to their health status to detect and automatically recover from failures.
The Mushroom Cloud Effect or What Happens When Containers Fail? by Alois Mayr...Docker, Inc.
Micro service architectures result in up to 20 times larger environments than their monolithic counterparts. In such big and interconnected environments container metrics will tell you about infrastructure health but not service health. Even if you have implemented service health checks to quickly react on service failures, in a resilient system you will see intermediary mushroom cloud effects of a large number of services being affected temporarily. How do you find out what really caused the problem and how to distinguish effect vs. cause?
In this session we will do post-mortem analysis by walking through different cases of failures we've observed in a real-world large e-commerce production environment and show you how to figure out what actually caused the failures.
ContainerCon EU 2016 - Software-Defined Storage and Container SchedulersDavid vonThenen
Presentation at ContainerCon EU 2016. Discussing how Software-Defined Storage and Container Schedulers can compliment each other. Discuss the idea of building a Software-Defined Storage Framework for Mesos.
How Container Schedulers and Software-based Storage will Change the CloudDavid vonThenen
Persistent applications can be complex to manage and operate at scale but tend to be perfect for modern schedulers like Apache Mesos. The current trend in Containers is taking their ephemeral nature and turning it upside-down by running databases, key/value stores, WordPress, and etc within them. Internal direct attached storage and external storage are both options in running your long-running, persistent applications. The problem is how do you run these applications and containers in production environments?
This talk outlines how 2 Layer Scheduling, as known as the Offer-Accept model, found in Mesos and Software-based Storage enables deployment of managed frameworks and tasks while maintaining high availability, scale-out growth, and automation. This combination of technology will help build a "Skynet" like architecture for persistent applications and containers in the cloud.
Taking Care of Business at Office Depot with Elastic Cloud Enterprise Elasticsearch
Learn how Office Depot consolidated and migrated stand-alone Elasticsearch clusters into Elastic Cloud Enterprise to minimize compute costs while improving overall performance and time to market.
A New Centralized Volume Storage Solution for Docker and Container Cloud by W...Docker, Inc.
I would like to introduce Elara, which is a centralized storage solution for building a huge container-based cloud platform and it can work as a Docker volume plugin.
Elara can work with openstack (Cinder, Manila, Swift) and storages such as SAN and NAS, it has several advantages:
- No central control node (Decentralized)
- Microservice architecture
- Supports Docker volume plugin with extended volume operations (snapshot, migration, QoS etc.)
- Supports different kinds of backend storage including block device, filesystem storage and object storage
- Supports storage resource scheduler (storage pools)
- Easy to install and use
How Class Data Sharing Can Speed up Your Jakarta EE Application StartupRudy De Busscher
Java Byte code is OS independent, which means that your application's startup takes more time than a native image. Using the Class Data Sharing functionality introduced in more recent versions of the JVM, you can prepare your application so that it will load very fast.
In this presentation, I'll go into more detail what Class Data Sharing is and the differences between the OpenJDK and OpenJ9 versions. With some Jakarta EE demo applications, you will see gains that you can achieve and reduce memory footprint a lot in Docker containers by sharing memory.
Microservices architecture has many benefits. But it comes at a cost. Running microservices and monitoring what’s going on is tedious. That’s why MicroProfile adopts monitoring as a first-class concept. In this session, learn how MicroProfile runtimes collect metrics and how to seamlessly collect them with tools like Prometheus and Grafana. Learn how MicroProfile makes it easy to connect information about interrelated service calls, how to gather the information and analyze system bottlenecks, how to deploy and scale MicroProfile applications with Kubernetes and how to react to their health status to detect and automatically recover from failures.
The Mushroom Cloud Effect or What Happens When Containers Fail? by Alois Mayr...Docker, Inc.
Micro service architectures result in up to 20 times larger environments than their monolithic counterparts. In such big and interconnected environments container metrics will tell you about infrastructure health but not service health. Even if you have implemented service health checks to quickly react on service failures, in a resilient system you will see intermediary mushroom cloud effects of a large number of services being affected temporarily. How do you find out what really caused the problem and how to distinguish effect vs. cause?
In this session we will do post-mortem analysis by walking through different cases of failures we've observed in a real-world large e-commerce production environment and show you how to figure out what actually caused the failures.
Сергей Радзыняк ".NET Microservices in Real Life"Fwdays
На доповіді ми розглянемо на прикладі діючої фінансової системи наступні моменти:
- поточну архітектуру системи. Як і чому ми перейшли з моноліта на мікросервіси
- компоненти системи (MsSQL, MongoDB, RabbitMQ, Redis, Hangfire, AWS S3 Bucket, і деякі інші), критерії їх вибору і -
- труднощі, які виникли при роботі з ними
міжкомпонентну взаємодію
- бібліотеки і практики, які використовуються для побудови мікросервісів системи
- розглянемо декілька функціональних ланцюжків системи. -- Розповім про труднощі, які виникли при їх дизайні і впровадженні
Virtual Machines – Remember some of Googles VMS are used for different purposes. Either for an IaaS or PaaS service approach.
Cloud Functions is geared towards a serverless approach and focused on microservices
App Engine is focused on PaaS and can be delivered in two different solutions (Standard or Flexible)
Container Engine- Awesome solution for developers wanting a simple and lightweight container.
Note! A Compute Engine instances can run Linux and Windows Server
Stay productive while slicing up the monolith Markus Eisele
DevNexus 2017
Microservices-based architectures are en-vogue. The last couple of
years we have learned how the thought-leaders implement them, and
every other week we have heard about how containers and
Platform-as-a-Service offerings make them ultimately happen.
The problem is that the developers are almost forgotten and left alone
with provisioning and continuous delivery systems, containers and
resource schedulers, and frameworks and patterns to help slice
existing monoliths. How can we get back in control and efficiently
develop them without having to provision complete production-like
environments locally, by hand?
All the new buzzwords, frameworks, and hyped tools have made us forget
ourselves—Java developers–and what it means to be productive and have
fun building systems. The problem that we set out to solve is: how can
we run real-world Microservices-based systems on our local development
machines, managing provisioning, and orchestration of potentially
hundreds of services directly from a single command line tool, without
sacrificing productivity enablers like hot code reloading and instant
turnaround time?
During this talk, you’ll experience first-hand how much fun it can be
to develop large-scale Microservices-based systems. You will learn a
lot about what it takes to fail fast and recover and truly understand
the power of a fully integrated Microservices development environment.
Kubernetes – An open platform for container orchestrationinovex GmbH
Datum: 30.08.2017
Event: GridKA School 2017
Speaker: Johannes M. Scheuermann
Mehr Tech-Vorträge: https://www.inovex.de/de/content-pool/vortraege/
Mehr Tech-Artikel: https://www.inovex.de/blog/
Сергей Радзыняк ".NET Microservices in Real Life"Fwdays
На доповіді ми розглянемо на прикладі діючої фінансової системи наступні моменти:
- поточну архітектуру системи. Як і чому ми перейшли з моноліта на мікросервіси
- компоненти системи (MsSQL, MongoDB, RabbitMQ, Redis, Hangfire, AWS S3 Bucket, і деякі інші), критерії їх вибору і -
- труднощі, які виникли при роботі з ними
міжкомпонентну взаємодію
- бібліотеки і практики, які використовуються для побудови мікросервісів системи
- розглянемо декілька функціональних ланцюжків системи. -- Розповім про труднощі, які виникли при їх дизайні і впровадженні
Virtual Machines – Remember some of Googles VMS are used for different purposes. Either for an IaaS or PaaS service approach.
Cloud Functions is geared towards a serverless approach and focused on microservices
App Engine is focused on PaaS and can be delivered in two different solutions (Standard or Flexible)
Container Engine- Awesome solution for developers wanting a simple and lightweight container.
Note! A Compute Engine instances can run Linux and Windows Server
Stay productive while slicing up the monolith Markus Eisele
DevNexus 2017
Microservices-based architectures are en-vogue. The last couple of
years we have learned how the thought-leaders implement them, and
every other week we have heard about how containers and
Platform-as-a-Service offerings make them ultimately happen.
The problem is that the developers are almost forgotten and left alone
with provisioning and continuous delivery systems, containers and
resource schedulers, and frameworks and patterns to help slice
existing monoliths. How can we get back in control and efficiently
develop them without having to provision complete production-like
environments locally, by hand?
All the new buzzwords, frameworks, and hyped tools have made us forget
ourselves—Java developers–and what it means to be productive and have
fun building systems. The problem that we set out to solve is: how can
we run real-world Microservices-based systems on our local development
machines, managing provisioning, and orchestration of potentially
hundreds of services directly from a single command line tool, without
sacrificing productivity enablers like hot code reloading and instant
turnaround time?
During this talk, you’ll experience first-hand how much fun it can be
to develop large-scale Microservices-based systems. You will learn a
lot about what it takes to fail fast and recover and truly understand
the power of a fully integrated Microservices development environment.
Kubernetes – An open platform for container orchestrationinovex GmbH
Datum: 30.08.2017
Event: GridKA School 2017
Speaker: Johannes M. Scheuermann
Mehr Tech-Vorträge: https://www.inovex.de/de/content-pool/vortraege/
Mehr Tech-Artikel: https://www.inovex.de/blog/
ParaScale private cloud storage software Customer presentation. Changing the economics of Bulk FIle and Content Storage. Software can be used to create both private and public clouds for Service providers and enterprises. Use commodity hardware, start small and grow as needed. Thin provision file systems and access using NFS, FTP, HTTP and WebDav. Global Namespace and transparent data migration with your choice of hardware. Massive parallel scaling and performance with enterprise features like load and capacity balancing, thin provisioning, replication, High Availability. Two types of nodes - Control nodes and Storage nodes. Tune the Cloud for Performance or Capacity, Capacity Scale Out, Performance Scale Out, Incremental additions to bandwidth and storage, Simplified Installation and Management with doanload and go,
Tracxn Research — Enterprise Storage Landscape, November 2016Tracxn
Startups which offer backup storage solutions for enterprises emerged as the top funded business model of the year in the enterprise storage sector, accounting for 40% ($371M) of the total funding secured by the sector. The backup storage business model also witnessed a 70% YoY rise.
Prepping Your Engineering Candidates to Reduce Your False NegativesGayle McDowell
How do
Have you ever sourced the perfect software developer, only to have him or her bomb the interview? What should programmers expect when asked to go to the whiteboard? How “buttoned up” should their code be? How do your hiring managers assess problem solving capabilities? What key behaviors are highly valued at your company? You will learn how to coach your tech candidates effectively, helping more of them survive the interview process, and increase your recruiting ROI.
Slides from Workshop 'Cloud Foundry: Hands-on Deployment Workshop'
http://www.meetup.com/CloudFoundry/events/150601282/
In this workshop you will learn Cloud Foundry fundamental concepts, setup, deployment and operations. We’ll cover a couple of alternatives to deploy CF in a local environment for learning and testing purposes as well as deploying Cloud Foundry atop IaaS production level environment, being able to manage hundreds of components and thousands of applications.
If you did not have a chance to work with Cloud Foundry, it may be useful to test its features locally at first. Deploying this environment on a local machine allows you to get hands-on experience in the solution and, in case you are a contributor, to test some features before you commit them to a production environment.
An introduction to {code} by Dell EMC, our mission on containers, and our core project REX-Ray. This will give the audience an understanding of why REX-Ray is important and where you can go to learn more.
Getting Started with Platform-as-a-ServiceCloudBees
A short introduction to Platform-as-a-Service, hsowing you to use CloudBees PaaS to develop, test and run your Java and other web applications in the Cloud
Latest (storage IO) patterns for cloud-native applications OpenEBS
Applying micro service patterns to storage giving each workload its own Container Attached Storage (CAS) system. This puts the DevOps persona within full control of the storage requirements and brings data agility to k8s persistent workloads. We will go over the concept and the implementation of CAS, as well as its orchestration.
Phil Pursglove: Velocity, the Need for Speed - epicenter 2010IrishDev.com
The Irish Software Show, ( http://epicenter.ie ) Phil Pursglove: Velocity, the Need for Speed
Velocity is Microsoft's new distributed caching framework.
In this session we'll look at why you might want a distributed cache, how to configure your applications (and servers!) to use it, and how to manage it when it goes live.
We'll also explore some of the other features of Velocity, including concurrency and locking, tagging, building a highly-available cache, and how to integrate Velocity into ASP.NET's output caching mechanism.
http://epicenter.ie/2010.html?zone_id=20&mode=agenda&session=165#session
Cost is often the conversation starter when customers think about moving to the cloud. AWS helps lower costs for customers through its “pay only for what you use” pricing model, frequent price drops, and pricing model choice to support variable & stable workloads. In this session, you will learn about the financial considerations of owning and operating a traditional data center or managed hosting provider versus utilizing AWS. We will detail our TCO methodology and showcase cost comparisons for some common customer use-cases. We’ll also cover a few AWS cost optimization areas, including Spot and Reserved Instances, EC2 Auto Scaling, and consolidated billing.
Presenter:
Amit Sharma, Solution Architect, Amazon Internet Services
Krishnenjit Roy, Director IT Operations, Freshdesk
{code} and Containers - Open Source Infrastructure within Dell TechnologiesThe {code} Team
Learn how The {code} Team is building new infrastructure possibilities for persistent storage in all the major container ecosystems such as Kubernetes, Docker, and Mesos with native integrations and contributing the Container Storage Interface
AWS Elastic Beanstalk is the fastest and simplest way to get an application up and running on Amazon Web Services. Developers can simply upload their application code and the service automatically handles all the details such as resource provisioning, load balancing, auto-scaling, and monitoring. This session shows you how to connect your Git repository with Amazon Web Services, deploy your code to AWS Elastic Beanstalk, easily enable or disable application functionality, and perform zero-downtime deployments through interactive demos and code samples.
Timothee Cruse, Solutions Architect, Amazon Web Services, ASEAN
The Kubernetes WebLogic revival (part 1)Simon Haslam
The first of two sessions Martien & I presented at UKOUG Techfest19 in Brighton, UK about:
(a) Running WebLogic in containers, managed by Kubernetes
(b) Oracle's Container Engine for Kubernetes (OKE) - Oracle Cloud's managed k8s service
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Key Trends Shaping the Future of Infrastructure.pdf
SCaLE 15x - How Container Schedulers and Software-Defined Storage will Change the Cloud
1. How Container Schedulers and
Software-Defined Storage will Change the Cloud
David vonThenen
{code} by Dell EMC
@dvonthenen
http://dvonthenen.com
github.com/dvonthenen
2. Agenda
• Review of Software-Defined Storage
• Container Schedulers
• Schedulers + Software-Defined Storage = Awesome!
• To the Cloud!!
• Demo
4. What are they?
• Many definitions… most agree on:
• Software-Defined Storage (SDS) serve as abstraction
layer above underlying storage
• Provides a (programmatic) mechanism to provision
storage
• Varying degrees of SDS: NFS, VMware VSAN
5. What makes them unique?
• Operational - Manage provisioning process and data
independent of underlying hardware
• Physical - Abstract consumed logical storage from
underlying physical storage
• Policy - Automation of policy driven both external (users)
and internal (platform)
• Day 2 Operations - Maintenance is inherently different
8. NFS & VSAN are different…
• What makes NFS and VSAN special?
• They are both Software-based Storage
Platforms!
• No special hardware, purpose built
appliance, storage array, storage
controller
10. What is a Scheduler?
• Fair and efficient workload
placement
• Adhering to a set of constraints
• Quickly (and deterministically)
dispatching jobs
• Robust and tolerates errors
11. Scheduling Work
• Containers like…
– Docker
– Mesos Unified Containerizer
– rkt (CoreOS)
• Cluster Manager
• Task placement based on resource
• Operational constraints
12. Custom Scheduling
• Many allow creation of own custom Scheduler
• Customization for your application:
– Run-Time?
– Availability?
– Fault Tolerance?
– Hardware Accel?
– Location?
14. Mesos Frameworks
• Ability to schedule tasks based on Application needs
• Framework implements a Scheduler and Executor
– Scheduler – Accepts/Denies resources
– Executor – Application
• Offer / Accept
Mechanism
• Multiple Frameworks
run within the cluster
17. Better Together
• Let’s create a Software-
Defined Storage Framework
• ScaleIO + Mesos Framework =
Awesome Sauce!
• First released in Sept 2016.
Now on version 0.3.1
• https://github.com/codedellemc
/scaleio-framework
18. Let’s take a look: ScaleIO
• Software-based Storage Platform
• Scale-out block storage
• Linear performance
• Elastic architecture
• Infrastructure agnostic
• Try ScaleIO. It’s a free download!
https://www.emc.com/products-solutions/trial-software-
download/scaleio.htm
19. SDS Framework = Mind Blown
• Framework installs and configures Storage Platform on
all Scheduler’s compute nodes
• Persistent storage native to
scheduling platform
• Globally accessible storage
• What Storage array? Reduce
complexity
• Deploy Anywhere!
20. Containers Today
• Many container workloads
are long running
• Many have state: user
data, configuration, and
etc
• Top 7 of 12 Apps in
Docker Hub are persistent
applications
21. Death of a Container
• Where does my data go?
• Turned to the compute
node’s local disk to store
data
• What happens on a node
failure?
• Production applications
require high availability
• External Storage!
/etc /var
/bin /opt
/data
22. External Storage Enablement
• REX-Ray
– Vendor agnostic storage orchestration engine
– AWS, GCE, ScaleIO, VirtualBox, many more
– https://github.com/codedellemc/rexray
• mesos-module-dvdi
– Hook for Mesos nodes to manage external storage
– https://github.com/codedellemc/mesos-module-dvdi
– Contributed back to and is apart of Mesos proper
23. What this Means for your Apps
• Tolerates node failures
• Highly Available containers and Apps!
• Insulates changes with:
– container scheduler (APIs, etc)
– storage platform (workflows, APIs, etc)
• Production ready!
25. Moving towards the Cloud
• Applications with management APIs
• Cloud is perfect to enable DevOps
• What makes these cloud accessible?
26. Self Monitoring Apps
• Framework deploy and configure
applications.
• Enable application monitoring via
Management APIs
• Determine health and remediate!
• Can fix themselves, but to what end?
27. Self-aware Applications
• AWS SDK – 10 Language bindings
• Software-based Storage Platform
with a Cloud Platform driven by APIs
• Applications that change their
environment
– Maintenance, Remediation,
Performance, etc
• Self-aware applications! Skynet!
28. Premise: Self Managing
• Framework can monitor and self remediate Software-
based Storage Platform
• The Scenario:
– ScaleIO has a Storage Pool that is approaching full
– Identifies the health check warning
– Creates new EBS volumes in EC2 to expand the Storage
Pool
30. Configuration
• Mesos Configuration
– 3 Node Mesos Cluster (Management)
– 3 Mesos Agent nodes (Compute)
• ScaleIO Cluster (Scale-out storage)
– Will install on top of 3 Mesos Agent nodes
– 180 GB local disks on each node to make up this Storage
Pool
Other forms of Software Defined Storage may need a physical appliance or require some purpose built hardware. NFS and VSAN do not. I am going to touch on this a little more later.
Is a Container Scheduler
- Docker
- Unified Containerizer
Task placement based on CPU, Memory, and Disk
User defined constraints
