Deploying Elasticsearch and Kibana on Kubernetes with the Elastic Operator / ECK

•

0 likes•391 views

Managing and Elasticsearch deployment on Kubernetes can be challenging. Orchestrating a deployment or upgrading are not simple tasks. Our operator will help you easily manage simple or complex deployments like hot/warm/cold. In this talk, Janko Strassburg and Imma Valls, Sr. Support Engineers at Elastic will demonstrate how to use the new operator, Elastic Cloud on Kubernetes (ECK) to automate deployments and manage an Elasticsearch cluster.

Software

1
Janko Strassburg - Sr. Support Engineer @jankopueh
Imma Valls - Sr. Support Engineer @eyeveebee
Deploying Elasticsearch &
Kibana to Kubernetes with the
Elastic operator

2
Typical Adoption of the Elastic Stack …
Single cluster
Single use case
Single cluster
Multiple use cases
Single cluster
Use case grows
1 2 3
More data More use cases

3
Managing one big cluster has challenges
• Managing Differences
• Isolating tenants
• True fair use is impossible
Single cluster
Multiple use cases

5
Typical Adoption of the Elastic Stack …
Single cluster
Single use case
Single cluster
Multiple use cases
Single cluster
Use case grows
1 2 3
More data More use cases
Many teams, many projects,
multiple clusters and use cases
4
More of everything

6
Elastic Cloud on Kubernetes (ECK)
● New product that allows customers to orchestrate Elasticsearch,
Kibana, APM Server on Kubernetes
● Extends native Kubernetes API using the Operator pattern
● Open code https://github.com/elastic/cloud-on-k8s
● Also available at https://operatorhub.io/operator/elastic-cloud-eck
Beta release October 14th

7
What is a Kubernetes Operator
● A way to deliver a Kubernetes
Native Application
● Encode operational logic
○ E.g. “I know how to upgrade
Elasticsearch properly”

● Multi-cluster deployment and
management
● Automatic security configuration
● Snapshot scheduling and
keystore support
● Faster recovery from failures
● Local persistent storage by Elastic
● Advanced topology
○ master, ingest, ml, hot-warm
cold
Elastic Cloud on Kubernetes

9
Demo
https://ela.st/bcn-k8s-meetup-2019-11-14

10
Next steps
● Sample configuration on Github
https://github.com/elastic/cloud-on-k8s/tree/master/config/samples
● Launching blog
https://www.elastic.co/blog/introducing-elastic-cloud-on-kubernetes-the-
elasticsearch-operator-and-beyond
● Documentation
https://www.elastic.co/es/products/elastic-cloud-kubernetes
● Operator at OperatorHub.io
https://operatorhub.io/operator/elastic-cloud-eck
● Discuss forums
https://discuss.elastic.co/c/eck

11
Thanks!
https://ela.st/bcn-k8s-meetup-2019-11-14

What's hot

MySQL Monitoring using Prometheus & Grafana

YoungHeon (Roy) Kim

Autoscaling Kubernetes

craigbox

Kubernetes Networking

CJ Cullen

At LinkedIn, the Kafka infrastructure is run as a service: the Streaming team develops and deploys Kafka, but is not the producer or consumer of the data that flows through it. With multiple datacenters, and numerous applications sharing these clusters, we have developed an architecture with multiple pipelines and multiple tiers. Most days, this works out well, but it has led to many interesting problems. Over the years we have worked to develop a number of solutions, most of them open source, to make it possible for us to reliably handle over a trillion messages a day.

Multi tier, multi-tenant, multi-problem kafka

Todd Palino

Building Real-time Pipelines with FLaNK_ A Case Study with Transit Data Building Real-time Pipelines with FLaNK: A Case Study with Transit Data In this session, we will explore the powerful combination of Apache Flink, Apache NiFi, and Apache Kafka for building real-time data processing pipelines. We will present a case study using the FLaNK-MTA project, which leverages these technologies to process and analyze real-time data from the New York City Metropolitan Transportation Authority (MTA). By integrating Flink, NiFi, and Kafka, FLaNK-MTA demonstrates how to efficiently collect, transform, and analyze high-volume data streams, enabling timely insights and decision-making. Takeaways: Understanding the integration of Apache Flink, Apache NiFi, and Apache Kafka for real-time data processing Insights into building scalable and fault-tolerant data processing pipelines Best practices for data collection, transformation, and analytics with FLaNK-MTA as a reference Knowledge of use cases and potential business impact of real-time data processing pipelines https://github.com/tspannhw/FLaNK-MTA/tree/main https://medium.com/@tspann/finding-the-best-way-around-7491c76ca4cb apache nifi apache kafka apache flink apache iceberg apache parquet real-time streaming tim spann principal developer advocate cloudera datainmotion.dev

Building Real-time Pipelines with FLaNK_ A Case Study with Transit Data

Timothy Spann

Kubernetes in Docker

Docker, Inc.

Kubernetes Basics

Eueung Mulyana

Understanding docker networking

Lorenzo Fontana

Operator Framework Overview

Rob Szumski

The importance of ingestion and processing streaming data in telecommunication industry is ever increasing. We, SK Telecom which is Korea's number-one telecommunications provider, encounter how to use infra resources more efficiently. Apache Druid supports auto scaling feature for data ingestion, but it is only available on AWS EC2. We cannot rely on the feature on our private cloud. In this talk, we are going to introduce auto scale-out/in on Kubernetes. This approach is more outstanding than Druid's scaling implementation. Here are the benefits. The first is our approach can be used anywhere on private cloud or (managed) Kubernetes in Azure, AWS and GKE. The second is AWS EC2's startup and termination requires a few minutes, but our approach requires a few seconds. The last is the scaling mechanism is decoupled from Druid's source code. We will also share development of Druid Helm chart, rolling update, custom metric usage for horizontal auto scaling. The below is about detailed benefit compared with Druid's auto scaling approach: 1. Druid's auto scaling is only available in AWS, but our approach does not have the obstacle. It can be used in Private cloud(on-premise) are (managed) Kubernetes in Azure, AWS and GKE. 2. AWS EC2 is an instance of virtual machine, so the startup is slower than docker container. A few minutes are required for startup or termination of EC2. Docker container is very lightweight, so it requires a few seconds. 3. Druid's auto scaling is tightly coupled with AWS API because Druid engine code uses AWS API. Our scale-out/in algorithm is conceptually equal to Druid's auto scaling approach, but we decoupled the dependency because Kubernetes communicate with one of dispatcher nodes(i.e. Overlord node) using REST API.

Apache Druid Auto Scale-out/in for Streaming Data Ingestion on Kubernetes

DataWorks Summit

Kubernetes for Beginners: An Introductory Guide

Bytemark

Kibana Tutorial | Kibana Dashboard Tutorial | Kibana Elasticsearch | ELK Stac...

Edureka!

Kubernetes 101

Jacopo Nardiello

[2018] 오픈스택 5년 운영의 경험

NHN FORWARD

Microservices Architecture & Testing Strategies

Araf Karsh Hamid

Have you ever wondered how to implement your own operator pattern for you service X in Kubernetes? You can learn this in this session and see an example of open-source project that does spawn Apache Spark clusters on Kubernetes and OpenShift following the pattern. You will leave this talk with a better understanding of how spark-on-k8s native scheduling mechanism can be leveraged and how you can wrap your own service into operator pattern not only in Go lang but also in Java. The pod with spark operator and optionally the spark clusters expose the metrics for Prometheus so it makes it eas

Spark Operator—Deploy, Manage and Monitor Spark clusters on Kubernetes

Databricks

Docker Kubernetes Istio

Araf Karsh Hamid

Running Apache Spark on Kubernetes: Best Practices and Pitfalls

Databricks

[KubeCon EU 2020] containerd Deep Dive

Akihiro Suda

Red Hat OpenStack 17 저자직강+스터디그룹_1주차

Nalee Jang

What's hot (20)

MySQL Monitoring using Prometheus & Grafana

Autoscaling Kubernetes

Kubernetes Networking

Multi tier, multi-tenant, multi-problem kafka

Building Real-time Pipelines with FLaNK_ A Case Study with Transit Data

Kubernetes in Docker

Kubernetes Basics

Understanding docker networking

Operator Framework Overview

Apache Druid Auto Scale-out/in for Streaming Data Ingestion on Kubernetes

Kubernetes for Beginners: An Introductory Guide

Kibana Tutorial | Kibana Dashboard Tutorial | Kibana Elasticsearch | ELK Stac...

Kubernetes 101

[2018] 오픈스택 5년 운영의 경험

Microservices Architecture & Testing Strategies

Spark Operator—Deploy, Manage and Monitor Spark clusters on Kubernetes

Docker Kubernetes Istio

Running Apache Spark on Kubernetes: Best Practices and Pitfalls

[KubeCon EU 2020] containerd Deep Dive

Red Hat OpenStack 17 저자직강+스터디그룹_1주차

Similar to Deploying Elasticsearch and Kibana on Kubernetes with the Elastic Operator / ECK

Database as a Service (DBaaS) on Kubernetes

ObjectRocket

Taking Care of Business at Office Depot with Elastic Cloud Enterprise

Elasticsearch

There is a major shift in web and mobile application architecture from the ‘old-school’ one to a modern ‘micro-services’ architecture based on containers. Kubernetes has been quite successful in managing those containers and running them in distributed computing environments. Now enabling Big Data and Machine Learning on Kubernetes will allow IT organizations to standardize on the same Kubernetes infrastructure. This will propel adoption and reduce costs. Kubeflow is an open source framework dedicated to making it easy to use the machine learning tool of your choice and deploy your ML applications at scale on Kubernetes. Kubeflow is becoming an industry standard as well! Both Kubernetes and Kubeflow will enable IT organizations to focus more effort on applications rather than infrastructure.

Modern big data and machine learning in the era of cloud, docker and kubernetes

Slim Baltagi

10 tips for Cloud Native Security

Karthik Gaekwad

Google Tech Talk with Dr. Eric Brewer in Korea Apr.27.2015

Chris Jang

Monitoring kubernetes across data center and cloud

Datadog

DevSecOps in a cloudnative world

Karthik Gaekwad

Amazon Elastic Kubernetes Service (EKS) is a managed service that lets you run Kubernetes on AWS without needing to maintain your own Kubernetes control plane. As recently announced, eksctl is the official CLI tool for creating clusters on EKS! Michael Hausenblas (AWS) and eksctl creator, Ilya Dmitrichenko (Weaveworks), walk you through the basics of Amazon EKS with eksctl, and why many EKS builders have come to rely on eksctl for the initial provisioning of new clusters and ongoing configuration management of long-running clusters. They cover use cases, how to get started, common pitfalls to avoid, how to migrate from DIY Kubernetes on AWS (eg. Kops) to EKS using eksctl.

Introduction to EKS and eksctl

Weaveworks

Kubernetes can be complex to manage at enterprise scale! Cloud provider services like Amazon EKS solves the challenge of bringing up a Kubernetes control plane. However, production Kubernetes requires multi-layer security, access controls, load-balancing, monitoring, logging, governance, secrets management, policy management, and several other considerations. In this fast paced talk, we will cover how enterprises can address each of these areas and discuss best practices to fast track deployments.

Operationalizing Amazon EKS

Jim Bugwadia

A talk given at Craft Conf in Budapest, Hungary on May 10th, 2019. In this talk, Phil walked through the history of the need for a Container Runtime Interface (CRI) in Kubernetes, followed by an overview of all available CRI implementations, focusing on containerd, the CNCF core container runtime used in many clouds and projects. Phil demonstrated the "layers" of interaction from Kubernetes API, to CRI API to a container runtime's native API using an IBM Cloud Kubernetes cluster using containerd 1.2.6.

CraftConf 2019: CRI Runtimes Deep Dive: Who Is Running My Pod?

Phil Estes

Kubernetes has shown considerable traction since its debut in 2014, however there is still a significant portion of enterprises that have chosen other solutions for managing containers over Kubernetes. Given its technical leadership in the community this begs the question, why aren't more using it? In this talk we will address some of the reasons for this gap, and ideas for how we can solve it including what we are doing at Rancher Labs on this front.

Kubernetes for All

William Jimenez

Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2Gmuwlg. Andrew Spyker talks about Netflix's feisty team’s work across container runtimes, scheduling & control plane, and cloud infrastructure integration. He also talks about the demons they’ve found on this journey covering operability, security, reliability and performance. Filmed at qconsf.com. Andrew Spyker worked to mature the technology base of Netflix Container Cloud (Project Titus) within the development team. Recently, he moved into a product management role collaborating with supporting Netflix infrastructure dependencies as well as supporting new container cloud usage scenarios including user on-boarding, feature prioritization/delivery and relationship management.

Disenchantment: Netflix Titus, Its Feisty Team, and Daemons

C4Media

Kubernetes is a deep and complex technology that is evolving fast with new functionality and a growing ecosystem of cloud-native solutions. While the public cloud delivers an almost frictionless user experience, configuring and managing a production Kubernetes environment is an enormous technical challenge for the majority of enterprises that choose to do so on premises. Without the right approach, operationalizing Kubernetes in the data center can take upwards of 6 months, jeopardizing developer productivity and speed-to-market. In this webinar, you’ll learn from Nutanix cloud native experts on how to fast-track your way to operationalizing a production-ready Kubernetes environment on-prem. Specifically, we’ll talk about: How containerized applications use IT resources (and why legacy infrastructure isn’t built for Kubernetes); The main advantages of running Kubernetes on prem (as part of a multi-cloud strategy); Key aspects of Kubernetes lifecycle management that greatly benefit from automation.

Simplify Your Way To Expert Kubernetes Management

DevOps.com

Did your company start down the path of building a cloud native platform using Kubernetes with the goal of enabling developers to innovate faster and increase productivity, but then run into challenges keeping it operating in an optimal way? In this session, Weaveworks will discuss how to migrate from self-managed Kubernetes on EC2 to a GitOps managed Shared Services Platform (SSP) on EKS. A SSP built on EKS and managed with Weave GitOps provides developers and operators with common workflows to update both applications and infrastructure. With every change in version control, full audit trails are available, and security is enforced. While at the same time enabling easier rollbacks and faster mean-time-to-recovery (MTTR). In short, a Weave GitOps managed SSP increases developer velocity while boosting stability. How to operate a hybrid Kubernetes architecture, using managed EKS in the AWS Cloud and EKS-Distro on premises. How to structure your infrastructure repository to efficiently manage multiple teams. How to use Kubernetes RBAC to provide secure cluster multi-tenancy. How to use GitOps to promote releases across a hybrid set of independent clusters. How to accomplish data and operational sovereignty.

Migrating from Self-Managed Kubernetes on EC2 to a GitOps Enabled EKS

Weaveworks

2018년 3월 정기 세미나 - March 2018 Ops Meetup 후기

OpenStack Korea Community

Kubernetes Security

Karthik Gaekwad

Cairo Kubernetes Meetup - October event Talk #1

omehelba

Ejecución del Elastic Stack en Kubernetes

Elasticsearch

HCL Connections V7 will be based on Kubernetes only! A parallel WebSphere environment won't be necessary any longer. Martin and Christoph collected the basics and differences in building a Kubernetes environment of your choice. They show you a comparison of an on-premises deployment versus a hosted cloud environment (Amazon EKS). After this session you have the basics to size and build a Kubernetes cluster for Component Pack, so you can start learning the new technology to take off with Connections V7 and become a Kubernaut.

Kubernetes for HCL Connections Component Pack - Build or Buy?

Martin Schmidt

At Giant Swarm, we manage Kubernetes clusters for customers 24/7, both on-premises and in the cloud. That means we do not just set something up and hand it over, but we actually take care that it’s operational and up-to-date at all times. In this talk Timo explains how Giant Swarm are using Operators to codify all operational tasks of managing Kubernetes cluster and distributed applications on top. The operators manage PKI infrastructures, networks, VMs and storage both on-premises and in the cloud. There have been a lots of challenges and learnings in the past year and Timo would like to share them with you.

OSDC 2017: Automating Kubernetes Cluster Operations with Operators by Timo De...

NETWAYS

Similar to Deploying Elasticsearch and Kibana on Kubernetes with the Elastic Operator / ECK (20)

Database as a Service (DBaaS) on Kubernetes

Taking Care of Business at Office Depot with Elastic Cloud Enterprise

Modern big data and machine learning in the era of cloud, docker and kubernetes

10 tips for Cloud Native Security

Google Tech Talk with Dr. Eric Brewer in Korea Apr.27.2015

Monitoring kubernetes across data center and cloud

DevSecOps in a cloudnative world

Introduction to EKS and eksctl

Operationalizing Amazon EKS

CraftConf 2019: CRI Runtimes Deep Dive: Who Is Running My Pod?

Kubernetes for All

Disenchantment: Netflix Titus, Its Feisty Team, and Daemons

Simplify Your Way To Expert Kubernetes Management

Migrating from Self-Managed Kubernetes on EC2 to a GitOps Enabled EKS

2018년 3월 정기 세미나 - March 2018 Ops Meetup 후기

Kubernetes Security

Cairo Kubernetes Meetup - October event Talk #1

Ejecución del Elastic Stack en Kubernetes

Kubernetes for HCL Connections Component Pack - Build or Buy?

OSDC 2017: Automating Kubernetes Cluster Operations with Operators by Timo De...

More from Imma Valls Bernaus

In the wake of COVID-19, many cloud-native communities struggle to regain their former footing. This talk draws inspiration from Stardew Valley to provide actionable strategies for reviving and revitalizing your cloud-native community meetup. Just like restoring a farm, revitalizing a community requires careful planning, dedication, and a touch of gamification. We'll discuss the strategies used for a successful comeback of the Barcelona community, such as engaging older and new organizers, finding captivating topics and events, securing venues and sponsors, attracting speakers, or establishing a regular meetup schedule. Join me as we transform a community from a neglected patch of land back into a thriving hub of learning and connection!

Rebuilding Your Cloud Native Community Lessons learned from Stardew Valley

Imma Valls Bernaus

As enterprises adopt Prometheus and Kubernetes, the rate of metrics growth has skyrocketed, and so have the costs associated with it. Unfortunately, more metrics does not mean better business outcomes: Enterprises see no visible improvements to mean time to resolution (MTTR) when more than 50% of metrics go unused. In this talk we introduce how Grafana Cloud tackles the problem of unmanageable metrics growth with Adaptive Metrics, the newest cardinality optimization feature in Grafana Cloud that eliminates unused and partially used time series through customized aggregation.

Metrics Cost Management with Adaptive Metrics.pdf

Imma Valls Bernaus

Troubleshooting your Elasticsearch cluster like an Elastic Support Engineer

Imma Valls Bernaus

Al igual que la mayoría de las organizaciones modernas, tus equipos probablemente usan más de 10 aplicaciones basadas en la nube a diario, pero dedican demasiado tiempo a buscar la información que necesitan en todas estas. Gracias a las características integradas de Elastic Workplace Search, podrás comprobar lo sencillo que resulta poner el contenido relevante al alcance de tus equipos gracias a la búsqueda unificada para todas las aplicaciones que usan para llevar a cabo su trabajo.

Te damos la bienvenida a una nueva forma de realizar búsquedas

Imma Valls Bernaus

Eliminar los puntos ciegos significa que tienes suficiente contexto. ¿Pero, puedes obtener información importante de ese contexto cuándo lo necesitas? Aprende a detectar amenazas mientras evitas el ruido de falsos positivos, con el motor de detección de Elastic Security. Verás cómo automatizar la detección de amenazas mediante correlaciones y Machine Learning, con ejemplos reales de cada uno.

Automatiza las detecciones de amenazas y evita falsos positivos

Imma Valls Bernaus

We’ve all been stuck Where to start when troubleshooting an Elasticsearch cluster? Is your cluster down, or experiencing degraded performance? Did it fail to upgrade? A well-configured Elasticsearch installation is able to better utilize available resources and respond more efficiently to requests. Join this talk if you want to learn the tools available to help you out (Elasticsearch REST APIs, log analysis, monitoring) and how to prevent the most common issues we see in Elastic support, with the recommended best practices to avoid them.

Troubleshooting your Elasticsearch cluster like a support engineer

Imma Valls Bernaus

Elastic Stack Roadmap

Imma Valls Bernaus

Introducción al Stack Elastic y Machine Learning con Elasticsearch

Imma Valls Bernaus

Te presentamos a Kibana Lens, una nueva forma fácil e intuitiva para que todos visualicen sus datos dentro de Kibana. Con una nueva interfaz de arrastrar y soltar, características de exploración de datos con un clic y el poder de proporcionar sugerencias de visualización, Lens es la forma mas rápida de descubrir información de tus datos de Elasticsearch. Incluye una demo para descubrir cómo Lens puede ayudar tanto a los usuarios de Kibana nuevos como a los experimentados. Revisaremos cómo optimizar las actividades de análisis existentes y demostraremos lo fácil que es visualizar los datos.

Presentación de Kibana Lens: Una forma fácil e intuitiva de visualizar los datos

Imma Valls Bernaus

No tienes que ser un científico de datos para usar las características de machine learning de Elastic ni para saber crear y operar con modelos de datos en tiempo real. Aprende cómo se han integrado en el Elastic Stack y cómo se usan para el modelado de series temporales para la previsión y detección de anomalías. Echa también un vistazo en primicia a las nuevas características que permitirán más aplicaciones nuevas de machine learning.

Machine Learning para detección de anomalías, modelado de series temporales y...

Imma Valls Bernaus

In this workshop, we’ll give you the tools to start monitoring your infrastructure and applications using the Elastic Stack. Just bring your laptop with docker-compose installed, and we will guide you through the steps to start collecting and visualizing some logs and metrics. And come prepared to Choose Your Own Adventure! We will dive into: - System metrics: Collect infrastructure metrics. - Application logs: Collect structured logs in a central location. - Uptime monitoring: Ping services and actively monitor their availability and response time.

Monitorizando con el Stack Elastic Elige tu propia aventura

Imma Valls Bernaus

Desplegando Elasticsearch y Kibana en Kubernetes con el Operator de Elastic (...

Imma Valls Bernaus

El Stack Elastic / Stack ELK presenta en cada versión de todos sus productos (Elasticsearch, Kibana, Beats y Logstash), ya sea minor o major, nuevas y potentes funcionalidades. La actualización del Stack Elastic a la última versión te permite aprovechar estas mejoras y nuevas funciones. Sin embargo, las actualizaciones de software pueden ser una tarea desalentadora, especialmente cuando el software en cuestión da servicio a aplicaciones críticas. Pero, no tiene porque serlo. Únete a nuestro webinar para aprender cómo hacer que la actualización sin complicaciones, adoptando unos simples consejos.

Consejos de los expertos para actualizar el Stack ELK

Imma Valls Bernaus

Where to start when troubleshooting an Elasticsearch cluster? Is your cluster down, or experiencing degraded performance? Did it fail to upgrade? A well-configured Elasticsearch installation is able to better utilize available resources and respond more efficiently to requests. Join this talk if you want to learn the tools available to help you out (Elasticsearch REST APIs, log analysis, monitoring) and how to prevent the most common issues we see in Elastic support, with the recommended best practices to avoid them.

Troubleshooting your elasticsearch cluster like a support engineer

Imma Valls Bernaus

Automatiza las detecciones de amenazas y evita falsos positivos

Imma Valls Bernaus

Te damos la bienvenida a una nueva forma de realizar búsquedas

Imma Valls Bernaus

Madrid Elastic Meetup February 11 2019 - Release 6.x features

Imma Valls Bernaus

Barcelona Elastic Meetup January 31 2019 - Release 6.5 features

Imma Valls Bernaus

More from Imma Valls Bernaus (18)

Rebuilding Your Cloud Native Community Lessons learned from Stardew Valley

Metrics Cost Management with Adaptive Metrics.pdf

Troubleshooting your Elasticsearch cluster like an Elastic Support Engineer

Te damos la bienvenida a una nueva forma de realizar búsquedas

Automatiza las detecciones de amenazas y evita falsos positivos

Troubleshooting your Elasticsearch cluster like a support engineer

Elastic Stack Roadmap

Introducción al Stack Elastic y Machine Learning con Elasticsearch

Presentación de Kibana Lens: Una forma fácil e intuitiva de visualizar los datos

Machine Learning para detección de anomalías, modelado de series temporales y...

Monitorizando con el Stack Elastic Elige tu propia aventura

Desplegando Elasticsearch y Kibana en Kubernetes con el Operator de Elastic (...

Consejos de los expertos para actualizar el Stack ELK

Troubleshooting your elasticsearch cluster like a support engineer

Automatiza las detecciones de amenazas y evita falsos positivos

Te damos la bienvenida a una nueva forma de realizar búsquedas

Madrid Elastic Meetup February 11 2019 - Release 6.x features

Barcelona Elastic Meetup January 31 2019 - Release 6.5 features

Recently uploaded

INGKA DIGITAL: Linked Metadata by Design

Neo4j

Scenarios are the central artifact of the Behaviour Driven Development (BDD) process. Although many teams use scenarios and tools like Cucumber or SpecFlow to automate them, in many cases their scenarios contain a lot of details, particularly test data, and therefore they become too complicated to support collaboration with the business. The "essential" principle of scenario writing (scenario formulation) states that only those details should be included in the scenario that are relevant for the outcome. This talk provides help for those who struggle implementing this principle or would be interested to learn how you can create brief and maintainable scenarios.

Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)

Gáspár Nagy

Migrating your customer service data from Gorgias to Re:amaze can greatly enhance your support operations, but it requires detailed planning and precise execution. "A Guideline to Gorgias to Re:amaze Data Migration" is crafted to help businesses manage this transition smoothly and efficiently. This comprehensive guide ensures that all aspects of the data migration process are covered, from initial planning to post-migration support.

A Guideline to Gorgias to to Re:amaze Data Migration

Help Desk Migration

GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates

Neo4j

Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.

TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR

Tier1 app

A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf

kalichargn70th171

How to install and activate eGrabber JobGrabber

eGrabber

Agnieszka Andrzejewska - BIM School Course in Kraków

bim.edu.pl

How to download files safely from the internet ? Source: <a href="https://www.downloadsafely.com/">Download Safely</a> -Welcome to Secure Downloading&Surfing. Learn how to safely download files and protect your data while browsing the web. Let's dive into the world of secure surfing! Understanding the Risks Discover the potential threats associated with downloading files from the internet and the impact of malicious software on your device.

how-to-download-files-safely-from-the-internet.pdf

Mehmet Akar

OpenChain @ LF Japan Executive Briefing - May 2024

Shane Coughlan

This is a classic migration case study (the past, current and the future) at scale from a world-wide company transitioning from Confluent Platform and Confluent Cloud to self-managed Apache Kafka on Kubernetes using Strimzi. At Maersk, we have been architecting, designing and implementing our 3rd generation Event Streaming Platform. This platform is based on Kubernetes in Azure and using Strimzi to operate Apache Kafka at large scale, highly reliable, segregating data based on isolated use cases. Our 2nd generation was based on OnPrem Confluent Platform and Confluent Cloud and this presentation is the story of this migration and reasoning behind it. Furthermore, we would get into details on how we monitor (Grafana, Prometheus), alert (GoAlert and alert as code), operate and provide self-service solutions on top of Strimzi to enable business critical application in Maersk, implemented in GoLang using the GitOps deployment model with Flux and Kustomization among others. Finally, if time allows we will end with a demo of an open-source self service tool to monitor and explore the cluster with most wanted features such as topic message browsing and configuring and restarting connectors.

StrimziCon 2024 - Transition to Apache Kafka on Kubernetes with Strimzi

steffenkarlsson2

Studiovity film pre-production and screenwriting software

info611746

AI/ML Infra Meetup May. 23, 2024 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Lu Qiu (Data & AI Platform Tech Lead, @Alluxio) - Siyuan Sheng (Senior Software Engineer, @Alluxio) Speed and efficiency are two requirements for the underlying infrastructure for machine learning model development. Data access can bottleneck end-to-end machine learning pipelines as training data volume grows and when large model files are more commonly used for serving. For instance, data loading can constitute nearly 80% of the total model training time, resulting in less than 30% GPU utilization. Also, loading large model files for deployment to production can be slow because of slow network or storage read operations. These challenges are prevalent when using popular frameworks like PyTorch, Ray, or HuggingFace, paired with cloud object storage solutions like S3 or GCS, or downloading models from the HuggingFace model hub. In this presentation, Lu and Siyuan will offer comprehensive insights into improving speed and GPU utilization for model training and serving. You will learn: - The data loading challenges hindering GPU utilization - The reference architecture for running PyTorch and Ray jobs while reading data from S3, with benchmark results of training ResNet50 and BERT - Real-world examples of boosting model performance and GPU utilization through optimized data access

AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...

Alluxio, Inc.

WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation

WSO2

Top Mobile App Development Companies 2024

XongoLab Technologies LLP

IT Software Development Resume, Vaibhav jha 2024

vaibhav130304

Crafting the Perfect Measurement Sheet with PLM Integration

Wave PLM

APVP,apvp apvp High quality supplier safe spot transport, 98% purity

amy56318795

Breaking the Code : A Guide to WhatsApp Business API.pdf

Meon Technology

Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...

rajkumar669520

Recently uploaded (20)

INGKA DIGITAL: Linked Metadata by Design

Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)

A Guideline to Gorgias to to Re:amaze Data Migration

GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates

TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR

A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf

How to install and activate eGrabber JobGrabber

Agnieszka Andrzejewska - BIM School Course in Kraków

how-to-download-files-safely-from-the-internet.pdf

OpenChain @ LF Japan Executive Briefing - May 2024

StrimziCon 2024 - Transition to Apache Kafka on Kubernetes with Strimzi

Studiovity film pre-production and screenwriting software

AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...

WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation

Top Mobile App Development Companies 2024

IT Software Development Resume, Vaibhav jha 2024

Crafting the Perfect Measurement Sheet with PLM Integration

APVP,apvp apvp High quality supplier safe spot transport, 98% purity

Breaking the Code : A Guide to WhatsApp Business API.pdf

Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...

Deploying Elasticsearch and Kibana on Kubernetes with the Elastic Operator / ECK

1. 1 Janko Strassburg - Sr. Support Engineer @jankopueh Imma Valls - Sr. Support Engineer @eyeveebee Deploying Elasticsearch & Kibana to Kubernetes with the Elastic operator

2. 2 Typical Adoption of the Elastic Stack … Single cluster Single use case Single cluster Multiple use cases Single cluster Use case grows 1 2 3 More data More use cases

3. 3 Managing one big cluster has challenges • Managing Differences • Isolating tenants • True fair use is impossible Single cluster Multiple use cases

4. 4 Time to split!

5. 5 Typical Adoption of the Elastic Stack … Single cluster Single use case Single cluster Multiple use cases Single cluster Use case grows 1 2 3 More data More use cases Many teams, many projects, multiple clusters and use cases 4 More of everything

6. 6 Elastic Cloud on Kubernetes (ECK) ● New product that allows customers to orchestrate Elasticsearch, Kibana, APM Server on Kubernetes ● Extends native Kubernetes API using the Operator pattern ● Open code https://github.com/elastic/cloud-on-k8s ● Also available at https://operatorhub.io/operator/elastic-cloud-eck Beta release October 14th

7. 7 What is a Kubernetes Operator ● A way to deliver a Kubernetes Native Application ● Encode operational logic ○ E.g. “I know how to upgrade Elasticsearch properly”

8. ● Multi-cluster deployment and management ● Automatic security configuration ● Snapshot scheduling and keystore support ● Faster recovery from failures ● Local persistent storage by Elastic ● Advanced topology ○ master, ingest, ml, hot-warm cold Elastic Cloud on Kubernetes

9. 9 Demo https://ela.st/bcn-k8s-meetup-2019-11-14

10. 10 Next steps ● Sample configuration on Github https://github.com/elastic/cloud-on-k8s/tree/master/config/samples ● Launching blog https://www.elastic.co/blog/introducing-elastic-cloud-on-kubernetes-the- elasticsearch-operator-and-beyond ● Documentation https://www.elastic.co/es/products/elastic-cloud-kubernetes ● Operator at OperatorHub.io https://operatorhub.io/operator/elastic-cloud-eck ● Discuss forums https://discuss.elastic.co/c/eck

11. 11 Thanks! https://ela.st/bcn-k8s-meetup-2019-11-14

Deploying Elasticsearch and Kibana on Kubernetes with the Elastic Operator / ECK

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Deploying Elasticsearch and Kibana on Kubernetes with the Elastic Operator / ECK

Similar to Deploying Elasticsearch and Kibana on Kubernetes with the Elastic Operator / ECK (20)

More from Imma Valls Bernaus

More from Imma Valls Bernaus (18)

Recently uploaded

Recently uploaded (20)

Deploying Elasticsearch and Kibana on Kubernetes with the Elastic Operator / ECK