Meetup presentation on Feb 27th 2019 at the Dock8s Meetup in Heidelberg/Rhein-Neckar, at the verivox campus.
The talk touches on all areas which involve a cloud journey of a major produkt (iDesk2) of the Haufe Group: Planning & Politics, Technology and doing Operations for that product as a DevOps team.
The software development loop is, without question, the most critical component of any business and yet it can sometimes be difficult to get everyone to prioritize it. In this talk, we'll look at several case studies from major companies and how they became more competitive and more reliable to beat out competitors.
We'll provide tools to calculate cost savings and investment for investments into DevOps including personnel, CI/CD, monitoring, and more. Everyone cares about DevOps when features can't be delivered or services fail. We'll show you how to avoid the pitfalls of reactive DevOps in 2020. Then, instead of painful retrospectives about the investment that should have been made, you can celebrate what a good job you've done.
DigitalOcean transitioned from inconsistent deployment tools to using Kubernetes for container orchestration. This improved their ability to deploy new services from hours to minutes. They customized Kubernetes by focusing on stateless services, declarative deployments, and abstracting operational concerns. They created "docc" to simplify Kubernetes usage. It allows describing applications and infrastructure through manifests. Docc helped deploy 50 applications in 6 months and powered an internal hackathon. Lessons included keeping up with Kubernetes' rapid changes and automating cluster management. They will invest in service meshes, network policies, and secure secret storage.
This document discusses how NetApp provides solutions to enable DevOps through capabilities like configuration management, CI/CD, containers, cloud/PaaS, and analytics. It highlights NetApp's Ansible modules for automating storage tasks, Trident for dynamic container storage provisioning, and the NetApp Kubernetes Service (NKS) for deploying and managing Kubernetes clusters across clouds. The document emphasizes NetApp's focus on helping customers achieve freedom, speed and efficiency in their DevOps practices through these technologies and an open developer community.
DevOps Spain 2019. David Cañadillas -CloudbeesatSistemas
This document discusses using Jenkins X to automate CI/CD pipelines on Kubernetes. It begins by introducing Jenkins X and its capabilities for CI/CD automation on Kubernetes using custom resource definitions. It then discusses how Jenkins X embraces a GitOps model using Git as the source of truth for promoting applications through environments. Finally, it invites the reader to a CloudBees event to learn more about building a continuous software delivery system with Jenkins X.
Jonathan Donaldson, VP & GM, Cloud and Infrastructure Technologies, Intel Corporation talks about Intel's work in the community to help make Kubernetes ready for the enterprise.
12/12/16
Tectonic Summit 2016: Multitenant Data Architectures with KubernetesCoreOS
This document discusses using Kubernetes to build multitenant data architectures. It notes that software development and data science have distinct lifecycles that are well-served by repeatability. Kubernetes allows packaging of different workloads in containers and scheduling them across clusters, bridging data science and development. Some challenges include ensuring collaboration between container types and adapting workloads not designed for Kubernetes. Overall, Kubernetes provides benefits like resource sharing and self-healing that can form the basis of a multitenant data platform.
The document discusses continuous integration, continuous deployment, and infrastructure as code for modern applications. It describes how AWS services like CodePipeline, CodeBuild, CodeDeploy, and CloudFormation can be used to automate the build, test, and deployment of serverless and containerized applications. Continuous integration ensures code changes are built and tested regularly. Continuous deployment enables automated deployments to staging and production. Modeling infrastructure as code allows infrastructure changes to be released predictably using the same tools as code changes.
The software development loop is, without question, the most critical component of any business and yet it can sometimes be difficult to get everyone to prioritize it. In this talk, we'll look at several case studies from major companies and how they became more competitive and more reliable to beat out competitors.
We'll provide tools to calculate cost savings and investment for investments into DevOps including personnel, CI/CD, monitoring, and more. Everyone cares about DevOps when features can't be delivered or services fail. We'll show you how to avoid the pitfalls of reactive DevOps in 2020. Then, instead of painful retrospectives about the investment that should have been made, you can celebrate what a good job you've done.
DigitalOcean transitioned from inconsistent deployment tools to using Kubernetes for container orchestration. This improved their ability to deploy new services from hours to minutes. They customized Kubernetes by focusing on stateless services, declarative deployments, and abstracting operational concerns. They created "docc" to simplify Kubernetes usage. It allows describing applications and infrastructure through manifests. Docc helped deploy 50 applications in 6 months and powered an internal hackathon. Lessons included keeping up with Kubernetes' rapid changes and automating cluster management. They will invest in service meshes, network policies, and secure secret storage.
This document discusses how NetApp provides solutions to enable DevOps through capabilities like configuration management, CI/CD, containers, cloud/PaaS, and analytics. It highlights NetApp's Ansible modules for automating storage tasks, Trident for dynamic container storage provisioning, and the NetApp Kubernetes Service (NKS) for deploying and managing Kubernetes clusters across clouds. The document emphasizes NetApp's focus on helping customers achieve freedom, speed and efficiency in their DevOps practices through these technologies and an open developer community.
DevOps Spain 2019. David Cañadillas -CloudbeesatSistemas
This document discusses using Jenkins X to automate CI/CD pipelines on Kubernetes. It begins by introducing Jenkins X and its capabilities for CI/CD automation on Kubernetes using custom resource definitions. It then discusses how Jenkins X embraces a GitOps model using Git as the source of truth for promoting applications through environments. Finally, it invites the reader to a CloudBees event to learn more about building a continuous software delivery system with Jenkins X.
Jonathan Donaldson, VP & GM, Cloud and Infrastructure Technologies, Intel Corporation talks about Intel's work in the community to help make Kubernetes ready for the enterprise.
12/12/16
Tectonic Summit 2016: Multitenant Data Architectures with KubernetesCoreOS
This document discusses using Kubernetes to build multitenant data architectures. It notes that software development and data science have distinct lifecycles that are well-served by repeatability. Kubernetes allows packaging of different workloads in containers and scheduling them across clusters, bridging data science and development. Some challenges include ensuring collaboration between container types and adapting workloads not designed for Kubernetes. Overall, Kubernetes provides benefits like resource sharing and self-healing that can form the basis of a multitenant data platform.
The document discusses continuous integration, continuous deployment, and infrastructure as code for modern applications. It describes how AWS services like CodePipeline, CodeBuild, CodeDeploy, and CloudFormation can be used to automate the build, test, and deployment of serverless and containerized applications. Continuous integration ensures code changes are built and tested regularly. Continuous deployment enables automated deployments to staging and production. Modeling infrastructure as code allows infrastructure changes to be released predictably using the same tools as code changes.
This presentation is to reflect on the amazing advancement of the open source community in the field of Cloud Computing and how does it now allow us to build reliable software components quickly within truly agile infrastructure.
Ship Week 1: Intro to Continuous Delivery and GitOps
When building cloud native applications, software developers are no longer just responsible for coding new features. In the next module of Summer of Kubernetes, our expert guides (with the help of some special guests) will cover how to safely and effectively ship software without disrupting end users. To do this you will:
✅ Understand the basics of continuous delivery and GitOps
✅ Learn about how K8s enables declarative CD (via the use of reconciliation loops)
HP Helion European Webinar Series ,Webinar #3 BeMyApp
The document discusses building cloud native applications using the Helion Development Platform. It provides information on connecting applications to services like databases, using buildpacks to deploy different programming languages, and Windows support in Cloud Foundry including .NET applications and SQL Server. The presentation includes code examples and polls questions to engage webinar participants.
RedisConf18 - Using Redis as a Backend in a Serverless Application With KubelessRedis Labs
This document discusses Bitnami's products and services including their Application Catalog containing 150 applications and development runtimes packaged in multiple formats, their Stacksmith enterprise cloud migration tool, and their work defining packaging and deployment tools for Kubernetes. It provides examples of using Bitnami containers for Redis and Helm charts for Redis, and discusses how Redis can be used in a serverless way with Kubeless. Key takeaways are that Kubeapps and Helm provide great building blocks, and that features can be built with Kubeless and Redis in just minutes.
Hardening Your CI/CD Pipelines with GitOps and Continuous SecurityWeaveworks
Join us for a webinar on how to secure your CI/CD pipeline for Kubernetes with GitOps best practices and continuous runtime protection. As modern developers and DevOps teams are embarking on a quest for speed and reliability through automated CI/CD pipelines for Kubernetes, enterprises still need to ensure security and regulatory compliance.
Together with Deepfence, the Weaveworks team will explain and demonstrate how GitOps continuous delivery pipelines, combined with continuous security observability, improves the overall security of your development workflow - from Git to production.
In this webinar we will demonstrate:
Deepfence container scanning
Git-to-Kubernetes using FluxCD
Deepfence continuous runtime security
Building Cloud Native Applications Using Azure Kubernetes ServiceDennis Moon
This document provides an overview of building cloud-native applications using Azure Kubernetes Service (AKS). It discusses key concepts like containers, Docker, container registries, Kubernetes, and AKS. It also covers modern application architecture principles and 12-factor applications. Additionally, it defines common Kubernetes objects like pods, services, deployments and explains how to secure applications and monitor clusters deployed to AKS. The document recommends getting started with AKS by deploying sample applications from Azure DevOps to an AKS cluster created in the Azure portal or with the Azure CLI.
High-Precision GPS Positioning for Spring DevelopersVMware Tanzu
This document discusses high-precision GPS positioning for Spring developers. It covers GPS fundamentals and hardware, processing positioning data, and visualization. It describes using dual frequency GPS, consuming correction data via NTRIP, and processing NMEA data with libraries like GPSD. The document demonstrates receiving GPS data from an external receiver into a Spring Boot app using Spring Integration, exporting metrics to Prometheus and Grafana, and using QGIS and mobile apps for field data collection and visualization.
Journey Through Four Stages of Kubernetes Deployment MaturityAltoros
In this webinar we will discuss a crawl, walk, run approach to continuous delivery (CD) for applications, point by point:
Where to start, how to advance, and how to reach the level of maximum automation.
How to orchestrate CI/CD processes along with routing and business continuity.
When the automation level is sufficient.
GitOps principles and their benefits.
What tools should be used to automate CI, CD, GitOps, Container Registry, Secrets management, etc
This document discusses 4 levels of IoT maturity and how Cloud Foundry can help organizations achieve the highest level of maturity. It begins with an analogy about turning raw data into a gourmet meal using a kitchen and restaurant-style services. It then discusses 3 common problems organizations face with data and proposes Cloud Foundry as a solution. The next section discusses a case study of a medical device company using Cloud Foundry to securely and cost-effectively monitor devices. It concludes by recommending some open-source IoT apps to try on Cloud Foundry.
Yannis Zarkadas. Enterprise data science workflows on kubeflowMarynaHoldaieva
This document discusses using GitOps and multi-tenancy to provide an enterprise data science experience on Kubeflow. It describes how to deploy and manage Kubeflow using GitOps to simplify operations and accelerate time to production. GitOps allows storing all configuration in Git for versioning, rollbacks, and collaboration. Kustomize is used to manage configurations and integrate changes from upstream Kubeflow repositories while allowing customizations. This provides reproducibility, isolation of tenants, and easy upgrades in a production-ready Kubeflow cluster.
Observe and command your fleets across any kubernetes with weave git opsWeaveworks
Modern day deployments can often resemble the chaos of navigating the high seas with poor visibility and the dangers of unexpected events. Dev and test environments, running test data sets and feature flags in the public cloud, and production being served from a self-managed site that securely hosts client data can all be a challenge without full observability and control.
In this webinar, we show how you can reliably expand your Kubernetes footprint with Weave GitOps. Confidently observe and control your fleets, all from a single pane of glass across any environment.
Join this webinar to learn how to:
Control the health and propagation of customized clusters
Easily assign and secure clusters across multiple teams for multiple purposes
Observe all actions across all environments all from within Git
Understand managing all deployments across your cluster and fleets
Kubernetes 1.21 included 51 enhancements, including 13 features graduating to stable and 15 graduating to beta. Major themes included CronJobs graduating to stable, immutable secrets and configmaps, dual-stack IPv4/IPv6 support, graceful node shutdown, and the persistent volume health monitor. The 1.22 release timeline was also outlined, with enhancements freeze on May 13th and code freeze on July 8th, targeting August 4th for release. Various SIG updates provided information on enhancements for API machinery, apps, auth, CLI, cloud providers, instrumentation, network, node, scheduling and storage.
Event specifications, state of the serverless landscape, and other news from ...Daniel Krook
Presentation at Serverlessconf Paris on February 15, 2018.
https://paris.serverlessconf.io/
This is an update to the early talk at Serverlessconf NYC at:
https://www.slideshare.net/DanielKrook/the-cncf-on-serverless
The Cloud Native Computing Foundation (CNCF) Serverless Working Group - with participation from IBM, AWS, Microsoft, Red Hat, VMware, Nuclio, Serverless Inc., Huawei and many others - has been working on an open eventing specification and mapping the state of the serverless landscape, including the features of public cloud serverless platforms and the capabilities of on premises and open source Functions-as-a-Service projects. In this lightning talk you'll hear about those efforts, see the newly published whitepaper on serverless use cases, and learn how you can help steer serverless adoption through participation in the CNCF.
Microservices are the new black. You've heard about them, you've read about them, you may have even implemented a few, but sooner or later you'll run into the age-old conundrum: How do I break my monolith apart? Where do I draw service boundaries?
In this talk you will learn several widely-applicable strategies for decomposing your monolithic application, along with their respective risks and the appropriate mitigation strategies. These techniques are widely used at Wix, took us a long time to develop and have proven consistently effective; hopefully they will help you avoid the same battle scars.
The document discusses serverless computing and Apache OpenWhisk. It describes how OpenWhisk allows developers to focus on business logic rather than infrastructure by executing code in response to events in a serverless manner. OpenWhisk provides a programming model where developers can create actions to handle triggers via rules. A number of demos are presented showing how to create triggers, actions and rules with OpenWhisk to handle events and build REST APIs.
As a data scientist I frequently need to create web apps to provide interactive functionality, deliver data APIs or simply publish results. It is now easier than ever to deploy your data driven web app by using cloud based application platforms to do the heavy lifting. Cloud Foundry (http://cloudfoundry.org) is an open source public and private cloud platform that enables simple app deployment, scaling and connectivity to data services like PostgreSQL, MongoDB, Redis and Cassandra.
Resources: http://www.ianhuston.net/2015/01/cloud-foundry-for-data-science-talk/
From Developer to Data Scientist - Gaines KergosienITCamp
ABSTRACT: Due to recent advances in technology, humanity is collecting vast amounts of data at an unprecedented rate, making the skills necessary to mine insights from this data increasingly valuable. So what does it take for a Developer to enter the world of data science?
Join me on a journey into the world of big data and machine learning where we will explore what the work actually looks like, identify which skills are most important, and design a road map for how you too can join this exciting and profitable industry.
Implementing DevOps – How it came to the fore, its key elements and example d...Barton George
This short presentation takes you through how DevOps came to the fore, explains its role within a Modern IT environment and is supported by two demos. The first demos illustrates how you can combine GitLab + Kubernetes + persistent storage (PowerMax) in an automated fashion to implement automated workflows and features . The second steps you through how you can leverage an Ansible playbook to automate the setup and management of storage infrastructure at scale (Ansible modules are included with Isilon and PowerScale storage).
This presentation was originally delivered as a Linux Foundation webinar
Kubernetes - 7 lessons learned from 7 data centers in 7 monthsMichael Tougeron
Learn from the rapid journey that Adobe Advertising Cloud took to reach a multi-cloud/multi-region deployment and the lessons learned along the way. Mike will cover 7 challenging scenarios with StatefulSets, GitOps, autoscaling for machine learning and auto-remediation. Go behind the scenes of the wins & failures to see how the engineering and platform teams prevented the derailing of their Kubernetes journey. From developing with spot instances in dev to multi-cloud in production, the cloud platform team has dealt with an interesting set of challenges. As Mike will show, even challenging requirements can lead to successful deployments.
Pat Gelsinger, James Watters, Cornelia Davis at SpringOne Platform 2019VMware Tanzu
SpringOne Platform 2019
Title: Pat Gelsinger, James Watters, Cornelia Davis at SpringOne Platform 2019- Keynote Day 1 opening (James Watters)
Youtube: https://youtu.be/aJKQifLkhXI
This presentation is to reflect on the amazing advancement of the open source community in the field of Cloud Computing and how does it now allow us to build reliable software components quickly within truly agile infrastructure.
Ship Week 1: Intro to Continuous Delivery and GitOps
When building cloud native applications, software developers are no longer just responsible for coding new features. In the next module of Summer of Kubernetes, our expert guides (with the help of some special guests) will cover how to safely and effectively ship software without disrupting end users. To do this you will:
✅ Understand the basics of continuous delivery and GitOps
✅ Learn about how K8s enables declarative CD (via the use of reconciliation loops)
HP Helion European Webinar Series ,Webinar #3 BeMyApp
The document discusses building cloud native applications using the Helion Development Platform. It provides information on connecting applications to services like databases, using buildpacks to deploy different programming languages, and Windows support in Cloud Foundry including .NET applications and SQL Server. The presentation includes code examples and polls questions to engage webinar participants.
RedisConf18 - Using Redis as a Backend in a Serverless Application With KubelessRedis Labs
This document discusses Bitnami's products and services including their Application Catalog containing 150 applications and development runtimes packaged in multiple formats, their Stacksmith enterprise cloud migration tool, and their work defining packaging and deployment tools for Kubernetes. It provides examples of using Bitnami containers for Redis and Helm charts for Redis, and discusses how Redis can be used in a serverless way with Kubeless. Key takeaways are that Kubeapps and Helm provide great building blocks, and that features can be built with Kubeless and Redis in just minutes.
Hardening Your CI/CD Pipelines with GitOps and Continuous SecurityWeaveworks
Join us for a webinar on how to secure your CI/CD pipeline for Kubernetes with GitOps best practices and continuous runtime protection. As modern developers and DevOps teams are embarking on a quest for speed and reliability through automated CI/CD pipelines for Kubernetes, enterprises still need to ensure security and regulatory compliance.
Together with Deepfence, the Weaveworks team will explain and demonstrate how GitOps continuous delivery pipelines, combined with continuous security observability, improves the overall security of your development workflow - from Git to production.
In this webinar we will demonstrate:
Deepfence container scanning
Git-to-Kubernetes using FluxCD
Deepfence continuous runtime security
Building Cloud Native Applications Using Azure Kubernetes ServiceDennis Moon
This document provides an overview of building cloud-native applications using Azure Kubernetes Service (AKS). It discusses key concepts like containers, Docker, container registries, Kubernetes, and AKS. It also covers modern application architecture principles and 12-factor applications. Additionally, it defines common Kubernetes objects like pods, services, deployments and explains how to secure applications and monitor clusters deployed to AKS. The document recommends getting started with AKS by deploying sample applications from Azure DevOps to an AKS cluster created in the Azure portal or with the Azure CLI.
High-Precision GPS Positioning for Spring DevelopersVMware Tanzu
This document discusses high-precision GPS positioning for Spring developers. It covers GPS fundamentals and hardware, processing positioning data, and visualization. It describes using dual frequency GPS, consuming correction data via NTRIP, and processing NMEA data with libraries like GPSD. The document demonstrates receiving GPS data from an external receiver into a Spring Boot app using Spring Integration, exporting metrics to Prometheus and Grafana, and using QGIS and mobile apps for field data collection and visualization.
Journey Through Four Stages of Kubernetes Deployment MaturityAltoros
In this webinar we will discuss a crawl, walk, run approach to continuous delivery (CD) for applications, point by point:
Where to start, how to advance, and how to reach the level of maximum automation.
How to orchestrate CI/CD processes along with routing and business continuity.
When the automation level is sufficient.
GitOps principles and their benefits.
What tools should be used to automate CI, CD, GitOps, Container Registry, Secrets management, etc
This document discusses 4 levels of IoT maturity and how Cloud Foundry can help organizations achieve the highest level of maturity. It begins with an analogy about turning raw data into a gourmet meal using a kitchen and restaurant-style services. It then discusses 3 common problems organizations face with data and proposes Cloud Foundry as a solution. The next section discusses a case study of a medical device company using Cloud Foundry to securely and cost-effectively monitor devices. It concludes by recommending some open-source IoT apps to try on Cloud Foundry.
Yannis Zarkadas. Enterprise data science workflows on kubeflowMarynaHoldaieva
This document discusses using GitOps and multi-tenancy to provide an enterprise data science experience on Kubeflow. It describes how to deploy and manage Kubeflow using GitOps to simplify operations and accelerate time to production. GitOps allows storing all configuration in Git for versioning, rollbacks, and collaboration. Kustomize is used to manage configurations and integrate changes from upstream Kubeflow repositories while allowing customizations. This provides reproducibility, isolation of tenants, and easy upgrades in a production-ready Kubeflow cluster.
Observe and command your fleets across any kubernetes with weave git opsWeaveworks
Modern day deployments can often resemble the chaos of navigating the high seas with poor visibility and the dangers of unexpected events. Dev and test environments, running test data sets and feature flags in the public cloud, and production being served from a self-managed site that securely hosts client data can all be a challenge without full observability and control.
In this webinar, we show how you can reliably expand your Kubernetes footprint with Weave GitOps. Confidently observe and control your fleets, all from a single pane of glass across any environment.
Join this webinar to learn how to:
Control the health and propagation of customized clusters
Easily assign and secure clusters across multiple teams for multiple purposes
Observe all actions across all environments all from within Git
Understand managing all deployments across your cluster and fleets
Kubernetes 1.21 included 51 enhancements, including 13 features graduating to stable and 15 graduating to beta. Major themes included CronJobs graduating to stable, immutable secrets and configmaps, dual-stack IPv4/IPv6 support, graceful node shutdown, and the persistent volume health monitor. The 1.22 release timeline was also outlined, with enhancements freeze on May 13th and code freeze on July 8th, targeting August 4th for release. Various SIG updates provided information on enhancements for API machinery, apps, auth, CLI, cloud providers, instrumentation, network, node, scheduling and storage.
Event specifications, state of the serverless landscape, and other news from ...Daniel Krook
Presentation at Serverlessconf Paris on February 15, 2018.
https://paris.serverlessconf.io/
This is an update to the early talk at Serverlessconf NYC at:
https://www.slideshare.net/DanielKrook/the-cncf-on-serverless
The Cloud Native Computing Foundation (CNCF) Serverless Working Group - with participation from IBM, AWS, Microsoft, Red Hat, VMware, Nuclio, Serverless Inc., Huawei and many others - has been working on an open eventing specification and mapping the state of the serverless landscape, including the features of public cloud serverless platforms and the capabilities of on premises and open source Functions-as-a-Service projects. In this lightning talk you'll hear about those efforts, see the newly published whitepaper on serverless use cases, and learn how you can help steer serverless adoption through participation in the CNCF.
Microservices are the new black. You've heard about them, you've read about them, you may have even implemented a few, but sooner or later you'll run into the age-old conundrum: How do I break my monolith apart? Where do I draw service boundaries?
In this talk you will learn several widely-applicable strategies for decomposing your monolithic application, along with their respective risks and the appropriate mitigation strategies. These techniques are widely used at Wix, took us a long time to develop and have proven consistently effective; hopefully they will help you avoid the same battle scars.
The document discusses serverless computing and Apache OpenWhisk. It describes how OpenWhisk allows developers to focus on business logic rather than infrastructure by executing code in response to events in a serverless manner. OpenWhisk provides a programming model where developers can create actions to handle triggers via rules. A number of demos are presented showing how to create triggers, actions and rules with OpenWhisk to handle events and build REST APIs.
As a data scientist I frequently need to create web apps to provide interactive functionality, deliver data APIs or simply publish results. It is now easier than ever to deploy your data driven web app by using cloud based application platforms to do the heavy lifting. Cloud Foundry (http://cloudfoundry.org) is an open source public and private cloud platform that enables simple app deployment, scaling and connectivity to data services like PostgreSQL, MongoDB, Redis and Cassandra.
Resources: http://www.ianhuston.net/2015/01/cloud-foundry-for-data-science-talk/
From Developer to Data Scientist - Gaines KergosienITCamp
ABSTRACT: Due to recent advances in technology, humanity is collecting vast amounts of data at an unprecedented rate, making the skills necessary to mine insights from this data increasingly valuable. So what does it take for a Developer to enter the world of data science?
Join me on a journey into the world of big data and machine learning where we will explore what the work actually looks like, identify which skills are most important, and design a road map for how you too can join this exciting and profitable industry.
Implementing DevOps – How it came to the fore, its key elements and example d...Barton George
This short presentation takes you through how DevOps came to the fore, explains its role within a Modern IT environment and is supported by two demos. The first demos illustrates how you can combine GitLab + Kubernetes + persistent storage (PowerMax) in an automated fashion to implement automated workflows and features . The second steps you through how you can leverage an Ansible playbook to automate the setup and management of storage infrastructure at scale (Ansible modules are included with Isilon and PowerScale storage).
This presentation was originally delivered as a Linux Foundation webinar
Kubernetes - 7 lessons learned from 7 data centers in 7 monthsMichael Tougeron
Learn from the rapid journey that Adobe Advertising Cloud took to reach a multi-cloud/multi-region deployment and the lessons learned along the way. Mike will cover 7 challenging scenarios with StatefulSets, GitOps, autoscaling for machine learning and auto-remediation. Go behind the scenes of the wins & failures to see how the engineering and platform teams prevented the derailing of their Kubernetes journey. From developing with spot instances in dev to multi-cloud in production, the cloud platform team has dealt with an interesting set of challenges. As Mike will show, even challenging requirements can lead to successful deployments.
Pat Gelsinger, James Watters, Cornelia Davis at SpringOne Platform 2019VMware Tanzu
SpringOne Platform 2019
Title: Pat Gelsinger, James Watters, Cornelia Davis at SpringOne Platform 2019- Keynote Day 1 opening (James Watters)
Youtube: https://youtu.be/aJKQifLkhXI
Devoxx Poland 2019, Kraków: Talk by Mario-Leander Reimer (@LeanderReimer, Principal Software Architect at QAware)
=== Please download slides if blurred! ===
Abstract: Only a few years ago the move towards microservice architecture was the first big disruption in software engineering: instead of running monoliths, systems were now build, composed and run as autonomous services. But this came at the price of added development and infrastructure complexity. Serverless and FaaS seem to be the next disruption, they are the logical evolution trying to address some of the inherent technology complexity we are currently faced when building cloud native apps.
FaaS frameworks are currently popping up like mushrooms: Knative, Kubeless, OpenFn, Fission, OpenFaas or Open Whisk are just a few to name. But which one of these is safe to pick and use in your next project? Let's find out. This session will start off by briefly explaining the essence of Serverless application architecture. Leander will then define a criteria catalog for FaaS frameworks and continue by comparing and showcasing the most promising ones.
Open up your platform with Open Source and GitHubScott Graham
The document provides information about open sourcing projects and using GitHub. It discusses the benefits of open sourcing including increased adoption, feedback, and community. It then outlines the steps to open source a project including picking something to open source, deciding where to host it (e.g. GitHub), setting up a GitHub repository, using Git concepts like branches, structuring the project, and cleaning up and pushing the code. The document concludes with recommendations like using private and public repositories, taking advantage of GitHub tools, and considering package managers.
RedisConf18 - Redis in Dev, Test, and Prod with the OpenShift Service CatalogRedis Labs
This document discusses using Redis in development, test, and production environments with the OpenShift Service Catalog.
It demonstrates using Redis for iterative development with ephemeral instances in development. In testing, it shows production-like configurations with immutable infrastructure, recovery testing, and zero-downtime deployments. For production, it notes the Service Catalog can provide targeted Redis instances and make external services discoverable. It promotes the Open Service Broker API and OpenShift Service Catalog for expanding service options.
A Data-Driven Approach for Mobile Testing and AutomationTechWell
In the world of mobile app testing, data is your friend. So harness your data to your advantage to create an automation and testing strategy. Satyajit Malagu acknowledges that multiple devices, platforms, languages, crashes, bugs, and app stores make the scope of mobile app testing humongous. When you add in inherent human biases and team dynamics, the problems you face and prioritization challenges can be overwhelming. The data collected from analytics, bug trends, monitoring tools, test results, and other sources can help illuminate a clearer path. Join Satyajit as he provides an overview of the tools available to ensure a quality iOS/Android app. Discover a systematic way to determine which tool is suitable for which phase and context of each mobile project. Leave with a rubric on how you can direct your testing and automation efforts based on your collected data.
How to Scale With Helix Core and Microsoft Azure Perforce
This document discusses how to scale Helix Core using Microsoft Azure. It begins by explaining the benefits of using Helix Core and Azure together, such as high performance, scalability, security integration, and availability. It then covers computing, storage, and security options on Azure, including virtual machine types and operating system choices. Next, it describes how to set up global deployments with Helix Core on Azure using techniques like proxies, replicas, and the Perforce federated architecture. It concludes with examples of advanced topologies like build servers, hybrid cloud/on-premises implementations, and multi-cloud considerations.
At the end of 2017, our team started to work on a completely new mobile SDK. We started from scratch and we wanted to fix issues that we witnessed during our work on the existing SDK. And CI was one of the major topics.
This talk is about our approach to building new CI from scratch. What we tried, what didn't work, what types of issues we faced.
Keywords for this talk: Jenkins, AWS, Serverless, Docker, Mac mini, git, repo, Gerrit, Java, Go
La importancia de versionar el código: GitHub, portafolio y recursos para est...CloudNativeElSalvado
Hoy en día el uso de una herramienta de versionado de código es un elemento base para todo programador. Pero, ¿Sabías que te puede servir de portafolio? o que también puedes versionar infraestructura? y ¿Sabías que GitHub ofrece un paquete con muchos beneficios gratuitos para estudiantes de parte de sus socios? Sé parte de este evento y entérate de esto y más.
AGENDA
¿Qué es Git y para qué se utiliza?
Comandos básicos de Git
Trabajar en equipo con Git
Importancia de tener un portafolio en Git
Deployment
Beneficios de GitHub para estudiantes
This document discusses running Windows containers on Kubernetes (K8s). It provides reasons why enterprises, software vendors, and SaaS operators may want to run Windows applications on K8s, including managing dependencies, automation, and serving mixed customer bases. It outlines where K8s is a good fit for Windows applications and where it may not be. It also demonstrates how to run a demo with two Windows containers - one for a PowerShell process and one for IIS - on a K8s cluster with one Linux and two Windows nodes. The document discusses the evolution of Windows support in K8s, current limitations, and upcoming features like Containerd support and RunTimeClass. It invites contributors to the Windows community and lists
Kubernetes for Developers - 7 lessons learned from 7 data centers in 7 months...Michael Tougeron
Mike Tougeron from Adobe presented lessons learned from implementing Kubernetes across 7 data centers over 7 months. Some key lessons included the importance of communication, defining responsibilities, and training for abstracting Kubernetes resources. Additional lessons focused on code pipelines to production, ensuring applications work well on Kubernetes through metrics and monitoring, and performing cluster upgrades carefully. Managing applications and infrastructure across multiple clouds also presented challenges addressed.
Bryon Kataoka provides an overview of considerations for customers migrating from API Connect version 5 to version 2018, which is based on Docker and Kubernetes. Key steps include understanding the new version's capabilities, planning resource needs and testing approaches, preparing teams through Kubernetes and API Connect training, and adjusting to changes between versions during implementation. Migrating customers should minimize disruptions by upgrading to the latest version 5 and identifying custom policies before embarking on the transition to the cloud-native version 2018.
Talking Architecture Shop - Exploring Open Source Success at ScaleEric D. Schabell
You've heard of large scale open source architectures, but have you ever wanted to take a serious look at these real life enterprise implementations that scale? This session takes attendees on a tour of multiple use cases covering enterprise challenges like integration, optimisation, cloud adoption, hybrid cloud management, healthcare, retail, manufacturing, financial services, and much more. Not only are these architectures interesting, but they are successful real life implementations featuring open source technologies and power many of your own online experiences.
The attendee departs this session with a working knowledge of how to map general open source technologies to their solutions. Material covered is available freely online and attendees can use these solutions as starting points for aligning to their own solution architectures. Join us for an hour of power as we talk architecture shop!
Securing Red Hat OpenShift Containerized Applications At Enterprise ScaleDevOps.com
Improve and simplify securing Red Hat OpenShift containerized environments by leveraging CyberArk’s secrets management solutions and out-of-the-box certified integrations. This demo heavy technical session expands on the prior webinar and uses demos and examples to give practical guidance on how to improve securing your organization’s containerized applications. All while avoiding impacting developer velocity.
This session will provide:
A clear understanding of the challenges and requirements for securing Kubernetes and Red Hat OpenShift containerized environments at enterprise scale
The benefits of enhancing the native secrets management and security capabilities of OpenShift with CyberArk’s certified integrations
Guidance to address common security challenges, including achieving enterprise scale and availability, minimizing the time spent on audit and compliance requests, avoiding problems with developer adoption
Practical steps to get started using Conjur Open Source and next steps
CyberArk, the global leader in privileged access management, offers the industry’s most complete solution for securing both the credentials and secrets used by applications, Playbooks, scripts and other non-human identities, as well as human users. CyberArk solutions are deployed at many of the world’s largest enterprises including over half the Fortune 500.
Slides from a presentation to Rust Dublin Meetup group where I discussed why you should look at rust for backend services. Which Rust HTTP framework to use and how to deploy that onto OpenShift knative.
Combinação de logs, métricas e rastreamentos para observabilidade unificadaElasticsearch
Saiba como o Elasticsearch combina com eficiência dados em um único armazenamento e como o Kibana é usado para analisá-los. Além disso, veja como os desenvolvimentos recentes ajudam a identificar e resolver problemas operacionais mais rapidamente.
microXchg 2019, Berlin: Talk by Mario-Leander Reimer (@LeanderReimer, Principal Software Architect at QAware)
=== Please download slides if blurred! ===
Abstract: Only a few years ago the move towards microservice architecture was the first big disruption in software engineering: instead of running monoliths, systems were now build, composed and run as autonomous services. But this came at the price of added development and infrastructure complexity. Serverless and FaaS seem to be the next disruption, they are the logical evolution trying to address some of the inherent technology complexity we are currently faced when building cloud native apps.
FaaS frameworks are currently popping up like mushrooms: Knative, Kubeless, OpenFn, Fission, OpenFaas or Open Whisk are just a few to name. But which one of these is safe to pick and use in your next project? Let's find out. This session will start off by briefly explaining the essence of Serverless application architecture. We will then define a criteria catalog for FaaS frameworks and continue by comparing and showcasing the most promising ones.
DevOps KPIs as a Service: Daimler’s SolutionVMware Tanzu
1. Daimler developed a DevOps KPI-as-a-Service solution to provide transparency into key performance indicators for its Cloud Foundry-based platforms.
2. The solution collects and stores platform data daily and generates reports in Excel format on demand to analyze metrics like usage, capacity, and adoption over time.
3. Initial goals were to leverage existing platform data with little effort using a "learning by doing" approach; the team now aims to improve integration, documentation, automation, and marketing of the KPI tool within Daimler.
TEC118 –How Do You Manage the Configuration of Your Environments from Metal ...Chris Kernaghan
The document discusses configuration management in IT infrastructure. It describes how configuration management has evolved from manual processes using tools like Excel and Word documents to more automated approaches using infrastructure as code. It provides examples of configuration management systems like Puppet and Chef and shows their architectures and how they can be used to configure operating systems, databases, and applications in a consistent, repeatable manner. The presentation includes demonstrations of Puppet and Chef.
The document discusses GitLab, an open source DevOps platform. It provides an overview of GitLab's features including version control, issue tracking, code review, continuous integration/delivery, security tools, and more. Recent landmarks for GitLab include being used by over 100,000 organizations and having over 2,000 contributors. The document promotes GitLab as a one-stop shop that allows development from idea to production.
Similar to Cloud Journey: Lifting a Major Product to Kubernetes (20)
The document lists various programming languages including Java, C#, Delphi, and Python. It also covers frontend technologies like React, Angular, and Vue. Databases such as MongoDB, SQLITE, Oracle, and MySQL are mentioned along with cloud providers AWS and Azure. Source control systems including GitLab, GitHub, TFS Onpremise, and Bitbucket as well as IDEs like Visual Studio Code, IntelliJ, and Visual Studio are provided.
In this talk, Martin covers how an All-JavaScript approach with MongoDB, Express, React and Node.js (MERN) enables iterating fast, picking the example of the quickly growing product 'myOnboarding' by Haufe-Lexware. He touches on the pros and cons of this technology stack, how the technology ties in to the product's microservices architecture, and how the product team leverages CI/CD to be able to act, and react, fast and securely. The talk further touches on how the product team setup and customer feedback is crucial to iterate fast, in the right direction.
This document discusses moving two customer-facing applications, Haufe Instant Feedback and Haufe Agile Hats, from self-hosted to cloud-native architectures on AWS. It provides an overview of the architectures, which include separating the applications by product at the VPC level and using AWS Fargate for container orchestration without Kubernetes. The document outlines the security measures taken and continuous integration/delivery pipeline used to deploy updates from development to production environments on AWS.
This document provides an overview of the myOnboarding product and development approach at Haufe. Key points:
- myOnboarding is an onboarding SaaS product with a CMS, mobile apps, and responsive website to help new employees through their first months.
- It uses a microservices architecture with the MERN stack (MongoDB, Express, React, Node.js) deployed to Kubernetes. This allows for independent deployments and fast iteration.
- Features are developed using a RAD approach with short-lived branches and feature flags. This enables quick feedback loops and gradual rollout.
- Extensive automated testing of APIs and Docker images helps ensure backward compatibility and catch errors during deploys.
ONA ( organizational network analysis ) to enable individuals to impact their...Haufe-Lexware GmbH & Co KG
ONA - organizational network analysis - is becoming an important topic for HR-technology. Simply put, ONA provides insight into how organizations really function.
Embedding ONA capability has the potential to enable employers and employees to organize themselves more effectively, communicate more impactfully, and to lead their companies forward.
ONA ( organizational network analysis ) enabling individuals to impact their ...Haufe-Lexware GmbH & Co KG
ONA - organizational network analysis - is becoming an important topic for HR-technology. Simply put, ONA provides insight into how organizations really function.
Embedding ONA capability has the potential to enable employers and employees to organize themselves more effectively, communicate more impactfully, and to lead their companies forward.
One of the areas that can greatly improve the customer experience is a search that returns relevant content.
In this session, Hans presents the most current results on his research to extract a keyword vocabulary and use vectorized representations of these words to enable lawyer customers to find the content that helps them do their job.
It is a core demand of marketing & sales to segment their customer base. Join this session to learn to identify and prepare the data to perform this segmentation with machine learning.
myOnboarding is a solution that aims to help employees have the best start at a new company. It provides relevant onboarding information to employees at the right time to reduce uncertainty and improve performance and engagement. The solution was developed using rapid application development principles with an agile approach to gather feedback and continuously improve. It has evolved over time from initial frameworks like KeystoneJS to use MeteorJS and React for a customizable and scalable platform. The technology uses Docker, Kubernetes, and Azure services for continuous delivery of new features and versions to customers.
An introduction to the concept of BDD and its implementation using the JGiven framework.
Presentation for the Java User Group Freiburg meetup on October 24, 2017.
Configuration of Spring Boot applications using Spring Cloud Config and Spring Cloud Vault.
Presentation given at the meeting of the Java User Group Freiburg on October 24, 2017
1) The document discusses managing short-lived Kubernetes deployments and outlines the steps taken to implement a DevOps process using Kubernetes and Azure Container Services.
2) Key priorities included enabling CI/CD, automatic provisioning, and minimizing the need for operations work.
3) The solution implemented Kubernetes with Azure Container Services using Azure as the IaaS provider to enable on-demand development and test environments identical to production.
Opportunities offered by Serverless Architecture: What are the offers from the big Cloud Providers and how you can build a 3-tier architecture app having no servers. See also http://dev.haufe.com/Serverless_with_AWS_at_DevTalks/
The document discusses the Haufe Publishing System project and its approach using lean principles. Some key points:
- The project aimed to modernize their platform by reducing dependencies, improving sharing, and allowing for faster change.
- Lean principles like eliminating waste, amplifying learning, and deciding late were followed. Features were implemented incrementally and feedback was used for continuous improvement.
- The architectural approach focused on business value, composability, shared services, evolutionary refinement, and data-driven processes.
- The project used a pipeline approach with separate environments for development, integration, and production on Kubernetes clusters for each environment. Automated testing was done at each stage.
This document discusses Haufe-Lexware's API strategy. It advocates adopting a microservices architecture with independently working teams that follow an API style guide. APIs are organized by domain and sit at the domain boundary rather than for internal communication. API management follows a DevOps approach with immutable infrastructure, containerization, and green-blue deployments. The role of APIs is to act as a shock absorber by decoupling domains, systems, teams, and development speeds through outside-in design and self-service.
The document discusses Haufe Group's transformation to a more modern and agile technology strategy. It outlines the company's move to microservices, automation, and product teams. Key points include establishing architectural principles focused on business value over technical strategy, using microservices with a shared nothing architecture, and automating the development ecosystem through infrastructure as code, continuous integration/delivery, and containerization. The presentation provides examples from migrating services to microservices and refactoring a monolithic publishing system.
Kubernetes is an open-source platform for automating deployment, scaling, and operations of containerized applications. It provides tools to deploy containers across clusters of hosts, provide mechanisms for load-balancing, monitor health, and update containers. Kubernetes adds functionality to Docker by managing Docker hosts and containers at scale. It uses abstractions like pods, replica sets, deployments, services and ingresses to declaratively define application components and expose them using NodePorts, LoadBalancers or Ingresses. Users can interact with Kubernetes using kubectl to deploy and manage applications on the cluster.
Martin Danielsson presented on API Management with wicked.haufe.io. API Management provides discoverability and self-service access to APIs for developers, monitors traffic to provide usage insights, and protects APIs from misuse through security procedures and policies. Wicked.haufe.io is an open source API Management platform based on Mashape Kong that provides features like rate limiting, OAuth 2.0 support, and a developer portal with self signup. It is designed to run in Docker and deploy on any infrastructure for machine-to-machine communication, single page applications, and mobile apps. The presentation demonstrated wicked.haufe.io functionality through a live demo.
Odoo releases a new update every year. The latest version, Odoo 17, came out in October 2023. It brought many improvements to the user interface and user experience, along with new features in modules like accounting, marketing, manufacturing, websites, and more.
The Odoo 17 update has been a hot topic among startups, mid-sized businesses, large enterprises, and Odoo developers aiming to grow their businesses. Since it is now already the first quarter of 2024, you must have a clear idea of what Odoo 17 entails and what it can offer your business if you are still not aware of it.
This blog covers the features and functionalities. Explore the entire blog and get in touch with expert Odoo ERP consultants to leverage Odoo 17 and its features for your business too.
An Overview of Odoo ERP
Odoo ERP was first released as OpenERP software in February 2005. It is a suite of business applications used for ERP, CRM, eCommerce, websites, and project management. Ten years ago, the Odoo Enterprise edition was launched to help fund the Odoo Community version.
When you compare Odoo Community and Enterprise, the Enterprise edition offers exclusive features like mobile app access, Odoo Studio customisation, Odoo hosting, and unlimited functional support.
Today, Odoo is a well-known name used by companies of all sizes across various industries, including manufacturing, retail, accounting, marketing, healthcare, IT consulting, and R&D.
The latest version, Odoo 17, has been available since October 2023. Key highlights of this update include:
Enhanced user experience with improvements to the command bar, faster backend page loading, and multiple dashboard views.
Instant report generation, credit limit alerts for sales and invoices, separate OCR settings for invoice creation, and an auto-complete feature for forms in the accounting module.
Improved image handling and global attribute changes for mailing lists in email marketing.
A default auto-signature option and a refuse-to-sign option in HR modules.
Options to divide and merge manufacturing orders, track the status of manufacturing orders, and more in the MRP module.
Dark mode in Odoo 17.
Now that the Odoo 17 announcement is official, let’s look at what’s new in Odoo 17!
What is Odoo ERP 17?
Odoo 17 is the latest version of one of the world’s leading open-source enterprise ERPs. This version has come up with significant improvements explained here in this blog. Also, this new version aims to introduce features that enhance time-saving, efficiency, and productivity for users across various organisations.
Odoo 17, released at the Odoo Experience 2023, brought notable improvements to the user interface and added new functionalities with enhancements in performance, accessibility, data analysis, and management, further expanding its reach in the market.
Measures in SQL (SIGMOD 2024, Santiago, Chile)Julian Hyde
SQL has attained widespread adoption, but Business Intelligence tools still use their own higher level languages based upon a multidimensional paradigm. Composable calculations are what is missing from SQL, and we propose a new kind of column, called a measure, that attaches a calculation to a table. Like regular tables, tables with measures are composable and closed when used in queries.
SQL-with-measures has the power, conciseness and reusability of multidimensional languages but retains SQL semantics. Measure invocations can be expanded in place to simple, clear SQL.
To define the evaluation semantics for measures, we introduce context-sensitive expressions (a way to evaluate multidimensional expressions that is consistent with existing SQL semantics), a concept called evaluation context, and several operations for setting and modifying the evaluation context.
A talk at SIGMOD, June 9–15, 2024, Santiago, Chile
Authors: Julian Hyde (Google) and John Fremlin (Google)
https://doi.org/10.1145/3626246.3653374
The Rising Future of CPaaS in the Middle East 2024Yara Milbes
Explore "The Rising Future of CPaaS in the Middle East in 2024" with this comprehensive PPT presentation. Discover how Communication Platforms as a Service (CPaaS) is transforming communication across various sectors in the Middle East.
INTRODUCTION TO AI CLASSICAL THEORY TARGETED EXAMPLESanfaltahir1010
Image: Include an image that represents the concept of precision, such as a AI helix or a futuristic healthcare
setting.
Objective: Provide a foundational understanding of precision medicine and its departure from traditional
approaches
Role of theory: Discuss how genomics, the study of an organism's complete set of AI ,
plays a crucial role in precision medicine.
Customizing treatment plans: Highlight how genetic information is used to customize
treatment plans based on an individual's genetic makeup.
Examples: Provide real-world examples of successful application of AI such as genetic
therapies or targeted treatments.
Importance of molecular diagnostics: Explain the role of molecular diagnostics in identifying
molecular and genetic markers associated with diseases.
Biomarker testing: Showcase how biomarker testing aids in creating personalized treatment plans.
Content:
• Ethical issues: Examine ethical concerns related to precision medicine, such as privacy, consent, and
potential misuse of genetic information.
• Regulations and guidelines: Present examples of ethical guidelines and regulations in place to safeguard
patient rights.
• Visuals: Include images or icons representing ethical considerations.
Content:
• Ethical issues: Examine ethical concerns related to precision medicine, such as privacy, consent, and
potential misuse of genetic information.
• Regulations and guidelines: Present examples of ethical guidelines and regulations in place to safeguard
patient rights.
• Visuals: Include images or icons representing ethical considerations.
Content:
• Ethical issues: Examine ethical concerns related to precision medicine, such as privacy, consent, and
potential misuse of genetic information.
• Regulations and guidelines: Present examples of ethical guidelines and regulations in place to safeguard
patient rights.
• Visuals: Include images or icons representing ethical considerations.
Real-world case study: Present a detailed case study showcasing the success of precision
medicine in a specific medical scenario.
Patient's journey: Discuss the patient's journey, treatment plan, and outcomes.
Impact: Emphasize the transformative effect of precision medicine on the individual's
health.
Objective: Ground the presentation in a real-world example, highlighting the practical
application and success of precision medicine.
Data challenges: Address the challenges associated with managing large sets of patient data in precision
medicine.
Technological solutions: Discuss technological innovations and solutions for handling and analyzing vast
datasets.
Visuals: Include graphics representing data management challenges and technological solutions.
Objective: Acknowledge the data-related challenges in precision medicine and highlight innovative solutions.
Data challenges: Address the challenges associated with managing large sets of patient data in precision
medicine.
Technological solutions: Discuss technological innovations and solutions
Baha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdfBaha Majid
IBM watsonx Code Assistant for Z, our latest Generative AI-assisted mainframe application modernization solution. Mainframe (IBM Z) application modernization is a topic that every mainframe client is addressing to various degrees today, driven largely from digital transformation. With generative AI comes the opportunity to reimagine the mainframe application modernization experience. Infusing generative AI will enable speed and trust, help de-risk, and lower total costs associated with heavy-lifting application modernization initiatives. This document provides an overview of the IBM watsonx Code Assistant for Z which uses the power of generative AI to make it easier for developers to selectively modernize COBOL business services while maintaining mainframe qualities of service.
UI5con 2024 - Keynote: Latest News about UI5 and it’s EcosystemPeter Muessig
Learn about the latest innovations in and around OpenUI5/SAPUI5: UI5 Tooling, UI5 linter, UI5 Web Components, Web Components Integration, UI5 2.x, UI5 GenAI.
Recording:
https://www.youtube.com/live/MSdGLG2zLy8?si=INxBHTqkwHhxV5Ta&t=0
What is Continuous Testing in DevOps - A Definitive Guide.pdfkalichargn70th171
Once an overlooked aspect, continuous testing has become indispensable for enterprises striving to accelerate application delivery and reduce business impacts. According to a Statista report, 31.3% of global enterprises have embraced continuous integration and deployment within their DevOps, signaling a pervasive trend toward hastening release cycles.
WMF 2024 - Unlocking the Future of Data Powering Next-Gen AI with Vector Data...Luigi Fugaro
Vector databases are transforming how we handle data, allowing us to search through text, images, and audio by converting them into vectors. Today, we'll dive into the basics of this exciting technology and discuss its potential to revolutionize our next-generation AI applications. We'll examine typical uses for these databases and the essential tools
developers need. Plus, we'll zoom in on the advanced capabilities of vector search and semantic caching in Java, showcasing these through a live demo with Redis libraries. Get ready to see how these powerful tools can change the game!
UI5con 2024 - Boost Your Development Experience with UI5 Tooling ExtensionsPeter Muessig
The UI5 tooling is the development and build tooling of UI5. It is built in a modular and extensible way so that it can be easily extended by your needs. This session will showcase various tooling extensions which can boost your development experience by far so that you can really work offline, transpile your code in your project to use even newer versions of EcmaScript (than 2022 which is supported right now by the UI5 tooling), consume any npm package of your choice in your project, using different kind of proxies, and even stitching UI5 projects during development together to mimic your target environment.
Most important New features of Oracle 23c for DBAs and Developers. You can get more idea from my youtube channel video from https://youtu.be/XvL5WtaC20A
Enhanced Screen Flows UI/UX using SLDS with Tom KittPeter Caitens
Join us for an engaging session led by Flow Champion, Tom Kitt. This session will dive into a technique of enhancing the user interfaces and user experiences within Screen Flows using the Salesforce Lightning Design System (SLDS). This technique uses Native functionality, with No Apex Code, No Custom Components and No Managed Packages required.
A neural network is a machine learning program, or model, that makes decisions in a manner similar to the human brain, by using processes that mimic the way biological neurons work together to identify phenomena, weigh options and arrive at conclusions.
8 Best Automated Android App Testing Tool and Framework in 2024.pdfkalichargn70th171
Regarding mobile operating systems, two major players dominate our thoughts: Android and iPhone. With Android leading the market, software development companies are focused on delivering apps compatible with this OS. Ensuring an app's functionality across various Android devices, OS versions, and hardware specifications is critical, making Android app testing essential.
Superpower Your Apache Kafka Applications Development with Complementary Open...Paul Brebner
Kafka Summit talk (Bangalore, India, May 2, 2024, https://events.bizzabo.com/573863/agenda/session/1300469 )
Many Apache Kafka use cases take advantage of Kafka’s ability to integrate multiple heterogeneous systems for stream processing and real-time machine learning scenarios. But Kafka also exists in a rich ecosystem of related but complementary stream processing technologies and tools, particularly from the open-source community. In this talk, we’ll take you on a tour of a selection of complementary tools that can make Kafka even more powerful. We’ll focus on tools for stream processing and querying, streaming machine learning, stream visibility and observation, stream meta-data, stream visualisation, stream development including testing and the use of Generative AI and LLMs, and stream performance and scalability. By the end you will have a good idea of the types of Kafka “superhero” tools that exist, which are my favourites (and what superpowers they have), and how they combine to save your Kafka applications development universe from swamploads of data stagnation monsters!
Superpower Your Apache Kafka Applications Development with Complementary Open...
Cloud Journey: Lifting a Major Product to Kubernetes
1. Welcome to
&
Dock8s Meetup
Robert Werlich
Site Reliability Engineer
robert.werlich@verivox.com
Marlen Blaube
Senior HR Business Partner
marlen.blaube@verivox.com
2. Cloud Journey: Lifting a Major
Product to Kubernetes
Dock8s Meetup Heidelberg
Feb 27th 2019
Martin Danielsson, Haufe Group, Freiburg
@donmartin76 (Twitter, Github)
3. Dock8s Meetup Heidelberg, February 27th 2019
whoami
C:> WINDOWS.EXE
C/C++/C# Background
10+ years
$ docker ps
Containers & Kubernetes
Since ~4 years
wicked.haufe.io maintainer
OSS API Management
Solution
Architect
Developer
since 2006
7. Dock8s Meetup Heidelberg, February 27th 2019
Some numbers
100+ active
git repos
874k LOC
10-15 Developers
200-500
concur-
rent users
Typically
100 req/s
448 GB RAM
56 Cores
8.
9. Major revenue
Strategic move
to containers Modular
Architecture
Without Container
Experience
Hosted with Hoster
(€€€)
Long Release
cycles
(LOTS of) Manual
Work for Releases
Little Operations
Insight
Error tracking
very difficult
Non-Parity
Dev/Test/Prod
(Cost!)
Legacy Web App
(Java based)
10. Dock8s Meetup Heidelberg, February 27th 2019
Vision – Goals
Enabling
CI/CD
Automatic
Provisioning
Full Insight
Minimize
Ops
13. Dock8s Meetup Heidelberg, February 27th 2019
Stakeholder Management
CONVINCE THEM,
DON‘T PERSUADE
THEM
COMMUNICATE
OFTEN AND
CLEARLY
DON‘T
UNDERESTIMATE
TASKS AT HAND
BE TRANSPARENT SHARE
SUCCESSES
BUT ALSO
FAILURES!
14. Dock8s Meetup Heidelberg, February 27th 2019
Team Setup – Vision
100% DevOps Engineers
T-Shaped Engineers
No dedicated manual testers
Automate! YBI, YRI. Ops experience?
15. Dock8s Meetup Heidelberg, February 27th 2019
Some HR topics
Release
Managers?
Operations
Responsibility?
Quality
Engineers
(testers)?
On Call Duty?
18. Dock8s Meetup Heidelberg, February 27th 2019
Steps to DevOps Happiness
Provision Deploy CI/CD
Weekly for Production, Daily for Dev/Test
Ship when ready!
19. Dock8s Meetup Heidelberg, February 27th 2019
Wait, uh, what…?
Target
“No-Ops”
No long-running
systems
Enable validation of
3rd Party component
upgrades
Incremental
changes
Practice Disaster
Recovery Daily
100% Reproducible
Deployments
On-demand Production
Identical Environments
20. Dock8s Meetup Heidelberg, February 27th 2019
Code
&
Pipelines
So, it‘s all…
… and pipelines are also code
21. Dock8s Meetup Heidelberg, February 27th 2019
Incremental Backend Development
Merge feature to
master
•After code
review
•Including test
suite changes
Build master
branch
•Includes unit
testing
•First integration
tests
Deploy to
integration system
•Blue/Green with
integration tests
Deploy to
Production
•Blue/Green with
integration tests
22. Dock8s Meetup Heidelberg, February 27th 2019
Incremental Frontend Development
Merge feature to
master
•After code
review
•Including test
suite changes
Build master
branch
•Includes unit
testing
•First integration
tests
Deploy to
integration system
•Run e2e
integration tests
•Rollback if
failing
Deploy to
Production
•Run e2e
integration tests
•Rollback if
failing
24. Dock8s Meetup Heidelberg, February 27th 2019
Full Provisioning
Create backup
Provision new
infrastructure
•From backups
•Same as
disaster
recovery!
Deploy
components
•Using
deployment
pipelines
•Partly
parallelized
Top level DNS
switch
•Using DNS
traffic
manager
Destroy old
infrastructure
•If tests
succeed
25. Dock8s Meetup Heidelberg, February 27th 2019
Persistence Options
Roll your own persistence Persistence “as a service”
Self managed VMs (incl. NFS) Managed Disks
(AWS EBS, Azure Managed Disks)
DBaaS (many options)
Files as a service
(AWS EFS, Azure Files)
Gluster/Ceph FS (cluster)
26. Dock8s Meetup Heidelberg, February 27th 2019
iDesk2 Deployment Architecture
Resource Group
Kubernetes
Cluster
ks8
Master
ks8
Agent
ks8
Agent n
…
NFS
VM(s)
Postgres
VM(s)
Disks
Disks
• Azure Files not fast enough
• Legacy components depend on
UNIX rights (Azure Files is SMB)
• Azure Disks only ReadWriteOnce
• Azure PGaaS was not yet available
• More „bang for your buck“
• PG Admin knowledge in Team
28. Dock8s Meetup Heidelberg, February 27th 2019
Some hints…
Assess your Persistence
Needs early on
If possible, use DBaaS
(avoid NIH syndrome)
Externalize Configuration
Shared File Storage is not
“Cloud Native”
30. Dock8s Meetup Heidelberg, February 27th 2019
Now that we have Kubernetes…?
Self healing
Robust
Production Ready
Battle proven
“Vertrauen ist gut...
… Kontrolle ist besser!”
Complex
Additional Abstraction
Layer
31. Dock8s Meetup Heidelberg, February 27th 2019
“Kontrolle” - What do you mean?
Detecting these things is a start...
32. Dock8s Meetup Heidelberg, February 27th 2019
Fail: Lyin’ Monitors
End-to-End Monitoring
ALL GOOD
People logging in
500
… an entire weekend.
34. Dock8s Meetup Heidelberg, February 27th 2019
Prometheu
s
A
Metrics
Endpoint
http://A:8080/metrics
JVM Metrics
Node.js Metrics
VM Exporters
(node_exporter)
DB Exporters
(pg_exporter)
Kubernetes Statistics
Prometheus Client based
Custom Exporters
...
BTime Series
DB
36. Dock8s Meetup Heidelberg, February 27th 2019
Metrics
White Box Black Box
Counters
GaugesHistograms
Summaries Application
Network
Latencies
Errors
Timeouts
Infrastructure
Disk Space
CPU
Memory
Pod Status
46. Dock8s Meetup Heidelberg, February 27th 2019
Percentage of document
retrieval requests served within
0.25 and 1s
Percentage of search requests
answered within 1, 3 and 7.5s
Percentage of Error Pages
Indicators
95% and 98.5%
50%, 95% and 98.5%
<1%
Agreements
Service Level
48. Dock8s Meetup Heidelberg, February 27th 2019
Holistic View
Instrument early (and lots)
Deployments easier
Less fear of change
We are in control!
hope and think we
49. Dock8s Meetup Heidelberg, February 27th 2019
Fails: Resiliency Issues
VMs are sometimes
patched and restarted.
Or they just die.
So will any
service on them.
Networks are
unreliable.
Connections will fail.
Use (libraries for)
circuit breakers
and retries.
Re-establishing TLS on
each call to external
services is expensive.
… and the service
will hate you. Use
Keep-Alive.
SPOFs will
eventually fail.
Assess and act.
Learn how to
detect problems.
52. Dock8s Meetup Heidelberg, February 27th 2019
Key Performance
Indicators
• >70% Cost Saving
• Release Effort down >98% via
automation
• Higher Release Pace (3-5/y to 15-20/mo)
• Performance measurable
• Faster Reaction to Issues
• Unlocks Cloud Technology
Dock8s Meetup Heidelberg, February 27th 2019
53. Dock8s Meetup Heidelberg, February 27th 2019
k8s Ops possible
as a Team
Requires full automation
(also test)
Team dedication Rethinking ops is
challenging
No Silver Bullet
Assess your requirements
Could just as well have been AWS; Azure was investigated first as we didn‘t know whether we would have the need to go to Azure Germany (this was 2017).
This has a couple of implications:
You need backups for persistent data inside the cluster
You must be able to automatically restore them
You will also get a certain amount of „non-persisted“ time (time where you cannot persist user changed) – for Aurora, this is around 90 minutes each Tuesday early morning Acceptable for us, may not be acceptable for other teams
Instrument your components to get out (possibly) interesting metrics.
Rather instrument more, if you do it from the start, it doesn’t hurt much. And adding later is also rather easy.
Monitor and alert on anticipated failures or known previous issues If for some reason you cannot find or fix the root cause* With Monitor and Alert, I subsume Logging and Tracing here.
Enable insight and visualization - or “debugging” if you will - to see inside your system what might have gone wrong.
“This is what you would call ‘instrumenting’ your code” - exporting metrics from it
You would use a client library (there are client libraries for most programming languages). This takes your application current state of all tracked metrics and transforms it into a format that Prometheus understands and exposes it via the http endpoints, which Prometheus scrapes at regular time intervals.
There are a number of libraries and servers which help in exporting existing metrics from third-party systems as Prometheus metrics. This is useful for cases where it is not feasible to instrument a given system with Prometheus metrics directly
What can we do with that data - Two examples: Dashboarding and Alerting
E.g. Grafana can use Prometheus as a data source via the Prometheus Query Language to display time series as a graph, e.g. for dashboarding.
Simultaneously, Prometheus can evaluate certain expressions to see whether alerts have to be triggered. These are then passed on to another component of Prometheus, the Alertmanager, which in turn makes sure the alerts are delivered to wherever they should be delivered to. For us, that’s (both) Rocket Chat and E-Mail.
One step back, what kind of metrics exist? Let’s look at a couple of categories - first, white box and black box. That’s where the metrics come from - do you measure them inside your stack (white box), or do you probe from the outside - black box.
Hint: You should do both.
Bottom left you see different types of metrics here specifically Prometheus supports - Counters (things which only increase), Gauges (things which go up and down), Histograms (to see a discrete distribution) and Summaries (for seeing quantiles).
Bottom right you see the sources of metrics - infrastructure (things like disk space, CPU and memory utilization), network (latencies, errors, timeouts and such) and perhaps the most interesting bit - your own application metrics.
Recall - there is no automatic way of retrieving all of your application specific metrics - this is the instrumentation bit.
It was in parts an eye opener to us when we started looking at metrics...
By simply inspecting response times on various end points, we could pinpoint issues we weren’t really aware of, but which helped getting an even better experience on our web site.
Mind you - all of these things were already in the logs - but who reads logs in case you don’t REALLY have a problem. Takers?
Typical “Newletter Friday” - The editors of on of the largest products send out newsletters each friday, which we immediately see on login numbers.
So, what’s this number?
It’s number of individual time series we collect from our production system. Prometheus can do lots more, up to millions, but it’s still quite a number of things to look at and evaluate.
OK, so, great. We have a bunch of metrics. What do we do with those?
Of course you should alert on infrastructure failure - if the failure entrails any need of intervention. If you can automatically recover - no need to alert.
Rule of thumb: Alerts should be ACTIONABLE. If there’s an alert - you should have to do something (even if it’s just investigating). If an alert doesn’t require any actions - chances are good you should not alert on it (and just collect statistics).
We have found out that this is dang hard though.
The other thing that is just plain clear is that you must make sure that your application is available - probably by using some black box type of end to end test. If your application isn’t available - that must be your top priority to get it back up and running (but that’s obvious).
Is that enough though?
Let’s say we have 99,99% availability, does that mean everything is fine? No. We must find additional metrics to measure how well we are doing.
Actually, we would like to measure user happiness. We are doing that with NPS and “Kundenbarometer”, but we’d like to have at least an approximation in real time. Well, you can’t do that, but you can approximate via the definition of functional and non-functional requirements you know (or at least assume) are important for customer happiness.
Typical things are: Latencies or expected runtimes, and of course that your application does what it’s intended to do.
This takes us back to metrics and calculated metrics, in other words KPIs, or SLIs, Service Level Indicators.
Disclaimer: This is not an exact science, but always a guesstimate. Rule of thumb should at least be: If these indicators are off, the customer will definitely be UNHAPPY.
And in addition to these, we of course also track the availability, where we also have an SLA.
So, as these are the values to which we will be held accountable, we better also alert on these.
We have gathered a more holistic view on our application - we no longer just look at what has to be developed, we also, from the start, look at how the components will behave at runtime, and how we can observe them.
We don’t have to think very hard about how and where to run things - we have solved most tricky problems using Kubernetes and the toolset around; we just have to re-apply patterns, while relying on that most things aren’t that complicated that nobody has solved them yet.
We have a lot less fear of changing things. Since everything is built up as code, everything is easily and fairly quickly reproducible, and we can efficiently test changes up front.
We have gathered a feeling that we are in control. At least, we hope and think we are in control. And that’s a nice feeling.
Restarted VMs:
Redis cluster failed after restart
AppServer could not reconnect to Redis
Pods running only once? SPOF
Expect failures
Circuit breakers: Currently Hystrix, investigating Istio/linkerd
TLS: External semantic search – clogged up their load balancer after a couple of hours of traffic.