3 Pitfalls Everyone Should Avoid with Cloud Data

•Download as PPTX, PDF•

0 likes•77 views

The daily hype is all around you. From cloud native, multicloud, to hybrid cloud, this is the path to your digital future. The choices you make as a developer does not preclude the daily work of enhancing your customer's experience and agile delivery of your applications. With all this delivery and infrastructure, there is a lot of data generated when engaging with any cloud experience. Regulatory and compliance pressures force us to store audit and observability data. Understanding the pitfalls around the collection, storage, and maintenance of your cloud data can mean the difference between bankruptcy and success with our cloud native strategy. Let us take you on a journey, looking closely at the decisions you are making as a developer delivering and dealing with monitoring your applications. Join us for an hour of power, where real customer experiences are used to highlight the three top lessons learned as their developers transitioned their data needs into cloud native environments. Key Takeaways: Attendees to this session will gain insights into the data explosion that is part of the large scale cloud native world. Real customer experiences are used to highlight the three top lessons learned as their developers transitioned their data needs into cloud native environments.

Technology

chronosphere.io
chronosphere.io
3 Pitfalls
Eric D. Schabell
Director Evangelism
@ericschabell{@fosstodon.org}
Everyone Should Avoid with Cloud Data

chronosphere.io
Understand your
cloud costs?

chronosphere.io
De Persgroep
(Based on audience question from ‘Power to Innovate talk)
“Why don’t you go 100% to cloud for hosting your news group
assets?”
The quoted price for hosting was OK, but the bandwidth
quotes were off the charts.
Shortly thereafter, during the Paris attacks (Charlie Hebdo)
the French people crashed all local news sites. The Walloon
(FR Belgium) sites hosted by De Persgroep received an extra
1.2 million unique visitors…. (810K BE, 450K NL).

chronosphere.io
Observability across
entire landscape?

chronosphere.io
“It’s remarkable how common
this situation is, where an
organization is paying more for
their observability data, than
they do for their production
infrastructure.”

chronosphere.io
Data complexity
Experiment:
- Hello World app on 4 node
Kubernetes cluster with
Tracing, End User Metrics
(EUM), Logs, Metrics
(containers / nodes)
- 30 days == +450 GB

chronosphere.io
The struggle is real
“I don't yet collect spans/traces because I can hardly get our devs to care about basic metrics, let alone traces.”
“This is a large enterprise with approx. 1000 developers. Cultivating a culture of engineering that cares about
availability is a challenge that we need to solve alongside any technical implementations.”

chronosphere.io
https://go.chronosphere.io/2023-observability-report.html
87%
of engineers say using
cloud native architectures
have increased the
complexity of discovering
and troubleshooting
incidents

chronosphere.io
10 hours
on average, per week, trying
to triage and understand
incidents - a quarter
of a 40 hour work week

chronosphere.io
33%
said those issues disrupted
their personal life
39%
admitting they are
frequently stressed out

chronosphere.io
22%
said they want to quit

chronosphere.io
Cloud Native Observability
at Scale

chronosphere.io
3. FinOps the crucial Ops

chronosphere.io
Know the cost of
observability
metrics data?

chronosphere.io
Dedicated FinOps
“By 2023, 80% of organizations
using cloud services will
establish a dedicated FinOps
function to automate policy-
driven observibility and
optimization of cloud
resources to maximize value.”
-- Source: IDC 2022

chronosphere.io
What should be
the #1 item on
cloud wishlist?

chronosphere.io
1. … ??? …
2. Determine your goals of migrating data to the cloud
3. Assess your current situation
4. Select the right cloud migration partner
5. Create your business case for the cloud
6. Select the type of cloud environment needed – public, private, hybrid or hybrid-multi?
7. Determine the specific cloud components necessary
8. Choose the right cloud provider
9. Plan the cloud approach
10. Execute the migration
11. Observability of the production environment

Questions?
Eric D. Schabell
Director Evangelism
@ericschabell{@fosstodon.org}

Similar to 3 Pitfalls Everyone Should Avoid with Cloud Data

Making real sense of enterprise Cloud computing in the context of your business is not always a trivial task. The volume, diversity and intensity of opinions on what cloud can do for your organization are relentless, as are the pressures to lower IT costs, speed up implementations, simplify enterprise IT and deliver more value in your own organizations. Shifting your mission critical systems to the cloud presents a formidable range of challenges for many organizations, least of which the potential loss of control over your disaster recovery capability. Conversely, keeping your enterprise IT systems where you can see them, and using the cloud to manage your backups and disaster recovery may appear to run counter to the prevailing perception that the cloud is the ultimate destination for all IT systems. In this presentation, Rob Livingstone will be covering off some of the key considerations of disaster recovery planning in the hybrid cloud environment and how, paradoxically, cloud could either be the cause of your disaster or has the potential to save you from one. He will be offering practical insights and tips on how you should approach the cloud when it comes to planning for the worst so that you come out looking your best.

Will the Cloud be your disaster, or will Cloud be your disaster recovery?

Livingstone Advisory

The daily choices you make as an engineer when shipping code contributes to the feedback loop. In cloud native environments a surprising amount of data is generated from the application layer down to infrastructure and along the delivery path. Regulatory and compliance pressures force us to store audit and observability data. Understanding the pressures on our engineering teams around the collection, storage, and maintenance of your cloud data can mean the difference between successful teams and burnout. Let us take you on a journey, looking closely at the current state of observability based on a recent research conducted with 500 cloud native engineers and find out what it’s like to be in the trenches.

Checking the pulse of your cloud native architecture

Eric D. Schabell

The daily hype is all around you. From cloud, hybrid cloud, to hybrid multicloud, you’re told this is the way to ensure a digital future for your business. These choices you’ve got to make don’t preclude the daily work of enhancing your customer's experience and agile delivery of those applications. Let us take you on a journey, looking closely at what hybrid multicloud means for your business, the decisions being made about delivering applications, and dealing with legacy applications, likely the most important resources to your business. Join us for an hour of power, where real customer experiences are used to highlight the three top lessons learned as they transitioned into hybrid multicloud environments. https://docs.google.com/presentation/d/1_MFHY3YJyvz-qrJfOZKDJ_dwTLhd2WxpQGFWxd34r5s

Red Hat Summit 2018 - 3 pitfalls everyone should avoid with hybrid multicloud

Eric D. Schabell

Presented at QuantCon Singapore 2016, Quantopian's quantitative finance and algorithmic trading conference, November 11th. The vast proliferation of data related to the financial industry introduces both new opportunities and challenges to quantitative investors. These challenges are often due to the nature of big data and include: volume, variety, and velocity. In this talk, Dr. Cheng will take the audience on a tour of the “big-data production line” in InfoTrie and show how the financial news collected from various and customizable sources are transformed into quantitative signals in a real-time manner. The talk will touch on various kind of topics like sentiment analysis, entity detection, topic classification, and big-data tools.

“Real Time Machine Learning Architecture and Sentiment Analysis Applied to Fi...

Quantopian

Industry4.0 IoT Vincent Thavonekham - Azure Day Ukraine

FactoVia

Are you interested in dipping your toes in the cloud native observability waters, but as an engineer you are not sure where to get started with tracing problems through your microservices and application landscapes on Kubernetes? Then this is the session for you, where we take you on your first steps in an active open-source project that offers a buffet of languages, challenges, and opportunities for getting started with telemetry data. The project is called openTelemetry, but before diving into the specifics, we’ll start with de-mystifying key concepts and terms such as observability, telemetry, instrumentation, cardinality, percentile to lay a foundation. After understanding the nuts and bolts of observability and distributed traces, we’ll explore the openTelemetry community; its Special Interest Groups (SIGs), repositories, and how to become not only an end-user, but possibly a contributor.We will wrap up with an overview of the components in this project, such as the Collector, the OpenTelemetry protocol (OTLP), its APIs, and its SDKs. Attendees will leave with an understanding of key observability concepts, become grounded in distributed tracing terminology, be aware of the components of openTelemetry, and know how to take their first steps to an open-source contribution! Key Takeaways: Open source, vendor neutral instrumentation is an exciting new reality as the industry standardizes on openTelemetry for observability. OpenTelemetry is on a mission to enable effective observability by making high-quality, portable telemetry ubiquitous. The world of observability and monitoring today has a steep learning curve and in order to achieve ubiquity, the project would benefit from growing our contributor community.

Observability For You and Me with OpenTelemetry

Eric D. Schabell

The crazy growth of observability data often outpaces the growth of your applications and infrastructure. Data volume and complexity can quickly grow out of control – reducing system reliability, lengthening remediation time, and increasing costs. To get data under control, central observability teams and engineers need detailed visibility into data usage, the ability to filter and aggregate data intelligently, and manage high cardinality data without weakening issue detection or query performance. In this webinar, you will learn: - About different architectures and methods for ingesting, filtering, and aggregating complex data - Why Chronosphere’s unique server-side approach is optimally designed for the scale and complexity of cloud native observability data - How some of the most successful cloud native businesses have reduced data volumes by 42% while improving issue detection and remediation

How to Wrestle Your Observability Data Demons and Win!

Eric D. Schabell

Find out what's going on in the world of #containers in 2018. Read #predictions from 16 of the industry's leading experts to learn more about Docker, Kubernetes, Microservices and more! Hear from industry thought leaders from companies like Datadog, Hedvig, ManageEngine, Mirantis, Red Hat, SUSE and more. Make sure to also read the more than 280+ other expert predictions from technologies across virtualization, cloud computing, hyperconverged, IoT, security, etc. here: http://bit.ly/2DQi2OT

VMblog - 2018 Containers Predictions from 16 Industry Experts

vmblog

Situation Normal, FOWA Dublin

Simon Wardley

Mary Barnsdale article about Fog Computing for Cisco

Mary Barnsdale

Cloud Computing - Fundamentals and Applications

Emiliano Reynares

We all want to have better business outcomes for our organizations solutions, such as faster remediation of problems, easier problem detection, greater revenue generation, happier customers, and engineering teams that can remain focused on delivering more business value. The problem with the popular three pillars (metrics, logs, tracing) is that you are talking about technology aspects and not about solutions. It's like talking about the tools in a mechanics toolbox used to make your convertible run again, instead of focusing on the blue smoke coming out of the exhaust, the rising engine temperature, and using that data to quickly remediate the problem by replacing the seals to prevent oil leaking in the engine. Let’s quickly tour the phases that lead to better outcomes and get our focus back on effective observability goals. Key takeaways - Modern cloud native observability needs three guiding phases to provide better outcomes, not tooling. Based on article: https://www.schabell.org/2022/09/o11y-guide-cloud-native-observability-needs-phases.html

SRECon EU 2023 - Three Phases to Better Observability Outcomes

Eric D. Schabell

OCRE Workshop: Shaping the Earth Observation Services Market for Research. Session 3: Presentations from DIAS and eoMALL. This workshop aims to bring the EO service providers closer to the research community, capture their needs and develop fit for purpose EO services. The event will be the 4th OCRE Requirements Gathering Workshop. Researchers and Earth Observation Service Providers will be asked to provide inputs to help us shape OCRE's tender. The OCRE project aims to provide the first end-to-end instance of organised, large-scale market pull for EO services in Europe. These services will be provided for free to EU researchers through the European Open Science Cloud. To ensure that the services meet the actual needs of the research community we invite both the demand and the supply side, to share their views and engage in a productive dialogue. Our aim is to capture the needs of EU researchers and inform the EO service providers so that they make available services that effectively address them. We will also explain how the OCRE process will work, how the different stakeholders should be involved and how to make the most of the foreseen benefits.

Mundi

OCRE | Open Clouds for Research Environments

Are you collecting just about every metric under the sun and the kitchen sink too? Understanding the cost of collecting metrics and the usefulness of those metrics is the only way to scale in a cloud native world. You can’t get away with just collecting everything as you grow. Your observability teams need to make decisions about what to collect, what to drop, what to aggregate, and still be able to alert, triage, remediate, and do their root cause analysis on a daily basis. Gain immediate insights into high cost data (DPPS), when to drop time series data, and how to determine when the value of that data is at its lowest. Session includes a recorded demo video of it in action.

Optimizing Observability Spend: Metrics

Eric D. Schabell

Cloud costs: my 2 cents

RightScale

Research topics for EON Realty's Research Grant Program (RGP) v16

Senthilkumar R

Conquering Disaster Recovery Challenges and Out-of-Control Data with the Hybr...

actualtechmedia

Technologies to Build Hybrid Clouds on Public-Private Infrastructures

Helix Nebula The Science Cloud

The Death Of Computer Forensics: Digital Forensics After the Singularity

Tech and Law Center

Comarch ICT - CLOUD EXPO

Comarch_Services

Similar to 3 Pitfalls Everyone Should Avoid with Cloud Data (20)

Will the Cloud be your disaster, or will Cloud be your disaster recovery?

Checking the pulse of your cloud native architecture

Red Hat Summit 2018 - 3 pitfalls everyone should avoid with hybrid multicloud

“Real Time Machine Learning Architecture and Sentiment Analysis Applied to Fi...

Industry4.0 IoT Vincent Thavonekham - Azure Day Ukraine

Observability For You and Me with OpenTelemetry

How to Wrestle Your Observability Data Demons and Win!

VMblog - 2018 Containers Predictions from 16 Industry Experts

Situation Normal, FOWA Dublin

Mary Barnsdale article about Fog Computing for Cisco

Cloud Computing - Fundamentals and Applications

SRECon EU 2023 - Three Phases to Better Observability Outcomes

Mundi

Optimizing Observability Spend: Metrics

Cloud costs: my 2 cents

Research topics for EON Realty's Research Grant Program (RGP) v16

Conquering Disaster Recovery Challenges and Out-of-Control Data with the Hybr...

Technologies to Build Hybrid Clouds on Public-Private Infrastructures

The Death Of Computer Forensics: Digital Forensics After the Singularity

Comarch ICT - CLOUD EXPO

More from Eric D. Schabell

Great observability begins with great instrumentation! We know it's hard to decide where to start your observability journey, so we've come up with a perfect introduction to observability workshop collection getting you hands-on with the best open source cloud native observability projects available. Attendees can pick their own cloud native observability learning path (https://o11y-workshops.gitlab.io) in this session from the following workshops: OpenTelemetry (traces) - Learn how to adopt OpenTelemetry by instrumenting a sample application with spans and metrics. You’ll leave with an understanding of how telemetry travels and be ready to bring OpenTelemetry to your project. The workshop is self-paced and available online, so attendees can continue to explore after the event: https://o11y-workshops.gitlab.io/workshop-opentelemetry Prometheus (metrics) - During the workshop, you will install Prometheus, collect metrics, and learn how to effectively run it in your observability stack. The workshop is self-paced and available online, so attendees can continue to explore after the event: https://o11y-workshops.gitlab.io/workshop-prometheus Fluent Bit (pipelines) - This workshop will guide you through the open source project Fluent Bit, what it is, a basic installation, and setting up a first cloud native observability pipeline project. The workshop is self-paced and available online, so attendees can continue to explore after the event: https://o11y-workshops.gitlab.io/workshop-fluentbit Perses (visualization) - Great observability is impossible without great visualization! Learn how to adopt truly open visualization by installing Perses, exploring the provided tooling, tinkering with its API, and then get your hands dirty building your first dashboard in no time! The workshop is self-paced and available online, so attendees can continue to explore after the event: https://o11y-workshops.gitlab.io/workshop-perses

OpenShift Commons Paris - Choose Your Own Observability Adventure

Eric D. Schabell

Observability For You and Me with OpenTelemetry (with demo)

Eric D. Schabell

Are you interested in dipping your toes in the cloud native observability waters, but as an engineer you are not sure where to get started with tracing your microservices and applications on Kubernetes? Then this is the session for you, where we take you on your first steps in an active open-source project that offers a buffet of opportunities for getting started with telemetry data. The project, openTelemetry (OTEL), is where we start with de-mystifying key concepts and terms such as observability, telemetry, instrumentation to lay a foundation. Then we’ll explore the OTEL community and how to become not only an end-user, but possibly a contributor.We will wrap up with an overview of the components in this project, such as the Collector, the OTEL protocol (OTLP), its APIs, and its SDKs. Attendees will leave with an understanding of key observability concepts in distributed tracing! Key takeaways: Open source, vendor neutral instrumentation is an exciting new reality as the industry standardizes on openTelemetry for observability. OpenTelemetry is on a mission to enable effective observability by making high-quality, portable telemetry ubiquitous. The world of observability and monitoring today has a steep learning curve and in order to achieve ubiquity, the project would benefit from growing our contributor community.

Observability For You and Me with OpenTelemetry

Eric D. Schabell

The CNCF Ambassador program is designed for individuals who are passionate about cloud native technologies and want to contribute to the community. Becoming an ambassador is a great opportunity to enhance your knowledge, gain visibility within the industry, and help drive the adoption of cloud-native technologies. The road to becoming an ambassador might seem intimidating, scary, or just impossible, but it does not have to be. We've put together a roadmap that leads you to the title of CNCF Ambassador. In this session a current ambassador and the community manager share the stage to bring you insights into achieving the title of CNCF Ambassador. Whether you are a developer, student, or seasoned professional, this talk provides attendees with 5 actionable insights needed to take your cloud-native skills to the next level and become a CNCF Ambassador. Join us to learn how you can contribute to the community and advance your career by taking the road to the CNCF Ambassador community.

Roadmap to Becoming a CNCF Ambassador

Eric D. Schabell

Anyone embedded in the cloud native teams in any organization can voice their frustrations at not being taken seriously by their executive decision makers. This leads to way too much on-call stress, frustrations, and eventual burnout. With research showing us DevOps spending over 10 hrs a week on issues in their environments, we could all use quick action by our executives when we find ways to fix our cloud native issues. The trick is to tell the tales we accumulate in such a way as to engage, inspire, and effect change in our organizations. This session provides attendees with ample cloud native bedtime stories, tricks that make your tales land within the executive human mind, and actionable insights to head home with immediate results. Join me for a half hour of power where you are empowered to tell better cloud native stories for better executive decision outcomes. Key takeaways - Attendees to this session will be given a small yet powerful set of examples to help them effectively tell their cloud native observability tales to motivate their executives into action. Humans listen to stories (tales) more than they pay attention to pages of charts, dashboards, and data. Learn how to tell your tales, terrifying and educational, with tips and tricks to engage your executives into believing your need for organization’s observability improvements.

Cloud Native Bedtime Stories - Terrifying Execs into Action

Eric D. Schabell

Optimizing Observability Spend: Metrics

Eric D. Schabell

Anyone embedded in the cloud native observability teams in any organization can voice their frustrations at not being taken seriously by their executive decision makers. This leads to way too much on-call stress, frustrations, and eventual burnout. With research showing us DevOps spending over 10 hrs a week on issues in their environments, we could all use quick action by our executives when we find ways to fix our cloud native issues. The trick is to tell the tales we accumulate in such a way as to engage, inspire, and effect change in our organizations. This session provides attendees with ample cloud native bedtime stories, tricks that make your tales land within the executive human mind, and actionable insights to head home with immediate results. Join me for a half hour of power where you are empowered to tell better observability stories for better executive decision outcomes.

Engaging Your Execs - Telling Great Observability Tales Inspiring Action

Eric D. Schabell

Storytelling is as old as time itself…. Since the beginning of humankind, we share our experiences, we teach, we inspire, we relate to stories as told all around us. How can we learn to use this powerful mechanism to tell effective tales about our production environments when dealing with our management teams? Learn how humans listen to stories (tales) more than they pay attention to pages of charts, dashboards, and data. If you want to learn how to make sure your message lands and how to effectively manage upwards in your organization, this is the session for you. Attendees will depart with a small yet powerful set of actionable examples that almost ensure your stories will capture your management's attention. One thing is certain, stories are being told, but what are your production stories and how can you become adept at telling them?

WTF is SRE - Telling Effective Tales about Production

Eric D. Schabell

Open Source 101 - Observability For You and Me with OpenTelemetry

Eric D. Schabell

Storytelling is as old as time itself…. Since the beginning of humankind, we share our experiences, we teach, we inspire, we relate to stories as told all around us. They are told by elders, they are told by kids at the dinner table, they are written down in books, and they are captured on video or tape. One thing is certain, stories are being told, but what are your stories and how can you become adept at telling them? These slides: http://go/storytelling

Storytelling - How to build and delivery a story

Eric D. Schabell

There are two primary approaches to scrape and collect metrics using Prometheus - using a centralized set of dedicated scrapers or decentralized scrapers that run as an agent. With centralized scraping, Prometheus is deployed as a central scraper to pull metrics from all discoverable endpoints and sometimes can be split across multiple centralized instances using a few different approaches. However, with a decentralized approach, Prometheus runs as an agent and in Kubernetes is deployed as a DaemonSet on each node in a cluster and only collects metrics from the node it runs on. Each model has pros and cons - especially when operating at large scale - which can make it difficult when deciding which model to use. In this session, the speaakers will provide an overview of Prometheus metrics collection at DoorDash, where having highly reliable resources, easy endpoint discovery, and real-time insights is critical. They will share insights and best practices into DoorDash’s decision to implement a decentralized model by offering pros and cons of each approach. Leave with a better understanding of the “right” model for your use case(s).

PromCon EU 2022 - Centralized vs Decentralized Prometheus Scraping Architectu...

Eric D. Schabell

You've heard of large scale open source architectures, but have you ever wanted to take a serious look at real life enterprise edge implementations that scale? This session takes attendees on a tour of multiple use cases for enterprise challenges on the edge with integration, telco, healthcare, manufacturing, and much more. Not only are these architectures interesting, but they are successful real life implementations featuring open source technologies and power many of your own edge experiences. The attendee departs this session with a working knowledge of how to map general open source technologies to their own edge solutions. Material covered is available freely online and attendees can use these solutions as starting points for aligning to their own solution architectures. Join us for an hour of power as we talk architecture shop!

DevConf.US 2022 - Exploring Open Source Edge Success at Scale

Eric D. Schabell

(Note the title of the slides was updated so does not match, but content is correct) You've heard of large scale open source architectures, but have you ever wanted to take a serious look at real life enterprise telco implementations that scale? This session takes attendees on a tour of multiple use cases for enterprise challenges in the telco domain with a look at use cases for integration, networks, 5G, hyperscalers, and much more. Not only are these architectures interesting, but they are successful real life implementations featuring open source technologies and power many of your own edge experiences. The attendee departs this session with a working knowledge of how to map general open source technologies to their own telco solutions. Material covered is available freely online and attendees can use these solutions as starting points for aligning to their own solution architectures. Join us for an hour of power as we talk architecture shop!

DevConf.US 2022 - Exploring Open Source Telco Success at Scale

Eric D. Schabell

Diagraming is one of the most important communication tools for sharing your project and architectural ideas to your colleagues and teams. In this workshop walkthrough, attendees are exposed to an open source tool we host online for designing architecture diagrams like an expert. Attendees are walked through the following in just 30 mins: - open and explore the tooling in your favourite web browser - explore the provided asset libraries for drag-and-drop designing - learn about the three types of diagrams that make up a good design - create your first simple logical diagram - create your first simple schematic diagram - create a detailed diagram - how to import and export diagrams and elements from a diagram This session is an introduction to the free online workshop available for attendees to jump right into after the session. Each of the individual labs in this workshop are stand alone, allowing the attendee to focus on anything of interest without having to work through the previous labs. If you're looking to become more proficient in sharing your ideas, architectures, and projects visually to wider audiences you can't underestimate the value of a good diagram. Join us to learn the tips and tricks that make a good diagram such a good communication vehicle and how our tooling eases your design tasks. Then head homewards with a free online workshop just waiting for you to explore! https://bit.ly/your-best-diagrams

Designing Your Best Architectural Diagrams

Eric D. Schabell

You've heard of large scale open source architectures, but have you ever wanted to take a serious look at these real life enterprise implementations that scale? This session takes attendees on a tour of multiple use cases covering enterprise challenges like integration, optimisation, cloud adoption, hybrid cloud management, healthcare, retail, manufacturing, financial services, and much more. Not only are these architectures interesting, but they are successful real life implementations featuring open source technologies and power many of your own online experiences. The attendee departs this session with a working knowledge of how to map general open source technologies to their solutions. Material covered is available freely online and attendees can use these solutions as starting points for aligning to their own solution architectures. Join us for an hour of power as we talk architecture shop!

Talking Architecture Shop - Exploring Open Source Success at Scale

Eric D. Schabell

(DevOpsDays Raleigh April 2022) You've heard of large scale open source architectures, but have you ever wanted to take a serious look at these real life enterprise DevOps implementations that scale? This session takes attendees on a tour of multiple use cases covering DevOps challenges with hybrid cloud management with GitOps, DevOps in healthcare, and much more. Not only are these architectures interesting, but they are successful real life implementations featuring open source technologies and power many of your own online experiences. The attendee departs this session with a working knowledge of how to map general open source technologies to their solutions. Material covered is available freely online and attendees can use these solutions as starting points for aligning to their own solution architectures. Join us for an hour of power as we talk architecture shop!

Talking Architecture Shop - Exploring Open Source DevOps at Scale

Eric D. Schabell

We've all had the retail shopping experience, either online or in a physical shop, but have you ever wanted to take a serious look at how they deliver that experience in a cost effective manner at scale? This session takes attendees on a tour of three architecture blueprints covering three of the most interesting solutions retail organisations have to implement successfully to survive. Not only are these architecture solutions interesting, but they are based on successful real life implementations featuring open source technologies and power a lot of your world wide shopping experiences. The following three use cases will be discussed and detailed in architectural diagrams showcasing how open technologies are integrated to solve them: - Supply chain integration - Real-time stock control - Point of sale The attendee shall depart this session with a working knowledge of how to map general open source technologies to their solutions with examples all based on real life use cases. Material covered is available freely online and attendees can use these solutions as starting points for aligning to their own solution spaces as they can be pre-loaded into our architecture diagram tooling for modification. Furthermore, content is available online for each of these use cases providing attendees with reference material post conference.

DevConf.CZ - Talking Architecture Shop with Anyone

Eric D. Schabell

You've heard of large scale open source architectures, but have you ever wanted to take a serious look at these real life enterprise implementations that scale? This session takes attendees on a tour of multiple use cases covering enterprise challenges like integration, optimisation, cloud adoption, hybrid cloud management, and much more. Not only are these architectures interesting, but they are successful real life implementations featuring open source technologies and power many of your own online experiences. The attendee departs this session with a working knowledge of how to map general open source technologies to their solutions. Material covered is available freely online and attendees can use these solutions as starting points for aligning to their own solution architectures. Join us for an hour of power as we talk architecture shop!

Talking architecture shop - Exploring open source success at scale

Eric D. Schabell

More from Eric D. Schabell (18)

OpenShift Commons Paris - Choose Your Own Observability Adventure

Observability For You and Me with OpenTelemetry (with demo)

Observability For You and Me with OpenTelemetry

Roadmap to Becoming a CNCF Ambassador

Cloud Native Bedtime Stories - Terrifying Execs into Action

Optimizing Observability Spend: Metrics

Engaging Your Execs - Telling Great Observability Tales Inspiring Action

WTF is SRE - Telling Effective Tales about Production

Open Source 101 - Observability For You and Me with OpenTelemetry

Storytelling - How to build and delivery a story

PromCon EU 2022 - Centralized vs Decentralized Prometheus Scraping Architectu...

DevConf.US 2022 - Exploring Open Source Edge Success at Scale

DevConf.US 2022 - Exploring Open Source Telco Success at Scale

Designing Your Best Architectural Diagrams

Talking Architecture Shop - Exploring Open Source Success at Scale

Talking Architecture Shop - Exploring Open Source DevOps at Scale

DevConf.CZ - Talking Architecture Shop with Anyone

Talking architecture shop - Exploring open source success at scale

Recently uploaded

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Orbitshub

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Six Myths about Ontologies: The Basics of Formal Ontology

johnbeverley2021

Understanding the FAA Part 107 License ..

Christopher Logan Kennedy

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

The integration landscape is changing rapidly with the introduction of technologies like GraphQL, gRPC, stream processing, iPaaS, and platformless. However, not all existing applications and industries can keep up with these new technologies. Certain industries, like manufacturing, logistics, and finance, still rely on well-established EDI-based message formats. Some applications use XML or CSV with file-based communications, while others have strict on premises deployment requirements. This talk focuses on how Ballerina's built-in integration capabilities can bridge the gap between "old" and "new" technologies, modernizing enterprise applications without disrupting business operations.

Modernizing Legacy Systems Using Ballerina

WSO2

Simplifying Mobile A11y Presentation.pptx

MarkSteadman7

AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)

Samir Dash

Quantum Leap in Next-Generation Computing

WSO2

Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Mcleodganj Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Mcleodganj Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Mcleodganj Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Deepika Singh

Stronger Together: Developing an Organizational Strategy for Accessible Desig...

caitlingebhard1

TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....

rightmanforbloodline

Decarbonising Commercial Real Estate: The Role of Operational Performance

IES VE

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

Tracing the root cause of a performance issue requires a lot of patience, experience, and focus. It’s so hard that we sometimes attempt to guess by trying out tentative fixes, but that usually results in frustration, messy code, and a considerable waste of time and money. This talk explains how to correctly zoom in on a performance bottleneck using three levels of profiling: distributed tracing, metrics, and method profiling. After we learn to read the JVM profiler output as a flame graph, we explore a series of bottlenecks typical for backend systems, like connection/thread pool starvation, invisible aspects, blocking code, hot CPU methods, lock contention, and Virtual Thread pinning, and we learn to trace them even if they occur in library code you are not familiar with. Attend this talk and prepare for the performance issues that will eventually hit any successful system. About authorWith two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Victor Rentea

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

The presentation was made in “Web3 Fusion: Embracing AI and Beyond” is more than a conference; it's a journey into the heart of digital transformation. The conference a provided a platform where the future of technology meets practical application. This three-day hybrid event, set in the heart of innovation, served as a gateway to the latest trends and transformative discussions in AI, Blockchain, IoT, AR/VR, and their collective impact on the information space.

AI in Action: Real World Use Cases by Anitaraj

AnitaRaj43

Recently uploaded (20)

Corporate and higher education May webinar.pptx

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

Six Myths about Ontologies: The Basics of Formal Ontology

Understanding the FAA Part 107 License ..

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Modernizing Legacy Systems Using Ballerina

Simplifying Mobile A11y Presentation.pptx

AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)

Quantum Leap in Next-Generation Computing

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Stronger Together: Developing an Organizational Strategy for Accessible Desig...

TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....

Decarbonising Commercial Real Estate: The Role of Operational Performance

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

How to Troubleshoot Apps for the Modern Connected Worker

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

AI in Action: Real World Use Cases by Anitaraj

3 Pitfalls Everyone Should Avoid with Cloud Data

1. chronosphere.io chronosphere.io 3 Pitfalls Eric D. Schabell Director Evangelism @ericschabell{@fosstodon.org} Everyone Should Avoid with Cloud Data

2. chronosphere.io

3. chronosphere.io 1. Cloud & data

4. chronosphere.io Understand your cloud costs?

5. chronosphere.io De Persgroep (Based on audience question from ‘Power to Innovate talk) “Why don’t you go 100% to cloud for hosting your news group assets?” The quoted price for hosting was OK, but the bandwidth quotes were off the charts. Shortly thereafter, during the Paris attacks (Charlie Hebdo) the French people crashed all local news sites. The Walloon (FR Belgium) sites hosted by De Persgroep received an extra 1.2 million unique visitors…. (810K BE, 450K NL).

6. chronosphere.io

7. chronosphere.io 2. O11y is data

8. chronosphere.io Observability across entire landscape?

9. chronosphere.io Cloud Native

10. chronosphere.io Observability…

11. chronosphere.io “It’s remarkable how common this situation is, where an organization is paying more for their observability data, than they do for their production infrastructure.”

12. chronosphere.io Data complexity Experiment: - Hello World app on 4 node Kubernetes cluster with Tracing, End User Metrics (EUM), Logs, Metrics (containers / nodes) - 30 days == +450 GB

13. chronosphere.io

14. chronosphere.io The struggle is real “I don't yet collect spans/traces because I can hardly get our devs to care about basic metrics, let alone traces.” “This is a large enterprise with approx. 1000 developers. Cultivating a culture of engineering that cares about availability is a challenge that we need to solve alongside any technical implementations.”

15. chronosphere.io https://go.chronosphere.io/2023-observability-report.html 87% of engineers say using cloud native architectures have increased the complexity of discovering and troubleshooting incidents

16. chronosphere.io 10 hours on average, per week, trying to triage and understand incidents - a quarter of a 40 hour work week

17. chronosphere.io 33% said those issues disrupted their personal life 39% admitting they are frequently stressed out

18. chronosphere.io 22% said they want to quit

19. chronosphere.io Cloud Native at Scale

20. chronosphere.io Cloud Native Observability at Scale

21. chronosphere.io O11y at Scale (need)

22. chronosphere.io 3. FinOps the crucial Ops

23. chronosphere.io Know the cost of observability metrics data?

24. chronosphere.io Dedicated FinOps “By 2023, 80% of organizations using cloud services will establish a dedicated FinOps function to automate policy- driven observibility and optimization of cloud resources to maximize value.” -- Source: IDC 2022

25. chronosphere.io

26. chronosphere.io What should be the #1 item on cloud wishlist?

27. chronosphere.io 1. … ??? … 2. Determine your goals of migrating data to the cloud 3. Assess your current situation 4. Select the right cloud migration partner 5. Create your business case for the cloud 6. Select the type of cloud environment needed – public, private, hybrid or hybrid-multi? 7. Determine the specific cloud components necessary 8. Choose the right cloud provider 9. Plan the cloud approach 10. Execute the migration 11. Observability of the production environment

28. chronosphere.io

29. Questions? Eric D. Schabell Director Evangelism @ericschabell{@fosstodon.org}

3 Pitfalls Everyone Should Avoid with Cloud Data

Recommended

Recommended

More Related Content

Similar to 3 Pitfalls Everyone Should Avoid with Cloud Data

Similar to 3 Pitfalls Everyone Should Avoid with Cloud Data (20)

More from Eric D. Schabell

More from Eric D. Schabell (18)

Recently uploaded

Recently uploaded (20)

3 Pitfalls Everyone Should Avoid with Cloud Data