Revitalizing Walmart's Aging Architecture for Web Scale

•

19 likes•20,762 views

Learn how Walmart embraced the concepts of reactive programming, microservices, and domain-driven design to achieve results impossible only a decade ago.

Software

Revitalizing
Walmart'sAging
Architecture for
Web Scale

Typesafe
Reactive
Platform
» Play - RESTful API
framework
» Akka - Distributed
computing framework
» Spark - General purpose in-
memory compute engine
» ConductR, Monitoring, and
commercial features

Theworld by2020
» 4 billion connected people
» 25+ million apps
» 25+ billion embedded systems
» 40 zettabytes (40 trillion gigabytes)
» 5,200 GB of data for every person on Earth

The goal
» ~100% availability ("nine nines")

The goal
» ~100% availability ("nine nines")
» Consistent responsiveness under varying load
conditions

The goal
» ~100% availability ("nine nines")
» Consistent responsiveness under varying load
conditions
» Predictable spikes of trafﬁc, e.g, Black Friday
» Less predictable spikes of trafﬁc, e.g,
marketing campaign driving trafﬁc

Walmart's Business Uplift
» Conversions up 20%
» Mobile orders up 98%
» No downtime Black Friday or Boxing Day

Walmart's OperationalSavings
» Moved off expensive hardware
» On cheap virtual x86 servers
» 20% - 50% cost savings
» ~ 40% compute cycles

asynchronous, non-blocking, real-time, highly-
available, loosely coupled, scalable, fault-tolerant,
concurrent, reactive, event-driven, push instead of
pull, distributed, low latency, high throughput...

Reactive
The ultimate maturity model
for microservices.
» Responsive
» Resilient
» Elastic
» Message-driven

Why,What, How
Reactive (principles)
» responsive, resilient,
elastic, message-driven

Why,What, How
Reactive (principles)
» responsive, resilient,
elastic, message-driven
Microservices (strategy)
» bounded contexts (DDD),
event sourcing, CQRS,
eventual consistency

Ecosystem
plus:
» service registry
» service discovery
» architecture visualization
» security

Message-driven
» distribution
» location transparency
» isolation

Resilient
» dedicated separate error
channel

Elastic
» scale up
» async
» non-blocking
» scale out
» immutable data
» share nothing

Responsive
» responsive to events, load,
failure, users
» embrace new concepts and
patterns
» cluster computing
» distribution of data
» new patterns like
circuit breakers

Commercialfeatures
» Akka Split Brain Resolver
» Akka 2.3 Cluster Support for Docker
» Play User Quotas
» Play SOAP

ProjectSuccess Subscription
» Certiﬁed build
» Compatibility veriﬁcations
» Security alerts
» Binary updates
» Long-term support
» Legal protection

Typesafe ConductR
ManageTypesafe Reactive Platformapplicationsacrossacluster

Typesafe Monitoring
Knowexactlywhatyour Reactive system is doing

Thankyou!
Visit https://www.typesafe.com/products/typesafe-
reactive-platform to get started
Contactinfo
» Twitter: @kvnwbbr
» Email: kevin.webber@typesafe.com

Like many other cities, Amsterdam faces numerous liveability challenges, due to increases in population and tourists and their mobility and transportation. One of its well-know areas is the The Red Light District, currently a complex ecosystem with millions of visitors, passers-by, workers and residents, managed by an even more complex and crowded ecosystem of organisations, departments and individual experts. To let this area function well, and offer to each user the best experience to live, work and pass by, the city government has been searching for a smart solution. To get from abstract, numeric data to actual solutions in the streets, a service design approach was introduced. Close collaboration between the city of Amsterdam and its inhabitants with the use of an iterative, people-centric and data-driven service design approach, made it possible to define a complete set of new design measures. Together and in co-creation with stakeholders like the police, these measures are currently being piloted and implemented. A smart city solution is now being rolled out, combining sensors and data analysis algorithms to generate data about people movements and crowdedness.

Business Model Camp, Hub Berkeley, CAAlexander Osterwalder

Business Ecosystem Design

Jan Schmiedgen

Top Companies and Players in the VR/AR Education Space

Mercedes Bent

If cracking the business deal with your best shot is on your mind, then go forward with this amazing PowerPoint presentation that not only offers the best graphics but also compiles information in a presentable manner. The one stop solution, when it comes to compiling of text and graphic is Business Model Generation Value Proposition PowerPoint Presentation Slides. Presentation layout can be customized as per the topic you need to address in the meeting. The business model generation PPT slide helps deliver the content and maintain a record of the same in the best possible manner. To the point and crisp information is conveyed which a perfect roadmap for the financial years by business model PowerPoint PPT. May it be revenue model, swot analysis or business model, planning or comparison, every core issue is addressed by wonderful mix of colored graphs and graphics in presentation slides. For business model visionaries, the PPT are a game changer and strive to map, design and test different strategies. Delve into all the facts involved with our Business Model Generation Value Proposition PowerPoint Presentation Slides. It helps investigate the issue.

Lean launchpad educators teaching handbookStanford University

Creating awesome value proposition using Value Proposition Canvas

Tathagat Varma

Enabling Transformation through Agility & Innovation - AWS Transformation Day...

Amazon Web Services

Learn how AWS can help transform your business. With AWS, enterprises are becoming more agile, secure, and scalable. This helps to promote innovation, shorten cycles to respond to business requirements, increase employee productivity, and retain and recruit top talent. Improve business performance, reduce costs, and reinvent your IT strategies. Topics include how to maximize the value of your Enterprise workloads with AWS, foster a culture of innovation, manage risk and security, and new ways to think about product development, how to modernize the delivery of IT services, and best practices for adopting the cloud at scale.

Value Proposition Canvas Explained

azlaan

The lecture on Value Proposition Canvas Part A explains why the concept is of so much importance especially to first time entrepreneurs. Startups sustainability requires in-depth understanding of the target customers. Failing at this stage will have costly repercussions for the entrepreneur and his business. Part A discuss the Value Proposition Canvas definition, value proposition examples, and how Value Proposition Canvas is different than Business Slogans.

Go to Market Strategy - Entrepreneurship 101

MaRS Discovery District

IT Strategy, Cloud Benefit Realization

Value Amplify Consulting

Pitch Deck Teardown: This is the deck WayRay used to raise $80M at a $500M va...

HajeJanKamps

Lecture 1: Business Model & Customer DevelopmentStanford University

Go-to-Market Template

Blue Leopard LLC

What's Next: Digital Transformation

Ogilvy Consulting

Startup Workshop #1: Product/Market Fit

Milan Vukas

Backcasting - IA Summit 2007 Session Presentation

Matthew Milan

Digital Transformation

Vishal Sharma

Life Cycle Of Pre SalesShobhit Khanna

Building Digital Strategy Roadmap For Digital Transformation Complete Deck

SlideTeam

Digital strategy roadmap is a blueprint for aligning business goals with your digital strategy. It shows how the company plans to embrace digital technologies to grow business and create better customer experience in the long term. Creating a digital strategy roadmap is not simply listing out key digital initiatives and giving them a tentative timeline. It follows an extensive research process which starts with Digital Review. It starts with uncovering consumer insights and market insights. One then develops Digital Strategy keeping in mind the digital goals and key initiatives in the short and long term. The third step in this process is Digital Planning which involves setting realistic time frame for implementing digital initiatives. The final steps involve setting KPIs for measuring the success of digital strategy. Taking the healthcare sector as a case study, our researchers have outlined the digital landscape of the industry and showed key digital strategies a healthcare provider wishes to implement for digital transformation. https://bit.ly/3bL7TlW

Agile Transformation at Scale

ITSM Academy, Inc.

Presenter: Dr. Gail Ferreira, Agile Practice Leader, MATRIX Resources, San Francisco Center of Excellence Rapid scale directly impacts all levels of decision-making, planning, execution, culture, and communications for executives in hypergrowth companies. In this session, we will discuss how to organize, support, and tailor agile practices for teams and sub-teams in companies with a rapid growth cycle. We will share contemporary case studies of hypergrowth companies who have delivered agile at scale. Topics will include: • Basic agile and lean methods • Scrum of Scrums • SAFe • Disciplined Agile Delivery (DAD) • Agility at Scale (Ambler/Lines) • Spotify model (Tribes, Squads, Chapters & Guilds, DSDM).

Build a Better Entrepreneur Pitch Deck

Center For Entrepreneurial Innovation

An effective pitch presentation can be the difference between securing investment and/or support for your startup. Download our slide presentation, "Build a Better Pitch Deck," and gain insight on what content to include in your slides and how to design them for the most impact. This information is aggregated from leading entrepreneurship and investor sources both in Arizona and throughout the nation.

Pitch Deck For Pre Seed Funding Powerpoint Presentation Slides

SlideTeam

"You can download this product from SlideTeam.net" This is an early stage investment which the owner requires to start the business. This is also known as pre seed capital or pre seed money. Business owners can raise this money from friends, family or investors and give stakes in the company in exchange. The presentation is helpful for start ups looking to raise funding for the initial development of the product, to set up a business, or to build a new team. This presentation will help the start ups to present their business or business idea and future growth plans in front of the potential investors. This presentation comprises the following sections Company Overview, Company introduction, unique business idea, business model, revenue streams, historical events, products, and services etc. Market Overview Target audience identification and segmentation, competitive landscape, market size and opportunities etc. Financials Overview Income statement, revenue, and cash flow projections, capitalization tables, valuation, break even point, and cost analysis etc. Investment and funding overview Funding requirements, use of raised funds, future plans, the exit strategy for the investors etc. This presentation will help the organizations to move from the situation, where they need funds for initial business development to set the future targets, use, and goals of raised funding. https://bit.ly/33qDPxI

Marketing Strategies - Go-to-Market Plans

Four Quadrant LLC

This Slideshare presentations provides examples of Marketing Strategies as they are found in Go-to-Market Templates provided by Four Quadrant at http://www.fourquadrant.com/products/ Included in the Powerpoint presentation are slides that cover: Marketing Strategies – Focus & Direction Marketing Strategies – GTM Fundamentals Marketing Strategies - Core Focus Marketing Strategies – Types of Differentiation Marketing Strategies – Pricing Models Marketing Strategies - Demand Creation Plan Marketing Strategies - Beach Head Marketing Strategies – Strategic Value Message Marketing Strategies – Customer Conversations Marketing Strategies – Target Account Profile Marketing Strategies - Demand Creation Marketing Strategies – Quantitative Plan Marketing Strategies – User Flows Marketing Strategies - Content Marketing Marketing Strategies – Demand Follow-up Marketing Strategies – Star Bursting Marketing Strategies – Lead Nurture Marketing Strategies - Scoring Model See more at Four Quadrant at http://www.fourquadrant.com/products/

Designing a Scalable Twitter - Patterns for Designing Scalable Real-Time Web ...

Nati Shalom

Twitter is a good example for next generation real-time web applications, but building such an application imposes challenges such as handling an every growing volume of tweets and responses, as well as a large number of concurrent users, who continually *listen* for tweets from users (or topics) they follow. During this session we will review some of the key design principles addressing these challenges, including alternatives *NoSQL* alternatives and blackboard patterns. We will be using Twitter as a use case, while learning how to apply these to any real-time we application

ElasticMQ: a fully asynchronous, Akka-based SQS server

Adam Warski

What's hot

Business Model Generation Value Proposition PowerPoint Presentation Slides

SlideTeam

Lean launchpad educators teaching handbookStanford University

Creating awesome value proposition using Value Proposition Canvas

Tathagat Varma

Enabling Transformation through Agility & Innovation - AWS Transformation Day...

Amazon Web Services

Value Proposition Canvas Explained

azlaan

Go to Market Strategy - Entrepreneurship 101

MaRS Discovery District

IT Strategy, Cloud Benefit Realization

Value Amplify Consulting

Pitch Deck Teardown: This is the deck WayRay used to raise $80M at a $500M va...

HajeJanKamps

Lecture 1: Business Model & Customer DevelopmentStanford University

Go-to-Market Template

Blue Leopard LLC

What's Next: Digital Transformation

Ogilvy Consulting

Startup Workshop #1: Product/Market Fit

Milan Vukas

Backcasting - IA Summit 2007 Session Presentation

Matthew Milan

Digital Transformation

Vishal Sharma

Life Cycle Of Pre SalesShobhit Khanna

Building Digital Strategy Roadmap For Digital Transformation Complete Deck

SlideTeam

Agile Transformation at Scale

ITSM Academy, Inc.

Build a Better Entrepreneur Pitch Deck

Center For Entrepreneurial Innovation

Pitch Deck For Pre Seed Funding Powerpoint Presentation Slides

SlideTeam

Marketing Strategies - Go-to-Market Plans

Four Quadrant LLC

What's hot (20)

Business Model Generation Value Proposition PowerPoint Presentation Slides

Lean launchpad educators teaching handbook

Creating awesome value proposition using Value Proposition Canvas

Enabling Transformation through Agility & Innovation - AWS Transformation Day...

Value Proposition Canvas Explained

Go to Market Strategy - Entrepreneurship 101

IT Strategy, Cloud Benefit Realization

Pitch Deck Teardown: This is the deck WayRay used to raise $80M at a $500M va...

Lecture 1: Business Model & Customer Development

Go-to-Market Template

What's Next: Digital Transformation

Startup Workshop #1: Product/Market Fit

Backcasting - IA Summit 2007 Session Presentation

Digital Transformation

Life Cycle Of Pre Sales

Building Digital Strategy Roadmap For Digital Transformation Complete Deck

Agile Transformation at Scale

Build a Better Entrepreneur Pitch Deck

Pitch Deck For Pre Seed Funding Powerpoint Presentation Slides

Marketing Strategies - Go-to-Market Plans

Viewers also liked

Designing a Scalable Twitter - Patterns for Designing Scalable Real-Time Web ...

Nati Shalom

ElasticMQ: a fully asynchronous, Akka-based SQS server

Adam Warski

Akka Revealed: A JVM Architect's Journey From Resilient Actors To Scalable Cl...

Lightbend

By now, you’ve probably heard of Akka, the JVM toolkit for building scalable, resilient and resource efficient applications in Java or Scala. With over 12 open-source and commercial modules in the toolkit, Akka takes developers from actors on a single JVM, all the way out to network partition healing and clusters of servers distributed across fleets of JVMs. But with such a broad range of features, how can Architects and Developers grok Akka from a high-level perspective? In this technical webinar by Hugh McKee, O’Reilly author and Developer Advocate at Lightbend, we introduce Akka from A to Z, starting with a tour from the humble actor and finishing all the way at the clustered systems level. Specifically, we will review: *How Akka Actors behave, create systems, and manage supervision and routing *The way Akka embraces Reactive Streams with Akka Streams and Alpakka *How various components of the Akka toolkit provide out-of-the-box solutions for distributed data, distributed persistence, pub-sub, and ES/CQRS *How Akka works with microservices, and brings this functionality into Lagom and Play Frameworks *Looking at Akka clusters, how Akka is used to build distributed clustered systems incorporate clusters within clusters *What’s needed to orchestrate and deploy complete Reactive Systems

Microservices, Monoliths, SOA and How We Got Here

Lightbend

The Enterprise Architect’s Intro to Microservices - Part 1 of 3 **Find upcoming webinar details here: https://www.lightbend.com/community#filter:webinar** If you’re tired of battling a monolithic enterprise system that’s difficult to scale and maintain––and even harder to understand––then this webinar series is for you. In these three expert sessions, we go over the details of why a microservice-based architecture that consists of small, independent services is far more flexible than the traditional all-in-one systems that continue to dominate today’s enterprise landscape. In Part 1, Enterprise Advocate Kevin Webber will review a bit of history of application development, from the early days of monoliths and SOA to the emergence of Microservice architectures. We will review the drawbacks of heritage architectures and how the principles of Reactive can help you build isolated services that are scalable, resilient to failure, and combine with other services to form a cohesive whole. In the next two webinars, we go deeper into the characteristics of Reactive Microservices, and the considerations how to build complete systems, presented by Lightbend CTO and Akka creator, Jonas Bonér.

Real-Time Anomaly Detection with Spark MLlib, Akka and Cassandra

Natalino Busa

We present a solution for streaming anomaly detection, named “Coral”, based on Spark, Akka and Cassandra. In the system presented, we run Spark to run the data analytics pipeline for anomaly detection. By running Spark on the latest events and data, we make sure that the model is always up-to-date and that the amount of false positives is kept low, even under changing trends and conditions. Our machine learning pipeline uses Spark decision tree ensembles and k-means clustering. Once the model is trained by Spark, the model’s parameters are pushed to the Streaming Event Processing Layer, implemented in Akka. The Akka layer will then score 1000s of event per seconds according to the last model provided by Spark. Spark and Akka communicate which each other using Cassandra as a low-latency data store. By doing so, we make sure that every element of this solution is resilient and distributed. Spark performs micro-batches to keep the model up-to-date while Akka detects the new anomalies by using the latest Spark-generated data model. The project is currently hosted on Github. Have a look at : http://coral-streaming.github.io

Lambda Architecture with Spark, Spark Streaming, Kafka, Cassandra, Akka and S...

Helena Edelson

Regardless of the meaning we are searching for over our vast amounts of data, whether we are in science, finance, technology, energy, health care…, we all share the same problems that must be solved: How do we achieve that? What technologies best support the requirements? This talk is about how to leverage fast access to historical data with real time streaming data for predictive modeling for lambda architecture with Spark Streaming, Kafka, Cassandra, Akka and Scala. Efficient Stream Computation, Composable Data Pipelines, Data Locality, Cassandra data model and low latency, Kafka producers and HTTP endpoints as akka actors...

Streaming Analytics with Spark, Kafka, Cassandra and Akka

Helena Edelson

This talk will address how a new architecture is emerging for analytics, based on Spark, Mesos, Akka, Cassandra and Kafka (SMACK). Popular architecture like Lambda separate layers of computation and delivery and require many technologies which have overlapping functionality. Some of this results in duplicated code, untyped processes, or high operational overhead, let alone the cost (i.e. ETL). I will discuss the problem domain and what is needed in terms of strategies, architecture and application design and code to begin leveraging simpler data flows. We will cover how the particular set of technologies addresses common requirements and how collaboratively they work together to enrich and reinforce each other.

Viewers also liked (7)

Designing a Scalable Twitter - Patterns for Designing Scalable Real-Time Web ...

ElasticMQ: a fully asynchronous, Akka-based SQS server

Akka Revealed: A JVM Architect's Journey From Resilient Actors To Scalable Cl...

Microservices, Monoliths, SOA and How We Got Here

Real-Time Anomaly Detection with Spark MLlib, Akka and Cassandra

Lambda Architecture with Spark, Spark Streaming, Kafka, Cassandra, Akka and S...

Streaming Analytics with Spark, Kafka, Cassandra and Akka

Similar to Revitalizing Walmart's Aging Architecture for Web Scale

Revitalizing Aging Architectures with Microservices

Legacy Typesafe (now Lightbend)

When you need to react quickly to competitive threats, but your existing architecture is anything but nimble, what do you do? In this presentation, you will hear the story of how Walmart Canada revitalized its aging architecture with a microservices model built for speed and performance - that efficiently leveraged its JVM infrastructure - to achieve major e-commerce success in just 12 months: Conversions up 20% Mobile orders up 98% No downtime during Black Friday or Boxing Day This webinar is based off Kevin Webber’s highly successful Gartner session, Lessons Learned: Revitalizing Walmart's Aging Architecture For Web Scale, and will include added content.

The 6 Rules for Modernizing Your Legacy Java Monolith with Microservices

Lightbend

We change a monolithic system only when we have no other choice. Traditional enterprise systems are tightly-coupled; all-in-one, all-or-nothing, difficult to scale, difficult to understand and difficult to maintain. Rather than swiftly capture opportunity, we ponder if it’s really worth it—is it worth upsetting the delicate balance of the house of cards we call our enterprise system? Often the opportunity quickly disappears, captured by a faster company. Some people have started calling this “Getting Ubered”. So what can you do about it? Talking about Microservices is one thing, but how can your organization start taking action to address this issue? In this webinar by battle-hardened Enterprise Advocate, Kevin Webber, we walk through the 6 key concepts to understand as a guide for taking action: 1. Domain Driven Design (DDD) 2. Asynchronous messaging 3. API management 4. Dependency management 5. CQRS & event sourcing 6. Transactions & ordering Reactive Platform has what you need to breath new life into your legacy system with a new Microservices-based approach.

Microservices: Architecture for the Real-time Organization

Kevin Webber

The real-time organization is responsive to change. Real-time organizations architect their systems to evolve naturally as they adapt to the competitive landscape around them. At the core of real-time organizations are microservices. The microservice architecture (MSA) empowers independent teams within large organizations to move at the pace of startups, freeing them from the constraints of “design by committee” and other architectural anti-patterns that ground productivity within the enterprise to a halt. We explore all of the relevant patterns of microservices architecture including domain-driven design (DDD), circuit breaker, data pump, saga pattern, distributed transaction, async messaging, etc.

Battery Ventures: Simulating and Visualizing Large Scale Cassandra Deployments

DataStax Academy

What is reactive

Lightbend

High-speed, Reactive Microservices 2017

Rick Hightower

Devoxx university - Kafka de haut en bas

Florent Ramiere

Micro service, Containers & Cluster Management

Vasu Thiyagarajan

Internet Scale Architecture

RightScale

Cloud computing revolutionized application design, and changed the way people think about infrastructure. The rise of cloud computing coincided with a new generation of applications and services that required scale. New architecture and design had to take into account low latency network connectivity, geographic distribution, large real-time data stores, the ability to meet demand (while not knowing exactly how much demand to handle), and so much more. We refer to this as Internet Scale. Yet most discussion of scale and cloud revolves around compute as virtualized instances, which have defined configurations and constrained options. Delivering on the promise of Internet Scale involves substantial upfront design, and a comprehensive understanding of the entire architecture - from the underlying hardware, to the operating system, the application stack, services, and deployment. And, it involves choice - choices you should make based on your requirements. Join us for a discussion on the many facets of Internet Scale, and how it can apply to your applications and services.

Data & analytics challenges in a microservice architecture

Niels Naglé

DataSaturday 2019 session: Domain driven design, microservices, event-driven, polyglot data storage. All popular developments within software architecture to realize modular and ultra-scalable solutions. But what is the impact on the Data & Analytics side? So how to contain a global vision on the data and processes when every service contains their own logic, data and enrichments? which data is leading? How to avoid conflicts? So what do these architectures mean for Data & Analytics.

Scaling Security on 100s of Millions of Mobile Devices Using Apache Kafka® an...

confluent

Watch this talk here: https://www.confluent.io/online-talks/scaling-security-on-100s-of-millions-of-mobile-devices-using-kafka-and-scylla-on-demand Join mobile cybersecurity leader Lookout as they talk through their data ingestion journey. Lookout enables enterprises to protect their data by evaluating threats and risks at post-perimeter endpoint devices and providing access to corporate data after conditional security scans. Their continuous assessment of device health creates a massive amount of telemetry data, forcing new approaches to data ingestion. Learn how Lookout changed its approach in order to grow from 1.5 million devices to 100 million devices and beyond, by implementing Confluent Platform and switching to Scylla.

The Enterprise Cloud

Mark Masterson

Webinar Slides: Real-Time Analytics from MySQL

Continuent

Learn how Continuent Tungsten can replicate in real-time to multiple analytics powerhouses with no dips in performance. Targets include AWS RedShift, Kafka, Vertica and more. Don't miss the supplemental training video. We will explore how to deploy a cluster slave in your existing environment, answering the following questions: - What is a cluster slave? - Why should I consider adding a cluster slave? - What targets can I replicate to? AGENDA This webinar has three parts, and lasts about 30 minutes. - Re-cap of Tungsten Cluster and Tungsten Replicator - Use case: replicating from a cluster to analytics - Continuent benefits - Q & A

AWS AutoScalling- Tech Talks Maio 2019

Amazon Web Services LATAM

Actor model in F# and Akka.NET

Riccardo Terrell

Digital Workloads on AWS

Amazon Web Services

Ingestion in data pipelines with Managed Kafka Clusters in Azure HDInsight

Microsoft Tech Community

Loadbalancers: The fabric for your micro services

Chiradeep Vittal

Keine Angst vorm Dinosaurier: Mainframe-Integration und -Offloading mit Confl...

Precisely

Mainframes sind immer noch weit verbreitet im Einsatz und verarbeiten täglich über 70 Prozent der wichtigsten Rechentransaktionen der Welt. Sehr hohe Kosten, monolithische Architekturen und fehlende Experten sind die größten Herausforderungen für Mainframe-Anwendungen. Es ist an der Zeit, innovativer zu werden, auch mit dem Mainframe! Stellen wir uns gemeinsam dem Dinosaurier! Mainframe Offloading mit Confluent, Apache Kafka und dem zugehörigen Ökosystem kann genutzt werden, um moderne Dateninfrastrukturen in Echtzeit mit dem Mainframe synchron zu halten. Dabei ermöglich Kafka sowohl die Datenverarbeitung als auch die Integration mit Systemen wie Data Warehouses und Analytics-Plattformen. Dabei können via Change Data Capture (CDC) permanent Mainframe-Änderungen im hochvoluminösen Bereich nach Kafka gepusht werden. In dieser on-demand-präsentation zeigen Confluent und Precisely, wie Unternehmen diesen Schritt zur Legacy-Migration machen, Kosten sparen, eine skalierbare und offene Architektur schaffen und so neue Dienste und Anwendungen ermöglichen.

AWS Meetup: Career Day 2019 - Lightning Talk with Cloud Career Path: Infrastr...

AWS User Group - Thailand

Similar to Revitalizing Walmart's Aging Architecture for Web Scale (20)

Revitalizing Aging Architectures with Microservices

The 6 Rules for Modernizing Your Legacy Java Monolith with Microservices

Microservices: Architecture for the Real-time Organization

Battery Ventures: Simulating and Visualizing Large Scale Cassandra Deployments

What is reactive

High-speed, Reactive Microservices 2017

Devoxx university - Kafka de haut en bas

Micro service, Containers & Cluster Management

Internet Scale Architecture

Data & analytics challenges in a microservice architecture

Scaling Security on 100s of Millions of Mobile Devices Using Apache Kafka® an...

The Enterprise Cloud

Webinar Slides: Real-Time Analytics from MySQL

AWS AutoScalling- Tech Talks Maio 2019

Actor model in F# and Akka.NET

Digital Workloads on AWS

Ingestion in data pipelines with Managed Kafka Clusters in Azure HDInsight

Loadbalancers: The fabric for your micro services

Keine Angst vorm Dinosaurier: Mainframe-Integration und -Offloading mit Confl...

AWS Meetup: Career Day 2019 - Lightning Talk with Cloud Career Path: Infrastr...

Recently uploaded

Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...

Globus

Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.

BoxLang: Review our Visionary Licenses of 2024

Ortus Solutions, Corp

Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...

Anthony Dahanne

Les Buildpacks existent depuis plus de 10 ans ! D’abord, ils étaient utilisés pour détecter et construire une application avant de la déployer sur certains PaaS. Ensuite, nous avons pu créer des images Docker (OCI) avec leur dernière génération, les Cloud Native Buildpacks (CNCF en incubation). Sont-ils une bonne alternative au Dockerfile ? Que sont les buildpacks Paketo ? Quelles communautés les soutiennent et comment ? Venez le découvrir lors de cette session ignite

Quarkus Hidden and Forbidden Extensions

Max Andersen

Lecture 1 Introduction to games development

abdulrafaychaudhry

Cyaniclab : Software Development Agency Portfolio.pdf

Cyanic lab

CyanicLab, an offshore custom software development company based in Sweden,India, Finland, is your go-to partner for startup development and innovative web design solutions. Our expert team specializes in crafting cutting-edge software tailored to meet the unique needs of startups and established enterprises alike. From conceptualization to execution, we offer comprehensive services including web and mobile app development, UI/UX design, and ongoing software maintenance. Ready to elevate your business? Contact CyanicLab today and let us propel your vision to success with our top-notch IT solutions.

GlobusWorld 2024 Opening Keynote session

Globus

Understanding Globus Data Transfers with NetSage

Globus

NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?

How Recreation Management Software Can Streamline Your Operations.pptx

wottaspaceseo

Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.

Accelerate Enterprise Software Engineering with Platformless

WSO2

Key takeaways: Challenges of building platforms and the benefits of platformless. Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience. How Choreo enables the platformless experience. How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo. Demo of an end-to-end app built and deployed on Choreo.

First Steps with Globus Compute Multi-User Endpoints

Globus

In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.

Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf

AMB-Review

Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos https://www.amb-review.com/tubetrivia-ai Exclusive Features: AI-Powered Questions, Wide Range of Categories, Adaptive Difficulty, User-Friendly Interface, Multiplayer Mode, Regular Updates. #TubeTriviaAI #QuizVideoMagic #ViralQuizVideos #AIQuizGenerator #EngageExciteExplode #MarketingRevolution #BoostYourTraffic #SocialMediaSuccess #AIContentCreation #UnlimitedTraffic

Providing Globus Services to Users of JASMIN for Environmental Data Analysis

Globus

JASMIN is the UK’s high-performance data analysis platform for environmental science, operated by STFC on behalf of the UK Natural Environment Research Council (NERC). In addition to its role in hosting the CEDA Archive (NERC’s long-term repository for climate, atmospheric science & Earth observation data in the UK), JASMIN provides a collaborative platform to a community of around 2,000 scientists in the UK and beyond, providing nearly 400 environmental science projects with working space, compute resources and tools to facilitate their work. High-performance data transfer into and out of JASMIN has always been a key feature, with many scientists bringing model outputs from supercomputers elsewhere in the UK, to analyse against observational or other model data in the CEDA Archive. A growing number of JASMIN users are now realising the benefits of using the Globus service to provide reliable and efficient data movement and other tasks in this and other contexts. Further use cases involve long-distance (intercontinental) transfers to and from JASMIN, and collecting results from a mobile atmospheric radar system, pushing data to JASMIN via a lightweight Globus deployment. We provide details of how Globus fits into our current infrastructure, our experience of the recent migration to GCSv5.4, and of our interest in developing use of the wider ecosystem of Globus services for the benefit of our user community.

SOCRadar Research Team: Latest Activities of IntelBroker

SOCRadar

The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month. The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies. However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News. Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!

Navigating the Metaverse: A Journey into Virtual Evolution"

Donna Lenk

AI Pilot Review: The World’s First Virtual Assistant Marketing Suite

Google

AI Pilot Review: The World’s First Virtual Assistant Marketing Suite 👉👉 Click Here To Get More Info 👇👇 https://sumonreview.com/ai-pilot-review/ AI Pilot Review: Key Features ✅Deploy AI expert bots in Any Niche With Just A Click ✅With one keyword, generate complete funnels, websites, landing pages, and more. ✅More than 85 AI features are included in the AI pilot. ✅No setup or configuration; use your voice (like Siri) to do whatever you want. ✅You Can Use AI Pilot To Create your version of AI Pilot And Charge People For It… ✅ZERO Manual Work With AI Pilot. Never write, Design, Or Code Again. ✅ZERO Limits On Features Or Usages ✅Use Our AI-powered Traffic To Get Hundreds Of Customers ✅No Complicated Setup: Get Up And Running In 2 Minutes ✅99.99% Up-Time Guaranteed ✅30 Days Money-Back Guarantee ✅ZERO Upfront Cost See My Other Reviews Article: (1) TubeTrivia AI Review: https://sumonreview.com/tubetrivia-ai-review (2) SocioWave Review: https://sumonreview.com/sociowave-review (3) AI Partner & Profit Review: https://sumonreview.com/ai-partner-profit-review (4) AI Ebook Suite Review: https://sumonreview.com/ai-ebook-suite-review

Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx

rickgrimesss22

In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...

Juraj Vysvader

A Sighting of filterA in Typelevel Rite of Passage

Philip Schwarz

Corporate Management | Session 3 of 3 | Tendenci AMS

Tendenci - The Open Source AMS (Association Management Software)

Experience our free, in-depth three-part Tendenci Platform Corporate Membership Management workshop series! In Session 1 on May 14th, 2024, we began with an Introduction and Setup, mastering the configuration of your Corporate Membership Module settings to establish membership types, applications, and more. Then, on May 16th, 2024, in Session 2, we focused on binding individual members to a Corporate Membership and Corporate Reps, teaching you how to add individual members and assign Corporate Representatives to manage dues, renewals, and associated members. Finally, on May 28th, 2024, in Session 3, we covered questions and concerns, addressing any queries or issues you may have. For more Tendenci AMS events, check out www.tendenci.com/events

Recently uploaded (20)

Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...

BoxLang: Review our Visionary Licenses of 2024

Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...

Quarkus Hidden and Forbidden Extensions

Lecture 1 Introduction to games development

Cyaniclab : Software Development Agency Portfolio.pdf

GlobusWorld 2024 Opening Keynote session

Understanding Globus Data Transfers with NetSage

How Recreation Management Software Can Streamline Your Operations.pptx

Accelerate Enterprise Software Engineering with Platformless

First Steps with Globus Compute Multi-User Endpoints

Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf

Providing Globus Services to Users of JASMIN for Environmental Data Analysis

SOCRadar Research Team: Latest Activities of IntelBroker

Navigating the Metaverse: A Journey into Virtual Evolution"

AI Pilot Review: The World’s First Virtual Assistant Marketing Suite

Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx

In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...

A Sighting of filterA in Typelevel Rite of Passage

Corporate Management | Session 3 of 3 | Tendenci AMS

Revitalizing Walmart's Aging Architecture for Web Scale

1. Revitalizing Walmart'sAging Architecture for Web Scale

2. Typesafe Reactive Platform » Play - RESTful API framework » Akka - Distributed computing framework » Spark - General purpose in- memory compute engine » ConductR, Monitoring, and commercial features

7. Size ofthe internettoday

8. Theworld by2020 » 4 billion connected people » 25+ million apps » 25+ billion embedded systems » 40 zettabytes (40 trillion gigabytes) » 5,200 GB of data for every person on Earth

9. WalmartCanada

10. Business Impact

11. The goal » ~100% availability ("nine nines")

12. The goal » ~100% availability ("nine nines") » Consistent responsiveness under varying load conditions

13. The goal » ~100% availability ("nine nines") » Consistent responsiveness under varying load conditions » Predictable spikes of traffic, e.g, Black Friday » Less predictable spikes of traffic, e.g, marketing campaign driving traffic

14. The goal » ~100% availability ("nine nines") » Consistent responsiveness under varying load conditions » Predictable spikes of traffic, e.g, Black Friday » Less predictable spikes of traffic, e.g, marketing campaign driving traffic » Enable LOBs to rapidly adapt to market conditions

15. ARevitalizedArchitecture

16. Walmart's Business Uplift » Conversions up 20% » Mobile orders up 98% » No downtime Black Friday or Boxing Day

17. Walmart's OperationalSavings » Moved off expensive hardware » On cheap virtual x86 servers » 20% - 50% cost savings » ~ 40% compute cycles

18. Whereto begin?

19.

20.

21.

22.

23. asynchronous, non-blocking, real-time, highly- available, loosely coupled, scalable, fault-tolerant, concurrent, reactive, event-driven, push instead of pull, distributed, low latency, high throughput...

24. asynchronous, non-blocking, real-time, highly- available, loosely coupled, scalable, fault-tolerant, concurrent, reactive, event-driven, push instead of pull, distributed, low latency, high throughput... Too complicated. We need a simple vocabulary.

25. Reactive The ultimate maturity model for microservices. » Responsive » Resilient » Elastic » Message-driven

26. Why,What, How Reactive (principles) » responsive, resilient, elastic, message-driven

27. Why,What, How Reactive (principles) » responsive, resilient, elastic, message-driven Microservices (strategy) » bounded contexts (DDD), event sourcing, CQRS, eventual consistency

28. Why,What, How Reactive (principles) » responsive, resilient, elastic, message-driven Microservices (strategy) » bounded contexts (DDD), event sourcing, CQRS, eventual consistency Tools (implementation) » Typesafe Reactive Platform (Play, Akka, Spark)

29. Heritage system

30. Future system

31. Clustered microservices

32. Ecosystem plus: » service registry » service discovery » architecture visualization » security

33. Implementation?

34. Typesafe Reactive Platform

35. Message-driven » distribution » location transparency » isolation

36. Resilient » supervision

37. Resilient » dedicated separate error channel

38. Elastic » scale up » async » non-blocking » scale out » immutable data » share nothing

39. Responsive » responsive to events, load, failure, users » embrace new concepts and patterns » cluster computing » distribution of data » new patterns like circuit breakers

40.

41. Whatwe offer

42. Commercialfeatures » Akka Split Brain Resolver » Akka 2.3 Cluster Support for Docker » Play User Quotas » Play SOAP

43. ProjectSuccess Subscription » Certiﬁed build » Compatibility veriﬁcations » Security alerts » Binary updates » Long-term support » Legal protection

44. Typesafe ConductR ManageTypesafe Reactive Platformapplicationsacrossacluster

45. Typesafe Monitoring Knowexactlywhatyour Reactive system is doing

46. Thankyou! Visit https://www.typesafe.com/products/typesafe- reactive-platform to get started Contactinfo » Twitter: @kvnwbbr » Email: kevin.webber@typesafe.com

Revitalizing Walmart's Aging Architecture for Web Scale

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (7)

Similar to Revitalizing Walmart's Aging Architecture for Web Scale

Similar to Revitalizing Walmart's Aging Architecture for Web Scale (20)

Recently uploaded

Recently uploaded (20)

Revitalizing Walmart's Aging Architecture for Web Scale