Scalability At Kueski

•

3 likes•1,064 views

This document discusses strategies for scaling applications. It begins by addressing common myths around scaling, then details the infrastructure changes made to an application called Kueski from version 1.0 to make it more scalable. Key strategies included separating databases onto their own servers, adding load balancers, using Redis for caching, implementing read replicas of databases, employing client-side sessions, offloading long tasks to queues, and leveraging content delivery networks for static assets. The document emphasizes designing for scalability from the start and addressing bottlenecks through incremental changes.

Technology

Kueski 1.0
DB
Frontend
Backend
Client
Browser
Public IP
Famous last
words
This is temporal,
we will fix it
when we have
more engineers
and budget.

Kueski 1.0
DB
Frontend
Backend
Client
Browser
Public IP
Myth
NoSQL
databases
are better
than SQL
ones.
In the practice
It depends!
No
transactions!
No suitable for
banking
applications.

Fact
Fixing an error in the first day takes another day…
Fix the error two years later takes 6 months!
Many startups cannot
afford that kind of
mistakes.

Kueski 1.0
Frontend
Backend
Client
Browser
Public IP
DB
Separate database to it own server...

Kueski 1.0
Frontend
Backend
Client
Browser
Public IP
DB
Kueski 1.0
Frontend
Backend
Create a second server...
One IP for
two servers?

Frontend
Backend
Client Browser
Public IP
DB
Frontend
Backend
Load Balancer
Add a load balancer...

Frontend
Backend
Client Browser
Public IP
DB
Frontend
Backend
Load Balancer
Sessions
Problem!

Frontend
Backend
Client Browser
Public IP
Frontend
Backend
Load Balancer
DB
Redis
Use a memory based database to store sessions...

Frontend
Backend
Client Browser
Public IP
DB & Sessions
Frontend
Backend
Load Balancer
Or use the same SQL database for the sessions...

Frontend
Backend
Client Browser
Public IP
DB & Sessions
Frontend
Backend
Load Balancer
Database
Bottleneck!

Frontend
Backend
Client Browser
Public IP
Frontend
Backend
Load Balancer
DB
Redis
Replica 1 Replica 2
Create read replicas...
Advice
Use a
framework
that supports
read replicas.

Load
Balancer
Bottleneck!
Frontend
Backend
Client Browser
Public IP
Frontend
Backend
Load Balancer
DB
Redis
Replica 1 Replica 2

Client Browser
Load Balancer Load Balancer
DNS DNS DNS
Add multiple load balancers and setup DNS...
Round robin IP
Who is doing the load
balancing of the DNS?

Frontend
Backend
Client Browser
Frontend
Backend
Load Balancer
DB
Redis
Replica 1
Load Balancer
DNS DNS
So far...
Multizone

Frontend
Backend
Client Browser
Frontend
Backend
Load Balancer
DB
Redis
Replica 1
Load Balancer
DNS DNS
Sessions
Bottleneck!

Frontend
Backend
Client Browser
Frontend
Backend
Load Balancer
DB
Load Balancer
Use
Client Side
Sessions!
Replica 1
DNS DNS

Client Side Sessions
Client
Browser
Backend
Encrypted
Digitally Signed
Session Data
Send
session data
every request

Long Response Times
Uploads
Fotos, Documents, Video (hours)
Long Jobs
Query Web Service, PDF generation, Search (minutes)
Rendering
HTML, Images (seconds)
Long
response
times kills
scalability

Connection pool
exhaustion
● Database
● Requests
Uploads
Client Browser
Backend
Client Browser
Uploads
Server
Backend
Token
Upload
&
Receive
Token
Old Approach
Better Approach

Long JobsClient
Browser
AWS
SQS
(Queue)
Backend
Push
Notification
Better Approach
Consumer
(Postprocessing)
Consumer
(Postprocessing)
Push
Message
Pop
Message Database
Browser
Unresponsiveness
Connection pool exhaustion

Rendering
Frontend
Backend
In the practice
Ruby does not
scale if you don’t
know how!
Wasted server CPU
Myth
Ruby does
not scale!
Even more...
Any language can scale
knowing the right way!

Rendering
HTML
Backend
Javascript CSS Images

Rendering
Index
(HTML)
Backend
(API)
Javascript
CSS
Images
Client
Browser
CDN

Myth
Scaling from
day zero is
impossible
In the practice
You should create all your
infrastructure and applications
ready to scale, any time, without
much effort, from day zero.

In this session, we will build a minimum viable Spring Data web service with REST API, add a MySQL backing service as the primary data store, and a Redis Labs backing service for caching. We will demonstrate performance metrics without Redis caching enabled and then with Redis caching enabled. I will also provide an intro-level explanation of the platform capabilities within Pivotal Web Services.

Back your app with MySQL and Redis on Cloud Foundry

Kenny Bastani

CRN MagazineJoshua Steffan

JDD 2016 - Tomasz Ducin - Backend-less Development Revisited

PROIDEA

It's obvious that SPA interfaces rely on RESTful APIs". But does it have to be like this always? Tight-coupling between interfaces and APIs result in great development issues. Frequent backend unavailability, complicated compilation process, long deploy time, development team communication issues - if any of these apply to your project, you should take a look at Backend-less development. It's an emerging approach of using JavaScript to decouple frontend and backend, enabling them to be developed independently. The costs and the benefits of mocking the entire API. The three possible architectural approaches in doing so. Mock engine examples in Angular.js and sinon.js. Simulating business logic in mocks using plain JavaScript and JSONs. Using JSON Schema do generate massive amounts of mock data on the fly. The technical and business aspects of separating frontend and backend - these are the topics I will cover. Mock your API and make your frontend truly independent!

Tips for Installing Cognos Analytics 11.2.1x

Senturus

We walk through the installation and configuration steps for a Cognos 11.2.1 upgrade. Just some of the topics we cover include: how installer got smarter, upgraded hardware requirements, backing up and preserving files, upgrade strategy and themes and extensions. See the recording and download this deck: https://senturus.com/resources/tips-for-installing-cognos-analytics-11-2-1/ Senturus offers a full spectrum of services for business analytics. Our Knowledge Center has hundreds of free live and recorded webinars, blog posts, demos and unbiased product reviews available on our website at: https://senturus.com/resources/

Migration DB2 to EDB - Project Experience

EDB

The talk will be about the project to find a replacement for all IBM products in the company with the example for the databases. What was the goal of the project, the learning, a short overview about the options we migrated about 500 db2 databases to EnterpriseDB. The database size was from a small size up to 4 TB and we implemented a completely new fully automated deployment of VM and database. Databases are now 11 month in production. The talk will have an overview of the project, the learnings, a few parameters and technical parameters that were found for stability and performance.

How R Developers Can Build and Share Data and AI Applications that Scale with...

Databricks

Benefits of Managed Databases

DigitalOcean

Watch this Tech Talk: https://do.co/video_areyes Learn about the benefits of DBaaS from Alexis Reyes, Senior Solutions Engineer at DigitalOcean. He'll walk through all things DBaaS, including the difficulties that come with managing a database on your own. About the Presenter Alexis Reyes is the Senior Solutions Engineer at DigitalOcean with over 10 years of data center experience. He focuses on understanding his customers' business and technology, and how those two align. New to DigitalOcean? Get US $100 in credit when you sign up: https://do.co/deploytoday To learn more about DigitalOcean: https://www.digitalocean.com/ Follow us on Twitter: https://twitter.com/digitalocean Like us on Facebook: https://www.facebook.com/DigitalOcean Follow us on Instagram: https://www.instagram.com/thedigitalocean/ We're hiring: http://do.co/careers

[AWS DC Meetup] Not Your Father’s WebApp: The Cloud-Native Architecture of im...

Chris Shenton

Not Your Father’s Web App: The Cloud-Native Architecture of images.nasa.gov

Chris Shenton

Presentation to the NASA Cloud Community of Interest. Shows the evolution of simple webapps lacking resilience and scalability up to cloud-native apps that tolerate server faults and availability zone outages. Describes how images.nasa.gov leverages S3, EC2, ELB, DynamoDB, CloudSearch, ElasticTranscoder and more to provide a modern, scalable, mobile-friendly site showcasing the best of NASA's images, video and audio.

Case Study with Answers.com on Scaling with Memcached and MySQL

answers

The Evolution of Software for a Startup

SARCCOM

Sql And Storage Considerations For Share Point Server 2010Mike Watson

Building isomorphic java script apps faster with next.js

Madhav Chaturvedi

The great migration embracing serverless first

AngelaTimofte1

Serverless architectures can reduce operational cost and development time but it does come with an architectural overhead and complexity. In this talk you'll get an insight on how Trustpilot adopted a serverless mindset. The benefits and challenges of migrating and refactoring our systems having a serverless first approach. Learn how we mitigated the complexity of our services and cut down the cost on our infrastructure.

Massively Scaled High Performance Web Services with PHP

Demin Yin

Over the years, people have questioned if PHP is a good choice for building web services. In this talk, I will share how we use PHP on the backend for Glu Mobile’s flagship mobile game Design Home, enabling it to regularly rank amongst the top free mobile games in the Apple App Store and the Google Play Store. We will deep dive into the thought processes, development, testing, and deployment strategy, showcasing what we have achieved with PHP.

Kentico CMS: A Case Study in Building for Today’s Web

Thomas Robbins

Building software is a set of smart choices to meet the needs of your customers and the possibilities of technology. Today’s Web demands that customers have a choice in how they deploy their applications. With over 7,000 websites in 84 countries, Kentico CMS for ASP.Net is delivered as a single code base for use as a cloud, hosted, or on-premise solution. With over 34 out of the box modules and everything built on a SQL Server backend – How did we do it? What tradeoffs did we make? In this session we will answer that question and look at how to build a rich and compelling website using Windows Azure.

A Gentle Introduction to Functions-as-a-Service

Valeri Karpov

Thin Server Architecture

Mitch Pirtle

Lightbend Fast Data Platform

Lightbend

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

James Anderson

Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management. The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM). Speakers: Bob Boule Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle. Gopinath Rebala Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

Similar to Scalability At Kueski

Back your App with MySQL & Redis, the Cloud Foundry Way- Kenny Bastani, Pivotal

Redis Labs

Back your app with MySQL and Redis on Cloud Foundry

Kenny Bastani

CRN MagazineJoshua Steffan

JDD 2016 - Tomasz Ducin - Backend-less Development Revisited

PROIDEA

Tips for Installing Cognos Analytics 11.2.1x

Senturus

Migration DB2 to EDB - Project Experience

EDB

How R Developers Can Build and Share Data and AI Applications that Scale with...

Databricks

Benefits of Managed Databases

DigitalOcean

[AWS DC Meetup] Not Your Father’s WebApp: The Cloud-Native Architecture of im...

Chris Shenton

Not Your Father’s Web App: The Cloud-Native Architecture of images.nasa.gov

Chris Shenton

Case Study with Answers.com on Scaling with Memcached and MySQL

answers

The Evolution of Software for a Startup

SARCCOM

Sql And Storage Considerations For Share Point Server 2010Mike Watson

Building isomorphic java script apps faster with next.js

Madhav Chaturvedi

The great migration embracing serverless first

AngelaTimofte1

Massively Scaled High Performance Web Services with PHP

Demin Yin

Kentico CMS: A Case Study in Building for Today’s Web

Thomas Robbins

A Gentle Introduction to Functions-as-a-Service

Valeri Karpov

Thin Server Architecture

Mitch Pirtle

Lightbend Fast Data Platform

Lightbend

Similar to Scalability At Kueski (20)

Back your App with MySQL & Redis, the Cloud Foundry Way- Kenny Bastani, Pivotal

Back your app with MySQL and Redis on Cloud Foundry

CRN Magazine

JDD 2016 - Tomasz Ducin - Backend-less Development Revisited

Tips for Installing Cognos Analytics 11.2.1x

Migration DB2 to EDB - Project Experience

How R Developers Can Build and Share Data and AI Applications that Scale with...

Benefits of Managed Databases

[AWS DC Meetup] Not Your Father’s WebApp: The Cloud-Native Architecture of im...

Not Your Father’s Web App: The Cloud-Native Architecture of images.nasa.gov

Case Study with Answers.com on Scaling with Memcached and MySQL

The Evolution of Software for a Startup

Sql And Storage Considerations For Share Point Server 2010

Building isomorphic java script apps faster with next.js

The great migration embracing serverless first

Massively Scaled High Performance Web Services with PHP

Kentico CMS: A Case Study in Building for Today’s Web

A Gentle Introduction to Functions-as-a-Service

Thin Server Architecture

Lightbend Fast Data Platform

Recently uploaded

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

James Anderson

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...

James Anderson

A tale of scale & speed: How the US Navy is enabling software delivery from l...

sonjaschweigert1

Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved: - Reduction in onboarding time from 5 weeks to 1 day - Improved developer experience and productivity through actionable findings and reduction of false positives - Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO) Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production. We will cover: - How to remove silos in DevSecOps - How to build efficient development pipeline roles and component templates - How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence) - How to streamline operations with automated policy checks on container images

Large Language Model (LLM) and it’s Geospatial Applications

Rohit Gautam

Elizabeth Buie - Older adults: Are we really designing for our future selves?

Nexer Digital

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

SOFTTECHHUB

The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing. One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.

Monitoring Java Application Security with JDK Tools and JFR Events

Ana-Maria Mihalceanu

Pushing the limits of ePRTC: 100ns holdover for 100 days

Adtran

DevOps and Testing slides at DASA Connect

Kari Kakkonen

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024

Neo4j

PCI PIN Basics Webinar from the Controlcase Team

ControlCase

Mind map of terminologies used in context of Generative AI

Kumud Singh

GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...

Neo4j

Leonard Jayamohan, Partner & Generative AI Lead, Deloitte This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Aggregage

GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024

Neo4j

GridMate - End to end testing is a critical piece to ensure quality and avoid...

ThomasParaiso2

RESUME BUILDER APPLICATION Project for students

KAMESHS29

Communications Mining Series - Zero to Hero - Session 1

DianaGray10

This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered: • Communication Mining Overview • Why is it important? • How can it help today’s business and the benefits • Phases in Communication Mining • Demo on Platform overview • Q/A

Recently uploaded (20)

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

Securing your Kubernetes cluster_ a step-by-step guide to success !

Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...

A tale of scale & speed: How the US Navy is enabling software delivery from l...

Large Language Model (LLM) and it’s Geospatial Applications

Elizabeth Buie - Older adults: Are we really designing for our future selves?

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

Monitoring Java Application Security with JDK Tools and JFR Events

Pushing the limits of ePRTC: 100ns holdover for 100 days

DevOps and Testing slides at DASA Connect

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024

PCI PIN Basics Webinar from the Controlcase Team

Mind map of terminologies used in context of Generative AI

GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...

Generative AI Deep Dive: Advancing from Proof of Concept to Production

GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024

GridMate - End to end testing is a critical piece to ensure quality and avoid...

RESUME BUILDER APPLICATION Project for students

Communications Mining Series - Zero to Hero - Session 1

Scalability At Kueski

1. Scalability

2. How to do it New Challenges Myths

3. Kueski 1.0 DB Frontend Backend Client Browser Public IP Famous last words This is temporal, we will fix it when we have more engineers and budget.

4. Kueski 1.0 DB Frontend Backend Client Browser Public IP Myth NoSQL databases are better than SQL ones. In the practice It depends! No transactions! No suitable for banking applications.

5. Fact Fixing an error in the first day takes another day… Fix the error two years later takes 6 months! Many startups cannot afford that kind of mistakes.

6. Let’s do it right… Step by step

7. Scalable Infrastructure

8. Kueski 1.0 Frontend Backend Client Browser Public IP DB Separate database to it own server...

9. Kueski 1.0 Frontend Backend Client Browser Public IP DB Kueski 1.0 Frontend Backend Create a second server... One IP for two servers?

10. Frontend Backend Client Browser Public IP DB Frontend Backend Load Balancer Add a load balancer...

11. Frontend Backend Client Browser Public IP DB Frontend Backend Load Balancer Sessions Problem!

12. Frontend Backend Client Browser Public IP Frontend Backend Load Balancer DB Redis Use a memory based database to store sessions...

13. Frontend Backend Client Browser Public IP DB & Sessions Frontend Backend Load Balancer Or use the same SQL database for the sessions...

14. Frontend Backend Client Browser Public IP DB & Sessions Frontend Backend Load Balancer Database Bottleneck!

15. Frontend Backend Client Browser Public IP Frontend Backend Load Balancer DB Redis Replica 1 Replica 2 Create read replicas... Advice Use a framework that supports read replicas.

16. Load Balancer Bottleneck! Frontend Backend Client Browser Public IP Frontend Backend Load Balancer DB Redis Replica 1 Replica 2

17. Client Browser Load Balancer Load Balancer DNS DNS DNS Add multiple load balancers and setup DNS... Round robin IP Who is doing the load balancing of the DNS?

18. Frontend Backend Client Browser Frontend Backend Load Balancer DB Redis Replica 1 Load Balancer DNS DNS So far... Multizone

19. Frontend Backend Client Browser Frontend Backend Load Balancer DB Redis Replica 1 Load Balancer DNS DNS Sessions Bottleneck!

20. Frontend Backend Client Browser Frontend Backend Load Balancer DB Load Balancer Use Client Side Sessions! Replica 1 DNS DNS

21. Client Side Sessions Client Browser Backend Encrypted Digitally Signed Session Data Send session data every request

22. Scalable Application

23. Long Response Times Uploads Fotos, Documents, Video (hours) Long Jobs Query Web Service, PDF generation, Search (minutes) Rendering HTML, Images (seconds) Long response times kills scalability

24. Connection pool exhaustion ● Database ● Requests Uploads Client Browser Backend Client Browser Uploads Server Backend Token Upload & Receive Token Old Approach Better Approach

25. Long JobsClient Browser AWS SQS (Queue) Backend Push Notification Better Approach Consumer (Postprocessing) Consumer (Postprocessing) Push Message Pop Message Database Browser Unresponsiveness Connection pool exhaustion

26. Rendering Frontend Backend In the practice Ruby does not scale if you don’t know how! Wasted server CPU Myth Ruby does not scale! Even more... Any language can scale knowing the right way!

27. Rendering Frontend Backend

28. Rendering HTML Backend Javascript CSS Images

29. Rendering Index (HTML) Backend (API) Javascript CSS Images Client Browser CDN

30. Myth Scaling from day zero is impossible In the practice You should create all your infrastructure and applications ready to scale, any time, without much effort, from day zero.

31. Thanks!

Scalability At Kueski

Recommended

Recommended

More Related Content

Similar to Scalability At Kueski

Similar to Scalability At Kueski (20)

Recently uploaded

Recently uploaded (20)

Scalability At Kueski