Does Django scale? An introduction to Scalability

“Does Django scale?”
An introduction to Scalability
Python Barcelona
David Arcos

Hi! I’m David
●
I’m a backend developer specialized in distributed systems,
scalability and security
●
>10 years building ...

1) Does Django Scale?
Questions

https://stackoverflow.com/questions/886221/does-django-scale

https://docs.djangoproject.com/en/dev/faq/general/#does-django-scale

1) Does Django Scale? YES
2) What is Scalability?
Questions

Scalability
“The potential of a system
to be enlarged to accommodate
a growing amount of work”

“A Word on Scalability” (2006)
“A service is said to be scalable if when
we increase the resources in a system,
it results...

Will it scale?
An algorithm/protocol/system does scale, if it
is suitably efficient and practical when applied
to large si...

Performance != Scalability
●
Performance is a quality metric:
– “The time it takes to execute one request”
●
Scalability:
...

Where is the state?
●
Scaling is much easier if:
– The app servers are stateless
– The database keeps the state
●
So:
– Ve...

Vertical / horizontal scaling

Vertical scaling
●
Scale up/down: add/remove resources to a
single node
– Adding more power (faster CPU, more CPUs, more
m...

Vertical scaling… but...
●
But:
– There are hardware limits
●
RDS current limit of 488 GiB of memory (db.r4.16xlarge)
– Di...

Horizontal scaling
●
Scale out/in: add/remove nodes to a system
– Adding new computers to a cluster
●
Very common on (stat...

Horizontal scaling.. but...
●
But:
– Architecture must support it
●
Keep the state in external db!
– Management overhead
●...

1) Does Django Scale? YES
2) What is Scalability?
3) What is Django?
Questions

“The web framework for
perfectionists with deadlines”
https://www.djangoproject.com

Who uses Django?
●
Instagram
●
Pinterest
●
Spotify
●
Disqus
●
Bitbucket
●
Mozilla Firefox
●
Dropbox
●
Open Stack
●
NASA
●
...

DRF: Django REST framework
https://www.django-rest-framework.org
“A powerful and flexible toolkit for building Web APIs”

http://www.celeryproject.org
Celery: Distributed Task Queue

Other Python web frameworks

1) Does Django Scale? YES
2) What is Scalability?
3) What is Django?
4) How to scale Django?
Questions

How to Scale Django?
●
Measure first, find bottlenecks
– Rinse and repeat
●
Focus on database performance
– Indexes, queri...

“High Performance Django” book
https://highperformancedjango.com

1) Does Django Scale? YES
2) What is Scalability?
3) What is Django?
4) How to scale Django?
Questions

Thanks for attending!
At Lead Ratings we are looking for:
– Python Developers
– Data Engineers
– Data Scientists

Questions?

Does Django scale? An introduction to Scalability

Does Django scale? An introduction to Scalability

You are reading a preview.

Activate your 30 day free trial to continue reading.

Share SlideShare

Facebook
Twitter
LinkedIn

Embed

Size (px)

Show related SlideShares at end

WordPress Shortcode

Link

Share
Email

Irresistible content for immovable ... by Velocity Partners 222927 views
How To Build Amazing Products Throu... by Product School 46885 views
Bridging the Gap Between Data Scien... by ryanorban 131117 views
Intro to user centered design by Rebecca Destello 17833 views
How to Master Difficult Conversatio... by Piktochart 390285 views
How to Land that First Customer by Floown 817502 views

Top clipped slide

1 of 30 Ad

1 of 30 Ad