MQTT - A practical protocol for the Internet of ThingsBryan Boyd
In today’s mobile world, the volume of connected devices and data is growing at a rapid pace. As more and more “things” become part of the Internet (refrigerators, pacemakers, cows?), the importance of scalable, reliable and efficient messaging becomes paramount. In this talk we will dive into MQTT: a lightweight, open standard publish/subscribe protocol for rapid messaging between “things”.
MQTT is simple to understand, yet robust enough to support interactions between millions of devices and users. MQTT is being used in connected car applications, mobile banking, Facebook Messenger, and many things in between. In this talk you will learn all about the protocol (in 10 minutes!) and see some of its applications: live-tracking, gaming, and more. We’ll walk through designing an MQTT-based API for a ride-share mobile application, and discuss how MQTT and REST APIs can complement each other.
Lessons Learned Building a Connector Using Kafka Connect (Katherine Stanley &...confluent
While many companies are embracing Apache Kafka as their core event streaming platform they may still have events they want to unlock in other systems. Kafka Connect provides a common API for developers to do just that and the number of open-source connectors available is growing rapidly. The IBM MQ sink and source connectors allow you to flow messages between your Apache Kafka cluster and your IBM MQ queues. In this session we will share our lessons learned and top tips for building a Kafka Connect connector. We'll explain how a connector is structured, how the framework calls it and some of the things to consider when providing configuration options. The more Kafka Connect connectors the community creates the better, as it will enable everyone to unlock the events in their existing systems.
Blue-green deploys with Pulsar & Envoy in an event-driven microservice ecosys...StreamNative
In this talk, learn how Toast leverages our Envoy control-plane to manage blue-green deploys of Pulsar consumers, and how this has helped drive adoption across the engineering organization. Dive into the history of Pulsar at Toast, starting from its introduction in 2019 to provide event-driven architecture across a rapidly scaling restaurant software platform. We will detail some of the hurdles that we encountered gaining buy-in across a diverse set of teams, and dive deep into how we enforce best practices and integrate with our service control plane.
MQTT - A practical protocol for the Internet of ThingsBryan Boyd
In today’s mobile world, the volume of connected devices and data is growing at a rapid pace. As more and more “things” become part of the Internet (refrigerators, pacemakers, cows?), the importance of scalable, reliable and efficient messaging becomes paramount. In this talk we will dive into MQTT: a lightweight, open standard publish/subscribe protocol for rapid messaging between “things”.
MQTT is simple to understand, yet robust enough to support interactions between millions of devices and users. MQTT is being used in connected car applications, mobile banking, Facebook Messenger, and many things in between. In this talk you will learn all about the protocol (in 10 minutes!) and see some of its applications: live-tracking, gaming, and more. We’ll walk through designing an MQTT-based API for a ride-share mobile application, and discuss how MQTT and REST APIs can complement each other.
Lessons Learned Building a Connector Using Kafka Connect (Katherine Stanley &...confluent
While many companies are embracing Apache Kafka as their core event streaming platform they may still have events they want to unlock in other systems. Kafka Connect provides a common API for developers to do just that and the number of open-source connectors available is growing rapidly. The IBM MQ sink and source connectors allow you to flow messages between your Apache Kafka cluster and your IBM MQ queues. In this session we will share our lessons learned and top tips for building a Kafka Connect connector. We'll explain how a connector is structured, how the framework calls it and some of the things to consider when providing configuration options. The more Kafka Connect connectors the community creates the better, as it will enable everyone to unlock the events in their existing systems.
Blue-green deploys with Pulsar & Envoy in an event-driven microservice ecosys...StreamNative
In this talk, learn how Toast leverages our Envoy control-plane to manage blue-green deploys of Pulsar consumers, and how this has helped drive adoption across the engineering organization. Dive into the history of Pulsar at Toast, starting from its introduction in 2019 to provide event-driven architecture across a rapidly scaling restaurant software platform. We will detail some of the hurdles that we encountered gaining buy-in across a diverse set of teams, and dive deep into how we enforce best practices and integrate with our service control plane.
Introducing Apache Kafka - a visual overview. Presented at the Canberra Big Data Meetup 7 February 2019. We build a Kafka "postal service" to explain the main Kafka concepts, and explain how consumers receive different messages depending on whether there's a key or not.
Replication in computing involves sharing information so as to ensure consistency between redundant resources, such as software or hardware components, to improve reliability, fault-tolerance, or accessibility.
Fundamentals and Architecture of Apache KafkaAngelo Cesaro
Fundamentals and Architecture of Apache Kafka.
This presentation explains Apache Kafka's architecture and internal design giving an overview of Kafka internal functions, including:
Brokers, Replication, Partitions, Producers, Consumers, Commit log, comparison over traditional message queues.
MQTT is a standardized publish/subscribe Push protocol that was released by IBM in 1999. MQTT was planned to send a data accurately under the long network delay and low- bandwidth network condition.
Apache Kafka as Message Queue for your microservices and other occasionsMichael Reinsch
This talk provides a quick intro to Apache Kafka, the basic concepts, and why it's good as a message queue.
We'll also explore the benefits and challenges of using a message queue as base of your microservices infrastructure (especially when transitioning from a monolith).
Amazon Web Services (AWS) provides on-demand computing resources and services in the cloud, with pay-as-you-go pricing. This session provides an overview and describes how using AWS resources instead of your own is like purchasing electricity from a power company instead of running your own generator. Using AWS resources provides many of the same benefits as a public utility: Capacity exactly matches your need, you pay only for what you use, economies of scale result in lower costs, and the service is provided by a vendor experienced in running large-scale networks. A high-level overview of AWS infrastructure (such as AWS Regions and Availability Zones) and AWS services is provided as part of this session.
Speaker: Tom Whateley, Solutions Architect and Stephanie Zieno, Account Manager, Amazon Web Services
Hello, kafka! (an introduction to apache kafka)Timothy Spann
Hello ApacheKafka
An Introduction to Apache Kafka with Timothy Spann and Carolyn Duby Cloudera Principal engineers.
We also demo Flink SQL, SMM, SSB, Schema Registry, Apache Kafka, Apache NiFi and Public Cloud - AWS.
There is a renaissance underway in the messaging space. Due to the demands of IoT networks, cloud native apps, and microservices developers are looking for simple, fast, messaging systems. This is a sharp contrast to how traditional messaging was done.
This webinar will cover:
- The basics of messaging patterns
- What makes NATS unique
- Using a demo inspired by Pokemon Go as an example
IBM MQ and Kafka, what is the difference?David Ware
Message queueing solutions used to be the one general purpose tool used for all asynchronous application patterns, then along came event streaming as an application model. To support this effectively needed a whole new approach to how messages are handled by the messaging technology. Now the tables are turned and many are wondering if an event streaming solution can be used for all their asynchronous application patterns from now on. But just as message queueing solutions work in a way to optimize for their core use cases, so do event streaming solutions, and these behaviors directly affect the applications that use them. This session picks IBM MQ and Kafka to look at how they compare and, more importantly, differ in their behavior so that you can decide which application scenarios are best suited by each. Spoiler -they're both good in their own way!
Unit 3 -Data storage and cloud computingMonishaNehkal
Data storage
Cloud storage
Cloud storage from LANs to WANs
Cloud computing services
Cloud computing at work
File system
Data management
Management services
Billions of Messages in Real Time: Why Paypal & LinkedIn Trust an Engagement ...confluent
(Bruno Simic, Solutions Engineer, Couchbase)
Breakout during Confluent’s streaming event in Munich. This three-day hands-on course focused on how to build, manage, and monitor clusters using industry best-practices developed by the world’s foremost Apache Kafka™ experts. The sessions focused on how Kafka and the Confluent Platform work, how their main subsystems interact, and how to set up, manage, monitor, and tune your cluster.
Introducing Apache Kafka - a visual overview. Presented at the Canberra Big Data Meetup 7 February 2019. We build a Kafka "postal service" to explain the main Kafka concepts, and explain how consumers receive different messages depending on whether there's a key or not.
Replication in computing involves sharing information so as to ensure consistency between redundant resources, such as software or hardware components, to improve reliability, fault-tolerance, or accessibility.
Fundamentals and Architecture of Apache KafkaAngelo Cesaro
Fundamentals and Architecture of Apache Kafka.
This presentation explains Apache Kafka's architecture and internal design giving an overview of Kafka internal functions, including:
Brokers, Replication, Partitions, Producers, Consumers, Commit log, comparison over traditional message queues.
MQTT is a standardized publish/subscribe Push protocol that was released by IBM in 1999. MQTT was planned to send a data accurately under the long network delay and low- bandwidth network condition.
Apache Kafka as Message Queue for your microservices and other occasionsMichael Reinsch
This talk provides a quick intro to Apache Kafka, the basic concepts, and why it's good as a message queue.
We'll also explore the benefits and challenges of using a message queue as base of your microservices infrastructure (especially when transitioning from a monolith).
Amazon Web Services (AWS) provides on-demand computing resources and services in the cloud, with pay-as-you-go pricing. This session provides an overview and describes how using AWS resources instead of your own is like purchasing electricity from a power company instead of running your own generator. Using AWS resources provides many of the same benefits as a public utility: Capacity exactly matches your need, you pay only for what you use, economies of scale result in lower costs, and the service is provided by a vendor experienced in running large-scale networks. A high-level overview of AWS infrastructure (such as AWS Regions and Availability Zones) and AWS services is provided as part of this session.
Speaker: Tom Whateley, Solutions Architect and Stephanie Zieno, Account Manager, Amazon Web Services
Hello, kafka! (an introduction to apache kafka)Timothy Spann
Hello ApacheKafka
An Introduction to Apache Kafka with Timothy Spann and Carolyn Duby Cloudera Principal engineers.
We also demo Flink SQL, SMM, SSB, Schema Registry, Apache Kafka, Apache NiFi and Public Cloud - AWS.
There is a renaissance underway in the messaging space. Due to the demands of IoT networks, cloud native apps, and microservices developers are looking for simple, fast, messaging systems. This is a sharp contrast to how traditional messaging was done.
This webinar will cover:
- The basics of messaging patterns
- What makes NATS unique
- Using a demo inspired by Pokemon Go as an example
IBM MQ and Kafka, what is the difference?David Ware
Message queueing solutions used to be the one general purpose tool used for all asynchronous application patterns, then along came event streaming as an application model. To support this effectively needed a whole new approach to how messages are handled by the messaging technology. Now the tables are turned and many are wondering if an event streaming solution can be used for all their asynchronous application patterns from now on. But just as message queueing solutions work in a way to optimize for their core use cases, so do event streaming solutions, and these behaviors directly affect the applications that use them. This session picks IBM MQ and Kafka to look at how they compare and, more importantly, differ in their behavior so that you can decide which application scenarios are best suited by each. Spoiler -they're both good in their own way!
Unit 3 -Data storage and cloud computingMonishaNehkal
Data storage
Cloud storage
Cloud storage from LANs to WANs
Cloud computing services
Cloud computing at work
File system
Data management
Management services
Billions of Messages in Real Time: Why Paypal & LinkedIn Trust an Engagement ...confluent
(Bruno Simic, Solutions Engineer, Couchbase)
Breakout during Confluent’s streaming event in Munich. This three-day hands-on course focused on how to build, manage, and monitor clusters using industry best-practices developed by the world’s foremost Apache Kafka™ experts. The sessions focused on how Kafka and the Confluent Platform work, how their main subsystems interact, and how to set up, manage, monitor, and tune your cluster.
Adam Dagnall: Advanced S3 compatible storage integration in CloudStackShapeBlue
Adam's slides from his talk at the CloudStack European User group meetup, March 13, London. To provide tighter integration between the S3 compatible object store and CloudStack, Cloudian has developed a connector to allow users and their applications to utilize the object store directly from within the CloudStack platform in a single sign-on manner with self-service provisioning. Additionally, CloudStack templates and snapshots are centrally stored within the object store and managed through the CloudStack service. The object store offers protection of these templates and snapshots across data centres using replication or erasure coding.
For people who start to create a cloud service, it’s really important to know how to create a scalable cloud service to fit the growth of the future workloads. In this session, we will introduce how to design a scalable cloud service including AWS services introduction and best practices.
Scaling to millions of users with Amazon CloudFront - April 2017 AWS Online T...Amazon Web Services
Learning Objectives:
• Learn how to use CloudFront dynamic delivery features • See a live demo and learn how to take advantage of Cloud Front newest features
Traditionally, content delivery networks (CDNs) were designed to accelerate static content. Amazon CloudFront supports delivery of an entire website, including dynamic, static, streaming and interactive content using a global network of edge locations. CloudFront integrates with other AWS services that are built to scale massively. Together, the solution can automatically scale to millions of users by leveraging the global reach of CloudFront and the auto scaling capability of AWS platform. In this talk, we introduce you to various design patterns and best practices to build a massively scalable solution using CloudFront. We discuss how this scale can be achieved without compromising on availability, security or cost.
This Presentation is on a very popular technology related topic, Cloud Computing. It is in our basic daily technology need like gmail i.e. also based on Cloud Computing. And also it has also very good source of job in it. Hope it would be helpful for your School or College project.
Key Aspects of Effective Communication and Leadership Features in Italian Ele...Chiara Cilardo
Leaderships's styles and positioning in actual political scenario in Italy; how to improve personality management and main leader's attributes (empathy, integrity, leadership, capacity); designing effective communication and media plan in political election campaigns; possible scenario and possible winning communication style.
Team Members: Chiara Cilardo, Claudio Contini, Azzurra Maria Barausse, Pier Francesco Prata
An integrated communication plan aimed at increasing brand positioning and brand recognition of the city; a tourism marketing plan and a set of thematic events ("Caserta: the path of beauty") were built tailored to typical food and wine products and historical sites to promote peculiarities of that territory.
Team Members: Chiara Cilardo, Ly Nguyen, Federico Oliveri, Azzurra Maria Barausse, Claudio Contini, Chiara Neffat
Pasta Brand - Digital Interactive MarketingChiara Cilardo
Creation of a brand of pasta and its value proposition based on the analysis of the market and of the potential target; creation of a communication strategy (web site, social networks, e-commerce).
Team Members: Chiara Cilardo, Claudio Contini, Ilaria Cascione, Azzurra Maria Barausse
Terre Des Hommes committed this project to promote their InDifesa Campaign for the "World Day for Girls 2014" by United Nations Foundation; we build a social media campaign, outlined a script of a viral video, designed a guerrilla marketing plan to launch the campaign.
Team Members: Chiara Cilardo, Ly Nguyen, Federico Oliveri, Azzurra Maria Barausse, Claudio Contini
Customer Plan - Esselunga Frozen Pizza CaseChiara Cilardo
Design of a customer plan based on a deep analysis of the retailer and the category "frozen pizza" (private labels and competitors position, price strategy, logistic structure, the shelf); in addition, a marketing tools analysis was conducted; segmentation suggestions (space and merchandising), new opportunities proposal (innovation and partnerships, new products, off and on line improvements).
Team Members: Chiara Cilardo, Cristina Munoz Garcia, Azzurra Maria Barausse, Valeria Di Persio D'Agostino
B2B Business Marketing - Rinaldi Case StudyChiara Cilardo
B2B case study: defining a business strategy based on the analysis of company results, actual market, competitors position in order to build an effective plan to increase its market share.
Team Members: Chiara Cilardo, Cristina Munoz Garcia, Azzurra Maria Barausse, Valeria Di Persio D'Agostino
Creation of an on-line survey about Mc Donalds services; after collecting 113 surveys, an analysis of output (SPSS) was conducted in order to understand how critical variables (price, demographics, perceived quality of food, services, brand image) affect overall customer satisfaction
Team Members: Chiara Cilardo, Cristina Munoz Garcia; Azzurra Maria Barausse; Valeria Di Persio D'Agostino
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
2. INDEX
u
CLOUD
COMPUTING:
HOW
IT
WORKS
u
DROPBOX:
THE
SERVICE
u
DROPBOX
FOR
BUSINESS
u
SECURITY
ISSUES
u
SECURITY
ARCHITECTURE
u
DROPBOX’S
ARCHITECTURE
and
EVOLUTION
u
BUSINESS
MODEL
3. Service
models:
SaaS
PaaS
Iaas
Adop0on
of:
Virtualiza.on
Soa
4
deployment
models:
Private
Community
Public
Hybrid
Cloud
CompuIng:
How
Does
It
Work
4. Main
features
of
cloud
compuIng
(Na#onal
Ins#tute
of
Standards
and
Technology
-‐
NIST):
1. On-‐demand
self
service:
access
to
informa0on
resources
only
when
needed,
paying
the
same
usage
and
not
on
the
basis
of
a
fixed
fee
or
by
purchasing
a
license
once;
2. Broad
network
access:
resources
are
available
on-‐line
and
accessible
at
any
.me
via
desktop,
laptop,
mobile,
tablet;
3. Resource
pooling:
using
a
mul.tenant
model,
which
allows
an
instance
of
soAware
to
serve
more
clients,
with
different
physical
and
virtual
resources
dynamically
reassigned
according
to
consumer
demand;
4. Rapid
elasIcity:
resources
can
be
rapidly
and
elas.cally
increased
(scalability);
5. Measured
service:
where
the
cloud
provider
measures
or
monitors
the
provision
of
services
for
various
reasons,
including
billing,
effec0ve
use
of
resources,
or
overall
predic0ve
planning
5. Dropbox,
born
in
2007
founded
by
Drew
Houston,
is
a
soAware
mul0plaHorm
cloud
storage
that
offers
an
hos0ng
file
service
and
automathic
synch
via
web
It
is
available
on
Windows,
Mac
OS
X,
Linux,
iOS,
Blackberry
OS
and
Android
Service
model:
SaaS
Deployment
model:
public
Dropbox
as
a
collabora0on
plaHorm
that
provides
users
with
reliable
data
storage,
synced
across
mul0ple
devices,
and
also
shared
among
a
group
of
users
200m
users
1
billion
files
syncs
a
day
10s
of
thousand
physical
servers
DROPBOX
6. Using
Dropbox
in
a
Business
ProspecIve
-‐ Decreasing
in
maintenance
costs
(servers,
employees)
-‐ Environmental
issues
(less
use
of
energy)
-‐ Flexibility
(variety
of
devices
and
OS)
-‐ Increase
in
collaboraIon
(sharing
access
to
important
files
independently
from
the
loca0on)
-‐ Limited
costs
and
fees
(no
hardware
costs
and
very
liUle
setup
0me:
Dropbox
for
Business
is
priced
at
$795
annually
for
up
to
five
users,
plus
an
addi0onal
$125
per
year
for
each
addi0onal
user)
7. DROPBOX
SECURITY
CONCERNS:
-‐ Monitor
dropbox
usage
-‐ Beware
security
prac.ces
-‐ Treat
Dropbox
as
public
repository
-‐ Access
control
Some
possible
future
soluIons:
-‐
encryp.on
and
password
-‐
remote
wipe
8. HOW
DROPBOX
DEALS
WITH
PRIVACY
AND
SECURITY
PROBLEMS
AES-‐256
encrypIon:
a
webtool
to
encrypt
and
decrypt
text
using
AES
encryp.on
algorithm;
you
can
chose
128,
192
or
256-‐bit
long
key
size
for
encryp0on
and
decryp0on
Secure
Socket
Layer
(SSL):
encryp0ng
protocol
that
allows
a
safe
communica0on
between
source
and
client
(client/server
model)
on
TCP/IP
net
to
prevent
tampering
(falsifica0on)
of
data
9. HOW
DROPBOX
DEALS
WITH
PRIVACY
AND
SECURITY
PROBLEMS
AES-‐256
encryp0on
SSL
11. The
Server
Clients
DB
S3
Late
2007
3
employees
• Fast
changing
environment,
resources
are
growing
at
the
same
0me
with
the
demand
• The
server
runs
out
of
space
and
becomes
overloaded
• Put
the
data
on
S3
• Use
of
MySQL
12. Early
2008
10
employees
50k
users
Clients
Metaserver
DB
S3
Noteserver
Blockserver
The
server
is
split
into
2
servers:
• Metaserver:
doing
all
the
meta
data
calls
• Blockserver:
hos0ng
all
the
files’
content
13. Late
2008
10
employees
100K
users
• Need
of
adding
more
meta
and
block
servers
• Only
one
DB
Add
Memecache
to
avoid
DB
scaling
issues
• Load
Balancing
method
to
op0mize
resources,
minimize
response
0me,
avoid
overload
of
resources.
Clients
Noteserver
DB
S3
LB
Memcache
Metaserver
Metaserver
Blockserver
Blockserver
14. Metaserver
Memcache
Early
2012
100
employees
50M
users
• Use
of
several
DBs
• Large
use
of
load
balancing
Clients
DB
S3
Memcache
Memcache
Metaserver
Metaserver
Blockserver
Blockserver
Noteserver
Noteserver
LB
LB
DB
DB
15. 1
billion
of
file
syncs
a
day
10s
thousand
fisical
servers
2014
200M
users
16. FACT:
Typically
people
tend
to
consume
more
contents
than
they
produce
BUT
For
Dropbox
the
wricen
raIon
between
uploading
vs
downloading
files
is
1:1
FURTHERMORE:
Best
prac0ces
and
standard
solu0ons
are
designed
for
different
order
of
magnitude
in
terms
of
writes
IMPLICATION
•
With
the
same
number
of
servers
Dropbox
is
doing
10
to
100
Imes
writes
than
other
companies
do!
•
Backend
must
be
designed
in
order
to
support
high
volume
of
writes
and
high
requirements
in
terms
of
correctness
17. Dropbox’s Business Model
LIGHT
USERS
HEAVY
AND
MEDIUM
USERS
COMPANIES
2GB
FREE
STORAGE
SUBSCRIPTIONS
$
SUBSCRIPTIONS
$$$
18. The Gamification
MIUM
Register
and
get
2GB
of
data
storage
for
free
In
order
to
receive
addiIonal
data
storage
•
Invite
your
friends
to
use
dropbox
•
View
Dropbox’s
how-‐to
online
videos
•
Download
Dropbox
on
other
devices