The document proposes a Bulk-n-Pick method for one-to-many data transfer in dense wireless spaces. It begins by outlining problems with congested WiFi networks and inefficient HTTP requests. The solution involves pushing data to clients using circuits rather than individual packet pulls, which reduces overhead. The Bulk-n-Pick method bulk transfers data then allows clients to pick relevant portions, improving throughput. Modeling suggests it completes transfers much faster than traditional methods, especially with multiple parallel sessions. The approach reintroduces benefits of circuits for bulk data transfer over wireless networks.
Breaking the Kubernetes Kill Chain: Host Path Mount
Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces
1. in Dense Wireless Spaces
Marat Zhanikeev
maratishe@gmail.com
maratishe.github.io
2016/07/24@NANA@Hakodate
Bulk-n-Pick Method
PDF: bit.do/160724
for One-to-Many Data Transfer
#densewireless
#bulktransfer #sync
#congestion
#websockets
#html5
2. .
The Problem
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 2/18
...
2/18
3. .
The Problem
• WiFi networks are badly congested -- dense wireless spaces
◦ as a side effect: LAN hubs have removed CSMA in modern hubs/switches, but no in
WLANs
◦ distance effect is huge: farther = slower (rates) = takes longer = increases
congestion
• webapps served over WiFi need to be rewritten
◦ when congested, HTTP requests come back empty -- JS side should
have additional logic for repeated requests (resilience)
• educational classes have considerable bulk of content -- heavy WiFi users
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 3/18
...
3/18
4. .
The Problem : Overhead Calculator
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 4/18
...
4/18
5. .
The Problem : Experiments
1
2
3
5
10
No.oftriesthreshold
gap#0 tag#tabletsonly gap#5 tag#all gap#0 tag#all
0 20 40 60 80 100
Probability
10
50
100
200
500
1000
2000
5000
10000
25000
50000
Completiontimethreshold(ms)
gap#0 tag#tabletsonly gap#5 tag#all gap#0 tag#all
Size#100000Size#10000Size#100
~40% take 3+ tries
~40% take 10s or more
0 20 40 60 80 100
Probability
0 20 40 60 80 100
Probability
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 5/18
...
5/18
6. .
The Solution
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 6/18
...
6/18
7. .
The Solution : Push, not Pull
Server
Client
…….
Server
Client
…….
Pull
Push
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 7/18
...
7/18
9. .
The Solution : Circuits vs Packets
2 flows
.....
L1
L15
2 flows
15 links
30 flows ...
• the old circuits vs
packets problem
• intuition for LANs/WLANs
◦ under low-volume traffic,
packets are better
◦ under bulk/bigdata traffic,
circuits are better
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 9/18
...
9/18
10. .
The Solution : Circuits = Scheduling
Line=
outgoing
port
Overhead =
contention
No. of flows
Line=
outgoing
port
Overhead
Scheduling
Traditional
Circuits
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 10/18
...
10/18
11. .
The Proposal
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 11/18
...
11/18
12. .
Proposal : Bulk-n-Pick Method
Network
(wireless)
User device
(browser)
AJAX
Time
order
Web
server
WiFi
…..
Bulk
step
Pick
step
Store bulk
(Javascript variable)
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 12/18
...
12/18
13. .
Proposal : Setup/Modeling
• use experiments (above) as numeric models
• emulate a wider range of conditions and see how Bulk-n-Pick
performs
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 13/18
...
13/18
14. .
Proposal : Results (1/2)
0 2 4 6 8 10 12 14 16 18
Ordered list
0
500
1000
1500
2000
2500
3000
3500
4000
Completiontime(seconds)
TraditionalBulk-n-pick (proposal with 2 concurrent bulks)
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 14/18
...
14/18
15. .
Proposal : Results (2/2)
0 2 4 6 8 10
Number of parallel Bulk-n-Pick sessions
0
1000
2000
3000
4000
5000
6000
7000
Finalcompletiontime(seconds)
Traditional
Bulk-n-pick (proposed)
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 15/18
...
15/18
17. .
Wrapup: The Bigger Picture
• this paper builts up on 01, and tests in https://github.com/maratishe/msaplayer
• but Bulk-n-Pick model is a bigger concept that brings back circuits and
builds a new webapp logic around them
Network
Web Server
Chrome Browser
Control
…….
Buffer
User
WebSocket
WebWorker
WebSocket
WebWorker
WebSocket
Server
WebSocket request
fork()
Handshake
01 M.Zhanikeev+0 "Experiments with application throughput in a browser with full HTML5 support" IEICE ComEx (2013)M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 17/18
...
17/18
18. .
That’s all, thank you ...
M.Zhanikeev -- maratishe@gmail.com Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces -- bit.do/160724 18/18
...
18/18