Your SlideShare is downloading. ×
0
A Survey of
High-speed Networks


     By Ning Zhang
  University of Waterloo
Questions to Answer
• What is the role of network subsystem in
  OS?
• What is new in high-speed network?
• What is the us...
Network Subsystem
• In OS, all the software components (NIC driver,
  protocol implementations …) related to network
  com...
Broadband and High-speed
             Network
• Network performance is determined by 2
  parameters: bandwidth and latency...
Measure of Latency
• Latency Tl = Tp + Tt + To
  – Tp = d/c, represents propagation time,
  – Tt = s/w, represents transmi...
Host I/O Bus



         Bus Interface

output                     input
queue                     queue




         Link...
Network Interface Card
• Who do the dirty work?
   – Direct Memory Access (DMA)
   – Programmable I/O (PIO)
• Where to put...
Proposed Changes to NIC
• Mapping NIC memory to virtual memory
• Connecting NIC to memory bus rather than
  I/O bus
• Allo...
Typical Levels in Memory Hierarchy
  Level        1          2         3          4         5

 Called     Registers   Cac...
JOIN Network and Disk
• Integrate the two distinct devices into one:
   – Pushing up NIC to system bus à make faster devic...
Fibre Channel Features
• Allowing many well-known existing
  channels and network protocols to run
  under the same physic...
Fibre Channel Layers
• FC-0: signaling, media specification,
  receiver/transmitter specification.
• FC-1: data encoding, ...
Fibre Channel Services
• Class 1: dedicated connection service.
  Frame orders are preserved. e.g.
  audio/video on-demand...
InfiniBand Architecture vs. FC
• Higher bandwidth (250M~3GB/sec) and
  more sophisticated architecture than FC.
• Higher s...
IBA Layers
• Physical layer: signaling, framing, etc.
• Link layer: packet format, flow control,
  subnet routing, etc.
• ...
IBA Service Types
    Service Type        Connection   Acknowledged   Transport
                         Oriented
 Reliabl...
Lightweight Network Protocols
    (Trapeze as an example)
• Trapeze is built on Myrinet
• Lightweight Remote Procedure Cal...
Impact on DDBMS?
• How to place data?
  – Range partitioning
  – Round robin partitioning
  – Hashing partitioning
• How t...
Conclusion and Future Work
• As networks getting faster and faster,
  protocol overhead becomes the biggest time
  consume...
Upcoming SlideShare
Loading in...5
×

High-speed Networks

2,019

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
2,019
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
72
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "High-speed Networks"

  1. 1. A Survey of High-speed Networks By Ning Zhang University of Waterloo
  2. 2. Questions to Answer • What is the role of network subsystem in OS? • What is new in high-speed network? • What is the usage of high-speed networks in current I/O devices? • What can be done to the DDBMS based on these changes?
  3. 3. Network Subsystem • In OS, all the software components (NIC driver, protocol implementations …) related to network communications are called network subsystem. • Three components in Network subsystem: hardware architecture of the host, the host software system, and the network interface. • The common services provided to the application determines their functionality and efficiency. • It is crucial to understand what services provided to the upper layer applications.
  4. 4. Broadband and High-speed Network • Network performance is determined by 2 parameters: bandwidth and latency. • Bandwidth: the number of bits can be transferred in a unit of time. Broadband means the number is large. • Latency: the time it takes to transfer a certain size of message from one end to the other end. High- speed means the latency should be short.
  5. 5. Measure of Latency • Latency Tl = Tp + Tt + To – Tp = d/c, represents propagation time, – Tt = s/w, represents transmission time, – To represents protocol overhead. • High-speed is two-fold: – Tt is small à broadband network. – To is small à low overhead protocols and hardware support.
  6. 6. Host I/O Bus Bus Interface output input queue queue Link Interface Adaper Network Link
  7. 7. Network Interface Card • Who do the dirty work? – Direct Memory Access (DMA) – Programmable I/O (PIO) • Where to put the data? – System’s space – User’s space. • How close to the CPU? – I/O bus – System bus
  8. 8. Proposed Changes to NIC • Mapping NIC memory to virtual memory • Connecting NIC to memory bus rather than I/O bus • Allowing caching network interface registers, out-of-order and speculative access to the registers. • Removing side-effects from the API in OS.
  9. 9. Typical Levels in Memory Hierarchy Level 1 2 3 4 5 Called Registers Cache Main Disk Network Memory Storage Bandwidth 4,000- 800- 400-2,000 4-32 1-200 (MB/s) 32,000 5,000 Backed by Cache Main Disk Network Tape Memory
  10. 10. JOIN Network and Disk • Integrate the two distinct devices into one: – Pushing up NIC to system bus à make faster devices closer to CPU – Externalizing disk to high-speed networks à make slower devices farer from CPU • System/Storage Area Network (SAN): creating a method of attaching storage to network. – Fibre Channel (FC): ANSI X3T9.3 – InfiniBand Architecture (IBA): HP, IBM, Intel, Microsoft, Sun… – Others: ESCON, SCCI, HIPPI…
  11. 11. Fibre Channel Features • Allowing many well-known existing channels and network protocols to run under the same physical interface and media • High bandwidth (>=100MB/sec) • Flexible topologies • Connectivity over several kilometers. • Support for multiple data rates, media types, and connectors.
  12. 12. Fibre Channel Layers • FC-0: signaling, media specification, receiver/transmitter specification. • FC-1: data encoding, link maintenance. • FC-2: frame format, sequence management, flow control, classes of service, topologies. • FC-3: undefined set of services. • FC-4: mappings for Upper Level Protocols (ULPs).
  13. 13. Fibre Channel Services • Class 1: dedicated connection service. Frame orders are preserved. e.g. audio/video on-demand. • Class 2: connectionless, but guarantees notification of delivery or failure to deliver. e.g. client/server distributed computing. • Class 3: connectionless, unacknowledged delivery. e.g. IP/UDP packets.
  14. 14. InfiniBand Architecture vs. FC • Higher bandwidth (250M~3GB/sec) and more sophisticated architecture than FC. • Higher scalability: thousands of nodes per subnet. (FC -- 127 nodes in arbitrated loop). • Higher flexibility: more complex topologies • More layers and classes of services. • Support IP v.6 and multicast.
  15. 15. IBA Layers • Physical layer: signaling, framing, etc. • Link layer: packet format, flow control, subnet routing, etc. • Network layer: routing between subnets. • Transport layer: message segmentation and reordering. • Upper layer protocols: network management protocols, etc.
  16. 16. IBA Service Types Service Type Connection Acknowledged Transport Oriented Reliable Connection Yes Yes IBA Unreliable Connection Yes Yes IBA Reliable Datagram No Yes IBA Unreliable Datagram No No IBA RAW datagram No No Raw
  17. 17. Lightweight Network Protocols (Trapeze as an example) • Trapeze is built on Myrinet • Lightweight Remote Procedure Call (RPC) – Programmable firmware on NIC – Zero-copy – Message pipelining on DMA • Non-blocking RPC – Natural extension to select() system call. – Set up a hook procedure then return immediately.
  18. 18. Impact on DDBMS? • How to place data? – Range partitioning – Round robin partitioning – Hashing partitioning • How to make relational operators more parallel? – Pipelined parallelism – Partitioned parallelism
  19. 19. Conclusion and Future Work • As networks getting faster and faster, protocol overhead becomes the biggest time consumer. – Hardware solution: Storage Area Networks (FC, IBA) – Software solution: lightweight protocols (Trapeze) • DDBMS needs to revise its assumption, algorithms, and strategies.
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×