NUMA and scaleup

614 views

Published on

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
614
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
8
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

NUMA and scaleup

  1. 1. NUMA and Scale UpZhongke ChenJuly 2012
  2. 2. SMP VS NUMA (NON-UNIFORM MEMORYARCHITECTURE) SMP NUMA (!=MPP) Technology Education Confidential and Proprietary 2
  3. 3. HOW LINUX HANDLES NUMALinux detects NUMA and deals it differently from SMPDefault Policy: One process is fixed to one node. Confidential and Proprietary 3
  4. 4. SCALE UP PROBLEMWhat happens if one process uses large memory? (larger than the memory in one node) Confidential and Proprietary 4
  5. 5. WHAT HAPPENSOnly memory on one node is used.The system starts to swap heavily. Confidential and Proprietary 5
  6. 6. WORKAROUNDS numactl --interleave=all (inefficient to access remote memory) Confidential and Proprietary 6
  7. 7. TRUE SOLUTIONS 1. Multiple Smaller Processes 2. Control Policy via libnuma API 3. Another workaround: Virtualization Confidential and Proprietary 7
  8. 8. REFERENCE• http://en.wikipedia.org/wiki/Non-Uniform_Memory_Access• http://developer.amd.com/assets/LibNUMA-WP-fv1.pdf• http://www.kernel.org/doc/Documentation/vm/numa_memor y_policy.txt• http://linux.die.net/man/8/numactl• http://linux.die.net/man/3/numa Confidential and Proprietary 8

×