Jul. 7th 2012 OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano
Masashi Imano
SGI OpenFOAM Cloud
Benchmark
1
Jul. 7th 2012 OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano
Test cluster conditions
• Hardware: SGI Altix ICE8200
• CPU: Intel Xeon X5365 3.00GHz 4cores x 2
• Node: 16 nodes
• Memory: 16GB/node (No swap memory)
• Interconnect: InfiniBand DDR
• OS: SUSE LINUX ENTERPRISE SERVER 10.3
• MPI:
✓ SGI MPT (1.2.6)
✓ OpenMPI
(ThirdParty package distributed with OpenFOAM)
2
Jul. 7th 2012 OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano
• OpenFOAM versions: 2.1.x
• MPI:
✓ OpenMPI (Ver. 1.5.3, mpirun options: --mca btl openib,self,sm)
✓ SGI MPT (Ver.1.2.6)
• Benchmark problem
✓ Flow: Lid-driven 2D cavity (tutorials)
✓ Re: 100 (laminar)
✓ solver: icoFoam (piso)
✓ Linear solver: AMG (p), PBiCG (U)
✓ Mesh:
S(500 2,Δt:5x10-5 s), M(1000 2, Δt:10-5 s), L(2000 2, Δt:10-5 s)
x
Ux = 1 m/s
d = 0.1 m
y
Calculation conditions
3
Jul. 7th 2012 OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano
Benchmark results
0
37500
75000
112500
150000
1 2 4 8
127000
140000
80000
15940
10810
21700
60000
37700
Timesteps/Day
Number of Nodes
OpenMPI SGI MPT
Mesh: S (5002= 1/4 Millions)
4
Jul. 7th 2012 OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano
Benchmark results
0
2500
5000
7500
10000
1 2 4 8
8470
9240
5520
3260
4620
6240
4940
317
Timesteps/Day
Number of Nodes
OpenMPI SGI MPT
Mesh: M (10002 =1 Million)
80%up
50%up
5
Jul. 7th 2012 OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano
Benchmark results
0
750
1500
2250
3000
1 2 4 8
2520
1560
510
280
1780
1430
450
260
Timesteps/Day
Number of Nodes
OpenMPI SGI MPT
Mesh: L (20002 =4 Millions)
40%up
6
Jul. 7th 2012 OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano
Any Questions?
7

SGI OpenFOAM Cloud Benchmark, OpenFOAM Study Meeting for beginner@Kansai, 7th Jul. 2012

  • 1.
    Jul. 7th 2012OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano Masashi Imano SGI OpenFOAM Cloud Benchmark 1
  • 2.
    Jul. 7th 2012OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano Test cluster conditions • Hardware: SGI Altix ICE8200 • CPU: Intel Xeon X5365 3.00GHz 4cores x 2 • Node: 16 nodes • Memory: 16GB/node (No swap memory) • Interconnect: InfiniBand DDR • OS: SUSE LINUX ENTERPRISE SERVER 10.3 • MPI: ✓ SGI MPT (1.2.6) ✓ OpenMPI (ThirdParty package distributed with OpenFOAM) 2
  • 3.
    Jul. 7th 2012OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano • OpenFOAM versions: 2.1.x • MPI: ✓ OpenMPI (Ver. 1.5.3, mpirun options: --mca btl openib,self,sm) ✓ SGI MPT (Ver.1.2.6) • Benchmark problem ✓ Flow: Lid-driven 2D cavity (tutorials) ✓ Re: 100 (laminar) ✓ solver: icoFoam (piso) ✓ Linear solver: AMG (p), PBiCG (U) ✓ Mesh: S(500 2,Δt:5x10-5 s), M(1000 2, Δt:10-5 s), L(2000 2, Δt:10-5 s) x Ux = 1 m/s d = 0.1 m y Calculation conditions 3
  • 4.
    Jul. 7th 2012OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano Benchmark results 0 37500 75000 112500 150000 1 2 4 8 127000 140000 80000 15940 10810 21700 60000 37700 Timesteps/Day Number of Nodes OpenMPI SGI MPT Mesh: S (5002= 1/4 Millions) 4
  • 5.
    Jul. 7th 2012OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano Benchmark results 0 2500 5000 7500 10000 1 2 4 8 8470 9240 5520 3260 4620 6240 4940 317 Timesteps/Day Number of Nodes OpenMPI SGI MPT Mesh: M (10002 =1 Million) 80%up 50%up 5
  • 6.
    Jul. 7th 2012OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano Benchmark results 0 750 1500 2250 3000 1 2 4 8 2520 1560 510 280 1780 1430 450 260 Timesteps/Day Number of Nodes OpenMPI SGI MPT Mesh: L (20002 =4 Millions) 40%up 6
  • 7.
    Jul. 7th 2012OpenFOAM Study Meeting for beginner @ Kansai Masashi Imano Any Questions? 7