Slide 1Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Com...
2Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DAcknowledgements Tha...
3Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DCelebrating a True Mi...
4Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E D SPaSM - Molecular D...
5Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight Image from VP...
6Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E D Paul Woodward’s PPM...
7Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DRoadrunner at a glanc...
8Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DPowerXCell 8i4 GBPowe...
9Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DPowerXCell 8i4 GBPowe...
10Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DInteractive TeraScal...
11Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E D Today LANL relies ...
12Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E D ViewMaster drives ...
13Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DLANL Metropolis Cent...
14Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DLANL Metropolis Cent...
15Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E D World’s largest an...
16Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DMetropolis Center’s ...
17Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DMetropolis Center’s ...
18Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight from Desktop...
19Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DInteractive TeraScal...
20Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DThe Same Viz Archite...
21Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Other Vi...
22Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Legacy V...
23Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DStudying Turbulence ...
24Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DStudying Turbulence ...
25Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Python: ...
26Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Python: ...
27Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Transpar...
28Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Transpar...
29Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Extrusio...
30Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Extrusio...
31Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Measured...
32Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Textures...
33Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DThe DOE ASC Program’...
34Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DThe DOE ASC Program’...
Upcoming SlideShare
Loading in …5
×

Kares cei viz08

4,519 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
4,519
On SlideShare
0
From Embeds
0
Number of Embeds
2,463
Actions
Shares
0
Downloads
14
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Data management with Parallel EnSight: How each EnSight server-process (50 server-processes on 5 viz-node machines with 10 processes per machine) pulls out it’s subset of the data from the large dataset. Each server process performs operations on the data in parallel (iso-surface extraction, clipping, etc.) Each server process sends it’s subset of the data to the SOS (server-of-servers) The SOS stitches the fragments of data from each server together into a whole. It sends the data to the Client. The Client then renders the data in parallel multiple pipes of a 16 pipe SGI. We send rendered images to desktops, multipanel powerwalls, or immersive RAVEs. (we have images of each that we should use to demonstrate that fact). The data, viz nodes, login nodes, etc. are on a machine/part of a machine called “ASCI White” at Livermore. ASCI WAN provides 4 stripes of OC-12 (622 Mb/s per stripe) The B21 or B22 machines should be called an SGI, and are at Los Alamos. We want to mention the sizes of the datasets we’re visualizing: Per time step: 85M cells (26GB) - 468M cells (97GB) Total: 25-30+TB of Viz data, 200+TB total data (~300 time steps) We are successfully visualizing the largest simulations ever computed! And we’re doing it across thousands of miles! Many visualizations were created for last week’s NEDPC meeting for Crestone, Blanca, Antero, V&V teams. All Crestone data left on White (where generated). 200+TB This architecture works for movie creation, as well as for workstations, PowerWalls, and RAVEs.
  • Data management with Parallel EnSight: How each EnSight server-process (50 server-processes on 5 viz-node machines with 10 processes per machine) pulls out it’s subset of the data from the large dataset. Each server process performs operations on the data in parallel (iso-surface extraction, clipping, etc.) Each server process sends it’s subset of the data to the SOS (server-of-servers) The SOS stitches the fragments of data from each server together into a whole. It sends the data to the Client. The Client then renders the data in parallel multiple pipes of a 16 pipe SGI. We send rendered images to desktops, multipanel powerwalls, or immersive RAVEs. (we have images of each that we should use to demonstrate that fact). The data, viz nodes, login nodes, etc. are on a machine/part of a machine called “ASCI White” at Livermore. ASCI WAN provides 4 stripes of OC-12 (622 Mb/s per stripe) The B21 or B22 machines should be called an SGI, and are at Los Alamos. We want to mention the sizes of the datasets we’re visualizing: Per time step: 85M cells (26GB) - 468M cells (97GB) Total: 25-30+TB of Viz data, 200+TB total data (~300 time steps) We are successfully visualizing the largest simulations ever computed! And we’re doing it across thousands of miles! Many visualizations were created for last week’s NEDPC meeting for Crestone, Blanca, Antero, V&V teams. All Crestone data left on White (where generated). 200+TB This architecture works for movie creation, as well as for workstations, PowerWalls, and RAVEs.
  • Data management with Parallel EnSight: How each EnSight server-process (50 server-processes on 5 viz-node machines with 10 processes per machine) pulls out it’s subset of the data from the large dataset. Each server process performs operations on the data in parallel (iso-surface extraction, clipping, etc.) Each server process sends it’s subset of the data to the SOS (server-of-servers) The SOS stitches the fragments of data from each server together into a whole. It sends the data to the Client. The Client then renders the data in parallel multiple pipes of a 16 pipe SGI. We send rendered images to desktops, multipanel powerwalls, or immersive RAVEs. (we have images of each that we should use to demonstrate that fact). The data, viz nodes, login nodes, etc. are on a machine/part of a machine called “ASCI White” at Livermore. ASCI WAN provides 4 stripes of OC-12 (622 Mb/s per stripe) The B21 or B22 machines should be called an SGI, and are at Los Alamos. We want to mention the sizes of the datasets we’re visualizing: Per time step: 85M cells (26GB) - 468M cells (97GB) Total: 25-30+TB of Viz data, 200+TB total data (~300 time steps) We are successfully visualizing the largest simulations ever computed! And we’re doing it across thousands of miles! Many visualizations were created for last week’s NEDPC meeting for Crestone, Blanca, Antero, V&V teams. All Crestone data left on White (where generated). 200+TB This architecture works for movie creation, as well as for workstations, PowerWalls, and RAVEs.
  • Kares cei viz08

    1. 1. Slide 1Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Computing at theEnSight and Computing at thePetascalePetascaleLA-UR-08-05876LA-UR-08-05876Robert J. Kares and Robert K. GreeneRobert J. Kares and Robert K. GreeneApplied Physics (X) DivisionApplied Physics (X) DivisionLos Alamos National LaboratoryLos Alamos National LaboratoryPresented to:Presented to:CEI VIZ’08 ConferenceCEI VIZ’08 ConferenceBaltimore, MDBaltimore, MDSeptember 23-25, 2008September 23-25, 2008
    2. 2. 2Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DAcknowledgements Thanks to my LANL colleague and friend:Robert Greenefor creating most of the visualizations in this presentation. Thanks also to my LANL colleagues:Brian Albright, Will Dearholt, Chris Fryer, Fernando Grinstein, PaulHenning, Jeremy Margulies, Paul Woodward (UMN) and Lin Yinfor their kind permission to use results from their work.
    3. 3. 3Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DCelebrating a True Milestone in Supercomputing ! On May 26, 2008 a joint team of physicists and computerscientists from Los Alamos National Laboratory and IBM achieveda long deamed of goal in supercomputing. At 3:00 AM EST at the IBM assemble plant in Poughkeepsie, NYthe new RoadRunner machine under construction for LANLby IBM demonstrated a sustained performance of:1,026 teraflops/s or 1.026 petaflops/son the standard Top500 LINPACK benchmark. In the weeks that followed several real applications were run onthe full machine that demonstrated some truly amazingperformance numbers.
    4. 4. 4Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E D SPaSM - Molecular Dynamics• Full 17 CU run achieved 361 TF• 26% of theoretical peak (double precision 1.376 PF)• 37 GF per Cell (36% of SPE peak)• Kernel operation achieves 45% of Cell theoretical peak VPIC - Laser-Plasma Interactions• 1.00 Trillion particle run• Aggressive test of full 17 CU system• Achieved sustained performance of >374.25 TF— 11% of theoretical max performance (single precision 3.0 PF)• Cell processes used 42.8 TB RAM (93.8% of available Cell memory)— Opteron processes used 7.3 TB RAMSustained Petascale Performance from Real ApplicationsImage courtesy of Lin Yin, LANL
    5. 5. 5Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight Image from VPIC Laser-Plasma Interaction ProblemImage courtesy of Lin Yin, LANL
    6. 6. 6Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E D Paul Woodward’s PPM Hydro• A single CU test problem with two fluid Rayleigh-Taylor mixing• Ran 20,320 time steps on a 768 X 2176 X 896 gridin about 2 hours of wall clock time• On a single CU (1/17thof the full machine) achieveda sustained performance of 15.1 TF• Paul estimates that he can run a 60 billioncell problem, 115,000 time steps on thefull 17 CU machine in about 34 hours ofwall clock time at a sustained performanceof 200 TFSustained Petascale Performance from Real ApplicationsImage courtesy of Paul Woodward, University of Minnesota
    7. 7. 7Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DRoadrunner at a glance Cluster of 17 Connected Units• 6,120 AMD dual-core Opterons• 12,240 IBM PowerXCell 8i processors• 44.1 Teraflops peak (Opteron)• 1.26 Petaflops peak (Cell eDP)• 1.026 PF sustained Linpack, #1 Top500 InfiniBand 4x DDR fabric• 2-stage fat-tree; all-optical cables• Full bisection BW within each CU— 384 GB/s (bi-directional)• Half bisection BW among CUs— 3.3 TB/s (bi-directional)• Non-disruptive expansion to 24 CUs 98 TB aggregate memory• 49 TB Opteron• 49 TB Cell 204 GB/s sustained File System I/O• 204x2 10G Ethernets to Panasas Fedora Linux (RHEL possible) SDK for Multicore Acceleration• Cell compilers, libraries and tools xCAT Cluster Management• System-wide GigEnet network 2.35 MW Power• 437 MFlop/Watt, #3 on Green500 Size:• 278 racks• 5200 ft2• 55 miles of IB cable• 250 tons
    8. 8. 8Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DPowerXCell 8i4 GBPowerXCell 8i4 GBRoadrunner is a cluster-of-clusters of “Triblade” nodesPowerXCell 8i4 GBPowerXCell 8i4 GBOpteron x28 GBOpteron x28 GBInfiniBand 4x DDR2 GB/s, 2µs2 PCI-E x8 links, 2GB/s, 2µs eachTriblade schematicA “connected unit” is180 Triblades on afirst level InfiniBandswitch
    9. 9. 9Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DPowerXCell 8i4 GBPowerXCell 8i4 GBThe PowerXCell 8i is a heterogeneous network on achip, and the floating point workhorse of a TribladePowerXCell 8i4 GBPowerXCell 8i4 GBOpteron x28 GBOpteron x28 GB2 GB/s, 2µs2 PCI-E x8 links, 2GB/s, 2µs eachSPELSSPELSSPELSSPELSSPELSSPELSSPELSSPELSEIBPPE4 GBInfiniBand 4x DDR
    10. 10. 10Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DInteractive TeraScale Visualization and Analysis withthe EnSight Server-of-ServersEnSightSOSServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerLocal Network orASC DISCOM WANLANL Los Alamos, NMCompute PlatformLocal/RemoteRoadrunner or LLNL Purple NodesViewMasterViz ClusterEnSightMaster Client264 HP xw8200 nodesnVidia 3400/4500 cards3.2 TB memory35 TB scratch diskDR clientDR clientDR clientDR clientDR clientLANL Data VisualizationCorridor delivers highresolution client images todesktops, PowerWalls and theCAVE at 60 fps with stereoGPFS• Leave the data on the computeplatform.• Run the SOS in distributed mode.• If you have to move the data…you
    11. 11. 11Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E D Today LANL relies primarily on ViewMaster, our 264 node HP Linuxrendering cluster for its large data production visualization needs:– Each of the 264 nodes is an HP xw8200 with dual 64 bit 3.4 GHz Xeons.– 132 of the nodes are display nodes connected to either user desktops orshared facilities, have 16 GB of memory each and an nVidia 4500 or 4500Ggraphics card.– The remaining 134 rendering pool nodes have 8 GB each and an nVidia 3400card for parallel rendering.– ViewMaster has its own 35 TB NetApp filer which is hung off its local GigEswitch and is cross-mounted on all the nodes to provide global disk spacededicated entirely to viz.– All nodes have both a GigE and InfiniBand 4X interconnect:– GigE carries all external and file I/O traffic.– IB carries data for parallel rendering with the EnSight DR client.Petascale Data Requires Big Dedicated Viz Hardware
    12. 12. 12Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E D ViewMaster drives 50 user offices, 3 stereo powerwalls and the five-sidedCAVE in the Metropolis Center for Modeling and Simulation. Each office user has their own dedicated ViewMaster node with a 1920 X1080 stereo display. 34 ViewMaster nodes are dedicated to driving the Metropolis Center’sfive-sided CAVE using nVidia 4500G’s for genlocked stereo. Images are delivered via a high bandwidth, point-to-point, digital fiberoptic distribution system to offices and theaters. And of course EnSight, EnVideo and Reveal run all of these sharedfacilities and provide all the visualization and analysis needs for officeusers.Petascale Data Requires Big Dedicated Viz Hardware
    13. 13. 13Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DLANL Metropolis Center’s Stereo CollaboratoryPowerWalls Two 3840 X 2048 pixel stereopowerwalls. Designed for interactive data explorationwith groups of about a dozen users. Designed to be used by end-users on awalk-in basis. EnSight GUI runs on a separate consolepanel with the stereo display on thepowerwall. So if you can run EnSight your desktop,you can run it on one of these stereowalls. Teach users to run EnSight and they canuse all of our big shared display facilitieswith no extra effort.
    14. 14. 14Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DLANL Metropolis Center’s PowerWall Theater• 7680 X 4096 pixel stereo wall• Full multimedia• Seating for 85• For shared, interactive dataexploration and presentations• EnVideo plays 60 fps in stereo
    15. 15. 15Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E D World’s largest and most complex VR environment:• 33 Christie Digital Mirage 2000 projectors:— 3 X 3 projectors on the front panel.— 3 X 2 projectors on floor and ceiling.— 2 X 3 projectors on left and right side walls.• Rear projection on all five surfaces including boththe floor and ceiling.• VICON Motion Systems tracking system with8 IR cameras viewing the tracked volume.• Uses a unique configuration of IR reflecting balls attached to the user’s stereo glassesand input wand to track the position and orientation of the head and 6D input device. EnSight DR client running on 34 nodes of ViewMaster drives the five-sidedCAVE environment. User controls the environment by selecting items from the EnSight headsup macro (HUM) display with the wand or by pressing buttons on the wandthat are bound to different transformations or user-defined macros.Metropolis Center’s Five-Sided CAVE
    16. 16. 16Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DMetropolis Center’s Five-Sided CAVE
    17. 17. 17Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DMetropolis Center’s Five-Sided CAVE
    18. 18. 18Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight from Desktops to Petaflops EnSight is used by LANL users for visualization and analysis ofeverything from our smaller 2D simulations to our largest 3D herocalculations. EnSight is run on everything from desktop PC’s and Mac’s to our3 TF ViewMaster rendering cluster attached to the five-sided CAVE:• LANL users have only one tool to learn for their visualization and analysis needs.• If you can use EnSight on your desktop, you can use it anywhere. EnSight is interfaced to all of our codes:• This makes code-to-code comparisons and V&V activities easy.• EnSight also reads Silo and Exodus II files so we can compare results from ourcodes with those of other laboratories. EnSight enables highly effective, scalable distance computing:• Leave the data on the compute platform and run EnSight distributed.• Can compare different datasets no matter how large they are orwhere they are located.
    19. 19. 19Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DInteractive TeraScale Visualization and Analysis withthe EnSight Server-of-ServersEnSightSOSServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerServerLocal Network orASC DISCOM WANLANL Los Alamos, NMCompute PlatformLocal/RemoteRoadrunner or LLNL Purple NodesViewMasterViz ClusterEnSightMaster Client264 HP xw8200 nodesnVidia 3400/4500 cards3.2 TB memory35 TB scratch diskDR clientDR clientDR clientDR clientDR clientLANL Data VisualizationCorridor delivers highresolution client images todesktops, PowerWalls and theCAVE at 60 fps with stereoGPFS• Leave the data on the computeplatform.• Run the SOS in distributed mode.• If you have to move the data…you
    20. 20. 20Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DThe Same Viz Architecture is Used for Our Smaller 2D ProblemsEnSightServerLocal GigE NetworkLANL Los Alamos, NMLocal Compute PlatformRedtail or TLCC NodesDesktop PCEnSightClientGPFS• Leave the data on the computeplatform.• Run EnSight in distributed mode.
    21. 21. 21Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Other Visualization Efforts at LANL EnSight is the production visualization and analysis tool used by all ofthe ASC users at LANL:• EnSight serves an extremely broad community of LANL users.• Rich set of powerful visualization and analysis features.• Fully scalable, parallel and distributed.• Supports all ASC platform architectures and is interfaced to all the codes.• EnSight is a very well supported, stable, commercial product. Open source packages like VTK and ParaView have their place in theLANL community as research tools for exploring and prototyping newvisualization and analysis techniques:• Exploring uses for the Cell processors on Roadrunner like ray tracing.• Prototyping uses for GPU’s in data analysis. But open source packages are no substitute for a fully supported,stable, commercial software product in a demanding productionenvironment like the one we have at LANL.
    22. 22. 22Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Legacy Viz Tools at LANL We have many legacy visualization tools at LANL. Over time EnSight is replacing all of them with a single powerfulsolution. The timescale to complete this transformation is not limited by anytechnical shortcomings with EnSight or by EnSight’s ease of use. Rather it is limited by users’ reluctance to learn new tools. So why are people changing at all?• Because they see other users doing things with EnSight that they cannot do withlegacy tools.• Using EnSight for their analysis results in a much better understanding of theirsimulation results.
    23. 23. 23Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DStudying Turbulence with EnSight: the Taylor-GreenVortex in 3D The Taylor-Green vortex is one of the simplest systems in which tostudy the generation of small scales and turbulence by 3D vortexstretching:• Evolution from a simple initial vortex flow provides a dynamical model of decayingturbulence.• Used as a test of our continuous adaptive mesh refinement code RAGE. Here we wish to understand the dynamical onset and eventual decay ofthe turbulence by using EnSight to display many diverse quantitiessimultaneously:• Use EnSight to extract a brick of floats containing the 3 velocity components.• Perform 3D FFT’s on the 3 velocity components with a Fortran routine.• Take angular averages over direction in k space to form the power spectrum of thekinetic energy vs |k|.• Convert the power spectrum vs |k| on every timestep to a 1D part.• Animate everything together on the same image to study the dynamical evolutionfrom the initial coherent vortex flow to fully turbulent Kolmogorov flow that decaysaway in late time.
    24. 24. 24Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DStudying Turbulence with EnSight: the Taylor-GreenVortex in 3DSimulation courtesyof F. Grinstein,LANL
    25. 25. 25Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Python: Comparing 3D Simulations of theVetter-Sturtevant Shocktube Experiments The Vetter-Sturtevant shocktube experiments:• Two gases, air and SF6, initially separated by a membrane inside a tube, are mixedby the passage of a strong shock through the interface between them.• Used as a test of our continuous adaptive mesh refinement code RAGE. How can you compare different 3D simulations of these experiments? Use EnSight and Python to perform a dimensional reduction of the 3Dsimulation data:• Use Python script with EnSight to place an integration plane at positions along thetube axis oriented perpendicular to the axis.• At each position EnSight computes the mix parameter by integration over the planeand returns the result to Python.• In this way a 1D plot of the mix parameter vs position is generated at each time.• 3D mix is reduced to a plot of the1D mix parameter vs position that can becompared between simulations over time.• EnSight is used to integrate the mix parameter along the axis and plot the resultover time.• Animate everything together on the same image to study the quantitative evolutionof the shock induced mixing.
    26. 26. 26Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Python: Comparing 3D Simulations of theVetter-Sturtevant Shocktube ExperimentsSimulation courtesy of F. Grinstein, LANL
    27. 27. 27Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Transparency: 3D SPH Simulations ofSupernova 3D SPH Simulation of a Supernova detonation:• 15 Solar mass progenitor star• Symmetric explosion in 3D EnSight uses multiple transparent isosurfaces of density colored bytemperature to display the instabilities in the expanding layers of theexploding star. An interesting alternative to traditional volume rendering methods. The transparency in this animation uses the new depth peeling featureto greatly accelerate the rendering speed. The full 3D structure of the expanding shells are much more readilyapparent in the stereo version of the animation … check it out at thevendor show.
    28. 28. 28Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Transparency: 3D SPH Simulations ofSupernovaSimulation courtesy of C. Fryer, LANL
    29. 29. 29Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Extrusion: 2D Simulations of ExplosivelyFormed Cu Jet Impacting on a Plate 2D simulation of a shaped charge explosively forming apenetrating Cu jet and the impact of the jet on a steel plate:• Material strength parameters were used in both metals.• Used as a test of our continuous adaptive mesh refinement code Nobel. Here we use the new EnSight extrude feature to create a 3D version ofthe 2D axisymmetric problem by rotation about the axis. Different materials are rotated by different amounts to visually separatethem in the animation:• HE is rotated by 180 degrees• CU and Steel by 270 degrees Materials are colored by speed to show the jet formation and its impacton the steel.
    30. 30. 30Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Extrusion: 2D Simulations of ExplosivelyFormed Cu Jet Impacting on a PlateSimulation courtesy of W. Dearholt, LANL
    31. 31. 31Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Measured Data: Geologic Mapping of thePajarito PlateauData courtesy of EES Division, LANL
    32. 32. 32Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DEnSight and Textures: Geologic Mapping of the PajaritoPlateauData courtesy of EES Division, LANL
    33. 33. 33Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DThe DOE ASC Program’s Commitment to EnSightRemains Strong The US Department of Energy’s Advanced Simulation and Computing(ASC) program was established by Congress in 1995 to provide themodeling and simulation capabilities required to maintain the USnuclear stockpile in the absence of nuclear testing. Since the beginning of ASC EnSight has played a central role in boththe LANL and national ASC programs. Since June of 2000, ASC contracts with CEI from both LANL and theASC Tri-Lab have helped to accelerate the development of manyEnSight features designed to address the problems of big data:• EnSight Gold and the EnSight Server-Of-Servers• EnSight DR Distributed Rendering• EnSight support for VR with distributed memory clusters• EnSight support for many advanced analysis features like Python scripting• CEI tools like EnVideo, EnVe and Reveal
    34. 34. 34Operated by Los Alamos National Security, LLC for NNSAU N C L A S S I F I E DU N C L A S S I F I E DThe DOE ASC Program’s Commitment to EnSightRemains Strong In FY08 LANL ASC contracts with CEI have resulted in severaladditional new features that are driving the release of EnSight 9:• Full MPI support for the EnSight SOS• Restructuring of the communication between SOS and the DR client to improveperformance All the benefits of this enormous multi-year development effort areavailable to everyone in the HPC community via the standardcommercial release of EnSight Gold. In the future ASC faces many challenges:• How to utilize the power of multi-core CPU’s for analysis.• How to track the changing landscape of ASC platform architectures and data sizes. ASC will continue to work with CEI to insure that EnSight meets thesechallenges as we move into the petascale future.

    ×