Windows Server 2008 R2 Dev Session 02

Windows® Server 2008 R2: Develop With New Parallel Computing Technologies
Clint Edmonson
Architect Evangelist
clinted@microsoft.com

Agenda
The Shift!
Why parallel computing?
The Platform!
The Process!
The Tools!

Moore’s LawOur Old Friend Gordon Moore
From http://www.intel.com/technology/mooreslaw/
“The number of transistors on a chip will double about every 2 years”
Typically manifested as clock-speed increases
We mistakenly associate Moore’s Law with CPU speed

Why Can’t We Continue to Scale Up?Heat!
Increased clock speed == increases power usage
Increased power usage == increased heat output
Image courtesy of http://www.phys.ncku.edu.tw/~htsu/humor/fry_egg.html

Solution: Scale OutMulti-core / Many-core
Multi-core
Two or more independent cores (or CPUs)
Homogenous architecture
May be integrated onto a single integrated circuit die
May be integrated onto multiple dies in a single chip package
Many-core
Number of processors exceeds traditional multi-processor techniques
Heterogeneous architecture
All cores share resource and services like memory and disk access

The Free Lunch is Over

How to Program for Parallel ComputingThe “Many-core Shift”
Platform must manage resources effectively
Programs must be written differently
More than just managing threads
Applications must scale up or down

Agenda
The Platform!
Parallel computing platform
The Process!
The Tools!
The Shift!

Got CPUs? Get R2… Your Apps Will Fly!

Windows Server 2008 R2Platform Hardware Trends
Power Efficiency
Multicore & NUMA
64-bit
Virtualization

Helpful Terminology
Logical processor (a.k.a. thread execution engine)
Core
A processing unit
With hyper-threading, it can consists of 2 or 4 logical processors
Socket(a.k.a. processor, package, CPU)
Physical processor
Consists of one or more cores
NUMA node
Set of logical processors and cache that are close to one another
Group
1 or more NUMA nodes
Set of up to 64 processors

Windows Organizes Many-Cores via GroupNew with Windows 7 and Windows Server 2008 R2
Group
NUMA = Non-Uniform Memory Access
LP = Logical Processor
NUMA Node
Socket
Socket
Core
Core
LP
LP
LP
LP
Core
Core
NUMA Node

Processor GroupsGroups, 4 Nodes, 8 Sockets, 32 Cores, 4 LPs/Core = 128 LPs
Group
Group
NUMA Node
NUMA Node
NUMA Node
NUMA Node
Socket
Socket
Socket
Socket
Socket
Socket
Socket
Socket
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
Core
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP
LP

Windows on 256 Processors
A SQL Server Transaction Processing Workload
video

Agenda
The Process!
Introducing parallelism into your applications
The Tools!
The Shift!
The Platform!

Visual Studio 2010 (.NET Developer)Tools, Programming Models, Runtimes
Tools
Programming Models
Parallel LINQ
(PLINQ)
Task ParallelLibrary
Parallel
Debugger Tool Windows
Data Structures
.NET Parallel Extensions
Parallel
Profiler
Analysis
Task Scheduler
Resource Manager
.NET Runtime
Threads Pools
Managed Library
Tools

Demystifying Parallel Programming
Parallel Extensions Make It Easy
demo

3 Ways to Express Parallelism in Your Apps
Imperative Task Parallelism (fine grained)
Imperative Data Parallelism (structured)
Declarative Data Parallelism (PLINQ)

Imperative Task Parallelism
Fine-grained parallelism
Express potential parallelism via expressions and statements that take the form of lightweight tasks
You have fine-grained control
Semantic is similar to how threads and the threadpool work today

Imperative Data Parallelism
Structured parallelism
Mechanisms used to express common imperative data-oriented operations
For loops
For each loop
Invoke
Think in terms of blocks of code
Parallelize loops

Declarative Data Parallelism
PLINQ
Implementation of LINQ-to-objects that execute queries in parallel
Express what you want to accomplish, rather than how you want to accomplish it
Minimal impact to existing queries

Visual Studio 2010 (C++ Developer)Tools, Programming Models, Runtimes
Tools
Programming Models
Agents
Library
Parallel PatternLibrary
Parallel
Debugger Tool Windows
Data Structures
C++ Concurrency Runtime
Parallel
Profiler
Analysis
Task Scheduler
Resource Manager
Operating System
Threads
Win7/R2: UMS Threads
Native Library
Tools

Agenda
The Tools!
Visual Studio 2010
The Shift!
The Platform!
The Process!

Debugging Parallel ApplicationsNew in Visual Studio®2010
Two new debugger tool windows:
“Parallel Tasks”
“Parallel Stacks”

Demystifying Parallel Programming
Debugging A Parallel Application
demo

Parallel Performance AnalyzerCore Utilization View
Profiling tools support multi-core/parallel execution
Identify parallelism opportunities
Enable performance tuning for parallel apps
Improving the productivity of parallel development and performance tuning
Integrated with the IDE
Providing better visualizations
Showing temporal relationships
Illustrating Interactions with OS, libraries and I/O
Exposing causes of inefficiency
Providing actionable data by linking behavior to source code whenever possible
Analysis Views
Core utilization and concurrency
Thread blocking
Cross-core thread migration
Platforms
Windows Vista ®, Server 2008, and Windows 7
32 and 64-bit
Native and managed environments
Core Utilization / Concurrency
View
Other processes
Number of cores
Idle time
Your process

Parallel Performance AnalyzerThread Blocking View
Measure time for interesting segments
Hide uninteresting threads
Zoom in and out
Detailed thread analysis
(one channel per thread)
Legend
Thread execution
breakdown

Parallel Performance AnalyzerCore Execution / Thread Migration View
Each core in a swim lane
One color per thread
This thread migrates across all four cores
Red indicates cross-core migrations

SummaryCall-to-Action
Start learning to think in parallel
Consider how your solution will scale on multi-core systems
Utilize the parallel programming platform and tools to maximize your application scalability

Learn More About Windows Server 2008 R2
Resources
Microsoft.com
http://www.microsoft.com/windowsserver2008/en/us/R2.aspx
MSDN Concurrency Developer Center
http://msdn.microsoft.com/concurrency
Developer Team Blogs
http://blogs.msdn.com/nativeconcurrency
http://blogs.msdn.com/pfxteam
http://blogs.technet.com/winserverperformance
http://www.danielmoth.com/Blog/labels/ParallelComputing.html

Visual Studio 2010 with MSDNand The Ultimate Offer
Presenter Name Jerry Flynn
Presenter Title Developer Solution Specialist
Microsoft Corporation
presenter Email jerryfl@microsoft.com

© 2009 Microsoft Corporation. All rights reserved.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

http://pullareddy-wargal.blogspot.com	118
http://pullareddy-wargal.blogspot.in	37
http://www.notsotrivial.net	29
http://hosup2.blogspot.com	14
http://hosup2.blogspot.kr	14
http://www.slideshare.net	8
http://pullareddy-wargal.blogspot.com.au	4
http://hosup2.textcube.com	2
http://pullareddy-wargal.blogspot.co.uk	2
http://pullareddy-wargal.blogspot.ca	2
http://hosup2.blogspot.ca	1

Windows Server 2008 R2 Dev Session 02

by Clint Edmonson

Accessibility

Categories

Upload Details

Usage Rights

11 Embeds 231

Statistics

Windows Server 2008 R2 Dev Session 02 Presentation Transcript