ARCHITECTURAL CONCEPTS: CHIP MULTITHREADED ERA Marcelo Vitor Moretti Arbore Sun Campus Ambassador [email_address]

Agenda IT Needs Participation Age Sun's Throughput Initiative Technology Overview CoolThread Technology

IT Needs

Participation Age

Sun's Throughput Initiative

Technology Overview

CoolThread Technology

Challenges in the Age of Participation Information Age Virtual Wide use Dynamic IT grow Exponential data grow Manage massive information Process massive information Protect massive information Passive

Information Age

Virtual

Wide use

Dynamic

IT grow

Exponential data grow

Manage massive information

Process massive information

Protect massive information

Passive

Challenges in the Age of Participation Information Age Virtual Wide use Dynamic IT grow Exponential data grow Manage massive information Process massive information Protect massive information Passive Participation Age Globalization Political, cultural, social change Internet Sharing Open Source GPL Ecological responsibility Notion of connectivity is changing Active

Information Age

Virtual

Wide use

Dynamic

IT grow

Exponential data grow

Manage massive information

Process massive information

Protect massive information

Passive

Participation Age

Globalization

Political, cultural, social change

Internet

Sharing

Open Source

GPL

Ecological responsibility

Notion of connectivity is changing

Active

Challenges in the Age of Participation “ What's the next era? The Participation Age, in which an open and competitive network fuels growing opportunities for everyone – not simply to draw data or shift work around the world, but to participate, to create value and independence. If the Information Age was passive, the Participation Age is active. ” Jonathan Schwartz, CEO of Sun, 2005

“ What's the next era? The Participation Age, in which an open and

competitive network fuels growing opportunities for everyone – not

simply to draw data or shift work around the world, but to participate,

to create value and independence. If the Information Age was

passive, the Participation Age is active. ”

Jonathan Schwartz, CEO of Sun, 2005

Challenges in the Age of Participation Networked computers will grown by a factor of 1000: 1M in 2004 to 1B in 2012. Worldwide installed networked devices in 2012: Source: IDC, 2004 ( http://www.sun.com/processors/whitepapers/idc_whitepaper.pdf )‏

Networked computers will grown by a factor of 1000: 1M in 2004 to 1B in 2012.

Worldwide installed networked devices in 2012:

Challenges in the Age of Participation Networked computers will grown by a factor of 1000: 1M in 2004 to 1B in 2012. Worldwide installed networked devices in 2012: Source: IDC, 2004 ( http://www.sun.com/processors/whitepapers/idc_whitepaper.pdf )‏

Networked computers will grown by a factor of 1000: 1M in 2004 to 1B in 2012.

Worldwide installed networked devices in 2012:

Challenges in the Age of Participation Networked computers will grown by a factor of 1000: 1M in 2004 to 1B in 2012. Worldwide installed networked devices in 2012: Source: IDC, 2004 ( http://www.sun.com/processors/whitepapers/idc_whitepaper.pdf )‏

Networked computers will grown by a factor of 1000: 1M in 2004 to 1B in 2012.

Worldwide installed networked devices in 2012:

Grupo de Sistemas Pervasivos e de Alto Desempenho LSI - EPUSP Pervasive Computing Sensor network Wearable computing Intelligent ambients Augmented Reality Context Aware E-textiles Brain computer interfaces High Performance Computing Clusters GRID Hardware reconfigurable computing Processor Architectures Networking Optical Networks Wireless Networks Power Line Data base, Data WareHouse, Data mining Security Intelligent Vehicles and roads http://www.pad.lsi.usp.br

Pervasive Computing

Sensor network

Wearable computing

Intelligent ambients

Augmented Reality

Context Aware

E-textiles

Brain computer interfaces

High Performance Computing

Clusters

GRID

Hardware reconfigurable computing

Processor Architectures

Networking

Optical Networks

Wireless Networks

Power Line

Data base, Data WareHouse, Data mining

Security

Intelligent Vehicles and roads

New levels of performance, capacity and security along with less power, heating and cooling Challenges in the Age of Participation Throughput Computing, Sun, november 2005

New levels of performance, capacity and security along with less power, heating and cooling

Throughput Computing, Sun, november 2005

To overcome this challenges, business must: Increase application throughput along with capacity and performance to address pressing business needs as well as capture new customers and opportunities Challenges in the Age of Participation Throughput Computing, Sun, november 2005 New levels of performance, capacity and security along with less power, heating and cooling

To overcome this challenges, business must:

Increase application throughput along with capacity and performance to address pressing business needs as well as capture new customers and opportunities

Throughput Computing, Sun, november 2005

New levels of performance, capacity and security along with less power, heating and cooling

To overcome this challenges, business must: Increase application throughput along with capacity and performance to address pressing business needs as well as capture new customers and opportunities Reduce power, cooling, and real estate costs both to save money and to enable necessary growth and scalability Challenges in the Age of Participation Throughput Computing, Sun, november 2005 New levels of performance, capacity and security along with less power, heating and cooling

To overcome this challenges, business must:

Increase application throughput along with capacity and performance to address pressing business needs as well as capture new customers and opportunities

Reduce power, cooling, and real estate costs both to save money and to enable necessary growth and scalability

Throughput Computing, Sun, november 2005

New levels of performance, capacity and security along with less power, heating and cooling

To overcome this challenges, business must: Increase application throughput along with capacity and performance to address pressing business needs as well as capture new customers and opportunities Reduce power, cooling, and real estate costs both to save money and to enable necessary growth and scalability Maintain application compatibility and enhance security across the organization to preserve investments and limit risks to the firm and its clientele Challenges in the Age of Participation Throughput Computing, Sun, november 2005 New levels of performance, capacity and security along with less power, heating and cooling

To overcome this challenges, business must:

Increase application throughput along with capacity and performance to address pressing business needs as well as capture new customers and opportunities

Reduce power, cooling, and real estate costs both to save money and to enable necessary growth and scalability

Maintain application compatibility and enhance security across the organization to preserve investments and limit risks to the firm and its clientele

Throughput Computing, Sun, november 2005

New levels of performance, capacity and security along with less power, heating and cooling

Information Technology Traditional processor tactics focus on Instruction-level parallelism: Large caches Superscalar designs Out-of-order execution Very high clock rates Deep pipelines Speculative pre-fetches Throughput Computing, Sun, november 2005

Traditional processor tactics focus on Instruction-level parallelism:

Large caches

Superscalar designs

Out-of-order execution

Very high clock rates

Deep pipelines

Speculative pre-fetches

Throughput Computing, Sun, november 2005

Traditional processor tactics focus on Instruction-level parallelism: Large caches Superscalar designs Out-of-order execution Very high clock rates Deep pipelines Speculative pre-fetches Information Technology Throughput Computing, Sun, november 2005 Complex Power hungry Too much heat Real estate concerns Small relative performance gain

Traditional processor tactics focus on Instruction-level parallelism:

Large caches

Superscalar designs

Out-of-order execution

Very high clock rates

Deep pipelines

Speculative pre-fetches

Throughput Computing, Sun, november 2005

Complex

Power hungry

Too much heat

Real estate concerns

Small relative performance gain

Information Technology Increasing single-threaded processor performance by 100 percent provides only a small relative gain in application performance due to memory latency: Throughput Computing, Sun, november 2005

Increasing single-threaded processor performance by 100 percent provides only a small relative gain in application performance due to memory latency:

Throughput Computing, Sun, november 2005

Sun's Throughput Initiative More work done within the constraints of space, power, cooling, and time. Focus on real workloads. Everything from system design to OS and application technology. Threads. Hardware Multithreading.

More work done within the constraints of space, power, cooling, and time.

Focus on real workloads.

Everything from system design to OS and application technology.

Threads.

Hardware Multithreading.

CoolThreads processor technology Hardware threading: A hypothetical multithreaded processor core switches between a number of active threads, doing useful work even while threads stall to perform memory-related operations Throughput Computing, Sun, november 2005

Hardware threading: A hypothetical multithreaded processor core switches between a number of active threads, doing useful work even while threads stall to perform memory-related operations

Throughput Computing, Sun, november 2005

Chip MultiThreading (CMT): CoolThreads processor technology Throughput Computing, Sun, november 2005

Chip MultiThreading (CMT):

Throughput Computing, Sun, november 2005

CoolThreads processor technology Chip MultiThreading: Better use of processor resources Better throughput Simple pipeline Lower frequency Less heat Less space

Chip MultiThreading:

Better use of processor resources

Better throughput

Simple pipeline

Lower frequency

Less heat

Less space

Hardware UltraSPARC IV+ UltraSPARC T1 UltraSPARC T2 Solaris Extensive threading support Solaris Containers Dynamic Tracing (DTrace) Binary Compatibility Guarantee Multithreaded Environments Multithreaded native applications Multi-process applications Multi-instance applications Java applications Technology Overview Throughput Computing, Sun, november 2005

Hardware

UltraSPARC IV+

UltraSPARC T1

UltraSPARC T2

Solaris

Extensive threading support

Solaris Containers

Dynamic Tracing (DTrace)

Binary Compatibility Guarantee

Multithreaded Environments

Multithreaded native applications

Multi-process applications

Multi-instance applications

Java applications

Throughput Computing, Sun, november 2005

THANK YOU! Marcelo Vitor Moretti Arbore Questions? Sun Campus Ambassador [email_address]

Marcelo Vitor Moretti Arbore