Computer Vision Powered by Heterogeneous System Architecture (HSA) by Dr. Ha...AMD Developer Central
Computer Vision Powered by Heterogeneous System Architecture (HSA) by Dr. Harris Gasparakis, AMD, at the Embedded Vision Alliance Summit, May 2014.
Harris Gasparakis, Ph.D., is AMD’s OpenCV manager. In addition to enhancing OpenCV with OpenCL acceleration, he is engaged in AMD’s Computer Vision strategic planning, ISVs, and AMD Ventures engagements, including technical leadership and oversight in the AMD Gesture product line. He holds a Ph.D. in theoretical high energy physics from YITP at SUNYSB. He is credited with enabling real-time volumetric visualization and analysis in Radiology Information Systems (Terarecon), including the first commercially available virtual colonoscopy system (Vital Images). He was responsible for cutting edge medical technology (Biosense Webster, Stereotaxis, Boston Scientific), incorporating image and signal processing with AI and robotic control.
Keynote (Phil Rogers) - The Programmers Guide to Reaching for the Cloud - by ...AMD Developer Central
Keynote presentation, The Programmers Guide to Reaching for the Cloud, by Phil Rogers, AMD Corporate Fellow, AMD, at the AMD Developer Summit (APU13), Nov. 11-13, 2013.
HC-4019, "Exploiting Coarse-grained Parallelism in B+ Tree Searches on an APU...AMD Developer Central
Presentation, HC-4019, "Exploiting Coarse-grained Parallelism in B+ Tree Searches on an APU," by Mayank Daga and Mark Nutter at the AMD Developer Summit (APU13) Nov. 11-13.
HC-4020, Enhancing OpenCL performance in AfterShot Pro with HSA, by Michael W...AMD Developer Central
Presentation Hc-4020, Enhancing OpenCL performance in AfterShot Pro with HSA, by Michael Wootton at the AMD Developer Summit (APU13) November 11-13, 2013.
Computer Vision Powered by Heterogeneous System Architecture (HSA) by Dr. Ha...AMD Developer Central
Computer Vision Powered by Heterogeneous System Architecture (HSA) by Dr. Harris Gasparakis, AMD, at the Embedded Vision Alliance Summit, May 2014.
Harris Gasparakis, Ph.D., is AMD’s OpenCV manager. In addition to enhancing OpenCV with OpenCL acceleration, he is engaged in AMD’s Computer Vision strategic planning, ISVs, and AMD Ventures engagements, including technical leadership and oversight in the AMD Gesture product line. He holds a Ph.D. in theoretical high energy physics from YITP at SUNYSB. He is credited with enabling real-time volumetric visualization and analysis in Radiology Information Systems (Terarecon), including the first commercially available virtual colonoscopy system (Vital Images). He was responsible for cutting edge medical technology (Biosense Webster, Stereotaxis, Boston Scientific), incorporating image and signal processing with AI and robotic control.
Keynote (Phil Rogers) - The Programmers Guide to Reaching for the Cloud - by ...AMD Developer Central
Keynote presentation, The Programmers Guide to Reaching for the Cloud, by Phil Rogers, AMD Corporate Fellow, AMD, at the AMD Developer Summit (APU13), Nov. 11-13, 2013.
HC-4019, "Exploiting Coarse-grained Parallelism in B+ Tree Searches on an APU...AMD Developer Central
Presentation, HC-4019, "Exploiting Coarse-grained Parallelism in B+ Tree Searches on an APU," by Mayank Daga and Mark Nutter at the AMD Developer Summit (APU13) Nov. 11-13.
HC-4020, Enhancing OpenCL performance in AfterShot Pro with HSA, by Michael W...AMD Developer Central
Presentation Hc-4020, Enhancing OpenCL performance in AfterShot Pro with HSA, by Michael Wootton at the AMD Developer Summit (APU13) November 11-13, 2013.
CC-4001, Aparapi and HSA: Easing the developer path to APU/GPU accelerated Ja...AMD Developer Central
Presentation CC-4001, Aparapi and HSA: Easing the developer path to APU/GPU accelerated Java applications, by Gary Frost and Vignesh Ravi at the AMD Developer Summit (APU13) Nov. 11-13, 2013.
CC-4006, Deliver Hardware Accelerated Applications Using RemoteFX vGPU with W...AMD Developer Central
Presentation CC-4006, Deliver Hardware Accelerated Applications Using RemoteFX vGPU with Windows Server, by Derrick Isoka at the AMD Developer Summit (APU13) November 11-13, 2013
MM-4092, Optimizing FFMPEG and Handbrake Using OpenCL and Other AMD HW Capabi...AMD Developer Central
Presentation MM-4092, Optimizing FFMPEG and Handbrake Using OpenCL and Other AMD HW Capabilities, by Srikanth Gollapudi at the AMD Developer Summit (APU13) November 11-13, 2013.
AMD is introducing “Seattle,” a 64-bit ARM-based server System-on a –Chip (SoC) built on the same technology that powers billions of today’s most popular mobile devices.
In this video from the HPC User Forum in Tucson, Gregory Stoner from AMD presents: It's Time to ROC.
"With the announcement of the Boltzmann Initiative and the recent releases of ROCK and ROCR, AMD has ushered in a new era of Heterogeneous Computing. The Boltzmann initiative exposes cutting edge compute capabilities and features on targeted AMD/ATI Radeon discrete GPUs through an open source software stack. The Boltzmann stack is comprised of several components based on open standards, but extended so important hardware capabilities are not hidden by the implementation."
Learn more: http://gpuopen.com/getting-started-with-boltzmann-components-platforms-installation/
and
http://hpcuserforum.com
Watch the video presentation: http://wp.me/p3RLHQ-fcJ
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
The Pendulum Swings Back - Understanding Converged and Hyperconverged Integrated Systems, presented Oct 17, 2017 at IBM Systems Technical University, New Orleans LA
CC-4001, Aparapi and HSA: Easing the developer path to APU/GPU accelerated Ja...AMD Developer Central
Presentation CC-4001, Aparapi and HSA: Easing the developer path to APU/GPU accelerated Java applications, by Gary Frost and Vignesh Ravi at the AMD Developer Summit (APU13) Nov. 11-13, 2013.
CC-4006, Deliver Hardware Accelerated Applications Using RemoteFX vGPU with W...AMD Developer Central
Presentation CC-4006, Deliver Hardware Accelerated Applications Using RemoteFX vGPU with Windows Server, by Derrick Isoka at the AMD Developer Summit (APU13) November 11-13, 2013
MM-4092, Optimizing FFMPEG and Handbrake Using OpenCL and Other AMD HW Capabi...AMD Developer Central
Presentation MM-4092, Optimizing FFMPEG and Handbrake Using OpenCL and Other AMD HW Capabilities, by Srikanth Gollapudi at the AMD Developer Summit (APU13) November 11-13, 2013.
AMD is introducing “Seattle,” a 64-bit ARM-based server System-on a –Chip (SoC) built on the same technology that powers billions of today’s most popular mobile devices.
In this video from the HPC User Forum in Tucson, Gregory Stoner from AMD presents: It's Time to ROC.
"With the announcement of the Boltzmann Initiative and the recent releases of ROCK and ROCR, AMD has ushered in a new era of Heterogeneous Computing. The Boltzmann initiative exposes cutting edge compute capabilities and features on targeted AMD/ATI Radeon discrete GPUs through an open source software stack. The Boltzmann stack is comprised of several components based on open standards, but extended so important hardware capabilities are not hidden by the implementation."
Learn more: http://gpuopen.com/getting-started-with-boltzmann-components-platforms-installation/
and
http://hpcuserforum.com
Watch the video presentation: http://wp.me/p3RLHQ-fcJ
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
The Pendulum Swings Back - Understanding Converged and Hyperconverged Integrated Systems, presented Oct 17, 2017 at IBM Systems Technical University, New Orleans LA
IBM Power9 Servers are here! Launched this week, the AC922 POWER9 servers will form the basis of the world’s fastest “Coral” supercomputers coming to ORNL and LLNL. Built specifically for compute-intensive AI workloads, the new POWER9 systems are capable of improving the training times of deep learning frameworks by nearly 4x allowing enterprises to build more accurate AI applications, faster.
Listen to the Radio Free HPC podcast on Power9: https://insidehpc.com/2017/12/radio-free-hpc-looks-new-power9-titan-v-snapdragon-845/
Learn more: https://www.ibm.com/us-en/marketplace/power-systems-ac922
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
PAS 8 is a high performance scale-out NAS solution designed to support heavy computational workloads for scientific and technical applications, delivering the highest levels of performance, scalability and manageability. Read More.
Panasas ActiveStor 11 and 12: Parallel NAS Appliance for HPC WorkloadsPanasas
Panasas® ActiveStor™ is the world’s fastest parallel storage system, bringing plugand-
play simplicity to large scale storage deployments. Based on a fourth-generation
storage blade architecture and the Panasas® PanFS™ storage operating system,
ActiveStor delivers unmatched parallel file system performance in addition to the
scalability, manageability, reliability, and value required by demanding technical
computing organizations in the bioscience, energy, finance, government, manufacturing
and other research sectors.
The Panasas ActiveStor family of scale-out NAS solutions enable enterprise customers to rapidly solve complex computing problems, speed innovation and bring new products to market faster. The Panasas ActiveStor HC is a multi-petabyte scale-out NAS solution designed for managing massive amounts of data and delivering the highest levels of performance, scalability and manageability. The Panasas ActiveStor HC is an ideal solution for
organizations requiring scalability, cost efficiency, and performance to capture and store huge amounts of data for technical applications. Panasas ActiveStor HC’s efficient design provides nearly one PB of raw capacity in a single floor tile-sized footprint, and capacity can be added without disruption to create vast, multi petabyte storage pools.
DDN: Massively-Scalable Platforms and Solutions Engineered for the Big Data a...inside-BigData.com
In this talk from the DDN User Group at ISC’13, James Coomer from DataDirect Networks presents: Massively-Scalable Platforms and Solutions Engineered for the Big Data and Cloud Era.
Watch the presentation here: http://insidehpc.com/2013/06/26/video-james-coomer-keynotes-ddn-user-group-at-isc13/
Optimizing the Upstreaming Workflow: Flexibly Scale Storage for Seismic Proce...Avere Systems
Of all the applications in the oil and gas industry's upstream workflow, those involved in seismic processing place the greatest demand on storage. Pre-stack and post-stack migration, velocity modeling, and other processing steps are challenging even the highest performance NAS systems. In this Webinar, we discuss meeting these demands with accelerated performance, reduced cost, and a streamlined workflow.
Vulkan and DirectX12 share many common concepts, but differ vastly from the APIs most game developers are used to. As a result, developing for DX12 or Vulkan requires a new approach to graphics programming and in many cases a redesign of the Game Engine. This lecture will teach the basic concepts common to Vulkan and DX12 and help developers overcome the main problems that often appear when switching to one of the new APIs. It will explain how those new concepts will help games utilize the hardware more efficiently and discuss best practices for game engine development.
For more, visit http://developer.amd.com/
AMD’s math libraries can support a range of programmers from hobbyists to ninja programmers. Kent Knox from AMD’s library team introduces you to OpenCL libraries for linear algebra, FFT, and BLAS, and shows you how to leverage the speed of OpenCL through the use of these libraries.
Review the material presented in the AMD Math libraries webinar in this deck.
For more:
Visit the AMD Developer Forums:http://devgurus.amd.com/welcome
Watch the replay: www.youtube.com/user/AMDDevCentral
Follow us on Twitter: https://twitter.com/AMDDevCentral
This is the slide deck from the popular "Introduction to Node.js" webinar with AMD and DevelopIntelligence, presented by Joshua McNeese. Watch our AMD Developer Central YouTube channel for the replay at https://www.youtube.com/user/AMDDevCentral.
This presentation accompanies the webinar replay located here: http://bit.ly/1zmvlkL
AMD Media SDK Software Architect Mikhail Mironov shows you how to leverage an AMD platform for multimedia processing using the new Media Software Development Kit. He discusses how to use a new set of C++ interfaces for easy access to AMD hardware blocks, and shows you how to leverage the Media SDK in the development of video conferencing, wireless display, remote desktop, video editing, transcoding, and more.
An Introduction to OpenCL™ Programming with AMD GPUs - AMD & Acceleware WebinarAMD Developer Central
This deck presents highlights from the Introduction to OpenCL™ Programming Webinar presented by Acceleware & AMD on Sept. 17, 2014. Watch a replay of this popular webinar on the AMD Dev Central YouTube channel here: https://www.youtube.com/user/AMDDevCentral or here for the direct link: http://bit.ly/1r3DgfF
Learn more about DirectGMA in this blog post: bit.ly/AMDDirectGMA
AMD has introduced Direct Graphics Memory Access in order to:
‒ Makes a portion of the GPU memory accessible to other devices
‒ Allows devices on the bus to write directly into this area of GPU memory
‒ Allows GPUs to write directly into the memory of remote devices on the bus supporting DirectGMA
‒ Provides a driver interface to allow 3rd party hardware vendors to support data exchange with an AMD GPU using DirectGMA
‒ and more
View the accompanying blog post here: bit.ly/AMDDirectGMA
This Webinar explores a variety of new and updated features in Java 8, and discuss how these changes can positively impact your day-to-day programming.
Watch the video replay here: http://bit.ly/1vStxKN
Your Webinar presenter, Marnie Knue, is an instructor for Develop Intelligence and has taught Sun & Oracle certified Java classes, RedHat JBoss administration, Spring, and Hibernate. Marnie also has spoken at JavaOne.
The Small Batch (and other) solutions in Mantle API, by Guennadi Riguer, Mant...AMD Developer Central
This presentation discusses the Mantle API, what it is, why choose it, and abstraction level, small batch performance and platform efficiency.
Download the presentation from the AMD Developer website here: http://bit.ly/TrEUeC
Inside XBox One by Martin Fuller from the Sweden Game Developers Conference, June 2, 2014, Stockholm, Sweden. View other presentations here: http://bit.ly/TrEUeC
Productive OpenCL Programming An Introduction to OpenCL Libraries with Array...AMD Developer Central
In this webinar presentation, ArrayFire COO Oded Green demonstrates best practices to help you quickly get started with OpenCL™ programming. Learn how to get the best performance from AMD hardware in various programming languages using ArrayFire. Oded discusses the latest advancements in the OpenCL™ ecosystem, including cutting edge OpenCL™ libraries such as clBLAS, clFFT, clMAGMA and ArrayFire. Examples are shown in real code for common application domains.
Watch the webinar here: http://bit.ly/1obT0M2
For more developer resources, visit:
http://arrayfire.com/
http://developer.amd.com/
Follow us on Twitter: https://twitter.com/AMDDevCentral
See info in the slides for more contact information and resource links!
Rendering Battlefield 4 with Mantle by Johan Andersson - AMD at GDC14AMD Developer Central
Johan Andersson will show how the Frostbite 3 game engine is using the low-level graphics API Mantle to deliver significantly improved performance in Battlefield 4 on PC and future games from Electronic Arts in this presentation from the 2014 Game Developers Conference in San Francisco March 17-21. Also view this and other presentations on our developer website at http://developer.amd.com/resources/documentation-articles/conference-presentations/
RapidFire - the Easy Route to low Latency Cloud Gaming Solutions - AMD at GDC14AMD Developer Central
Learn more about how AMD’s RapidFire SDK simplifies the delivery of multi-game streaming from a single GPU while minimizing latency to ensure one of the best cloud gaming experiences in this presentation from the 2014 Game Developers Conference in San Francisco March 17-21. Also view this and other presentations on our developer website at http://developer.amd.com/resources/documentation-articles/conference-presentations/
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
2. BIG
DATA
IS
A
STRATEGIC
DECISION:
CAPEX
AND
OPEX
Devices
2
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
Apps
Cloud
3. HIGHER
PERFORMANCE,
LESS
POWER
AND
SPACE
Hadoop
Technology
Stack
Data
Warehouse
Data
AnalyRcs
Management
Data
Access
Data
Processing
Data
Storage
3
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
4. SEAMICRO
SM15000™
ACCELERATES
APACHE™
HADOOP™
DEPLOYMENTS
! Superior
high
availability
‒ AcRve/standby
NameNode
‒ AcRve/standby
JobTracker
‒ Highly
resilient
fabric
for
inter-‐node
east-‐west
traffic
! Reduced
down
Rme
‒ Remap
or
rezone
disks
to
recover
data
‒ Hot-‐swappable
upgrades
or
component
replacements
! Hardware
redundancy
‒ Power
supplies
‒ Network
I/O
4
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
5. SM15000
OVERVIEW
64
HDDs/SDDs
•
Share
drives
across
all
servers
•
Assign
one
server
to
one
or
more
drives
as
needed
•
In
service
upgrades
as
needed
64
Industry
standard
x86
servers
•
AMD
Opteron™,
Intel
Xeon®,
Atom™
•
Energy
efficient
processor
•
20
Gbps
per
socket,
16X
tradiRonal
servers
960
terabytes
Fabric
Storage
•
Extends
supercompute
fabric
to
external
storage
•
Up
to
3.84
PB
storage
capacity;
up
to
960
3.5”
SAS/
SATA
drives
•
Map
to
any
CPU—same
as
internal
drives
5
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
160
Gbps
Network
I/O
•
Share
network
I/O
across
all
servers
•
Eliminate
TOR
switch
•
Minimize
cabling
•
In
service
upgrades
as
needed
6. SEAMICRO
FREEDOM™
FABRIC
ASIC
PROVIDES
MASSIVE
PERFORMANCE,
REDUCES
POWER
AND
SPACE
B E N E F I T S
Freedom™
SeaMicro
IOVT
TIO
Freedom Supercompute
Fabric
6
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
Eliminates 90% of the components
on a motherboard shrinking
power used, cost and space
Reduces the power used by
any CPU by consolidating and
shutting off unused functionality
Provides massive bandwidth
while eliminating power hungry
top of rack switches
7. FS
4060-‐L
FABRIC
STORAGE
ENCLOSURE
WITH
ZONING
CAPABILITY
! High
density,
power
opRmized
4U
enclosure
with
60
3.5”
drives
! Up
to
16
enclosures
per
SM15000,
960
drives,
and
3.84
PB
storage
capacity
! Redundant
controllers,
ports,
fans,
and
PSUs
! Support
cost
opRmized
24x7
operaRons
SATA
HDD
for
high
density
Big
Data
and
Object
Storage
deployments
! OpRonal
configuraRon
to
logically
parRRon
an
enclosure
into
two
30
3.5”
drive
enclosures
! Balanced
disk
to
core
raRo
(1:1)
for
opRmizing
Hadoop
performance
! Field
configurable
to
provide
utmost
flexibility
to
balance
density
and
performance
7
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
8. FREEDOM
FABRIC
DISAGGREGATES
SERVER
RESOURCES
PROVIDES
FLEXIBILITY
FOR
EXPANSION
AND
INFRASTRUCTURE
OPTIMIZATION
! SM15000
provides
independent
scaling
of
Compute,
Storage,
and
Network
! Centrally
managed
provisioning
of
storage
and
network
resources
to
compute
nodes
enabled
by
CLI
and
API
interfaces
SeaMicro
SM15000
Server
Hadoop
OpRmizaRon
Compute
and
Memory
Pool
CPU
CPU
CPU
CPU
Deploy
CPU
CPU
Fabric
Interconnect
Shared
Storage
Pool
8
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
Network
Pool
Cost
and
Performance
Tune
and
OpWmize
Run
and
Analyze
9. SM15000
FLEXIBLE
STORAGE
ALLOWS
ITERATIVELY
OPTIMIZING
APACHE®
HADOOP™
DEPLOYMENT
! Flexible
shared
storage
with
commodity
hardware
enabled
by
SeaMicro
fabric
technology
! Decoupled
from
Compute
and
Network
to
grow
storage
independently
! IteraRvely
opRmize
Hadoop
disk
to
core
raRo
as
applicaRon
needs
evolve
Captive DAS with Rigid
Storage to Compute Ratio
Flexible scale-out Fabric Storage
up to 5PB
Freedom
Fabric
Traditional
Rackmount
9
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
Intel
/AMD
X86
servers
10. APACHE®
HADOOP™
DEPLOYMENT
ON
THE
SEAMICRO
SM15000™
SM15000
ZooKeeper
HDFS
NameNode
ZooKeeper
MapReduce
JobTracker
MapReduce
JobTracker
Up
to
160
Gb/s
Redundant
NameNode
and
JobTracker
bandwidth
for
data
ingesWon
10
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
DataNode/
TaskTracker
DataNode/
TaskTracker
DataNode/
TaskTracker
DataNode/
TaskTracker
HDFS
NameNode
DataNode/
TaskTracker
DataNode/
TaskTracker
10Gb/s
network
bandwidth/node
DataNode/
TaskTracker
DataNode/
TaskTracker
60
DataNode/
TaskTracker
Nodes
• 8GB/s
storage
bandwidth
• Flexible
storage
capacity
11. SEAMICRO
REFERENCE
ARCHITECTURE
FOR
APACHE®
HADOOP™
! Hadoop
HA
with
NameNode
and
JobTracker
AcRve/Standby
ConfiguraRon
! Up
to
60
DataNode/TaskTracker
nodes,
512
x86
cores,
960
TB
raw
capacity,
10
Gb/s
Internode
bandwidth
and
160
Gb/s
uplink
bandwidth
in
28
RU
and
5.8
kW
SoluWon
Components
•
•
•
•
•
•
Highly
Available
AcRve/Standby
NameNode
Highly
Available
AcRve/Standby
JobTracker
DataNode/TaskTracker
SM15000
Internal
Drives
for
NameNode
and
JobTracker
11
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
•
•
SeaMicro
SM15000
AMD
Opteron
or
Intel
Xeon
(Ivy
Bridge)
CPU
chassis
32
GB
memory
per
node
2
10GbE
Network
cards
8
Storage
Controller
cards
4
FS
4060-‐L
enclosures
with
SAS
zoning
enabled
60
4TB
3.5”
SAS
or
SATA
drives
per
enclosure
Any
Hadoop
distribuRon
(CDH,
HDP,
MapR,
Apache
Hadoop
etc.)
ZooKeeper
for
NameNode
and
JobTracker
HA
12. SM15000
HADOOP
DEPLOYMENT
SoluWon
Components
SM15000
Intel
Xeon
SM15000
AMD
Opteron
Performance
OpRmized
Cost
OpRmized
Racks
<1
<1
Servers
64
64
Cores
256
512
DRAM
2TB
4
TB
240/960
TB
240/960
TB
Cable
Management
0
RU
0
RU
ToR
SwRches
None
None
Downlink
Network
Cables
None
None
60
60
10
Gb/s
10
Gb/s
Uplink
bandwidth
Up
to
160
Gb/s
Up
to
160
Gb/s
Storage
bandwidth
8
GigaBytes/s
8
GigaBytes/s
Use
case
Hard
Drives
Data
Nodes
Bandwidth
per
node
12
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
13. SM15000
–
INDUSTRY’S
ONLY
FLEXIBLE
SYSTEM
FOR
OPTIMIZING
HADOOP
CLUSTERS
Storage
Intensive
Compute
Intensive
Network
Intensive
Compute
Intensive
Storage
Intensive
Map
Reduce
Map
Reduce
Map
HDFS
Input
Up
to
512
x86
cores
with
4TB
DRAM
per
Fabric
Server
in
10RU
13
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
Map
and
Intermediate
Data
Write
Flexible
scale-‐out
storage
with
over
1400
spindles
and
5
Petabytes
of
capacity
Shuffle
Reduce
10
Gpbs
Inter-‐
Node
Bandwidth
per
server
HDFS
Output
160
Gbps
shared
uplink
for
Inter-‐
Rack
traffic
14. SM15000
HADOOP
PERFORMANCE
BETTER
THAN
COMPETITIVE
OFFERINGS
! 77%
less
power
per
node
! 30%
less
power
per
core
! 63%
more
data
sorted
per
second
per
Wat
than
Large
Vendor
Large
Vendor
Terasort
CompleRon
7
min
13
seconds
8
min
33
seconds
Nodes
62
incl.
HA
18
248
216
5800
W
7200
W
MB/s
per
Wat
0.4
0.24
MB/s
per
CPU
core
9.3
9.0
Wats/Node
94
W
400
W
Wats/Core
23
W
33
W
SeaMicro
SM15000
with
64
Nodes
based
on
Intel
Xeon®
(Ivy
Bridge)
1265
L-‐v2
CPU,
32
GB
memory,
and
2
3.5”
3TB
SAS
drives
per
node
CPU
Cores
Power
CompeRRve
soluRon
consists
of
dual
socket
2U
rack-‐
mount
servers
with
Intel
Xeon
E5-‐2667
2.9
GHz
octal
core
CPUs
with
64
GB
memory,
16
disks,
and
4
GbE
network
links
per
node
14
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
Terasort
-‐
Sort
rate
per
Wa`
MB/s
per
Wa`
SM15000
0.4
0.35
0.3
0.25
0.2
0.15
0.1
0.05
0
SM15000
Large
Vendor
15. WAYFAIR.COM:
PERSONALIZED
SHOPPING
EXPERIENCE
FOR
“A
ZILLION
THINGS”
Applica'ons:
Apache®
Hadoop™,
SQL
server,
PHP
! Challenge
‒ Space
and
power
constraints
hindered
availability
of
“shared
nothing”
servers
for
development
‒ Too
costly
in
space
and
power
to
use
tradiRonal
servers
for
the
number
of
servers
required
and
accurately
test
applicaRon
performance
! SoluRon
‒ SeaMicro
SM
high
density
server
‒ 256
Intel®
Xeon®
cores
in
10
RU
system
‒ 64
servers,
1.28
Tbps
SeaMicro
Freedom™
Supercompute
Fabric
! Results
‒ Reduced
development
cycles
and
shortened
Rme
to
market
for
new
products
‒ Increased
producRvity
of
development
engineers
by
providing
abundant
access
to
“shared
nothing”
servers
versus
developing
on
virtualized
server
farms
‒ Eliminated
unnecessary
equipment
such
as
top
of
rack
switches
and
terminal
servers;
simplified
network
and
power
cabling
15
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
“The
SeaMicro
SM
server
is
helping
us
operate
at
a
large
scale
and
fast
pace.
The
key
benefits
are
reduced
operaRng
costs
and
increased
efficiency
for
our
big
data
development
infrastructure.
It
provides
the
highest
density
and
flexibility
while
slashing
energy
consumpRon:
256
Intel
Xeon
cores,
64
hosts.
It
consumes
50
percent
less
power
and
doubled
our
compuRng
capacity...”
Ben
Clark,
Director
of
So@ware
Engineering
16. EHARMONY:
INCREASE
COMPUTING
WHILE
REDUCING
TOTAL
COST
OF
OWNERSHIP
Applica'ons:
Apache®
Hadoop™
! Challenge
‒ Provide
cost
effecRve
compuRng
plaxorm
for
Apache
Hadoop
‒ Reduce
costs
incurred
from
external
cloud
compuRng
! SoluRon
‒ SeaMicro
SM10000-‐64
high
density
server
‒ 512
Intel®
Atom™
cores
in
10
RU
system
! Results
‒ Reduce
TCO
by
more
than
74
percent
‒ Save
thousands
per
month
spent
on
cloud
compuRng
service
‒ URlize
compuRng
resources
7
x
24
16
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
“We
purchased
SeaMicro
servers
and
immediately
reduced
our
operaRng
expenses…The
system
has
been
in
place
for
over
two
years,
and
we
have
had
zero
down
Rme.”
Cormac
Twomey,
Data
Center
Opera'ons
17. AMD
SEAMICRO
PARTNERS
WITH
INDUSTRY
LEADERS
Hadoop
Partner
17
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS
OS/Hypervisor
OpenStack
19. FS
4060-‐L
SAS
ZONING
! SAS
zoning
allows
the
logical
parRRoning
of
FS
4060-‐L
enclosure
into
two
30
disk
enclosures
in
4U
‒ Provides
fully
independent
end
to
end
path
to
all
30
drives
in
each
zone
‒ Up
to
2
S-‐cards
connected
to
a
storage
enclosure
SM15000
S-‐card
SM15000
S-‐card
Zone
1
FS
4060-‐L
Zone
2
FS
4060-‐L
with
SAS
zoning
19
|
RIGHT
SIZING
HADOOP
DEPLOYMENTS