The World Leader in Visual Computing
The Rise of the
Monorepo at NVIDIA
or
“If it isn’t checked in,
it doesn’t exist”
FACTS
Founded in 1993
Jen-Hsun Huang is co-founder,
president and CEO
Headquartered in Santa Clara, Calif.
Listed in 1999 on NASDAQ under the
symbol NVDA
Invented the GPU in 1999 and has
shipped more than 1 billion to date
$5.01 billion in revenue in TTM
~9,300 employees worldwide
~7,300 patent assets
PC
GeForce | Quadro
DATA CENTER
Tesla | GRID
MOBILE
Tegra | SHIELD
ENTERPRISE
VIRTUALIZATION
AUTONOMOUS
MACHINES
HPC & CLOUD
SERVICE PROVIDERSGAMING DESIGN
The World Leader in Visual Computing
The Evolution of NVIDIA
PC Gaming
GeForce
Enterprise
Workstation
Quadro
Tablets
Tegra
Auto
Tegra/VCM
Mobile Entertainment
SHIELD
Enterprise VDI
GRID vGPU
Enterprise
Remote Workstation
GRID VGX/VCA
Cloud Gaming
GRID
Enterprise
High Performance Computing (HPC)
CUDA/Tesla
NewComputingDevices
Gaming
Enterprise
2000 2005 2010 2016
GEFORCE: WORLD’S
#1 GAMING PLATFORM
200M GeForce gamers worldwide
Most advanced technology
Amazing experiences & imagery
GAMEWORKS: PUSHING
THE LIMITS OF GAMING
300 NVIDIA visual effects
engineers
Libraries, algorithms, tools for
game developers
Featured in 12 blockbuster titles
in 2015
0
5
10
15
20
25
30
35
PERFORMANCE
Apple TV
(2012)
Roku 3 Fire TV Nexus
Player
Apple TV
(2015)
SHIELD
SHIELD: THE BEST
ANDROID TV BOX
Most powerful smart TV device
A world of apps and content in 4K
Amazing games
GEFORCE NOW: AMAZING
GAMES ANYWHERE
“Netflix of games”
AAA titles delivered at 1080p 60fps
Streamed to SHIELD family of
devices
QUADRO: THE CHOICE
OF PROFESSIONALS
Enables professional designers to
bring their visions to life
90% workstation market share
Since 2009, every film nominated
for “Best Visual Effects” made
with NVIDIA
Multi-Res Shading | VR SLI | Context Priority
Direct Mode | Front Buffer Rendering
VR: A REVOLUTIONARY
VISUAL COMPUTING
EXPERIENCE
Transforming gaming, design,
film, news
Requires powerful GPUs:
Oculus min-spec = enthusiast GPU
GameWorks VR: Software for VR
headset and game developers
BREAKTHOUGHS IN
MEDICAL IMAGING
GPUs are essential in medical
imaging
Power the GE Revolution CT
scanner
High-quality imagery while
reducing radiation by up to 82%
ACCELERATING SCIENCE
Researchers use GPUs to solve
the world’s biggest challenges
Work highlighted in leading
scientific journals
GTC: Annual developer
conference — best come together
to share their work
“The Three Breakthroughs that have Finally
Unleashed AI on the World”
GPUs ● Big data ● Better algorithms
“a bird perched on a branch of a tree”
ACCELERATING
ARTIFICIAL
INTELLIGENCE
GPU-powered machines trained to
recognize images, text, speech
Backbone of next-gen, magical
apps
Adobe, Alibaba, Baidu, Facebook,
Flickr Yahoo!, Google, Microsoft
PHYSICALLY BASED
RENDERING
Simulating light and materials to
mirror real-world conditions
Potential to eliminate the need
for physical prototypes
NVIDIA Iray and DesignWorks
software bringing PBR to millions
GRID: VIRTUALIZED
GRAPHICS IN THE
DATACENTER
Big data, global collaboration,
mobility, security fueling
enterprise virtualization
GRID enables any app to be
virtualized on any device
All major server and virtualization
companies offer GRID-enabled
products
MOST ENERGY-EFFICIENT,
PROGRAMMABLE,
PERVASIVE ACCELERATOR
Tesla platform powers top
supercomputers in U.S., Europe,
Japan; Next-gen supercomputers
for U.S. Dept. of Energy
CUDA programming model is
accessible, easy to program
A SUPERCOMPUTER FOR
AUTONOMOUS MACHINES
Bringing AI and machine learning to
a world of robots and drones
Jetson TX1 is the first embedded
computer designed to process deep
neural networks
1 TeraFLOPS in a credit-card sized
module
DRIVING INNOVATION
NVIDIA processors power digital
cockpits and infotainment systems
8M cars on the road,
25M more coming by 2020
BY THE NUMBERS: P4 Infrastructure
63 RW (read/write) instances
12 RO (read-only) instances
125 Scratch instances
2 Broker instances
3 Broker mirrors
1 ICM instance (integrates w/ circuit/mask tools)
1 ICM RO instance
17 External instances (proxies of 3rd parties P4)
62 Proxies worldwide and 1k+ ports proxied
81 Physical servers
935 TB used on 21 volumes on 4 filers
TYPICAL P4 SERVER CONFIGURATION
HP DL380 Gen 9 running CentOS 6.x
2 Intel E5-2687v3 w/ 10 cores each at 3.1GHz
256 Gig RAM
2 10Gb NIC (a single dual port card)
1 HP P440/4GB FBWC RAID controller
1 SAS Expander
24 900GB 10k RPM 12G SAS 2.5” HDs
9TB Usable DAS from 22 drive RAID 10
BY THE NUMBERS: P4 Usage
8k Users (many not in Engineering)
933.3M Managed files
2.1B Revisions (2.3 revisions per file)
159 Different types of files stored
88.5M Transactions per day (average)
97.9k p4 submit operations per day (average)
47.5k Committed changes per day (average)
11M p4 sync operations per day (average)
751k “open” (add/edit/etc.) ops per day (average)
496k p4 edit operations per day (average)
117 Different p4 commands used
42.5%
33.6%
7.2%
4.3%
2.7%
2.5%
2.3%
HW Engineering
SW Engineering
Operations
CECTID
Marketing
Sales
Background accts
HPC
Research
Legal
Finance
Misc
ROLES OF OUR 8K P4 USERS
BY THE NUMBERS: P4 file types
46.6%
11.6%
11.0%
10.2%
4.2%
3.3%
2.7%
2.4%
2.2%
text
binary
text+CS
ubinary
binary+Fl
ktext
xtext
text+ko
ctext
xbinary
symlink
text+Cko
text+Ck
text+kox
text+km
binary+l
kxtext
less than 1%
31.4%
22.4%
12.1%
5.8%
4.7%
3.4%
2.4%
2.3%
1.7%
1.7%
describe
filelog
sync
fstat
info
changes
client
revert
print
have
where
opened
group
user
key
edit
monitor
rmt-Journal
sizes
review
job
jobs
fixes
change
users
files
dirs
login
counter
add
integrate
resolve
unlock
groups
reviews
BY THE NUMBERS: P4 commands
Typical Perforce instance setup
p4misc
p4misc
failover
p4misc
checkpoint
metadata replication
metadata replication
user cmds
Server complex for hw team
p4hw
p4hw
failover
p4hw
checkpoint
user cmds
p4hw-ro
p4hw-ro
failover
p4hw-ro
checkpoint
user cmds
p4hw-pse
p4hw-pse
failover
p4hw-pse
checkpoint
user cmds
p4hw-broker
mirror1
p4hw-broker
mirror2
user cmds
p4hw-broker
Server complex for sw team
p4sw p4sw
checkpoint
user cmds
p4sw-ro
p4sw-analysis
p4sw
p4sw
failover
user cmds
p4sw-ro
failover
p4sw-ro
checkpoint
user cmds
p4sw-dvs
p4sw-dvs
failover
p4sw-dvs
checkpoint
p4sw-broker
mirror
user cmds
p4sw-analysis
p4sw-analysis-02
p4sw-analysis-03
p4sw-analysis-04
p4sw-analysis-05
user cmds
user cmds
user cmds
user cmds
user cmds
user cmds
p4sw-dvs-02
p4sw-dvs-02
failover
p4sw-dvs-02
checkpoint
user cmds
p4sw-buildbrain
p4sw-buildbrain
failover
p4sw-buildbrain
checkpoint
user cmds
p4sw-as2
p4sw-as2
failover
p4sw-as2
checkpoint
user cmds
p4sw-broker
Tools to manage Perforce
• P4NV – our CMDB
• Ansible
• Server provisioning scripts
• Elaborate stop/start and rotation scripts
• Shared versioned file storage
• Ease of access from all Perforce servers
• Support HA and DR
• PSE
Chip library design/release
Circuit Design
• Cadence Virtuoso/Composer
• IC Manage GDP
Circuit Release
• Internal verif scripts
• “p4 integrate”
Chip library build
• Continuous
• All models
• Full verification
Chip library release
• Four lib types
• Chip lead does integrate
• Multiple NetApp volumes
• NVIDIA is the world leader in visual computing
• Very complex Perforce environment enables our
engineering team to manage their files/code
• Perforce partners with us to support the complexity of
our growing business
+

The Rise of the Monorepo at NVIDIA 

  • 1.
    The World Leaderin Visual Computing The Rise of the Monorepo at NVIDIA or “If it isn’t checked in, it doesn’t exist”
  • 3.
    FACTS Founded in 1993 Jen-HsunHuang is co-founder, president and CEO Headquartered in Santa Clara, Calif. Listed in 1999 on NASDAQ under the symbol NVDA Invented the GPU in 1999 and has shipped more than 1 billion to date $5.01 billion in revenue in TTM ~9,300 employees worldwide ~7,300 patent assets
  • 4.
    PC GeForce | Quadro DATACENTER Tesla | GRID MOBILE Tegra | SHIELD ENTERPRISE VIRTUALIZATION AUTONOMOUS MACHINES HPC & CLOUD SERVICE PROVIDERSGAMING DESIGN The World Leader in Visual Computing
  • 5.
    The Evolution ofNVIDIA PC Gaming GeForce Enterprise Workstation Quadro Tablets Tegra Auto Tegra/VCM Mobile Entertainment SHIELD Enterprise VDI GRID vGPU Enterprise Remote Workstation GRID VGX/VCA Cloud Gaming GRID Enterprise High Performance Computing (HPC) CUDA/Tesla NewComputingDevices Gaming Enterprise 2000 2005 2010 2016
  • 8.
    GEFORCE: WORLD’S #1 GAMINGPLATFORM 200M GeForce gamers worldwide Most advanced technology Amazing experiences & imagery
  • 9.
    GAMEWORKS: PUSHING THE LIMITSOF GAMING 300 NVIDIA visual effects engineers Libraries, algorithms, tools for game developers Featured in 12 blockbuster titles in 2015
  • 10.
    0 5 10 15 20 25 30 35 PERFORMANCE Apple TV (2012) Roku 3Fire TV Nexus Player Apple TV (2015) SHIELD SHIELD: THE BEST ANDROID TV BOX Most powerful smart TV device A world of apps and content in 4K Amazing games
  • 11.
    GEFORCE NOW: AMAZING GAMESANYWHERE “Netflix of games” AAA titles delivered at 1080p 60fps Streamed to SHIELD family of devices
  • 12.
    QUADRO: THE CHOICE OFPROFESSIONALS Enables professional designers to bring their visions to life 90% workstation market share Since 2009, every film nominated for “Best Visual Effects” made with NVIDIA
  • 14.
    Multi-Res Shading |VR SLI | Context Priority Direct Mode | Front Buffer Rendering VR: A REVOLUTIONARY VISUAL COMPUTING EXPERIENCE Transforming gaming, design, film, news Requires powerful GPUs: Oculus min-spec = enthusiast GPU GameWorks VR: Software for VR headset and game developers
  • 15.
    BREAKTHOUGHS IN MEDICAL IMAGING GPUsare essential in medical imaging Power the GE Revolution CT scanner High-quality imagery while reducing radiation by up to 82%
  • 16.
    ACCELERATING SCIENCE Researchers useGPUs to solve the world’s biggest challenges Work highlighted in leading scientific journals GTC: Annual developer conference — best come together to share their work
  • 17.
    “The Three Breakthroughsthat have Finally Unleashed AI on the World” GPUs ● Big data ● Better algorithms “a bird perched on a branch of a tree” ACCELERATING ARTIFICIAL INTELLIGENCE GPU-powered machines trained to recognize images, text, speech Backbone of next-gen, magical apps Adobe, Alibaba, Baidu, Facebook, Flickr Yahoo!, Google, Microsoft
  • 18.
    PHYSICALLY BASED RENDERING Simulating lightand materials to mirror real-world conditions Potential to eliminate the need for physical prototypes NVIDIA Iray and DesignWorks software bringing PBR to millions
  • 19.
    GRID: VIRTUALIZED GRAPHICS INTHE DATACENTER Big data, global collaboration, mobility, security fueling enterprise virtualization GRID enables any app to be virtualized on any device All major server and virtualization companies offer GRID-enabled products
  • 20.
    MOST ENERGY-EFFICIENT, PROGRAMMABLE, PERVASIVE ACCELERATOR Teslaplatform powers top supercomputers in U.S., Europe, Japan; Next-gen supercomputers for U.S. Dept. of Energy CUDA programming model is accessible, easy to program
  • 21.
    A SUPERCOMPUTER FOR AUTONOMOUSMACHINES Bringing AI and machine learning to a world of robots and drones Jetson TX1 is the first embedded computer designed to process deep neural networks 1 TeraFLOPS in a credit-card sized module
  • 22.
    DRIVING INNOVATION NVIDIA processorspower digital cockpits and infotainment systems 8M cars on the road, 25M more coming by 2020
  • 23.
    BY THE NUMBERS:P4 Infrastructure 63 RW (read/write) instances 12 RO (read-only) instances 125 Scratch instances 2 Broker instances 3 Broker mirrors 1 ICM instance (integrates w/ circuit/mask tools) 1 ICM RO instance 17 External instances (proxies of 3rd parties P4) 62 Proxies worldwide and 1k+ ports proxied 81 Physical servers 935 TB used on 21 volumes on 4 filers
  • 24.
    TYPICAL P4 SERVERCONFIGURATION HP DL380 Gen 9 running CentOS 6.x 2 Intel E5-2687v3 w/ 10 cores each at 3.1GHz 256 Gig RAM 2 10Gb NIC (a single dual port card) 1 HP P440/4GB FBWC RAID controller 1 SAS Expander 24 900GB 10k RPM 12G SAS 2.5” HDs 9TB Usable DAS from 22 drive RAID 10
  • 25.
    BY THE NUMBERS:P4 Usage 8k Users (many not in Engineering) 933.3M Managed files 2.1B Revisions (2.3 revisions per file) 159 Different types of files stored 88.5M Transactions per day (average) 97.9k p4 submit operations per day (average) 47.5k Committed changes per day (average) 11M p4 sync operations per day (average) 751k “open” (add/edit/etc.) ops per day (average) 496k p4 edit operations per day (average) 117 Different p4 commands used
  • 26.
  • 27.
    BY THE NUMBERS:P4 file types 46.6% 11.6% 11.0% 10.2% 4.2% 3.3% 2.7% 2.4% 2.2% text binary text+CS ubinary binary+Fl ktext xtext text+ko ctext xbinary symlink text+Cko text+Ck text+kox text+km binary+l kxtext less than 1%
  • 28.
  • 29.
    Typical Perforce instancesetup p4misc p4misc failover p4misc checkpoint metadata replication metadata replication user cmds
  • 30.
    Server complex forhw team p4hw p4hw failover p4hw checkpoint user cmds p4hw-ro p4hw-ro failover p4hw-ro checkpoint user cmds p4hw-pse p4hw-pse failover p4hw-pse checkpoint user cmds p4hw-broker mirror1 p4hw-broker mirror2 user cmds p4hw-broker
  • 31.
    Server complex forsw team p4sw p4sw checkpoint user cmds p4sw-ro p4sw-analysis p4sw p4sw failover user cmds p4sw-ro failover p4sw-ro checkpoint user cmds p4sw-dvs p4sw-dvs failover p4sw-dvs checkpoint p4sw-broker mirror user cmds p4sw-analysis p4sw-analysis-02 p4sw-analysis-03 p4sw-analysis-04 p4sw-analysis-05 user cmds user cmds user cmds user cmds user cmds user cmds p4sw-dvs-02 p4sw-dvs-02 failover p4sw-dvs-02 checkpoint user cmds p4sw-buildbrain p4sw-buildbrain failover p4sw-buildbrain checkpoint user cmds p4sw-as2 p4sw-as2 failover p4sw-as2 checkpoint user cmds p4sw-broker
  • 32.
    Tools to managePerforce • P4NV – our CMDB • Ansible • Server provisioning scripts • Elaborate stop/start and rotation scripts • Shared versioned file storage • Ease of access from all Perforce servers • Support HA and DR • PSE
  • 33.
    Chip library design/release CircuitDesign • Cadence Virtuoso/Composer • IC Manage GDP Circuit Release • Internal verif scripts • “p4 integrate” Chip library build • Continuous • All models • Full verification Chip library release • Four lib types • Chip lead does integrate • Multiple NetApp volumes
  • 34.
    • NVIDIA isthe world leader in visual computing • Very complex Perforce environment enables our engineering team to manage their files/code • Perforce partners with us to support the complexity of our growing business +

Editor's Notes

  • #3 DougQuist-Maxwell-720p https://www.youtube.com/watch?v=sjiJ_B0yIMw
  • #8 DougQuist-Kite-720p https://www.youtube.com/watch?v=nwuFd5uK_xQ
  • #14 DougQuist-GTC GTC 2016 Keynote Video (link from NVIDIA’s creative team)