This was presented at Netapp Insight 2014 on how Amgen migrated 1.5PB storage from legacy End of Life storage to Netap Clustered data ONTAP

1. Customer Case Study: How Amgen Utilizes
NetApp Clustered Data ONTAP and FAS62x0
for Growth and Non-disruptive Operations
Harish Mundre – Principal IS Architect, Amgen Inc.
Richard Stokotelny – Technical Account Manager, NetApp Inc
CR-2-2540
NetApp Proprietary – Limited Use Only

2. Insight 2014 | © 2014 NetApp, Inc. All rights reserved2
 Company background
 Business and technical challenges
 Program overview
 Storage design and architecture overview
 Migration methodologies and strategies
 Project benefits and accomplishments
 Key takeaway and summary
 Q & A
NetApp Proprietary – Limited Use Only
Agenda

3. Insight 2014 | © 2014 NetApp, Inc. All rights reserved3
 Amgen Inc.
− World’s leading independent biotechnology company,
with a mission to serve patients
 Harish Mundre – Principal IS architect
− Designed and architected clustered Data ONTAP solution
for Amgen
 Richard Stokotelny – NetApp Technical Account Manager
NetApp Proprietary – Limited Use Only
Company Background

4. Insight 2014 | © 2014 NetApp, Inc. All rights reserved4
 Meet storage capacity for growing / dynamic business needs
 Zero or minimal downtime for critical applications
 Reduce OpEx year-over-year
 Substantially reduce data center resources
NetApp Proprietary – Limited Use Only
IT Business Challenges

5. Insight 2014 | © 2014 NetApp, Inc. All rights reserved5
 Address storage and backup requirement for large data
 Minimize downtime associated with lifecycle refresh of filers
 Meet performance demand for mission critical applications and
high transactional databases
 High I/O load impacting several critical applications
 Nondisruptive hardware and software maintenance
 Segregation of data
NetApp Proprietary – Limited Use Only
Technical Challenges

6. Insight 2014 | © 2014 NetApp, Inc. All rights reserved6
 Refresh 22 NetApp controllers running 7-Mode to Clustered Data
ONTAP – Part of lifecycle refresh program
 NetApp filers are geographically distributed in North America
and EMEA
 Total allocated storage – 1.2PB
 No like-for-like migration
 Reduce cost by implementing storage tiering
NetApp Proprietary – Limited Use Only
Lifecycle Refresh Program Overview

7. Insight 2014 | © 2014 NetApp, Inc. All rights reserved7
 NetApp Clustered Data ONTAP® (cDOT)
 Flash Pool™ intelligent caching
 MSATA drive shelves for big data
 NetApp QoS
 SnapVault®
 NetApp professional service
NetApp Proprietary – Limited Use Only
NetApp Products, Solutions and Services

8. Insight 2014 | © 2014 NetApp, Inc. All rights reserved8
 Storage virtual machine
 Network
 Storage tier
 QoS
NetApp Proprietary – Limited Use Only
Storage Design and Architecture Overview

9. Insight 2014 | © 2014 NetApp, Inc. All rights reserved9
Storage Virtual Machine
Storage Design and Architecture Overview
NetApp Proprietary – Limited Use Only
 VMware
 Department share
 Application
 SAN
 Oracle Database
− Production
− Test
− Dev
VMware Oracle SAN
Storage Virtual
Machine
C C1 C2 C3A A1 A3
A2
B B1B2B3
Storage Virtual
Machine
Storage Virtual
Machine

10. Insight 2014 | © 2014 NetApp, Inc. All rights reserved10
 Dual port (e0a and e8a) ifgroup with LACP channel
 Ifgroups are tagged to storage VLAN (a0a-103)
 4 Data LIFs per SVM
o LIFS are part of storage failover group
o CIFS – Dynamic Mapping
o NFS – Static Mapping
o SAN – Static Mapping
Logical Networking
Storage Design and Architecture Overview
NetApp Proprietary – Limited Use Only
HA HA
LIF2LIF3LIF4 LIF1
Nondisruptive to hosts and
clients

11. Insight 2014 | © 2014 NetApp, Inc. All rights reserved11
Networking – Port configuration
Storage Design and Architecture Overview
NetApp Proprietary – Limited Use Only
 Management network
– Cluster Network
– Node Network
– Storage Processor
– Admin Network
 Storage Virtual Machine
– Data LIF
 Data Protection
– Snapmirror and Backup

12. Insight 2014 | © 2014 NetApp, Inc. All rights reserved1212
Physical Networking
Storage Design and Architecture Overview
NetApp Proprietary – Limited Use Only
Legend
Management Network Switches
(Device Mgmt. Switches)
Data Serving Switches
SP
e3a
SAN Switches
Cisco MDS 9506 (48-Port)
e0b
e4a
e0i
e0a e0c
SP
X1117AX1117A
e0i
X1117AX1117A
e0d
e0b
e3a
e4a
e0d
e0j
e0j
e0k
e0l
e0k
e0l
e3b
e3b
 Management Network - 1GbE
 Data Network – 10 GbE
 SAN – MDS 9500/9700 Series

13. Insight 2014 | © 2014 NetApp, Inc. All rights reserved13
 Tier 1
− SSD and SAS drives
 Tier 2
− SSD and NL-SAS drives
 Tier 3
− MSATA shelves
Storage Tiering – FlashPools and Volume Move
Storage Design and Architecture Overview
NetApp Proprietary – Limited Use Only
Flash
SAS NL-SAS
Flash
MSATA
Volume Move(s)

14. Insight 2014 | © 2014 NetApp, Inc. All rights reserved14
 Goal
− Meet consistent performance
− Maintain isolated performance.
 Currently enabled to generate performance utilization
of all volumes
 NetApp OCI to generate performance report to isolate
user and tenant workloads impacting each other
 Aware of number of node limitations
Quality of Service
NetApp Proprietary – Limited Use Only

15. Insight 2014 | © 2014 NetApp, Inc. All rights reserved15
 Volume level migrations
− Use 7-Mode Transition Tool (7MTT)
− Use SnapMirror®
 Qtree migrations
− Migration at volume level and delete unwanted Qtrees
at destination
 Directory level migrations
− Secure copy and/or Robo copy
− Migrations at host level
NetApp Proprietary – Limited Use Only
Migration Methodologies and Strategies

16. Insight 2014 | © 2014 NetApp, Inc. All rights reserved16
 Close to 200 items checklist!
− Resources
− Schedule downtime and business approval
− Dependency
 Validate all SnapMirror dependencies
 Local account, vol language, custom scripts
− Develop discovery and migration workbook
− Operational Readiness
− Migration and Roll-back plan
NetApp Proprietary – Limited Use Only
Migration Precheck List

17. Insight 2014 | © 2014 NetApp, Inc. All rights reserved17
 Reduced OpEx and future fiscal years by an average of 56%
 Freed up valuable floor space in crowded data centers
(~21 Cabinets reduction)
 Substantially reduced power requirements in data centers
(~130 KWh and 490K BTUs)
NetApp Proprietary – Limited Use Only
Project Benefits and Accomplishments

18. Insight 2014 | © 2014 NetApp, Inc. All rights reserved18
 Tiered over 750TB of data
− 65% Migrated from SAS to NL-SAS
 Technology refresh
− 22 Out of warranty physical controllers retired
(5+ year old equipment)
− Introduced non-disruptive operations technology
 Oracle and VMware transformed to clustered Data ONTAP
− 31 vfiler migrated
− 1450 Volumes addressed
 Capacity expansion
− 46 Aggrs and 120 volumes over 85% full were remediated
NetApp Proprietary – Limited Use Only
Project Benefits and Accomplishments

19. Insight 2014 | © 2014 NetApp, Inc. All rights reserved19
Summary and
Key Takeaways
NetApp Proprietary – Limited Use Only

20. Insight 2014 | © 2014 NetApp, Inc. All rights reserved20
Key Takeaways
 Crawl, walk and run journey
− Start with POC or run CDOT in production before initiating business
critical application migration from 7 mode systems
 Aware of custom configuration and Replication relationship
 The NetApp® Data ONTAP® 8 storage operating system offers a
unified cluster architecture that scales and adapts to your changing
needs, reducing risk and cost
NetApp Proprietary – Limited Use Only

21. Insight 2014 | © 2014 NetApp, Inc. All rights reserved21
 Technical Reports
− TR-3982: Clustered Data ONTAP 8.2: An Introduction
− TR-4129: Namespaces in Clustered Data ONTAP
− TR-4182: Best Practices for Clustered Data ONTAP Network Configurations
− TR-4067: Clustered Data ONTAP NFS Best Practice and Implementation Guide
− TR-4191: Best Practices Guide for Clustered Data ONTAP 8.2 Windows File Services
− TR-4183: SnapVault Best Practices Guide for Clustered Data ONTAP
− TR-4080: Best Practices for Scalable SAN in Clustered Data ONTAP 8.2
− TR-4070: Flash Pool Design and Implementation Guide
− TR-4015: Snapmirror configuration and Best practices for clustered Data ONTAP
Resources
NetApp Proprietary – Limited Use Only

22. Insight 2014 | © 2014 NetApp, Inc. All rights reserved22
 Insight Sessions
− CR-2-2272 - Hands-On Lab for Migration to Clustered Data ONTAP Using the 7-Mode Transition
− CR-1-1825 - Where to Start If You Want to Transition to Clustered Data ONTAP
− CR-2-3001 - Transitioning Enterprise Applications to Clustered Data ONTAP
− MTE-TR-TT - Meet the Engineer - Transition (TT)
 NetApp Support Links
− Clustered Data ONTAP for 7-Mode Administrators
 https://mysupport.netapp.com/info/web/ECMP1658253.html
Resources
NetApp Proprietary – Limited Use Only

23. Insight 2014 | © 2014 NetApp, Inc. All rights reserved23
Questions?
NetApp Proprietary – Limited Use Only

24. Insight 2014 | © 2014 NetApp, Inc. All rights reserved24 NetApp Proprietary – Limited Use Only

25. Insight 2014 | © 2014 NetApp, Inc. All rights reserved25
Insight 2014
#NTAPinsight
@NetAppInsightUS
NetApp Insight US
@NetApp
Thank You!
Connect with Harish Mundre:
hmundre@amgen.com
www.linkedin.com/in/harishmundre/
@mjharish
Richard Stokotelny
richard5@netapp.com
@rstokotelny
Stop by our social media lounge
at Insight Central

26. Insight 2014 | © 2014 NetApp, Inc. All rights reserved26
Thank You
NetApp Proprietary – Limited Use Only
© 2014 NetApp, Inc. All rights reserved. No portions of this presentation may be reproduced without prior written consent
of NetApp, Inc. Specificationsare subject to change without notice. NetApp and the NetApp logo are registered trademarks
of NetApp, Inc. in the United States and/or other countries. All other brands or products are trademarks or registered
trademarks of their respective holders and should be treated as such.