IDT Telecom, a leader in prepaid communication and payment services, used on-premises appliances to back up its data worldwide. Faced with increasing support costs for its appliances and a goal to align its backup environment with its cloud strategy, IDT looked to StorReduce and Amazon Web Services (AWS) for a more cost-effective, efficient, and scalable backup and recovery solution. With StorReduce’s scalable deduplication software, IDT moved its primary backup data to Amazon S3 for faster throughputs and recovery times, saving up to 80 percent in costs. Learn how StorReduce and AWS enabled IDT to replace its on-premises backup appliances with AWS, lower total cost of ownership, and increase data availability.
3. Today’s agenda
An overview of Backup and Recovery on
AWS
StorReduce and AWS
Case Study: IDT Telecom
StorReduce demo
Q&A/Discussion
4. Learning objectives
• How to remove single points of failure by moving primary backup to
AWS with StorReduce.
• Steps to take to gain granular access to critical data to achieve
regulatory compliance.
• How to enable faster backup and recovery than on-premises
appliances and reduce costs.
6. Common storage challenges on premises
High Cost
Building and maintaining on-
premises storage hardware is
expensive
Compliance
Meeting compliance regulations
for facilities is difficult to achieve with
traditional on-premises deployments
Complex and Slow
Logistical overhead limits
deployment time
7. Benefits of AWS for secondary storage
Integrated
Optimize your storage
solutions by integrating
multiple AWS services
Secure
Encrypt data and
tightly control access
Cost-efficient
Allows you to pay only
for what you use
Easy to maintain
No need to
buy or maintain
on-premises hardware
8. Benefits of APN partners
Easy
Configuration
Incremental Backup and
Block Level Backup
Asynchronous
Replication
Highly
Available
Cost-effective Policy-based
Backups
9. Amazon Elastic File
System
File
Amazon Elastic Block
Store
Amazon Elastic Compute
Cloud (Amazon EC2)
Instance Store
Amazon S3/ Amazon S3
Standard-Infrequent
Access (S3 Standard-IA)
Amazon Glacier
Data Transfer
AWS Direct
Connect
AWS
Snowball
ISV
Connectors
Amazon
Kinesis Data
Firehose
Amazon S3
Transfer
Acceleration
AWS
Storage
Gateway
Storage is a platform: AWS storage maturity
ObjectBlock
10. Amazon Virtual
Private Cloud (VPC)
Isolated cloud resources
AWS Web Application
Firewall
Filter malicious web traffic
AWS Shield
DDoS protection
AWS Certificate
Manager
Provision, manage, and
deploy SSL/TSL
certificates
Networking
AWS Key
Management Service
Manage creation and
control of encryption keys
AWS CloudHSM
Hardware-based key
storage
Server-Side
Encryption
Flexible data encryption
options
Encryption
AWS Identity and
Access Management
Manage user access and
encryption keys
SAML Federation
SAML 2.0 support to
allow on-premises identity
integration
AWS Directory
Service
Host and manage
Microsoft Active Directory
Organizations
Manage settings for
multiple accounts
Identity &
Management
AWS Service Catalog
Create and use
standardized products
AWS Config
Track resource inventory
and changes
AWS CloudTrail
Track user activity and
API usage
Amazon CloudWatch
Monitor resources and
applications
Amazon Inspector
Analyze application
security
Compliance
Access a deep set of cloud security tools
Amazon Macie
Discover, classify & protect
data
11. Shared responsibility model
AWS
Responsible for
security OF the cloud
Customer
Responsible for
security IN the cloud
• Customer data
• Platform, applications, identity and access management
• Operating system, network and firewall configuration
• Client-side data encryption and data integrity authentication
• Server-side encryption (file system and/or data)
• Network traffic protection (encryption, integrity, and/or identity)
• Compute
• Storage
• Database
• Networking
• AWS Global Infrastructure
̵ Regions
̵ Availability Zones
̵ Edge Locations
12. AWS and compliance standards
Certifications & Attestations Laws, Regulations and Privacy Alignments & Frameworks
Cloud Computing Compliance Controls
Catalogue (C5)
DE 🇩🇪 CISPE EU 🇪🇺 CIS (Center for Internet Security) 🌐
Cyber Essentials Plus UK 🇬🇧 EU Model Clauses EU 🇪🇺 CJIS (US FBI) US 🇺🇸
DoD SRG US 🇺🇸 FERPA US 🇺🇸 CSA (Cloud Security Alliance) 🌐
FedRAMP US 🇺🇸 GLBA US 🇺🇸 Esquema Nacional de Seguridad ES 🇪🇸
FIPS US 🇺🇸 HIPAA US 🇺🇸 EU-US Privacy Shield EU 🇪🇺
IRAP AU 🇦🇺 HITECH 🌐 FISC JP 🇯🇵
ISO 9001 🌐 IRS 1075 US 🇺🇸 FISMA US 🇺🇸
ISO 27001 🌐 ITAR US 🇺🇸 G-Cloud UK 🇬🇧
ISO 27017 🌐 My Number Act JP 🇯🇵 GxP (US FDA CFR 21 Part 11) US 🇺🇸
ISO 27018 🌐 Data Protection Act – 1988 UK 🇬🇧 ICREA 🌐
MLPS Level 3 CN 🇨🇳 VPAT / Section 508 US 🇺🇸 IT Grundschutz DE 🇩🇪
MTCS SG 🇸🇬 Data Protection Directive EU 🇪🇺 MITA 3.0 (US Medicaid) US 🇺🇸
PCI DSS Level 1 💳 Privacy Act [Australia] AU 🇦🇺 MPAA US 🇺🇸
SEC Rule 17-a-4(f) US 🇺🇸 Privacy Act [New Zealand] NZ 🇳🇿 NIST US 🇺🇸
SOC 1, SOC 2, SOC 3 🌐 PDPA - 2010 [Malaysia] MY 🇲🇾 Uptime Institute Tiers 🌐
PDPA - 2012 [Singapore] SG 🇸🇬 Cloud Security Principles UK 🇬🇧
PIPEDA [Canada] CA 🇨🇦
🌐 = industry or global standard Agencia Española de Protección de
Datos
ES 🇪🇸
15. AWS
StorReduce
StorReduce
Purpose-Built
Backup
Appliances
Tape
Object Clone
Save up to
60% in
costs
StorReduce is a scale-out deduplication software that:
• Uses single namespace to store all backup data in a
single pool, not silos
• Provides replication between clouds and regions
• Offers near-instantaneous, unlimited copies of an
entire data set at petabyte scale, for free
You can:
• Install StorReduce on AWS or on-premises in your
existing backup software to send backups and
archives to AWS
• Remove purpose-built backup appliances and tape
• Use any cloud service on backup data moved to cloud
Gartner Cool Vendor in Storage
Technologies 2018. Access report by
visiting storreduce.com.
16. Use cloud services on backup data moved to cloud
AWS
Extract Metadata
& Data
Dark Data
Intelligence
For short demos on malware protection and more see
http://storreduce.com/use-cases/insight/
Example:
1. Detect malware intrusions globally from your backups
2. Search inside all files for any word or phrase rather than
look through a catalog of backups
3. Run sentiment analysis across all your emails in
backups
Search,
Machine
Learning,
Analytics…
17. How StorReduce works
Amazon S3
Interface
REST API
Admin Interface
Backup
Software
File
System
Gateway
Cloud
Services
Cloud Storage
Amazon S3
Private object stores
Amazon S3
Interface
REST API
StorReduce Server
SSD
Index Data
Raw
Data
Deduplicated
Data
Amazon
S3
client
Amazon
S3 client
Amazon
S3
client
VM, RPM, Docker,
AMI…
On cloud and / or on
premises
On-premises - requires only 0.2% of the volume of data being written to cloud in commodity SSD (Solid State
Drives).
19. Architecture
Object Storage
Applications (Backups, Big Data, Unstructured Data …)
Read / Write at
LAN Speed
10s – 100s Gbit/s
• Single namespace
• Highly available
• Single deduplication pool
with 24/7 throughput
• No buffering
• Commodity hardware
20. Performance
Fifteen-server cluster, scales
to many more clusters to
increase throughput
• Ingest: 750TB per day,
inline deduplication,
sustained at 13.7 GiB/s
• Recovery: sustained at
7.7 GiB/s
• Deduplication ratio: 97%.
21. Backup to cloud: Replace backup appliances and tape
AWS
StorReduce
Backupapplication
Ingest faster
Recover faster
Deduplication ratio = up to 95% reduction
Backup
Appliance
StorReduce
StorReduce + Cloud:
1. No single point of failure
2. No silos
3. Scalable
4. Use cloud services on migrated
backups
StorReduce
Tape
StorReduce
+ AWS services,
Cloning &
Replication
Based on total cost of ownership (TCO) calculations from AWS and
StorReduce,
estimated savings in costs is up to 80%.
22. StorReduce works with major backup applications
• Any backup system with an Amazon S3 interface including:
• Backup systems with a CIFS/ NFS interface, StorReduce is fully tested with
and uses
• Hadoop backups
(NetBackup) (RMAN)
23. TCO: StorReduce + AWS vs. backup appliance
• Data stored in petabytes (logical capacity, before deduplication): 10 PB
• Deduplication ratio: 10:1
• Object storage solution: Amazon S3 Standard-IA
• Existing backup appliance solution: Purpose-built backup appliance
• Requires two appliances for redundancy? Yes
TCO over 5 years
Backup to Amazon S3-IA with StorReduce costs ……………... $1,984,625
Backup to backup appliance cost …………………………………...
$7,200,000
By storing to AWS with StorReduce
vs. using a backup appliance, you save …………………………….
$5,215,375 =
72%
vs.
26. About IDT
• 1,000+ Employees
• US$1B+ Revenue
IDT connects ethnic communities with
their friends & family around the world.
27. IDT hybrid – on-Premises and cloud
HKUSA
UK Brazil Argentina
Tokyo
IDT Data Centers
28. IDT backups (1PB) - Before StorReduce and AWS
Oracle
Exadat
a
VMware
Farms
NetApp Filers Quantum DXi
Deduplication Appliances
Veritas
NetBackup
Oracle
RMAN
29. Business goal: Cost reduction and cloud strategy
• Astronomical maintenance cost of on-premises deduplication
appliances
• On-premise deduplication appliances re-purchased every 4-5
years
• Offsite backups to cloud
• On-premise data set shrinking as workloads move to cloud
30. Why IDT chose StorReduce on AWS
Direct backup using Amazon S3 API
Works with the existing backup applications
Data deduplication
Cost savings
Offsite backups to cloud
31. IDT backups 1PB – Now with StorReduce and
AWS
Oracle
Exadat
a
VMWare
Farms
NetApp Filers
Veritas
NetBacku
p
Oracle
RMAN
StorRedu
ce Cluster
Deduplicate
d
Data
StorReduce
Amazon S3
API
AWS Direct Connect
32. One of the most frequently asked question
What did you do with your
old dedupe appliances?
33.
34. Results using StorReduce and AWS
Quickly scale with fluctuating amounts of data
Optimize utilization of storage capacity with data
deduplication
Lower total cost of ownership by approximately 80
percent
Meet regulatory compliance with segregated
environments for backup data
Infrastructure flexibility to accommodate future
needs
37. Next Steps and Further Information
Learn more about StorReduce on AWS
StorReduce on AWS page: http://storreduce.com/aws-webinar-idt/
Solution brief: http://storreduce.com/webinar/solution-brief/
IDT case study:
http://storreduce.com/downloads/whitepapers/StorReduce_IDT_AWS_Case_Study.
pdf
My Architecture Video:
https://www.youtube.com/watch?time_continue=3&v=9XafOuxxmr0
Free trial of StorReduce on AWS Quick Start:
https://aws.amazon.com/quickstart/architecture/storreduce/
Try AWS for free:
https://aws.amazon.com/free/