This document discusses IBM's Cloud Object Storage System, which was acquired from Cleversafe. It provides a scalable and cost-effective solution for storing large amounts of unstructured data, such as photos, videos, and research files. The system uses erasure coding to split data into slices and distribute them across commodity hardware for high availability and reliability without proprietary equipment. It can be deployed as software, pre-built appliances, or as a cloud service on IBM SoftLayer infrastructure.
[IBM 김상훈] 오브젝트스토리지 | 늘어만 가는 데이터 저장문제로 골 아프신가요? (자료를 다운로드하시면 고화질로 보실 수 있습니다.)(Joe), Sanghun Kim
안녕하십니까 IBM Korea 김상훈입니다.
폭증하는 데이터 시대, 비정형 데이터의 폭발적 증가로 저장하는데 고민이신가요? 계속 불어만 가는 데이터, 특히나 비정형 데이터에 탁월한 효과를 가진 IBM의 최적의 솔루션을 소개하고자 합니다.
오브젝트 스토리지는 테이프를 이용한 백업, 디스크에 데이터를 저장과 백업을 했던 기존의 방식보다 여러가지 장점을 가지고 있습니다. IBM 오브젝트 스토리지는,
1. 무한확장: 현재 보유한 데이터에서 계속 늘어나는 증가데이터까지 가능하며,
2. 비용절감: 기존 스토리지 대비 최대 70% 절감 가능
3. 운영편의성: 일반 서버 위에 소프트웨어로 구성하는 형태
4. 데이터 보안: 기존 방식보다 월등한 보안성
의 특징을 가집니다. 이메일과 함께 추가 설명이 담긴 링크도 함께 드리오니 확인해보시길 바랍니다.
더 이상 저장, 백업, 아카이브에 골 썩히지 마십시오. 고맙습니다.
- IBM 김상훈 드림
JoeKim@kr.ibm.com
02-3781-7900 (스토리지 연결)
IBM Cloud Object Storage: How it works and typical use casesTony Pearson
This session covers the general concepts of object storage and in particular the IBM Cloud Object Storage offerings. Presented at IBM TechU in Johannesburg, South Africa September 2019
Proactive Threat Detection and Safeguarding of Data for Enhanced Cyber resili...Sandeep Patil
IBM Storages like IBM Spectrum Scale/IBM CLoud Object storage System integrate with leading SIEM like IBM QRadar / SPLUNK for proactive threat detection and Cyber Resiliency
Basic knowledge of Storage technology and complete understanding on DAS, NAS & SAN with advantages and disadvantages. A quick understanding on storage will help you make the best decision in terms of cost and need.
[IBM 김상훈] 오브젝트스토리지 | 늘어만 가는 데이터 저장문제로 골 아프신가요? (자료를 다운로드하시면 고화질로 보실 수 있습니다.)(Joe), Sanghun Kim
안녕하십니까 IBM Korea 김상훈입니다.
폭증하는 데이터 시대, 비정형 데이터의 폭발적 증가로 저장하는데 고민이신가요? 계속 불어만 가는 데이터, 특히나 비정형 데이터에 탁월한 효과를 가진 IBM의 최적의 솔루션을 소개하고자 합니다.
오브젝트 스토리지는 테이프를 이용한 백업, 디스크에 데이터를 저장과 백업을 했던 기존의 방식보다 여러가지 장점을 가지고 있습니다. IBM 오브젝트 스토리지는,
1. 무한확장: 현재 보유한 데이터에서 계속 늘어나는 증가데이터까지 가능하며,
2. 비용절감: 기존 스토리지 대비 최대 70% 절감 가능
3. 운영편의성: 일반 서버 위에 소프트웨어로 구성하는 형태
4. 데이터 보안: 기존 방식보다 월등한 보안성
의 특징을 가집니다. 이메일과 함께 추가 설명이 담긴 링크도 함께 드리오니 확인해보시길 바랍니다.
더 이상 저장, 백업, 아카이브에 골 썩히지 마십시오. 고맙습니다.
- IBM 김상훈 드림
JoeKim@kr.ibm.com
02-3781-7900 (스토리지 연결)
IBM Cloud Object Storage: How it works and typical use casesTony Pearson
This session covers the general concepts of object storage and in particular the IBM Cloud Object Storage offerings. Presented at IBM TechU in Johannesburg, South Africa September 2019
Proactive Threat Detection and Safeguarding of Data for Enhanced Cyber resili...Sandeep Patil
IBM Storages like IBM Spectrum Scale/IBM CLoud Object storage System integrate with leading SIEM like IBM QRadar / SPLUNK for proactive threat detection and Cyber Resiliency
Basic knowledge of Storage technology and complete understanding on DAS, NAS & SAN with advantages and disadvantages. A quick understanding on storage will help you make the best decision in terms of cost and need.
IBM DS8880 and IBM Z - Integrated by DesignStefan Lein
This Presentation shows the strength of the IBM DS8880 Enterprise Storage Platform with special emphasis on the System Z integration capabilities. December 2017
Cloud Storage Comparison: AWS vs Azure vs Google vs IBMRightScale
As public cloud storage services mature, it becomes easier to make apples-to-apples comparisons. We drill down on the latest specs and features for object, block, archival, and file storage across AWS, Azure, Google, and IBM. We also compare prices for a variety of storage scenarios.
High Performance Object Storage in 30 Minutes with Supermicro and MinIORebekah Rodriguez
The Supermicro Cloud DC is the perfect combination of performance, reliability, craftsmanship and flexibility for deploying MinIO object storage. MinIO on the Cloud DC platform outperforms and is more cost-effective than equivalently-sized hardware from other manufacturers. We recently benchmarked a cluster of four Cloud DC servers with NVMe drives and measured an impressive 42.57 GB/s average read (GET) throughput and 24.69 GB/s average write (PUT) throughput. This first class performance demonstrates that MinIO on Supermicro Cloud DC is a compelling solution for object storage intensive workloads such as advanced analytics, AI/ML and other modern, cloud-native applications.
In this webinar, you will learn:
Best use cases and deployment considerations for MinIO object storage
How to design and size a MinIO object storage cluster on Supermicro Cloud DC
How to deploy a distributed MinIO cluster onto a Cloud DC server cluster
Watch the Webinar: https://www.brighttalk.com/webcast/17278/519401
An overview of the Amazon ElastiCache managed service, with examples of how it can be used to increase performance, lower costs and augment other database services and databases to make things faster, easier and less expensive.
Amazon Aurora 는 엔터프라이즈급의 가용성과 성능을 제공합니다. 실제 적용에서 Aurora성능 개선을 위해 무엇을 해야하는지, 그에 따른 모범 사례는 무엇이 있는지 본 세션에서 살펴봅니다. 또한 AWS Lambda 및 Amazon S3 와 같은 AWS의 다양한 서비스와 통합하는 최근 기능들에 대하여 상세하게 살펴보고 한국 고객들이 Aurora를 도입 및 마이그레이션한 사례를 통해 어떻게 마이그레이션에 접근해야 하는지를 살펴봅니다.
연사: 구승모, 아마존 웹서비스 솔루션즈 아키텍트
IBM DS8880 and IBM Z - Integrated by DesignStefan Lein
This Presentation shows the strength of the IBM DS8880 Enterprise Storage Platform with special emphasis on the System Z integration capabilities. December 2017
Cloud Storage Comparison: AWS vs Azure vs Google vs IBMRightScale
As public cloud storage services mature, it becomes easier to make apples-to-apples comparisons. We drill down on the latest specs and features for object, block, archival, and file storage across AWS, Azure, Google, and IBM. We also compare prices for a variety of storage scenarios.
High Performance Object Storage in 30 Minutes with Supermicro and MinIORebekah Rodriguez
The Supermicro Cloud DC is the perfect combination of performance, reliability, craftsmanship and flexibility for deploying MinIO object storage. MinIO on the Cloud DC platform outperforms and is more cost-effective than equivalently-sized hardware from other manufacturers. We recently benchmarked a cluster of four Cloud DC servers with NVMe drives and measured an impressive 42.57 GB/s average read (GET) throughput and 24.69 GB/s average write (PUT) throughput. This first class performance demonstrates that MinIO on Supermicro Cloud DC is a compelling solution for object storage intensive workloads such as advanced analytics, AI/ML and other modern, cloud-native applications.
In this webinar, you will learn:
Best use cases and deployment considerations for MinIO object storage
How to design and size a MinIO object storage cluster on Supermicro Cloud DC
How to deploy a distributed MinIO cluster onto a Cloud DC server cluster
Watch the Webinar: https://www.brighttalk.com/webcast/17278/519401
An overview of the Amazon ElastiCache managed service, with examples of how it can be used to increase performance, lower costs and augment other database services and databases to make things faster, easier and less expensive.
Amazon Aurora 는 엔터프라이즈급의 가용성과 성능을 제공합니다. 실제 적용에서 Aurora성능 개선을 위해 무엇을 해야하는지, 그에 따른 모범 사례는 무엇이 있는지 본 세션에서 살펴봅니다. 또한 AWS Lambda 및 Amazon S3 와 같은 AWS의 다양한 서비스와 통합하는 최근 기능들에 대하여 상세하게 살펴보고 한국 고객들이 Aurora를 도입 및 마이그레이션한 사례를 통해 어떻게 마이그레이션에 접근해야 하는지를 살펴봅니다.
연사: 구승모, 아마존 웹서비스 솔루션즈 아키텍트
Inter connect2016 yss1841-cloud-storage-options-v4Tony Pearson
This session will cover private and public cloud storage options, including flash, disk and tape, to address the different types of cloud storage requirements. It will also explain the use of Active File Management for local space management and global access to files, and support for file-and-sync.
Introduction to both Object Storage generically and SoftLayer's specific Object Storage capabilities. Starts with comparison of Object to Block and File and what it is and is not, moves on to common use cases (Social / Mobile App Storage, Analytic Data Store, Offsite Backup / Archive, and NAS Filer Consolidation), and then to enabling technologies (Storage Gateways, Aspera). Finally, finishes with the Locations, Features, and Pricing, of SoftLayer Object Storage.
Object Storage 1: The Fundamentals of Objects and Object StorageHitachi Vantara
In part 1 of 3, objects and object storage are defined, their key attributes are identified and the most common use cases for object storage are described. Join Jeff Lundberg, senior product marketing manager at Hitachi Data Systems, to learn the fundamentals of object storage and get answers to your questions. View this WebTech to learn: What makes an object. The difference between block, file and object storage. Key attributes and uses of object store solutions. For more information on Object Storage please view our white paper: http://www.hds.com/assets/pdf/hitachi-white-paper-introduction-to-object-storage-and-hcp.pdf
IBM Object Storage and Software Defined Solutions - CleversafeDiego Alberto Tamayo
Digital Content Growth
• Continued growth in graphical content creation
• Multi-device and HD/4K/8K make it even more challenging to store and process data
• Time & location shifting: viewing on individual schedule
• Content life-cycle management provides a balance between cost & performance
while maintaining customer experience
• Meta data availability and access
• Digital disruption with Over The Top (OTT) digital only competitors - new business
models
• OTT viewing will grow from representing 3.4% of TV viewing hours in 2013 to
20.4% by 2017 in NA
• 63% stream on-demand media more than weekly
• Security and data protection are big issues.
• File sharing declines with legal on-demand options
• Connection speeds are increasing making new options possible
IBM Storage for Analytics, Cognitive and CloudTony Pearson
Presentation on Software-Defined Storage, Spectrum Scale for Analytics with Hadoop and Hortonworks, and IBM Cloud Object Storage, presented March 15 in San Juan, Puerto Rico
S de0882 new-generation-tiering-edge2015-v3Tony Pearson
IBM offers a variety of storage optimization technologies that balance performance and cost. This session covers Easy Tier, Storage Analytics, and Spectrum Scale.
IBM Cloud Object Storage System, presented Oct 16, 2017 at IBM Systems Technical University in New Orleans, LA. This covers the object storage from IBM from the acquisition of Cleversafe, formerly known as DSnet product.
IBM introduces a new Cloud-based sizing and design tool called "File and Object Storage Design Engine" studio or FOS-DE. This tool can be used to size IBM Spectrum NAS, IBM Spectrum Scale and IBM Cloud Object Storage opportunities
S ss0885 spectrum-scale-elastic-edge2015-v5Tony Pearson
IBM Spectrum Scale offerings include the Spectrum Scale software that you can deploy on your own choice of hardware, Elastic Storage Server and Storwize V7000 Unified pre-built systems.
In Place Analytics For File and Object DataSandeep Patil
Why would one want to get into this mess ? Would it not be nice to have a storage system that supports unified file and object, has inplace analytics support via Hadoop connectors, performance well, is scalable , has ability to seamlessly tier to other object stores or tape and is software defined. It sounds like a No Brainier !
Software Defined Analytics with File and Object Access Plus Geographically Di...Trishali Nayar
Introduction to Spectrum Scale Active File Management (AFM)
and its use cases. Spectrum Scale Protocols - Unified File & Object Access (UFO) Feature Details
AFM + Object : Unique Wan Caching for Object Store
Object Storage promises many things - unlimited scalability, both in terms of capacity and file count, low cost but highly redundant capacity and excellent connectivity to legacy NAS. But, despite these promises object storage has not caught on in the enterprise like it has in the cloud. It seems like, for the enterprise object storage just isn’t a good fit. The problem is that most object storage system’s starting capacity is too large. And while connectivity to legacy NAS systems is available, seamless integration is not. Can object storage be sized so that it is a better fit for the enterprise?
S cv3179 spectrum-integration-openstack-edge2015-v5Tony Pearson
IBM is a platinum sponsor of OpenStack, and is the #1 ranked vendor of Software Defined Storage. This session explains how its Spectrum Storage family of products support Glance, Cinder, Manila, Swift and Keystone interfaces of OpenStack.
Introduction to types of cloud storage and overview and comparison of the SoftLayer Storage Services. Topics covered include Block and File offerings"Codename: Prime", Consistent Performance, Mass Storage Servers (QuantaStor), and Backup (EVault, R1Soft), Object Storage (OpenStack Swift), CDN, Data Transfer Service, and Aspera.
With AWS you can choose the right storage service for the right use case. Given the myriad of choices, from object storage to block storage, this session will profile details and examples of some of the choices available to you, with details on real world deployments from customers using Amazon Simple Storage Service (Amazon S3), Amazon Elastic Block Store (Amazon EBS), Amazon Glacier and AWS Storage Gateway. In addition, this session will also cover all the new AWS storage features introduced in the last 12 months.
AWS Summit 2014 Melbourne - Breakout 1
Businesses of all sizes are archiving their data to the AWS Cloud in order to reduce costs while taking advantage of highly secure, highly durable, and simple cloud based storage services. With AWS, you pay as you go and you can scale up and down as required. With your data stored in the AWS Cloud, it’s easy to use other Amazon Web Services to take advantage of additional cost savings and benefits. Amazon storage services remove the need for complex and time-consuming capacity planning, ongoing negotiations with multiple hardware and software vendors, specialized training, and maintenance of offsite facilities or transportation of storage media to third party offsite locations. Amazon Web Services now offers a robust set of hybrid storage solutions for customers that currently operate and maintain data centers. Our Next Generation Enterprise Storage strategy has at its heart Amazon S3. This highly scalable, extremely durable storage service combines with a diverse set of Cloud Storage Gateways to provide businesses with a new approach to Enterprise storage.
Presenter: Jeff Putt, Business Development Manager, APAC, Amazon Web Services
Introduction to MariaDB. Covers the history of Structured Query language, MySQL and MariaDB, shows how to install on Windows, Mac or Linux desktop, and practical examples.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
UiPath Test Automation using UiPath Test Suite series, part 5DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024Neo4j
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfPeter Spielvogel
Building better applications for business users with SAP Fiori.
• What is SAP Fiori and why it matters to you
• How a better user experience drives measurable business benefits
• How to get started with SAP Fiori today
• How SAP Fiori elements accelerates application development
• How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities
• How SAP Fiori paves the way for using AI in SAP apps
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Communications Mining Series - Zero to Hero - Session 1DianaGray10
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
2. #ibmedge
Abstract
This session will cover private and
public cloud storage options,
including Flash, Disk and Tape to
address the different types of cloud
storage requirements
The difference between with block, file
and object stores, and where they are
best used for different workloads will be
explained.
1
3. #ibmedge
This week with Tony Pearson
Day Time Topic
Monday
2:30pm
All Flash is Not Created Equal:
Tony Pearson Contrasts IBM FlashSystem and SSD
Grand Garden Arena, Lower Level, MGM Grand - Studio A
Wednesday
11:00am
All Flash is Not Created Equal:
Tony Pearson Contrasts IBM FlashSystem and SSD
Grand Garden Arena, Lower Level, MGM Grand - Studio 2
1:15pm
Tony Pearson Presents
IBM Cloud Object Storage System and Its Applications
MGM Grand - Room 114
2:30pm
The Pendulum Swings Back: Tony Pearson Explains Converged and
Hyperconverged Environments
MGM Grand - Room 113
Thursday
09:00am
Tony Pearson Presents
IBM's Cloud Storage Options
MGM Grand - Room 116
2
4. What is Object Store?
IBM Cloud Object
Storage System
Applications and
Use Cases
Agenda
5. #ibmedge
Clients are facing explosive growth in Unstructured Data,
which is exactly why Object Storage is so critical*Exabytes
0
20
40
60
80
100
120
2009 2010 2011 2012 2013 2014 2015 2016 2017
Unstructured Data
Structured Data
Source: IDC
Unstructured
data growth of
60–80%
per year
creates
Web-scale
storage needs
*1 exabyte = 1,000 petabytes =1 million terabytes = 1 billion gigabytes
Problem - Traditional and Legacy Storage Designed for
Transactional, Not Unstructured Data
4
6. #ibmedge
How is Object Storage Different?
Block and File Storage
• Decide where to put it
– For block, which array/volume/LUN
– For file, which filer/subdirectory
• Remember where it is to get it back
• Read/Write records, append data
• Limits on LUN size, number of files
Object Storage
• Provide data over to the Object storage
– Get “claim stub” reference locator
• Use or share “claim stub” to access data
HTTP, Openstack Swift, S3
• Get/Put/Delete object in its entirety
• Effectively “unlimited” scalability
5
7. #ibmedge
Object Store for Unstructured data
Hot Data
High-IOPS and Low-Latency
All-Flash and Hybrid Flash/Disk
Information Lifecycle Management (ILM)
Structured data / Random-Access
Active logs and traces
Virtual Machines and VDI
Single-Tenancy
Static and Stable data
Backups, Files, Archives
Seismic, Research, Telemetry, HPC
Video, Animation, Body Cams
Photos, Images, CAD/CAM, GIS
Music, Audio
Genomic, Medical Images
Multi-tenancy
Object Store provides a
• Secure
• Reliable
• Scalable
• Cost Effective
Platform For Unstructured data
Object Store
is not designed for
• High IOPS workflows
• Transaction
Processing
• Inherent ILM
6
8. #ibmedge
Volume vs. File vs. Object level access
POSIX
Read record
Write record
Volume
Read block
Write block
SAN
or
LAN
LAN
File
Read record
Write record
LAN
or
WAN
Object
Get, Put,
Delete
NFS, SMB
Read record
Write record
REST
Get, Put
Delete
SAN Zoning,
LUN Masking
•Device
•LUN / Volser
•Block ID
Access
Control
List
(ACL)
Access
Control
List
(ACL)
•Mount point
or Drive Letter
•Path (subdirs)
•File name
•Account
•Container
•Object
SCSI
Reserve
File
Locking
Eventual
Consistency
7
9. #ibmedge
Object Store Hierarchy – Account, Container and Object
Account 1 Account 3Account 2
A1
D4
C3
B2
Photo123 Video789Doc456
Account
• Object store can have one or more accounts
• Each account could have separate administrators
to manage ACLs
• Provides Multi-tenancy, Secure isolation
Container (aka “Bucket”)
• Container can have one or more objects
• Unique Container name within the account
Object
• A string of bits, similar to a file
• Unique identifier within the container
• No sub-containers, “flat namespace”, but can
mimic subdirs with slashes a/b/c
• Unique URI based on account, container and
object id:
Server-URL/Account2/C3/Doc456
8
10. #ibmedge
Object Storage is Simpler for Application Development
POSIX – over 60 commands NFS – over 30 commands
HEAD
• Read metadata
GET
• Read content and
metadata
PUT
• Write content and
metadata
DELETE
• Remove object or
empty container
POST
• Update metadata
Object – 5 commands
SMB – over 80 commands
9
11. #ibmedge
Where Objects can be Stored
Proprietary, specialized
Storage systems
Software Defined, Commodity,
Industry-standard
SAN/LAN
LAN/WAN
Photo123 Video789
Doc456
Object-on-Database
Relational and NoSQL
Key/value stores
Block or File devices
RAID protection
Object-on-File
Account = File System
Container = Fileset
Object = File
Metadata = Attributes
Storage-rich Servers
Multiple copies or
Erasure Coding
Eventually Consistent
OpenStack Swift
Amazon S3
Basic HTTP
10
12. #ibmedge
Data Protection Schemes
Tolerate 1 drive failure Tolerate 2 drive failures Tolerate “M” failures
RAID-1 / RAID-10
K pieces 2 x K slices
RAID-5
K pieces K + 1 slices
2.0X
1.2X
3.0X
1.5X
1.7XTriplication
K pieces 3 x K slices
RAID-6
K pieces K + 2 slices
Erasure Coding
K pieces K+M = N
slices
11
13. What is Object Store?
IBM Cloud Object
Storage System
Applications and
Use Cases
Agenda
14. #ibmedge
Storage Positioning – Filling a Gap
Unified file and
object storage.
Optimized for high
performance, across
flash and disk
Flash 15K
Unified file and object
storage on tape
Information Lifecycle
Management (ILM) across tiers
HighestPerformance
Lowest cost
Tape
IBM was looking to offer easy to
manage, scalable disk-based
object storage for unstructured
data
• Moderate performance
• Moderate cost
10K 7200 rpm
13
15. #ibmedge
IBM acquires Cleversafe, Inc.
IBM Cloud
Object
Storage
System
Object
Store
Over 350 Patents Awarded
Object Storage Leader
2 years in a row
Multiple Exabytes in
Production
Notable Milestones
Acquired by IBM 2015
Software Company
• Founded in 2004 in Chicago
• Shipping product since 2008
Software Defined
Object Storage
• Over 100 people dedicated to
software development
Runs on Industry Standard x86
servers
• Certified platforms to provide
enterprise grade experience,
predictable performance and support
Product Renamed
• IBM Cloud Object Storage System
14
16. #ibmedge
Data Growth at Petabyte (PB) Scale
PB of data
3 to 5x
Data
Protection
RAID, Mirrors,
Replication, Tape
Data Protection
High Availability & Disaster Recovery
Geo-Distribution & Erasure Coding
Infrastructure
Proprietary, specialized
hardware, multiple systems
Operations
More than 1 FTE per PB
Maintenance outages
Infrastructure
Software Defined,
Commodity Hardware,
Single System
Operations
Less than 1 FTE per 6 PB
Single system, Secure
Self-healing
1.7 x
60% Less
Hardware &
Rack space
Traditional
Approach
IBM Cloud
Object Storage
Approach
70%
Lower
TCO
15
17. #ibmedge
IBM Cloud Object Storage System economics beat
legacy NAS storage and Amazon Web Services (AWS)
$8,400
$4,210
$1,613
$1,053
Legacy NAS DR
protected
Legacy NAS single copy
IBM Cloud Object + NAS
gateway
dsNet object protected
IBM Cloud Object
IBM Cloud Object vs NAS
Cost: 80% lower
$0
$2,000,000
$4,000,000
$6,000,000
$8,000,000
$10,000,000
480 TB 960 TB 1920 TB 3840 TB
S3
Cost: 30 to 60% lower
IBM Cloud Object vs AWS S3
IBM Cloud Object
Amazon S3
16
IBM Cloud Object Storage Dedicated
1.7x faster “read” and 9.9x faster “write”
performance than Amazon S3.
--- Frost & Sullivan
18. #ibmedge
dsNet® Manager
• Fault management
• Performance monitoring
• Storage configuration
• Reporting
• Provisioning
Accesser®
• Slices data
• Disperses data
• Retrieves data
• Use Load Balancer
across accesser pools
• Stateless
• No cache
• No metadata
Slicestor®
• Storage for slices
• Single or multi-site
• Capacity based pricing
• Rebuilds slices
Supported on Certified industry standard platforms
Software Defined &
Hardware Aware
Qualified for predictable performance
Faster time to production
Choice of drive technology
Single Pane Management of HW & SW
IBM Cloud Object Storage System – Components
17
19. #ibmedge
IBM Cloud Object Storage System – Terminology
HTTP
Application
Server
dsNet
Manger
Accesser
Slicestor
Storage
Pool
Accesser PoolVault
Load
Balancer
Site A Site B Site C
End user
Global Namespace
Object Store organized in Accounts,
Containers and Objects
IBM Cloud Object Storage System
uses “Vaults”.
Vault = Account / Container
Multiple vaults can share
storage pools
OpenStack Swift
Amazon S3
18
21. #ibmedge
IBM Cloud Object Storage System – Single vs. Multi-Site
Single Site
Better performance,
when site-tolerance
not a factor, better
than traditional
RAID-5 / RAID-6
Two Site / Vault Mirroring
Allows customers to leverage existing two-site
infrastructure. Provides concurrent reads and
writes despite communication disruption
between locations. Local data better than
traditional RAID-5 / RAID-6
Geographically Dispersed
Three to Nine Sites
Consider adding IBM SoftLayer or leverage
existing datacenter locations to provide a broader
distribution of data for higher availability, site-
tolerance and scalability
20
22. #ibmedge
CONTENT
TRANSFORMATION
IBM Cloud software
encrypts, slices and
applies Information
Dispersal Algorithms
otherwise known as
erasure coding
policies to the data.
Data Ingest
Accesser
Software
Storage Nodes
Site 1 Site 2 Site 3
Physical Distribution
Slices are distributed to
separate disks and industry
standard x86 hardware
across geographic locations.
Data Retrieval
Storage Nodes
Reliable Retrieval
An operator defined subset of
slices is needed to retrieve
data bit perfectly in real time.
Site 1 Site 2 Site 3
BENEFITS
The level of
resiliency is fully
customizable
resulting in a
massively reliable
and efficient way to
store data at scale
as opposed to RAID
and replication
techniques.
Accesser
Software
Slicestor
Software
How the IBM Cloud Object Storage System Works
21
23. #ibmedge
Original Data
Encrypted, Erasure
Coded Slices
12
11
10
9
8
7
6
5
4
3
1
2
Slicestor®
Appliances
Accesser® Appliance, Application,
VM, Docker Container or Embedded
Accesser®
$ 7
6
5
4
3
1
2Original object is
encrypted then
cut into pieces
Each slice is written to a
separate storage node. In
this example, the storage
nodes are geographically
dispersed across 3 sites.
Information Dispersal
Algorithm (IDA)
Erasure coding is used
to transform the data
into a customizable
number of slices (7/12
in this example)
Writing Data to IBM Cloud Object Storage System
Site 1 Site 2 Site 3
22
26. #ibmedge
Scalability
Site 1 Site 2 Site 3
S3 Compatible API Openstack Swift
Compatible API
Simple Object API
Slicestor
Software
Accesser
Software
Scalability – Scale performance
and/or capacity at any time with no
downtime to operations
Need more Performance?
Add more Accesser nodes
Need more Capacity?
Add more disks to existing Slicestor
nodes, or add more storage pools
– All pools must have the same
number of nodes
– Difference storage pools can
have different amounts of storage
– All nodes in each storage pool
must have same amount of
storage
Storage
Pool 1
Storage
Pool 2
Storage
Pool 3
25
27. #ibmedge
IBM Cloud Object Storage System –
Software, Pre-Built Systems or Cloud Services
Software
• ClevOS – IBM Cloud Object
Storage System software
packaged with Debian Linux OS
• Software-defined, hardware-
aware model for flexibility of x86
platform choice
• Can be deployed on qualified
vendor hardware
Pre-built Systems
• Fully integrated appliance
models for easy
deployment and support
• On-premises object
storage solution
Cloud Services
• IBM SoftLayer hardware
infrastructure running IBM Cloud
Object Storage System software
• Off-premise offering for
customers that want security and
controlled performance
26
28. #ibmedge
IBM Cloud Object Storage System –
Deployment Options
Infrastructure
Dedicated
(Private)
Public
Local
(Private)
On-premises
Off-premises
Cloud
Infrastructure
Off-premises
(IBM SoftLayer)
Public
• Standard regional
• Nearline regional
• Nearline geo-
dispersed
Consumed
pricing
Dedicated
• IBM Managed
• Client managed
• Hybrid / Mixed
Allocated
pricing
Client
infrastructure
On-premises
(Recommend:
500TB or more)
Locally managed
• Software
• Pre-built systems
27
29. #ibmedge
Pre-Built Systems for IBM Cloud Object Storage System
dsNet Manager 2105 / 3105
Accesser 2100 / 3105 / 4105
Slicestor 2212
Slicestor 2448
Health and performance monitoring
GUI and API access
Configuration and security
Zero downtime upgrades
12 drives @ 4, 6 or 8 TB
48 to 96 TB Nearline HDD
in 2U rack space
16, 32 or 48 drives @ 4, 6 or 8 TB
64 to 384 TB Nearline HDD
in 4U rack space
Slices, Disperses and Retrieves data
28
30. #ibmedge
IBM Cloud Object Storage – SmartWrite and Rebuild
Once write threshold is met, returns
success response to client
• Example: 7/9/12 (7 pieces 12 slices)
• Minimum 7 slices required to read back
• Once 9 slices are written, write is
considered complete for application
• Best effort to write remaining slices
• If time-out occurs, unwritten slices dropped
Entire namespace scanned on ongoing
basis
• Slice integrity check
• Missing slice check
• Slicestors work together to rebuild
missing or corrupted slice(s)
• Rebuilder is “always on” at moderate
rate for I/O rate predictability
Optimistically attempts to write all slices in parallel
X ?
29
31. #ibmedge
7
6
5
4
3
1
2
$
With erasure coding “k” pieces are turned into “n” slices:
Reads can be performed using any k of the n slices
• This example is a “7 of 12” Information Dispersal Algorithm (IDA)
means only 7 slices are needed to reconstruct the original object
With this IDA, a read
can still be executed
with any five storage
nodes being
unavailable out of 12.
With 3 sites,
even an entire
site outage (plus
one additional
storage node
outage) can be
tolerated.
Reading Data from IBM Cloud Object Storage System
Site 1 Site 2 Site 3
30
32. #ibmedge
The Math Behind Reed-Solomon Erasure Coding
“K” variable of input data: a, b, c, d, e
Here we create “K+M”
equations, adding and
subtracting by different
co-factors
Results in “K+M” slices
that can be geographically
dispersed
We can tolerate losing up
to “M” slices of data, and
still solve for the original
“K” pieces of data.
31
33. #ibmedge
IBM Cloud Object Storage System – Access Methods
Data
Site 1 Site 2 Site 3
S3 Compatible API Openstack Swift
Compatible API
Simple Object API
Slicestor
Software
Accesser
Software
DIRECT API ACCESS
The Accesser Software exposes three REST
APIs for ingest and retrieval. Applications with
knowledge of these APIs can leverage IBM
Cloud Object Storage directly.
Site 1 Site 2 Site 3
S3 Compatible API Openstack Swift
Compatible API
Simple Object API
Slicestor
Software
Accesser
Software
NAS (NFS/SMB) Backup/Archive General Applications
PARTNER BASED
A variety of Certified technology partners can leverage IBM’s
multi tenancy support to satisfy concurrent use cases on a
single IBM Cloud Object Storage instance.
Hadoop
32
34. What is Object Store?
IBM Cloud Object
Storage System
Applications and
Use Cases
Agenda
35. #ibmedge
Market Verticals
Secure customer
trust and business
compliance.
Consistently
create engaging
experiences.
Manage the data
essential to serving the
good of the public.
Scale your
market offering
without worry.
Have reliable
storage for your on
demand content.
Active Archive
Content Repository STaaS
Genomics
Collaboration
Enterprise Storage as a
Service (STaaS)
Backup
Financial
Services &
Insurance
Media &
Entertainmen
t
Production
GovernmentService
Providers
Media &
Entertainment
Distribution
Heath Care &
Life Sciences
Put medical
progress before
everything else.
Content
Collaboration
Enterprise Collaboration
34
36. #ibmedge
Client Reference– Web Based Photo Sharing
Users upload photo
and video content via
web based application
Photo and video objects are sent to
Cleversafe via REST based protocols
Metadata is
captured and
stored
• Scale – 130 petabytes and growing: more than 50 Billion images stored
• Manageability – 3 Administrators manage entire environment
• Security – 50,000+ uploads per minute with zero touch security
• Always-on availability – SLA of 100% download on demand – even during
California to Nevada datacenter move
• Economics – Operating costs reduced by more than 70%
• Key decision makers – Technical team backed by financial cost cutting
mandates
35
37. #ibmedge
IBM Cloud Object Storage System – Partner Comparison
Vendor Product Protocols Features Use Cases
Avere
FXT series
• NFS
• SMB
Global namespace
Encryption, Compression, Snapshots,
Clustering
• Analytics
• Media rendering
Ctera Networks
CX0 series
• NFS, SMB
• AFP, FTP
• WebDAV
• iSCSI
Encryption, Snapshots, Replication,
Enterprise File Sync and Share (EFSS)
• Backup
• RO/BO storage
IBM Spectrum Scale • NFS, SMB
• OpenStack
• Amazon S3
• Hadoop
• POSIX
Global namespace & file locking,
Encryption, Snapshots, Compression,
Replication
• Analytics / HPC
• Media rendering
• VMs and Databases
• Collaboration
• NAS Consolidation
• Backup / Archiving
Nasuni NF series • NFS, SMB
• FTP, SFTP
• HTTPS
• iSCSI
Global namespace & file locking,
Encryption, Snapshots, Compression,
Dedupe, EFSS
• Collaboration
• File sharing
• Archiving
Panzura Global File
System
• NFS
• SMB
Global namespace & file locking,
Encryption, Compression, Dedupe
• Collaboration
• NAS consolidation
36
38. #ibmedge
IBM Spectrum Protect supports Cloud Object Storage!
Client nodes
• IBM Cloud Object Storage System
(using S3-compatible API)
Off-premises:
• IBM SoftLayer
On-premises
IBM Spectrum
Protect Server
37
39. #ibmedge
IBM Spectrum Storage and IBM Cloud Object Storage
Unified file and object
storage. Optimized for
high performance, across
flash, disk and object
store
Flash
Object
Store
15K
IBM Cloud Object Storage System
( File, backup and archive interfaces
available through variety of options )
IBM SoftLayer
OpenStack Swift
Amazon Web Services S3
Swift S3 emulation
Unified file and object
storage on tape
Transparent Cloud Tiering
Information Lifecycle
Management (ILM) across tiers
HighestPerformance
Lowest cost
Tape10K 7200 rpm
38
40. #ibmedge
No need for 3rd party
encryption solution or key
management
Not a post process. Data is
fully protected upon write
commit
No need to install and
manage a separate OS
Base price includes all
interfaces
Predict drive failures and
take appropriate action
No need to repurchase
licenses when refreshing
hardware
ENCRYPTION IS INHERENT ERASURE CODING IS INLINE
SOFTWARE PACKAGED WITH OS
ALL FEATURES INCLUDED
DISK LIFECYCLE MANAGEMENT
PERPETUAL LICENSING MODE
Competitive Differentiators
39
42. #ibmedge
IBM Redbooks on IBM Spectrum Scale
41
IBM Spectrum
Scale (formerly
GPFS)
Implementing IBM
Spectrum Scale
IBM Spectrum
Scale in an
OpenStack
Environment
IBM Spectrum
Scale – Big Data
and Analytics
Solution
IBM Spectrum
Scale and ECM
FileNet Content
Manager
www.redbooks.ibm.com
43. #ibmedge
IBM Tucson Executive Briefing Center
• Tucson, Arizona is home for storage
hardware and software design and
development
• IBM Tucson Executive Briefing Center
offers:
• Technology briefings
• Product demonstrations
• Solution workshops
• Take a video tour!
• http://youtu.be/CXrpoCZAazg
42
44. #ibmedge
About the Speaker
Tony Pearson is a Master Inventor and Senior Software Engineer for the IBM Storage product line. Tony joined IBM
Corporation in 1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on
storage topics covering the entire IBM Storage product line, IBM Spectrum Storage software products, and topics related to
Cloud Computing, Analytics and Cognitive Solutions. He interacts with clients, speaks at conferences and events, and leads
client workshops to help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and
virtualization products.
Tony writes the “Inside System Storage” blog, which is read by hundreds of clients, IBM sales reps and IBM Business Partners
every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1
most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume
I through V.
Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and
software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in
Electrical Engineering, both from the University of Arizona. Tony holds 19 patents for inventions on storage hardware and
software products.
9000 S. Rita Road
Bldg 9032 Floor 1
Tucson, AZ 85744
+1 520-799-4309 (Office)
tpearson@us.ibm.com
Tony Pearson
Master Inventor
Senior Software
Engineer
IBM Storage
43
46. #ibmedge
Please Note: Edge 2016 Disclaimers
• IBM’s statements regarding its plans, directions, and intent are subject to change or
withdrawal without notice and at IBM’s sole discretion.
• Information regarding potential future products is intended to outline our general product
direction and it should not be relied on in making a purchasing decision.
• The information mentioned regarding potential future products is not a commitment, promise,
or legal obligation to deliver any material, code or functionality. Information about potential
future products may not be incorporated into any contract.
• The development, release, and timing of any future features or functionality described for our
products remains at our sole discretion.
• Performance is based on measurements and projections using standard IBM benchmarks in
a controlled environment. The actual throughput or performance that any user will
experience will vary depending upon many factors, including considerations such as the
amount of multiprogramming in the user’s job stream, the I/O configuration, the storage
configuration, and the workload processed. Therefore, no assurance can be given that an
individual user will achieve results similar to those stated here.
45