The document discusses two case studies of integrating OpenStack Swift object storage into legacy systems. Case 1 involves using Swift as backup storage for a legacy backup server. Issues arose due to the backup software not supporting Swift's REST API. Mounting Swift via Cloudfuse helped pass backups with workarounds. Case 2 uses Swift with a Cloud Storage Gateway (Fobas CSC) to provide a file server across locations, addressing Swift's lack of file protocols and small file performance. The combination met requirements and provided good performance. The document concludes cloud gateways can help integration but limit Swift benefits, and improving gateways and native cloud applications unlock more value.
The document summarizes highlights from the 2016 Austin OpenStack Summit. It notes the summit had over 7,500 attendees, more than when it first started with just 75. It discusses various announcements and presentations including the launch of a certification effort, many IoT and telco applications, and major companies using OpenStack in production. Traction in the ISV space and a focus on user experience, manageability and scalability in the newest release were also mentioned.
Achieving Network Deployment Flexibility with Mirantis OpenStackEric Zhaohui Ji
This is the deck presented for Intel Network Builder.
No longer do we live in a world where you can build your networks around expensive, proprietary pieces of hardware and software. Technology moves so fast that you need to be able to keep up, and that means changing your network on demand. But how can you achieve that kind of flexibility while still maintaining the crucial aspects of performance and reliability?
In this webinar we'll look at the network agility provided by OpenStack, which enables you to gain all of the advantages of software defined networking and Network Functions Virtualization without having to compromise on basic requirements. We'll discuss:
•How Mirantis OpenStack enables enterprise and telecom networking
•The features your OpenStack distribution needs to enable NFV
•Using DPDK and SR-IOV to enhance Virtual Network Function performance
•Achieving a Highly Available OpenStack control plane with Multi-rack deployment
Cisco’s Cloud Strategy, including our acquisition of CliQr Cisco Canada
At Partner Summit we made a series of exciting announcements in our Cloud portfolio, including our acquisition of CliQr. Join us to learn about these new announcements and an understanding of Cisco’s Cloud Strategy.
- How does CliQr fit into our existing Cloud portfolio (Metapod, APIC, Enterprise Cloud Suite, Cloud Consumption-as-a-Service)?
- How does our Cloud portfolio today meet the needs of our customers? What problems are we solving?
- How does our portfolio today position us for the world of Containers and Microservices?
Join us for a presentation of how these announcements fit into our current environment and what they mean to your longer-term strategy.
Mirantis provides a distribution of OpenStack called Mirantis OpenStack. It packages OpenStack with additional tools to improve stability, scalability, and manageability compared to upstream OpenStack releases. Mirantis OpenStack includes validated drivers, continuous integration testing of packages, and tools for lifecycle management, performance testing, and security. It is used by over 100 customers worldwide for private cloud deployments.
Introducing Cisco HyperFlex Systems: The Next Generation in Complete Hypercon...Cisco Canada
Initial hyperconverged solutions brought new levels of IT simplicity, as well as the associated speed. However, quickly increasing simplicity came at a price and design trade-offs were made limiting infrastructure agility, efficiency, and adaptability.
Introducing Cisco HyperFlex Systems, complete hyperconvergence that unifies Cisco networking and computing technology with the next-generation Cisco HX Data Platform. Powered by the Cisco Unified Computing System (Cisco UCS) platform, Cisco HyperFlex solutions deliver new levels of operational efficiency and adaptability to more workloads and applications. Cisco HyperFlex technology answers the operations requirements for agility, scalability, and pay-as-you-grow economics of the cloud—but with the benefits of on-premises infrastructure.
Agenda:
• New innovations to the Cisco data center portfolio
• Introducing Cisco HyperFlex Systems powered by the Cisco UCS platform
• Deep dive into the Cisco HyperFlex HX Data Platform
• Preview early deployments of Cisco HyperFlex Systems
vCloud NFV - Accelerating deployment of the Telco Cloud (SDN NFV Day ITB 2016)SDNRG ITB
The document discusses network function virtualization (NFV) and VMware's vCloud NFV platform. It describes how vCloud NFV provides a common, modular platform that allows service providers to deploy virtualized network functions from multiple vendors on shared infrastructure in a cost-effective manner. This enables benefits like reduced costs, increased flexibility, and accelerated time to market for new services. The document also outlines VMware's NFV reference architecture, partner ecosystem, and momentum among global service providers adopting its NFV solutions.
Why SD-WAN as it Moves to Mainstream Adoption?ColloqueRISQ
The document discusses software-defined wide area networks (SD-WANs) and their increasing adoption. It notes that digital business is innovating faster than traditional network infrastructure. SD-WANs use software to dynamically distribute traffic across multiple connection types based on application policies. The document reviews the current state of enterprise networks and drivers for SD-WAN adoption like cloud migration. It provides an overview of the SD-WAN market and vendor landscape. The document also outlines considerations for SD-WAN evaluation and recommends when organizations should look to adopt SD-WAN technology.
Cisco Managed Private Cloud in Your Data Center: Public cloud experience on ...Cisco DevNet
A session in the DevNet Zone at Cisco Live, Berlin. In this workshop, participants will gain an insight into the considerations and requirements of hybrid cloud applications. We will cover how to design for capacity augmentation of existing private cloud applications in the hybrid cloud environment, as well as how to explicitly design an application for a hybrid cloud with performance, access, and availability in mind.
The document summarizes highlights from the 2016 Austin OpenStack Summit. It notes the summit had over 7,500 attendees, more than when it first started with just 75. It discusses various announcements and presentations including the launch of a certification effort, many IoT and telco applications, and major companies using OpenStack in production. Traction in the ISV space and a focus on user experience, manageability and scalability in the newest release were also mentioned.
Achieving Network Deployment Flexibility with Mirantis OpenStackEric Zhaohui Ji
This is the deck presented for Intel Network Builder.
No longer do we live in a world where you can build your networks around expensive, proprietary pieces of hardware and software. Technology moves so fast that you need to be able to keep up, and that means changing your network on demand. But how can you achieve that kind of flexibility while still maintaining the crucial aspects of performance and reliability?
In this webinar we'll look at the network agility provided by OpenStack, which enables you to gain all of the advantages of software defined networking and Network Functions Virtualization without having to compromise on basic requirements. We'll discuss:
•How Mirantis OpenStack enables enterprise and telecom networking
•The features your OpenStack distribution needs to enable NFV
•Using DPDK and SR-IOV to enhance Virtual Network Function performance
•Achieving a Highly Available OpenStack control plane with Multi-rack deployment
Cisco’s Cloud Strategy, including our acquisition of CliQr Cisco Canada
At Partner Summit we made a series of exciting announcements in our Cloud portfolio, including our acquisition of CliQr. Join us to learn about these new announcements and an understanding of Cisco’s Cloud Strategy.
- How does CliQr fit into our existing Cloud portfolio (Metapod, APIC, Enterprise Cloud Suite, Cloud Consumption-as-a-Service)?
- How does our Cloud portfolio today meet the needs of our customers? What problems are we solving?
- How does our portfolio today position us for the world of Containers and Microservices?
Join us for a presentation of how these announcements fit into our current environment and what they mean to your longer-term strategy.
Mirantis provides a distribution of OpenStack called Mirantis OpenStack. It packages OpenStack with additional tools to improve stability, scalability, and manageability compared to upstream OpenStack releases. Mirantis OpenStack includes validated drivers, continuous integration testing of packages, and tools for lifecycle management, performance testing, and security. It is used by over 100 customers worldwide for private cloud deployments.
Introducing Cisco HyperFlex Systems: The Next Generation in Complete Hypercon...Cisco Canada
Initial hyperconverged solutions brought new levels of IT simplicity, as well as the associated speed. However, quickly increasing simplicity came at a price and design trade-offs were made limiting infrastructure agility, efficiency, and adaptability.
Introducing Cisco HyperFlex Systems, complete hyperconvergence that unifies Cisco networking and computing technology with the next-generation Cisco HX Data Platform. Powered by the Cisco Unified Computing System (Cisco UCS) platform, Cisco HyperFlex solutions deliver new levels of operational efficiency and adaptability to more workloads and applications. Cisco HyperFlex technology answers the operations requirements for agility, scalability, and pay-as-you-grow economics of the cloud—but with the benefits of on-premises infrastructure.
Agenda:
• New innovations to the Cisco data center portfolio
• Introducing Cisco HyperFlex Systems powered by the Cisco UCS platform
• Deep dive into the Cisco HyperFlex HX Data Platform
• Preview early deployments of Cisco HyperFlex Systems
vCloud NFV - Accelerating deployment of the Telco Cloud (SDN NFV Day ITB 2016)SDNRG ITB
The document discusses network function virtualization (NFV) and VMware's vCloud NFV platform. It describes how vCloud NFV provides a common, modular platform that allows service providers to deploy virtualized network functions from multiple vendors on shared infrastructure in a cost-effective manner. This enables benefits like reduced costs, increased flexibility, and accelerated time to market for new services. The document also outlines VMware's NFV reference architecture, partner ecosystem, and momentum among global service providers adopting its NFV solutions.
Why SD-WAN as it Moves to Mainstream Adoption?ColloqueRISQ
The document discusses software-defined wide area networks (SD-WANs) and their increasing adoption. It notes that digital business is innovating faster than traditional network infrastructure. SD-WANs use software to dynamically distribute traffic across multiple connection types based on application policies. The document reviews the current state of enterprise networks and drivers for SD-WAN adoption like cloud migration. It provides an overview of the SD-WAN market and vendor landscape. The document also outlines considerations for SD-WAN evaluation and recommends when organizations should look to adopt SD-WAN technology.
Cisco Managed Private Cloud in Your Data Center: Public cloud experience on ...Cisco DevNet
A session in the DevNet Zone at Cisco Live, Berlin. In this workshop, participants will gain an insight into the considerations and requirements of hybrid cloud applications. We will cover how to design for capacity augmentation of existing private cloud applications in the hybrid cloud environment, as well as how to explicitly design an application for a hybrid cloud with performance, access, and availability in mind.
Enovance nfv solution - Openstack in Action 5, Paris, May 2014Sandro Mazziotta
This document discusses eNovance's NFV solution. It begins with an introduction to NFV and ETSI activities. It then outlines eNovance's NFV solution, which enhances OpenStack to provide carrier grade capabilities for deploying and managing VNFs at scale. Open NFV infrastructure is a good first step, but the next step requires open orchestration and APIs to enable an open VNF marketplace. eNovance helps service providers address challenges in deploying NFV using OpenStack.
Security and Virtualization in the Data CenterCisco Canada
The evolving complexity of the data center is placing increased demand on the network and security teams to come up with inventive methods for enforcing security policies in these ever-changing environments. The goal of this session is to provide participants with an understanding of features and design recommendations for integrating security into the data center environment. This session will focus on recommendations for securing next-generation data center architectures. Areas of focus include security services integration, leveraging device virtualization, and considerations and recommendations for server virtualization. The target audience are security and data center administrators.
The document discusses Infinidat's scale-out storage solutions. It highlights Infinidat's unique software-driven architecture with over 100 patents. Infinidat solutions can scale to multi-petabyte capacity in a single rack and provide high performance, reliability, and cost-effectiveness compared to other storage vendors. The document also covers Infinidat's flexible business models, replication capabilities, and easy management tools.
This document discusses InfiniGuard, a data protection solution from Infinidat. It highlights challenges with current backup solutions including slow restore times. InfiniGuard addresses this by leveraging InfiniBox storage technology to achieve restore objectives. It provides fast, scalable backup and restore performance. InfiniGuard also discusses threats from server-side encryption attacks and how its immutable snapshots and isolated backup environment help provide cyber resilience against such threats.
The document discusses Cisco's Container Platform and provides the following key points:
1. Cisco's Container Platform provides a turnkey solution for production-grade Kubernetes container environments that is easy to acquire, deploy and manage on hybrid cloud infrastructures.
2. It features native Kubernetes integration that is 100% upstream compatible, integrated networking, management and security capabilities, and support for AI/ML workloads.
3. The platform architecture includes hardware from Cisco (UCS servers, Nexus switches), virtualization software (VMware, HyperFlex), and container-specific software like Kubernetes, Istio and Prometheus for orchestration, networking and monitoring of container workloads.
eNovance - Seamless build and delivery of OpenStack basedPhilippe Theriault
eNovance uses a platform to industrialize custom integrations of OpenStack based cloud. That continuous integration / continuous deployment platform and process is a game changer in the Cloud deployment market.
With users expecting an immersive experience, and with IoT becoming the new mobile, we are more dependent on Wi-Fi than ever before. The Cisco Catalyst 9100 Access Points, powered by Wi-Fi 6 (802.11ax) technology and supporting Cisco’s intent-based networking architecture, are ready for the growing user expectations, IoT devices, and next-generation cloud-driven applications. Cisco’s first Wi-Fi 6 access point can handle the increased mobile traffic as well as support IoT at scale. It has superior RF innovations and will expand wireless access with intelligence to provide a secure, reliable, high-quality wireless experience for all networks.
Resources:
Watch the related TechWiseTV episode: http://cs.co/9006ELWE6
TechWiseTV: http://cs.co/9009DzrjN
UCS Update: Efficiently Managing your server environment for traditional ente...Cisco Canada
Cisco UCS has helped customers get more out of their IT by providing a simplified physical environment with more efficient management. However, UCS continues to innovate and deliver additional value. This session will focus on updates and new offerings that have enhanced the Cisco UCS portfolio in the previous year. These include M-Series composable infrastructure, Dense Storage servers, next generation Fabric Interconnects, updated servers, additional storage offerings, and more. This will also cover refreshes and best practices to the UCS Management portfolio. Finally, there will be the opportunity for a questions throughout and after the presentation.
NFV orchestration for cloud and virtual branch servicesCisco Canada
The document discusses Cisco's Virtual Managed Services (VMS) platform for orchestrating cloud and virtual branch managed services. VMS allows for the automated orchestration and lifecycle management of virtual network functions (VNFs) running on Cisco's Enterprise Network Compute System (ENCS) in clouds and virtual branches. The ENCS provides an NFV infrastructure optimized for branch and campus deployments, with features like hardware acceleration and integrated switching. VMS provides a simplified way for service providers to deliver virtualized managed services to enterprise customers.
SDN Scale-out Testing at OpenStack Innovation Center (OSIC)PLUMgrid
The OpenStack Innovation Center (OSIC), established by Intel and Rackspace, is created to accelerate adoption of open source cloud operating system while supporting open source principles. OSIC provides ready-to-use data center facilities to the OpenStack community for development and test. This case study presentation highlights a scale-out test performed within a 3 week period using OpenStack Ansible Community based on Liberty with an SDN overlay network connecting 131 nodes running over 1,000 VMs. Tempest and Rally tests were conducted to validate functions including high availability failure scenarios. Join this session to find out more about OSIC and the SDN scale-out test configuration, scenarios, and results.
This document discusses cloud infrastructure and how it is built. It begins by outlining the structure of cloud computing, comparing cloud to traditional hosting architectures. It then describes the different layers of cloud, including storage, servers, networking, operating systems, and more. It discusses how cloud provides scalability through its design with no single point of failure. The document also looks at the future of cloud, such as using ARM/ATOM processors and the rise of containers. In general, it provides an overview of cloud infrastructure and architectures.
The document discusses projects related to next generation content delivery networks (NG-CDNs) and network management systems (NMS). It provides details on an NG-CDN proof-of-concept implemented using Juniper Media Flow Controllers for content caching and OpenNMS for network monitoring and management. It also discusses using Drools for rules-based fault and performance management of the NG-CDN. Additionally, it summarizes an AT&T small cell project involving deployment of small cell routers and switches with an NMS cluster for management.
Cisco Connect Montreal 2017 - Mise à Jour UCS et HyperflexCisco Canada
This document summarizes Cisco's UCS, Hyperflex, and Intersight infrastructure solutions for hybrid cloud. It provides an overview of Cisco UCS and its momentum in the market, the various UCS server and fabric interconnect options, Cisco HyperFlex hyperconverged solutions, and how Cisco solutions can provide an adaptive infrastructure that scales compute and storage independently. It positions these solutions as part of a complete data center strategy with unified management and the ability to integrate with traditional converged and software-defined storage infrastructure.
IBM System Storage® : la famiglia si allarga…ultimi annunciS.info Srl
The document discusses recent announcements from IBM about enhancements to its Storwize family of software-defined storage solutions. Key updates include the addition of IP replication with integrated network optimization technology to improve replication performance over long distances, improvements to real-time compression capabilities, a mobile application for storage monitoring, and enhanced functionality for stretched clusters. These updates further advance IBM's vision of delivering a fully software-defined storage platform.
RoCEv2 is an extension of the original RoCE specification announced in 2010 that brought the benefits of Remote Direct Memory Access (RDMA) I/O architecture to Ethernet-based networks. RoCEv2 addresses the needs of today’s evolving enterprise data centers by enabling routing across Layer 3 networks. Extending RoCE to allow Layer 3 routing provides better traffic isolation and enables hyperscale data center deployments.
Watch the video presentation: http://insidehpc.com/2014/09/slidecast-ibta-releases-updated-specification-rocev2/
Network Function Virtualization (NFV) using IOS-XRCisco Canada
Network Function Visualization (NFV) is being heavily adapted in Service Providers, Enterprise Network, and data center market segments. IOS-XRv 9000 and IOS XRv offer NFV functionality leveraging Cisco IOS-XR's already proven and time-tested deployment of this network OS in the field. The session will go over the fundamentals of NFV, introduces virtual flavors of IOS-XR and their use cases as virtual Route Reflector (vRR) and virtual Provider Edge (vPE), as well as demonstrate how these use-cases bring improvement and efficiency to the network implementation. In this session the attendees will be offered a hands-on experience of deploying IOS-XRv 9000 in a virtual environment, explore its basics, and configure it as a virtual device.
Expanding your impact with programmability in the data centerCisco Canada
1) Digital readiness involves embracing automation, operational simplicity through programmability, network disaggregation, and DevOps to drive speed and agility.
2) Programmability allows for more flexibility, innovation, speed, repeatability and fewer mistakes by enabling automated workflows, off-box management via controllers and APIs, and SDKs for application development.
3) Adopting programmability means network operations will need to understand concepts like REST, XML, JSON, and work with developers to automate tasks and integrate the network.
Presentazione IBM System Storage - Evento Torino 19 novembre 2013PRAGMA PROGETTI
The document discusses recent announcements and enhancements from IBM regarding their software defined storage solutions. Key points include:
- IBM introduced IP replication capabilities for their Storwize family that utilizes Bridgeworks SANSlide technology to improve network utilization up to 3x.
- Real-time compression algorithms were enhanced to provide up to 3x higher throughput for VMware migrations and 35% reduced CPU usage.
- A mobile dashboard was released for monitoring IBM Storwize systems from mobile devices.
- Other enhancements included support for 800GB SSDs, SAS data migration capabilities, and an "enhanced stretched cluster" feature for IBM SVC.
A session in the DevNet Zone at Cisco Live, Berlin. Join us for a case study discussion about DevOps principles and how they were incorporated into an Infinite Video project.
OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...Masaaki Nakagawa
DOCOMO MAIL is 24/7 cloud mail system which has accesses from over 20 million people. This mail system stores user's mail archive in OpenStack Swift with Peta Byte scale capacity deployed by NTT DATA.
We have been successfully operating this service since Sep 2014 without any downtime. In this session, we'll present the actual issues and challenges we have faced and conquered.
Here're some specific points we'd like to highlight.
* No service degrade, no downtime.
* Massive scale and still growing.
* Hundreds of servers operated by few people.
Distributed application usecase on dockerHiroshi Miura
1) The document discusses using Docker containers and the Hinemos monitoring system to automate operations for a distributed application running on container clusters.
2) Key benefits outlined include automated rebalancing of containers for performance and cost reduction, reduced downtime through automated fallback from failures, and consolidation of platforms through wrapping differences in container images.
3) Challenges addressed include complex data distribution management and inability to integrate environments for applications with different dependencies, which Docker containers help solve.
Enovance nfv solution - Openstack in Action 5, Paris, May 2014Sandro Mazziotta
This document discusses eNovance's NFV solution. It begins with an introduction to NFV and ETSI activities. It then outlines eNovance's NFV solution, which enhances OpenStack to provide carrier grade capabilities for deploying and managing VNFs at scale. Open NFV infrastructure is a good first step, but the next step requires open orchestration and APIs to enable an open VNF marketplace. eNovance helps service providers address challenges in deploying NFV using OpenStack.
Security and Virtualization in the Data CenterCisco Canada
The evolving complexity of the data center is placing increased demand on the network and security teams to come up with inventive methods for enforcing security policies in these ever-changing environments. The goal of this session is to provide participants with an understanding of features and design recommendations for integrating security into the data center environment. This session will focus on recommendations for securing next-generation data center architectures. Areas of focus include security services integration, leveraging device virtualization, and considerations and recommendations for server virtualization. The target audience are security and data center administrators.
The document discusses Infinidat's scale-out storage solutions. It highlights Infinidat's unique software-driven architecture with over 100 patents. Infinidat solutions can scale to multi-petabyte capacity in a single rack and provide high performance, reliability, and cost-effectiveness compared to other storage vendors. The document also covers Infinidat's flexible business models, replication capabilities, and easy management tools.
This document discusses InfiniGuard, a data protection solution from Infinidat. It highlights challenges with current backup solutions including slow restore times. InfiniGuard addresses this by leveraging InfiniBox storage technology to achieve restore objectives. It provides fast, scalable backup and restore performance. InfiniGuard also discusses threats from server-side encryption attacks and how its immutable snapshots and isolated backup environment help provide cyber resilience against such threats.
The document discusses Cisco's Container Platform and provides the following key points:
1. Cisco's Container Platform provides a turnkey solution for production-grade Kubernetes container environments that is easy to acquire, deploy and manage on hybrid cloud infrastructures.
2. It features native Kubernetes integration that is 100% upstream compatible, integrated networking, management and security capabilities, and support for AI/ML workloads.
3. The platform architecture includes hardware from Cisco (UCS servers, Nexus switches), virtualization software (VMware, HyperFlex), and container-specific software like Kubernetes, Istio and Prometheus for orchestration, networking and monitoring of container workloads.
eNovance - Seamless build and delivery of OpenStack basedPhilippe Theriault
eNovance uses a platform to industrialize custom integrations of OpenStack based cloud. That continuous integration / continuous deployment platform and process is a game changer in the Cloud deployment market.
With users expecting an immersive experience, and with IoT becoming the new mobile, we are more dependent on Wi-Fi than ever before. The Cisco Catalyst 9100 Access Points, powered by Wi-Fi 6 (802.11ax) technology and supporting Cisco’s intent-based networking architecture, are ready for the growing user expectations, IoT devices, and next-generation cloud-driven applications. Cisco’s first Wi-Fi 6 access point can handle the increased mobile traffic as well as support IoT at scale. It has superior RF innovations and will expand wireless access with intelligence to provide a secure, reliable, high-quality wireless experience for all networks.
Resources:
Watch the related TechWiseTV episode: http://cs.co/9006ELWE6
TechWiseTV: http://cs.co/9009DzrjN
UCS Update: Efficiently Managing your server environment for traditional ente...Cisco Canada
Cisco UCS has helped customers get more out of their IT by providing a simplified physical environment with more efficient management. However, UCS continues to innovate and deliver additional value. This session will focus on updates and new offerings that have enhanced the Cisco UCS portfolio in the previous year. These include M-Series composable infrastructure, Dense Storage servers, next generation Fabric Interconnects, updated servers, additional storage offerings, and more. This will also cover refreshes and best practices to the UCS Management portfolio. Finally, there will be the opportunity for a questions throughout and after the presentation.
NFV orchestration for cloud and virtual branch servicesCisco Canada
The document discusses Cisco's Virtual Managed Services (VMS) platform for orchestrating cloud and virtual branch managed services. VMS allows for the automated orchestration and lifecycle management of virtual network functions (VNFs) running on Cisco's Enterprise Network Compute System (ENCS) in clouds and virtual branches. The ENCS provides an NFV infrastructure optimized for branch and campus deployments, with features like hardware acceleration and integrated switching. VMS provides a simplified way for service providers to deliver virtualized managed services to enterprise customers.
SDN Scale-out Testing at OpenStack Innovation Center (OSIC)PLUMgrid
The OpenStack Innovation Center (OSIC), established by Intel and Rackspace, is created to accelerate adoption of open source cloud operating system while supporting open source principles. OSIC provides ready-to-use data center facilities to the OpenStack community for development and test. This case study presentation highlights a scale-out test performed within a 3 week period using OpenStack Ansible Community based on Liberty with an SDN overlay network connecting 131 nodes running over 1,000 VMs. Tempest and Rally tests were conducted to validate functions including high availability failure scenarios. Join this session to find out more about OSIC and the SDN scale-out test configuration, scenarios, and results.
This document discusses cloud infrastructure and how it is built. It begins by outlining the structure of cloud computing, comparing cloud to traditional hosting architectures. It then describes the different layers of cloud, including storage, servers, networking, operating systems, and more. It discusses how cloud provides scalability through its design with no single point of failure. The document also looks at the future of cloud, such as using ARM/ATOM processors and the rise of containers. In general, it provides an overview of cloud infrastructure and architectures.
The document discusses projects related to next generation content delivery networks (NG-CDNs) and network management systems (NMS). It provides details on an NG-CDN proof-of-concept implemented using Juniper Media Flow Controllers for content caching and OpenNMS for network monitoring and management. It also discusses using Drools for rules-based fault and performance management of the NG-CDN. Additionally, it summarizes an AT&T small cell project involving deployment of small cell routers and switches with an NMS cluster for management.
Cisco Connect Montreal 2017 - Mise à Jour UCS et HyperflexCisco Canada
This document summarizes Cisco's UCS, Hyperflex, and Intersight infrastructure solutions for hybrid cloud. It provides an overview of Cisco UCS and its momentum in the market, the various UCS server and fabric interconnect options, Cisco HyperFlex hyperconverged solutions, and how Cisco solutions can provide an adaptive infrastructure that scales compute and storage independently. It positions these solutions as part of a complete data center strategy with unified management and the ability to integrate with traditional converged and software-defined storage infrastructure.
IBM System Storage® : la famiglia si allarga…ultimi annunciS.info Srl
The document discusses recent announcements from IBM about enhancements to its Storwize family of software-defined storage solutions. Key updates include the addition of IP replication with integrated network optimization technology to improve replication performance over long distances, improvements to real-time compression capabilities, a mobile application for storage monitoring, and enhanced functionality for stretched clusters. These updates further advance IBM's vision of delivering a fully software-defined storage platform.
RoCEv2 is an extension of the original RoCE specification announced in 2010 that brought the benefits of Remote Direct Memory Access (RDMA) I/O architecture to Ethernet-based networks. RoCEv2 addresses the needs of today’s evolving enterprise data centers by enabling routing across Layer 3 networks. Extending RoCE to allow Layer 3 routing provides better traffic isolation and enables hyperscale data center deployments.
Watch the video presentation: http://insidehpc.com/2014/09/slidecast-ibta-releases-updated-specification-rocev2/
Network Function Virtualization (NFV) using IOS-XRCisco Canada
Network Function Visualization (NFV) is being heavily adapted in Service Providers, Enterprise Network, and data center market segments. IOS-XRv 9000 and IOS XRv offer NFV functionality leveraging Cisco IOS-XR's already proven and time-tested deployment of this network OS in the field. The session will go over the fundamentals of NFV, introduces virtual flavors of IOS-XR and their use cases as virtual Route Reflector (vRR) and virtual Provider Edge (vPE), as well as demonstrate how these use-cases bring improvement and efficiency to the network implementation. In this session the attendees will be offered a hands-on experience of deploying IOS-XRv 9000 in a virtual environment, explore its basics, and configure it as a virtual device.
Expanding your impact with programmability in the data centerCisco Canada
1) Digital readiness involves embracing automation, operational simplicity through programmability, network disaggregation, and DevOps to drive speed and agility.
2) Programmability allows for more flexibility, innovation, speed, repeatability and fewer mistakes by enabling automated workflows, off-box management via controllers and APIs, and SDKs for application development.
3) Adopting programmability means network operations will need to understand concepts like REST, XML, JSON, and work with developers to automate tasks and integrate the network.
Presentazione IBM System Storage - Evento Torino 19 novembre 2013PRAGMA PROGETTI
The document discusses recent announcements and enhancements from IBM regarding their software defined storage solutions. Key points include:
- IBM introduced IP replication capabilities for their Storwize family that utilizes Bridgeworks SANSlide technology to improve network utilization up to 3x.
- Real-time compression algorithms were enhanced to provide up to 3x higher throughput for VMware migrations and 35% reduced CPU usage.
- A mobile dashboard was released for monitoring IBM Storwize systems from mobile devices.
- Other enhancements included support for 800GB SSDs, SAS data migration capabilities, and an "enhanced stretched cluster" feature for IBM SVC.
A session in the DevNet Zone at Cisco Live, Berlin. Join us for a case study discussion about DevOps principles and how they were incorporated into an Infinite Video project.
OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...Masaaki Nakagawa
DOCOMO MAIL is 24/7 cloud mail system which has accesses from over 20 million people. This mail system stores user's mail archive in OpenStack Swift with Peta Byte scale capacity deployed by NTT DATA.
We have been successfully operating this service since Sep 2014 without any downtime. In this session, we'll present the actual issues and challenges we have faced and conquered.
Here're some specific points we'd like to highlight.
* No service degrade, no downtime.
* Massive scale and still growing.
* Hundreds of servers operated by few people.
Distributed application usecase on dockerHiroshi Miura
1) The document discusses using Docker containers and the Hinemos monitoring system to automate operations for a distributed application running on container clusters.
2) Key benefits outlined include automated rebalancing of containers for performance and cost reduction, reduced downtime through automated fallback from failures, and consolidation of platforms through wrapping differences in container images.
3) Challenges addressed include complex data distribution management and inability to integrate environments for applications with different dependencies, which Docker containers help solve.
This document discusses challenges with modern data infrastructure and how DataCore software addresses them. It summarizes that data is growing faster than storage budgets, storage silos waste capacity and are hard to manage, and applications often run slowly due to storage performance issues. DataCore software solves these problems by pooling storage, providing infrastructure services independently of hardware, separating software and hardware advances, and providing single-pane management of disparate infrastructure.
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storageMayaData Inc
Webinar Session - https://youtu.be/_5MfGMf8PG4
In this webinar, we share how the Container Attached Storage pattern makes performance tuning more tractable, by giving each workload its own storage system, thereby decreasing the variables needed to understand and tune performance.
We then introduce MayaStor, a breakthrough in the use of containers and Kubernetes as a data plane. MayaStor is the first containerized data engine available that delivers near the theoretical maximum performance of underlying systems. MayaStor performance scales with the underlying hardware and has been shown, for example, to deliver in excess of 10 million IOPS in a particular environment.
Using Storlets/Docker For Large Scale Image ProcessingKota Tsuyuzaki
OpenStack Storlets, one of the OpenStack official project to provide Function as a Service-like computation environment on top of OpenStack Swift, leverages a user defined code computation environment inside the object storage system in a secure and isolated manner through the use of Docker containers. Docker container has pretty benefited mechanisms for the perspective; high-performance computing (HPC), secure, and efficient network transfer to run the user code. Therefore, Storlets allows users to invoke their HPC applications much more efficiently without downloading the data binary from their object storage system to their computing resources.
In this presentation, we introduce high level architecture of OpenStack Storlets, and use cases of NTT, the telecommunications company in Japan. Especially, we focus on our commercial image processing applications for data analytics, which use a large amount of picture data growing to approximately PB scales.
Everyone understands disk has become the primary target for backups in the last several years. It’s also safe to say that the main type of disk storage used as a target for backups would be a purpose-built backup appliance that presents itself to the backup application as an NFS or SMB server and then deduplicates any backups stored on it.
But what about object storage? Object storage vendors tout that their systems are less expensive to buy and less expensive to operate than traditional disk arrays and NAS appliances. So, does it make sense to use them for backups? How much is deduplication a factor and is deduplication even available with object storage? What else can object storage bring to the table that traditional disk backup appliances can’t?
How the Development Bank of Singapore solves on-prem compute capacity challen...Alluxio, Inc.
The Development Bank of Singapore (DBS) has evolved its data platforms over three generations to address big data challenges and the explosion of data. It now uses a hybrid cloud model with Alluxio to provide a unified namespace across on-prem and cloud storage for analytics workloads. Alluxio enables "zero-copy" cloud bursting by caching hot data and orchestrating analytics jobs between on-prem and cloud resources like AWS EMR and Google Dataproc. This provides dynamic scaling of compute capacity while retaining data locality. Alluxio also offers intelligent data tiering and policy-driven data migration to cloud storage over time for cost efficiency and management.
NVMe and all-flash systems can solve any performance, floor space and energy problems. At least this is the marketing message many vendors and analysts spread today – but actually, sounds too good to be true, right?
Like always in real life, there is no clear black or white, but some circumstances you should be aware of – especially if you intend to leverage these technologies.
You may ask yourself: Do I need to rip and replace my existing storage? What is the best way to integrate both? What benefits do I receive?
Well, just join our brief webinar, which also includes a live demo and audience Q&A so you can get the most out of these technologies, make your storage great again and discover:
• How to integrate Flash over NVMe in real life
• How to benefit of some Flash/NVMe for your entire applications
Dealing with data storage pain points? Learn why a true Software-defined Storage solution is ideal for improving application performance, managing diversity and migrating between different vendors, models and generations of storage devices.
Webinar: The Four Requirements of a Cloud-Era File SystemStorage Switzerland
File systems are the heart of most organizations. They’re how critical unstructured data assets are stored, organized, and shared. But with files exploding in size and quantity as well as the cloud offering potentially cheaper and more scalable storage than traditional NAS, a new set of requirements is needed. Is your file system ready?
In a fast growing storage space management world, it is now an important task to think about options that can safely store our data and at a cheaper cost. Small scale businesses, that cant afford their own storage spaces, can easily take the advantage of such services.
The webinar discusses how primary storage should be integrated with disaster recovery (DR) plans. It notes that backup software alone is not enough for DR and that primary storage needs capabilities like granular snapshots, replication, and cloud integration. The webinar presenters from Storage Switzerland and Tintri then outline Tintri's primary storage solutions for DR, including varying recovery point objectives, asynchronous replication, synchronous replication with near-zero RTO, and analytics and management through Tintri Global Center.
Zero Downtime with Tyrone Unified Storage SolutionTyrone Systems
Well known GPS Maps Navigation service provider entrusts Tyrone Opslag FS2 unified storage platform for their storage needs as it offers them high performance, scalability and flexibility
Updates on webSpoon and other innovations from Hitachi R&DHiromu Hota
Updates on webSpoon and introduction of SpoonGit (Git client integrated with Spoon) at PCM17 (10th Pentaho Community Meeting in Mainz, Germany, Nov 11, 2017)
Tape and cloud storage targets have their pros and cons. There are many differences between these two technologies, which we will explore in this paper. These differences can steer the decision process you may have for getting virtual machine (VM) backups offsite with Veeam® Backup & Replication™.
Building an Apache Hadoop data applicationtomwhite
Slides for the Strata tutorial by Tom White (Cloudera), Joey Echeverria (Rocana), Ryan Blue (Cloudera): http://strataconf.com/big-data-conference-uk-2015/public/schedule/detail/39626
Ceph, Open Source, and the Path to Ubiquity in Storage - AACS Meetup 2014Patrick McGarry
Everyone needs storage, but Open Source is changing how we think about storage infrastructure through new features, added durability, and reduced cost. New storage solutions like Ceph are providing distributed, flexible, powerful options that can support a myriad of use cases across object, block, and file system applications. This talk will explore the history and basics of Ceph, the current status of the community, and where the project is headed in the near future.
In this video from the Stanford HPC Conference, Liran Zvibel from Weka.IO presents: Making Machine Learning Compute Bound Again.
"GPUs are getting faster on a yearly cycle. Networking was able to catch up and support linear scaling of models that fit in memory. Traditional storage has not caught up to the condensed performance needed by GPU-filled servers. The amount of concurrent clients and the sheer amount of data required to effectively scale modern deep learning models keeps growing.
We are going to present WekaIO, the lowest latency, highest throughput file system solution that scales to 100s of PB in a single namespace supporting the most challenging deep learning projects that run today. We will present real life benchmarks comparing WekaIO performance to a local SSD file system, showing that we are the only coherent shared storage that is even faster than the current caching solutons, while allowing customers to linearly scale performance by adding more GPU servers. Also, we will view the complete ML project lifecycle, from collecting data, cleaning, tagging, exploring, training, validating, and finally archiving, and how customers can use cloud bursting to leverage public cloud infrastructure for improved economics."
Learn more: https://weka.io
and
http://hpcadvisorycouncil.com
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
DataCore has spent the last 17 years developing a hardware agnostic set of storage services. Some of these services are common among modern storage systems. Things like snapshots, thin provisioning and mirroring. No other vendor can offer this functionality in a universally compatible format. Our storage services can be found in our SANsymphony-V & DataCore Virtual SAN products.
DataCore has spent the last 17 years developing a hardware agnostic set of storage services. Some of these services are common among modern storage systems. Things like snapshots, thin provisioning and mirroring. No other vendor can offer this functionality in a universally compatible format. Our storage services can be found in our SANsymphony-V & DataCore Virtual SAN products.
Similar to How to integrate OpenStack Swift to your "legacy" system (20)
E-commerce Development Services- Hornet DynamicsHornet Dynamics
For any business hoping to succeed in the digital age, having a strong online presence is crucial. We offer Ecommerce Development Services that are customized according to your business requirements and client preferences, enabling you to create a dynamic, safe, and user-friendly online store.
GraphSummit Paris - The art of the possible with Graph TechnologyNeo4j
Sudhir Hasbe, Chief Product Officer, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j
Dr. Jesús Barrasa, Head of Solutions Architecture for EMEA, Neo4j
Découvrez les dernières innovations de Neo4j, et notamment les dernières intégrations cloud et les améliorations produits qui font de Neo4j un choix essentiel pour les développeurs qui créent des applications avec des données interconnectées et de l’IA générative.
WhatsApp offers simple, reliable, and private messaging and calling services for free worldwide. With end-to-end encryption, your personal messages and calls are secure, ensuring only you and the recipient can access them. Enjoy voice and video calls to stay connected with loved ones or colleagues. Express yourself using stickers, GIFs, or by sharing moments on Status. WhatsApp Business enables global customer outreach, facilitating sales growth and relationship building through showcasing products and services. Stay connected effortlessly with group chats for planning outings with friends or staying updated on family conversations.
E-commerce Application Development Company.pdfHornet Dynamics
Your business can reach new heights with our assistance as we design solutions that are specifically appropriate for your goals and vision. Our eCommerce application solutions can digitally coordinate all retail operations processes to meet the demands of the marketplace while maintaining business continuity.
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Łukasz Chruściel
No one wants their application to drag like a car stuck in the slow lane! Yet it’s all too common to encounter bumpy, pothole-filled solutions that slow the speed of any application. Symfony apps are not an exception.
In this talk, I will take you for a spin around the performance racetrack. We’ll explore common pitfalls - those hidden potholes on your application that can cause unexpected slowdowns. Learn how to spot these performance bumps early, and more importantly, how to navigate around them to keep your application running at top speed.
We will focus in particular on tuning your engine at the application level, making the right adjustments to ensure that your system responds like a well-oiled, high-performance race car.
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeAftab Hussain
Understanding variable roles in code has been found to be helpful by students
in learning programming -- could variable roles help deep neural models in
performing coding tasks? We do an exploratory study.
- These are slides of the talk given at InteNSE'23: The 1st International Workshop on Interpretability and Robustness in Neural Software Engineering, co-located with the 45th International Conference on Software Engineering, ICSE 2023, Melbourne Australia
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...Crescat
Crescat is industry-trusted event management software, built by event professionals for event professionals. Founded in 2017, we have three key products tailored for the live event industry.
Crescat Event for concert promoters and event agencies. Crescat Venue for music venues, conference centers, wedding venues, concert halls and more. And Crescat Festival for festivals, conferences and complex events.
With a wide range of popular features such as event scheduling, shift management, volunteer and crew coordination, artist booking and much more, Crescat is designed for customisation and ease-of-use.
Over 125,000 events have been planned in Crescat and with hundreds of customers of all shapes and sizes, from boutique event agencies through to international concert promoters, Crescat is rigged for success. What's more, we highly value feedback from our users and we are constantly improving our software with updates, new features and improvements.
If you plan events, run a venue or produce festivals and you're looking for ways to make your life easier, then we have a solution for you. Try our software for free or schedule a no-obligation demo with one of our product specialists today at crescat.io
Flutter is a popular open source, cross-platform framework developed by Google. In this webinar we'll explore Flutter and its architecture, delve into the Flutter Embedder and Flutter’s Dart language, discover how to leverage Flutter for embedded device development, learn about Automotive Grade Linux (AGL) and its consortium and understand the rationale behind AGL's choice of Flutter for next-gen IVI systems. Don’t miss this opportunity to discover whether Flutter is right for your project.
Zoom is a comprehensive platform designed to connect individuals and teams efficiently. With its user-friendly interface and powerful features, Zoom has become a go-to solution for virtual communication and collaboration. It offers a range of tools, including virtual meetings, team chat, VoIP phone systems, online whiteboards, and AI companions, to streamline workflows and enhance productivity.
What is Master Data Management by PiLog Groupaymanquadri279
PiLog Group's Master Data Record Manager (MDRM) is a sophisticated enterprise solution designed to ensure data accuracy, consistency, and governance across various business functions. MDRM integrates advanced data management technologies to cleanse, classify, and standardize master data, thereby enhancing data quality and operational efficiency.
Using Query Store in Azure PostgreSQL to Understand Query PerformanceGrant Fritchey
Microsoft has added an excellent new extension in PostgreSQL on their Azure Platform. This session, presented at Posette 2024, covers what Query Store is and the types of information you can get out of it.
Transform Your Communication with Cloud-Based IVR SolutionsTheSMSPoint
Discover the power of Cloud-Based IVR Solutions to streamline communication processes. Embrace scalability and cost-efficiency while enhancing customer experiences with features like automated call routing and voice recognition. Accessible from anywhere, these solutions integrate seamlessly with existing systems, providing real-time analytics for continuous improvement. Revolutionize your communication strategy today with Cloud-Based IVR Solutions. Learn more at: https://thesmspoint.com/channel/cloud-telephony
Good afternoon, everyone. Thank you for coming to this session.
We are from NTT DATA, system integrater in Japan.
Last autumn, we had OpenStack summit in Japan, my home country and I spend very exciting time there.
And I’m happy to join again to the OpenStack summit here, Austin.
As mentioned in some keynote sessions, like Jonathan’s one, now, OpenStack is coming to the next stage to support diversity of IT systems which running on OpenStack.
Today, I’ll share you our experience in the Swift project, putting focus on the problem we face. I’ll talk about our real cases, and how we tried to integrate Swift to some customer’s project in them, and I’m happy if it can be a help to enhance support of swift for diversity of IT systems.
Let me start with the disclaimer of this presentation
Before talking detailed contents, let me shortly introduce ourselves.
We three are all platform engineers in NTT DATA. I’m Takashi Kajinami. I’ve worked in the Swift and OpenStack project in NTT DATA.
…
NTT DATA is a system integrator, so we provide IT systems for our customers, and also develop some features which is required in our customers’ usecase.
We belongs to OSS professional sector in NTT DATA, working about cloud technologies like OpenStack, Swift, Sheepdog, Docker and so on, and data processing technologies like PostgreSQL, Hadoop, Spark and bla bla bla.
We are especially responsible for cloud platforms using OpenStack technologies, and working to provide private cloud by OpenStack, and cloud storage using OpenStack Swift.
That is the reason why we’ll talk about Swift.
Here I show you the agenda for our presentation.
First, I will shortly explain what is swift, and the reason why we use swift for our system integration.
Then, Masaaki and Masahiro explain what kind of problems we faced in our swift projects, and introduce our approach in these project, with some detailed information about two real use cases.
Finally, I’ll summarize and share what we learned from these cases.
OK. So Swift.
How many people here know Swift?
How many people are using Swift, or have provided system using Swift?
OpenStack Swift is a part of OpenStack project, and Storage project.
Swift realizes distributed object storage like Amazon S3.
Object storage is a new style storage with different interface from conventional block storage or fliesystems.
Swift provides RESTful API and clients can upload data into storage as PUT request, and download data into storage as GET request.
These REST API works on HTTP Protocol, so swift is often used as archiving storage for web contents like photo or video or backup data.
Swift has many good features, but I don’t have so much time to explain today, so I’ll talk about its three key features, durability, scalability and no vendor lock-in.
The first key feature is durability.
Swift make some copies of data in storage cluster, for example 3 copies, and distribute copies over devices, nodes, racks.
So, even if some parts of swift cluster fails, you can protect data from failures and continue to access all data with remaining copies.
In addition, swift also automatically detects disk defeats, and heal missing data copies in other devices working properly.
From Grizzly/Havana release, I think very long time has passed since theses get released, swift gets “Global Cluster” features, which enables geographically distributed storage cluster over multiple datacenters to realize disaster recovery.
Disaster recovery is one of topics most interesting to especially Japanese customers, after our experience of big disasters like earthquake, tsunami and so on.
The second feature is scalability.
Swift distributes data over multiple devices, and when you add new devices, it rebalances data to new nodes.
So, we can enlarge capacity and improve performance of swift cluster by adding new swift nodes.
We can extend the storage from small capacity like 10TB, to huge capacity like dozens of PB
In addition, there are no limitations on the number of devices you can add, so we can extend swift clusters flexibly.
You can add capacity as much as you need, when you need, and you can adopt you storage to unpredictable market situation with effective cost.
The last one is “no vendor lock-in.”
Swift is open source software, which works on python framework, and you can drive it on commodity I/A servers and linux.
You don’t need any special devices for swift, and you can select cost-effective hardware to construct huge storage.
In addition, you can flexibly mix some types of servers in a single cluster, so you can add latest hardware to existing cluster consist of old servers.
You can add latest servers when you extend, and, on the other hand, can remove old servers when they get broken after their maintenance period.
So, you can keep your swift cluster for a long time, regardless of the maintenance period of servers, with replacing old servers to new ones.
So now, I’ve explained about three key features of swift.
Swift realizes very durable and scalable storage, and makes us free from any vendor lock-ins.
As I talked in the beginning of this session, we are working as System Integrator, and unfortunately this mismatch between existing systems and swift happens very often for us.
What can we do for that?
OK, thank you takashi, I’m Masaaki Nakagawa software platform engineer at NTTDATA.
Today, We share you two case of use case of swift.
Now, I start to share case 1, use swift as backup storage of legacy backup server.
One day, a customer came to us to talk about new project.
From these requirements, we define some points for design.
These are points.
「Backed-up data size is from hundreds TB to 1 PB」 leads scalable
We thought that these points are satisfied by swift.
Next, we discussed swift integrated system design.
This figure shows that system design overview which is satisfying design points.
For convenience, this figure set two site
User system, backup server, swift proxy, and swift storage is deployed each site.
Backup server gets backed-up data from user system,
Backup server PUT or GET backed-up data to/from each proxy which deployed same site.
Swift proxy is set affinity configuration to operation PUT or GET data to same site swift storage.
Swift storage is set region configuration each site individually.
We thought that this design is enough for requirement.
But unfortunately, this design was difficult to realize,
because of low compatibility of backup server and swift.
Backup server doesn’t support swift API.
And this server requires to set server-specific virtual tape device on block storage.
To use swift as backup storage, we have to mount swift to local file system as block storage.
Like this case, we often receive RFP form customer that
using swift as backup storage of backup software which does not ready for swift.
Use case of backup storage is suite for swift but we have to give up to use swift because by legacy backup software.
To avoid such a unbearable give up, we should prepare something workaround.
As workaround, we have experimentally tried to mount swift to filesystem by using cloudfuse.
I would like to introduce it.
Cloudfuse is OSS which enable swift to mount as block storage to filesystem.
If you create/delete/update files,
cloudfuse changes these operation to swift API request.
If you want to know about detail of cloudfuse, please refer this web site.
In this case, we set cloudfuse like this figure.
By this architecture, we succeeded to mount swift and make backup server read mount point.
So we tried to backup process to get issue point of this architecture.
By trying, we get two issues to proceed backup process.
The first is fail initializing virtual tape device.
Virtual tape device initializing process creates temporary file and rename it.
But cloudfuse doesn’t support rename operation.
So to achieve this issue, we need to improve cloudfuse, or choose other same component like cloudfuse, or do workaround.
In this time, we choose workaround, create virtual tape device at other location and move it.
The second is swift doesn’t support append object data.
During backup process, backup server appends backup data to virtual tape device.
But swift doesn’t support append operation.
To achieve this, we used DLO plugin.
We can apply DLO plugin to appending operation.
By achieving these issues, we have gotten one pass to backup.
But if using this architecture for commerce,
we need to more detail analyzing
Second case is to use swift as storage for file server.
We are asked to renew file server which has access from users in geographically separated areas.
There are three requirements.
First, Users store data in local storage without any overhead with replication
Second, All users can share same files
Third, Support file-based protocols to write various size of files
Let me show the details of requirements
First requirements is that users store data in local storage without any overhead of replication to keep the latency of access low.
Users are located geographically separated areas and Users store in local storage.
So, storages need to be located in geographically separated areas like this picture
But, it is required that all users can share the same files. So, it is needed to bundle local storages in one virtual storage.
If there is one virtual storage, users can share same files.
After a user in EU writes a file in local storage, it is replicated to all other storages and user in North America can read the file.
Third requirement is to support file-based protocols such as CIFS or NFS to write various size of files. The reason why customer requested is to reuse the existing many legacy applications and to avoid high costs and risks while developing new applications. To use storage as back-end of file server, accessing small files in low latency is required
From these requirements, we compared three storage software. First row expresses requirements. Second row expresses features to realize requirements. Third to Fifth rows are the name of comparison of software. We chosen Ceph, GlusterFS and Swift which have global cluster feature. This table shows swift fulfills most requirements. Additionally, since we have knowledge of swift, we planed to use swift.
But, swift has two issues for requirements.
First issue is about file system interface. Although users need to access by file-based protocols such as CIFS and NFS, Swift supports only Rest API.
Second issue is about small file optimization. To use as file-server, accessing small files in low latency is required. But, swift is not good at processing many small files because swift is optimized for big file to store much data.
So, how to solve the issues? This table shows issues and solutions. Second row of the table shows our solutions.
We solved first issue to integrate Cloud Storage Gateway.
We solved second issue to add two features, data management with small block size and storage cache
First solution about file system interface is to integrate Cloud Storage Gateway. This is a gateway software which translates cloud storage APIs such as REST API and standard file-based interface such as CIFS and NFS seamlessly.
Then users access to the Cloud Storage Gateway by CIFS or NFS, The “Cloud Storage Gateway” transforms user’s request to REST API request. After swift responds the request, the “Cloud Storage Gateway” transforms response of REST API to CIFS or NFS response.
Users can access the data in swift by file-based protocols.
This is the solution for file system interface issue
Second solutions about small file optimization are data management with small block size and storage cache. Most “Cloud Storage Gateway” has these two features. First is the feature which manages data with small block size. So, the latency to access many small files randomly is optimized
Second is storage cache which stores data which users accessed.
If “Cloud Storage Gateway” has the file user accesses in storage cache already, it returns the file to the user directly. Since there is no access to swift, the latency is very low
So, does combination of swift and “Cloud Storage Gateway” suit the requirements?
Although “Cloud Storage Gateway” solves the two issues, it is important to confirm if “Cloud Storage Gateway” has the feature of clustering because this feature depends “Cloud Storage Gateway”
If a “Cloud Storage Gateway” doesn’t support the clustering feature, it distinguishes the benefit of global cluster which all users share same files
We used “Fobas Cloud Storage Cache” which is one of Cloud Storage Gateway. It’s proprietary software.
This has many features. Of course, it has the features, data management with small block size and storage cache. Another notable feature is Loosely Cluster.
Loosely Cluster is the feature to bundle file systems of “Fobas Cloud Storage Cache” with virtual one file system, which enables to share same files in multiple locations in “Cloud Storage Gateway” layer. “Fobas Cloud Storage Cache” in multiple locations replicate meta data respectively. So, a user in North America can read the file which a user in Europe creates.
Since “Fobas Cloud Storage Cache” has clustering feature, the combination of Swift and “Fobas Cloud Storage Cache” can realize every requirements. So, we used it
This is a simple architecture. Each location has Swift and “Fobas Cloud Storage Cache”.
Since they are clustered and replicate data, all users can share same files.
We did performance test.
The table shows the result of comparing with the performance of ordinary fileserver. I’m sorry that I can’t share specific performances.
We got the result that the performance is enough good for file server when the protocol is nfs. When the protocol is CIFS, the performance is not so good. But, we can use it as file server which the performance is not high priority.
I want to share three limitations to leverage the solution
First is that the performance of CIFS protocol isn’t so good. I think the reason is that the performance is not so tuned so far, since "Cloud Storage Gateway" developers tend to focus on flexibility, scalability and availability. As "Cloud Storage Gateway" software market becomes matured, this problem would be solved.
Second is that the performance becomes much worse when data is not on cache. Of course, the reason is that the latency increases by that of swift because "Cloud Storage Gateway" gets data from swift. It is important to design size of storage cache carefully. It is the key that to compare performance and cost efficiency while thinking the tendency of data usage
Third is that there is a good and bad point of integration. The good point is that we can get software’s specific features such as Global Cluster. The bad point is that the availability becomes lower because possible failure points increase while the number of components are increasing
At last, let me suggest an idea. The market size of “Cloud Storage Gateway” is increasing rapidly. The market size would increase almost 8000% by this year if compared to the level of 6 years ago.
So, I think the demand of the combination of Swift and “Cloud Storage Gateway” is increasing. Although proprietary software have many useful features, it is not optimized for swift. How about developing “Cloud Storage Gateway” optimized for swift? In my opinion, there is a certain demand.
Summary of second use case.
This case is integrating swift as back-end storage of file server which has access from users in geographically separated areas.
Because swift doesn’t file-based protocols and is not good at processing small files in low latency, we join together swift and “Cloud Storage Gateway” to realize requirements. The performance is enough good
Since swift is superior to other software in global cluster feature, to realize file server which has the feature, Swift and “Cloud Storage Gateway” is very good combination