This document discusses integrating OpenStack into Sina's existing infrastructure. It describes Sina's business, infrastructure, and challenges faced in integrating OpenStack. Key integration challenges discussed include network deployment, security considerations, load balancing, and evaluating Swift for object storage. The document also outlines Sina's contributions to OpenStack around billing and monitoring integration.
Is OpenStack Neutron production ready for large scale deployments?Елена Ежова
OpenStack Neutron with ML2 OVS has always been a challenging component in terms of performance and scalability. However, in recent releases, several enhancements and bug-fixes have resulted in significant improvements in overall reliability, performance and scalability of Neutron. In this presentation, we will share the results of our testing (both control-plane and data-plane) at large scale and provide a detailed data-driven analysis that explores the true scale limits and bottlenecks of Neutron.
This presentation was shown at the OpenStack Online Meetup session on August 28, 2014. It is an update to the 2013 sessions, and adds content on Services Plugin, Modular plugins, as well as an Outlook to some Juno features like DVR, HA and IPv6 Support
Open stack networking_101_update_2014-os-meetupsyfauser
This is the latest Update to my OpenStack Networking / Neutron 101 Slides with some more Information and caveats on the new DVR and Gateway HA Features
BRKDCT-2445 Agile OpenStack Networking with Cisco Solutions - Cisco Live! US ...Rohit Agarwalla
One of the key areas of contributions from Cisco within OpenStack has been in the evolution and the development of the OpenStack Networking Service - Neutron. Using Neutron's Modular Layer 2 (ML2) plug-in and advanced services framework, Cisco has integrated products and solutions with the networking service to simplify the deployment of highly scalable, manageable and performant networks. Through this session we will cover and provide details of reference as well as the various OpenStack Neutron plugins/drivers for hardware and software Cisco products including the Nexus 1k/3k/5k/6k/7k/9k, UCS FI, CSR 1kv, ASR1K, CPNR and Application Policy Infrastructure Controller (APIC). The audience will also learn about Group Based Policy API in OpenStack that is based on the ACI Policy model. We will further discuss different OpenStack networking architecture, deployments and understand Cisco’s community code contribution that enable and support IPv6 and NFV related features in Neutron.
Is OpenStack Neutron production ready for large scale deployments?Елена Ежова
OpenStack Neutron with ML2 OVS has always been a challenging component in terms of performance and scalability. However, in recent releases, several enhancements and bug-fixes have resulted in significant improvements in overall reliability, performance and scalability of Neutron. In this presentation, we will share the results of our testing (both control-plane and data-plane) at large scale and provide a detailed data-driven analysis that explores the true scale limits and bottlenecks of Neutron.
This presentation was shown at the OpenStack Online Meetup session on August 28, 2014. It is an update to the 2013 sessions, and adds content on Services Plugin, Modular plugins, as well as an Outlook to some Juno features like DVR, HA and IPv6 Support
Open stack networking_101_update_2014-os-meetupsyfauser
This is the latest Update to my OpenStack Networking / Neutron 101 Slides with some more Information and caveats on the new DVR and Gateway HA Features
BRKDCT-2445 Agile OpenStack Networking with Cisco Solutions - Cisco Live! US ...Rohit Agarwalla
One of the key areas of contributions from Cisco within OpenStack has been in the evolution and the development of the OpenStack Networking Service - Neutron. Using Neutron's Modular Layer 2 (ML2) plug-in and advanced services framework, Cisco has integrated products and solutions with the networking service to simplify the deployment of highly scalable, manageable and performant networks. Through this session we will cover and provide details of reference as well as the various OpenStack Neutron plugins/drivers for hardware and software Cisco products including the Nexus 1k/3k/5k/6k/7k/9k, UCS FI, CSR 1kv, ASR1K, CPNR and Application Policy Infrastructure Controller (APIC). The audience will also learn about Group Based Policy API in OpenStack that is based on the ACI Policy model. We will further discuss different OpenStack networking architecture, deployments and understand Cisco’s community code contribution that enable and support IPv6 and NFV related features in Neutron.
Software Defined networking - An overview
OpenStack Neutron Overview
OpenVswitch - Overview
Neutron-VXLAN-GRE-OVS : behind the scenes
neutron Packet flow to external network
neutron Packet flow from VM to VM
Overview of OpenStack nova-networking evolution towards Neutron. Architecture overview of OVS plugin, ML2, and MidoNet Overlay product. Overview and example of Heat templates, along with automation of physical switches using Cumulus
This presentation for a talk at the Linux Tag 2014 has a couple of new Slides compared to earlier presentations that explain some different networking models like Flat, VLAN based, 'SDN Fabric based', etc.
Simplifying the OpenStack and Kubernetes network stack with RomanaJuergen Brendel
These slides were used during a meetup in Wellington, hosted by Catalyst IT. Pani Networks presented their Romana project: Cloud native, pure L3 networking for OpenStack and Kubernetes clusters.
Agile OpenStack Networking with Cisco SolutionsCisco DevNet
A session in the DevNet Zone at Cisco Live, Berlin. One of the key areas of contributions from Cisco within OpenStack has been in the evolution and the development of the OpenStack Networking Service - Neutron. Using Neutron's Modular Layer 2 (ML2) plug-in and advanced services framework, Cisco has integrated products and solutions with the networking service to simplify the deployment of highly scalable, manageable and performant networks. Through this session we will cover and provide details of reference as well as the various OpenStack Neutron plugins/drivers for hardware and software Cisco products including the Nexus 1k/3k/5k/6k/7k/9k, UCS FI, CSR 1kv, ASR1K, CPNR and Application Policy Infrastructure Controller (APIC). The audience will also learn about Group Based Policy API in OpenStack that is based on the ACI Policy model. We will further discuss different OpenStack networking architecture, deployments and understand Cisco’s community code contribution that enable and support IPv6 and NFV related features in Neutron.
Quantum (OpenStack Meetup Feb 9th, 2012)Dan Wendlandt
This is a talk I gave on Quantum at the Bay Area OpenStack Meetup on Feb 9th, 2012.
I added a few slides to try and address some of questions people had during the talk.
Interop Tokyo 2014 SDI (Software Defined Infrustructure) ShowCase Seminoar Presentation. The presentation covers Neutron API models (L2/L3 and Advanced Network services), Neutron Icehouse Update and Juno topics.
Designed for IT professionals looking to expand their OpenStack Networking knowledge, “Navigating OpenStack Networking” is a comprehensive and fast-paced session which provides an overview of OpenStack Networking, its history, its predecessor (Nova Networks), its components and then dives deep into the architecture, its features and plugin model and its role in building an OpenStack Cloud.
Do you want to modernize your data center? NSX has introduced amazing new technology and is the perfect ally for network and security administrators. But what if you want more agility? Could you imagine drinking coffee and watching the network configuring itself? Consuming NSX through configuration frameworks like Ansible or scripting languages such as Python or PowerShell goes a step beyond the simple usage of the GUI and allow for introducing custom advanced logic and workflows. Automating your infrastructure allows you to increase productivity, reduce errors due to manual configuration mistakes and simplify processes.
More on http://cloudmaniac.net
This was a tutorial which Mark McClain and I led at ONUG, Spring 2015. It was well received and serves as a walk through of OpenStack Neutron and it's features and usage.
These are the slides from the webinar "OpenStack networking (Neutron)", which covered the topics:
- OpenStack Networking: the Neutron project (NaaS);
- Main features of Neutron;
- Advanced networking functionalities in OpenStack.
This is my latest OpenStack Networking presentation. I presented it at OSDC 2014. It includes a lot of backup slides with CLI outputs that show how ML2 with the OVS agent creates GRE based overlay networks and logical routers
Software Defined Networking is seeing a lot of momentum these days. With server virtualization solving the virtual machines problem, and large scale object storage solving the distributed storage challenge, SDN is seen as key in virtual networking.
In this talk we don't try to define SDN but rather dive straight into what in our opinion is the core enabled of SDN: the virtual switch OVS.
OVS can help manage VLAN for guest network isolation, it can re-route any traffic at L2-L4 by keeping forwarding tables controlled by a remote controller (Openfow controller). We show these few OVS capabilities and highlight how they are used in CloudStack and Xen.
Xen Summit presentation of CloudStack and Software Defined Networks. OpenVswitch is the default bridge in Xen and supported in XenServer and Xen Cloud Platform
Software Defined networking - An overview
OpenStack Neutron Overview
OpenVswitch - Overview
Neutron-VXLAN-GRE-OVS : behind the scenes
neutron Packet flow to external network
neutron Packet flow from VM to VM
Overview of OpenStack nova-networking evolution towards Neutron. Architecture overview of OVS plugin, ML2, and MidoNet Overlay product. Overview and example of Heat templates, along with automation of physical switches using Cumulus
This presentation for a talk at the Linux Tag 2014 has a couple of new Slides compared to earlier presentations that explain some different networking models like Flat, VLAN based, 'SDN Fabric based', etc.
Simplifying the OpenStack and Kubernetes network stack with RomanaJuergen Brendel
These slides were used during a meetup in Wellington, hosted by Catalyst IT. Pani Networks presented their Romana project: Cloud native, pure L3 networking for OpenStack and Kubernetes clusters.
Agile OpenStack Networking with Cisco SolutionsCisco DevNet
A session in the DevNet Zone at Cisco Live, Berlin. One of the key areas of contributions from Cisco within OpenStack has been in the evolution and the development of the OpenStack Networking Service - Neutron. Using Neutron's Modular Layer 2 (ML2) plug-in and advanced services framework, Cisco has integrated products and solutions with the networking service to simplify the deployment of highly scalable, manageable and performant networks. Through this session we will cover and provide details of reference as well as the various OpenStack Neutron plugins/drivers for hardware and software Cisco products including the Nexus 1k/3k/5k/6k/7k/9k, UCS FI, CSR 1kv, ASR1K, CPNR and Application Policy Infrastructure Controller (APIC). The audience will also learn about Group Based Policy API in OpenStack that is based on the ACI Policy model. We will further discuss different OpenStack networking architecture, deployments and understand Cisco’s community code contribution that enable and support IPv6 and NFV related features in Neutron.
Quantum (OpenStack Meetup Feb 9th, 2012)Dan Wendlandt
This is a talk I gave on Quantum at the Bay Area OpenStack Meetup on Feb 9th, 2012.
I added a few slides to try and address some of questions people had during the talk.
Interop Tokyo 2014 SDI (Software Defined Infrustructure) ShowCase Seminoar Presentation. The presentation covers Neutron API models (L2/L3 and Advanced Network services), Neutron Icehouse Update and Juno topics.
Designed for IT professionals looking to expand their OpenStack Networking knowledge, “Navigating OpenStack Networking” is a comprehensive and fast-paced session which provides an overview of OpenStack Networking, its history, its predecessor (Nova Networks), its components and then dives deep into the architecture, its features and plugin model and its role in building an OpenStack Cloud.
Do you want to modernize your data center? NSX has introduced amazing new technology and is the perfect ally for network and security administrators. But what if you want more agility? Could you imagine drinking coffee and watching the network configuring itself? Consuming NSX through configuration frameworks like Ansible or scripting languages such as Python or PowerShell goes a step beyond the simple usage of the GUI and allow for introducing custom advanced logic and workflows. Automating your infrastructure allows you to increase productivity, reduce errors due to manual configuration mistakes and simplify processes.
More on http://cloudmaniac.net
This was a tutorial which Mark McClain and I led at ONUG, Spring 2015. It was well received and serves as a walk through of OpenStack Neutron and it's features and usage.
These are the slides from the webinar "OpenStack networking (Neutron)", which covered the topics:
- OpenStack Networking: the Neutron project (NaaS);
- Main features of Neutron;
- Advanced networking functionalities in OpenStack.
This is my latest OpenStack Networking presentation. I presented it at OSDC 2014. It includes a lot of backup slides with CLI outputs that show how ML2 with the OVS agent creates GRE based overlay networks and logical routers
Software Defined Networking is seeing a lot of momentum these days. With server virtualization solving the virtual machines problem, and large scale object storage solving the distributed storage challenge, SDN is seen as key in virtual networking.
In this talk we don't try to define SDN but rather dive straight into what in our opinion is the core enabled of SDN: the virtual switch OVS.
OVS can help manage VLAN for guest network isolation, it can re-route any traffic at L2-L4 by keeping forwarding tables controlled by a remote controller (Openfow controller). We show these few OVS capabilities and highlight how they are used in CloudStack and Xen.
Xen Summit presentation of CloudStack and Software Defined Networks. OpenVswitch is the default bridge in Xen and supported in XenServer and Xen Cloud Platform
Understanding and deploying Network VirtualizationSDN Hub
Analogous to server virtualization, Network Virtualization decouples and isolates virtual networks (i.e. tenant) from the underlying network hardware. One of the key value propositions of Software-Defined Networking (SDN) is to enable the provisioning and operation of virtual networks. This tutorial motivates the need for network virtualization, describes the high-level requirements, provides an overview of all architectural approaches, and gives you a clear picture of the vendor landscape.
Previously presented at ONUG Fall 2013 and Spring 2014.
A look at cloud network virtualization requirements, several implementation options, a retrospective on Neutron, and a presentation of the state of the art of Network Virtualization Overlays.
Midokura OpenStack Day Korea Talk: MidoNet Open Source Network Virtualization...Dan Mihai Dumitriu
OpenStack deployments for public or private clouds require overlay networking. Due to the scale and rate of change of virtual resources, it isn't practical to rely on traditional network constructs and isolation mechanims. Today's deployments require performance, resilience, and high availability to be considered truly production-ready. In this session, we deep dive into the MidoNet architecture, and process of sending a data packet across an OpenStack environment through a network overlay. A distributed architecture implements logical constructs that are used to build networks without a single point of failure, all while adding network functionality in a highly-scalable manner. Network functions are applied in a single virtual hop. By applying network services right at the ingress host, the network is free from unnecessary clogging and bottlenecks by avoiding additional hops. Packets reach their destination more efficiently with the single virtual hop. After this session, the audience will understand how distributed architectures allow efficient networking with routing decisions and network services applied at the edge. Also, the audience will understand how it is easier to scale clouds when the network intelligence is distributed.
Secure Multi Tenant Cloud with OpenContrailPriti Desai
Building a secure multi-tenant cloud necessitates proper tenant isolation and access control. Key network and security functions must scale independently based on the dynamic resource requirements across each tenant. Additionally, On-demand and self-service provisioning are required for achieving operational efficiencies. Robust, dynamic and elastic software abstractions are imperative to support applications built to run such complex environments.
This slide deck covers:
• Architectural design choices
• Implementation blueprints
• Operational best practices
that have been made to build OpenStack cloud at Symantec.
Session on CloudStack, intended for new users to CloudStack, provides an overview to varied audience levels information on usages, use cases, deployment and its architecture.
DevOps in a Public OpenStack Cloud - Hui ChengHui Cheng
Presented at OpenStack Summit Fall 2012, San Diego, by Hui Cheng. Detail notes see here: http://freedomhui.com/2012/10/devops-in-openstack-public-cloud/
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
2. Agenda
Background
● Who We Are
● Infrastructure & Platform
● Challenges
Integration Challenges
● Network Deployment
● Security Consideration
● Load Balancer
● Swift Evaluation
Our Contributions
● Billing
● Monitoring
3. Who Are We
Sina.com
• Largest infotainment web portal in China
• Provides various on-line services, like news, Finance,
video, email, blog hosting, etc.
• Operates first PaaS cloud computing platform
Sina Weibo
• twitter-like microblog service
• over 300m users
• huge influence on China's society
We are building a reliable, scalable and secure
infrastructure and platform to support our business.
4. Infrastructure & Platform
Physical Servers
Traditional Operation
Virtualization Platform(IaaS)
●VM Management System(VMMS) → Sina Web
Service(SWS)
●VMMS is private solution developed in-house
●SWS is based on OpenStack
Application Platform(PaaS)
●Virtual Host → Sina App Engine(SAE)
●SAE provides both Public and Private Service.
5. Sina App Engine
• No. 1 Public PaaS Platform in
China launched in Nov 2009
• PHP, Python, Java and Ruby
Support
• Numbers
160,000+ developers
200,000+ apps on SAE
800 million page views per day
20+ Services
• SAE Cloud Storage Service is replaced by Swift
• Deploy SAE on OpenStack
6. Challenges
SAE meets the majority of business needs, but does not cover
all, especially for web games
Customers require full stack of cloud computing
We Choose OpenStack as our IaaS solution
8. OpenStack Deployment
Rabbit
MySQL
dashboard
schedule
nova-api
nova-compute nova-compute
nova-network nova-network
keystone
glance
Sina SSO
Swift
9. Nova Network
Networking is the biggest challenges for IaaS
Network Topology:
• VLAN
• FlatDHCP
• FlatDHCP & Multihost
10. Network Topology --- VLAN
Capability:
• Accessibility of VMs within one tenant
• Isolation of VMs from different tenants
• VM is able to access public network
• VM can be accessible from public network
• Isolation between virtual network and
internal network
Drawback:
• Pre-allocate network for future projects
• Traffic bottleneck in the NAT gateway
12
11. Network Topology(Flat)
Capability:
• Accessibility of all VMs in the fixed IP range
• VM is able to access public network
• VM can be accessible from public network
• Full isolation between virtual network and
internal network
Drawback:
Tenant isolation lessens
Traffic bottleneck in the NAT gateway
13
12. Network Topology(Flat &
Multihost)
Capability:
• Accessibility of all VMs in the fixed IP range
• VM is able to access public network
• VM can be accessible from public network
Bonus:
• Totally distributed architecture avoid
single-point failure.
• Multiple gateway eliminates NAT bottleneck
• High throughout between OS regions
Drawback:
• Tenant isolation lessens
• Need security facility(SWS-filter) to protect
intranet
If security problems were solved, this would be our best choice!
14
13. Security in OpenStack
Security Group --- Layer 3 Filter Static filters --- Layer 2 Filter
Role-based firewall MAC, IP, and ARP spoofing protection
One security group is a Role Not configurable
Ingress filtering Defined in /etc/libvirt/nwfilter/*.xml
Target is the instance Implemented by ebtables
Source can be CIDR or another group ebtables -t nat --list
Implemented by iptables
See details: iptables -t filter -n -L
Whitelist mechanism(ACCEPT rules)
15
14. Security Enhancement
SWS Filter
Prevent Intranet Penetration
• Intranet is the internal network outside of
OpenStack
Egress filtering
• Target is internal network
• Source is instances in OpenStack
Implementation
• Whitelist mechanism(ACCEPT rules)
• On the top of nova-filter-top Forward
Chain
Rational
• SWS filter is managed by cloud manager
• Only explicit authorized packets can reach Internal network C
• Packet should be controlled within Compute Node
16
16. Load Balancer
Goals
Load Balance
• Dispatch request DNS Acceleration Design
• Support multiple routing algorithm
• Health check
Smart DNS
Acceleration
• Reality: narrow bandwidth between ISPs
• Building fiber channels from ISPs to pivot Public Network
• Given the same endpoint within user’s ISP
Telecom Unicom Mobile Others ISP
IPv4 Shortage
• Reality: dozens of public IPs support
hundreds of VMs High speed fiber channel
• IPv4 has been exhausted
• IPv6 is not realistic yet in China Pivot
18
18. Load Balancer
Layer 4 Load Balancer
Consideration:
1. dispatch request by TCP port
2. lvs + haproxy
20
19. Swift Evaluation
Extremely Durable and Highly Available
Superior Scalability
Linear Growth of Performance
Symmetric Architecture
No Single-failure
Simple & Reliable
21
20. Swift Evaluation
• 1 Zone = 1 Physical Server with 12x2T disk
GET abc.png • Write/Read applies quorum protocol
PUT abc.png
Load Balancer
Zone1 Zone2 Zone3 Zone4 Zone5
Proxy Server Proxy Server Proxy Server Proxy Server Proxy Server
Object Server Object Server Object Server Object Server Object Server
Container Server Container Server Container Server Container Server Container Server
Account Server Account Server Account Server Account Server Account Server
22
21. Swift Evaluation
Swift packages
Proxy Server
Account Server
Container Server
Object Server Physical Deployment
Storage Nodes
OS installation
sda sdb sdc sdd sdk
raid 1 ……
disk1 disk2 disk3 disk4 disk5 disk12
23
22. Swift Evaluation
Performance issue
CPU utilization rate up to 100% even without request
Testing environment: Audit:
Nodes: 5 x Dell R510 swift-account-auditor : 1.5m
CPU: Intel® Xeon® E5360 swift-account-replicator: 9.5m
Memory: 12GB
Replica: 3 swift-container-auditor: 8.4m
swift-container-replicator: 9.3m
No. of Objects: 150,000,000 swift-container-updater: 19.0m
No. of Accounts: 120,000
No. of Containers: 160,000 swift-object-updater: 0.1 s
swift-object-replicator: 10.5 hours
swift-object-auditor: 48.3 hours
Result:
Periodic scanning all partitions, calculating checksum and synchronization
24