• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
JCO Conference OpenStack
 

JCO Conference OpenStack

on

  • 3,325 views

Jaesuk Ahn from KT

Jaesuk Ahn from KT

Statistics

Views

Total Views
3,325
Views on SlideShare
3,308
Embed Views
17

Actions

Likes
3
Downloads
80
Comments
0

4 Embeds 17

http://www.isaserver.co.kr 6
http://www.cloudplatform.co.kr 5
http://192.168.0.253 5
http://1.214.42.130 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    JCO Conference OpenStack JCO Conference OpenStack Presentation Transcript

    • (OpenStack)Public/Private
    • Index   OpenStack Overview  OpenStack Details
    • .  . •  IaaS (Infrastructure as a Service): , , on-demand . •  PaaS (Platform as a Service): / on-demand . •  SaaS (Software as a Service): on-demand  IaaS •  Public Cloud: . •  Private Cloud: , . •  Hybrid Cloud: Public Cloud Private Cloud .
    • ? Platform / Service MN O P Q ! ۨ Ȃ ‫ כּ‬R PaaS (Hadoop, M ongoDB % ) (Cloud Foundry) CloudM anagement OpenStack, CloudStack OpenNebula, Eucalyptus, CloudForms Utility M onitoring Automation (Zabbix, Nagios, collectd, Hyperic) (Puppet, Chef) Hypervisor Network Load Balancer Xen, KVM Ỵ Open Network (HAProxy) Foundation Datacenter / Open Flow Switch / Hardware (Open vSwitch) Open Compute File ZFS, Nexenta, GlusterFS % System
    • OpenStackPublic과 Private 클라우드를 구축하기 위한 오픈소스 Software / 커뮤니티
    • OpenStack ?   Public Private Sof tware , , , .   “Public & Private” , .
    • OpenStack ? #3 Cloud Prediction for 2011 OpenStack Will Come into its Own #2 Cloud Computing Story of 2010 This years new wonder of the open-source community Top 12 Cloud Gifts of 2010 One of the great success stories in open source for the cloud #3 Biggest Cloud Computing Story of 2010 Cloud Computing Game-Changer #5 Cloud Company to Watch in 2011 Ranked Above Red Hat and Salesforce.com
    • OpenStack ? ‣  커뮤니티: 1020 people / 77 companies ‣  Global 참여:" 디자인 서밋에 14 개국의 450여명이 참여 ‣  Global 사용자 그룹: Japan, Silicon Valley, New York, Austin, Egypt, South Korea, UK등
    • OpenStack ? OpenStack Object Storage OpenSta ck / / OpenStack ,6 OpenStack Object Storage " OpenStack Private OpenStack Object Storage ( ) Project Citrix Cerfified Openstack ( Rackspace / )>> OpenStack , OpenStackPrivate/Public .
    • … , ?  , !  OpenStack :( ) Private Cloud  OpenStack , – OpenStack . ?( : enStratus, Rightscale, Gladinet) – “ ” ? innovative  IaaS !
    • OpenStack ?  Control and Flexibility. . legacy 3rd Party .  Industry Standard. 14 70 Open Stack . OpenStack . Linux .  . Public / Private .  . OpenStack Secur ity Policy, , , Public OpenStack .
    • OpenStack ?  projects  Compute (code-named “Nova”) -  Provision /  Object Storage (code-named “Swift”) -  / .  Image Service (code-named “Glance”) -  , , , .
    • OpenStack Compute ?  OpenStack Compute Subproject : Codename “NOVA”   Cloud fabric controller   Infrastructure as a Service(IaaS)   Amazon EC2, Rackspace Cloud Servers, Eucalyptus, OpenNebula   Users and Projects   Hypervisor virtualization sw , web-based API  Nova   REST-based API :   : Commodity   Hypervisor : KVM, Xen, XenServer, UML, Hyper-V, Vmware vSphere, LXC   Asynchronous eventually consistent communication   Horizontally and Massively Scalable   Amazon EC2 API OpenStack API
    • Nova ?  http://ken.pepple.info/openstack/2011/04/22/openstack-nova-architecture/
    • Nova ?
    • Nova ?  Shared-Nothing, Message-based Compute nova-manag local method Auth Volume e Manager Controller local method Network Controller API Server local method Cloud OpenStack API Controller EC2 API Scheduler / Scheduler REST HTTP AMQP Object Compute Euca2ools Store Controller instance
    • Nova Logical
    • Nova ?  API   Hypervisor, storage networking /   HTTP   User EC2 access/secret key OpenStack API access key , API API Amazon EC2 API  VM instance, Security group, Volume, Snapshot, SSH key, VM image, IP address , Availability zone /  EC2 API command-line Euca2ools EC2 API OpenStack API   Rackspace Cloud Server API Servers, Images, Flavours, S hared IP /  Command-line novatools
    • Nova ?  Scheduler     Random, Simple   Multi-zone distributed Scheduler  Compute Node   Compute server   Instance Run, Terminate, Reboot   Volume Attach, Detach   Get console output  Network Node     Flat, Flat DHCP, VLAN DHCP
    • Nova ? 4. Ex) euca-run-instance 6. Role-Based 5. VM à ( ) 1. API Scheduler No Compute Nod de e User 7. API Server Network Node (RabbitMQ) 2.EC2 Access Key / Secret Key , Object Storage Se Volume Node rver 3.rpc.cast method: “run_instance ”
    • Nova ?  Flat Mode   instance bridge(‘br100’) IP   Instance network configuration ‘/etc/network/interface’  Flat DHCP Mode   Flat mode instance bridge   Ethernet device(‘eth0’) bridge   Instance ‘dhcpdiscover’ dnsmasq IP
    • Nova ?  VLAN DHCP Mode   instance public VPN   VLAN bridge  VLAN Private IP   Instance VLAN private IP  Nova VPN: CloudPipe   VLAN VLAN instance “cloudp ipe” VPN instance   CloudPipe instance VLAN IP 2 IP   port , network node public IP + port VPN
    • Nova ?
    • Nova Multi zone ?•  Zones Nova .•  Nested : Zones .•  Zone . (top-level Zones). A: API Service S: Scheduler Service N: Network Service V: Volume Service
    • ?  VLAN Network Internet 외부망 내부망
    • Nova ? Bexar Cactus Cactus DiabloAustin Release 2011.1.1 Feature Release Diablo1 Diablo2 Diablo3 Diablo4 ReleaseRelease (2011.1) Release Freeze (2011.2) 2011-02-03 03-03 2011-03-24 2011-04-14 2011-06-02 2011-06-30 2011-07-282011-08-252011-09-222010-10-21  Cactus Release 33 blueprint (8 deferred) Cactus Release Multi cluster in a region Region multi cluster http://wiki.openstack.org/MultiClusterZones IPv6 Flat, FlatDHCP, VLAN IPv4/IPv6 Multi NIC libvirt Support for more than one NIC per instance. Rackspace requires two nics minimum (1 public, 1 private), but this should be abstracted to support N NIC’s VMware vSphere Support Vmware vSphere as computer provider
    • Nova ? Cactus Release Live migration of running cloud servers Support migration (moving running VMs from one physical node to another) without shutting dow n the cloud server OpenStack API 1.1 New features in the OpenStack API 1.1 include IPv6 support, migration to the OpenStack names pace, and support for API extensions Unified Image Allow Nova to build instances directly from VHDs, with the customer data and kernel in one imag e. XS-Snapshots are already created as VHDs; this blueprint will allow Nova to boot the snapsh ots. LXC (Linux Container) LXC (Linux Containers) is an operating system-level virtualization method for running multiple is olated Linux systems (containers) on a single control host. LXC does not provide a virtual machi ne, but rather provides a virtual environment that has its own process and network space
    • Nova ? Bexar Cactus Cactus DiabloAustin Release 2011.1.1 Feature Release Diablo1 Diablo2 Diablo3 Diablo4 ReleaseRelease (2011.1) Release Freeze (2011.2) 2011-02-03 03-03 2011-03-24 2011-04-14 2011-06-02 2011-06-30 2011-07-282011-08-252011-09-222010-10-21  Diablo 68 blueprint Diablo blueprint Integrated nova auth OpenStack Rackspace Integrated network services IPAM(IP address management), DHCP/dnsmasq virtual network segment, n etwork containers, LBaaS(Load Balance As A Service) NaaS(Network As A Service) Integrated block storage iSCSI volume , volume migration, Swift volume
    • Nova ? Diablo Release Distributed & Advanced scheduler Multi-zone smart Service Provider Deployment Readiness OpenStack Nova deploy service provider Administrative vms VM/ API (load balancing, queuing systems, databases, load balancers, network bridging components) Boot from Volume Golden volume snapshot volume boot ※ blueprint https://blueprints.launchpad.net/nova/
    • OpenStack Object Storage (Swift)   •  – , ( ) / / •  Highly available, distributed, eventually consistent object/blob store •  Single Point of Failure •  à commodity server기반 저렴하고 안정적인 페타급 (PB) 스토리지 서비스 가능  - , à Amazon S3 (Simple Storage Service) 와 유사 •  Archiving & Distributing (+CDN) Data http://aws.amazon.com/solutions/case-studies/ •  3rd Party Applications & Solutions  REST API / Library 3rd-party
    •   Client [HTTP] Proxy Ser Account Account Server Sqlite PUT ver Ring , DB file GET DELETE Req/API h POST andling, Container Container Server , Ring , Sqlite DB file Object Object Server Ring  Ring ( ) File •  Object Ring dev1 10.1.1.1/sdc “PUT OBJ1” Hash >> Shift dev1 dev11 dev53 dev11 10.1.1.1/sdm dev53 10.1.1.5/sdg : : : * Shift(Hash) ,
    • Account, Container, Object •  URL us er User(s) •  Container Account •  Account User Account:User token https://swift.kt.com/v1/AUTH_57069e6e-2b54-4eeb-95a9-1eff53637978 •  Object (ex. Amazon S3 Bucket) Container Container • Access Control List(ACL) Contai ner https://swift.kt.com/v1/AUTH_57069e6e-2b54-4eeb-95a9-1eff53637978/TESTCONTAINER •  •  Container ACL Object Object •  Object ( , ) https://swift.kt.com/v1/AUTH_57069e6e-2b54-4eeb-95a9-1eff53637978/TESTCONTAINER/TESTFILE.txt
    • Ring   Ring •  A mapping between the names of entities stored on disk and their physical location •  3 Rings – Account Ring, Container Ring, Object Ring •  Using Zone, Devices, Partitions and Replicas info. to build a Ring * zone: zone (ex. , / )  Ring -   Replica: , 3 replicas   Zone: replica , 3 (=3replicas) ,4   Devices: ( ) - : 12 of 2TB disk per node, 8 node  96 devs, 192TB cf) 3 replica 1/3  64TB   Partitions: Zone ⊃ (node) ⊃ Devices  Partitions device * partition skew replication “ skew
    • Ring   Ring - HW deployment •  Proxy Network IO •  A/C/O Zone (Disk I/O) Zone-1 A/C/O A/C/O Server JBOD file Server JBOD … Proxy Serv s s er Zone-2 A/C/O A/C/O Server JBOD Server JBOD … Proxy Serv er s s Load Bala ncer Zone-3 A/C/O A/C/O … Server JBOD Server JBOD file … s s Proxy Serv er Zone-4 A/C/O A/C/O Server file JBOD Server JBOD … s s
    • Ring (2) 3 replicas   Ring - Ring build replica replica replica •  (ring-builder) 1 2 3 2^13 Partitions - zone 4 , zone 24 devs Dev0 Dev24 Dev48 - 8 (2^13) Dev1 Dev25 Dev49 •  weight ( = weight ) 0~95 dev index … … … •  Rebalance : partition * replica , : : : * weigh t  86*3  Ring   Rebalancing •  2  weight ( 1) weight device ) 96 , •  , , 2) r eplica 1 * 2^13  192 dev 43*3 2 2 * 1.5*2^13 rebalancing + replication
    • Ring (2)   Ring ? •  •  Partitions * Replicas , * Cassandra ring … hash / •  / •  : / •  :  / ex. 1) 70~80% + rebalancing 2) rebalancing 3) partition •  History of Ring, (http://swift.openstack.org/overview_ring.html) •  , Gossip  + •   , Single point of failure, •  
    • Related Info  – http://swift.openstack.org •  swift administrator, developers guide  : http://launchpad.net/swift •  , : Swift-1.3.0 (Cactus) •  Python 2.6, Ubuntu 10.04 •  xfs (xattr ) •  Sqlite3 DB  SAIO – Swift All-In-One •  Virtual machine •  Debugging? eclipse + pydev plugin + pydevd.settrace()  swift update (https://blueprints.launchpad.net/swift/diablo) •  •  •  Multi-cluster •  S3 API
    • Rackspace / Amazon   http://aws.amazon.com/solutions/case-studies/   http://69.20.89.3/apps/backup_and_collaboration/online_file_storage/ Rackspace Cloudfiles Amazon S3/EC2   Email Hosting  Application Hosting   Email Archiving  Backup and Storage   Email marketing  Content Delivery   File Sharing  E-Commerce   Backup & Collaboration  Media Hosting   Mobile applications  On-Demand Workforce  Search Engines  Web Hosting
    • Rackspace API   Rackspace CloudFiles API •  , API •  CyberDuck : •  Mobile App: (CDN) •  Plixi(Tweet Photo):
    • KT ucloud storage  KT •  cs: server •  ds: database service •  •  storage: storage service •  bs: backup service  cs.ucloud.com ...
    • Swift API   KT ucloud SS (Swift) tools URL Cloud storageCyberduck Open source FTP, SFTP, WebDAV, Cloud Cyberduck.ch Amazon S3 Files, FTP, WebDav Google Docs & Amazon S3 Browser for M Google Docs ac & Windows. Cloudfiles Window Azure Openstack Etc…Gladinet Seamless access, aggregate, and backup Gladinet.com Amazon S3 to cloud storage FTP, WebDav Google Docs Cloudfiles Internap Openstack Etc…Cloudfuse Cloudfuse is a FUSE application which pro ohloh.net/p/cloudfuse Cloudfiles vides access to Rackspaces Cloud Files ( Openstack(Swift) or any installation of Swift).
    • Swift API JAVA CLI client (1)  JAVA ANT  •  https://github.com/rackspace/java-cloudfiles/archives/master  •  /cloudfiles.properties version=v1 connection_timeout=5000 # Auth info auth_url=https://ssproxy.ucloud.com/auth/v1.0 auth_token_name=X-Auth-Token auth_user_header=X-Storage-User auth_pass_header=X-Storage-Pass  ANT
    • Swift API JAVA CLI client (2)  Windows @echo off java -cp lib/commons-cli-1.1.jar;lib/httpcore-4.1.jar;lib/httpclient-4.0.3.jar;lib/commons-lang-2.4.jar;lib/junit.jar;lib/commons-co dec-1.3.jar;lib/commons-io-1.4.jar;lib/commons-logging-1.1.1.jar;lib/log4j-1.2.15.jar;dist/java-cloudfiles.jar;.;classes; com.racks pacecloud.client.cloudfiles.sample.FilesCli pause  Linux, MAC #!/bin/sh export CLASSPATH=lib/commons-cli-1.1.jar:lib/httpcore-4.1.jar:lib/httpclient-4.0.3.jar:lib/commons-lang-2.4.jar:lib/junit.jar:lib/co mmons-codec-1.3.jar:lib/commons-io-1.4.jar:lib/commons-logging-1.1.1.jar:lib/log4j-1.2.15.jar:dist/java-cloudfiles.jar:. java com.rackspacecloud.client.cloudfiles.sample.FilesCli  •  username •  password API KEY (cs.ucloud.com ) •  account Enter •  help command
    • Swift API JAVA CLI client (3)  COMMAND •  get List the containers for this account •  get container List the contents of the given container •  get container/object destination Download the given object and store it at the destination •  head Get information about this account •  head container Get the containers information •  head container/object Get the objectss information and metadata •  put container Create the given container •  put container localfile Upload the local file to the container •  delete container Delete the container •  delete container/object Delete the given object •  help Print this help message •  exit Exit the program
    • Swift API APIAccount and Authentication GET account Account , , GET accounts list User , , PUT account (token, storage url) DELETE account * API GET user GET users list PUT user DELETE userStorage account service GET Storage account Container , HEAD Storage account Account POST Storage account Account metadataStorage container service HEAD Storage container Object , GET Storage container Container PUT Storage container Container , DELETE Storage container Container metadata POST Storage container : user metadata Container ACL POST Storage container : ACLStorage object service HEAD Storage object Object GET Storage object Object PUT Storage object Object copy Chunked Transfer Encoding Object Copy Object Object metadata POST Storage object DELETE Storage object
    • OpenStack Image Service (Glance)   OpenStack , , , .  query Standard REST API  Swift  upload •  RawMachine (kernel/ramdisk outside of imge, a.k.a. AMI) •  VHD (Hyper-V) •  VDI (VirtualBox) •  Qcow2 (QEMU/KVM) •  VMDK (VMWare) •  OVF
    • OpenStack ? ‣  OpenStack http:// ‣  OpenStack http: www.openstack.org //www.openstack.or.kr
    • ( ) www.jclouds.org (multi-cloud library)▷  jclouds 는 개발자들이 다양한 클라우드를 활용하고, 자바 개발 skill들을 재 사용 가능토록 하는 오픈소스 라이브러리이다. ▷  jclouds API는 Amazon, GoGrid, Microsoft Azure, vCloud, Rackspa ce, OpenStack등의 다양한 클라우드 환경을 지원하며, 개발자들이 각각 서비스들의 복잡한 API구성과는 상관없이, 자유롭게 클라우드 고유의 기능들을 자유롭게 사용할 수 있도록 함.   ( ) How to change cloud providers without restarti ng your JVM: http://www.youtube.com/watch?v=SJ7sm3lhKnw   Quick Start OpenStack: http://code.google.com/p/jclouds/wiki/QuickStartOpenStack
    • ( ) www.jclouds.org (multi-cloud library)
    • ?Openstack : www.openstack.or.kr Facebook OpenStack Korea Group : @songerie : jaesuk.ahn@gmail.com