The document discusses automated integration testing for CloudStack using Marvin, a Python testing framework, which simplifies creating custom cloud environments and executing API commands. It details the setup of a testing environment with various virtual machines and outlines both manual and automated procedures for creating cloud infrastructure and running test scenarios. Future enhancements include nightly tests using Jenkins and integration tests for additional virtualization environments.

1. CloudStack Automated
Integration Testing with Marvin

2. Mike Tutkowski
●CloudStack Software Engineer
●Member of CloudStack Project Management Committee (PMC)
●Focused on CloudStack’s storage component
SolidFire (http://www.solidfire.com/)
●Based out of Boulder, CO
●Develop a scale-out SAN technology
●Built from the ground up to support guaranteed Quality of Service (QoS) on a per-volume
(LUN) basis (min, max, and burst IOPS per volume)
●All-Flash Array
●Leverage compression, de-duplication, and thin provisioning (all inline) on a 4-KB block
boundary across the entire cluster to drive down cost/GB to be on par with traditional disk-
based SANs
●Rest-like API to enable automation of all aspects of the SAN

3. What is Marvin?
Python Testing Framework for CloudStack
* deployDataCenter module to make it easy to create a custom cloud (requires JSON
input file)
* Provides infrastructure for low-level communication with CS MS (cloudstackConnection
module)
* Easy-to-use modules for sending API commands to CloudStack (ex.
CreateStoragePoolCmd) and receiving responses (ex. CreateStoragePoolResponse).
* Common abstractions like StoragePool, Volume, Snapshot, Cluster, Host, etc. classes
* Utility modules for performing common activities (ex. Restart the management server)
* Write tests using the unittest module (start a test method with the word “test”, provide
setup, teardown methods, etc.)
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Marvin+-+Testing+with+Python

4. nosetests test_cloudstack_server.py
************************************************************
import paramiko
from nose import with_setup
from nose.tools import assert_equals
class TestStartCloudStackServer():
def setup(self):
ssh = paramiko.SSHClient()
ssh.set_missing_host_key_policy(paramiko.AutoAddPolicy())
ssh.connect('192.168.156.34', username='cloudstack', password='solidfire')
def teardown(self):
return
@with_setup(setup, teardown)
def test_start_cloudstack_server(self):

5. What needs to be automated?
1.Setup of the Test Environment
1.Creation of the Cloud Infrastructure
in CloudStack
1.Test Scenarios

6. Testing Environment
ESXi host with 3 VMs
●Ubuntu VM
●CS Management Server
●CS Database
●Secondary Storage (NFS share)
●2 XenServer VMs (add
vhv.enable = true to VMX file of
each VM)
●Hosts on which to run VMs

7. Setup of the Testing Environment
1.Talk to ESXi host:
Revert Ubuntu VM and each XenServer VM to a snapshot.
Start Ubuntu VM and each XenServer VM.
2.Put both XenServer hosts in the same resource pool (XenServer
name for a cluster).
3.SSH into Ubuntu VM
a.Update CloudStack codebase (git fetch upstream master)
b.Build codebase (mvn -P developer,systemvm clean install)
c.Rebuild the CloudStack database (mvn -P developer -pl
developer -D deploydb)
d.Run the CloudStack Management Server (mvn -pl client
jetty:run)

8. Manual Setup of the Testing Environment

9. Automated Setup of the Testing Environment
1. Revert VMs PySphere (vSphere Python
Module)
2. Put XenServer Hosts in
Cluster
xmlrpclib (Python Module) to
send XenAPI commands
3. Run Management Server Paramiko (Python Module that
implements SSH v2 protocol)

10. Creation of Our Cloud Infrastructure
1 Basic Zone
1 Pod
1 Cluster
2 XenServer Hosts
2 Primary Storages (local storage
on each XenServer host)
1 Secondary Storage

11. Manual Creation of the Cloud
Infrastructure

12. Automated Creation of the Cloud Infrastructure
1.Generate JSON Config File
1.Deploy Cloud with Marvin
deployDataCenter module

13. Test Scenarios (Follow a Pattern)
1.Create Resources
(SolidFire Primary Storage, Disk Offerings, Compute
Offerings)
1.Run test scenarios
1.Verify CloudStack DB
1.Verify SolidFire SAN

14. Manual CloudStack Tests

15. Automated CloudStack Tests
1. Create Resources Marvin (setup section of test)
2. Run Test Scenarios Marvin (test* methods)
3. Verify CloudStack DB Marvin (test* methods) &
Customized API Plug-in
4. Verify SolidFire SAN Marvin (test* methods) &
SolidFire REST-like API (via
SolidFire Python SDK)

16. Future tasks
1.Leverage Jenkins to Run Tests Nightly
1.Integration Tests for KVM and VMware
1.Integration with AT2