Automatically scale out EC2
Get the AS Command Line Tools:
1) Launch config:AMI to be used
2) Autoscaling group: where/how to launch
3) Autoscaling policy: what should AS do?
4) Autoscaling trigger: what will activate AS
Four main components
set JAVA_HOME=C:Program FilesJavajre6
set JAVA_HOME=C:Program Files (x86)Javajre6 (Windows 7)
ZFS on Amazon EC2
How to install and run
ZFS on Amazon EC2
(yes, you can!)
(demo coming soon)
What is ZFS?
ZFS is a file system + logical volume manager.
- protection against data corruption
- support for high storage capacities
- integration of filesystem and volume management
- snapshots and copy-on-write clones
- continuous integrity checking and automatic repair
- native NFSv4 ACLs.
OpenZFS is an Open Source implementation of it.
How can I use it?
Launch an EC2 instance with an AMI which supports
2) OmniOS (native ZFS support based on a fork of the
original OpenSolaris project that open-sourced ZFS)
3) FreeBSD (native ZFS support based on a port of the
OpenSolaris ZFS code)
And now what?
It works the same as with any other hardware
1) Attach a few EBS volumes to your EC2 instance;
2) use them as you would use regular disks with ZFS
An example follows.
$ sudo modprobe zfs
[attach 3 EBS volumes to the instance]
$ sudo zpool create test raidz sdf sdg sdh
$ sudo zpool status
scan: none requested
NAME STATE READ WRITE CKSUM
test ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
sdf ONLINE 0 0 0
sdg ONLINE 0 0 0
sdh ONLINE 0 0 0
errors: No known data errors
/dev/xvda1 on / type ext4 (rw,noatime)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
test on /test type zfs (rw,xattr)
$ df -h
Filesystem Size Used Avail Use% Mounted on
/dev/xvda1 7.9G 1.6G 6.3G 20% /
tmpfs 15G 0 15G 0% /dev/shm
test 196G 0 196G 0% /test
What can I do with ZFS?
Many things! Here’s one example:
Use an EBS Provisioned IOPS volumes as ZFS cache
and log (ZIL) devices to accelerate your zpools.
This works much like you would use SSDs in the real
world to accelerate ZFS reads and writes.
For instance, you could provision an EBS volume with
1000 IOPS and use it as a ZIL device for your zpool in
order to accelerate database writes.
Friends, nice people,
cool things, etc.