This document discusses how Cacoo, a collaborative drawing tool, utilizes AWS and open source software to scale their service globally and handle rapid user growth. It describes how Cacoo uses AWS services like EC2, S3, and CloudFront to flexibly expand infrastructure on demand. Real-time collaboration is enabled through a custom BlazeDS messaging system using command patterns to synchronize edits between users. Over 400 million commands have been saved to support collaboration. Open source tools like Fabric and Boto simplify server operations.

1. How we spread out our service globally
by utilizing
AWS and open source software
2013/08/04(sun)

2. Takashi SOMEDA
染田 貴志
COSCUP 2013 Taipei
https://twitter.com/tksmd
Technology Evangelist at Nulab,Inc.
JAWS UG Kyoto Branch leader
About me
https://facebook.com/takashi.someda
Write tech articles about AWS, SCM
https://github.com/tksmd

4. COSCUP 2013 Taipei
Backlog is a project management tool that 1,800 companies use.
In addition to issue management feature, Backlog provides
• File sharing by WebDAV
• Git and Subversion repository hosting.
Visit http://backlogtool.com/tw/

5. 920,000 users around the world draw wireframes, network
diagrams, UML, business plans and so on.
Cacoo provides basic functionality as a draw tool and powerful collaborative
features like
• Simultaneous Editing on same diagram by multiple users
• Integration with Google Services like Google Apps, Google Drive and Google+
Hangouts

6. Examples
COSCUP 2013 Taipei

7. User Growth of Cacoo
COSCUP 2013 Taipei
0
100,000
200,000
300,000
400,000
500,000
600,000
700,000
800,000
900,000
1,000,000
Oct,2010 Oct,2011 Oct,2012 Aug,2013
62,000
200,000
600,000
920,000
All
Japan
Overseas

8. Agenda
COSCUP 2013 Taipei
 Service Overview
 Real time collaboration
 Flexible Infrastructure by AWS
 Summary

9. Service Overview
http://www.flickr.com/photos/ancientsword/2856148716/

10. Service Components
COSCUP 2013 Taipei

11. Software Architecture
COSCUP 2013 Taipei

12. Real time Collaboration
http://www.flickr.com/photos/ian_munroe/3315718996/

13. Simultaneous Editing
COSCUP 2013 Taipei

14. BlazeDS client
COSCUP 2013 Taipei
http://livedocs.adobe.com/blazeds/1/blazeds_devguide/lcarch_2.html

15. BlazeDS server
COSCUP 2013 Taipei
http://livedocs.adobe.com/blazeds/1/blazeds_devguide/lcarch_3.html

16. Message flow between Cacoo Editors
COSCUP 2013 Taipei

17. Synchronize MessageDestination
COSCUP 2013 Taipei
Patch added to
flex.messaging.cluster.JGroupsCluster
flex.messaging.cluster.ClusterNode
Using custom MessageService extends
flex.messaging.services.MessageService
( can be configured in messaging-config.xml )

18. What message exchanged
COSCUP 2013 Taipei
http://www.flickr.com/photos/dps/7161557/
Command

19. Command Execution Model
COSCUP 2013 Taipei
1.add 1.add1.add
2.move
Undomoveadd
1.add
2.zoom
zoom …

20. Command Interface
COSCUP 2013 Taipei
public class Command implements IExternalizable {
public var sequenceNo:uint = 0;
public var isLocal:Boolean = true;
public function Command() {
}
public function execute():void {
}
public function undo():void {
}
public function redo():void {
execute();
}
:
}
/*
sequenceNo keeps the order of commands to be
executed in each editors.
isLocal is used to distinguish that the command is
created on local editor or it is received from other
editor.
*/

21. # of Saved Commands
COSCUP 2013 Taipei
430,749,991

22. Partition on different tablespaces
COSCUP 2013 Taipei
create table command_01 ( LIKE command INCLUDING INDEXES INCLUDING DEFAULTS
INCLUDING CONSTRAINTS,
CHECK (diagram_id % 4 = 0)
) INHERITS (command) TABLESPACE tblspc_01;
ALTER TABLE command_01_pkey set tablespace tblspc_01;

23. Flexible Infrastructure by AWS
http://www.flickr.com/photos/naturegeak/5688437941/

24. Cacoo for Google+ Hangouts
COSCUP 2013 Taipei
http://launch-hangouts.cacoo.com/lp-zh_tw.html

25. We had only one month
COSCUP 2013 Taipei
beginning of March 2012
Cacoo became a candidate of the 3rd party app
announced on Hangouts API launch
28th Mar. 2012
Cacoo for Google+ Hangouts launched
Need to
 Develop application
 Do performance testing estimating 10-20 times accesses than
that of cacoo.com at that time
 Prepare 10+ Servers for performance testing and new
production environment

26. Simplify server operations
COSCUP 2013 Taipei
@task
def add_app(zone):
ec2 = connect_ec2()
ami = ec2.get_image(AMI_ID['app'])
r = ami.run(min_count=1, max_count=1,
key_name=KEY_NAME, user_data=load_cloudinit_script(),
security_groups=['app’],instance_type=INSTANCE_TYPE['app'],
block_device_map=create_block_device_map(),
placement=zone, instance_initiated_shutdown_behavior='stop')
instance = r.instances[0]
wait_for_startup(instance)
execute(”setup_app", hosts=[instance.public_dns_name])
execute(”update_hosts", roles=['all'])
execute(”start_app", hosts=[instance.public_dns_name])
execute(“update_nginx_upstream”)
$ fab add_app:zone=us-west-1a
# fabric and boto
# http://fabfile.org
# http://docs.pythonboto.org/

27. Tipping Point Example #1
COSCUP 2013 Taipei

28. Tipping Point Example #2
COSCUP 2013 Taipei

29. What we did for those growth
COSCUP 2013 Taipei
# For example1
$ ec2addsnap
$ ec2addvol –snapshot <snap_id> –s 1024G
$ ec2attvol
# For example2
$ ec2run

30. CloudFront for SWF distribution
COSCUP 2013 Taipei
Loading SWF is 10+ times faster

31. Summary
http://www.flickr.com/photos/nauright/2662160957/

32. OSS and AWS enable us
COSCUP 2013 Taipei
To fit the infrastructure according to the growth
To make it available to use all over the world
To make realize the key features quickly

33. COSCUP 2013 Taipei
Thanks!!
Q and A