The document describes TOFU (Tofu on the Fly), a system for dynamically generating and caching image thumbnails on Amazon S3. It works by installing an Apache module that generates thumbnails using ImageMagick when images are requested, then caches them on S3 for future requests. This avoids hitting application servers for every image and provides scalability. The document discusses the TOFU architecture, implementation details, performance testing results, and strategies for integrating with CDNs like Akamai to improve performance.

2. @mirakui

13. BEFORE TOFU
app
app
app
apache
apache

19. 800
…

22. 800
…

27. 800
7,000 /sec

29. IDC→EC
2

30. BEFORE TOFU
app
app
app
NFS
apache
apache

31. BEFORE TOFU
app
app
app
NFS
apache
apache

32. BEFORE TOFU
app
app
app
NFS
apache
apache

33. BEFORE TOFU
app
app
app
NFS
apache
apache

34. NFS

35. S3

36. 99.999999999%

38. TOFU

39. BEFORE TOFU
app
app
app
apache
apache

40. AFTER TOFU
app
app
app
TOFU
apache

41. http://d3921.image.cookpad.com/recipes/
1237075/100x141c/
0b9c3ad1cba65869058e17cf78988bcb.jpg

42. http://d3921.image.cookpad.com/recipes/
1237075/100x141c/
0b9c3ad1cba65869058e17cf78988bcb.jpg

43. ID
http://d3921.image.cookpad.com/recipes/
1237075/100x141c/
0b9c3ad1cba65869058e17cf78988bcb.jpg

44. http://d3921.image.cookpad.com/recipes/
1237075/100x141c/
0b9c3ad1cba65869058e17cf78988bcb.jpg

45. ‘100’
‘100x100’
‘100x100c’
‘100x100c40_198_137_104_300’

46. ‘100x100cq10’
‘100x100cq30’
‘100x100cq50’
‘100x100cq70’
‘100x100cq90’

47. http://d3921.image.cookpad.com/recipes/
1237075/100x141c/
0b9c3ad1cba65869058e17cf7
8988bcb.jpg

48. DEMO

50. Apache module (mod_tofu.so)
ImageMagick(Wand)
Amazon S3

51. <Location />
SetHandler tofu
AWSAccessKeyId AKIXXXXX
AWSSecretAccessKey XXXXXXXXXXX
AWSS3BucketName my-tofu-bucket
</Location>
s3://my-tofu-bucket/recipes/1234/1234.jpg
http://[host]/recipes/1234/[size]/[hash].jpg

52. 3

59. TOFU

61. akamai (cdn)
ELB
ec2
c1.xlarge
Apache Apache Apache
(mod_tofu) (mod_tofu) … (mod_tofu) x6
S3

63. ImageMagick
OR
Imlib2

64. ImageMagick or Imlib2
Imlib2
Imlib2
ImageMagick

65. ImageMagick

66. ImageMagick
ImageMagick

67. EC2

68. TOFU

69. akamai (cdn)
ELB
Apache Apache Apache
(mod_tofu) (mod_tofu) … (mod_tofu)
S3

70. instance cores memory price
m1.large 2 7.5gb 23,904/
m1.xlarge 4 15gb 47,808/
c1.xlarge 8 7gb 47,808/
m2.xlarge 2 17.1gb 35,868/
m2.2xlarge 4 34.2gb 71,712/
m2.4xlarge 8 68.48gb 142,826/
$1=83yen, tokyo region

71. c1.xlarge
8 cores / 20 ECUs
core c1.xlarge
tofu CPU

72. S3

73. S3

74. 2011.4.12
s3::ListAllBuckets
→
…

75. S3

76. Akamai

77. akamai (cdn)
ELB
Apache Apache Apache
(mod_tofu) (mod_tofu) … (mod_tofu)
x6
S3

78. Akamai
CDN
(Contents Delivery Network)
80% 1hop
SLA100%

79. Akamai
OR
CloudFront

80. CloudFront
AWS CDN
S3 EC2
Akamai
(Custom Origin )

81. Akamai CloudFront
50
37.5
25
12.5
0
ping (msec)
※ just-ping.com

82. Akamai

83. Akamai

84. akamai (cdn) hit90%
ELB
Apache Apache Apache
(mod_tofu) (mod_tofu) … (mod_tofu)
S3

85. akamai (cdn) hit90%
ELB 24
CACHE(?)
hit60%
Apache Apache Apache
(mod_tofu) (mod_tofu) … (mod_tofu)
S3

86. akamai (cdn)
ELB
Varnish Varnish
Apache Apache Apache
(mod_tofu) (mod_tofu) … (mod_tofu)
S3

87. …

88. instance cores memory price
m1.large 2 7.5gb 23,904/
m1.xlarge 4 15gb 47,808/
c1.xlarge 8 7gb 47,808/
m2.xlarge 2 17.1gb 35,868/
m2.2xlarge 4 34.2gb 71,712/
m2.4xlarge 8 68.48gb 142,826/
……

89. akamai (cdn)
ELB tofu
Varnish Varnish
Apache Apache ApacheApache
ApacheApache
(mod_tofu) (mod_tofu) … (mod_tofu) (mod_tofu)
(mod_tofu)
(mod_tofu)
S3

91. TOFU
UP →