Uploaded byHiroyuki Inoue
リアルタイム分析サービス『たべみる』を支える高可用性アーキテクチャ
The document outlines an architecture for utilizing AWS services including EC2, ELB, and Redshift for both online and batch processing applications. It describes data unloading from Redshift to an S3 bucket and subsequent data loading from S3 into Redshift, detailing the necessary credentials and formatting. The setup spans multiple availability zones for enhanced reliability.
リアルタイム分析サービス『たべみる』を支える高可用性アーキテクチャ
- 2.
- 3.
- 4.
- 5.
- 6.
- 7. • • Users Apps (EC2) ELB MySQL TD (Hadoop) Redshi< 夜間バッチ オンライン
- 8.
- 9. • • • Users Apps (EC2) ELB Redshi< for Apps Redshi< for Batch
- 10. • • • • Availability Zone A Availability Zone B Users Apps (EC2) ELB Redshi< for Apps Redshi< for Batch
- 11. • • unload (‘select * from stats’) to ‘s3://…’ credentials ‘…’ delimiter ‘,’ addquotes escape ; copy stats from ‘s3://…’ credentials ‘…’ delimiter ‘,’ removequotes escape ; Redshi< for Apps Redshi< for Batch S3 Bucket unload copy
- 12.
- 13.
- 14.