Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

StackStormを1年間データ基盤で使ってみてぶつかったトラブルとその解決策の共有

480 views

Published on

StackStorm Meetup JP #7 https://stackstorm-jp.connpass.com/event/125944/ 発表資料

Published in: Technology
  • Be the first to comment

StackStormを1年間データ基盤で使ってみてぶつかったトラブルとその解決策の共有

  1. 1. StackStorm 1 / @laclefyoshi / ysaeki@r.recruit.co.jp
  2. 2. : / @laclefyoshi • 2011/04 • 2015/09 • • (FutureOfData; 2016) • Queryable State for Kafka Streams (Apache Kafka Meetup Japan #2; 2016) • Apache Spark ( Geek Night #11; 2016) • (BigData-JAWS #6; 2017) • Apache Kafka 0.11 Exactly Once Semantics (Apache Kafka Meetup Japan #3; 2017) • Apache Kafka 
 (Apache Kafka Meetup Japan #4; 2018) • StackStorm (Tech Night @ Shiodome #8; 2018) • Neptune (BigData-JAWS #13; 2018) 2
  3. 3. StackStorm 1
  4. 4. 1 https://www.slideshare.net/laclefyoshi/stackstorm-99437154 4
  5. 5. 5
  6. 6. logging.conf consoleHandler →journald st2xxx → journald → rsyslogd 6
  7. 7. Timeout 1/2 • 1 • grpc : https://github.com/grpc/grpc/issues/17986 • St2 gsutil • gsutil v1.9.0 St2 ↓ St2 Status = Timeout 7
  8. 8. Timeout 2/2 • 2 • • AM3 logrotate logrotate ↓ St2 Status = Timeout 8
  9. 9. Running ↓ St2 Status = Running • • logrotate etc. st2actionrunner RabbitMQ PostgreSQL for Mistral 
 9
  10. 10. CronTimer • st2ruleengine 
 CronTimer 10
  11. 11. • st2 get … ASCII Python2 : st2 execution get … -d DEBUG st2 execution get … -j JSON CLI st2 execution get … UnicodeEncodeError: 'ascii' codec can't encode characters 11
  12. 12. Web UI • Web UI • React Run Web UI CLI Web UI ↓ 12
  13. 13. 1/2 • 1 stdbuf -o0 
 1 core.remote 
 2 ↓ 2 1 
 KB 10KB 13
  14. 14. 2/2 • pseudo tty SSH • st2common/st2common/runners/paramiko_ssh.py sudo paramiko.channel.Channel.get_pty 370 get_pty 1 core.remote 
 2 ↓ 2 1 
 KB 10KB 14
  15. 15. • St2 React OS • 
 OSS • v2.9 • v3 Python3 • Orquesta Mistral 16

×