• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Fluentd and MySQL
 

Fluentd and MySQL

on

  • 12,463 views

about fluent-plugin-mysql (super lightening talk presentation)

about fluent-plugin-mysql (super lightening talk presentation)

Statistics

Views

Total Views
12,463
Views on SlideShare
3,914
Embed Views
8,549

Actions

Likes
6
Downloads
23
Comments
2

12 Embeds 8,549

http://mysql-casual.org 4655
http://d.hatena.ne.jp 3622
http://rg443blog.wordpress.com 169
http://www.socialtoprunners.jp 66
http://webcache.googleusercontent.com 26
http://www35.jimdo.com 3
http://www.socialtoprunners.com 3
http://translate.googleusercontent.com 1
http://mysql-casual.sakura.ne.jp 1
http://hatenatunnel.appspot.com 1
https://www.google.co.jp 1
http://www.google.co.jp 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel

12 of 2 previous next

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • Great

    Thanks
    Are you sure you want to
    Your message goes here
    Processing…
  • thx
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Fluentd and MySQL Fluentd and MySQL Presentation Transcript

    • Fluentd and MySQL MySQL Casual Talks Vol.3 (2012/04/19) LT @tagomoris NHN Japan Corp.12年4月20日金曜日
    • Whats Fluentd ? • Log collector daemon we all loves. • Message (key-value pairs) without schema12年4月20日金曜日
    • Storage systems with Fluentd • HDFS of Hadoop • Amazon S3 • MongoDB • Online aggregation and graphs12年4月20日金曜日
    • RDBMS with Fluentd? • Schema is fine! • Schema-less fluentd message is not suitable for RDBMS.... $ gem search -r fluent-plugin-mysql *** REMOTE GEMS *** $12年4月20日金曜日
    • If it doesnt exists, Ill write it. 無いのなら 作ってしまえ プラグイン12年4月20日金曜日
    • fluent-plugin-mysql • Fluentd buffered output plugin • https://github.com/tagomoris/fluent-plugin-mysql • Released just before this LT! • Now, we can do gem install fluent-plugin-mysql12年4月20日金曜日
    • Schema ?12年4月20日金曜日
    • We have mysql_json ! • "mysql_json - a MySQL UDF for parsing JSON" • http://blog.kazuhooku.com/2011/09/mysqljson-mysql-udf-for-parsing-json.html • https://github.com/kazuho/mysql_json12年4月20日金曜日
    • Simple configuration <source>   type forward </source> <match test.*>   type mysql   host localhost   database applogs   username root   sql INSERT INTO tbl SET jsondata=?   format json   flush_interval 1s </match>12年4月20日金曜日
    • Coooooooool!!!! mysql> select * from tbl where json_get(jsondata, pospos) like moge%; +----+----------------------------------------------+ | id | jsondata                                     | +----+----------------------------------------------+ |  2 | {"hoge":1,"pospos":"mogemogemogemogemogege"} | +----+----------------------------------------------+ 1 row in set (0.00 sec)12年4月20日金曜日
    • Thanks ! (See you next in Fluentd Casual Talks!)12年4月20日金曜日
    • Schema.... • fluent-plugin-mysql also supports schema-full insert. • like below: <match test.*>   type mysql   host localhost   database applogs   username root   key_names status,path,rhost,agent,referer table tbl columns status,path,rhost,agent,referer   flush_interval 1s </match>12年4月20日金曜日