SlideShare a Scribd company logo
Submit Search
Upload
Login
Signup
Data Processing and Ruby in the World
Report
SATOSHI TAGOMORI
Follow
Software Engineer at Treasure Data, Inc.
Feb. 24, 2018
•
0 likes
•
6,541 views
1
of
18
Data Processing and Ruby in the World
Feb. 24, 2018
•
0 likes
•
6,541 views
Download Now
Download to read offline
Report
Technology
"Recent Ruby" talk at Ruby 25th Anniversary
SATOSHI TAGOMORI
Follow
Software Engineer at Treasure Data, Inc.
Recommended
Ruby and Distributed Storage Systems
SATOSHI TAGOMORI
13.3K views
•
43 slides
Heroku Dockerの使い所
Yusuke Kon
2.4K views
•
24 slides
Fluentd - Flexible, Stable, Scalable
Shu Ting Tseng
14.2K views
•
35 slides
Realtime Search Infrastructure at Craigslist (OpenWest 2014)
Jeremy Zawodny
14.5K views
•
24 slides
Sphinx at Craigslist in 2012
Jeremy Zawodny
5.3K views
•
31 slides
Lisp in the Cloud
Mike Travers
5.7K views
•
13 slides
More Related Content
What's hot
Cassandra vs. Redis
Tim Lossen
27.3K views
•
64 slides
Real time fulltext search with sphinx
Adrian Nuta
12.6K views
•
35 slides
OpenStack Trove in Production at eBay - Trove Day 2014
Tesora
2.1K views
•
21 slides
Monitoring the ELK stack using Zabbix and Grafana (Dennis Kanbier / 26-11-2015)
Nederlandstalige Zabbix Gebruikersgroep
9.2K views
•
31 slides
企業・業界情報プラットフォームSPEEDAにおけるElasticsearchの活用
Akira Kitauchi
9.2K views
•
62 slides
The Wix Microservice Stack
Tomer Gabel
1.7K views
•
42 slides
What's hot
(20)
Cassandra vs. Redis
Tim Lossen
•
27.3K views
Real time fulltext search with sphinx
Adrian Nuta
•
12.6K views
OpenStack Trove in Production at eBay - Trove Day 2014
Tesora
•
2.1K views
Monitoring the ELK stack using Zabbix and Grafana (Dennis Kanbier / 26-11-2015)
Nederlandstalige Zabbix Gebruikersgroep
•
9.2K views
企業・業界情報プラットフォームSPEEDAにおけるElasticsearchの活用
Akira Kitauchi
•
9.2K views
The Wix Microservice Stack
Tomer Gabel
•
1.7K views
Railsチュートリアルの歩き方 (第4版)
Yohei Yasukawa
•
427.8K views
KeyValue Stores
Mauro Pompilio
•
3.8K views
T4T Training day - NodeJS
Tim Sommer
•
763 views
How Shit Works: Storage
Tomer Gabel
•
914 views
Vespa - Tokyo Meetup #yjmu
Yahoo!デベロッパーネットワーク
•
739 views
Making the case for write-optimized database algorithms / Mark Callaghan (Fac...
Ontico
•
704 views
MongoDB World 2016: Scaling MongoDB with Docker and cGroups
MongoDB
•
5.7K views
Using Sphinx for Search in PHP
Mike Lively
•
5.7K views
Fusion-io and MySQL at Craigslist
Jeremy Zawodny
•
3.9K views
Introduction to Napa.js
Daiyi Peng
•
346 views
Frontera: open source, large scale web crawling framework
Scrapinghub
•
5.9K views
新浪微博开放平台Redis实战
mysqlops
•
19.8K views
Lessons Learned Migrating 2+ Billion Documents at Craigslist
Jeremy Zawodny
•
20K views
London HUG 8/3 - Nomad
London HashiCorp User Group
•
1.1K views
Similar to Data Processing and Ruby in the World
The story of language development
Hiroshi SHIBATA
10.9K views
•
45 slides
II-SDV 2017: Custom Open Source Search Engine with Drupal 8 and Solr at Frenc...
Dr. Haxel Consult
1.2K views
•
47 slides
Ship It ! with Ruby/ Rails Ecosystem
Yi-Ting Cheng
1.8K views
•
75 slides
Make your app idea a reality with Ruby On Rails
Nataly Tkachuk
669 views
•
38 slides
How to distribute Ruby to the world
Hiroshi SHIBATA
3.8K views
•
51 slides
Open source-secret-sauce-rit-2010
Ted Husted
401 views
•
75 slides
Similar to Data Processing and Ruby in the World
(20)
The story of language development
Hiroshi SHIBATA
•
10.9K views
II-SDV 2017: Custom Open Source Search Engine with Drupal 8 and Solr at Frenc...
Dr. Haxel Consult
•
1.2K views
Ship It ! with Ruby/ Rails Ecosystem
Yi-Ting Cheng
•
1.8K views
Make your app idea a reality with Ruby On Rails
Nataly Tkachuk
•
669 views
How to distribute Ruby to the world
Hiroshi SHIBATA
•
3.8K views
Open source-secret-sauce-rit-2010
Ted Husted
•
401 views
Open Innovation means Open Source
Bertrand Delacretaz
•
1.4K views
Ruby Kaigi09 China Rubyupdate20090718
tengu
•
786 views
APIs in production - we built it, can we fix it?
Martin Gutenbrunner
•
285 views
Guidance, Code and Education: ScalaCenter and the Scala Community, Heather Mi...
OW2
•
93 views
The secret of programming language development and future
Hiroshi SHIBATA
•
1.1K views
Data Curation @ SpazioDati - NEXA Lunch Seminar
SpazioDati
•
2.2K views
10 technische SEO Hacks | Dominik Wojcik | SEOkomm 2017
TA Trust Agents Internet GmbH
•
1.6K views
Druid: Under the Covers (Virtual Meetup)
Imply
•
163 views
Mongodb - drupal dev days
Pierre Joye
•
1.4K views
Drupal Efficiency - Coding, Deployment, Scaling
smattoon
•
1K views
Open Innovation means Open Source
Bertrand Delacretaz
•
2.3K views
Atlanta OpenStack Summit: Technical Deep Dive: Big Data Computations Using El...
Sergey Lukjanov
•
1.4K views
First Pull Request - Sergio Ocon - ManageIQ Design Summit 2016
ManageIQ
•
756 views
At&T Interactive: The Many Facets Of Ruby
Coby Randquist
•
1.1K views
More from SATOSHI TAGOMORI
Ractor's speed is not light-speed
SATOSHI TAGOMORI
4.6K views
•
26 slides
Good Things and Hard Things of SaaS Development/Operations
SATOSHI TAGOMORI
829 views
•
23 slides
Maccro Strikes Back
SATOSHI TAGOMORI
7.8K views
•
33 slides
Invitation to the dark side of Ruby
SATOSHI TAGOMORI
15.4K views
•
31 slides
Hijacking Ruby Syntax in Ruby (RubyConf 2018)
SATOSHI TAGOMORI
11.1K views
•
53 slides
Make Your Ruby Script Confusing
SATOSHI TAGOMORI
1.4K views
•
18 slides
More from SATOSHI TAGOMORI
(20)
Ractor's speed is not light-speed
SATOSHI TAGOMORI
•
4.6K views
Good Things and Hard Things of SaaS Development/Operations
SATOSHI TAGOMORI
•
829 views
Maccro Strikes Back
SATOSHI TAGOMORI
•
7.8K views
Invitation to the dark side of Ruby
SATOSHI TAGOMORI
•
15.4K views
Hijacking Ruby Syntax in Ruby (RubyConf 2018)
SATOSHI TAGOMORI
•
11.1K views
Make Your Ruby Script Confusing
SATOSHI TAGOMORI
•
1.4K views
Hijacking Ruby Syntax in Ruby
SATOSHI TAGOMORI
•
43.8K views
Lock, Concurrency and Throughput of Exclusive Operations
SATOSHI TAGOMORI
•
2K views
Planet-scale Data Ingestion Pipeline: Bigdam
SATOSHI TAGOMORI
•
6.3K views
Technologies, Data Analytics Service and Enterprise Business
SATOSHI TAGOMORI
•
5K views
Perfect Norikra 2nd Season
SATOSHI TAGOMORI
•
6.2K views
Fluentd 101
SATOSHI TAGOMORI
•
3K views
To Have Own Data Analytics Platform, Or NOT To
SATOSHI TAGOMORI
•
8.3K views
The Patterns of Distributed Logging and Containers
SATOSHI TAGOMORI
•
24.5K views
How To Write Middleware In Ruby
SATOSHI TAGOMORI
•
6.9K views
Modern Black Mages Fighting in the Real World
SATOSHI TAGOMORI
•
9.4K views
Open Source Software, Distributed Systems, Database as a Cloud Service
SATOSHI TAGOMORI
•
5.4K views
Fluentd Overview, Now and Then
SATOSHI TAGOMORI
•
7.7K views
How to Make Norikra Perfect
SATOSHI TAGOMORI
•
4.7K views
Distributed Logging Architecture in Container Era
SATOSHI TAGOMORI
•
6.9K views
Recently uploaded
Improve Employee Experiences on Cisco RoomOS Devices, Webex, and Microsoft Te...
ThousandEyes
68 views
•
26 slides
Scaling out with WordPress
Konstantin Kovshenin
27 views
•
55 slides
BuilderAI Proposal_Malesniak
Michael Lesniak
78 views
•
9 slides
TEKART CON 2023
AdedoyinSamuel1
17 views
•
35 slides
Charity Navigator Masterclass - Accountability and Finance Beacon
OnBoard
29 views
•
31 slides
2023 Ivanti September Patch Tuesday
Ivanti
75 views
•
49 slides
Recently uploaded
(20)
Improve Employee Experiences on Cisco RoomOS Devices, Webex, and Microsoft Te...
ThousandEyes
•
68 views
Scaling out with WordPress
Konstantin Kovshenin
•
27 views
BuilderAI Proposal_Malesniak
Michael Lesniak
•
78 views
TEKART CON 2023
AdedoyinSamuel1
•
17 views
Charity Navigator Masterclass - Accountability and Finance Beacon
OnBoard
•
29 views
2023 Ivanti September Patch Tuesday
Ivanti
•
75 views
Microsoft Azure New - Sep 2023
Daniel Toomey
•
25 views
Roottoo Innovation V24_CP.pdf
roottooinnovation
•
19 views
who we are - values.pptx
LauraGarceran
•
27 views
AMAZON-RESUME.pdf
RegineRaneses
•
29 views
Document Understanding as Cloud APIs and Generative AI Pre-labeling Extractio...
DianaGray10
•
23 views
ISO Survey 2022: ISO 27001 certificates (ISMS)
Andrey Prozorov, CISM, CIPP/E, CDPSE. LA 27001
•
33 views
Cloud strorage whitepaper (Transform b2B).pdf
CampaignManagement1
•
14 views
Mastering System Resiliency with AIOps
Peterson Technology Partners
•
14 views
Zodhya intro deck Japan ILS
RohithPallerla
•
16 views
inQuba Webinar Series 2023 - Sanlam Hyper Personalization v2.0 FINAL.pptx
LizaNolte
•
27 views
The Rise of the Machines: How AI will shape our lives in 2024
Iain Martin
•
37 views
Accelerating Data Science through Feature Platform, Transformers, and GenAI
FeatureByte
•
108 views
Fipto Seed Pitch Deck
sjcobrien
•
29 views
Industry 4.0.pdf
Tery Lockitski
•
22 views
Data Processing and Ruby in the World
1.
Data Processing and
Ruby in the World #Ruby25th Satoshi Tagomori (@tagomoris)
2.
Satoshi Tagomori (@tagomoris) Fluentd,
MessagePack-Ruby, Norikra, Woothee, ... Treasure Data, Inc. Asakusa.rb
4.
Data Processing
5.
Data "Processing" ? 1.
COLLECT 2. SUMMARIZE 3. ANALYZE 4. VISUALIZE
6.
VISUALIZEANALYZESUMMARIZE Steps of Data
Processing COLLECT
7.
OSS Products related
with Ruby VISUALIZEANALYZESUMMARIZE Steps of Data Processing COLLECT
8.
https://red-data-tools.github.io/
9.
https://ruby-numo.github.io/ http://bioruby.org/ http://sciruby.com/
10.
OSS Products related
with Ruby VISUALIZEANALYZESUMMARIZE Steps of Data Processing COLLECT
11.
OSS Products related
with Ruby VISUALIZEANALYZESUMMARIZE Steps of Data Processing COLLECT Services related with Ruby
12.
Collecting Data using
Ruby
13.
Microsoft OMS Agent for
Linux: Fluentd https://www.microsoft.com/cloud-platform/operations-management-suite https://azure.microsoft.com/services/log-analytics/
14.
Google Stackdriver Logging Agent:
google-fluentd https://cloud.google.com/logging/ https://cloud.google.com/logging/docs/agent/
16.
https://cloud.google.com/kubernetes-engine/ https://azure.microsoft.com/services/container-service/ https://aws.amazon.com/eks/ IN PREVIEW
17.
VISUALIZEANALYZESUMMARIZE Steps of Data
Processing COLLECT github:sonots/cumo github:red-data-tools/red-chainer github:mrkn/mxnet.rb github:PairOnAir/xgboost-ruby
18.
Make "Data Processing"
World Better! Let's Keep On Moving! Congratulations 25th Anniversary, Ruby! @tagomoris