Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

•Download as KEY, PDF•

9 likes•1,818 views

Ryu Kobayashi

Technology

• Hadoop MapReduce
• Cassandra
• MapReduce + Cassandra
• Cassandra MapReduce

•

•
•
• ...

• ...

• Twitter @ryu_kobayashi

Cassandra

Facebook KVS NoSQL DB
0.6.2 0.6.3

Cassandra

Facebook KVS NoSQL DB
0.6.2 0.6.3

• Facebook

Cassandra

Facebook KVS NoSQL DB
0.6.2 0.6.3

• Facebook
• Twitter

Cassandra

Facebook KVS NoSQL DB
0.6.2 0.6.3

• Facebook
• Twitter
•
•

@shot6

Hadoop MR + Cassandra

Cassandra Contributer

Hadoop MR + Cassandra

Hadoop Cassandra H

Hadoop MR + Cassandra
• MR HDFS
• HDFS 30 40

Hadoop MR + Cassandra
• MR HDFS
• HDFS 30 40

• Cassandra 0.6 Hadoop
(API )

Hadoop MR + Cassandra
• MR HDFS
• HDFS 30 40

• Cassandra 0.6 Hadoop
(API )
• KVS HDFS
Hbase

Hadoop MR + Cassandra
• MR HDFS
• HDFS 30 40

• Cassandra 0.6 Hadoop
(API )
• KVS HDFS
Hbase
•
Cassandra InputFormat
RDBS

AWS EMR(Elastic MapReduce + S3

Hadoop MR + Cassandra
Cassandra HDFS +TaskTracker
Cassandra

Hadoop MR + Cassandra
Cassandra HDFS +TaskTracker
Cassandra

Contribute

Cassandra MapReduce

• org.apache.cassandra.hadoop

• storage-conf.xml
# Thrift storage-conf.xml
• Jar Cassadra Thrift
classpath

• OutputFormat HDFS
(0.7 )
• 1000 Map

# FAQ Issue http://goo.gl/5Q3Z

Cassandra MapReduce

github

http://bit.ly/9nwgSu

Cassandra-GUI
http://code.google.com/p/cassandra-gui/

Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

What's hot

Cloud Optimized Big DataJoydeep Sen Sarma

Messaging architecture @FB (Fifth Elephant Conference)Joydeep Sen Sarma

Hadoop cassandra trainingMagnific Trainings

Big Data A La Carte MenuVenkatesh Balakumar

Concepts on HadoopChristopher Sharkey

Hadoop and MapReduceHemanth Kumar Mantri

Nextag talkJoydeep Sen Sarma

Welcome to the Jungle: Distributed Systems for Large Data Sets - StampedeCon ...StampedeCon

Introduction to Big Data & Hadoop Architecture - Module 1Rohit Agrawal

Hadoop and Distributed ComputingFederico Cargnelutti

Hadoop An IntroductionMohanasundaram Ponnusamy

Facebook - Jonthan Gray - Hadoop World 2010Cloudera, Inc.

Apache Hadoop at 10Cloudera, Inc.

Intro To HadoopAl Chin

RSpec for AWSフルマネージドサービスYotaro Fujii

HadoopGagan Agrawal

Cloudera Hadoop DistributionThisara Pramuditha

Acunu overviewAcunu

Cassandra Hadoop Best Practices by Jeremy HannaModern Data Stack France

140614 bigdatacamp-la-keynote-jon hsiehData Con LA

What's hot (20)

Cloud Optimized Big Data

Messaging architecture @FB (Fifth Elephant Conference)

Hadoop cassandra training

Big Data A La Carte Menu

Concepts on Hadoop

Hadoop and MapReduce

Nextag talk

Welcome to the Jungle: Distributed Systems for Large Data Sets - StampedeCon ...

Introduction to Big Data & Hadoop Architecture - Module 1

Hadoop and Distributed Computing

Hadoop An Introduction

Facebook - Jonthan Gray - Hadoop World 2010

Apache Hadoop at 10

Intro To Hadoop

RSpec for AWSフルマネージドサービス

Hadoop

Cloudera Hadoop Distribution

Acunu overview

Cassandra Hadoop Best Practices by Jeremy Hanna

140614 bigdatacamp-la-keynote-jon hsieh

Viewers also liked

Portfolio Melt Advertising S.r.l.Melt Advertising S.r.l.

Office live meeting presentationTexasgirl10

Mobile Learning Using The iPod Touch - A Panel Discussion at Spring CUE 11Mobicip.com

Presentazione Melt Advertising s.r.l.Melt Advertising S.r.l.

Case history Cross-Media Mktg per PMIMelt Advertising S.r.l.

Social Media MarketingMelt Advertising S.r.l.

Viewers also liked (6)

Portfolio Melt Advertising S.r.l.

Office live meeting presentation

Mobile Learning Using The iPod Touch - A Panel Discussion at Spring CUE 11

Presentazione Melt Advertising s.r.l.

Case history Cross-Media Mktg per PMI

Social Media Marketing

Similar to Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

Developers summit cassandraで見るNoSQLRyu Kobayashi

Hadoop+Cassandra_IntegrationJoyabrata Das

Hadoop Conference Japan 2011 Fallに行ってきましたmoai kids

Partners in Crime: Cassandra Analytics and ETL with HadoopStu Hood

Cassandra+HadoopJeremy Hanna

Hadoop online trainingsGeek Trainings

Intro to cassandra + hadoopJeremy Hanna

マーケティングのためのHadoop利用Tatsuya Sasaki

Nosql taxonomy with new nuggetMatt Ingenthron

Stratio big data spainÁlvaro Agea Herradón

COOKPADでのHadoop利用Tatsuya Sasaki

Microsoft's Big Play for Big DataAndrew Brust

Microsoft's Big Play for Big Data- Visual Studio Live! NY 2012Andrew Brust

Qubole Overview at the Fifth Elephant ConferenceJoydeep Sen Sarma

800万人の"食べたい"をHadoopで分散処理Tatsuya Sasaki

Real World NoSQL (by Chris Yuen)orcsab

Deep dive into event store using Apache CassandraAhmedabadJavaMeetup

Cassandra Distributions and VariantsAnant Corporation

The Hadoop Path by Subash DSouza of Archangel Technology Consultants, LLC.Data Con LA

Similar to Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra (20)

Developers summit cassandraで見るNoSQL

Hadoop+Cassandra_Integration

Hadoop Conference Japan 2011 Fallに行ってきました

Partners in Crime: Cassandra Analytics and ETL with Hadoop

Cassandra+Hadoop

Hadoop online trainings

Intro to cassandra + hadoop

マーケティングのためのHadoop利用

Nosql taxonomy with new nugget

Stratio big data spain

COOKPADでのHadoop利用

Microsoft's Big Play for Big Data

Microsoft's Big Play for Big Data- Visual Studio Live! NY 2012

Qubole Overview at the Fifth Elephant Conference

800万人の"食べたい"をHadoopで分散処理

Real World NoSQL (by Chris Yuen)

Deep dive into event store using Apache Cassandra

Cassandra Distributions and Variants

The Hadoop Path by Subash DSouza of Archangel Technology Consultants, LLC.

Recently uploaded

The transition to renewables in India.pdfCompetition Advisory Services (India) LLP

Pigging Solutions Piggable Sweeping ElbowsPigging Solutions

Vulnerability_Management_GRC_by Sohang Sengupta.pptxnull - The Open Security Community

Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55

Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst

Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski

08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls

08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls

Slack Application Development 101 Slidespraypatel2

Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAndikSusilo4

Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren

My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar

Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes

GenCyber Cyber Security Day PresentationMichael W. Hawkins

Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix

Pigging Solutions in Pet Food ManufacturingPigging Solutions

E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxnull - The Open Security Community

The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad

Install Stable Diffusion in windows machinePadma Pradeep

#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada

Recently uploaded (20)

The transition to renewables in India.pdf

Pigging Solutions Piggable Sweeping Elbows

Vulnerability_Management_GRC_by Sohang Sengupta.pptx

Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...

Human Factors of XR: Using Human Factors to Design XR Systems

Integration and Automation in Practice: CI/CD in Mule Integration and Automat...

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men

08448380779 Call Girls In Civil Lines Women Seeking Men

Slack Application Development 101 Slides

Azure Monitor & Application Insight to monitor Infrastructure & Application

Advanced Test Driven-Development @ php[tek] 2024

My Hashitalk Indonesia April 2024 Presentation

Enhancing Worker Digital Experience: A Hands-on Workshop for Partners

GenCyber Cyber Security Day Presentation

Swan(sea) Song – personal research during my six years at Swansea ... and bey...

Pigging Solutions in Pet Food Manufacturing

E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx

The Codex of Business Writing Software for Real-World Solutions 2.pptx

Install Stable Diffusion in windows machine

#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024

Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

1. 3 Hadoop Hadoop MR + Cassandra 2010/06/28 @ryu_kobayashi

2. • Hadoop MapReduce • Cassandra • MapReduce + Cassandra • Cassandra MapReduce •

3. • • • ... • ... • Twitter @ryu_kobayashi

4. Hadoop MapReduce Google MapReduce

5. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3

6. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3

7. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3 • Facebook

8. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3 • Facebook • Twitter

9. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3 • Facebook • Twitter •

10. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3 • Facebook • Twitter • •

11. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3 • Facebook • Twitter • • @shot6

12. Hadoop MR + Cassandra

13. Hadoop MR + Cassandra

14. Hadoop MR + Cassandra

15. Hadoop MR + Cassandra Cassandra Contributer

16. Hadoop MR + Cassandra

17. Hadoop MR + Cassandra

18. Hadoop MR + Cassandra

19. Hadoop MR + Cassandra Hadoop Cassandra H

20. H

21. Hadoop MR + Cassandra

22. Hadoop MR + Cassandra • MR HDFS

23. Hadoop MR + Cassandra • MR HDFS • HDFS 30 40

24. Hadoop MR + Cassandra • MR HDFS • HDFS 30 40 • Cassandra 0.6 Hadoop (API )

25. Hadoop MR + Cassandra • MR HDFS • HDFS 30 40 • Cassandra 0.6 Hadoop (API ) • KVS HDFS Hbase

26. Hadoop MR + Cassandra • MR HDFS • HDFS 30 40 • Cassandra 0.6 Hadoop (API ) • KVS HDFS Hbase • Cassandra InputFormat RDBS AWS EMR(Elastic MapReduce + S3

27. Hadoop MR + Cassandra

28. Hadoop MR + Cassandra

29. Hadoop MR + Cassandra

30. Hadoop MR + Cassandra Cassandra HDFS +TaskTracker Cassandra

31. Hadoop MR + Cassandra Cassandra HDFS +TaskTracker Cassandra Contribute

32. Cassandra MapReduce • org.apache.cassandra.hadoop • storage-conf.xml # Thrift storage-conf.xml • Jar Cassadra Thrift classpath • OutputFormat HDFS (0.7 ) • 1000 Map # FAQ Issue http://goo.gl/5Q3Z

33. Cassandra MapReduce github http://bit.ly/9nwgSu

34.

35. Cassandra-GUI http://code.google.com/p/cassandra-gui/

Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (6)

Similar to Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

Similar to Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra (20)

More from Ryu Kobayashi

More from Ryu Kobayashi (6)

Recently uploaded

Recently uploaded (20)

Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

Editor's Notes