Drupal Big Data

1,855 views
1,615 views

Published on

Big Data Drupal with Cloudera, Hadoop, MapReduce, Nutch and Solr by niccolo

http://groups.drupal.org/node/286763

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,855
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
22
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Drupal Big Data

  1. 1. Big Data DrupalDEMOCRATIZING BIG DATA PROCESSES
  2. 2. ElementsBonitaClouderaNutchSolrDrupal
  3. 3. BonitaJAVA/ECLIPSE-BASED COMMERCIAL OPEN-SOURCE BUSINESSPROCESS AUTOMATION & MODELLING
  4. 4. Bonita StudioDesign business process modelsHuman or Service TasksHuman Tasks have FormsService Tasks have Connectors
  5. 5. BonitaExperienceWeb-based admin & workflow
  6. 6. Bonita Forms
  7. 7. Shell Script Tasksudo -u hdfs hadoop jar/opt/nutch/basil-apache-nutch-1.6/build/apache-nutch-1.6.joborg.apache.nutch.crawl.Crawl/user/nutch/demo-crawl/urls -dir${dir} -depth ${depth} -topN 10 -threads 50Runs Nutch job for Hadoop
  8. 8. ClouderaBIG DATA COMMERCIAL OPEN SOURCE
  9. 9. ClouderaCloudera Manager 4 (Free Edition)HbaseHDFSHiveHueImpalaMapreduceOozieZookeeper
  10. 10. Nutch JobHadoop job started by Bonita Shellconnector
  11. 11. ApacheFoundationNutchSolrHbaseHDFSHiveImpalaMapreduceHome to many of these projects
  12. 12. NutchIndustrial strength general purposeweb-crawlerhttp://blog.csdn.net/hadoopstudy/article/details/1501123
  13. 13. Nutchhttp://blog.csdn.net/hadoopstudy/article/details/1501123
  14. 14. SolrSearch & indexing
  15. 15. DrupalPHP WEB APPLICATION FRAMEWORK
  16. 16. Aegir BOA
  17. 17. DrupalNutch & Solr modulesIntegrate with search & viewsCreated at IASSponsored by Acquia
  18. 18. Apache SolrModule
  19. 19. Apache SolrExamplesModulehttp://drupal.org/project/apachesolr_examples
  20. 20. Nutch Mulisite
  21. 21. Drupal SearchNutch crawlSolr indexedDrupal search & views
  22. 22. Nutch SolrSandbox
  23. 23. Big Data DrupalDEMOCRATIZING BIG DATA PROCESSES
  24. 24. Big Data DrupalAuthor
  25. 25. Big Data DrupalWeb www.BigDataDrupal.comEmail niccolo.roberts@gmail.comContact Nicholas Roberts

×