Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Drupal for big data
- is it ready?
Janis Janovskis
Passive Management Ltd
London, April 16th, 2015
Janis
Janovskis
@passivus
Tech Entrepreneur
English, Russian, Latvian,
PHP, Javascript, Python, Go
> 100 Frameworks
Bigges...
Drupal - Big?
Big Data???
Big data is a broad term for data sets so large or
complex that traditional data processing
applications are i...
Volume
Velocity
Variety
Hang on…. What is
Drupal?
DataBase
Web server
Structure
Big Data???
Big data is a broad term for data sets so large or
complex that traditional data processing applications are
i...
Unstructured data
Can We parse
unstructured data
with Drupal???
function my_analysis_external_views_plugins() {
$plugin = array();
$plugin['query']
['my_analysis_master_plugin_query'] = ...
Views???
public function query($get_count = FALSE){
}
function execute(&$view){
$data = drupal_http_request(“what so ever”);
crazy_learn(&$data);
return drupal_render(what_so_e...
https://www.lullabot.com/blog/article/building-views-query-
plugins-part-2
https://www.drupal.org/project/feeds_crawler
Pros
• Great community
• Support
• Reputation
• Myriad of vendors
Cons
• Too robust
• Slow
• No lazy loading
• Single threaded
• Heavy
• Structured
Case Studies
Tracked search results with nodes???
Visualizing Big Data In Drupal: Using Data
Visualizations to Drive Knowledge
Discovery
https://www.drupal.org/sandbox/cilefen/
1858412
Drupal for big data
- is it … ?
Acknowledgements
• Nicolas Roberts - niccolo.roberts@gmail.com
• http://www.westridge.com/media/series/out-of-the-box
• Fl...
Thank You
@PassiveManage
passivemanagement.net/contact
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Drupal for big data   is it ready?
Upcoming SlideShare
Loading in …5
×

Drupal for big data is it ready?

678 views

Published on

In the emerging era of Internet of things and Big data I will try to look at the Drupal's perspective.

All web thrives over bigger and bigger data. Latest Startup trends reveal tendency of applications to work around the idea of data - how to better manage or display them. So being a Drupal professional you could ask for yourself is this platform ready or even is it a correct one to be applied?

Drupal has its immense advantages of being a great CMS to manage content and data for display, but can it actually handle huge amounts of it?

So this presentation covers;
What's in the box for Big Data Analysis
Drupal for huge amounts of data - pros and cons
Is it ready as a platform
Technology stack on what's needed to plug in Drupal into the subject of Big data
Provide an analysis of the tools available, to set up Drupal for Big Data processing
I will also demonstrate few Startup cases using Drupal as a part of their big data stack and look at their experiences

Published in: Business
  • Be the first to comment

  • Be the first to like this

Drupal for big data is it ready?

  1. 1. Drupal for big data - is it ready? Janis Janovskis Passive Management Ltd London, April 16th, 2015
  2. 2. Janis Janovskis @passivus Tech Entrepreneur English, Russian, Latvian, PHP, Javascript, Python, Go > 100 Frameworks Biggest team size 55 Smallest 2 Runer, chef, photographer
  3. 3. Drupal - Big?
  4. 4. Big Data??? Big data is a broad term for data sets so large or complex that traditional data processing applications are inadequate. Challenges include analysis, capture, curation, search, sharing, storage, transfer, visualisation, and information privacy. The term often refers simply to the use of predictive analytics or other certain advanced methods to extract value from data, and seldom to a particular size of data set. @Wikipedia
  5. 5. Volume
  6. 6. Velocity
  7. 7. Variety
  8. 8. Hang on…. What is Drupal?
  9. 9. DataBase
  10. 10. Web server
  11. 11. Structure
  12. 12. Big Data??? Big data is a broad term for data sets so large or complex that traditional data processing applications are inadequate. Challenges include analysis, capture, curation, search, sharing, storage, transfer, visualisation, and information privacy. The term often refers simply to the use of predictive analytics or other certain advanced methods to extract value from data, and seldom to a particular size of data set.
  13. 13. Unstructured data
  14. 14. Can We parse unstructured data with Drupal???
  15. 15. function my_analysis_external_views_plugins() { $plugin = array(); $plugin['query'] ['my_analysis_master_plugin_query'] = array(); ….. } Views???
  16. 16. Views??? public function query($get_count = FALSE){ }
  17. 17. function execute(&$view){ $data = drupal_http_request(“what so ever”); crazy_learn(&$data); return drupal_render(what_so_ever($data)); } Views???
  18. 18. https://www.lullabot.com/blog/article/building-views-query- plugins-part-2
  19. 19. https://www.drupal.org/project/feeds_crawler
  20. 20. Pros • Great community • Support • Reputation • Myriad of vendors
  21. 21. Cons • Too robust • Slow • No lazy loading • Single threaded • Heavy • Structured
  22. 22. Case Studies
  23. 23. Tracked search results with nodes???
  24. 24. Visualizing Big Data In Drupal: Using Data Visualizations to Drive Knowledge Discovery
  25. 25. https://www.drupal.org/sandbox/cilefen/ 1858412
  26. 26. Drupal for big data - is it … ?
  27. 27. Acknowledgements • Nicolas Roberts - niccolo.roberts@gmail.com • http://www.westridge.com/media/series/out-of-the-box • Florian Loretan • My Wife • Drupal Community • Organisers
  28. 28. Thank You @PassiveManage passivemanagement.net/contact

×