Janis Janovskis @ European Drupal Days 2015

1. © Ibuildings 2014/2015 - All rights reserved
#DrupalDaysEU
Drupal for big data - is it ready?

2. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Gold Sponsors

3. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Media Sponsors
Silver Sponsors

4. © Ibuildings 2014/2015 - All rights reserved
Janis Janovskis
Drupal architect and entrepreneur
worked > 100 frameworks, led > 55 guys
janis.janovskis@passivemanagement
@PASSIVUS
CTO of Passive Management

5. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
passivemanagement.net

6. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

7. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

8. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

9. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

10. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Big Data???
@Wikipedia
Big data is a broad term for data sets so large or
complex that traditional data processing applications are
inadequate. Challenges include analysis, capture,
curation, search, sharing, storage, transfer, visualisation,
and information privacy. The term often refers simply to
the use of predictive analytics or other certain advanced
methods to extract value from data, and seldom to a
particular size of data set.

11. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Volume

12. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Velocity

13. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Variety

14. © Ibuildings 2014/2015 - All rights reserved
Hang on…. What is Drupal?

15. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

16. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

17. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

18. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
DataBase

19. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Web server

20. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Structure

21. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

22. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
@Data Science for businesses
The fundamental concepts of data science are drawn
form many fields that study data analytics …

23. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Unstructured data

24. © Ibuildings 2014/2015 - All rights reserved
Can We parse unstructured data with Drupal???

25. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
function my_analysis_external_views_plugins() {
$plugin = array();
$plugin['query']['my_analysis_master_plugin_query'] =
array();
…..
}
Views???

26. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Views???
public function query($get_count = FALSE){
}

27. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
function execute(&$view){
$data = drupal_http_request(“what so ever”);
}
Views???
https://www.lullabot.com/blog/article/building-views-query-plugins-part-2

28. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

29. © Ibuildings 2014/2015 - All rights reserved
https://www.drupal.org/project/feeds_crawler

30. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

31. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Pros
• Great community
• Support
• Reputation
• Myriad of vendors

32. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Cons
• Too robust
• Slow
• No lazy loading
• Single threaded
• Heavy
• Structured

33. © Ibuildings 2014/2015 - All rights reserved
Case Studies

34. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

35. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

36. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

37. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

38. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

39. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Only ~2000 nodes???

40. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

41. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Used to track search results with nodes???

42. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

43. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Visualizing Big Data In Drupal: Using Data
Visualizations to Drive Knowledge Discovery

44. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

45. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

46. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

47. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved

48. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
https://www.drupal.org/sandbox/cilefen/1858412

49. © Ibuildings 2014/2015 - All rights reserved
Drupal for big data - is it … ?

50. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Acknowledgements
• Nicolas Roberts - niccolo.roberts@gmail.com
• http://www.westridge.com/media/series/out-of-the-box
• Florian Loretan
• My Wife
• Drupal Community
• Organisers - Lenka especially

51. #DrupalDaysEU
© Ibuildings 2014/2015 - All rights reserved
Grazie
@PassiveManage
passivemanagement.net/contact