#ISSlearn
REAL-TIME ANALYTICS
USING COUCHBASE +
ELASTIC STACK
15 July 2016 / Francisco Liwa
1(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx
© 2016 National University of
Singapore. All Rights Reserved
#ISSlearn
Real Time Analytics Using Couchbase + Elastic Stack
• What is Couchbase
• What is Elastic Stack
- ElasticSearch
- Kibana
2(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx
© 2016 National University of
Singapore. All Rights Reserved
#ISSlearn
What is Couchbase
• A NoSQL DataBase
• In-Memory
• Scalable
• Distributed System
• Document-Store
• Key-Value Store
• JSON Format
3(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx
© 2016 National University of
Singapore. All Rights Reserved
#ISSlearn
What is Elastic Stack
• Group of Application Software for Search
and Analytics from the Elastic Company
• Elastic Search
• Logstash
• Kibana
• Filebeat
• PacketBeat
• Etc.
4(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx
© 2016 National University of
Singapore. All Rights Reserved
#ISSlearn
What is ElasticSearch
• Multi-tenant , realtime and distributed search and analytics engine.
• Opensource , Apache license 2
• Unstructured search
• Structured Search
• Analytics
• Full text search (lucene-based)
5(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx
© 2016 National University of
Singapore. All Rights Reserved
#ISSlearn
What is Kibana
• Kibana is an open source analytics and visualization platform
• Designed for ElasticSearch
• Search, view, and interact with data stored in Elasticsearch
indices
• Perform advanced data analysis and visualize your data in a
variety of charts, tables, and maps.
6(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx
© 2016 National University of
Singapore. All Rights Reserved
#ISSlearn
DEMO
SUBTITLE
7(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx
© 2016 National University of
Singapore. All Rights Reserved
#ISSlearn
Real time Analytics Using Couchbase and Elastic Stack
• Hardware:
2 Machines - 16 GB
Memory / 160 GB Disk /
SGP1 - CentOS 6.8
• prereq:
Java: yum install
java-1.8.0-
openjdk.x86_64
8(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx
© 2016 National University of
Singapore. All Rights Reserved
#ISSlearn
Real time Analytics Using Couchbase and Elastic Stack
• A. Setup NoSQL DB Cluster
1. setup Couchbase - http://www.couchbase.com/
3.x Community edition - 128.199.86.160:8091 (password1.)
• B. Setup Elastic Stack
2. setup Elasticsearch - https://www.elastic.co/
* https://www.elastic.co/downloads/past-releases/elasticsearch-2-3-3
3. setup Elasticsearch-head plugin - elasticsearch plugin for web front end (
https://github.com/mobz/elasticsearch-head ) http://localhost:9200/_plugin/head/
http://188.166.214.126/
4. setup KIbana - a web visualization tool from Elastic ( https://www.elastic.co/products/kibana )
Kibana 4.5
5 setup elasticsearch-couchbase transport plugin - couchbase transport plugin for elasticsearch
( https://github.com/couchbaselabs/elasticsearch-transport-couchbase)
6. INGEST DATA
• (https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-1-7-logstash-1-5-and-
kibana-4-1-elk-stack-on-centos-7)
9(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx
© 2016 National University of
Singapore. All Rights Reserved
#ISSlearn
THANK YOU 
a0107538@nus.edu.sg/f.liwa@hellonanu.com
10(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx
© 2016 National University of
Singapore. All Rights Reserved

NUS-ISS Learning Day 2016 - Big Data Analytics

  • 1.
    #ISSlearn REAL-TIME ANALYTICS USING COUCHBASE+ ELASTIC STACK 15 July 2016 / Francisco Liwa 1(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
  • 2.
    #ISSlearn Real Time AnalyticsUsing Couchbase + Elastic Stack • What is Couchbase • What is Elastic Stack - ElasticSearch - Kibana 2(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
  • 3.
    #ISSlearn What is Couchbase •A NoSQL DataBase • In-Memory • Scalable • Distributed System • Document-Store • Key-Value Store • JSON Format 3(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
  • 4.
    #ISSlearn What is ElasticStack • Group of Application Software for Search and Analytics from the Elastic Company • Elastic Search • Logstash • Kibana • Filebeat • PacketBeat • Etc. 4(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
  • 5.
    #ISSlearn What is ElasticSearch •Multi-tenant , realtime and distributed search and analytics engine. • Opensource , Apache license 2 • Unstructured search • Structured Search • Analytics • Full text search (lucene-based) 5(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
  • 6.
    #ISSlearn What is Kibana •Kibana is an open source analytics and visualization platform • Designed for ElasticSearch • Search, view, and interact with data stored in Elasticsearch indices • Perform advanced data analysis and visualize your data in a variety of charts, tables, and maps. 6(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
  • 7.
    #ISSlearn DEMO SUBTITLE 7(Total Slides=8) T:S-ITSM-FOMModule1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
  • 8.
    #ISSlearn Real time AnalyticsUsing Couchbase and Elastic Stack • Hardware: 2 Machines - 16 GB Memory / 160 GB Disk / SGP1 - CentOS 6.8 • prereq: Java: yum install java-1.8.0- openjdk.x86_64 8(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
  • 9.
    #ISSlearn Real time AnalyticsUsing Couchbase and Elastic Stack • A. Setup NoSQL DB Cluster 1. setup Couchbase - http://www.couchbase.com/ 3.x Community edition - 128.199.86.160:8091 (password1.) • B. Setup Elastic Stack 2. setup Elasticsearch - https://www.elastic.co/ * https://www.elastic.co/downloads/past-releases/elasticsearch-2-3-3 3. setup Elasticsearch-head plugin - elasticsearch plugin for web front end ( https://github.com/mobz/elasticsearch-head ) http://localhost:9200/_plugin/head/ http://188.166.214.126/ 4. setup KIbana - a web visualization tool from Elastic ( https://www.elastic.co/products/kibana ) Kibana 4.5 5 setup elasticsearch-couchbase transport plugin - couchbase transport plugin for elasticsearch ( https://github.com/couchbaselabs/elasticsearch-transport-couchbase) 6. INGEST DATA • (https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-1-7-logstash-1-5-and- kibana-4-1-elk-stack-on-centos-7) 9(Total Slides=8) T:S-ITSM-FOMModule 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
  • 10.
    #ISSlearn THANK YOU  a0107538@nus.edu.sg/f.liwa@hellonanu.com 10(TotalSlides=8) T:S-ITSM-FOMModule 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved