Real-time streaming analysis of Meetup using Lamda Architecture.

1. Meetup Stream
Analysis
Deep Mehta https://www.linkedin.com/in/deepmehtait
Hitesh Basantani https://www.linkedin.com/in/basantanihitesh
Rohan Bhanderi https://www.linkedin.com/in/rohanbhanderi

2. The Data Stream (http://www.meetup.com/meetup_api/)

3. AWS VM for MapR Services (https://52.34.81.201:8443)

4. Lambda Architecture

5. Lambda Architecture

6. RSVP Schema

7. RSVP Schema

8. Websocket Producer

9. RsvpDetails Resource for receiving data from Kafka server

10. Inserting data into HBase from Spark streaming

11. Snapshot of Hbase table ‘rsvp’

12. Moving streaming data from Hbase to Hive

13. Number of events in each state of US/Canada

14. Number of events in each state of US/Canada

15. Most trending events of US/Canada

16. Most trending events of US/Canada

17. NodeJS Server for fetching data from HBase
● Node HBase is a Node.JS client for the Apache HBase database. It
use the Rest API (Stargate) to communicate with HBase. Data
exchange format is JSON.

18. NodeJS Server to HBase connection
● Create Client instance with hostname, port of HBase which will be
used in accessing HBase Rest APIs.

19. Accessing Rest APIs of HBase from NodeJS Server
● Create Client connection and with the help of .get(url,function{});
receive JSON data from hbase. Rest APIs work on base of
table_name, rowKey, column_family

20. Streaming Maps

21. Streaming Maps - Detailed View

22. Trending Events

23. Trending Event in Each State with RSVP

24. Sentimental Analysis on Event Comments
● Get Comments posted by user on each event from Meetup RSVP
API.
● Remove stop words from each comments
● Compare each comment with bag of Negative words and bag of
Positive words.
● Get Sentimental Score for each comment.

25. Sentimental Analysis on Event Comments

26. Sentimental Analysis on Event Comments

27. Thanks!
Any questions?