This document summarizes a project to visualize the relationships between questions in a network graph. It discusses using properties like node size, distance, and directed edges to represent the quality, similarity, and associations between questions. The team explored the data, performed cleansing and analysis, and used tools like R, Hive, and Sigma.js to generate the network graph and allow interactive exploration of the question relationships. The final product is deployed online for users to interact with the graph visualization.

1. Stack Overflow
Network Graph
Team: Heineken

3. Motivation
What we want?
- We want overall quality of a question
- We want to see how much the similar
questions related to the question

4. Solution
Visualize the Question Network by A Graph
- Inspired by http://www.visuwords.com/

6. Dataset

7. Dataset

8. How Can We Translate
the Questions Into
Network Graph?

9. Three Properties of Graph
1. Size of Node
2. Distance
Between Nodes
3. Directed Edges
1.Quality of A Question
2.Similarity Between
Questions (Content Based)
1.Link Between Questions
(Item based)

10. Quality
SimilarityAssociation
Question
Concept

11. Data Exploration

14. Data Exploration

15. Data Exploration

16. Data
Cleansing
Sed Pig Latin

17. Bash - Sed

18. Pig

19. Data Analysis
Cosine
Similarity
Aggregation
Integration

20. Hive

21. ● Library: “tm"
● Data Format: Corpus
● Standardization:
○ Cleansing
○ SMART IR system
○ Porter Stemmer Approach
● Term Frequency matrix
○ Normalization: Cornell SMART system
● Generate Vector Space Model Matrix
● Dot Product of the Matrix
Finding Similarities Among the Questions
in RStudio With R Language

24. factorial number of similarities

25. Visualization

26. Discovery - First 300 Questions TfIdf

27. Discovery - First 300 Questions Bool

28. Discovery - Links Rank Validation
Initial
OpenOrd

29. Discovery - Links Rank Validation
Filter

30. Discovery - Links Rank Validation
Edge View
OpenOrd

31. Discovery - Links Rank Validation

32. GEXF
Deployment

33. Sigma.js
Graphs from Gephi can be exported but they are static
But what we want is for the user to interact with the graph
Sigma.js is a JavaScript library that renders graphs on web pages
Export graph from Gephi and parse it through Sigma.js

34. Sigma.js
Init function

35. Sigma.js
parse.Gexf function
Creating Nodes

36. Sigma.js
Creating Edges

37. Final Product

38. Code Available on Git Repo

39. Cheers!