IS 735 Social Media Final Project report

1.
Appendix
Social Media (IS 735)
Fall 2020
Department of Information Systems
New Jersey Institute of Technology
Work Distribution
December 15, 2020
Team
We are a team of 3 PhD students as follows:
1. Kaustav Bhattacharjee​ (​kb526@njit.edu​)
2. Sahaj Vaidya​ (​ssv47@njit.edu​)
3. Soumyadeep Basu​ (​sb2356@njit.edu​)
Tasks
The following tasks were performed in chronological order:
1. Searched for Problem Statement
2. Developed of Project Proposal
3. Identified the datasets and expert users
4. Collected the datasets
5. Explored the datasets and cleaning the data
6. Collected missing data attributes
7. Developed the Data Collection Report
8. Implemented ElasticSearch in order to ingest the data (​discontinued later​)
9. Performed Topic Modelling using LDA on the expert users’ dataset
10. Performed Subjectivity Analysis on the expert users’ dataset
11. Developed Project Intermediate Report
12. Performed Topic Modelling using NMF on the expert users’ dataset
13. Performed Sentiment Analysis using BERT on the expert and non-expert users’ datasets
14. Performed Subjectivity Analysis on the non-expert users’ dataset (after feedback from
Intermediate Report)

2. 2
15. Performed Sentiment Analysis using Flair on the expert and non-expert users’
datasets
16. Performed Topic Modelling using LDA on the non-expert users’ dataset
17. Performed Topic Modelling using NMF on the non-expert users’ dataset
18. Developed the Project Final Report on Medium
Summary
We have performed the above mentioned task together as a team. We used to get into a call,
discuss the methods to be used and developed the code/algorithm to be used. Since we had to
deal with a lot of files (e.g.: 600 files of 6000 records each, for one of the data collection tasks),
we divided the files into equal numbers of subsets (e.g.: 200 files for each team member) and
distributed them among ourselves to be executed on our individual computers. Hence, it would
be difficult to pinpoint exactly what each person did, since all the team members have an equal
contribution to each of the tasks to make the project a success.
✦✦✦