This document provides information about Factweavers, an Indian company that specializes in building search and analytics solutions using technologies like Elasticsearch. It details some of Factweavers' projects including social media analytics tools that use Elasticsearch and visualization libraries, a financial news analytics platform, a network analysis tool, and knowledge bases for drones and big data. The document outlines the scope, technologies used, and Factweavers' solutions for each project.

1. Factweavers
Capability document
Site - www.factweavers.com
Contact - 09995311676

2. Why Factweavers
➢ Team powered by Elastic certified trainer
➢ Completed and delivered over 10 end to end
solutions over the span of 2 years since inception.
➢ Specialization in the search and analytics stack
➢ End to end capabilities on building web based
product
Author of the most referred
book in Elasticsearch called “
Elasticsearch Blue prints’ was
completed by Architect at
Factweavers. It is the first
book from an Indian to get
the position of authorized
reference for the new
segment of data
management.
Authored a book on Lucene
4. Lucene is the heart of
Elasticsearch and is what
enabled the text processing
features of Elasticsearch.

3. Platform architecture
Data ingress
Data is loaded from
various sources like
Excel sheet , SQL server
, API like twitter or
storage system like S3
Search database
Data is stored in a
search and analytic
document database like
Elasticsearch
Visualization
1. Authentication using
Node.JS/ Passport
2. Analytics and search
using search database
3. Web pages using
ReactJS / Javascript
4. Visualization using
D3.js , amCharts

4. Technology stack
Data fetching
1. Java 8
2. Logstash
3. Node.JS
4. Phantom JS
5. Python Scrapy
6. Apache Nutch
Data analysis Big data
1. NLP using GATE
2. Machine learning
3. Named entity
analysis
4. Event analysis in
text.
5. Sentiment analysis
6. Semantic web
analysis based on
ontologies
1. Elasticsearch
2. MongoDB
3. Kafka
4. Flume
5. Redis server
6. Apache Spark
Visualize / API
1. Node.JS
2. React.JS
3. D3.JS
4. AMCharts
5. Vert.x
6. Drop wizard

5. Social Media Analytics - OCTOBUZ
Scope
➢ Feed fetching from twitter , facebook ,
instagram and news media
➢ Sentiment analysis
➢ Location detection on origin of the feeds
➢ Visualization , search and analytics on the
feeds
Advantage
➢ 360 degree view on social media on any
topic
➢ Topic analysis for easy understanding of
topics
➢ Exportable reports
➢ Highly configurableTechnologies Used: Elasticsearch , Java8 , Flume , node.JS , MongoDB , AMCharts , D3.JS , NLP , Cluster analysis
Factweavers Solution
➢ Use GNIP API to receive tweets of interest.
➢ Kafka queue to absorb high volume of feeds from GNIP
➢ Use Facebook API to fetch facebook post , comments and
other information
➢ NodeJS/Express/Passport for Authentication and HTTP
server
➢ Elasticsearch as document storage engine , Search and
analytics
➢ Spatial / Temporal analysis
➢ Topic modelling
➢ AMCharts and D3.js for visualization

6. Financial News Analytics - MEDIABUZZ
Scope
➢ Fetch news articles from various news
sources via RSS or twitter
➢ Freebase analysis to extract all location ,
person , company entities
➢ Temporal analysis of feeds
➢ Entity analysis
Advantage
➢ The system make sense out of the news
data and present a semantic layer to make
more meaningful semantic search
Technologies Used: Elasticsearch , Java8 , RSS parsing , D3.JS , NLP , Twitter API fetching ,Freebase
Factweavers Solution
➢ Created a component called data fetcher which is capable
of taking various RSS links as input and fetch news from
them incrementally.
➢ Create component for parsing text news out of HTML news
link.
➢ Created component for parsing news and extracting
named entities and events.
➢ Build UI based on D3.js for visualization and search
Online Demo - http://factweavers.com/mediaBuzz

7. Network analysis - SKOPOS
Scope
➢ Aggregate logs from different network
device
➢ Construct topologies of the network.
➢ Apply various analysis like anomaly
detection , path analysis and bug database
correlation
Advantage
➢ Detect Configuration errors.
➢ Compare topology changes and traffic flow
from device to device.
➢ Real time alerting.
➢ Highly configurable User Interface.
Technologies Used: Elasticsearch , Python, D3.JS , Cluster analysis , Multi threding
Factweavers Solution
➢ Log and configuration extraction using protocols like
ssh,http.
➢ Custom solution using python.
➢ User Interface to configure fetch schedule and
protocols and device IP addresses.
➢ D3js for visualization.

8. Amazon of Drones - Dronofly
Scope
➢ Fetch the news articles about various kinds
of Drones from different sources
➢ Users can also contribute to articles/news
➢ On the fly search and categorisation of
drones.
➢ A forum for discussion amongst the users
Advantage
➢ All news and information about Drones in a
single page.
➢ Categorisation of each news under
appropriate tags, thus helping to make fast
and good insights
➢ Allows users to discuss and rate the
findings, thus providing valuable feedback
Technologies Used: Elasticsearch , node.JS , MongoDB ,React JS.
Factweavers Solution
➢ The Factweavers data fetcher tool scraps the internet
for the news and articles related to drones.
➢ The articles are parsed and then pused to the admin
database.
➢ An admin section was also designed inorder to enable
the news addition manually.
➢ Admins can approve/edit the news/article in the UI.
➢ Approved news is shown in the dronofly.com
➢ Elasticsearch as document storage engine , Search
and analytics
➢ Complete UI/UX design inhouse

9. Knowledge base for BigData - BIGDGURU
Scope
➢ Collect articles related to big-data, which
include technical and non-technical ones.
➢ Users can also contribute to articles/news
➢ On the fly search on the articles.
➢ A forum for discussion amongst the usersAdvantage
➢ Insightful articles and news about the hot
domain big data under the same roof
➢ Categorisation of each news under
appropriate tags, thus helping to make fast
and good insights
➢ Forums and threads for engaging users to
discuss on the articles or topics.
Technologies Used: : Elasticsearch , node.JS , MongoDB ,React JS.
Factweavers Solution
➢ The Factweavers data fetcher tool scraps the internet
for the news and articles related to big data.
➢ The articles are parsed and then collected in an admin
database.
➢ An admin section was also designed in order to enable
the news addition manually.
➢ User contributed articles are also incorporated in the
admin database
➢ Admins can approve/edit the news/article in the UI.
➢ Approved news is shown in the bigdguru.com
➢ Elasticsearch as document storage engine , Search
and analytics

10. Thank you