How do you cut the Big Data clutter and tell interesting, insightful and impacting stories? This session talks about the need for Data Visualization & how Visual stories can come to the aid of the Big Data problem associated with meaningful consumption. The point is illustrated by leveraging several industry case studies.
Gramener is a data analytics and visualisation company.
We have the ability to process data at a small and a large scale. We analyse the data to find non-intuitive insights that lie hidden behind it and present it as a visual story that makes those insights obvious in real time.
Let’s take a small test. We’ll show a table of numbers on the screen, and ask 3 questions about those numbers. You have 30 seconds to answer these. You can just write down the answers or remember them – there’s no need to say the answer out aloud.
Your timer starts now.
What answers did you get?
How many numbers were above 100? How many were below 10? Which quadrant had the highest total?
[Typically, there will be a lot of variance in these answers] So there’s considerable variation in the answers you get.
Now, let’s do the same exercise again, but with some extremely simple highlighting. It’s the same questions. You have 30 seconds. This time, you can say the answer out aloud if you like.
Your time starts now.
HYDSPIN Dec14 visual story telling
MAKING SENSE OF BIG DATA:
VISUAL STORY TELLING
B GANES KESARI,
A data visualisation and analytics company
We handle terabyte-size data via non-traditional analytics and visualise it in real-time.
Gramener transforms your data into concise dashboards
that make your business problem & solution visually obvious.
We help you find insights quickly, based on cognitive research,
and our visualisations guide you towards actionable decisions.
Generation Analysis Consumption
Increasing volumes of data
being churned out by systems
Social network data
Consumers embracing Web
2.0 & social media lifestyle
Devices generating & logging
data from every activity
Each industry is poised to take advantage of big
data to varying degrees. Some factors that increase
the relevance of big data to an industry are:
Volume of data
The larger the volume of data, the
more likely it is that a firm will
benefit from increasing use of data.
Greater fluctuations in performance
offer more potential for a data-driven
organisation to improve results.
More customers (or stakeholders of
any kind) offer greater potential for
segmentation and tailored action.
This permits greater automation of
decision making, allowing processing
power to replace human judgement.
Frequency at which leaders and
laggards change place in a sector
indicates potential for disruption.
McKinsey Global Institute, Big Data, June 2011
… but at a high cost
Investments of various kinds are required to make
the data actionable. It is not enough that the data
just exists, or is collected. Some challenges are:
Collection, storage, analysis and
visualisation of data – all require
investments in modern technology.
The deeper the analysis & data
expertise a firm has, the better it can
leverage data. But such talent is rare.
A shift in mind-set from experience-driven
decision making to data driven
decision making is required.
Collecting relevant data, storing it,
and making it available to analysts in
an easy manner requires investment.
A mature vendor ecosystem
providing end-to-end or piece-wise
solutions to these is not yet a reality.
A DATA VISUALISATION
You will see 3 questions.
You have 30 seconds.
Can we understand the brief history of
elections in India?
How have the political fortunes
changed over time?
How did the biggest election of them
all unfold in 2014?
EXPLORATORY | INTERACTIVE
India’s General Elections landscape…
~300 Parties fielding 8000 candidates
~1 Mn booths served by 20 Mn people
~800 Mn Registered Voters
Varied data on several parameters
~21,000 Votes/sec of live results
A Big Data problem… in every sense
LIVE ELECTION ANALYSIS
Analytics Canter, which
you can see at
ns or election-results.
served over 10 million
requests on 16th May
2014 — the day of India
This is one of the
visualisations that we
(and perhaps many
others) have attempted
how the Election results unfolded>>
Does any party hold a consistent 100%
Which party holds record for being most
persistent in adversity?
Which party’s candidates have lost deposits
for nearly a decade?
How did weather change in India over
the past century?
What were the hottest and coldest
Are there places that exhibit some
100 YEARS OF INDIA’S WEATHER
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
STORIES FROM TEXT
Can business impacting stories be
mined from large bodies of text?
Can investors better read companies by
studying Investor earning calls?
Can companies understand what
analysts want & be better prepared?
Image credit: ttps://www.flickr.com/photos/a_mason/3009985823
HOW IS THE TEXT PROCESSED?
Web Scraping Tokenization Part-of-
Text Analytics Engine
Ticker Qtr #Qns
AAPL 53% 3
AAPL 51% 7
GS 52% 6
MSFT 53% 4
... ... ...
MS 54% 9
JP 53% 6
... ... ...
Ticker Qtr %Gr
AAPL 53% 23%
AAPL 51% -35%
GS 52% 95%
MSFT 53% 101%
... ... ...
MS 54% 14%
JP 53% 20%
... ... ...
What are the popular, critically
Where do my preferences figure?
Which one should I watch next?
The Dark Knight
Wild Wild West
The Good, The
Bad, The Ugly
Many unwatched movies
Few unwatched movies
Mix of watched & unwatched
Few watched movies
Many watched movies
Movies on the IMDb
BEST PLACES TO
PLACES’ TO LIVE IN
Can we plug into public data to
better understand cities?
Can we identify the best places to
Can this be customized to an
Image credit: https://www.flickr.com/photos/dynamosquito/2431025077
WHAT DOES THE
WORLD SEARCH FOR?
What are some questions that interest
How does this vary across countries?
Can we do ongoing ‘search-listening’?