Capturing Data, Pre-processing, Analysis, Post Processing

1. ALTEN Calsoft Labs’ BI &
Analytics Solutions Overview
Sep, 2015
INNOVATE | INTEGRATE | TRANSFORM

2. INNOVATE | INTEGRATE | TRANSFORM
DisparateDataSources
•With a diverse range of
repositories, various
data types and discreet
external sources of
data, enterprises are
finding it difficult to
derive business
intelligence in a
seamless way. MakingDataReady
•Organizations have to
spend more than 80%
of the time and cost on
the pre-processing
stage of data before
actually leveraging the
benefits of application
analytics.
SpecialHardware
•Many data-driven
applications are
dependent on specific
hardware appliances
from selective vendors
to operate effectively,
incurring huge
deployment costs
especially for small and
medium enterprises
(SMEs).
Demand for an Unified Data Analysis Platform that can process data effectively and reduce
development time of applications for customers.
Key Industry Challenges
©ALTEN Calsoft Labs 2

3. INNOVATE | INTEGRATE | TRANSFORM
Data Visualization
Data Storage
Infrastructure
Data pre-processing / Harmonization / Enrichment / Analysis Data to Insights
Analysis Gap
Current Scenario in Most Enterprises
©ALTEN Calsoft Labs 3

4. INNOVATE | INTEGRATE | TRANSFORM
Processing Deriving Insights
Storage Enrichment
Structured
Unstructured
Semi Structured
Visualization of
data
Capturing
Data falls into 4 categories:
1) Web and Social Media 2) Machine to Machine 3) Big Transaction Data 4) Human generated Data
Values is multi-fold when it is correlated with publicly available data sets like weather, YELP etc.
Typical Data to Insight flow
©ALTEN Calsoft Labs 4

5. INNOVATE | INTEGRATE | TRANSFORM
Typical Time and Complexity
Insights
Raw Data
Capturing Data
Pre Processing Analysis
Post Processing
More than 12% of
time is spent here
and is complex.
Domain specific
More than 80% of
time is spent here.
Complex task
Connectors need
to be written.
Moderately
complex
Involved and
moderately complex.
Need Creative skill
for UI/UX
©ALTEN Calsoft Labs 5

6. INNOVATE | INTEGRATE | TRANSFORM
Less overall time spent, in
gaining insights
Decision Makers get insights,
quickly
Data Scientists have more
time to spend on Business
Problems
How ALTEN Calsoft Labs helps
©ALTEN Calsoft Labs 6

7. INNOVATE | INTEGRATE | TRANSFORM
Our Data to Analysis flow
Captured Data:
Step 1
Semantic
Harmonization
Step 2
Enrichment of Data
Step 3
Data Processing
Step 4
Visualization of
Data
Step 5
• Web and Social
Media
• Machine to Machine
• Big Transaction Data
• Human generated
Data
• Visual
Semantic
modelling
• Content based
storage
• Supports all
form of best of
breed NoSQL
technologies
• Semantically
link data across
the source
• Automatic
creation of
Datafolds and
query based on
datafolds
• Extensible
knowledgebase
• Distributed
Query Engine
• Distributed
Graph engine
• Recommendati
on engine
• Statistical
programming
support
• Visualization of
Data
• Push and Pull
support
• Real time
streaming
visualization
©ALTEN Calsoft Labs 7

8. INNOVATE | INTEGRATE | TRANSFORM
Data Visualization
Our Analytics Expertise
©ALTEN Calsoft Labs 8
Data Storage
Infrastructure
Data Processing
Tools

9. INNOVATE | INTEGRATE | TRANSFORM
Unified Data
Analysis Platform
to perform
variety of
analysis tasks on
your Data
Available On
Premise,
Private Cloud
and Public
Cloud
Data Storage
Infrastructure
Data Processing
Infrastructure
Data Visualization
MetaData Layer | Enrichment Layer | Seamless Data Access
Text Analysis Statistical Data Analysis Graph Engine SQL Engine
Seamless APIs / Interface of choice
Our Solution - Unified Data Analysis Platform
©ALTEN Calsoft Labs 9

10. INNOVATE | INTEGRATE | TRANSFORM
Features Description
Smart Unified Data Lake Unification of Structured, Un Structured and Poly Structured Data and semantically
standardizing the data. This enables “Free Form Search” to get the insights, for e.g.
search like “Activation in Rajasthan” to get a chart, can be achieved
Ease of Cognitive
Application
Development
Data Analyst, UI/UX developer on their language of choice (JVM based languages,
Python) can develop applications without knowing anything about “Big Data” or
“NoSQL” technologies.
Efficiency with Data
Scientists
Data Scientist can readily develop models without worrying about Data pre-processing
using their tools of choice (SPSS, SAS,R etc.). Models developed can be reused across
Business Units
Stream, Interactive and
Batch Processing
Models or Cognitive applications once developed, can be enabled streaming for real
time requirements.
Decisions based on
Smart Data
Right decisions at the Right time to the Right device for the Decision Makers. Decision
makers can see the story on their date as never before, drilling down from 30000 ft to
grain level
Why Alten Calsoft Labs’ Solution?
©ALTEN Calsoft Labs 10

11. SUCCESS STORIES

12. INNOVATE | INTEGRATE | TRANSFORM
State wise Distributor sale report
State wise Monthly sale report
Model wise Distributor sale report Model wise Monthly sale report
Vendor Performance Analysis Dashboard
©ALTEN Calsoft Labs 12

13. INNOVATE | INTEGRATE | TRANSFORM
Vendor wise Activation
Model wise Activation
Mobile Device Activation Insights
©ALTEN Calsoft Labs 13

14. INNOVATE | INTEGRATE | TRANSFORM
Challenge Solution
1. Handle Variety of Messages
• Each probe captures varied number of
parameters based on the deployed
location and DPI capabilities
2. Handle Velocity of Messages
• Probe messages are received once every
30 seconds per device scaling up to 3-5
million devices
1. Handle Volume of Messages
• 2 MB of data is received per 30 second
per device, accumulating up to approx.
1.4 GB per day per device
1. Raise Alarms in Real-time
• Raise alarms based on the captured
values as soon as the message is received
using real-time analysis and update the
operational dashboard
1. Periodic reports
• Generate weekly/monthly reports
Data Storage
Infrastructure
Data Processing
Infrastructure
Data Visualization
FactorDB (MetaData Layer) | Enrichment Layer | Seamless Data Access
Text Analysis Statistical Data
Analysis
Graph Engine SQL Engine
Seamless APIs / Interface of choice
Captured 37,000 request/sec with 4KB of data and 47,000
request/sec with 2KB of data
Real-time parameter extraction and alert generation using
FORMCEPT’s pre-processing modeling engine built on
Storm
Scalable Storage Infrastructure based on HDFS and HBase
with Elasticsearch as the indexing engine for alarms and
views required by dashboard
Interactive Real-time Dashboard
Periodic reports using batch jobs and exploratory data
analysis using Spark interface
IPTV Data Analysis based on data captured
through Deep Packet Inspection
©ALTEN Calsoft Labs 14

15. INNOVATE | INTEGRATE | TRANSFORM
Challenge Solution
1. Scalable Storage for Analysis
• Analyze data up-to ball-by-ball level
• Analyze blogs, comments, etc.
• Relate images, videos, commentary
2. 360◦ Player Profile Analysis
• MySQL had player profile data scattered
across more than 150 tables
• Difficult to collate the data across MySQL
tables due to excessive joins
1. Provide seamless query interface
• Move to graph search and free flow
query for the end users to fetch player
profile and apply filters, like- “Sachin
Tendulkar at Wankhede Stadium”
1. Move to predictive analytics
• Predict outcomes for on-going matches
Seamless data import and on-the-fly join from existing
MySQL tables – Real-time and periodic (Move towards
Lambda Architecture)
Batch processing for insights, real-time track for records
and on-going events
Cricket Ontology designed from scratch to provide Graph
Search for cricket domain using FORMCEPT’s
Knowledgebase and Graph Engine
Interactive Responsive Profile Dashboard
Custom visualization components to show the insights and
player records
Data Storage
Infrastructure
Data Processing
Infrastructure
Data Visualization
FactorDB (MetaData Layer) | Enrichment Layer | Seamless Data Access
Text Analysis Statistical Data
Analysis
Graph Engine SQL Engine
Seamless APIs / Interface of choice
Player Profile analysis and free flow Graph Search
for Cricket Domain
©ALTEN Calsoft Labs 15

16. INNOVATE | INTEGRATE | TRANSFORM
Disease Surveillance Dashboard
©ALTEN Calsoft Labs 16

17. INNOVATE | INTEGRATE | TRANSFORM
Sample Provider Dashboard
©ALTEN Calsoft Labs 17

18. INNOVATE | INTEGRATE | TRANSFORM
Sample Provider Dashboard
©ALTEN Calsoft Labs 18

19. INNOVATE | INTEGRATE | TRANSFORM
Sample Payer Dashboard
©ALTEN Calsoft Labs 19

20. INNOVATE | INTEGRATE | TRANSFORM
Sample R&D Analytics – Mutations Dashboard
©ALTEN Calsoft Labs 20

21. INNOVATE | INTEGRATE | TRANSFORM
Healthcare Payer Analytics – Member Dashboard
©ALTEN Calsoft Labs 21

22. INNOVATE | INTEGRATE | TRANSFORM
Contact Us
2
Bangalore – Corporate & Development Centre
196, Bannerghatta Road,
Bangalore 560 076.
Phone: +91 80 4034 3000
Bangalore – Design and Development
Centre 2
No.25, Level-5,
Shankaranarayana Building,
M.G. Road, Bangalore-560001
Phone: +91 (0)80 42 41 42 41
Chennai - Design and Development Center 3
1st & 2nd Floor, ESPEE IT Park,
Plot No.5, Jawaharlal Nehru Road,
Ekkatuthangal, Chennai - 600 032,
Phone: +91 44 4595 9100/01/02/03
Mysore – Embbedded Engineering and
Development Centre
64-C1, Hootagalli Industrial Area,
Kasaba Hobli, Mysore - 570 018.
Phone: +91 0821 2404 900
INDIA
40 avenue André Morizet,
92514 Boulogne-Billancourt,
Phone : +33 (0)1 46 08 70 00
France
USA
Head Office
2953, Bunker Hill Lane,
Suite 203,
Santa Clara, CA 95054.
Phone: +1 (408) 755 3000
Fax : +1 (925) 249 3031
http://www.altencalsoftlabs.com info@calsoftlabs.com in.linkedin.com/calsoftlabs @calsoftlabs