The document discusses extracting value from big data using SpagoBI, highlighting various scenarios and methodologies such as in-memory processing and real-time data streaming. It emphasizes the need for telecommunication and public administration sectors to utilize big data for improved services and solutions. Furthermore, it outlines capabilities like self-service reporting, ad-hoc queries, and open-source tools that facilitate big data analysis and visualization.

1. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Extracting value from Big Data
through a new information exploration paradigm
Monica Franceschini - SpagoBI Architect
SpagoBI Competency Center - Engineering Group

2. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
big data dimensions

3. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
3 scenarios
BYTES STREAM
SEMANTIC
BIG
DATASETS
Analytics
SpagoBI for Big Data

4. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
big data storages
Data Source
Data Set
Visualization
In-MemoryIn-Memory
PersistencyPersistency
HiveQL
HBQL
CQL
SchedulationSchedulation
….
Impala

5. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
real-time
Data
Streaming
In-MemoryIn-Memory
Event
Dispatcher
VisualizationVisualization
SpagoBI
Adapter
●
Web Service
●
Java API
●
Queue
●
...
Event Handlers
●
Dataset
●
Alerts
●
SMS
●
Mail
PersistencyPersistency

6. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
semantic approach
Semantic
database
Explorative AnalysisExplorative Analysis
Network Analysis asNetwork Analysis as DRIVERDRIVER
Network Analysis
Engine
MQL,Cypher,MQL,Cypher,
SPARQLSPARQL......
Freebase,Freebase,
Orient DB,Orient DB,
Neo4J...Neo4J...
Classify and Categorize unstructured and heterogeneous data through
semantic annotations, using domain ontologies.
FILTERFILTER
VisualizationVisualization

7. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
use cases
Telecommunication companies:
need to extract value from mobile data
traffic information to improve services
and advance new solutions
Public administration: need to
extract value from information
gathered from different sources
(consumption, highway traffic, voice
traffic) in order to improve the supply of
tourist, environmental, social services
VALUE
BIG DATA
OPEN DATA

8. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
big data platform
RDBMSRDBMS DWHDWH OpenOpen
DataData
NoSQLNoSQL
LocalLocal
ServicesServices
APIORCHESTRATIONAPIORCHESTRATION
DataData
MarketplaceMarketplaceProcess/Process/
ServicesdesignerServicesdesigner
CloudCloud
servicesservices
Dataset
SpagoBI
SpagoBISpagoBI ......
API
DataData
MarketplaceMarketplaceSpagoBISpagoBI
......
Cleaning & IntegrationCleaning & Integration
Analysis & VisualizationAnalysis & Visualization

9. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
data “measures”
Data
Does size matter?Does size matter?
Big Data are differentBig Data are different
types...Big Data aretypes...Big Data are
something more!!!something more!!!

10. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
dashboards
Use cockpits to:
Aggregate analysis toAggregate analysis to
get information at aget information at a
glanceglance
Filter data usingFilter data using
specific documentsspecific documents
Make different kinds ofMake different kinds of
documents interactdocuments interact
with each otherwith each other

11. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
self-service
Use Free Enquiry
engine to:
Define your own queriesDefine your own queries
over datasetsover datasets
Create new datasets in aCreate new datasets in a
graphical and smart waygraphical and smart way
Refine your analysisRefine your analysis

12. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
ad-hoc reporting
Use
Worksheet to:
Provide an instantProvide an instant
graphical meaning tographical meaning to
your datasetsyour datasetsCreate a prototype forCreate a prototype for
your projectyour project
Interact with Qbe toInteract with Qbe to
refresh your datarefresh your data

13. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
agile development
Query
Create
charts
Refine the
query
Persist
New
query

14. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
what comes next?
Unstructured &
heterogeneous data
Statistical computing
Text mining
Sentiment analysis
...and more...
NEW
VISUALIZATION

15. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
open-source as a
resource
Big-data through Open Source tools:
– Technologically feasible
– No product costs
– Experimental proposals on well-known
domains
– Exploration of new domains
– Investment skills (data scientist)

16. www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
contacts
http://www.caribbean-tour.com/Contact-Us.html
Find out all information
(demo, documentation, tutorials, services and much more)
and download all SpagoBI components at:
www.spagobi.orgwww.spagobi.org
Contact us
spagobi@eng.itspagobi@eng.it