GeoKettle, GeoMondrian et Spatialytics : une suite open source de GeoBI

Benefits of Open Source
Geospatial Business Intelligence
(Geo-BI)
By Luc Vaillancourt, Spatialytics CEO
for
Dr. Thierry Badard
(Spatialytics CTO and Professor at Laval University)

06/10/2009 Geospatial Business Intelligence 1

Plan
1. Spatialytics
– Dr. Thierry Badard
2. Business Intelligence
– BI Offering
3. Open Source
– Open Source BI Players
• Pentaho Offering
4. Spatialytics.org Offering
– GeoKettle
– GeoMondrian
– SOLAPLayers
5. Summary

1. About Spatialytics

• A new company
• Based in Quebec City
• Inspired by the work of Dr. Thierry Badard
– Inspired by the Pentaho Open Source BI suite..
• Solutions in Geo-BI
• CTO : Dr. Thierry Badard
• CEO : Luc Vaillancourt
– Co-founded KOREM in 1993, founded BALIZ in 2007

1.1 About Dr. Thierry Badard
• Co-founder & CTO of Spatiaylits Solutons Inc.
• professor in Geomatics at Laval University,
Quebec City, since 2005
– Leads the GeoSOA Research team
• industrial researcher at IGN of France between
1996 and 2004
• well involved in the OSGeo
– Voting member
– Co-fonder of the “francophone” chapter (OSGeo-fr)
– Co-fonder of the “Québec” chapter (OSGeo-qc)
– Member of the FOSS4G organizing committee

BI Market Grows 22% In Tough Economy
http://www.informationweek.com/news/business_intelligence/analytics/showArticle.jhtml?articleID=217800991

• 22% growth in 2008 (13% in 2007)
• $8.8 billion in 2008
– BI platforms, analytic applications, performance
management software
• 75% to the top6 :
– SAP/Business Objects, SAS Institute, Oracle, IBM/Cognos,
Microsoft and MicroStrategy
• Users : "increase transparency" to identify costs and
better align strategy with execution

2.1 BI Offering
• Data Integration (ETL : from OLTP to OLAP)
• Data Warehouse (any RBDMS)
• OLAP Server (OnLine Analytical Processing)
• End-User Applications (via MDX) :
– Analysis - Data Mining
– Dashboards - Reporting

DATA BI TECHNOLOGY ARCHITECTURE
SOURCE
S MDX
ET End‐User Applications
BDM flat L
S files Data
Warehous (OLAP)
sensor e
s


3. Open Source

3. Open Source
Open Source Software Market Accelerated by Economy
and Increased Acceptance From Enterprise Buyers
http://www.businesswire.com/portal/site/home/permalink/?ndmViewId=news_view&newsId=20090729005107&newsLang=en

• An IDC study on Open Source :
– worldwide revenue from OSS will grow at a 22.4%
compound annual growth rate (CAGR) to reach
$8.1 billion by 2013
– OSS has had a much higher level of acceptance
over the past 12 months than previously expected
– the economy accelerated the uptake and use of
OSS in the closing months of 2008
Worldwide Open Source Software 2009–2013 Forecast (IDC #219260)


3.1 Open Source BI

• Players :
– Pentaho
– SpagoBI
– Talend (ETL)
– JasperSoft


3.1.1 Pentaho

• Pentaho Corporation is the commercial open
source alternative for Business Intelligence (BI)
• Pentaho's products have been downloaded
more than three million times
• Pentaho is the only commercial open source BI
suite provider who leads and sponsors all of its
core open source BI projects.

3.1.1 Pentaho

• highly experienced industry leaders with a strong
record of creating successful BI products for top-tier
commercial vendors, including: Business Objects,
Cognos, Hyperion, IBM, Oracle, SAS ...
• « to achieve positive, disruptive change in the BI space
by building a On-Demand Business Intelligence and making !it
Cloud
class-leading BI platform 05/10/2009

available to everyone by shift of business intelligence to an on-
releasing it into Open
LucidEra was founded in 2005 by veterans of the business intelligence industry.
Computing
Our founders recognized early the
Source » demand model.
http://www.pentaho.com/news/releases/20091005_pentaho_announces_strategic_technology_acquisition.php


3.1.1 Pentaho


3.1.1 Pentaho
• Kettle : ETL / Data Integration
• Mondrian : OLAP Server
• End-User Applications (via MDX) :
– Pentaho Reporting
– CDF (Community Dashboard Framework)
– Weka for Data Mining
DATA
SOURCES MDX
L
flat Data
BDM
files Warehous (OLAP)
S
e
sensor
s
CDF


Geo-BI


4. Spatialytics.org

Spatialytics leads and sponsors all of its core
Open Source Geo-BI projects,
available at


4. Spatialytics.org

Spatialytics.org Open Source Geo-BI projects,
are :
Origins of those projects :

- Faculté de foresterie, de géographie et de géomatique
- Département des sciences géomatiques
- GeoSOA Research Team
- Dr. Thierry Badard


4. Spatialytics.org
• GeoKettle : Data & GeoData Integration
• GeoMondrian : Saptial OLAP Server (SOLAP)
• Enriched MDX with Spatial capabilities
• SOLAPLayer : Map Component for Map-Centric or
“Map-Enabled” (Reporting, Dashboards) applications

DATA
SOURCES MDX
L
Data
BDM flat
files Warehouse (SOLA
S Thematic
P) Mapping
sensor
s


4.1 GeoKettle

• GeoKettle is a "spatially-enabled" version of
Pentaho Data Integration (Kettle)
• True and consistent integration of the spatial
component
– All steps provided by Kettle are able to deal with
geospatial data types
– Some geospatial dedicated steps have been added


4.1 GeoKettle


4.1 GeoKettle
• Current stable version : 3.2.0-20090609
• Released under LGPL
• http://www.geokettle.org
• Provides support for:
– Handling geometry data types (based on JTS)
– Definition of custom transformation steps by the user
– Topological predicates (Intersects, crosses, etc.)
– Input / Output with some spatial DBMS
– Native support for Oracle, PostGIS and MySQL
– MS SQL Server 2008, Ingres and IBM DB2 can be used but it
requires some tricks
– GIS file Input / Output : Shapefile (GML and KML soon)

4.1 GeoKettle
• Upcoming features:
– Cartographic preview (work in progress)
– Implementation of data matching and conflation steps in
order to allow geometric data cleansing and comparison of
geospatial datasets
– Read/write support for other DBMS & GIS file formats
• MapInfo (.tab or MIF/MID), KML, GeoJSON, GeoRSS, ESRI
Geodatabase, ArcSDE
• Native support for MS SQL Server 2008 and Ingres
• WFS, Sensor Web (TML, SensorML, SOS, ...)
– Implementation of a “Spatial analysis” step with a GUI
– Raster support : integration in progress of the Sextante
library

4.2 GeoMondrian

• SOLAP “allows a rapid and easy navigation
within spatial datawarehouses and offers many
levels of information granularity, many themes,
many epochs and many display modes of
information that are synchronized or not: maps,
tables and diagrams” – adapted from Rivest et al.,
2005


4.2 GeoMondrian
• GeoMondrian is a "spatially-enabled" version of
Pentaho Analysis Services (Mondrian)
• GeoMondrian brings to the Mondrian OLAP
server what PostGIS brings to the PostgreSQL
DBMS
– i.e. a consistent and powerful support for
geospatial data.
• Released under the EPL
• http://www.geo-mondrian.org


4.2 GeoMondrian
• As far as we know, it is the first implementation of a
true Spatial OLAP (SOLAP) Server
• Provides a consistent integration of spatial objects
into the OLAP data cube structure
– Instead of fetching them from an separate spatial DBMS,
web service or a GIS file
• Implements a native Geometry data type
• Provides first spatial extensions to the MDX
language
– Add spatial analysis capabilities to the analytical queries
• At present, it only supports PostGIS datawarehouses


4.2.1 Spatially enabled MDX
• bring to Mondrian and MDX what SQL spatial
extensions do for relational DBMS (i.e. Simple
Features for SQL and implementations such as
PostGIS).
• Example query: filter spatial dimension members
based on distance from a feature
– SELECT
{[Measures].[Population]} on columns,
Filter(
{[Unite geographique].[Region economique].members},
ST_Distance([Unitegeographique].CurrentMember.Properties("geom"),
[Unite geographique].[Province].[Ontario].Properties("geom")) < 2.0
) on rows
FROM [Recensements]
WHERE [Temps].[Rencensement 2001 (2001-2003)].[2001]

4.2.1 Spatially enabled MDX
• Many more possibilities:
– in-line geometry constructors (from WKT)
– member filters based on topological predicates
(intersects, contains, within, …)
– spatial calculated members and measures (e.g.
aggregates of spatial features, buffers)
– calculations based on scalar attributes derived
from
spatial features (area, length, distance, …)


4.3 SOLAPLayers

• SOLAPLayers is a lightweight cartographic component
which enables navigation in geospatial (Spatial OLAP or
SOLAP) data cubes, such as those handled by
GeoMondrian.
• to be integrated into existing dashboard frameworks in
order to produce interactive geo-analytical dashboards.
• Released under BSD (client part) and EPL (server part).
• http://www.solaplayers.org


4.3 SOLAPLayers

1645243


4.3 SOLAPLayers
• Is mainly based on OpenLayers and Dojo
• Allows:
– the connection with a Spatial OLAP server such as
GeoMondrian,
– the navigation in geospatial data cubes,
– and the cartographic representation of some
measures as static or dynamic choropleth maps.
• Many Features in development
– More thematic capabilities


5. Summary
DATA MDX
SOURCES ET End‐User
L Applications
Data
Warehous (OLAP)
MDX
ET End‐User
e
L Applications
BDM
S Data
Warehous (OLAP) MDX
ET e End‐User
L Applications
flat
Data CDF
Warehouse (SOLA
files
Themati
P) c
Mapping

sensor
s

OLTP
Operational
+ = Geo-BI (full SOLAP)

+ =

Not just free…

What else…

Monetize…

On the field…

…and in the Cloud

Events…


QUESTIONS ?

Thank you !
Luc Vaillancourt, Spatialytics CEO lvaillancourt@spatialytics.com @l_vaillancourt
Dr. Thierry Badard
- Spatialytics CTO tbadard@spatialytics.com @tbadard
- Professor at Laval University thierry.badard@scg.ulaval.ca

Coming soon!

WWW

Spatialytics.COM @spatialytics
Spatialytics.ORG


GeoKettle, GeoMondrian et Spatialytics : une suite open source de GeoBI

More Related Content

What's hot

Similar to GeoKettle, GeoMondrian et Spatialytics : une suite open source de GeoBI

More from ACSG Section Montréal

Recently uploaded

GeoKettle, GeoMondrian et Spatialytics : une suite open source de GeoBI