Benefits of Open Source Geospatial Business Intelligence (Geo-BI) By Luc Vaillancourt, Spatialytics CEO for Dr. Thierry Badard (Spatialytics CTO and Professor at Laval University) 6

Plan Spatialytics Dr. Thierry Badard Business Intelligence BI Offering Open Source Open Source BI Players Pentaho Offering Spatialytics.org Offering GeoKettle GeoMondrian SOLAPLayers Summary

Spatialytics

Dr. Thierry Badard

Business Intelligence

BI Offering

Open Source

Open Source BI Players

Pentaho Offering

Spatialytics.org Offering

GeoKettle

GeoMondrian

SOLAPLayers

Summary

1. About Spatialytics A new company Based in Quebec City Inspired by the work of Dr. Thierry Badard Inspired by the Pentaho Open Source BI suite.. Solutions in Geo-BI CTO : Dr. Thierry Badard CEO : Luc Vaillancourt Co-founded KOREM in 1993, founded BALIZ in 2007

A new company

Based in Quebec City

Inspired by the work of Dr. Thierry Badard

Inspired by the Pentaho Open Source BI suite..

Solutions in Geo-BI

CTO : Dr. Thierry Badard

CEO : Luc Vaillancourt

Co-founded KOREM in 1993, founded BALIZ in 2007

1.1 About Dr. Thierry Badard Co-founder & CTO of Spatiaylits Solutons Inc. professor in Geomatics at Laval University, Quebec City, since 2005 Leads the GeoSOA Research team industrial researcher at IGN of France between 1996 and 2004 well involved in the OSGeo Voting member Co-fonder of the “francophone” chapter (OSGeo-fr) Co-fonder of the “Québec” chapter (OSGeo-qc) Member of the FOSS4G organizing committee

Co-founder & CTO of Spatiaylits Solutons Inc.

professor in Geomatics at Laval University, Quebec City, since 2005

Leads the GeoSOA Research team

industrial researcher at IGN of France between 1996 and 2004

well involved in the OSGeo

Voting member

Co-fonder of the “francophone” chapter (OSGeo-fr)

Co-fonder of the “Québec” chapter (OSGeo-qc)

Member of the FOSS4G organizing committee

2. Business Intelligence 22% growth in 2008 (13% in 2007) $8.8 billion in 2008 BI platforms, analytic applications, performance management software 75% to the top6 : SAP/Business Objects, SAS Institute, Oracle, IBM/Cognos, Microsoft and MicroStrategy Users : "increase transparency" to identify costs and better align strategy with execution http://www.informationweek.com/news/business_intelligence/analytics/showArticle.jhtml?articleID=217800991 BI Market Grows 22% In Tough Economy

22% growth in 2008 (13% in 2007)

$8.8 billion in 2008

BI platforms, analytic applications, performance management software

75% to the top6 :

SAP/Business Objects, SAS Institute, Oracle, IBM/Cognos, Microsoft and MicroStrategy

Users : "increase transparency" to identify costs and better align strategy with execution

2.1 BI Offering Data Integration (ETL : from OLTP to OLAP) Data Warehouse (any RBDMS) OLAP Server (OnLine Analytical Processing) End-User Applications (via MDX) : Analysis - Data Mining Dashboards - Reporting (OLAP) ETL Data Warehouse BI TECHNOLOGY ARCHITECTURE End-User Applications MDX DATA SOURCES sensors flat files BDMS

Data Integration (ETL : from OLTP to OLAP)

Data Warehouse (any RBDMS)

OLAP Server (OnLine Analytical Processing)

End-User Applications (via MDX) :

Analysis - Data Mining

Dashboards - Reporting

3. Open Source An IDC study on Open Source : worldwide revenue from OSS will grow at a 22.4% compound annual growth rate (CAGR) to reach $8.1 billion by 2013 OSS has had a much higher level of acceptance over the past 12 months than previously expected the economy accelerated the uptake and use of OSS in the closing months of 2008 Open Source Software Market Accelerated by Economy and Increased Acceptance From Enterprise Buyers http://www.businesswire.com/portal/site/home/permalink/?ndmViewId=news_view&newsId=20090729005107&newsLang=en Worldwide Open Source Software 2009–2013 Forecast (IDC #219260)

An IDC study on Open Source :

worldwide revenue from OSS will grow at a 22.4% compound annual growth rate (CAGR) to reach $8.1 billion by 2013

OSS has had a much higher level of acceptance over the past 12 months than previously expected

the economy accelerated the uptake and use of OSS in the closing months of 2008

3.1 Open Source BI Players : Pentaho SpagoBI Talend (ETL) JasperSoft

Players :

Pentaho

SpagoBI

Talend (ETL)

JasperSoft

3.1.1 Pentaho Pentaho Corporation is the commercial open source alternative for Business Intelligence (BI) Pentaho's products have been downloaded more than three million times Pentaho is the only commercial open source BI suite provider who leads and sponsors all of its core open source BI projects.

Pentaho Corporation is the commercial open source alternative for Business Intelligence (BI)

Pentaho's products have been downloaded more than three million times

Pentaho is the only commercial open source BI suite provider who leads and sponsors all of its core open source BI projects.

3.1.1 Pentaho highly experienced industry leaders with a strong record of creating successful BI products for top-tier commercial vendors, including: Business Objects, Cognos, Hyperion, IBM, Oracle, SAS ... « to achieve positive, disruptive change in the BI space by building a class-leading BI platform and making it available to everyone by releasing it into Open Source »

highly experienced industry leaders with a strong record of creating successful BI products for top-tier commercial vendors, including: Business Objects, Cognos, Hyperion, IBM, Oracle, SAS ...

« to achieve positive, disruptive change in the BI space by building a class-leading BI platform and making it available to everyone by releasing it into Open Source »

3.1.1 Pentaho highly experienced industry leaders with a strong record of creating successful BI products for top-tier commercial vendors, including: Business Objects, Cognos, Hyperion, IBM, Oracle, SAS ... « to achieve positive, disruptive change in the BI space by building a class-leading BI platform and making it available to everyone by releasing it into Open Source » Cloud Computing On-Demand Business Intelligence LucidEra was founded in 2005 by veterans of the business intelligence industry. Our founders recognized early the shift of business intelligence to an on-demand model. http://www.pentaho.com/news/releases/20091005_pentaho_announces_strategic_technology_acquisition.php 05/10/2009 !

highly experienced industry leaders with a strong record of creating successful BI products for top-tier commercial vendors, including: Business Objects, Cognos, Hyperion, IBM, Oracle, SAS ...

« to achieve positive, disruptive change in the BI space by building a class-leading BI platform and making it available to everyone by releasing it into Open Source »

3.1.1 Pentaho

3.1.1 Pentaho Kettle : ETL / Data Integration Mondrian : OLAP Server End-User Applications (via MDX) : Pentaho Reporting CDF (Community Dashboard Framework) Weka for Data Mining (OLAP) ETL Data Warehouse End-User Applications MDX DATA SOURCES sensors flat files BDMS CDF

Kettle : ETL / Data Integration

Mondrian : OLAP Server

End-User Applications (via MDX) :

Pentaho Reporting

CDF (Community Dashboard Framework)

Weka for Data Mining

4. Spatialytics.org Spatialytics leads and sponsors all of its core Open Source Geo-BI projects, available at

Spatialytics leads and sponsors all of its core Open Source Geo-BI projects,

available at

4. Spatialytics.org Spatialytics.org Open Source Geo-BI projects, are : - Faculté de foresterie, de géographie et de géomatique - Département des sciences géomatiques - GeoSOA Research Team - Dr. Thierry Badard Origins of those projects :

Spatialytics.org Open Source Geo-BI projects,

are :

4. Spatialytics.org GeoKettle : Data & GeoData Integration GeoMondrian : Saptial OLAP Server (SOLAP) Enriched MDX with Spatial capabilities SOLAPLayer : Map Component for Map-Centric or “Map-Enabled” (Reporting, Dashboards) applications Data Warehouse (SOLAP) ETL End-User Applications MDX DATA SOURCES sensors flat files BDMS Thematic Mapping

GeoKettle : Data & GeoData Integration

GeoMondrian : Saptial OLAP Server (SOLAP)

Enriched MDX with Spatial capabilities

SOLAPLayer : Map Component for Map-Centric or “Map-Enabled” (Reporting, Dashboards) applications

4.1 GeoKettle GeoKettle is a "spatially-enabled" version of Pentaho Data Integration (Kettle) True and consistent integration of the spatial component All steps provided by Kettle are able to deal with geospatial data types Some geospatial dedicated steps have been added

GeoKettle is a "spatially-enabled" version of Pentaho Data Integration (Kettle)

True and consistent integration of the spatial component

All steps provided by Kettle are able to deal with geospatial data types

Some geospatial dedicated steps have been added

4.1 GeoKettle

4.1 GeoKettle Current stable version : 3.2.0-20090609 Released under LGPL http://www.geokettle.org Provides support for: Handling geometry data types (based on JTS) Definition of custom transformation steps by the user Topological predicates (Intersects, crosses, etc.) Input / Output with some spatial DBMS Native support for Oracle, PostGIS and MySQL MS SQL Server 2008, Ingres and IBM DB2 can be used but it requires some tricks GIS file Input / Output : Shapefile (GML and KML soon)

Current stable version : 3.2.0-20090609

Released under LGPL

http://www.geokettle.org

Provides support for:

Handling geometry data types (based on JTS)

Definition of custom transformation steps by the user

Topological predicates (Intersects, crosses, etc.)

Input / Output with some spatial DBMS

Native support for Oracle, PostGIS and MySQL

MS SQL Server 2008, Ingres and IBM DB2 can be used but it requires some tricks

GIS file Input / Output : Shapefile (GML and KML soon)

4.1 GeoKettle Upcoming features: Cartographic preview ( work in progress ) Implementation of data matching and conflation steps in order to allow geometric data cleansing and comparison of geospatial datasets Read/write support for other DBMS & GIS file formats MapInfo (.tab or MIF/MID), KML, GeoJSON, GeoRSS, ESRI Geodatabase, ArcSDE Native support for MS SQL Server 2008 and Ingres WFS, Sensor Web (TML, SensorML, SOS, ...) Implementation of a “Spatial analysis” step with a GUI Raster support : integration in progress of the Sextante library

Upcoming features:

Cartographic preview ( work in progress )

Implementation of data matching and conflation steps in order to allow geometric data cleansing and comparison of geospatial datasets

Read/write support for other DBMS & GIS file formats

MapInfo (.tab or MIF/MID), KML, GeoJSON, GeoRSS, ESRI Geodatabase, ArcSDE

Native support for MS SQL Server 2008 and Ingres

WFS, Sensor Web (TML, SensorML, SOS, ...)

Implementation of a “Spatial analysis” step with a GUI

Raster support : integration in progress of the Sextante library

4.2 GeoMondrian SOLAP “allows a rapid and easy navigation within spatial datawarehouses and offers many levels of information granularity, many themes , many epochs and many display modes of information that are synchronized or not: maps , tables and diagrams” – adapted from Rivest et al. , 2005

SOLAP “allows a rapid and easy navigation within spatial datawarehouses and offers many levels of information granularity, many themes , many epochs and many display modes of information that are synchronized or not: maps , tables and diagrams” – adapted from Rivest et al. , 2005

4.2 GeoMondrian GeoMondrian is a "spatially-enabled" version of Pentaho Analysis Services (Mondrian) GeoMondrian brings to the Mondrian OLAP server what PostGIS brings to the PostgreSQL DBMS i.e. a consistent and powerful support for geospatial data. Released under the EPL http://www.geo-mondrian.org

GeoMondrian is a "spatially-enabled" version of Pentaho Analysis Services (Mondrian)

GeoMondrian brings to the Mondrian OLAP server what PostGIS brings to the PostgreSQL DBMS

i.e. a consistent and powerful support for geospatial data.

Released under the EPL

http://www.geo-mondrian.org

4.2 GeoMondrian As far as we know, it is the first implementation of a true Spatial OLAP (SOLAP) Server Provides a consistent integration of spatial objects into the OLAP data cube structure Instead of fetching them from an separate spatial DBMS, web service or a GIS file Implements a native Geometry data type Provides first spatial extensions to the MDX language Add spatial analysis capabilities to the analytical queries At present, it only supports PostGIS datawarehouses

As far as we know, it is the first implementation of a true Spatial OLAP (SOLAP) Server

Provides a consistent integration of spatial objects into the OLAP data cube structure

Instead of fetching them from an separate spatial DBMS, web service or a GIS file

Implements a native Geometry data type

Provides first spatial extensions to the MDX language

Add spatial analysis capabilities to the analytical queries

At present, it only supports PostGIS datawarehouses

4.2.1 Spatially enabled MDX bring to Mondrian and MDX what SQL spatial extensions do for relational DBMS (i.e. Simple Features for SQL and implementations such as PostGIS). Example query: filter spatial dimension members based on distance from a feature SELECT {[Measures].[Population]} on columns, Filter( {[Unite geographique].[Region economique].members}, ST_Distance([Unitegeographique].CurrentMember.Properties(&quot;geom&quot;), [Unite geographique].[Province].[Ontario].Properties(&quot;geom&quot;)) < 2.0 ) on rows FROM [Recensements] WHERE [Temps].[Rencensement 2001 (2001-2003)].[2001]

bring to Mondrian and MDX what SQL spatial extensions do for relational DBMS (i.e. Simple Features for SQL and implementations such as PostGIS).

Example query: filter spatial dimension members based on distance from a feature

SELECT {[Measures].[Population]} on columns, Filter( {[Unite geographique].[Region economique].members}, ST_Distance([Unitegeographique].CurrentMember.Properties(&quot;geom&quot;), [Unite geographique].[Province].[Ontario].Properties(&quot;geom&quot;)) < 2.0 ) on rows FROM [Recensements] WHERE [Temps].[Rencensement 2001 (2001-2003)].[2001]

4.2.1 Spatially enabled MDX Many more possibilities: in-line geometry constructors (from WKT) member filters based on topological predicates (intersects, contains, within, …) spatial calculated members and measures (e.g. aggregates of spatial features, buffers) calculations based on scalar attributes derived from spatial features (area, length, distance, …)

Many more possibilities:

in-line geometry constructors (from WKT)

member filters based on topological predicates (intersects, contains, within, …)

spatial calculated members and measures (e.g. aggregates of spatial features, buffers)

calculations based on scalar attributes derived from spatial features (area, length, distance, …)

4.3 SOLAPLayers SOLAPLayers is a lightweight cartographic component which enables navigation in geospatial (Spatial OLAP or SOLAP) data cubes, such as those handled by GeoMondrian. to be integrated into existing dashboard frameworks in order to produce interactive geo-analytical dashboards. Released under BSD (client part) and EPL (server part). http://www.solaplayers.org

SOLAPLayers is a lightweight cartographic component which enables navigation in geospatial (Spatial OLAP or SOLAP) data cubes, such as those handled by GeoMondrian.

to be integrated into existing dashboard frameworks in order to produce interactive geo-analytical dashboards.

Released under BSD (client part) and EPL (server part).

http://www.solaplayers.org

4.3 SOLAPLayers 1645243

4.3 SOLAPLayers Is mainly based on OpenLayers and Dojo Allows: the connection with a Spatial OLAP server such as GeoMondrian, the navigation in geospatial data cubes, and the cartographic representation of some measures as static or dynamic choropleth maps. Many Features in development More thematic capabilities

Is mainly based on OpenLayers and Dojo

Allows:

the connection with a Spatial OLAP server such as GeoMondrian,

the navigation in geospatial data cubes,

and the cartographic representation of some measures as static or dynamic choropleth maps.

Many Features in development

More thematic capabilities

5. Summary (OLAP) ETL Data Warehouse End-User Applications MDX DATA SOURCES sensors flat files BDMS OLTP Operational

5. Summary (OLAP) ETL Data Warehouse End-User Applications MDX CDF DATA SOURCES sensors flat files BDMS OLTP Operational

5. Summary DATA SOURCES sensors flat files BDMS OLTP Operational (SOLAP) ETL End-User Applications MDX Thematic Mapping Data Warehouse + = + = Geo-BI (full SOLAP)

Events…

Thank you ! QUESTIONS ? @spatialytics @l_vaillancourt [email_address] [email_address] [email_address] Spatialytics.COM Spatialytics.ORG Coming soon! WWW Luc Vaillancourt , Spatialytics CEO Dr. Thierry Badard - Spatialytics CTO - Professor at Laval University @tbadard

QUESTIONS ?