Deploying OBIEE in the Cloud - Collaborate'14 Las Vegas
1. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Deploying OBIEE in the Cloud:
Options and Deployment Scenarios
Mark Rittman, CTO, Rittman Mead
Collaborate’14, Las Vegas, April 2014
2. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
About the Speaker
•Mark Rittman, Co-Founder of Rittman Mead
•Oracle ACE Director, specialising in Oracle BI&DW
•14 Years Experience with Oracle Technology
•Regular columnist for Oracle Magazine
•Author of two Oracle Press Oracle BI books
•Oracle Business Intelligence Developers Guide
•Oracle Exalytics Revealed
•Writer for Rittman Mead Blog :
http://www.rittmanmead.com/blog
•Email : mark.rittman@rittmanmead.com
•Twitter : @markrittman
3. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
About Rittman Mead
•Oracle BI and DW Gold partner
•Winner of five UKOUG Partner of the Year awards in 2013 - including BI
•World leading specialist partner for technical excellence,
solutions delivery and innovation in Oracle BI
•Approximately 80 consultants worldwide
•All expert in Oracle BI and DW
•Offices in US (Atlanta), Europe, Australia and India
•Skills in broad range of supporting Oracle tools:
‣OBIEE, OBIA
‣ODIEE
‣Essbase, Oracle OLAP
‣GoldenGate
‣Endeca
4. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Deploying OBIEE in the Cloud
•Many OBIEE customers are considering deploying their BI
infrastructure in the “cloud”
•“Push” and “Pull” factors in-play
‣Perceived benefits in reducing amount of on-premise servers,
software installs, upfront-license costs
‣May also be prompted by migration of rest of IT infrastructure
to the cloud
‣To enable business agility - deploy the system now
•But there are lots of ways you can deploy OBIEE in the cloud
•This presentation will outline the main options and scenarios,
as of January 2014
5. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Enabling Business Agility - Rapid Development in the Cloud
•Example cloud use of OBIEE - accelerating the BI development process
‣Combines agile development (“ExtremeBI”) with OBIEE deployed into Amazon AWS
‣Cloud element allows development to start now
‣Options for repatriating on-premise afterwards
•Based on Amazon AWS (EC2, S3) and Oracle BI
•More details at
http://www.rittmanmead.com/cloudbi/
6. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Deploying OBIEE in the Cloud
Part 1 : Oracle’s (Proposed) OBIEE11g Cloud Offering
7. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Oracle Cloud Business Intelligence
•As announced at Oracle Openworld 2013
•As of Jan’ 2014, in “preview” - web page only
•Expected (by me) in second half of 2014
•Part of the wider PaaS (platform-as-a-service)
offering including database, Java, documents etc
•Aimed at a very specific set of use-cases initially
‣Adding BI and analytics to cloud-based apps
‣Departmental sandbox-type analysis
8. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Self-Service, Consumer-Style Experience
9. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Initial Announced Functionality (Sep’ 2014)
10. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Oracle Cloud Business Intelligence - How it Works
•Runs in Oracle’s public cloud environment - multi-tenant?
‣No upfront license cost
‣Pay monthly (?)
•Uses new thin-client RPD modelling tool
(thick-client BI Administration tool still supported?)
•Only reports against a single Oracle database
schema (Oracle Cloud Schema-as-a-Service)
•“Standard” OBIEE - but will possibly preview new
functionality before on-premise versions
‣Proposed data-mashup feature
•Patched automatically by Oracle
‣Customer able to be max one version behind?
Cloud
On-PremiseAdmin access
over HTTP
Oracle Schema-as-a-service
Database (single source)
Oracle BI-as-a-Service
11. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Thin-Client Data Modeler (Subject to Change)
•Announced at Oracle Openworld 2013 - but could change as product evolves
•Cloud mandates a tool strategy that supports both Cloud and On-Premise development
‣Thin-Client Modeler to be delivered with BI Cloud Service v1
‣Web-based tool designed for the business user
•Masks complexity in creating a full model
using thick-client Admin Tool
•But does not initially support multi-source,
RPD federation etc
‣Future goal is to deliver thin-client tool with
comparable functionality to replace
the legacy Admin Tool
12. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Deploying OBIEE in the Cloud
Part 2 : Deploying “Full” OBIEE into the Public Cloud
13. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Deploying “Full” OBIEE into the Public Cloud
•Oracle’s Cloud Business Intelligence offering is consumer-style BI-as-a-service
•Simple provisioning, setup, maintenance - but with significant limitations (at present)
‣No ability to access non-Oracle cloud DB data
‣No ability to federate data sources
‣No access to Essbase, BI Publisher, Agents, Maps etc
•So why not deploy OBIEE yourself directly into the public cloud?
‣Amazon AWS
‣Rackspace etc
‣VMWare Hybrid Cloud
14. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Cloud Definitions: Public vs. Private Cloud
•Public Cloud: Shared infrastructure provided over the internet, to the public as a service
‣Organizations rent compute resource on this shared platform
‣Key vendors include Amazon (AWS), Rackspace, Microsoft (Azure) - and Oracle
‣Base offering is Infrastructure-as-a-Service (Iaas) - compute, storage, network
‣Also typically offer Platform-as-a-Service (PaaS) - e.g. Amazon RDS, Hosted JEE
•Private Cloud: Provisioning and Efficiency Benefits of cloud, but on private infrastructure
‣Similar principles: shared resource that can be provisioned on-demand
‣But internal to organization: improved security, potentially better value
‣Key vendors: VMWare, OpenStack
‣But elasicitity of service limited by hardware within the private cloud
•Hybrid Cloud: Combination of public + private cloud
‣Majority of workload run on private cloud, but with “burst out” to public cloud
15. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Key Cloud Vendors: Amazon AWS (+ Rackspace etc)
•Dominant vendor in public cloud infrastructure
‣Amazon EC2: Virtual servers in the cloud
‣Amazon S3: Storage in the cloud
•Usually the cheapest for compute/storage etc
•Some free options available
•Pay by the hour for various instance sizes
•Also offers IaaS and PaaS services such as
‣Amazon RDS (Oracle DB, mySQL etc)
‣Amazon Elastic MapReduce etc
•Other competitors include Rackspace, Google,
Microsoft
‣But AWS 5 x larger than next 14 competitors
(combined)
16. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Typical Single-Node Amazon EC2 Deployment
•OBIEE + RCU Database install deployed on a single EC2 instance
‣Various instance size options available based on RAM, vCPU etc
‣OBIEE licensing: 1vCPU = 1 proc
(http://www.oracle.com/us/corporate/
pricing/cloud-licensing-070579.pdf)
•DW Database on Amazon RDS instance
‣Managed Database instance (backups etc)
‣BYOL: 1vCPU = 1 proc DB EE
•Run BI Administrator either on-premise, or
on another EC2 (Windows) instance
Instance Examples:
m3.xlarge (4 vCPU, 15GB RAM) = $328/m
m2.2xlarge (4 vCPU, 34GB RAM) = $598/m
Oracle BI EE licensing: 1vCPU = 1 proc
Oracle DB SE1 licensing: >4vCPU = 1 proc
OBIEE FMW Install
+ RCU Oracle SE1
(Amazon EC2)
DW Database Install
(Amazon RDS)
Amazon RDS Examples (BYOL):
XL DB Instance: 4vCPU, 15GB RAM = $467/m
Hi-Mem 4XL DB Instance: 8vCPU, 68GB RAM
= $1613/m
Oracle DB EE licensing: 1vCPU = 1 proc
17. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
RDS Multi-Availability Zones
Amazon EC2 HA Configuration #1: (Stretch) WLS Cluster
•Multiple EC2 instances organised into
a WLS cluster
‣Instances can be placed into
different EC2 availability
zones (stretch cluster)
‣But watch latency…
•Uses Elastic Load Balancer
to route incoming requests
•Amazon RDS multi-availability
zones for automatic replication
to another availability zone
‣RCU DB cannot be on RDS
as no support for SYS
as SYSADMIN (req. for RCU)
OBIEE FMW Install
(FMW Node 1)
OBIEE FMW Install
(FMW Node 2)
OBIEE FMW Install
(FMW Node n)
Amazon Elastic Load Balancer
RCU Database Install
(Amazon EC2)
DW Database Install
(Amazon RDS)
Oracle Data Guard
WebLogic Domain
18. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Amazon EC2 HA Configuration #2: Replicated Single-Nodes
•Multiple EC2 instances, but configured
as WLS single-node
‣Bi-directional webcat replication keeps
separate catalogs in-sync
‣Could use EBS storage to
create shared FMW_HOME
as per HA EDG topology
‣Potentially place each
instance in separate EC2
availability zone
•Each node has own RCU Oracle DB SE1 DB
•Single Amazon RDS Oracle DB EE
instance for DW database, using
multi-availability zones
RDS Multi-Availability Zones
OBIEE FMW Install
+ RCU Oracle SE1
(FMW Node 1)
OBIEE FMW Install
+ RCU Oracle SE1
(FMW Node 2)
OBIEE FMW Install
+ RCU Oracle SE1
(FMW Node n)
Amazon Elastic Load Balancer
DW Database Install
(Amazon RDS)
Oracle Data Guard
WebLogic Domain WebLogic DomainWebLogic Domain
Bi-directional Webcat Replication
19. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Pros and Cons of Amazon EC2 for OBIEE
•Pros:
‣Cheapest mass-market cloud vendor: effectively sets base price
‣Extremely well-developed IaaS and PaaS offering - load
balancing, HA, monitoring, databases etc
‣Easy availability of skillets, well-known platform
•Cons:
‣Not “native” to OBIEE, Oracle - aimed more at general web apps
‣Some ambiguity around licensing - multi-availability zones etc
‣Not fully-tested AWS HA with OBIEE HA - could be some
incompatibilities etc around clustering, failover etc
‣RCU DB hard to host in RDS - versions, SYSDBA access etc
20. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Key Cloud Vendors: Oracle
•Announced at Oracle Openworld 2013: Infrastructure-as-a-Service (IaaS) offerings
‣Complements the existing PaaS services; aimed more at Amazon AWS
•From later in 2014, ability to rent compute, storage, documents, network etc from
Oracle, similar to Amazon AWS
‣For now though, focus is on service - DBaaS, Java etc - and Apps (HCM etc)
21. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Future Oracle Cloud Deployment?
•OBIEE in the Cloud - initially “sandbox” single source, in future - more features/sources?
•Hyperion EPM apps - Planning, FR
•DBaaS - full database in the cloud,
supports ETL, OLAP etc?
•Storage / Documents
•Identity Management?
•Enterprise Manager?
•But - what will it cost vs. Amazon AWS?
‣How scriptable / extensible will it be?
‣Limitations on product functionality?
‣But Oracle can be creative on licensing
22. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Deploying OBIEE in the Cloud
Part 3 : Multi-tenant OBIEE in the Cloud
23. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Multi-Tenant OBIEE in the Cloud
•Typically used by application providers to provide tenanted access to OBIEE dashboards
•Goes beyond application roles to support SaaS deployments
•New multi-tenant-specific application roles
‣BIGlobalAdministrator - full systems administrator
‣BITenantAdministrator - catalog admin privileges
‣Tenant Users - linked to tenant ID through
FMW identity store (init blocks not supported)
•Still uses single RPD, catalog
•Restricted set of features
‣No FMW control for Tenant admins
‣No Essbase
‣No BI Administration tool for Tenant Admins
‣No Scorecards, RTD, BI Publisher, BI Mobile
24. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Enabling Multi-Tenancy in OBIEE 11g
•Multi-tenancy isn’t enabled by default, needs to be enabled and configured
•Supported from OBIEE 11.1.1.7+
•Probably only really meant for Oracle’s own (cloud) use
•Provides three main capabilities vs.
home-grown multi-tenancy
‣Tenant-specific catalog permission admins
‣TenantGUIDs to prevent GUID clashes across tenants
‣Prompts, user lists etc scoped to just that tenant
•To enable multi-tenancy:
‣Follow the steps at http://docs.oracle.com/cd/
E28280_01/bi.1111/e10541/
configtenant.htm#BABCGBBC
25. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Deploying OBIEE in the Cloud
Part 3 : Cloud Databases for OBIEE
26. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Supporting Databases for OBIEE
•OBIEE 11g requires one or more RDBMSs for data sources, metadata etc
‣DW database (or DB sources) for reporting data
‣RCU database for supporting schemas
(BIPLATFORM, MDS etc)
•Likelihood is that Cloud OBIEE data sources will
be a mixture of on-premise, cloud (and app?)
•If OBIEE is deployed in the cloud, chances are
that it’s because its DW database is also there
•But what are the options if you want to deploy
supporting databases into the cloud?
Cloud
On-PremiseBI Admin Tool
RPD Access
BI Administration
Tool
On-Premise
Data Sources
Cloud-based
data sources
27. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Amazon Relational Database Service
•Database PaaS offering from Amazon AWS, provides
a range of databases as a managed service
‣Oracle SE1/SE/EE, mySQL, MS SQL Server, Postgres
•Includes license (Oracle SE1/SE) or BYOL (Oracle EE)
•Managed service, provides backups etc
•Multi-availability zones for resilience/high-availability
‣Automatically replicates DB to other region
•Mostly “full” Oracle, but no SYS as SYSDBA access
‣So no use for the RCU database
28. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Postgres on Amazon AWS
•Postgres is a mature RDBMS product, free core features, similar capability to Oracle 7/8
•Enterprise DB offer paid support and their own admin tools (Postgres Plus)
•Rather than license + install on-premise, can also be hosted on Amazon AWS
•Offered as an hourly-charged SaaS database,
includes support + tools
•Accessed by (unsupported) Postgres ODBC drivers
•Typically costs around the same price as Oracle SE1
‣$6.48/hour, or approx $56k for each server
(includes hosting though)
‣But need to factor in AWS storage + bandwidth costs
‣Likely annual costs : $120k/year
29. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Left-Field Alternative: Amazon Redshift hosted on Amazon AWS
•Another database-as-a-service offering from Oracle AWS
•Based on ParAccel, cut-down version and native to Amazon Cloud
‣Column-store, analysis-optimised
•Can connect to OBIEE via PostgreSQL drivers,
but like Postgres Plus, not Oracle supported
•Similar cost to Postgres Plus on AWS, but includes
AWS storage and bandwidth costs
30. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
For the Future : Hadoop / Impala (Big Data Sources)
•New in OBIEE 11.1.1.7 : Hadoop Connectivity through Hive
•Hive is a query environment over Hadoop/MapReduce to support SQL-like queries
•Hive server accepts HiveQL queries via HiveODBC or HiveJDBC, automatically
creates MapReduce jobs against data previously loaded into the Hive HDFS tables
•Approach used by ODI and OBIEE to gain access to Hadoop data
•Allows Hadoop data to be accessed just like any other data source
•But … it’s quite slow, for ad-hoc BI queries
31. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Addressing Hadoop / Hive Latency : Cloudera Impala
•Hive is slow - because it’s meant to be used for batch-mode queries
•Many companies / projects are trying to improve Hive - one of which is Cloudera
•Cloudera Impala is an open-source but
commercially-sponsored in-memory MPP platform
•Replaces Hive and MapReduce in the Hadoop stack
•Can we use this, instead of Hive, to access Hadoop?
•It will need to work with OBIEE
•Warning - it won’t be a supported data source (yet…)
32. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
How Impala Works
•A replacement for Hive, but uses Hive concepts and
data dictionary (metastore)
‣but not officially supported with OBIEE (yet)
•MPP (Massively Parallel Processing) query engine
that runs within Hadoop
‣Uses same file formats, security,
resource management as Hadoop
•Processes queries in-memory
•Accesses standard HDFS file data
•Option to use Apache AVRO, RCFile,
LZO or Parquet (column-store)
•Designed for interactive, real-time
SQL-like access to Hadoop
Impala
Hadoop
HDFS etc
BI Server
Presentation Svr
Cloudera Impala
ODBC Driver
Impala
Hadoop
HDFS etc
Impala
Hadoop
HDFS etc
Impala
Hadoop
HDFS etc
Impala
Hadoop
HDFS etc
Multi-Node
Hadoop Cluster
33. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Deploying OBIEE in the Cloud
Part 5 : ETL in the Cloud
34. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Why is ETL Important (& Why Would it Also Move to Cloud)?
•OBIEE needs a data source to report on, typically a data warehouse
•Initially these are on-premise, but over time they may migrate to the cloud
•Once all sources and targets are in the cloud
- where does the ETL live?
‣Doesn’t make sense for it to be the
only on-premise component
‣Can we also run this in the cloud?
35. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
ETL Tools Provided by Cloud Vendors
•Cloud infrastructure vendors (Amazon, Google, Oracle etc) typically provide tools to
import data into the cloud, and keep it refreshed
•These are good options if only this single target, and typically a single source
‣Usually free
‣Optimized for that platform
•But beyond that - you need an ETL tool
‣Complex transformations
‣Different metadata stores
‣Orchestrated loading
36. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Cloud ETL Requirements (DIaaS)
•DIaaS (Data Integration as a service) should be a service
‣Self-provisioned, no software install or configuration
‣Charged by the day/hour
‣Multi-tenant
‣A range of DB and cloud application adapters
‣All thin-client, web-based
‣Easy scale-out, HA, compatibility with Amazon EC2 etc
•Could just do the same as on-premise ETL, but “cloud expectations
are different” - consumer, service, simple UI
37. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Oracle’s Cloud Data Integration Offerings
•ODI 11g/12c could theoretically run in the cloud
•But its ELT approach means there’s no (usual) mid-tier ETL transform element
‣Agents typically are installed on sources and targets
‣Transformation happens on target
•SaaS application adapters typically
provided through Jdeveloper and SOA Suite
‣Functional, but not “consumer-simple”
•Forthcoming OBIA cloud adapters assume
on-premise install of OBIA/OBIEE,
with Oracle cloud apps as sources
38. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Cloud ETL Alternative #1 : Informatica Cloud
•A version of Informatica PowerCenter that runs in the cloud (sort of)
‣Metadata and application layer components run in the cloud (as a multi-tenant app)
‣“Secure Agent” runtime runs on-premise
- cut-down version of PowerCenter
‣Data transformation etc therefore happens on-premise
•Some interaction between on-premise and cloud
‣PowerCenter mapplets can be copied to the cloud
•Obvious cloud option for Informatica customers
39. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Cloud ETL Alternative #2 : SnapLogic Integration Cloud
•“Cloud native” data integration platform
•Focuses on “data paths” and application
integration, with data streamed point-to-point
•Transformations are done through “Snaplexes”
‣Java JVMs similar to ODI agents
‣Can run in-cloud or on-premise
‣Uses Amazon S3 storage for temp files etc
‣Elastic scale-out when running in cloud
•Weakness is the “last mile” of DW data
‣Lacks KMs and other templates for SCDs etc
‣Not as strong as an ELT tool for complex
database transformations
40. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Conclusions
•There are lots of reasons customers are considering deploying OBIEE in the cloud
‣All their other applications are moving to the cloud
‣Reduce cost and complexity around infrastructure
‣Enable business agility with services available now
•Several options for cloud OBIEE deployment
‣Oracle’s upcoming Cloud Business Intelligence offering
‣Deploying “full” OBIEE into a public cloud
‣Access OBIEE as a service using multi-tenancy
•Need to also consider database, IDM, ETL elements
•And also licensing, security etc
41. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Thank You for Attending!
•Thank you for attending this presentation, and more information can be found at
http://www.rittmanmead.com
•Contact us at info@rittmanmead.com or mark.rittman@rittmanmead.com
•Look out for our book, “Oracle Business Intelligence Developers Guide” out now!
•Follow-us on Twitter (@rittmanmead) or Facebook (facebook.com/rittmanmead)
42. T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or
+61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)
E : info@rittmanmead.com
W : www.rittmanmead.com
Deploying OBIEE in the Cloud:
Options and Deployment Scenarios
Mark Rittman, CTO, Rittman Mead
Collaborate’14, Las Vegas, April 2014