Incredible ODI tips to work with Hyperion tools that you ever wanted to know

Incredible ODI tips to work
with Hyperion tools that
you ever wanted to know
Ricardo Giampaoli
Rodrigo Radtke
About the Speakers
Giampaoli, Ricardo
• Oracle Ace
• Master in Business
Administration and IT
management
• EPM training instructor
• Essbase/Planning/OBIEE/ODI
Certified Specialist
• Blogger @ devepm.com
Radtke, Rodrigo
• Oracle Ace
• Graduated in Computer
Engineering
• Software Developer Sr. Advisor
at Dell
• ODI, Oracle and Java Certified
• Blogger @ devepm.com
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
What we'll learn
• Looping ODI Objects
• Dynamic “OS” commands
• Powerful “Dynamic Variables”
• Substitution Tags and how useful they are
• Dynamic Topology
• “Third Command Tab“ Technic
• ODI custom execution information
• Stop, Start and Restart ODI priority jobs automatically
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Looping ODI Objects (Regular Way)
• Too much work to control complex loop order and parameter variables
• More ODI Objects to maintain
• Harder to make it dynamic
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Looping ODI Objects (Champion Way)
• Easy to control complex loop order and parameter variables
• Less ODI Objects to maintain
• Easier to make it dynamic
• Be careful about the Log Counter and parallel executions
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Looping ODI Objects (Champion Way)
• Command on Source
• Always a Select command
• Command on Target
• DML commands
• Inserts, Update, delete, truncate, create…
• ODI Commands
• odiStartScen, odiFileXxxx, OS Command...
• Programming languages
• Java/groove/jython…
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Looping ODI Objects (Champion Way)
• Loop virtually anything
• Can “Generate” dynamic code
• Using ALL_TAB_COLUMNS we can change the code in
the “command on target” dynamically
• Change the columns dynamically
• Change the code in the WHERE/AND statement
• Creating SQL code (regular expression depending on the
amount of columns of the source table/repository)
• Using LISTAGG we can build models dynamically
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Dynamic "OS" Commands
• Use the same loop approach to get dynamic information from the
source and apply on the target tab
• Any type of OS command
• Great to automate EPM environments
• Stop, Start and restart services
• Log windows events
• Execute Esscmd and Essmsh commands (needs to configure system variables
in the Agent server to enable the execution of the commands anywhere in
the system)
• Execute EPMAutomate for PBCS
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Dynamic "OS" Commands (Essmsh/Esscmd)
• For Essmsh/Esscmd commands we need to use the DOS command
“echo” with the option -i
• “echo” will echo all the command until the | to the next command
• “echo” allow us to connect and then execute a maxl command in Essbase
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Dynamic "OS" Commands (Essmsh/Esscmd)
• Command on Source
• None. Set just the connection information to be used in the
target tab
• Command on Target
• Essmsh
• Alter, Create, Display, Drop, Execute, Import, Export, Refresh and
Query
• Esscmd
• Get, Create, Delete, List, Rename, Set, Update, Validate, Reset,
Remove….
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Powerful “Global Variables“ (Regular way)
• Parameter table to store parameter
values
• One column is the Session Name to get
the parameter dynamically depending of
the Session being executed
• Three more columns to store the
parameter type, parameter name and
parameter value
• All Scenarios will start with the
SESSION_NM Variable
• This technic allow us to have just one
variable to get different “LOG_PATH” for
different scenarios
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Powerful “Global Variables“ (Champion way)
• The only thing that changes is the
select inside the variables:
• We use the previous query as a sub query
to test if the query will return any rows
from the parameter table for that specific
Session Name
• If the results in empty the NVL command
will return “GLOBAL”
• This allow us to create just one Global
parameter for all interfaces
• Also if anything changes,
we just need to insert a
new value for any session name and the
variable will bring that value just for that
scenario
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Powerful “Global Variables“ (Champion way)
• Less variables to maintain and easier for deployment
• In most part the value of the variables are the same for all
interfaces
• Servers name, paths, emails, application name…
• We can leverage this technic using ODI Global variables
• No need to create the same variable in all projects
• More flexible
• If a test needs to be performed or something changes the only
thing needed is an insert for that specific scenario
• To rollback we just need to delete the Session specific row
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Substitution Tags and how useful they are
• Substitution tags are part of the java substitution API
• The API methods are java methods that return a string value
• 4 type of Substitution Tags
• <%>, <?>, <@> and <$>
• All of them does the same thing but each one has its own parse phase
• <%>: generates the command when it is sent to the agent, but BEFORE it gets to the agent;
• <?>: generates the code in the agent server, BEFORE the command is sent to Operator
and BEFORE ODI variables are substituted
• <$> (available from 11.1.1.6 on): generates the code in the agent server, BEFORE the
command is sent to Operator but AFTER ODI variables are substituted
• <@>: generates the code in the agent server, AFTER the command appears in the Operator
and AFTER ODI variables are substituted
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Substitution Tags and how useful they are
• Create an ODI variable and write ‘TEST’ on it
• Execute in Jython technology:
• Raise ‘<%= System.getProperty("os.name") %> -
<%="#ODI_VAR"%>’
• Repeat for each substitution tag
• Agent is Windows server 2008
• Client is Windows server 2003
Subs Tag Code generated Results
<%> raise 'Windows 2003 - #KSCOPE.ODI_VAR' Windows 2003 - TEST
<?> raise 'Windows Server 2008 R2 - #KSCOPE.ODI_VAR' Windows Server 2008 R2 - TEST
<$> raise 'Windows Server 2008 R2 - TEST' Windows Server 2008 R2 - TEST
<@> raise '<@= System.getProperty("os.name") @> - <@="#KSCOPE.ODI_VAR"@>' Windows Server 2008 R2 - TEST
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Substitution Tags and how useful they are
• Different parse phases are useful to create dynamic code
• Heavily used in ODI KMs
• We may “loop” tags within tags
• We can have a code in % phase passing information to a ? Phase
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Dynamic Topology (Regular Way)
• Featured by multiple contexts
• One Physical for each DB
• One Logic For All Physics
• One Context for each Physical
• Context nightmare
• Tons of context to manage
• If users executes scenarios in
operator, multiple context make it
difficult
• In multiple projects one context
could mean nothing
Amer
Apj
Emea
N DB
Amer
Apj
Emea
N DB
Target DWGlobal
Physical
Context
Logical
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Dynamic Topology (Champion Way)
• Featured by dynamic topology
• One Physical for each DB + one
physical with variables (Dynamic)
• One Logical for each Physical
• One Context for all
• Context heaven
• One context to manage
• Easier for users to execute
• One context for all projects
• Works in ODI 11 and ODI 12 with
patch 21156142
Amer Apj Emea N DB
Global DWDynamic
Amer Apj Emea N DB
Dynamic
Physical
Context
Logical
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Dynamic Topology (Champion Way)
• Create one variable for each field in the
physical topology
• Data Server:
• User: #ODI_PROJECT.CONN_USER
• Password: #ODI_PROJECT.CONN_PASS
• JDBC URL: #ODI_PROJECT.CONN_URL
• Physical Schema:
• Schema: #ODI_PROJECT.CONN_DATA_USER
• Work Schema: #ODI_PROJECT.CONN_WORK_USER
• Need to inform the
project_code.variable_name
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Dynamic Topology (Champion Way)
• Create one procedure
• One step for each database to
get the connection information
• The connection information
will be retrieved from the
“Command on Source” tab
• “Command on Target” to
execute a scenario passing all
connection information needed
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
“Third Command Tab“ Technic
• Sometimes we need more than a
command on source and target
• Executions of Maxl in multiple Essbase
applications
• Select on source with application
information (Loop)
• Command on target (to execute what we
want)
• Since we are using the Oracle technology
in the command on source we cannot get
Essbase login information
• For this example we need a “Third
Command Tab”
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
“Third Command Tab“ Technic
• Create a new step to get the
connection information
• On the command on source set
the Essbase technology and
schema
• On the command on target
use Java technology
and create 3 java
variables that will hold the
connection information
• Use the Java Variable in the next
Steps
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
“Third Command Tab“ Technic
• Loop Maxl/Cmd commands
• Get the return of a SQL into a Java variable to use in other
steps
• This is also useful because the java variable is replaced for his value
in operator
• Anything you want to store and use later within the scenario
execution
• If you want to use inside a children scenario you need to pass it to a
variable inside the scenario
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
ODI Custom Execution Information
• ODI repositories contains all kind of
useful information that we can
retrieve at run time
• Execution information, current variable
values, jobs in execution…
• We can retrieve all this information
using the previews technics
• Inside a procedure in the command on
source set the ODI repository connection
• In the command on target create a SQL
and add it to a java code that will
connect in the database to retrieve the
information
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
ODI custom execution information
• In another step we just need to
“Raise” the previous variable
• Now you can use anywhere in the
package
• This will show in the operator
the value that all existing
variables until that point has
• Works with all kind of variables:
refresh, set, declare, global,
project only…
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Stop, Start and Restart ODI priority jobs
automatically
• There’re some commands that cannot be executed within
ODI tools:
• Restart load plan, Restart session, Stop load plan, Stop session,
Start load plan, Start scen
• But all these commands can be executed outside ODI
using some .bat/.sh files located in the agent server:
• oraclediagentbin (Only exists in the agent)
• The command to ran is:
• stopsession <session_number> “-AGENT_URL=<agent_url>” [“-
STOP_LEVEL=<normal(default)|immediate>”]
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Stop, Start and Restart ODI priority jobs
automatically
• If we want to stop all jobs before running a priority
job, we could get all running jobs from ODI
repository and stop them
• To do so we need to get the Agent URL from the
master repository
• Get the job information from the work
repository
• And stop all the sessions
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Stop, Start and Restart ODI priority jobs
automatically
• Useful for priority job
• Check if other jobs are running and stop them automatically
• Executing jobs respecting a time window
• We can stop jobs that executes longer than a specific time window
• Depending of the error restart automatically a specific
job
DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Ricardo Giampaoli – TeraCorp
Rodrigo Radtke de Souza - Dell
Thank you!
1 of 29

Recommended

FE로 취업 전에 알았으면 좋았을 것들 by
FE로 취업 전에 알았으면 좋았을 것들FE로 취업 전에 알았으면 좋았을 것들
FE로 취업 전에 알았으면 좋았을 것들Taegon Kim
4.6K views39 slides
Hyperion planning integration with odi by
Hyperion planning integration with odiHyperion planning integration with odi
Hyperion planning integration with odiAmit Sharma
7.7K views17 slides
Nightwatch JS for End to End Tests by
Nightwatch JS for End to End TestsNightwatch JS for End to End Tests
Nightwatch JS for End to End TestsSriram Angajala
691 views13 slides
Docker Basic to Advance by
Docker Basic to AdvanceDocker Basic to Advance
Docker Basic to AdvanceParas Jain
470 views101 slides
Enterprise container platform verrazzano by
Enterprise container platform verrazzanoEnterprise container platform verrazzano
Enterprise container platform verrazzanoMichel Schildmeijer
388 views17 slides
[GitOps] Argo CD on GKE (v0.9.2).pdf by
[GitOps] Argo CD on GKE (v0.9.2).pdf[GitOps] Argo CD on GKE (v0.9.2).pdf
[GitOps] Argo CD on GKE (v0.9.2).pdfJo Hoon
515 views27 slides

More Related Content

What's hot

Create and Schedule scenario with ODI 11g by
Create and Schedule scenario with ODI 11gCreate and Schedule scenario with ODI 11g
Create and Schedule scenario with ODI 11gDharmaraj Borse
7.9K views10 slides
Observability with Consul Connect by
Observability with Consul ConnectObservability with Consul Connect
Observability with Consul ConnectBram Vogelaar
377 views38 slides
Docker introduction by
Docker introductionDocker introduction
Docker introductionJulien Maitrehenry
2.9K views34 slides
Step by step procedure for loading of data from the flat file to the master d... by
Step by step procedure for loading of data from the flat file to the master d...Step by step procedure for loading of data from the flat file to the master d...
Step by step procedure for loading of data from the flat file to the master d...Prashant Tyagi
21.3K views17 slides
Docker, LinuX Container by
Docker, LinuX ContainerDocker, LinuX Container
Docker, LinuX ContainerAraf Karsh Hamid
5.6K views71 slides
02 terraform core concepts by
02 terraform core concepts02 terraform core concepts
02 terraform core conceptszekeLabs Technologies
1.1K views15 slides

What's hot(20)

Create and Schedule scenario with ODI 11g by Dharmaraj Borse
Create and Schedule scenario with ODI 11gCreate and Schedule scenario with ODI 11g
Create and Schedule scenario with ODI 11g
Dharmaraj Borse7.9K views
Observability with Consul Connect by Bram Vogelaar
Observability with Consul ConnectObservability with Consul Connect
Observability with Consul Connect
Bram Vogelaar377 views
Step by step procedure for loading of data from the flat file to the master d... by Prashant Tyagi
Step by step procedure for loading of data from the flat file to the master d...Step by step procedure for loading of data from the flat file to the master d...
Step by step procedure for loading of data from the flat file to the master d...
Prashant Tyagi21.3K views
Terraform Introduction by soniasnowfrog
Terraform IntroductionTerraform Introduction
Terraform Introduction
soniasnowfrog3.3K views
Introduction to Ansible by CoreStack
Introduction to AnsibleIntroduction to Ansible
Introduction to Ansible
CoreStack721 views
nexus helm 설치, docker/helm repo 설정과 예제 by choi sungwook
nexus helm 설치, docker/helm repo 설정과 예제nexus helm 설치, docker/helm repo 설정과 예제
nexus helm 설치, docker/helm repo 설정과 예제
choi sungwook470 views
Docker Networking Deep Dive by Docker, Inc.
Docker Networking Deep DiveDocker Networking Deep Dive
Docker Networking Deep Dive
Docker, Inc.17.5K views
Formation JPA Avancé / Hibernate gratuite par Ippon 2014 by Ippon
Formation JPA Avancé / Hibernate gratuite par Ippon 2014Formation JPA Avancé / Hibernate gratuite par Ippon 2014
Formation JPA Avancé / Hibernate gratuite par Ippon 2014
Ippon19.9K views
Sw 100 fr docker conteneurisation des applications by Stephane Woillez
Sw 100 fr docker conteneurisation des applicationsSw 100 fr docker conteneurisation des applications
Sw 100 fr docker conteneurisation des applications
Stephane Woillez474 views
AWS 를 활용한 저지연 라이브 (Low Latency Live) 서비스 구현 - 류재춘 컨설턴트/에반젤리스트, GS Neot다 :: AW... by Amazon Web Services Korea
AWS 를 활용한 저지연 라이브 (Low Latency Live) 서비스 구현 - 류재춘 컨설턴트/에반젤리스트, GS Neot다 :: AW...AWS 를 활용한 저지연 라이브 (Low Latency Live) 서비스 구현 - 류재춘 컨설턴트/에반젤리스트, GS Neot다 :: AW...
AWS 를 활용한 저지연 라이브 (Low Latency Live) 서비스 구현 - 류재춘 컨설턴트/에반젤리스트, GS Neot다 :: AW...
Ansible roles done right by Dan Vaida
Ansible roles done rightAnsible roles done right
Ansible roles done right
Dan Vaida1.7K views
AWS 미디어 서비스를 이용한 글로벌 라이브 스트리밍 서비스 구축 - 황윤상 솔루션즈 아키텍트, AWS / 조용진 솔루션즈 아키텍트, AW... by Amazon Web Services Korea
AWS 미디어 서비스를 이용한 글로벌 라이브 스트리밍 서비스 구축 - 황윤상 솔루션즈 아키텍트, AWS / 조용진 솔루션즈 아키텍트, AW...AWS 미디어 서비스를 이용한 글로벌 라이브 스트리밍 서비스 구축 - 황윤상 솔루션즈 아키텍트, AWS / 조용진 솔루션즈 아키텍트, AW...
AWS 미디어 서비스를 이용한 글로벌 라이브 스트리밍 서비스 구축 - 황윤상 솔루션즈 아키텍트, AWS / 조용진 솔루션즈 아키텍트, AW...
SAP BW - Master data load via flat file by Yasmin Ashraf
SAP BW - Master data load via flat fileSAP BW - Master data load via flat file
SAP BW - Master data load via flat file
Yasmin Ashraf3.5K views
JCConf 2022 - New Features in Java 18 & 19 by Joseph Kuo
JCConf 2022 - New Features in Java 18 & 19JCConf 2022 - New Features in Java 18 & 19
JCConf 2022 - New Features in Java 18 & 19
Joseph Kuo220 views
Infrastructure as Code with Terraform and Ansible by DevOps Meetup Bern
Infrastructure as Code with Terraform and AnsibleInfrastructure as Code with Terraform and Ansible
Infrastructure as Code with Terraform and Ansible
DevOps Meetup Bern1.6K views
Automated Deployments with Ansible by Martin Etmajer
Automated Deployments with AnsibleAutomated Deployments with Ansible
Automated Deployments with Ansible
Martin Etmajer14.4K views
Terraform introduction by Jason Vance
Terraform introductionTerraform introduction
Terraform introduction
Jason Vance760 views

Viewers also liked

Tableau Best Practices for OBIEE by
Tableau Best Practices for OBIEETableau Best Practices for OBIEE
Tableau Best Practices for OBIEEBI Connector
2.3K views18 slides
How to solve complex business requirements with Oracle Data Integrator? by
How to solve complex business requirements with Oracle Data Integrator?How to solve complex business requirements with Oracle Data Integrator?
How to solve complex business requirements with Oracle Data Integrator?Gurcan Orhan
7.3K views68 slides
Oracle BI Hybrid BI : Mode 1 + Mode 2, Cloud + On-Premise Business Analytics by
Oracle BI Hybrid BI : Mode 1 + Mode 2, Cloud + On-Premise Business AnalyticsOracle BI Hybrid BI : Mode 1 + Mode 2, Cloud + On-Premise Business Analytics
Oracle BI Hybrid BI : Mode 1 + Mode 2, Cloud + On-Premise Business AnalyticsMark Rittman
4K views54 slides
SQL: The one language to rule all your data by
SQL: The one language to rule all your dataSQL: The one language to rule all your data
SQL: The one language to rule all your dataBrendan Tierney
3.3K views73 slides
Predictive analytics: Mining gold and creating valuable product by
Predictive analytics: Mining gold and creating valuable productPredictive analytics: Mining gold and creating valuable product
Predictive analytics: Mining gold and creating valuable productBrendan Tierney
3.2K views30 slides
No more unknown members! Smart data load validation for Hyperion Planning usi... by
No more unknown members! Smart data load validation for Hyperion Planning usi...No more unknown members! Smart data load validation for Hyperion Planning usi...
No more unknown members! Smart data load validation for Hyperion Planning usi...Rodrigo Radtke de Souza
1.1K views37 slides

Viewers also liked(20)

Tableau Best Practices for OBIEE by BI Connector
Tableau Best Practices for OBIEETableau Best Practices for OBIEE
Tableau Best Practices for OBIEE
BI Connector2.3K views
How to solve complex business requirements with Oracle Data Integrator? by Gurcan Orhan
How to solve complex business requirements with Oracle Data Integrator?How to solve complex business requirements with Oracle Data Integrator?
How to solve complex business requirements with Oracle Data Integrator?
Gurcan Orhan7.3K views
Oracle BI Hybrid BI : Mode 1 + Mode 2, Cloud + On-Premise Business Analytics by Mark Rittman
Oracle BI Hybrid BI : Mode 1 + Mode 2, Cloud + On-Premise Business AnalyticsOracle BI Hybrid BI : Mode 1 + Mode 2, Cloud + On-Premise Business Analytics
Oracle BI Hybrid BI : Mode 1 + Mode 2, Cloud + On-Premise Business Analytics
Mark Rittman4K views
SQL: The one language to rule all your data by Brendan Tierney
SQL: The one language to rule all your dataSQL: The one language to rule all your data
SQL: The one language to rule all your data
Brendan Tierney3.3K views
Predictive analytics: Mining gold and creating valuable product by Brendan Tierney
Predictive analytics: Mining gold and creating valuable productPredictive analytics: Mining gold and creating valuable product
Predictive analytics: Mining gold and creating valuable product
Brendan Tierney3.2K views
No more unknown members! Smart data load validation for Hyperion Planning usi... by Rodrigo Radtke de Souza
No more unknown members! Smart data load validation for Hyperion Planning usi...No more unknown members! Smart data load validation for Hyperion Planning usi...
No more unknown members! Smart data load validation for Hyperion Planning usi...
How to Handle DEV&TEST&PROD for Oracle Data Integrator by Gurcan Orhan
How to Handle DEV&TEST&PROD for Oracle Data IntegratorHow to Handle DEV&TEST&PROD for Oracle Data Integrator
How to Handle DEV&TEST&PROD for Oracle Data Integrator
Gurcan Orhan13.3K views
OBIEE 11.1.1.7: Upgrade y Nuevas Características by Edelweiss Kammermann
OBIEE 11.1.1.7: Upgrade y Nuevas CaracterísticasOBIEE 11.1.1.7: Upgrade y Nuevas Características
OBIEE 11.1.1.7: Upgrade y Nuevas Características
But how do I GET the data? Transparency Camp 2014 by Jeffrey Quigley
But how do I GET the data? Transparency Camp 2014But how do I GET the data? Transparency Camp 2014
But how do I GET the data? Transparency Camp 2014
Jeffrey Quigley3.6K views
oracle data integrator training | oracle data integrator training videos | or... by Nancy Thomas
oracle data integrator training | oracle data integrator training videos | or...oracle data integrator training | oracle data integrator training videos | or...
oracle data integrator training | oracle data integrator training videos | or...
Nancy Thomas869 views
Odi best-practice-data-warehouse-168255 by nm2013
Odi best-practice-data-warehouse-168255Odi best-practice-data-warehouse-168255
Odi best-practice-data-warehouse-168255
nm201310.8K views
ODI 11g in the Enterprise - BIWA 2013 by Mark Rittman
ODI 11g in the Enterprise - BIWA 2013ODI 11g in the Enterprise - BIWA 2013
ODI 11g in the Enterprise - BIWA 2013
Mark Rittman3.9K views
A microservice approach for legacy modernisation by luisw19
A microservice approach for legacy modernisationA microservice approach for legacy modernisation
A microservice approach for legacy modernisation
luisw199.9K views
Empowering Business Users: OBIEE 12c Visual Analyzer and Data Mashup by Edelweiss Kammermann
Empowering Business Users: OBIEE 12c Visual Analyzer and Data MashupEmpowering Business Users: OBIEE 12c Visual Analyzer and Data Mashup
Empowering Business Users: OBIEE 12c Visual Analyzer and Data Mashup
OUG Ireland Meet-up - Updates from Oracle Open World 2016 by Brendan Tierney
OUG Ireland Meet-up - Updates from Oracle Open World 2016OUG Ireland Meet-up - Updates from Oracle Open World 2016
OUG Ireland Meet-up - Updates from Oracle Open World 2016
Brendan Tierney2.3K views

Similar to Incredible ODI tips to work with Hyperion tools that you ever wanted to know

Wider than rails by
Wider than railsWider than rails
Wider than railsAlexey Nayden
1.8K views32 slides
Write Generic Code with the Tooling API by
Write Generic Code with the Tooling APIWrite Generic Code with the Tooling API
Write Generic Code with the Tooling APIAdam Olshansky
584 views30 slides
Ansible: How to Get More Sleep and Require Less Coffee by
Ansible: How to Get More Sleep and Require Less CoffeeAnsible: How to Get More Sleep and Require Less Coffee
Ansible: How to Get More Sleep and Require Less CoffeeSarah Z
25.5K views64 slides
Scaling tappsi by
Scaling tappsiScaling tappsi
Scaling tappsiÓscar Andrés López
1.1K views37 slides
How to JavaOne 2016 - Generate Customized Java 8 Code from Your Database [TUT... by
How to JavaOne 2016 - Generate Customized Java 8 Code from Your Database [TUT...How to JavaOne 2016 - Generate Customized Java 8 Code from Your Database [TUT...
How to JavaOne 2016 - Generate Customized Java 8 Code from Your Database [TUT...Malin Weiss
60 views76 slides
JavaOne2016 - How to Generate Customized Java 8 Code from Your Database [TUT4... by
JavaOne2016 - How to Generate Customized Java 8 Code from Your Database [TUT4...JavaOne2016 - How to Generate Customized Java 8 Code from Your Database [TUT4...
JavaOne2016 - How to Generate Customized Java 8 Code from Your Database [TUT4...Speedment, Inc.
453 views76 slides

Similar to Incredible ODI tips to work with Hyperion tools that you ever wanted to know(20)

Write Generic Code with the Tooling API by Adam Olshansky
Write Generic Code with the Tooling APIWrite Generic Code with the Tooling API
Write Generic Code with the Tooling API
Adam Olshansky584 views
Ansible: How to Get More Sleep and Require Less Coffee by Sarah Z
Ansible: How to Get More Sleep and Require Less CoffeeAnsible: How to Get More Sleep and Require Less Coffee
Ansible: How to Get More Sleep and Require Less Coffee
Sarah Z25.5K views
How to JavaOne 2016 - Generate Customized Java 8 Code from Your Database [TUT... by Malin Weiss
How to JavaOne 2016 - Generate Customized Java 8 Code from Your Database [TUT...How to JavaOne 2016 - Generate Customized Java 8 Code from Your Database [TUT...
How to JavaOne 2016 - Generate Customized Java 8 Code from Your Database [TUT...
Malin Weiss60 views
JavaOne2016 - How to Generate Customized Java 8 Code from Your Database [TUT4... by Speedment, Inc.
JavaOne2016 - How to Generate Customized Java 8 Code from Your Database [TUT4...JavaOne2016 - How to Generate Customized Java 8 Code from Your Database [TUT4...
JavaOne2016 - How to Generate Customized Java 8 Code from Your Database [TUT4...
Speedment, Inc.453 views
Punta Dreamin 17 Generic Apex and Tooling Api by Adam Olshansky
Punta Dreamin 17 Generic Apex and Tooling ApiPunta Dreamin 17 Generic Apex and Tooling Api
Punta Dreamin 17 Generic Apex and Tooling Api
Adam Olshansky307 views
Testing sync engine by Ilya Puchka
Testing sync engineTesting sync engine
Testing sync engine
Ilya Puchka349 views
Automate across Platform, OS, Technologies with TaaS by Thoughtworks
Automate across Platform, OS, Technologies with TaaSAutomate across Platform, OS, Technologies with TaaS
Automate across Platform, OS, Technologies with TaaS
Thoughtworks2.2K views
Scala io2013 : Our journey from UML/MDD to Scala macros by ebiznext
Scala io2013 : Our journey from UML/MDD to Scala macrosScala io2013 : Our journey from UML/MDD to Scala macros
Scala io2013 : Our journey from UML/MDD to Scala macros
ebiznext4.9K views
Solid And Sustainable Development in Scala by Kazuhiro Sera
Solid And Sustainable Development in ScalaSolid And Sustainable Development in Scala
Solid And Sustainable Development in Scala
Kazuhiro Sera10.4K views
Silicon Valley JUG - How to generate customized java 8 code from your database by Speedment, Inc.
Silicon Valley JUG - How to generate customized java 8 code from your databaseSilicon Valley JUG - How to generate customized java 8 code from your database
Silicon Valley JUG - How to generate customized java 8 code from your database
Speedment, Inc.267 views
How to generate customized java 8 code from your database by Speedment, Inc.
How to generate customized java 8 code from your databaseHow to generate customized java 8 code from your database
How to generate customized java 8 code from your database
Speedment, Inc.1.4K views
Data Warehouse 2.0: Master Techniques for EPM Guys (Powered by ODI) by Rodrigo Radtke de Souza
Data Warehouse 2.0: Master Techniques for EPM Guys (Powered by ODI)Data Warehouse 2.0: Master Techniques for EPM Guys (Powered by ODI)
Data Warehouse 2.0: Master Techniques for EPM Guys (Powered by ODI)
6 tips for improving ruby performance by Engine Yard
6 tips for improving ruby performance6 tips for improving ruby performance
6 tips for improving ruby performance
Engine Yard6.6K views
Solid and Sustainable Development in Scala by scalaconfjp
Solid and Sustainable Development in ScalaSolid and Sustainable Development in Scala
Solid and Sustainable Development in Scala
scalaconfjp539 views
Database Provisioning in EM12c: Provision me a Database Now! by Maaz Anjum
Database Provisioning in EM12c: Provision me a Database Now!Database Provisioning in EM12c: Provision me a Database Now!
Database Provisioning in EM12c: Provision me a Database Now!
Maaz Anjum3.3K views
Ladies Be Architects - Apex Basics by gemziebeth
Ladies Be Architects - Apex BasicsLadies Be Architects - Apex Basics
Ladies Be Architects - Apex Basics
gemziebeth1.2K views
Automate across Platform, OS, Technologies with TaaS by Anand Bagmar
Automate across Platform, OS, Technologies with TaaSAutomate across Platform, OS, Technologies with TaaS
Automate across Platform, OS, Technologies with TaaS
Anand Bagmar1.3K views

Recently uploaded

Advanced_Recommendation_Systems_Presentation.pptx by
Advanced_Recommendation_Systems_Presentation.pptxAdvanced_Recommendation_Systems_Presentation.pptx
Advanced_Recommendation_Systems_Presentation.pptxneeharikasingh29
5 views9 slides
TGP 2.docx by
TGP 2.docxTGP 2.docx
TGP 2.docxsandi636490
10 views8 slides
Chapter 3b- Process Communication (1) (1)(1) (1).pptx by
Chapter 3b- Process Communication (1) (1)(1) (1).pptxChapter 3b- Process Communication (1) (1)(1) (1).pptx
Chapter 3b- Process Communication (1) (1)(1) (1).pptxayeshabaig2004
6 views30 slides
CRM stick or twist.pptx by
CRM stick or twist.pptxCRM stick or twist.pptx
CRM stick or twist.pptxinfo828217
10 views16 slides
RIO GRANDE SUPPLY COMPANY INC, JAYSON.docx by
RIO GRANDE SUPPLY COMPANY INC, JAYSON.docxRIO GRANDE SUPPLY COMPANY INC, JAYSON.docx
RIO GRANDE SUPPLY COMPANY INC, JAYSON.docxJaysonGarabilesEspej
6 views3 slides
Data Journeys Hard Talk workshop final.pptx by
Data Journeys Hard Talk workshop final.pptxData Journeys Hard Talk workshop final.pptx
Data Journeys Hard Talk workshop final.pptxinfo828217
10 views18 slides

Recently uploaded(20)

Advanced_Recommendation_Systems_Presentation.pptx by neeharikasingh29
Advanced_Recommendation_Systems_Presentation.pptxAdvanced_Recommendation_Systems_Presentation.pptx
Advanced_Recommendation_Systems_Presentation.pptx
Chapter 3b- Process Communication (1) (1)(1) (1).pptx by ayeshabaig2004
Chapter 3b- Process Communication (1) (1)(1) (1).pptxChapter 3b- Process Communication (1) (1)(1) (1).pptx
Chapter 3b- Process Communication (1) (1)(1) (1).pptx
ayeshabaig20046 views
CRM stick or twist.pptx by info828217
CRM stick or twist.pptxCRM stick or twist.pptx
CRM stick or twist.pptx
info82821710 views
Data Journeys Hard Talk workshop final.pptx by info828217
Data Journeys Hard Talk workshop final.pptxData Journeys Hard Talk workshop final.pptx
Data Journeys Hard Talk workshop final.pptx
info82821710 views
Cross-network in Google Analytics 4.pdf by GA4 Tutorials
Cross-network in Google Analytics 4.pdfCross-network in Google Analytics 4.pdf
Cross-network in Google Analytics 4.pdf
GA4 Tutorials6 views
Short Story Assignment by Kelly Nguyen by kellynguyen01
Short Story Assignment by Kelly NguyenShort Story Assignment by Kelly Nguyen
Short Story Assignment by Kelly Nguyen
kellynguyen0119 views
CRIJ4385_Death Penalty_F23.pptx by yvettemm100
CRIJ4385_Death Penalty_F23.pptxCRIJ4385_Death Penalty_F23.pptx
CRIJ4385_Death Penalty_F23.pptx
yvettemm1006 views
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx by DataScienceConferenc1
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx
Ukraine Infographic_22NOV2023_v2.pdf by AnastosiyaGurin
Ukraine Infographic_22NOV2023_v2.pdfUkraine Infographic_22NOV2023_v2.pdf
Ukraine Infographic_22NOV2023_v2.pdf
AnastosiyaGurin1.4K views
Organic Shopping in Google Analytics 4.pdf by GA4 Tutorials
Organic Shopping in Google Analytics 4.pdfOrganic Shopping in Google Analytics 4.pdf
Organic Shopping in Google Analytics 4.pdf
GA4 Tutorials14 views
CRM stick or twist workshop by info828217
CRM stick or twist workshopCRM stick or twist workshop
CRM stick or twist workshop
info8282179 views
[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M... by DataScienceConferenc1
[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M...[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M...
[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M...
[DSC Europe 23] Spela Poklukar & Tea Brasanac - Retrieval Augmented Generation by DataScienceConferenc1
[DSC Europe 23] Spela Poklukar & Tea Brasanac - Retrieval Augmented Generation[DSC Europe 23] Spela Poklukar & Tea Brasanac - Retrieval Augmented Generation
[DSC Europe 23] Spela Poklukar & Tea Brasanac - Retrieval Augmented Generation
3196 The Case of The East River by ErickANDRADE90
3196 The Case of The East River3196 The Case of The East River
3196 The Case of The East River
ErickANDRADE9016 views
Data about the sector workshop by info828217
Data about the sector workshopData about the sector workshop
Data about the sector workshop
info82821712 views

Incredible ODI tips to work with Hyperion tools that you ever wanted to know

  • 1. Incredible ODI tips to work with Hyperion tools that you ever wanted to know Ricardo Giampaoli Rodrigo Radtke
  • 2. About the Speakers Giampaoli, Ricardo • Oracle Ace • Master in Business Administration and IT management • EPM training instructor • Essbase/Planning/OBIEE/ODI Certified Specialist • Blogger @ devepm.com Radtke, Rodrigo • Oracle Ace • Graduated in Computer Engineering • Software Developer Sr. Advisor at Dell • ODI, Oracle and Java Certified • Blogger @ devepm.com
  • 3. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM What we'll learn • Looping ODI Objects • Dynamic “OS” commands • Powerful “Dynamic Variables” • Substitution Tags and how useful they are • Dynamic Topology • “Third Command Tab“ Technic • ODI custom execution information • Stop, Start and Restart ODI priority jobs automatically
  • 4. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Looping ODI Objects (Regular Way) • Too much work to control complex loop order and parameter variables • More ODI Objects to maintain • Harder to make it dynamic
  • 5. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Looping ODI Objects (Champion Way) • Easy to control complex loop order and parameter variables • Less ODI Objects to maintain • Easier to make it dynamic • Be careful about the Log Counter and parallel executions
  • 6. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Looping ODI Objects (Champion Way) • Command on Source • Always a Select command • Command on Target • DML commands • Inserts, Update, delete, truncate, create… • ODI Commands • odiStartScen, odiFileXxxx, OS Command... • Programming languages • Java/groove/jython…
  • 7. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Looping ODI Objects (Champion Way) • Loop virtually anything • Can “Generate” dynamic code • Using ALL_TAB_COLUMNS we can change the code in the “command on target” dynamically • Change the columns dynamically • Change the code in the WHERE/AND statement • Creating SQL code (regular expression depending on the amount of columns of the source table/repository) • Using LISTAGG we can build models dynamically
  • 8. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Dynamic "OS" Commands • Use the same loop approach to get dynamic information from the source and apply on the target tab • Any type of OS command • Great to automate EPM environments • Stop, Start and restart services • Log windows events • Execute Esscmd and Essmsh commands (needs to configure system variables in the Agent server to enable the execution of the commands anywhere in the system) • Execute EPMAutomate for PBCS
  • 9. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Dynamic "OS" Commands (Essmsh/Esscmd) • For Essmsh/Esscmd commands we need to use the DOS command “echo” with the option -i • “echo” will echo all the command until the | to the next command • “echo” allow us to connect and then execute a maxl command in Essbase
  • 10. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Dynamic "OS" Commands (Essmsh/Esscmd) • Command on Source • None. Set just the connection information to be used in the target tab • Command on Target • Essmsh • Alter, Create, Display, Drop, Execute, Import, Export, Refresh and Query • Esscmd • Get, Create, Delete, List, Rename, Set, Update, Validate, Reset, Remove….
  • 11. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Powerful “Global Variables“ (Regular way) • Parameter table to store parameter values • One column is the Session Name to get the parameter dynamically depending of the Session being executed • Three more columns to store the parameter type, parameter name and parameter value • All Scenarios will start with the SESSION_NM Variable • This technic allow us to have just one variable to get different “LOG_PATH” for different scenarios
  • 12. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Powerful “Global Variables“ (Champion way) • The only thing that changes is the select inside the variables: • We use the previous query as a sub query to test if the query will return any rows from the parameter table for that specific Session Name • If the results in empty the NVL command will return “GLOBAL” • This allow us to create just one Global parameter for all interfaces • Also if anything changes, we just need to insert a new value for any session name and the variable will bring that value just for that scenario
  • 13. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Powerful “Global Variables“ (Champion way) • Less variables to maintain and easier for deployment • In most part the value of the variables are the same for all interfaces • Servers name, paths, emails, application name… • We can leverage this technic using ODI Global variables • No need to create the same variable in all projects • More flexible • If a test needs to be performed or something changes the only thing needed is an insert for that specific scenario • To rollback we just need to delete the Session specific row
  • 14. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Substitution Tags and how useful they are • Substitution tags are part of the java substitution API • The API methods are java methods that return a string value • 4 type of Substitution Tags • <%>, <?>, <@> and <$> • All of them does the same thing but each one has its own parse phase • <%>: generates the command when it is sent to the agent, but BEFORE it gets to the agent; • <?>: generates the code in the agent server, BEFORE the command is sent to Operator and BEFORE ODI variables are substituted • <$> (available from 11.1.1.6 on): generates the code in the agent server, BEFORE the command is sent to Operator but AFTER ODI variables are substituted • <@>: generates the code in the agent server, AFTER the command appears in the Operator and AFTER ODI variables are substituted
  • 15. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Substitution Tags and how useful they are • Create an ODI variable and write ‘TEST’ on it • Execute in Jython technology: • Raise ‘<%= System.getProperty("os.name") %> - <%="#ODI_VAR"%>’ • Repeat for each substitution tag • Agent is Windows server 2008 • Client is Windows server 2003 Subs Tag Code generated Results <%> raise 'Windows 2003 - #KSCOPE.ODI_VAR' Windows 2003 - TEST <?> raise 'Windows Server 2008 R2 - #KSCOPE.ODI_VAR' Windows Server 2008 R2 - TEST <$> raise 'Windows Server 2008 R2 - TEST' Windows Server 2008 R2 - TEST <@> raise '<@= System.getProperty("os.name") @> - <@="#KSCOPE.ODI_VAR"@>' Windows Server 2008 R2 - TEST
  • 16. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Substitution Tags and how useful they are • Different parse phases are useful to create dynamic code • Heavily used in ODI KMs • We may “loop” tags within tags • We can have a code in % phase passing information to a ? Phase
  • 17. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Dynamic Topology (Regular Way) • Featured by multiple contexts • One Physical for each DB • One Logic For All Physics • One Context for each Physical • Context nightmare • Tons of context to manage • If users executes scenarios in operator, multiple context make it difficult • In multiple projects one context could mean nothing Amer Apj Emea N DB Amer Apj Emea N DB Target DWGlobal Physical Context Logical
  • 18. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Dynamic Topology (Champion Way) • Featured by dynamic topology • One Physical for each DB + one physical with variables (Dynamic) • One Logical for each Physical • One Context for all • Context heaven • One context to manage • Easier for users to execute • One context for all projects • Works in ODI 11 and ODI 12 with patch 21156142 Amer Apj Emea N DB Global DWDynamic Amer Apj Emea N DB Dynamic Physical Context Logical
  • 19. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Dynamic Topology (Champion Way) • Create one variable for each field in the physical topology • Data Server: • User: #ODI_PROJECT.CONN_USER • Password: #ODI_PROJECT.CONN_PASS • JDBC URL: #ODI_PROJECT.CONN_URL • Physical Schema: • Schema: #ODI_PROJECT.CONN_DATA_USER • Work Schema: #ODI_PROJECT.CONN_WORK_USER • Need to inform the project_code.variable_name
  • 20. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Dynamic Topology (Champion Way) • Create one procedure • One step for each database to get the connection information • The connection information will be retrieved from the “Command on Source” tab • “Command on Target” to execute a scenario passing all connection information needed
  • 21. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM “Third Command Tab“ Technic • Sometimes we need more than a command on source and target • Executions of Maxl in multiple Essbase applications • Select on source with application information (Loop) • Command on target (to execute what we want) • Since we are using the Oracle technology in the command on source we cannot get Essbase login information • For this example we need a “Third Command Tab”
  • 22. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM “Third Command Tab“ Technic • Create a new step to get the connection information • On the command on source set the Essbase technology and schema • On the command on target use Java technology and create 3 java variables that will hold the connection information • Use the Java Variable in the next Steps
  • 23. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM “Third Command Tab“ Technic • Loop Maxl/Cmd commands • Get the return of a SQL into a Java variable to use in other steps • This is also useful because the java variable is replaced for his value in operator • Anything you want to store and use later within the scenario execution • If you want to use inside a children scenario you need to pass it to a variable inside the scenario
  • 24. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM ODI Custom Execution Information • ODI repositories contains all kind of useful information that we can retrieve at run time • Execution information, current variable values, jobs in execution… • We can retrieve all this information using the previews technics • Inside a procedure in the command on source set the ODI repository connection • In the command on target create a SQL and add it to a java code that will connect in the database to retrieve the information
  • 25. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM ODI custom execution information • In another step we just need to “Raise” the previous variable • Now you can use anywhere in the package • This will show in the operator the value that all existing variables until that point has • Works with all kind of variables: refresh, set, declare, global, project only…
  • 26. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Stop, Start and Restart ODI priority jobs automatically • There’re some commands that cannot be executed within ODI tools: • Restart load plan, Restart session, Stop load plan, Stop session, Start load plan, Start scen • But all these commands can be executed outside ODI using some .bat/.sh files located in the agent server: • oraclediagentbin (Only exists in the agent) • The command to ran is: • stopsession <session_number> “-AGENT_URL=<agent_url>” [“- STOP_LEVEL=<normal(default)|immediate>”]
  • 27. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Stop, Start and Restart ODI priority jobs automatically • If we want to stop all jobs before running a priority job, we could get all running jobs from ODI repository and stop them • To do so we need to get the Agent URL from the master repository • Get the job information from the work repository • And stop all the sessions
  • 28. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Stop, Start and Restart ODI priority jobs automatically • Useful for priority job • Check if other jobs are running and stop them automatically • Executing jobs respecting a time window • We can stop jobs that executes longer than a specific time window • Depending of the error restart automatically a specific job
  • 29. DevEpm.com @RZGiampaoli @RodrigoRadtke @DEVEPM Ricardo Giampaoli – TeraCorp Rodrigo Radtke de Souza - Dell Thank you!