How to Handle DEV&TEST&PROD for Oracle Data Integrator

7,510 views

Published on

Most of us have development teams apart from test and operation teams using the different repository environments. And there are generally 3 different ODI installations and repositories which each of the teams use separately. Chaos is usually expected and happened who will test which development and what to deploy into production.
In this session hear how ODI can handle your development hierarchy with ease of usage and in simplified/synchronized way for successful deployments.
A simple project will be built up and will be enlarged to enterprise level step by step.

Published in: Technology, Business
5 Comments
12 Likes
Statistics
Notes
  • In 27th slide, there we can see different Master Repositories, All the phases will be having same Master repository right.?? please correct me if i am wrong as you mentioned in slide 15.... . :(
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • With ODI11g don't have this problems (import load plans) with smart export/import...but ODI12c yes...
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Thanks Gurcan. We study new solutions to enviroments, thanks! How methodology to import load plans? Now we have problems with import different load plans, we appear meaningless errors
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Hi Jorge,
    There can be various types of architecture depending on your team's and/or company's strategy. And my answers would mostly be 'it depends'.
    Here are some questions & suggestions that you can choose or think of one, depending your environment or team's or company's decision or strategy, but there are many 'Best Practice' approaches.
    - What if there needs to be a tiny or small bug/hot-fix in your test? You need to start over in DEV and import/export to TEST again. Typically, I would recommend DEV and TEST as 'Development Work Repository' and PROD as 'Execution Work Repository' for DEV&TEST&PROD environments.
    - Unshared Master Repository is a tricky decision, but could be useful, you need to manually insert topology, users/roles and other related information for both TEST and PROD in your architecture. As far as I understand in your architecture, I would share Master Repository to TEST and PROD since both are 'Execution Work Repository', in order to decrease manual insertions related to 'Master Repository'.

    There are several limitations when you are setting up an SDLC architecture. These limitations could be addressed as hardware, strategy, decision, regulations, needs, amount of people involving in project (developers, testers, operators, dbas, admins, business users, etc.), location of teams, and many more.

    Cheers,
    Gurcan.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Hi, good info. But we have a DEV-TEST-PROD enviroment. Each enviroment have master-work repository. We import to TEST-PROD only load plans and scenarios. It's correct procedure this export-import?

    Before project, we have problems export - import with all odi objects. Now try the procedure export-import only scen and load plan and run ok
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
7,510
On SlideShare
0
From Embeds
0
Number of Embeds
216
Actions
Shares
0
Downloads
0
Comments
5
Likes
12
Embeds 0
No embeds

No notes for slide

How to Handle DEV&TEST&PROD for Oracle Data Integrator

  1. 1. CON4070 HOW TO HANDLE DEV&TEST&PROD FOR ORACLE DATA INTEGRATOR 26 September 2013 Gürcan Orhan (Principal Datawarehouse Consultant, Global Maksimum) Jérôme Françoisse (Consultant, Rittman Mead Consulting)
  2. 2. This session is brought to you by… 26 September 2013
  3. 3. 26 SEPTEMBER / ORACLE OPEN WORLD WHO AM I? +19 years of IT experience. +10 years of DWH experience. +7 years of Oracle Data Integrator experience, +5 years of Oracle Warehouse Builder experience. Sybase Power Designer, CA ERwin Data Modeler OBIEE, Cognos, Microstrategy, Business Objects, Tableau Joined Turkcell October 2008, Turkcell Technology March 2010, Global Maksimum June 2013 Oracle Excellence Awards - Technologist of the Year 2011 : Enterprise Architect (Oracle Magazine Editors’ Choice of Awards, Enterprise Architect) DWH & BI Chair : TROUG (Turkish Oracle User Group) Published Customer Snapshot for NODI @Oracle.com Published video about ODI @Oracle.com (Oracle Media Network) Published OTN Podcast about “Data Warehousing and ODI” Presenter in Oracle Open World since 2010 Presenter in ODTUG Kscope’11-13 Presenter in UKOUG, other OUGs Presenter in various universities in Turkey http://gurcanorhan.wordpress.com gurcan_orhan http://tr.linkedin.com/in/gurcanorhan
  4. 4. Global Maksimum Data & Information Technologies Big & Fast Data Processing Data Visualization Data Science
  5. 5. T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com Jérôme Françoisse • Consultant for Rittman Mead ‣ Oracle BI/DW Architect/Analyst/Developer • ODI Trainer • Providing ODI support on OTN Forums • Email : jerome.francoisse@rittmanmead.com • Twitter : @JeromeFr
  6. 6. T : +44 (0) 8446 697 995 or (888) 631 1410 (USA) E : enquiries@rittmanmead.com W: www.rittmanmead.com • Oracle Gold partner with offices in US (Atlanta), Europe, Australia and India • World leading specialist partner for technical excellence, solutions delivery and innovation in Oracle BI • Provide consulting, training, global managed services for customers around the world • 120+ consultants including 1 Oracle ACE Director and 2 Oracle ACEs • All expert in Oracle BI, DW, EPM and analytics tech. Skills in broad range of supporting Oracle tools: OBIEE, OBIA, ODIEE, Essbase, Oracle OLAP, GoldenGate, Exadata, Endeca • 16 Sessions at Oracle Open World 2013 • Blog : http://www.rittmanmead.com/blog/ • Twitter : @rittmanmead Rittman Mead
  7. 7. 26 SEPTEMBER / ORACLE OPEN WORLD ODI (Oracle Data Integrator) is a tool, that can talk, or learn how to talk, with any database system, or any operating system, in its own language. This is the power of ODI. MY DEFINITION OF ODI
  8. 8. 26 SEPTEMBER / ORACLE OPEN WORLD AGENDA
  9. 9. 26 SEPTEMBER / ORACLE OPEN WORLD ODI REPOSITORY ARCHITECTURE MASTER REPOSITORY  Information related to DB/OS connections Contexts, Repositories, Logical Architecture  Information related to ODI internal security  Versions
  10. 10. 26 SEPTEMBER / ORACLE OPEN WORLD ODI REPOSITORY ARCHITECTURE WORK REPOSITORY (DEVELOPMENT)  Source / Staging / Target metadata Models in Designer Navigator  Projects and beneath : Folders, Interfaces, Packages, Procedures, Variables, Sequences, Knowledge Modules, User Functions  Scenarios, Load Plans, Schedules  All the logs related to execution
  11. 11. 26 SEPTEMBER / ORACLE OPEN WORLD ODI REPOSITORY ARCHITECTURE WORK REPOSITORY (EXECUTION)  Scenarios  Load Plans  Schedules  Execution Logs
  12. 12. 26 SEPTEMBER / ORACLE OPEN WORLD CONTEXTS KEY TO JOIN PHYSICAL ARCHITECTURE AND LOGICAL ARCHIT SRC A (dev) SRC A (prod) SRC B (dev) SRC B (prod) SRC C (prod) Source-C Source-B Source-A
  13. 13. 26 SEPTEMBER / ORACLE OPEN WORLD AGENDA
  14. 14. 26 SEPTEMBER / ORACLE OPEN WORLD START-UP PROJECT : INITIAL ARCHITECTURE DEV & TEST PROD MASTER Topology Versionin g Security DEV WORK Models Projects Executio n EXEC WORK Executio n SRC A (dev) SRC B (dev) SRC A (test) SRC B (test) SRC A (prod) SRC B (prod) SRC C (prod)
  15. 15. 26 SEPTEMBER / ORACLE OPEN WORLD START-UP PROJECT : MANUAL EXPORT-IMPORT
  16. 16. 26 SEPTEMBER / ORACLE OPEN WORLD AGENDA
  17. 17. 26 SEPTEMBER / ORACLE OPEN WORLD WE’RE ON PRODUCTION We need to make some changes…
  18. 18. 26 SEPTEMBER / ORACLE OPEN WORLD ADMINS AT WORK TEST & PROD* ContextDEV Context * New MASTER Topology Versionin g Security EXEC WORK Executio n DEV WORK Models Projects Executio n EXEC WORK Executio n MASTER Topology Versionin g Security DEV WORK Models Projects Executio n EXPORT IMPORT
  19. 19. 26 SEPTEMBER / ORACLE OPEN WORLD ADMINS AT WORK DEV & TEST Context PROD* Context Insert manually Insert manually MASTER Topology Versionin g Security MASTER Topology Versionin g Security EXEC WORK Executio nEXPORT IMPORT DEV WORK Models Projects Executio n
  20. 20. 26 SEPTEMBER / ORACLE OPEN WORLD AGENDA
  21. 21. 26 SEPTEMBER / ORACLE OPEN WORLD MORE TESTERS IN TEAM DEV & TEST Context PROD* Context MASTER Topology Versionin g Security DEV Context TEST Context EXEC WORK Executio nEXPORT IMPORT DEV WORK Models Projects Executio n DEV WORK Models Projects Executio n MASTER Topology Versionin g Security
  22. 22. 26 SEPTEMBER / ORACLE OPEN WORLD EXPORT-IMPORT WITH A PACKAGE http://sonra.io/odi-automating-deployment-of-scenarios-in-oracle-data-integrator/
  23. 23. 26 SEPTEMBER / ORACLE OPEN WORLD EXPORT-IMPORT WITH THE ODI SDK for (Object scen : scenarioCollection) { OdiScenario odiscen =(OdiScenario)scen ; export.exportToXml(odiscen, ExportPath, OverWrite, RecursiveExport, Encoding); }for (String filename : XMLFiles) { import.importObjectFromXml( import.IMPORT_MODE_SYNONYM_INSERT_UPDATE, filename, true); } For(Object interface : interfaces) { OdiInterface odiInt = (OdiInterface) interface; String scenName = odiInt.getName(); OdiScenario newScen = gene.generateScenario(odiInt, scenName, newVersion); }
  24. 24. 26 SEPTEMBER / ORACLE OPEN WORLD AGENDA
  25. 25. 26 SEPTEMBER / ORACLE OPEN WORLD ENTERPRISE ARCHITECTURE DEV Context TEST Context PRE-PROD* Context PROD* Context DEV WORK Models Projects Executio n EXEC WORK Executio n MASTER Topology Versionin g Security MASTER Topology Versionin g Security DEV WORK Models Projects Executio n EXEC WORK Executio n MASTER Topology Versionin g Security * New
  26. 26. 26 SEPTEMBER / ORACLE OPEN WORLD ENTERPRISE ARCHITECTURE DEV PROD* DEV WORK Models Projects Executio n EXEC WORK Executio n MASTER Topology Versionin g Security MASTER Topology Versionin g Security DEV WORK Models Projects Executio n TEST PRE-PROD* EXEC WORK Executio n MASTER Topology Versionin g Security HOTFIX* DEV WORK Models Projects Executio n SMOKE EXEC WORK Executio n
  27. 27. 26 SEPTEMBER / ORACLE OPEN WORLD http://gurcanorhan.wordpress.com gurcan_orhan http://tr.linkedin.com/in/gurcanorhan http://www.rittmanmead.com/blog JeromeFr http://www.linkedin.com/in/jeromefrancoisse

×