Griffith Bi Migration & Source Control


Published on

Talk Given at SAS QUEST Forum 0 5th March 2009

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Griffith Bi Migration & Source Control

  1. 1. Migration and Source Control of SAS Business Intelligence objects in an ITIL environment <ul><li>David Waters – Griffith University </li></ul><ul><li>Title: Business Intelligence Systems Analyst </li></ul><ul><li>Actual: Data Architect/Data Modeller/ETL Developer </li></ul>
  2. 2. ITIL - Information Technology Infrastructure Library <ul><li>The Information Technology Infrastructure Library (ITIL) is a set of concepts and policies for managing information technology (IT) infrastructure, development and operations. </li></ul><ul><li>The goal of Change Management is to ensure that standardised methods and procedures are used for efficient handling of all changes </li></ul>
  3. 3. The Most Boring Topic Imaginable <ul><li>Source Control is Boring </li></ul><ul><li>Migration is Boring </li></ul><ul><li>Releasing software into Production is Boring </li></ul>
  4. 4. Unless <ul><li>Unless you have to rollback to an old version that you no longer have </li></ul><ul><li>Unless you migrate the wrong thing </li></ul><ul><li>Unless the software you release crashes the CEOs Browser Window </li></ul>
  5. 5. About Griffith <ul><li>37,786 Students (Fulltime and Part-time) </li></ul><ul><li>3,563 Staff (Full Time Equivalent) </li></ul><ul><li>5 Campuses (Nathan, Gold Coast, Mt Gravatt, Logan, South Bank) </li></ul><ul><li>8,847 International Students from 119 countries </li></ul><ul><li>38 Research Centres </li></ul><ul><li>268 Undergraduate Programs </li></ul><ul><li>382 Postgraduate Programs </li></ul><ul><li>104 Research Programs </li></ul>
  6. 6. Technology in Use at Griffith <ul><li>SAS – BI Suite </li></ul><ul><ul><li>DI - Data Integration Studio </li></ul></ul><ul><ul><li>BI - Info Maps, Web Report Studio, Office Add In etc </li></ul></ul>
  7. 7. Technology in Use at Griffith <ul><li>SAS – SPM (Strategic Performance Management) </li></ul><ul><ul><li>DI Studio, BMF Load for Data Loads </li></ul></ul><ul><ul><li>SPM Scorecards and WRS for User Experience </li></ul></ul>
  8. 8. Technology in Use at Griffith <ul><li>Oracle RDBMS </li></ul><ul><li>PeopleSoft, Finance, HR, Campus Solutions </li></ul><ul><li>Blackboard, Evaluations@Griffith etc </li></ul>
  9. 9. Design Methodology <ul><li>Kimball Method (Data Warehousing Design Patterns) </li></ul><ul><li>Star Schemas (in Oracle RDBMS) </li></ul><ul><li>Cubes (SAS) </li></ul>
  10. 10. Design Methodology <ul><li>Web Delivery – SAS Information Delivery Portal </li></ul><ul><li>SAS Information Maps for exposing data </li></ul><ul><li>Web Report Studio </li></ul><ul><li>Java Cube Viewer </li></ul>
  11. 11. Design Methodology <ul><li>Business Intelligence Initiatives of less than 12 weeks and preferably less than 8 weeks </li></ul><ul><ul><li>Lots of client engagement by the Business Analysts </li></ul></ul><ul><ul><li>Early and iterative user testing </li></ul></ul><ul><li>Fast delivery cycles, Agile (Scrum) etc </li></ul><ul><li>Separate Development, Test and Production </li></ul>
  12. 12. Development/Release Methodology <ul><li>ETL Jobs, Info Maps, Cubes go through full development, test, production life cycle </li></ul><ul><li>WRS reports built on existing Maps/Cubes can be fast tracked </li></ul>
  13. 13. Development/Release Methodology
  14. 14. Source Control <ul><li>Work units exported from ETL Studio, Management Console or OLAP Cube Studio </li></ul><ul><li>Imported into SVN (File source control) </li></ul>
  15. 15. Exporting Metadata DI Studio
  16. 16. Exporting Metadata DI Studio
  17. 17. Exporting Metadata OLAP Cube Studio
  18. 18. Exporting Metadata OLAP Cube Studio
  19. 19. Exporting Metadata
  20. 20. Exporting Metadata
  21. 21. Exporting Metadata
  22. 22. DI Studio
  23. 23. Tortoise SVN
  24. 24. SVN <ul><li>Subversion (SVN) is a version control system, it's intended as a successor to Concurrent Versions System (CVS). </li></ul><ul><li>Open Source </li></ul>
  25. 25. SVN <ul><li>Does have locking but generally: </li></ul><ul><ul><li>A server stores the current version(s) of a project and clients connect to the server and &quot;check out&quot; a complete copy, work on the copy and later &quot;check in&quot; their changes; </li></ul></ul><ul><ul><li>If two developers make a change to a file only changes made to the latest version are acceptable; </li></ul></ul><ul><ul><li>If both changes are made to the latest version then manual intervention may be required (pretty rare); </li></ul></ul><ul><li>Developers can update from the server repository; and </li></ul><ul><li>Developers can commit their changes </li></ul>
  26. 26. Tortoise SVN
  27. 27. Tortoise SVN
  28. 28. Tortoise SVN
  29. 29. Tortoise SVN
  30. 30. Tortoise SVN
  31. 31. Some Process Details – ETL Jobs <ul><li>Migrate Tables first (before Jobs) </li></ul><ul><li>File Loaders lose their mappings </li></ul><ul><ul><li>Keep them simple so we can automagically remap them </li></ul></ul><ul><li>Lookups lose their mappings </li></ul><ul><ul><li>Use SQL nodes instead </li></ul></ul>
  32. 32. e.g
  33. 33. Some Process Details – OLAP <ul><li>Indexes created by OLAP cube studio don’t migrate </li></ul><ul><ul><li>OLAP Cube Studio Wizard needs to be rerun </li></ul></ul>
  34. 34. Some Process Details – Info Maps <ul><li>Have to manually edit the SAS Library details in the XML of the Map </li></ul><ul><ul><li>Database Schemas are different on each environment </li></ul></ul><ul><ul><li>Edit the XML in the Info Map and change the Database Schema – we have a procedure on doing this </li></ul></ul><ul><ul><ul><li>( </li></ul></ul></ul>
  35. 35. Questions? <ul><li>Contact Details </li></ul><ul><ul><li>Telephone (07) 373 54052 </li></ul></ul><ul><ul><li>Mobile 0408 074 082 </li></ul></ul><ul><ul><li>Griffith Location Community Centre (N66) 1.21B </li></ul></ul><ul><ul><li>Campus Address Nathan Campus, Griffith University </li></ul></ul><ul><ul><li>170 Kessels Road, Nathan, QLD, 4111 </li></ul></ul><ul><ul><li>Email Address </li></ul></ul>