Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Performance Of Callidus TrueComp Pipeline And Datamart ETL And Reports


Published on

presented by Callidus Software at TrueConnection: Sales Performance Management Conference 2007

Published in: Business, Technology
  • Hi, I am looking for best market practices adopted while testing TrueComp. Please let me know any knoledge if any one have.
    Are you sure you want to  Yes  No
    Your message goes here

Performance Of Callidus TrueComp Pipeline And Datamart ETL And Reports

  1. 1. Performance of the Callidus TrueComp Pipeline, Datamart ETL and Reports David Ritson Senior Principal Architect, Solutions Architecture Callidus Software Inc
  2. 2. What Will Be Covered <ul><li>Factors Involving Performance </li></ul><ul><li>Validate and Transfer Performance </li></ul><ul><li>Allocate Performance </li></ul><ul><li>Classify Performance </li></ul><ul><li>Reset Performance </li></ul><ul><li>Post Allocate Performance </li></ul><ul><li>Reward Performance </li></ul><ul><li>Database Tuning </li></ul><ul><li>Datamart/Informatica Performance </li></ul><ul><li>Report Performance </li></ul><ul><li>Operational Considerations </li></ul>
  3. 3. Factors Involving Performance Order of Investigation Increased Impact TrueComp Rules SQL statements Java Distributed Processing and Network Database Schema Database Configuration File System and Operating System
  4. 4. Factors Involving Performance <ul><li>TrueComp Rules </li></ul><ul><ul><li>Brief discussion about the issues </li></ul></ul><ul><li>SQL statements </li></ul><ul><ul><li>Brief discussion about the issues </li></ul></ul><ul><li>Java Distributed Processing and Network </li></ul><ul><ul><li>Brief discussion about the issues </li></ul></ul><ul><li>Database Schema </li></ul><ul><ul><li>Brief discussion about the issues </li></ul></ul><ul><li>Database Configuration </li></ul><ul><ul><li>Brief discussion about the issues </li></ul></ul><ul><li>File System and Operating System </li></ul><ul><ul><li>Brief discussion about the issues </li></ul></ul>
  5. 5. Validate and Transfer Performance <ul><li>What can be configured for performance </li></ul><ul><li>Why does the import slow down over time </li></ul><ul><li>Should stage records be retained </li></ul><ul><li>What are some good ways to spot issues </li></ul>
  6. 6. Allocate Performance <ul><li>Discussion of rule evaluation versus firing </li></ul><ul><li>Grid configuration </li></ul>
  7. 7. Which Factors Affect Allocate Performance <ul><li>Excessive rule evaluation </li></ul><ul><li>Primary measurement </li></ul><ul><li>Measurement count best practices </li></ul>
  8. 8. Classify Performance <ul><li>What factors contribution towards Classify performance </li></ul><ul><li>What should be avoided </li></ul>
  9. 9. Reset Performance <ul><li>Which Factors Effect Reset Performance </li></ul><ul><li>Create Only What is Needed for Comp Calculations </li></ul><ul><li>Can Reset be Performed Outside of the Regular Pipeline </li></ul><ul><li>Can Objects be Reset Outside of the Product </li></ul><ul><li>What is Deferred Reset? </li></ul>
  10. 10. Post Allocate Performance <ul><li>Which Factors Effect Post Allocate Performance </li></ul>
  11. 11. Reward Performance <ul><li>Rule evaluation versus firing </li></ul><ul><li>Detailed deposits </li></ul><ul><li>Look backs in measurements </li></ul><ul><li>Sum related measurements </li></ul><ul><li>Islands </li></ul>
  12. 12. Database Tuning <ul><li>How are slow SQL statements identified </li></ul><ul><li>What can be done to fix them </li></ul><ul><li>What are some of the database parameters which effect TrueComp </li></ul>
  13. 13. Database Tuning - Statistics <ul><li>Why are statistics important to TrueComp </li></ul><ul><li>How can more consistent query execution be enforced </li></ul><ul><li>How can stats collection be more efficient </li></ul><ul><li>Do stats need to be built every time the pipeline runs </li></ul>
  14. 14. Database Tuning - Indexes <ul><li>Separate policies for ODS and Datamart </li></ul><ul><li>ODS </li></ul><ul><ul><li>Can additional indexes be added </li></ul></ul><ul><ul><li>Can stock indexes be modified </li></ul></ul><ul><li>Datamart </li></ul><ul><ul><li>Can additional indexes be added </li></ul></ul><ul><ul><li>Can stock indexes be modified </li></ul></ul>
  15. 15. Database Tuning – Parallelism in Oracle <ul><li>Will parallelism boost pipeline runtimes </li></ul><ul><li>Which pipeline stages will parallelism it help </li></ul><ul><li>Which pipeline stages will parallelism it hinder </li></ul>
  16. 16. Datamart/Informatica Performance <ul><li>What can be done at the Informatica and database level to boost performance </li></ul><ul><ul><li>Informatica settings </li></ul></ul><ul><ul><li>Source queries </li></ul></ul><ul><ul><li>Turning off unused mappings </li></ul></ul><ul><ul><li>How can I turn off the dropping/rebuilding of indexes </li></ul></ul>
  17. 17. Report Performance <ul><li>What is the main contributor to poor report generation performance </li></ul><ul><li>Answer is SQL. </li></ul><ul><li>How can SQL be identified when the reports are running </li></ul><ul><li>What are some best practices for dealing with reporting SQL </li></ul><ul><li>Should I query the TrueComp database or Datamart </li></ul>
  18. 18. Operational Considerations <ul><li>What can be done to benefit performance from the operations side </li></ul><ul><li>Should the pre aggregation of data be considered </li></ul><ul><li>After a successful pipeline do I need to keep all of my classification records </li></ul><ul><li>Pipeline reset ahead of time </li></ul>
  19. 19. Questions