Extreme Salesforce Data Volumes Webinar


Published on

Following best practices can help ensure your success. This is especially true for Force.com applications or large Salesforce orgs that have the potential to push platform limits.

Salesforce allows you to easily scale up from small to large amounts of data. Mostly this is seamless, but as data sets get larger, the time required for certain operations may grow too. Join us to learn different ways of designing and configuring data structures and planning a deployment process to significantly reduce deployment times and achieve operational efficiency.

Watch this webinar to:

:: Explore best practices for the design, implementation, and maintenance phases of your app's lifecycle.
:: Learn how seemingly unrelated components can affect one another and determine the ultimate scalability of your app.
:: See live demos that illustrate innovative solutions to tough challenges, including the integration of an external data warehouse using Force.com Canvas.
:: Walk away with practical tips for putting best practices into action.

Intended Audience

This webinar is perfect for Salesforce or Force.com architects and developers that want to better understand data management best practices to ensure both short and long-term implementation success. Although many topics focus on large data volumes, the recommendations in this presentation are equally relevant to smaller orgs.

Extreme Salesforce Data Volumes Webinar

  1. 1. Extreme Salesforce Data VolumesForce.com Architecture Best PracticesFrom salesforce.com’s Customer Centric Engineering – Technical Enablement team
  2. 2. Safe harbor Safe harbor statement under the Private Securities Litigation Reform Act of 1995: This presentation may contain forward-looking statements that involve risks, uncertainties, and assumptions. If any such uncertainties materialize or if any of the assumptions proves incorrect, the results of salesforce.com, inc. could differ materially from the results expressed or implied by the forward-looking statements we make. All statements other than statements of historical fact could be deemed forward-looking, including any projections of product or service availability, subscriber growth, earnings, revenues, or other financial items and any statements regarding strategies or plans of management for future operations, statements of belief, any statements concerning new, planned, or upgraded services or technology developments and customer contracts or use of our services. The risks and uncertainties referred to above include – but are not limited to – risks associated with developing and delivering new functionality for our service, new products and services, our new business model, our past operating losses, possible fluctuations in our operating results and rate of growth, interruptions or delays in our Web hosting, breach of our security measures, the outcome of intellectual property and other litigation, risks associated with possible mergers and acquisitions, the immature market in which we operate, our relatively limited operating history, our ability to expand, retain, and motivate our employees and manage our growth, new releases of our service and successful customer deployment, our limited history reselling non-salesforce.com products, and utilization and selling to larger enterprise customers. Further information on potential factors that could affect the financial results of salesforce.com, inc. is included in our annual report on Form 10-Q for the most recent fiscal quarter ended July 31, 2012. This documents and others containing important disclosures are available on the SEC Filings section of the Investor Information section of our Web site. Any unreleased services or features referenced in this or other presentations, press releases or public statements are not currently available and may not be delivered on time or at all. Customers who purchase our services should make the purchase decisions based upon features that are currently available. Salesforce.com, inc. assumes no obligation and does not intend to update these forward- looking statements.Join the conversation: #forcewebinar
  3. 3. Speakers Bud Vieira Steve Bobrowski Architect Evangelist Architect Evangelist @aavra @sbob909Join the conversation: #forcewebinar
  4. 4. Follow Developer Force for the latest news @forcedotcom / #forcewebinar Developer Force – Force.com Community +Developer Force – Force.com Community Developer Force Developer Force groupJoin the conversation: #forcewebinar
  5. 5. Architect Core Resource page •  Featured content for architects •  Articles, papers, blog posts, events •  Follow us on Twitter Updated weekly! http://developer.force.com/architectJoin the conversation: #forcewebinar
  6. 6. Have questions? §  We have an expert support team at the ready to answer your questions during the webinar. §  Ask your questions via the GoToWebinar Questions Pane. §  The speaker(s) will choose top questions to answer live at the end of the webinar. §  Please post your questions as we go along! §  Only post your question once; we’ll get to it as we go down the list.Join the conversation: #forcewebinar
  7. 7. Today s Learning Goal AWARENESSJoin the conversation: #forcewebinar
  8. 8. How much data can the Salesforce Platform handle? You might be surprised!Join the conversation: #forcewebinar
  9. 9. Best practices Design Load Configure MaintainJoin the conversation: #forcewebinar
  10. 10. Design best practicesJoin the conversation: #forcewebinar
  11. 11. Design phase best practices Data volu me Requirements an d growth Que r y Text design searchingJoin the conversation: #forcewebinar
  12. 12. RequirementsJoin the conversation: #forcewebinar
  13. 13. Understand application and user requirements Ho w m uc h How many o perational data records make is really sense in each list necessar y? view an d report? Can yo u deem certain data historical or not useful for views an d reports?Join the conversation: #forcewebinar
  14. 14. Example: Design list views that make sense How many pages of data records can a human process?Join the conversation: #forcewebinar
  15. 15. Data volume and growthJoin the conversation: #forcewebinar
  16. 16. Estimate the growth and volume of data Can yo u eliminate At what rate w ill certain types of the data volu me data fro m yo ur increase fro m schema? Fro m transactions? yo ur data loa ds? Fro m data loa ds? Can yo u offset the data growth by archiving data? Hard- deletes? Recycle bin empties?Join the conversation: #forcewebinar
  17. 17. Example: Project monthly and annual growth Large Object X (Monthly) Transaction growth rate •  Records •  GB Data load growth rate •  Records •  GB Archival offset •  Records •  GBJoin the conversation: #forcewebinar
  18. 18. Key success factor: Minimize data volume Devise a data Devise a data loa ding plan offloa ding plan that meets, but that archives doesn t excee d, unnecessar y data requirements After archiving, hard- delete rows or empty the recycle binJoin the conversation: #forcewebinar
  19. 19. Query designJoin the conversation: #forcewebinar
  20. 20. Learn how to design efficient queries Un derstan d Docu ment SOQL quer y available o ptimization in dexes Design selective list views, reports, an d SOQL queriesJoin the conversation: #forcewebinar
  21. 21. Document available indexesJoin the conversation: #forcewebinar
  22. 22. Cheat Sheet: Indexed Fields http://developer.force.com/architectJoin the conversation: #forcewebinar
  23. 23. Example: Design and profile selective SOQLJoin the conversation: #forcewebinar
  24. 24. Full-text searchJoin the conversation: #forcewebinar
  25. 25. Learn how to design efficient searches Docu ment Un derstan d available SOSL quer y in dexes o ptimization Design selective list views, reports, an d SOSL queriesJoin the conversation: #forcewebinar
  26. 26. Document text fields with Search indexesJoin the conversation: #forcewebinar
  27. 27. Cheat Sheet: Search Fields http://developer.force.com/architectJoin the conversation: #forcewebinar
  28. 28. Learn how Search retrieves rows INDEX Millions of DB records Query across entire index for matches to Record IDs of DB processing search string matches to includes sharing query are sent access check to DB for processingJoin the conversation: #forcewebinar
  29. 29. Review: Design phase best practices ü  Know your requirements ü  Estimate data growth rate ü  Minimize data volume ü  Design efficient operations ü  Plan an efficient sharing modelJoin the conversation: #forcewebinar
  30. 30. Data load best practicesJoin the conversation: #forcewebinar
  31. 31. Data load best practices Clean an d Check o ut organize data AppExchange before loa ding to ols Use Bulk APIs for Disable an d defer better what yo u can thro ughputJoin the conversation: #forcewebinar
  32. 32. Prepare your data to avoid overheadJoin the conversation: #forcewebinar
  33. 33. Disable actions that fire on insert Validation Rules Workflow Rules TriggersJoin the conversation: #forcewebinar
  34. 34. Understand the Force.com Bulk APIJoin the conversation: #forcewebinar
  35. 35. Be aware of Bulk API limitsJoin the conversation: #forcewebinar
  36. 36. Look for utilities to help get the job done easyJoin the conversation: #forcewebinar
  37. 37. Defer sharing calculations Or … load with Public default sharingJoin the conversation: #forcewebinar
  38. 38. Review: Data load phase best practices ü  Load cleansed data ü  Use the Bulk API ü  Consider loading utilities that use the Bulk API ü  Disable triggers, validations, and workflow ü  Defer sharing calculationsJoin the conversation: #forcewebinar
  39. 39. Configuration best practicesJoin the conversation: #forcewebinar
  40. 40. Learn how to create an efficient sharing model Don t o verprotect Streamline gro up yo ur data nesting an d yo ur role hierarchy Distribute Beware of locking ownership an d on updates parenting of recordsJoin the conversation: #forcewebinar
  41. 41. Don’t overprotect your dataJoin the conversation: #forcewebinar
  42. 42. Streamline your role Hierarchy Complex hierarchies = longer sharing calculations Keep nesting below 10 levels Simplify sales branch if using territory managementJoin the conversation: #forcewebinar
  43. 43. Avoid skewed data configurations Ownership Parent-childJoin the conversation: #forcewebinar
  44. 44. Beware of locking on updates Organization Lock Record Lock X X Single thread group updates Avoid parent child skew Use Granular Locking Sequence updates by ParentIDJoin the conversation: #forcewebinar
  45. 45. Review: Configuration phase best practices ü  Keep data public when possible ü  Use a lean role hierarchy ü  Avoid data skews ü  Minimize record lock trapsJoin the conversation: #forcewebinar
  46. 46. Maintenance best practicesJoin the conversation: #forcewebinar
  47. 47. Maintenance phase best practices Custo m Data in dexing partitioning Application Skinny tables partitioningJoin the conversation: #forcewebinar
  48. 48. Custom indexesJoin the conversation: #forcewebinar
  49. 49. Create your own indexesJoin the conversation: #forcewebinar
  50. 50. Request non-standard indexes Create a Support request to implement custom one and two-field indexesJoin the conversation: #forcewebinar
  51. 51. Skinny tablesJoin the conversation: #forcewebinar
  52. 52. Query tuning with skinny tablesJoin the conversation: #forcewebinar
  53. 53. Data partitioningJoin the conversation: #forcewebinar
  54. 54. Test and implement divisionsJoin the conversation: #forcewebinar
  55. 55. Application partitioningJoin the conversation: #forcewebinar
  56. 56. Leverage Salesforce Platform components Force.com Canvas facilitates seamless, transparent integration of operational & historical data ETL process 100010010 Lean Salesforce org manages operational data Heroku app & database manages historical dataJoin the conversation: #forcewebinar
  57. 57. Demo Integrated best practicesJoin the conversation: #forcewebinar
  58. 58. Demo: Integrated best practices ü  Lean Salesforce database ü  Archive historical data ü  Hard-delete archived records ü  Leverage external application (Heroku) for analytics ü  Integrate UIs using Force.com CanvasJoin the conversation: #forcewebinar
  59. 59. Additional Resources More Best Practices @ Architect Core Resources http://developer.force.com/architectJoin the conversation: #forcewebinar