Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

MWLUG 2017: SA104 - IBM Notes Performance Boost

1,057 views

Published on

Reloaded for the latest IBM Notes version, join Daniel Reimann, Director Technical Account Management US, and find out how to make the IBM Notes client faaaast and consistent! Learn how to debug the client, deal with outdated ODS', understand network latency and more to provide measurable benefit to your users. Gather best practices on how to streamline location and connection documents and why the catalog.nsf is so important.Improve your IBM Notes client installations to provide a better experience for your users! As a special bonus, Daniel will show you how to reduce the startup time of virtualized IBM Notes Clients (Citrix / VMware / etc) by up to 70%!

Published in: Data & Analytics
  • Be the first to comment

MWLUG 2017: SA104 - IBM Notes Performance Boost

  1. 1. MWLUG 2017 Moving Collaboration Forward SA104 IBM Notes Performance Boost Daniel Reimann, panagenda @panareima #MWLUG2017
  2. 2. MWLUG 2017 Moving Collaboration Forward Our Amazing Sponsors
  3. 3. MWLUG 2017 Moving Collaboration Forward @panareima #MWLUG2017 Introduction • Daniel Reimann – Director Technical Account Management, US – 17 years with Notes / Domino – Focus on optimizing and transforming collaboration landscapes – German, lives in Boston, MA – there will be an accent … ☺ – and I never had to delete my cache.ndk! • Thanks to Chris Adler for many updates in here!
  4. 4. MWLUG 2017 Moving Collaboration Forward @panareima #MWLUG2017 Notes is not dead – at least until Sept. 2021 • IBM Notes and Domino V9.0.1 extends support and enhances its collaboration toolset with social capabilities from IBM Connections V5.5 • Link: https://tinyurl.com/NotesIsNotDead
  5. 5. MWLUG 2017 Moving Collaboration Forward @panareima #MWLUG2017 I love Notes.
  6. 6. MWLUG 2017 Moving Collaboration Forward Let‘s start with some numbers 6 8/16/2017
  7. 7. IBM Notes 9.0.1 Fix Pack 8 Interim Fix 1 ~35.000 files (Notes 6/7 | 8/9 Basic used to have ~550) = +6.300% • 28.600 files in Notes Programframework in 2.700 subfolders – 11.200 (mostly undocumented) .properties files – 1.200 .jar files – 1.300 .html files • 600 files in Notes Dataworkspace in 250 subfolders – 40 (mostly undocumented) XML files – 40 (mostly undocumented) .properties files • Overall – 35.000 files in 2.950 subfolders – 11.280 mostly undocumented files – ... and around 60 NSFs/NTFs – ... and the good old notes.ini file @panareima #MWLUG2017
  8. 8. Add over 80 preference/dialog boxes • Each dialog has ~15 settings at average For a total of 1,200+ settings spread across • names.nsf (very few) • notes.ini (few) • XML, .prefs, .properties files (lots of) Plus any plugins, widgets, add-ons, etc. "you" or the user may have added to the Notes client install IBM Notes 9.0.1 Fix Pack 8 Interim Fix 1 @panareima #MWLUG2017
  9. 9. Workspace (nsf) Physical nsfs 1, 2, 3, … n IBM Notes 9.0.1 Fix Pack 8 Interim Fix 1 @panareima #MWLUG2017
  10. 10. MWLUG 2017 Moving Collaboration Forward What makes the Notes Client START slow 10 8/16/2017
  11. 11. IBM Notes release If you‘re not on 9.0.1 yet  9.0.1 is a significant improvement Software lifecycle of IBM Collaboration Solutions – http://www-01.ibm.com/software/support/collaboration/lifecycle/ @panareima #MWLUG2017
  12. 12. Antivirus realtime scanning in Data directory ~50% of the entire data volume in the Data directory changes on a DAILY basis in most setups • 5 - 10% in Dataworkspace (up to 300 files) • DISABLE Antivirus scanning for at least *.n*f *.ndk *.xml *.properties in the Notes Data directory. @panareima #MWLUG2017
  13. 13. What makes the Notes Client START slow Client crashes/database fixups • Happens mostly for clients with network based data directories Outdated Hardware • You need >2 GB memory if you want to use Notes and other software simultaneously • Old fixed disks with fragmentation • Got the money? Buy Solid State Disks and make Notes start off of them ;-) Tons of startup programs/scripts launching during "boot storm" • If the disk is unable to keep up, it's not the fault of Notes @panareima #MWLUG2017
  14. 14. What makes the Notes Client START slow Outdated Data directories • Virtually 100% of all NTFs (Laptops: 90%) can be removed by cleaning up old Notes 4+5+6+7 templates • Hint! use ini:SharedDataDirectory= (also with Single User install!) Operating System • Windows 8.1 boots ~20% faster than Windows 7 • Windows 10 ~15% faster than 8.1 @panareima #MWLUG2017
  15. 15. ODS of local databases ODS = On Disk Structure • ODS 16 = Notes 2 • ODS 17 = Notes 3 • ODS 20 = Notes 4 (or Templates) • ODS 41 = Notes 5 • ODS 43 = Notes 6 & 7 • ODS 48 = Notes 8 • ODS 51 = Notes 8.5 & 9.0 • ODS 52 = Notes 9.0.1 The difference between ODS 43 and 52 = up to 80% LESS FILE I/O • This helps on ANY client AND server hardware @panareima #MWLUG2017
  16. 16. ODS of local databases (cont.) CAUTION: ODS is not automatically updated when upgrading clients – ODS 51 requires Notes >= 8.5 and CREATE_R85_DATABASES=1 in notes.ini for NEW db's – ODS 52 requires Notes >= 9.0.1 and CREATE_R9_DATABASES=1 in notes.ini for NEW db's – Looking to upgrade ODS of desktop8.ndk? Good luck! Only renaming to older version (i. e. desktop6.ndk) or deleting helps! Good News for Notes > 8.5 – Use NSF_UpdateODS=1 with CREATE_R85/R9_DATABASES=1 for a one-time upgrade of most local databases • Note: USE WITH EXTREME CARE IF YOUR DATA DIRECTORIES ARE ON A NETWORK DRIVE! • Note: End users can't access databases during compact OR databases will be ignored if in use @panareima #MWLUG2017
  17. 17. ODS of local databases (cont.) Impact examples – Startup time of a Notes 9.0.1 client with 3 ODS20 databases in Notes data = 20 seconds – After ODS upgrade = 8 seconds – Reduced File I/O of your disks/SAN/NAS after ODS41 to 52 upgrade by 60% – Removing 70% of all old files in Data directories on SAN/NAS = 45% less managed storage (backup) The bad news: There is no way to tell what is "out there" – 3rd party tools or random inspections are highly recommended @panareima #MWLUG2017
  18. 18. IBM helps, too! @panareima #MWLUG2017
  19. 19. MWLUG 2017 Moving Collaboration Forward What makes the Notes Client START fast 19 8/16/2017
  20. 20. Eclipse Workspace improvement • Almost every IBM Notes Client start in a virtual environment (Citrix, VMware, VDI, etc.) is an initial (setup) start and takes at least 23 sec on average • ~65% - 70% of the time during first starts is used to build the workspace folder (at least 15 sec) • A typical new workspace folder (IBM Notes 9.0.1 FP8) consists of – >500 files – >200 folders – >85 MB (including 64MB *xpdplat_.jvm_G11 file  NotesShareClasses improvement) @panareima #MWLUG2017
  21. 21. NotesShareClasses improvement • In IBM Notes the jvm.shareclasses file (*xpdplat_.jvm_G11) is stored in each users Dataworkspace.configorg.eclipse.osgi folder and has a size of 64MB • To optimize file I/O, speed up the IBM Notes Client start and save storage (960MB per server == 15users), this file can be shared across all users of the virtual environment server 1. Create the following folder "C:TempNotesShareClasses" and set folder rights for "everyone" to read / write access 2. Change the value of the parameter "jvm.shareclasses.loc=" in %ProgramFiles(x86)%IBMNotesframeworkrcpdeployjvm. properties • from "${rcp.data}/.config/org.eclipse.osgi" • to "C:/Temp/NotesShareClasses"  it’s important to use "/" instead of "" @panareima #MWLUG2017
  22. 22. Eclipse Workspace improvement (cont.) Accelerate the IBM Notes Client start to be >65% faster (with less file I/O) 1. With a non-admin user (Windows + IBM Notes) run an initial setup of IBM Notes 2. Start IBM Notes and wait for 2-3minutes 3. Exit IBM Notes 4. Start IBM Notes again and wait for 2-3minutes 5. Exit IBM Notes 6. Create the following folder  %ProgramData%IBMNotesDataCommon 7. Copy the workspace folder from %LocalAppData%IBMNotesData to %ProgramData%IBMNotesDataCommon @panareima #MWLUG2017
  23. 23. Eclipse Workspace improvement (cont.) 8. Delete the following files & folders in %ProgramData%IBMNotesDataCommonworkspace a. UDM b. Logs  all but .prov2install c. .metadata.pluginscom.ibm.collaboration.* d. .metadata.pluginscom.ibm.rcp.personality.framework e. .metadata.pluginscom.ibm.rcp.security.auth f. .metadata.pluginscom.ibm.rcp.managedsettings @panareima #MWLUG2017
  24. 24. MWLUG 2017 Moving Collaboration Forward Live demo – Workspace improvement 24 8/16/2017
  25. 25. MWLUG 2017 Moving Collaboration Forward What makes the Notes Client PERFORM slow 25 8/16/2017
  26. 26. What makes the Notes Client PERFORM slow Again • ODS of local databases • Hardware Notes.ini • EXTMGR_ADDINS = (not just) local virus scanners • Disable Notes "plugins" like virus scanners etc. – They increase Network traffic by up to 200 – 250%! Data directory on the network vs. fixed disk • Disk performance is the #1 bottleneck – think SSD vs. normal HDD ; 7.200rpm vs. 5.400rpm ; network drive vs. local fixed disk @panareima #MWLUG2017
  27. 27. Port settings Port settings are included in the notes.ini • Type / Active / Encryption / Compression Legacy • LAN0 / COMx / DisabledPorts  remove Good idea • Use TCPIP according to the client type • PORTS = TCPIP • TCPIP = TCP,0,15,0,,12320, - Desktops • TCPIP = TCP,0,15,0,,45088, - Laptops • TCPIP = TCP,0,15,0,,12288, - Citrix / VDI Don't forget the Domino server side! @panareima #MWLUG2017
  28. 28. What makes the Notes Client PERFORM slow Install types: Basic vs. Standard – Basic client starts up fast, Standard client, well … not so fast IBM Roaming Users – Try replicating ~80MB each time after you logon to Notes before using it *facepalm* Connection documents – Pointing to outdated server names or IP addresses – Low priority connection documents, which can cause connectivity failures Location documents – IP addresses for home mail server --> breaks policies – Outdated home mail server information – Outdated mail file path – Catalog server (think db links, doc links, new bookmarks) @panareima #MWLUG2017
  29. 29. Why is the Catalog important? Ever wondered what exactly happens when you click on db links / doc links / view links? 1. Notes checks whether you already have a workspace icon pointing to the replica ID in the link. If yes, the top most icon on the stack decides on which server the db will open 2. If there's no icon on the workspace, Notes asks the catalog server in your currently selected location document where the db is to be found. So, make sure your catalog is up to date! No catalog server? Notes will ask your mail server! 3. Are you replicating your catalog.nsf across all servers? Bad news: If 2.) applies, Notes will open the database on the server it finds first in the catalog – which is sorted alphabetically. In global infrastructures that might be a server far far away Make sure to use an appropriate catalog server in your location documents! @panareima #MWLUG2017
  30. 30. MWLUG 2017 Moving Collaboration Forward PERFORMANCE Tips and Tricks 30 8/16/2017
  31. 31. Performance Measuring with Client Clocking NOTE: All of that should only be done on ONE client – it slows down clients and creates large log files! Use the following (in notes.ini) to measure client performance – CLIENT_CLOCK=1 – CONSOLE_LOG_ENABLED=1 – Debug_Outfile=c:somefolderdebug.txt – Debug_Console=1 – DEBUG_TCP_ALL=1 (use only if needed) Fileserver or local disk performance debugging is virtually impossible – If on >= 8.5 try adding DEBUGGINGWCTENABLED=16386 to the notes.ini though @panareima #MWLUG2017
  32. 32. Performance Measuring with Client Clocking Client_Clock=1 creates a debug file in the following format: @panareima #MWLUG2017
  33. 33. OpenNTF – NRPC Parser Link: http://www.openntf.org/internal/home.nsf/project.xsp?action=openDocument&name=Notes% 20RPC%20Parser Last Update: v1.0.14 – Nov 10, 2016 Developed by: Jamie Magee, MartinScott Consulting LLC, US Andrew Magerman, Magerman Collaborative Software GmbH, Switzerland @panareima #MWLUG2017 Performance Measuring with Client Clocking
  34. 34. OpenNTF – NRPC Parser @panareima #MWLUG2017 Performance Measuring with Client Clocking
  35. 35. We've all been advised to / guilty of deleting the cache.ndk in an effort to solve Notes issues – Some even delete cache.ndk on a scheduled basis HOWEVER, let us explain the impact of that on Notes performance ... – Increases traffic between client and server by 4,000% (forty times more traffic, yes) (8,000+% if the data directory is on a network drive) – The more databases end users use, the worse it gets – There is always a root cause – deleting cache.ndk only fixes symptoms – Let's look at some detailed traffic analysis for just ONE application (the mail file) of ONE user ... @panareima #MWLUG2017 Performance Tuning – the (in)famous cache.ndk
  36. 36. 100 users = 150 MB vs. 3,7 MB 1000 users = 1.5 GB vs. 37 MB Excluding Fileservers! After deleting cache.ndk Keeping / NOT deleting cache.ndk @panareima #MWLUG2017 Performance Tuning – the (in)famous cache.ndk
  37. 37. MWLUG 2017 Moving Collaboration Forward Summary 37 8/16/2017
  38. 38. Update ODS and hardware / clean out databases and templates Standardize whenever and however possible – This will save you a LOT of support time / cost Keep versions / fix packs current – Each release brings performance improvements but also resource demands Work around the impossibility to see all your client configurations – Write an inventory agent, login script, get a 3rd party tool Any challenge can be mastered with knowledge and tools – All client issues are solvable @panareima #MWLUG2017 Summary
  39. 39. -- > Get your free license here <-- • Efficient Client-Analysis is impossible without additional tooling • FREE one year license of panagenda MarvelClient Analyze • The results will speak for themselves panagenda MarvelClient
  40. 40. Headquarters, Austria: panagenda GmbH (Ltd.) Schreyvogelgasse 3/10 AT 1010 Vienna Phone: +43 1 89 012 89 Fax: +43 1 89 012 89-15 E-Mail: info@panagenda.com Headquarters, Germany: panagenda GmbH (Ltd.) Lahnstraße 17 DE 64646 Heppenheim Phone: +49 6252 67 939-00 Fax: +49 6252 67 939-16 E-Mail: info@panagenda.com USA: panagenda Inc. 60 State Street, Suite 700 MA 02109 Boston Phone: +1 617 855 5961 Fax: +1 617 488 2292 E-Mail: info@panagenda.com Germany: panagenda Consulting GmbH (Ltd.) Donnersbergstraße 1 DE 64646 Heppenheim Phone: +49 6252 67 939-86 Fax: +49 6252 67 939-16 E-Mail: info@panagenda.com The Netherlands: Trust Factory B.V. 11th Floor, Koningin Julianaplein 10 NL 2595 AA The Hague Phone: +31 70 80 801 96 E-Mail: info@trust-factory.com © 2007-2015 panagendaMake Your Data Work for daniel.reimann@panagenda.com Twitter: @panareima 40 8/16/2017

×