Service Oriented Development With Windows Communication Foundation Tulsa Dnug
DNUG 2017 - IBM Notes Performance Boost - Reloaded
-
Upload
christoph-adler -
Category
Software
-
view
40 -
download
2
Transcript of DNUG 2017 - IBM Notes Performance Boost - Reloaded
![Page 1: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/1.jpg)
# 44IBM Notes Performance Boost – Reloaded
Christoph Adler
![Page 2: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/2.jpg)
Senior Consultant at panagenda
15+ years of IBM (Lotus) solutions experience
Focused on• IBM Notes Client Management• Analysis and Optimization of ICS infrastructures• Cloud onboarding
Good to know• Lives in Germany• Frequent traveler• Wine or beer? Beer!• Don’t give energy drinks squirrel mode
Christoph Adler
2 11/6/2017
![Page 3: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/3.jpg)
Make Your Data Work for You
3 things before we start ...
3 11/6/2017
![Page 4: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/4.jpg)
1. Thank you!
Francie Tanner
4 11/6/2017
Florian Vogler Daniel Reimann
![Page 5: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/5.jpg)
2. Notes is not dead – at least until Sept. 2021
5 11/6/2017
IBM Notes and Domino V9.0.1 extends support and enhances its collaboration toolset with social capabilities from IBM Connections V5.5
Link:https://tinyurl.com/NotesIsNotDead
![Page 6: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/6.jpg)
3. Most import :-)
I (still) love Notes.
6 11/6/2017
![Page 7: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/7.jpg)
Make Your Data Work for You
Let‘s start with some numbers
7 11/6/2017
![Page 8: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/8.jpg)
IBM Notes 9.0.1 Fix Pack 8 Interim Fix 1
11/6/2017
~35.000 files (Notes 6/7 | 8/9 Basic used to have ~550) = +6.300%• 28.600 files in Notes Program\framework in 2.700 subdirectories
– 11.200 (largely undocumented) .properties files– 1.200 .jar files– 1.300 .html files
• 600 files in Notes Data\workspace in 250 subdirectories– 40 (largely undocumented) XML files– 40 (largely undocumented) .properties files
• Which is– 35.000 files in 2.950 subdirectories– 11.280 largely undocumented files
– ... and around 60 NSFs/NTFs– ... and the good old notes.ini file
8
![Page 9: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/9.jpg)
IBM Notes 9.0.1 Fix Pack 8 Interim Fix 1 (cont.)
11/6/2017
Add over 80 preference/dialog boxes• Each dialog has ~15 settings at average
For a total of 1,200+ settings sprayed across• address book (very few)• notes.ini (few)• and XML files (lots)
Plus any plugins, widgets,add-ons, etc. “you“ or the usermay have added to the Notesclient install
9
![Page 10: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/10.jpg)
IBM Notes 9.0.1 Fix Pack 8 Interim Fix 1 (cont.)
11/6/201710
![Page 11: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/11.jpg)
IBM Notes 9.0.1 Fix Pack 8 Interim Fix 1 (cont.)
11/6/2017
Workspace
(nsf)Physical nsfs 1, 2, 3, … n
11
![Page 12: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/12.jpg)
Make Your Data Work for You
What makes the Notes Client START slow
12 11/6/2017
![Page 13: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/13.jpg)
IBM Notes release
11/6/2017
If you‘re not on at least 9.0.1 yet 9.0.1 is a significant improvement
Software lifecycle of IBM Collaboration Solutions– http://www-01.ibm.com/software/support/collaboration/lifecycle/
13
![Page 14: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/14.jpg)
IBM Notes release (cont.)
11/6/2017
How-to install IBM Notes 9.0.1 Feature Pack 8
1. Uncompress Installation files manually2. Run the following command to install the Feature Pack:
cmd.exe /c””c:\Temp\901FP8\setup.exe" /s /v"/qn /lime “c:\Temp\logs\901FP8.log""
14
![Page 15: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/15.jpg)
IBM Notes release (cont.)
11/6/2017
How-to install IBM Notes 9.0.1 Feature Pack 8 Interim Fix 1
1. Uncompress Installation files manually2. Run the following command to install the Feature Pack:
cmd.exe /c””c:\Temp\901FP8IF1\ClientUpdate.exe" /s /v"/qn /lime “c:\Temp\logs\901FP8IF1.log""
15
![Page 16: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/16.jpg)
Antivirus realtime scanning in Data directory
11/6/2017
~50% of the entire data volume in the Data directory changes on a DAILY basis in most setups• 5 - 10% in Data\workspace (up to 300 files)• DISABLE Antivirus scanning for at least
*.ns**.ndk*.xml*.properties*.jar
in Data Directory.
16
![Page 17: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/17.jpg)
What makes the Notes Client START slow (cont.)
11/6/2017
Client crashes/database fixups• especially bad for network based data directories clients
Outdated Hardware• You need >2 GB memory if you want to use Notes AND something else• Old fixed disks with fragmentation• Fun Exercise: Buy a Solid State Disk and make Notes start off of that ;-)
Tons of startup programs/scripts launching during the “boot storm”• If the disk is unable to keep up, it‘s not Notes' fault
17
![Page 18: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/18.jpg)
What makes the Notes Client START slow (cont.)
11/6/2017
Outdated Data directories• Virtually 100% of all NTFs (Laptops: 90%) can be removed by• Cleaning up old Notes 4+5+6/7 templates• using ini:SharedDataDirectory= (also with Single User install!)
Operating System• Windows 8.1 boots ~20% faster than Windows 7• Windows 10 ~15% faster than 8.1
18
![Page 19: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/19.jpg)
ODS of local databases
11/6/2017
ODS = On Disk Structure• ODS 16 = Notes 2• ODS 17 = Notes 3• ODS 20 = Notes 4 (or Templates)• ODS 41 = Notes 5• ODS 43 = Notes 6 & 7• ODS 48 = Notes 8• ODS 51 = Notes 8.5 & 9• ODS 52 = Notes 9.0.1
The difference between ODS 43 and 52 = up to 80% LESS FILE I/OThis helps with ANY client AND server hardware
19
![Page 20: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/20.jpg)
ODS of local databases (cont.)
11/6/2017
CAUTION: The ODS is not automatically updated when upgrading clients– ODS 51 requires Notes >= 8.5 and CREATE_R85_DATABASES=1 in notes.ini for NEW db's– ODS 52 requires Notes >= 9.0.1 and CREATE_R9_DATABASES=1 in notes.ini for NEW db's
Good News for Notes > 8.5– Use NSF_UpdateODS=1 with CREATE_R85/9_DATABASES=1 for a one-time upgrade of most local
databases• NOTE: USE WITH EXTREME CARE IF YOUR DATA DIRECTORIES ARE ON A NETWORK DRIVE!• NOTE: End users can't access databases during compact OR databases will be ignored if in use
20
![Page 21: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/21.jpg)
ODS of local databases (cont.)
11/6/2017
Impact examples– Startup time of a Notes 9.0.1 client with 3 ODS20 databases in Notes data = 45 seconds– After ODS upgrade: 17 seconds– Reduced File I/O of your disks/SAN/NAS after ODS41 to 52 upgrade by 60%– Removing 70% of all old files in Data directories on SAN/NAS = 45% less managed storage (backup)
The bad news: There is no way to tell what is “out there”– 3rd party tools or random inspections are highly recommended
21
![Page 22: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/22.jpg)
IBM helps!
11/6/201722
![Page 23: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/23.jpg)
Make Your Data Work for You
What makes the Notes Client START (super) fast
23 11/6/2017
![Page 24: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/24.jpg)
Eclipse Workspace improvement
11/6/2017
• Every IBM Notes Client start in a virtual environment (citrix, vmware, etc.) is a first (setup) start and takes at least 23 sec on average
• ~65% - 70% of time during first starts is used to build the workspace folder (at least 15 sec)
• A typical new workspace folder (IBM Notes 9.0.1 FP8 IF1)consists of– >500 files– >200 folders– >85 MB (including 64MB *xpdplat_.jvm_G11 file NotesShareClasses improvement)
Building the workspace folder causes lots of file I/O
24
![Page 25: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/25.jpg)
Eclipse Workspace improvement (cont.)
11/6/2017
Accelerate the IBM Notes Client start to be >65% faster (with less file I/O)
1. With a non-admin user (Windows + IBM Notes) run an initial setup of IBM Notes2. Start IBM Notes and wait for 2-3minutes3. Exit IBM Notes4. Start IBM Notes again and wait for 2-3minutes5. Exit IBM Notes6. Create the following folder %ProgramData%\IBM\Notes\Data\Common7. Copy the workspace folder from %LocalAppData%\IBM\Notes\Data
to %ProgramData%\IBM\Notes\Data\Common
25
![Page 26: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/26.jpg)
Eclipse Workspace improvement (cont.)
11/6/2017
8. Delete the following files & folders in %ProgramData%\IBM\Notes\Data\Common\workspacea. UDMb. Logs all but .prov2installc. .metadata\.plugins\com.ibm.collaboration.*d. .metadata\.plugins\com.ibm.rcp.personality.frameworke. .metadata\.plugins\com.ibm.rcp.security.authf. .metadata\.plugins\com.ibm.rcp.managedsettings
26
![Page 27: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/27.jpg)
Make Your Data Work for You
Live
27 11/6/2017
![Page 28: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/28.jpg)
Make Your Data Work for You
What makes the Notes Client PERFORM slow
28 11/6/2017
![Page 29: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/29.jpg)
What makes the Notes Client PERFORM slow
11/6/2017
Again• ODS of local databases• Hardware
Notes.ini• EXTMGR_ADDINS = (not just) local virus scanners• Disable Notes “plugins“ like virus scanners etc.
– They increase Network traffic by up to 200 – 250%!
Data directory on the network vs. fixed disk• Disk performance is the #1 bottleneck
– think SSD vs. normal HDD ; 7.200rpm vs. 5.400rpm ; network drive vs. local fixed disk
29
![Page 30: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/30.jpg)
Port settings
11/6/2017
Port settings are included in the notes.ini• Type / Active / Encryption / Compression / Timeout
Legacy• LAN0 / COMx / DisabledPorts should be removed
Good idea• Use TCPIP according to the client type• PORTS = TCPIP• TCPIP = TCP,0,15,0,,12320, Desktops• TCPIP = TCP,0,15,0,,45088, Laptops• TCPIP = TCP,0,15,0,,12288, Citrix / VDI• Riverbed !?
Don‘t forget the Domino servers!
30
![Page 31: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/31.jpg)
What makes the Notes Client PERFORM slow (cont.)
11/6/2017
Install types: Basic vs. Standard– Basic client starts up fast, Standard client, well … not so fast
IBM Roaming Users– Try replicating 80MB each time you logon to Notes before use!
Connection documents– Pointing to outdated server names or IP addresses– Low priority connection documents, which can cause connectivity failures
Location documents– IP addresses for mailserver breaks Policies– Outdated mail and home server information– Outdated mail file path– Outdated Catalog server
31
![Page 32: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/32.jpg)
Make Your Data Work for You
PERFORMANCE Tips and Tricks
32 11/6/2017
![Page 33: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/33.jpg)
Performance Measuring with Client Clocking
11/6/2017
NOTE: All of this should only be done on “ONE” client – slows down client, creates huge log files!
Use the following to see and measure client performance– CLIENT_CLOCK=1– CONSOLE_LOG_ENABLED=1– Debug_Outfile=c:\debug.txt– Debug_Console=1– DEBUG_TCP_ALL=1 (use only if needed)
Fileserver or local disk Performance Debugging is virtually impossible– If on >= 8.5 try adding DEBUGGINGWCTENABLED=16386 in Notes
33
![Page 34: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/34.jpg)
Performance Measuring with Client Clocking (cont.)
11/6/2017
Client_Clock=1 leads to a debug file of the following format:
34
![Page 35: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/35.jpg)
Performance Measuring with Client Clocking (cont.)
11/6/2017
OpenNTF – NRPC Parser
Link:http://www.openntf.org/internal/home.nsf/project.xsp?action=openDocument&name=Notes%20RPC%20Parser
Last Update:v1.0.14 – Nov 10, 2016
Developed by:Jamie Magee, MartinScott Consulting LLC, USAndrew Magerman, Magerman Collaborative Software GmbH, Switzerland
35
![Page 36: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/36.jpg)
Performance Measuring with Client Clocking (cont.)
11/6/2017
OpenNTF – NRPC Parser
36
![Page 37: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/37.jpg)
Performance Tuning – Understanding cache.ndk
11/6/2017
We've all been “advised to”/guilty of deleting the cache.ndk in an effort to cure Notes performance problems/symptoms
– Some companies even delete cache.ndk on a scheduled basis
HOWEVER, let us explain the impact of that on Notes performance ...– Increases traffic between client and server by 4,000% (forty times more traffic, yes)
(10,000+% if the data directory is on a network drive)– The more databases end users use, the worse it gets– There is always a root cause – deleting cache.ndk only fixes symptoms– Let's look at some detailed traffic analysis for just ONE application (the mail file) of ONE user ...
37
![Page 38: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/38.jpg)
Performance Tuning – Understanding cache.ndk (cont.)
11/6/201738
100 users =150 MB vs. 3,7 MB
1000 users =1.5 GB vs. 37 MB
Excluding Fileservers!
After deleting cache.ndk Keeping / NOT deleting cache.ndk
![Page 39: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/39.jpg)
Summary: IBM Notes Performance Boost - Reloaded
11/6/2017
Update/clean out your ODS, databases and templates and hardware
Standardize whenever and however possible– This will save you hugely on support time/cost
Keep your users version/fix packs current– Each release brings performance improvements but also resource demands
Work around your inability to see clients– Write an inventory agent, login script, get a 3rd party tool
Any challenge can be overcome with Knowledge and Tools– All client issues are solvable
39
![Page 40: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/40.jpg)
# 44
Fragen ?
![Page 41: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/41.jpg)
# 44
Vielen Dank !
![Page 42: DNUG 2017 - IBM Notes Performance Boost - Reloaded](https://reader034.fdocuments.net/reader034/viewer/2022051123/5a666d957f8b9a47688b631f/html5/thumbnails/42.jpg)
Headquarters, Austria:panagenda GmbH (Ltd.)Schreyvogelgasse 3/10AT 1010 Vienna
Phone: +43 1 89 012 89Fax: +43 1 89 012 89-15E-Mail: [email protected]
Headquarters, Germany:panagenda GmbH (Ltd.)Lahnstraße 17DE 64646 Heppenheim
Phone: +49 6252 67 939-00Fax: +49 6252 67 939-16E-Mail: [email protected]
USA:panagenda Inc.60 State Street, Suite 700MA 02109 Boston
Phone: +1 617 855 5961Fax: +1 617 488 2292E-Mail: [email protected]
Germany:panagenda Consulting GmbH (Ltd.)Donnersbergstraße 1DE 64646 Heppenheim
Phone: +49 6252 67 939-86Fax: +49 6252 67 939-16E-Mail: [email protected]
The Netherlands:Trust Factory B.V. 11th Floor,Koningin Julianaplein 10NL 2595 AA The Hague
Phone: +31 70 80 801 96E-Mail: [email protected]
© 2007-2015 panagendaMake Your Data Work for You
42 11/6/2017