IBM ConnectED 2015 BP110: Mastering Your Logs, Everything You Shoul...

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

BP110: Mastering Your
Logs
Everything You Should
Know about Logging in
IBM Domino
Ben Menesi, Ytria

 Head of Product at Ytria
 IBM Notes Administration & Development for
various enterprise IBM customers
 Certified Advan...

 Founder, CEO & CTO at Ytria
 15+ years IBM Notes & API development
 Speaker at ICS conferences & published author
 IB...

Domino
Server
The
Admin

1.
• Events take place
2.
• Events are logged
3.
• Some events captured
4
• Few events addressed
5
• Lots of events missed...

 Everything about LOG.NSF
– Understanding different log events
– Extracting additional data
– Log Retention, Searching th...

LOG.NSF
What is (or isn’t) logged in log.nsf?
How can we extract more data?
Best Practices for retention, searching and mo...

 Almost everything from your Domino server (HTTP Web Server is
another topic!)
– Generally 90%+ of what’s in your Domino ...

 MAIN Log.nsf setting in your server’s Notes.ini file
 Logfilename: typically log.nsf
 Log_option: 1 = Log to the conso...

 Understanding your log views
Log.nsf
Log file structure
 SELECT Form=“Events”
 SELECT Form=“Mail Routing”
 SELECT For...

 Server tasks simultaneously log into various log.nsf documents
 Miscellaneous Events (form=Events)
– Size & content con...

 Understanding your log views
Log.nsf
Log file structure
 Select Form=“Session”
 Select Form=“Session”
 SELECT Form=“A...

 User Session Activity (form=Session)
– Sessions this server had with users or other servers
 Activity Data (form=Activi...

 Server tasks can log events to multiple types of documents!
– But no duplicate logs: different information!
– Example: S...

 Miscellaneous events: what do we see?
– Some high level info (Server, Start & Finish Time) and
– UI only shows ONE text ...

 What the EventsR6 item tells us us
– Used to be a Rich Text item Prior to R6 (whew!)
– @If(@IsAvailable(Eventlist);Event...

 Miscellaneous events – event attributes logged in multi-value Text
items
Log.nsf
1.) Miscellaneous events
EventList
Time...

 Miscellaneous events – EventSeverity
– Severities are recorded via numbers 0 – 5 where
• 0: Unknown
• 1: Fatal
• 2: Fail...

 Miscellaneous events – EventType
– Multiple type identifiers in use
• Best not to mess with this stuff
Log.nsf
1.) Misce...

 Can we get more data?
– We can use formulas and the list of Severities, Events & Status Codes
to get a better idea of ea...

 Customization options (Cont’d)
 Once we have the _sev variable, use icons to display (from DDM
resources)
– @If(_sev="0...

 # of High Warning severities / document
– @Elements(@Trim(@Replace(@Text(EventSeverity);"5":"4":"1":"2":"0
";"")))
 # o...

 Customization options: this is what you’ll get
– Tip: we can make the Highest and severity columns sortable but
careful ...

 Mail Routing Events
– Same Structure as Miscellaneous events
– Incrementally fills documents (considering 40KB / Log= li...

 Is there any additional data we can mine?
– Use same custom views (Severities, unique events, etc…)
• Tip: Messages can ...

 Unique # of Messages transferred [EventList item]
– Could be used as a sortable column formula
• @Elements(@Unique(@Expl...

 List of unique message codes [EventList item]
– Could be used as a categorized column formula – help finding emails
• @U...

 Security Event documents
– Same Structure as Miscellaneous events
– Incrementally fills documents (considering 40KB / Lo...

 Replication Events <> Miscellaneous events
– Important: Logs documents PER SESSION
– Only Replication Sessions where the...

 What additional data can we extract and use?
– EventList & EventSeverity items ONLY created on error
– # of entries in t...

 Interesting stuff: even when DB1 only has to SEND data to DB2,
we can see data being received by DB1
– BytesIN & BytesOU...

 Creating a custom replication view
 Replicator / Cluster Replicator? [Initiatedby item]
 Number of events [Pathname it...

 Creating a custom replication view (Cont’d)
Log.nsf
4.) Replication Events

 Usage Session logs – what do we (not) see?
– IMPORTANT: Logging on a /USER/SESSION base!
– Contains a TON of raw data
Lo...

 What is an event?
Log.nsf
5.) Usage Session Documents
Database Reads Writes Transactions
Bytes Read Bytes Written DB Ope...

 What additional data can we extract and use?
– PathName item (multi-value) contains list of databases accessed
• @Elemen...

 Searching your log file is painful
– Reason: you’ll be presented with any matching documents but you
won’t be able to re...

 Option #1: search using the Admin client
– TONS of parameters to specify – slow setup. Better for periodical
search requ...

 Option #1: search using the Admin client (Cont’d)
– Tip: do NOT use the Event Type tab!
• You can miss results because e...

 Option #1: search using the Admin client (Cont’d)
– Tip: You can save queries in domadmin.nsf to reuse later
– BEWARE: S...

 Option #2: A quicker DIY solution (less customizable)
– Advantages: reads matches from multiple log documents and saves ...

 Option #3: Pro tip for data-range search (Kudos to Kim Greene)
– Select log documents and Actions Forward
• Aggregates ...

 Option #4 Great open source log parser via OpenNTF from Jakob
Majkilde
– Installed on server, access to Console Logs, Tr...

 Option #5+ 3rd Party tools
– Use a tool like Ytria consoleEZ
Log.nsf
How to search?

 Log deletions managed by parameter defined in log= server
notes.ini parameter
– Deletions made at once, all entries olde...

 Known problem in previous Domino versions: log.nsf continues to
grow and ignores log= settings
– Workaround: use “Remove...

 Recommendation
– Use the “Remove documents note modified in the last (days)” setting
– Use console logs to keep old log ...

 Log_AgentManager
– 0 for no logging, 1 for partial & successful agent execution events, 2
for successful events only
 L...

 Mail_Log_To_MiscEvents
– 0/1 whether to log mail events into Misc. event documents
• Tip: MailLogToEventsOnly=1 to NOT s...

 Log_Console=2
– Logs all console commands even if prefixed with ! (By default !sh task
won’t be logged!)
 LOG_DisableTX...

USAGE ACTIVITY
What are our most used databases?
How do we know what a given user has been up to?
How do we get user activ...

 User Activity can be a *VERY* rich source of data
– Enable in the database properties window
• Tip: No_Force_Activity_Lo...

 Did you upgrade your database On Disk Structures?
– I’m not proud of it
– Tip: use Compact –REPLICA for upgrading system...

 Prior to ODS 48
– Entry size allocated 44 bytes, Object size 61600 bytes (max 1400 entries)
 ODS 48+ (undocumented impr...

 Does Notes only capture as much as it displays?
– Nope
Database User Activity
User Activity – What is really captured?
R...

 Differentiating between Data (as in: Document class notes) and
Non-Data (as in: everything else such as Designs, ACLs, e...

 Makes no difference between users and servers
– Workaround: use a tool to parse the data and input exceptions
 Only mai...

 How do we get the user activity for multiple databases
– Third party tools like http://www.agecom.com.au/useractivity
– ...

REPLICATION
LOGS
How is replication logged?
What can we read out?
What to watch out for?

 Set via Log_Replication=value
– 0 Do not log replication events
– 1 Log that DB is replicating (Default value)
– 2 Log s...

 Keeps track of what the current database replicated with
– Tip1: Local <> Server replication leaves NO TRACE in server r...

 Feature aiming to optimize performance introduced in Domino 7
– Result: Replication History Entries indicating replicati...

 Idea: to prevent complete recalculation when replicating with an
unknown server
– Results show 400% CPU increase in some...

 Purge Interval Replication Control
– New(ish) awesome option for preventing old documents from coming
back (Introduced i...

 Please fill out your evaluation forms
– Your feedback is very important!
 Feel free to get in touch!
– Contact - Ben Me...

Engage Online
 SocialBiz User Group socialbizug.org
– Join the epicenter of Notes and Collaboration user groups
 Social ...

Copyright © 2015 by International Business Machines Corporation (IBM). No part of this document may be reproduced or trans...

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

ConnectED 2015 - IBM Notes Traveler... by René Winkelmeyer 7349 views
BP205: There’s an API for that! Why... by Mikkel Flindt Hei... 4228 views
IBM ConnectED 2015 - AD302 - Respon... by beglee 3144 views
The future of web development wri... by Mark Leusink 8150 views
IBM Connect 2014 BP103: Ready, Aim,... by Benedek Menesi 10531 views
IBM ConnectED 2015 - BP106 From XPa... by Paul Withers 3678 views

View on Slideshare

1 of 67 Ad

View on Slideshare

1 of 67 Ad