30/11/11 Page 1
IT Services
Migration to Lotus Groupware
@ UZH
Implementing IBM Lotus Notes® in a Heterogenous Client Environment
Roberto Mazzoni / Roman Meng
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 2
IT Services
Agenda
– Introduction
– Challenges, requirements & why IBM Lotus® ?
– A technical approach
– Overview
– IMAP
– POP
– Lotus Traveler
– Lotus iNotes
– Multilingual
– Conclusion
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 3
IT Services
UZH - Introduction
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 4
IT Services
University of Zurich - About
– Established 1833, first radices date back to 1525
– The largest university in Switzerland with over 26,000 students
(as an International comparison: Oxford: 20,000 students)
– Alumni of the University of Zurich include 12 Nobel Prize laureates
(W. Röntgen, A. Einstein, E. Schrödinger, K. A. Müller, et al.)
– Rated 51 in the “Academic Ranking of World Universities 2010“
– Worldwide rank 38 in “Clinical Medicine and Pharmaceutics”
– Worldwide rank 30 in “Life Sciences and Agriculture”
– Member of the „League of European Research Universities“ (LERU)
– Schrödinger supercomputer ranked 96 in November 2009
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 5
IT Services
University of Zurich – Mission Statement
– pursues scholarly research and teaching and provides related services
– strives to provide exceptional quality in these areas and measures itself
against the highest international standards
– is aware of its responsibility in maintaining and offering a wide range of
academic disciplines
– grants as high a level of independence and shared responsibility as
possible to its students and staff, and promises equal opportunity on all
levels
– nurtures the intellectual, professional, and personal development of its
students and staff
– is committed to a participatory management style
– offers its staff modern contracts and working conditions
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 6
IT Services
University of Zurich - Funding
– Total income/costs: 1,162,000,000 CHF (2009)
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 7
IT Services
University of Zurich – Structure
– People – including guests approximately 35,000 members
– over 26,000 students
– approx. 500 professors
– approx. 2,700 academic personnel
– approx. 2,000 administrative personnel
– approx. 800 private lecturers / nominal professors
– approx. 2000 assistant lecturers
– numerous guests
– Decentralized and self-governed – 180 self-governed units
– 7 faculties
– approx. 150 institutes
– about 15 competence centers
– numerous associated institutes
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 8
IT Services
IBM Lotus® @ UZH – History
– 2005
– The university's IT strategy retains the evaluation of a groupware
containing the usual suspects: e-mail, scheduling, contacts, tasks,
mobile synchronization
– Opting for document management, synchronous communication,
workflows
– Replacing the old solution for approx. 35,000 users
– 2007
– Open tenders
– 2008
– End of evaluation, final decision done by the university management
– 2009
– Internal “Going live” with IT services
– 2010
– Official “Going live” and migration of the 40'000 users (yes, we found
some more...)
– 2011
– Closing operations for the project
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 9
IT Services
Challenges, Requirements &
Why IBM Lotus® ?
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 10
IT Services
Challenges
– Faculties/Institutes have very high degree of autonomy in the name of
"freedom for research and teaching".
– The instruments for the academic usage ranges from magnetic
resonance imaging (MRI), super computing up to devices suitable for
outdoor use in extreme conditions. (Sounds strange, but believe us...
they want them all to collaborate...)
– Software needed for academic usage is built on a broad range of
operating systems, some of them very exotic. (Do you really believe OS/
2, AmigaOS or OpenVMS is exotic? Don't even dare...)
– Academic work is international, public, interdisciplinary and strongly
networked. (like a good MMO...)
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 11
IT Services
Challenges
– The academic user has a very mobile working environment. (you
remember the terms “outdoor” and “extreme conditions”?)
– Most people work for different Institutes/Faculties/Universities
simultaneously and are often sharing a full-time equivalent with other
people. (Guess where we found the “other” users, so the headcount went
from 35'000 up to 40'000)
– High fluctuation due to academic interchange and the nature of
academic studies.
– Most of them are university graduates... (“No, you can't use this mouse
for bio-chemical experiments... It's for your computer...”)
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 12
IT Services
All these challenges lead us to...
– Requirements
– Requirements
– Requirements
– Requirements
– Requirements
– Requirements
– Requirements
– Requirements
– Requirements
– Requirements
– Some more requirements
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 13
IT Services
Free choice & No standard environment
– People / institutes don't pay for the service, its free of charge, so they are
not obliged to use it. We have to SELL the service with persuasion, so it
has to be „good“.
– So let's raise the bar, as we have to meet the standards as expected by
the users (and provided by the old solution)
– High availability from every workplace
– Transparent service cloud needed
– Scalable & Fast
– Disaster-resistent (failover)
– No enforcement possible neither for an operating system, a client nor for
a version of it
– Different deployed version of all (non-lotus) applications
– What we try is to “enforce” at least a common “major” version of
Lotus Notes
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 14
IT Services
Free choice & No standard environment
– Lotus Notes support for at least the main operating systems
– 40 % Microsoft® Windows®, from Windows 2000 to Windows 7
– 40 % Apple® Mac OS, from 9.x to OS X 10.6
– 20 % other, mostly Linux® of various distributions and some exotic
ones
– Everything available in every bitness or flavour
– How to „close the gap“ if no Lotus Notes® is available
– Not all systems allow a fat client, in many cases only a light-weight
client as an imap-only-client is possible.
– Or the OS is simply not supported
– Open protocols to support a lot of (native) clients where Lotus
Notes/iNotes is not possible or feasible (see later)
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 15
IT Services
Role centric model
– Not only the person is important, but their role is it too and it has to be
separable from the person
– Need for non personal, shared collaboration resources accessible
through access rights
– Mailfiles, Calendars, Contacts, Room/Resources, Applications,
Databases, etc
– Shared Mailbox: That's where mail-in kicks in
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 16
IT Services
Multilingual
– Switzerland alone has 4 languages of the country
– Full support for different languages needed
– Combined with the role centric model this means that people need to
have the possibility to dynamically switch the language
– Not only multilingual templates
– Multilingual Mailfiles too...
– And that dynamically in realtime...
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 17
IT Services
Openness of data
– No vendor lock acceptable
– Possibility to extract data after work done needed
– Access to data from non proprietary client required
– Open protocols (see later) to exchange/extract/import data
– Guest users
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 18
IT Services
Part of the data on foreign systems
– It is not possible for the people to have all their data they need for their
work on the lotus system. Some data has to be stored on foreign
systems
– If we want that they use Lotus Notes/iNotes® as a sole system, it will
have to support the protocols to access the data on foreign systems.
– Example
– IMAP Implementation in Lotus Notes...
– That's one of the main reasons we can't recommend Lotus Notes as
the „one and only“ client
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 19
IT Services
Interchange with non-lotus-systems needed
– The lotus systems have to connect with non-lotus-systems
– Open standardized protocols are the key
– IMAP/POP3 - standard for mail
– iCal – standard to read calendar data
– ics - to exchange calendar data in file format
– CalDAV - standard for read/write access to calendar data incl.
free/busy
– CardDAV - upcoming standard for contacts data
– SyncML - standard for mobile pim synchronization
– ActiveSync - standard for mobile pim synchronization
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 20
IT Services
Interchange with non-lotus systems needed
– And by the way...
– „Open Source & Standards are key to making our planet smarter and
improving the way we live and work. [...] IBM is an industry leader
helping governments move toward greater openness and innovation. Our
commitment and perspective on intellectual property, open standards,
and open source software emerges from our experience in the
marketplace and, equally important, from the direction in which we see
information technology taking the larger society.“
–
(http://www-03.ibm.com/linux/ossstds/ - Open Source and Standards @ IBM)
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 21
IT Services
Why Lotus®
? The Clients
– Clients
– Highly heterogeneous environment at the UZH (→ diversity /
autonomy)
– Lotus Notes supports a broad client infrastructure at the different
release levels
– The most important operating systems are supported for the full
client
– OS X, Windows, Linux
– Strategical importance of the web frontend: Lotus iNotes covers
basic to advanced functionality for desktop up to mobile computers
– Works with a wide range of browser, supported for the most
important of them
– Open technology
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 22
IT Services
Why Lotus®
? The Servers
– Server infrastructure leaves a very solid and sophisticated impression.
(→ high quality)
– Scalable!
– Most of the time very stable
– Also great flexibility in the host operating system for the servers
– Extensive documentation
– Extension possible with other Lotus products
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 23
IT Services
Why Lotus®
?
– Scope of function / flexibility
– Very broad (!) scope of function, very well covered to a great extent
– Coverage of demands with regard to „Accessibility“ and „Usability“
(→ equal opportunity)
– Potential for closing existing gaps (IMAP implementation, etc.)
– Open platform with possibilities for expansion and further development (→ self-
management / autonomy)
– Costs
– Within a 3-5 year perspective with a favorable and transparent cost structure
– License model
– The university treats all members (~40,000) equally and offers them all the
opportunity to use the system (→ equal opportunity)
– Flexible offer, well suited to the purposes of the UZH
– Supplier as implementation partner
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 24
IT Services
A technical approach
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 25
IT Services
Solution Overview
The current (simplified) server situation
Administration
1
Mail
1
Application
1
Test
1
Development
1
Traveler®
1
IMAP Proxy
1
Sametime®
1
Mail
2
Mail
3
Mail
4
Mail
5
Mail
6
Mail
7
Mail
8
Mail
9
Mail
10
Mail
11
Mail
12
IMAP Proxy
2
Traveler
2
Sametime
2
Application
2
Test
2
Development
2
Test Environment 1
Test Environment 2
Test Environment 3
Intranet
Mail Gateways +
Anti Virus / SPAM
Internet
SMTP
SMTP
SMTP
IBM Tivoli®
Identity Manager®
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 26
IT Services
Drawbacks and Opportunities: IMAP Task
– Read / Unread, does it matter? (PMR 68612,211,848)
– Unread Mark Inconsistency on Server with IMAP
– Status:
– Closed
– SPR
– Deleting mails in IMAP leads to incorrect unread marks for new mails
(read instead of unread) (PMR 68751,211,8489)
– Status:
– Closed
– Fixed in 8.5.1 via private hotfix
– Included in 8.5.2 Mainstream (SPR #TPON7MFEPW)
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 27
IT Services
Drawbacks and Opportunities: IMAP Task
– How to transform that task into a transparent service (cloud)?
– External solution with a open-source imap proxy called Perdition (and the
nomen wasn't an omen)
IP Dispatcher
idlperd01
207.48
idlperd02
207.49
Round
Robin
IP Dispatcher
idlmail01.lotus
207.12
imap.lotus
pop.lotus
207.6
idlmail02.lotus
207.13
idlmail03.lotus
207.14
idlmail04.lotus
207.15
idlmail05.lotus
207.16
idlmail06.lotus
207.17
idlmail01
207.42
idlmail02
207.43
idlmail01
207.42
idlmail04
207.45
idlmail05
207.46
idlmail06
207.47
idlmail03
207.44
LDAP-Map
Perdition
IMAP/POP Proxy
Lotus
Domino®
POP/IMAP
Port 110,143,
993,995
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 28
IT Services
Drawbacks and Opportunities: IMAP Task
– Challenge: Can you cluster IMAP with Lotus Domino?
– Short answer: No
– Long answer: Yes, now, after a long ride, you can...
– PMR 67789,211,848
– No clustering for IMAP and no possibility to solve it with external solutions.
– Development of a solution by IBM
– Status: Closed
– Private Hotfix in 8.5.1
– Included in 8.5.2 Mainstream (SPR #YDEN7F8HBQ)
– So what's the problem?
– For IMAP unique ids (UID) are crucial for every client
– Without the client looses track
– Best Solution: Guarantee on every server the same IMAP UID for the same
message (which wasn't and isn't the case)
– Problem: UIDs aren't replicated, instead they are generated by every server
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 29
IT Services
Drawbacks and Opportunities: IMAP Task
– The solution IBM provided: If we can't make them the same, at least
make sure that they differ
– Implementation of IMAP_UIDVALIDITY. If set to a different value on
every server, it guarantees that the UIDs are different.
– So, when a IMAP client fails over, no UID he knows does exist, so he will
download all messages again (drawback), but you get a stable state
(opportunity)
– We had some problems with customers complaining that they see
deleted mail again after a fail-over, but couldn't reproduce these issue.
We think these problems are based on other issues.
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 30
IT Services
Drawbacks and Opportunities: IMAP Task
– IMAP Data Corruption
– Increasing number of error reports: Note NTxxxx was not updated in the IMAP
btree. Corruption of database.
– Seems to happen when moving documents from one folder to another in
IMAP.
– There's even an article about it in the DominoPower Magazine, a quote from it: "IBM sugg
(http://www.dominopower.com/issues/issue201004/00002501001.html)
– Status:
– Open / we never could really track it down
– May be fixed in 8.5.2 (Time will tell...)
– Delegation of Mailfiles
– There is a fine IMAP delegation functionality included in Lotus Domino.
– It enables you to access other maifiles via IMAP if you got the rights
– It maps it in the folder tree in a new folder called “Other users”
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 31
IT Services
Drawbacks and Opportunities: IMAP Task
– Delegation of Mailfiles
– Sadly, it does not work if the mailfile of the access right holder is not
present on the same server as the accessed mailfile.
– So with about 12 Mailservers and 80'000 Mailfiles we were in trouble,
especially as we have a lot of delegations (remember the “role
based”?)
– The restriction wasn't documented anywhere. And (from a customer
view) it doesn't makes sense anyway: Why should you need your
own mailfile only to access another mailfile?
– We're still in discussion with IBM about this.
– Status:
– Open
– CritSit
– Solution tested for 8.5.3
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 32
IT Services
Minor Pitfalls: POP Task
– Ever seen a server sized for 10'000 users (2000 concurrent) going down
on its knees with the load of 20 POP Users?
– Don't use exact sizes! (we never did)
– And even estimated sizes are not enough (we did)
– New Notes.ini-Param in 8.5.1FP2:
– POP3_List_Size_Estimation=1
– Gives back 40k for every message as size.
– The 40k is a fake, but better than intensive number crunching
including a take down of the server
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 33
IT Services
Lotus Traveler
– We would have preferred SyncML (Open Standard)
– Did you know that 99% of the synchronization inside Lotus Traveler
is SyncML? (except ActiveSync)
– But we're happy with the current solution as it works for all needed
mobile OS
– Works like a charm
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 34
IT Services
Lotus Traveler
Population January 2011
Double i-Devices and set Androids > 200 for November 2011
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 35
IT Services
Lotus Traveler
– Now a problem: How to cluster Lotus Traveler and to keep it transparent
(as a service)?
– You can't do this out-of-the-box, but maybe this could be a working
solution for you too:
– Flip-Flop with a standby-server.
– Caveats: Users will do a prime sync when they flip-flop. But better
than nothing.
IP Dispatcher
idltrav01
207.58
idltrav02
207.59
„Flip Flop“
Lotus Traveler
All Ports sync.lotus
207.10
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 36
IT Services
Lotus iNotes / DominoWebAccess (Webmail)
– Same procedure as everywhere else: How to cluster Lotus iNotes and to
keep it transparent (as a service)?
– We've chosen a simple solution:
IP Dispatcher
idlmail01
207.42
idlmail02
207.43
idlmail01
207.42
idlmail04
207.45
idlmail05
207.46
idlmail06
207.47
Round Robin
IP Dispatcher
idlmail01.lotus
207.12
idlmail03
207.44
webmail.lotus
207.5
idlmail02.lotus
207.13
idlmail03.lotus
207.14
idlmail04.lotus
207.15
idlmail05.lotus
207.16
idlmail06.lotus
207.17
idlmail01
207.42
idlmail02
207.43
idlmail01
207.42
idlmail04
207.45
idlmail05
207.46
idlmail06
207.47
idlmail03
207.44
Round RobinRedirect
iwaredir.nsf Lotus iNotes
Port 80,443
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 37
IT Services
Multilingual and dynamic
– Think about the following situation:
– A professor and three assistants share a mailfile
– Two of them speak German and English, one only English and the last one
only German
– Which language template would you apply?
– That's one of the reasons for us to have multilingual mailfiles, so the
users can choose their language dynamically
– PMR #11101,112,848, #11995,112,848 et al.
– Hot fix developed by IBM
– ENABLE_MULTILINGUAL_FOLDERS=1 & Merger tool for the template
– Worked great for the last 7-8 months
– We found now a problem with Lotus Traveler which didn't synchronize the
inbox anymore by some users.
– Included in 8.5.2: SPR #SHEZ6VLEDR, #RGAU7ZXN4T
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 38
IT Services
CalDAV
– De facto standard for synchronizing calendar data
– Based on iCal – format
– Able to do read/write – access, tasks, busy/free-schedules, etc
– Implementation on many devices (iPhone...) and clients (Mozilla
Thunderbird, etc).
– IBM was talking about it since years behind the curtains
– But we haven't seen a solution yet
– Even a subscribable read-only iCal-Feed of the calendars would be great
– (and better than nothing)
– At the moment: No out-of-the-box solution to give third-party-co-workers
a feed about your calendar data.
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 39
IT Services
Conclusion
30/11/11 Migration to Lotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 40
IT Services
Conclusion
– Don't forget: it's a groupware, not only a mail system
– We're still happy
– We are ready to roll out Lotus Sametime Standard
– What we think about IBM as our provider and implementation partner:
– Flexible, reactive and open minded to our needs
– Robust
– Did you ever loose a redundant SAN?
– But we still agree with Marie Scott (Director of E-mail Services, Virginia
Commonwealth University): “Why do universities like “free, free, free”?” ☺

Migration to Lotus Groupware @ UZH

  • 1.
    30/11/11 Page 1 ITServices Migration to Lotus Groupware @ UZH Implementing IBM Lotus Notes® in a Heterogenous Client Environment Roberto Mazzoni / Roman Meng
  • 2.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 2 IT Services Agenda – Introduction – Challenges, requirements & why IBM Lotus® ? – A technical approach – Overview – IMAP – POP – Lotus Traveler – Lotus iNotes – Multilingual – Conclusion
  • 3.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 3 IT Services UZH - Introduction
  • 4.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 4 IT Services University of Zurich - About – Established 1833, first radices date back to 1525 – The largest university in Switzerland with over 26,000 students (as an International comparison: Oxford: 20,000 students) – Alumni of the University of Zurich include 12 Nobel Prize laureates (W. Röntgen, A. Einstein, E. Schrödinger, K. A. Müller, et al.) – Rated 51 in the “Academic Ranking of World Universities 2010“ – Worldwide rank 38 in “Clinical Medicine and Pharmaceutics” – Worldwide rank 30 in “Life Sciences and Agriculture” – Member of the „League of European Research Universities“ (LERU) – Schrödinger supercomputer ranked 96 in November 2009
  • 5.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 5 IT Services University of Zurich – Mission Statement – pursues scholarly research and teaching and provides related services – strives to provide exceptional quality in these areas and measures itself against the highest international standards – is aware of its responsibility in maintaining and offering a wide range of academic disciplines – grants as high a level of independence and shared responsibility as possible to its students and staff, and promises equal opportunity on all levels – nurtures the intellectual, professional, and personal development of its students and staff – is committed to a participatory management style – offers its staff modern contracts and working conditions
  • 6.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 6 IT Services University of Zurich - Funding – Total income/costs: 1,162,000,000 CHF (2009)
  • 7.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 7 IT Services University of Zurich – Structure – People – including guests approximately 35,000 members – over 26,000 students – approx. 500 professors – approx. 2,700 academic personnel – approx. 2,000 administrative personnel – approx. 800 private lecturers / nominal professors – approx. 2000 assistant lecturers – numerous guests – Decentralized and self-governed – 180 self-governed units – 7 faculties – approx. 150 institutes – about 15 competence centers – numerous associated institutes
  • 8.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 8 IT Services IBM Lotus® @ UZH – History – 2005 – The university's IT strategy retains the evaluation of a groupware containing the usual suspects: e-mail, scheduling, contacts, tasks, mobile synchronization – Opting for document management, synchronous communication, workflows – Replacing the old solution for approx. 35,000 users – 2007 – Open tenders – 2008 – End of evaluation, final decision done by the university management – 2009 – Internal “Going live” with IT services – 2010 – Official “Going live” and migration of the 40'000 users (yes, we found some more...) – 2011 – Closing operations for the project
  • 9.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 9 IT Services Challenges, Requirements & Why IBM Lotus® ?
  • 10.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 10 IT Services Challenges – Faculties/Institutes have very high degree of autonomy in the name of "freedom for research and teaching". – The instruments for the academic usage ranges from magnetic resonance imaging (MRI), super computing up to devices suitable for outdoor use in extreme conditions. (Sounds strange, but believe us... they want them all to collaborate...) – Software needed for academic usage is built on a broad range of operating systems, some of them very exotic. (Do you really believe OS/ 2, AmigaOS or OpenVMS is exotic? Don't even dare...) – Academic work is international, public, interdisciplinary and strongly networked. (like a good MMO...)
  • 11.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 11 IT Services Challenges – The academic user has a very mobile working environment. (you remember the terms “outdoor” and “extreme conditions”?) – Most people work for different Institutes/Faculties/Universities simultaneously and are often sharing a full-time equivalent with other people. (Guess where we found the “other” users, so the headcount went from 35'000 up to 40'000) – High fluctuation due to academic interchange and the nature of academic studies. – Most of them are university graduates... (“No, you can't use this mouse for bio-chemical experiments... It's for your computer...”)
  • 12.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 12 IT Services All these challenges lead us to... – Requirements – Requirements – Requirements – Requirements – Requirements – Requirements – Requirements – Requirements – Requirements – Requirements – Some more requirements
  • 13.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 13 IT Services Free choice & No standard environment – People / institutes don't pay for the service, its free of charge, so they are not obliged to use it. We have to SELL the service with persuasion, so it has to be „good“. – So let's raise the bar, as we have to meet the standards as expected by the users (and provided by the old solution) – High availability from every workplace – Transparent service cloud needed – Scalable & Fast – Disaster-resistent (failover) – No enforcement possible neither for an operating system, a client nor for a version of it – Different deployed version of all (non-lotus) applications – What we try is to “enforce” at least a common “major” version of Lotus Notes
  • 14.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 14 IT Services Free choice & No standard environment – Lotus Notes support for at least the main operating systems – 40 % Microsoft® Windows®, from Windows 2000 to Windows 7 – 40 % Apple® Mac OS, from 9.x to OS X 10.6 – 20 % other, mostly Linux® of various distributions and some exotic ones – Everything available in every bitness or flavour – How to „close the gap“ if no Lotus Notes® is available – Not all systems allow a fat client, in many cases only a light-weight client as an imap-only-client is possible. – Or the OS is simply not supported – Open protocols to support a lot of (native) clients where Lotus Notes/iNotes is not possible or feasible (see later)
  • 15.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 15 IT Services Role centric model – Not only the person is important, but their role is it too and it has to be separable from the person – Need for non personal, shared collaboration resources accessible through access rights – Mailfiles, Calendars, Contacts, Room/Resources, Applications, Databases, etc – Shared Mailbox: That's where mail-in kicks in
  • 16.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 16 IT Services Multilingual – Switzerland alone has 4 languages of the country – Full support for different languages needed – Combined with the role centric model this means that people need to have the possibility to dynamically switch the language – Not only multilingual templates – Multilingual Mailfiles too... – And that dynamically in realtime...
  • 17.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 17 IT Services Openness of data – No vendor lock acceptable – Possibility to extract data after work done needed – Access to data from non proprietary client required – Open protocols (see later) to exchange/extract/import data – Guest users
  • 18.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 18 IT Services Part of the data on foreign systems – It is not possible for the people to have all their data they need for their work on the lotus system. Some data has to be stored on foreign systems – If we want that they use Lotus Notes/iNotes® as a sole system, it will have to support the protocols to access the data on foreign systems. – Example – IMAP Implementation in Lotus Notes... – That's one of the main reasons we can't recommend Lotus Notes as the „one and only“ client
  • 19.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 19 IT Services Interchange with non-lotus-systems needed – The lotus systems have to connect with non-lotus-systems – Open standardized protocols are the key – IMAP/POP3 - standard for mail – iCal – standard to read calendar data – ics - to exchange calendar data in file format – CalDAV - standard for read/write access to calendar data incl. free/busy – CardDAV - upcoming standard for contacts data – SyncML - standard for mobile pim synchronization – ActiveSync - standard for mobile pim synchronization
  • 20.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 20 IT Services Interchange with non-lotus systems needed – And by the way... – „Open Source & Standards are key to making our planet smarter and improving the way we live and work. [...] IBM is an industry leader helping governments move toward greater openness and innovation. Our commitment and perspective on intellectual property, open standards, and open source software emerges from our experience in the marketplace and, equally important, from the direction in which we see information technology taking the larger society.“ – (http://www-03.ibm.com/linux/ossstds/ - Open Source and Standards @ IBM)
  • 21.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 21 IT Services Why Lotus® ? The Clients – Clients – Highly heterogeneous environment at the UZH (→ diversity / autonomy) – Lotus Notes supports a broad client infrastructure at the different release levels – The most important operating systems are supported for the full client – OS X, Windows, Linux – Strategical importance of the web frontend: Lotus iNotes covers basic to advanced functionality for desktop up to mobile computers – Works with a wide range of browser, supported for the most important of them – Open technology
  • 22.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 22 IT Services Why Lotus® ? The Servers – Server infrastructure leaves a very solid and sophisticated impression. (→ high quality) – Scalable! – Most of the time very stable – Also great flexibility in the host operating system for the servers – Extensive documentation – Extension possible with other Lotus products
  • 23.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 23 IT Services Why Lotus® ? – Scope of function / flexibility – Very broad (!) scope of function, very well covered to a great extent – Coverage of demands with regard to „Accessibility“ and „Usability“ (→ equal opportunity) – Potential for closing existing gaps (IMAP implementation, etc.) – Open platform with possibilities for expansion and further development (→ self- management / autonomy) – Costs – Within a 3-5 year perspective with a favorable and transparent cost structure – License model – The university treats all members (~40,000) equally and offers them all the opportunity to use the system (→ equal opportunity) – Flexible offer, well suited to the purposes of the UZH – Supplier as implementation partner
  • 24.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 24 IT Services A technical approach
  • 25.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 25 IT Services Solution Overview The current (simplified) server situation Administration 1 Mail 1 Application 1 Test 1 Development 1 Traveler® 1 IMAP Proxy 1 Sametime® 1 Mail 2 Mail 3 Mail 4 Mail 5 Mail 6 Mail 7 Mail 8 Mail 9 Mail 10 Mail 11 Mail 12 IMAP Proxy 2 Traveler 2 Sametime 2 Application 2 Test 2 Development 2 Test Environment 1 Test Environment 2 Test Environment 3 Intranet Mail Gateways + Anti Virus / SPAM Internet SMTP SMTP SMTP IBM Tivoli® Identity Manager®
  • 26.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 26 IT Services Drawbacks and Opportunities: IMAP Task – Read / Unread, does it matter? (PMR 68612,211,848) – Unread Mark Inconsistency on Server with IMAP – Status: – Closed – SPR – Deleting mails in IMAP leads to incorrect unread marks for new mails (read instead of unread) (PMR 68751,211,8489) – Status: – Closed – Fixed in 8.5.1 via private hotfix – Included in 8.5.2 Mainstream (SPR #TPON7MFEPW)
  • 27.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 27 IT Services Drawbacks and Opportunities: IMAP Task – How to transform that task into a transparent service (cloud)? – External solution with a open-source imap proxy called Perdition (and the nomen wasn't an omen) IP Dispatcher idlperd01 207.48 idlperd02 207.49 Round Robin IP Dispatcher idlmail01.lotus 207.12 imap.lotus pop.lotus 207.6 idlmail02.lotus 207.13 idlmail03.lotus 207.14 idlmail04.lotus 207.15 idlmail05.lotus 207.16 idlmail06.lotus 207.17 idlmail01 207.42 idlmail02 207.43 idlmail01 207.42 idlmail04 207.45 idlmail05 207.46 idlmail06 207.47 idlmail03 207.44 LDAP-Map Perdition IMAP/POP Proxy Lotus Domino® POP/IMAP Port 110,143, 993,995
  • 28.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 28 IT Services Drawbacks and Opportunities: IMAP Task – Challenge: Can you cluster IMAP with Lotus Domino? – Short answer: No – Long answer: Yes, now, after a long ride, you can... – PMR 67789,211,848 – No clustering for IMAP and no possibility to solve it with external solutions. – Development of a solution by IBM – Status: Closed – Private Hotfix in 8.5.1 – Included in 8.5.2 Mainstream (SPR #YDEN7F8HBQ) – So what's the problem? – For IMAP unique ids (UID) are crucial for every client – Without the client looses track – Best Solution: Guarantee on every server the same IMAP UID for the same message (which wasn't and isn't the case) – Problem: UIDs aren't replicated, instead they are generated by every server
  • 29.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 29 IT Services Drawbacks and Opportunities: IMAP Task – The solution IBM provided: If we can't make them the same, at least make sure that they differ – Implementation of IMAP_UIDVALIDITY. If set to a different value on every server, it guarantees that the UIDs are different. – So, when a IMAP client fails over, no UID he knows does exist, so he will download all messages again (drawback), but you get a stable state (opportunity) – We had some problems with customers complaining that they see deleted mail again after a fail-over, but couldn't reproduce these issue. We think these problems are based on other issues.
  • 30.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 30 IT Services Drawbacks and Opportunities: IMAP Task – IMAP Data Corruption – Increasing number of error reports: Note NTxxxx was not updated in the IMAP btree. Corruption of database. – Seems to happen when moving documents from one folder to another in IMAP. – There's even an article about it in the DominoPower Magazine, a quote from it: "IBM sugg (http://www.dominopower.com/issues/issue201004/00002501001.html) – Status: – Open / we never could really track it down – May be fixed in 8.5.2 (Time will tell...) – Delegation of Mailfiles – There is a fine IMAP delegation functionality included in Lotus Domino. – It enables you to access other maifiles via IMAP if you got the rights – It maps it in the folder tree in a new folder called “Other users”
  • 31.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 31 IT Services Drawbacks and Opportunities: IMAP Task – Delegation of Mailfiles – Sadly, it does not work if the mailfile of the access right holder is not present on the same server as the accessed mailfile. – So with about 12 Mailservers and 80'000 Mailfiles we were in trouble, especially as we have a lot of delegations (remember the “role based”?) – The restriction wasn't documented anywhere. And (from a customer view) it doesn't makes sense anyway: Why should you need your own mailfile only to access another mailfile? – We're still in discussion with IBM about this. – Status: – Open – CritSit – Solution tested for 8.5.3
  • 32.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 32 IT Services Minor Pitfalls: POP Task – Ever seen a server sized for 10'000 users (2000 concurrent) going down on its knees with the load of 20 POP Users? – Don't use exact sizes! (we never did) – And even estimated sizes are not enough (we did) – New Notes.ini-Param in 8.5.1FP2: – POP3_List_Size_Estimation=1 – Gives back 40k for every message as size. – The 40k is a fake, but better than intensive number crunching including a take down of the server
  • 33.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 33 IT Services Lotus Traveler – We would have preferred SyncML (Open Standard) – Did you know that 99% of the synchronization inside Lotus Traveler is SyncML? (except ActiveSync) – But we're happy with the current solution as it works for all needed mobile OS – Works like a charm
  • 34.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 34 IT Services Lotus Traveler Population January 2011 Double i-Devices and set Androids > 200 for November 2011
  • 35.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 35 IT Services Lotus Traveler – Now a problem: How to cluster Lotus Traveler and to keep it transparent (as a service)? – You can't do this out-of-the-box, but maybe this could be a working solution for you too: – Flip-Flop with a standby-server. – Caveats: Users will do a prime sync when they flip-flop. But better than nothing. IP Dispatcher idltrav01 207.58 idltrav02 207.59 „Flip Flop“ Lotus Traveler All Ports sync.lotus 207.10
  • 36.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 36 IT Services Lotus iNotes / DominoWebAccess (Webmail) – Same procedure as everywhere else: How to cluster Lotus iNotes and to keep it transparent (as a service)? – We've chosen a simple solution: IP Dispatcher idlmail01 207.42 idlmail02 207.43 idlmail01 207.42 idlmail04 207.45 idlmail05 207.46 idlmail06 207.47 Round Robin IP Dispatcher idlmail01.lotus 207.12 idlmail03 207.44 webmail.lotus 207.5 idlmail02.lotus 207.13 idlmail03.lotus 207.14 idlmail04.lotus 207.15 idlmail05.lotus 207.16 idlmail06.lotus 207.17 idlmail01 207.42 idlmail02 207.43 idlmail01 207.42 idlmail04 207.45 idlmail05 207.46 idlmail06 207.47 idlmail03 207.44 Round RobinRedirect iwaredir.nsf Lotus iNotes Port 80,443
  • 37.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 37 IT Services Multilingual and dynamic – Think about the following situation: – A professor and three assistants share a mailfile – Two of them speak German and English, one only English and the last one only German – Which language template would you apply? – That's one of the reasons for us to have multilingual mailfiles, so the users can choose their language dynamically – PMR #11101,112,848, #11995,112,848 et al. – Hot fix developed by IBM – ENABLE_MULTILINGUAL_FOLDERS=1 & Merger tool for the template – Worked great for the last 7-8 months – We found now a problem with Lotus Traveler which didn't synchronize the inbox anymore by some users. – Included in 8.5.2: SPR #SHEZ6VLEDR, #RGAU7ZXN4T
  • 38.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 38 IT Services CalDAV – De facto standard for synchronizing calendar data – Based on iCal – format – Able to do read/write – access, tasks, busy/free-schedules, etc – Implementation on many devices (iPhone...) and clients (Mozilla Thunderbird, etc). – IBM was talking about it since years behind the curtains – But we haven't seen a solution yet – Even a subscribable read-only iCal-Feed of the calendars would be great – (and better than nothing) – At the moment: No out-of-the-box solution to give third-party-co-workers a feed about your calendar data.
  • 39.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 39 IT Services Conclusion
  • 40.
    30/11/11 Migration toLotus Groupware @ UZH, Roberto Mazzoni / Roman Meng Page 40 IT Services Conclusion – Don't forget: it's a groupware, not only a mail system – We're still happy – We are ready to roll out Lotus Sametime Standard – What we think about IBM as our provider and implementation partner: – Flexible, reactive and open minded to our needs – Robust – Did you ever loose a redundant SAN? – But we still agree with Marie Scott (Director of E-mail Services, Virginia Commonwealth University): “Why do universities like “free, free, free”?” ☺