1. “ IBM ECM
Design Studio
Curation is creation. Creating something
that didn’t exist before, using building
materials that are themselves finished
work. And if you do it right, you’re adding
value in the process.
– Colin Wright, Author
Watson Curator
-dashboard: brief overview
Tina Adams: UX/Visual Design Lead
These are wireframes to get to a proof of concept

2. 2
curation
The selection, preservation, maintenance, collection and
archiving of assets.
Curation establishes, maintains, and adds value to data
for present and future use.

3. 3
why do I need curation?
Curation improves the quality of information and data within your
operational and strategic processes.
Successful digital curation will mitigate digital obsolescence,
keeping your information accessible and relevant indefinitely.

4. 4
our mission
Improve the quality of information and
data within your operational and
strategic processes, significantly
cutting time-to-value .

5. 5personas
By performing their usual activity of classifying
documents, the SME is actually training IBM Watson
Curator in the background, with each document
classification, to accurately auto-classify the next
document in the list.
The SME work will be more consistent and the system
is constantly checking and learning, to be more
accurate with every classification the SME makes,
significantly lessening the work the SME needs to do!
WOW
factor!

6. 6personas
Curt Sloan
curator
Simone Li
subject matter expert
knowledge
skill
knowledge
skill
responsibilities:
• oversees the entire curation process
• assigns docs to SMEs
• researches doc sources
• reviews documents
• publishes final Collections
“I need to ensure the sources are
diverse and plentiful to provide a
viable baseline of data for SME
reviews.”
responsibilities:
• part time contractor
• reviews/vets docs for
accuracy and relevancy
• trains IBM Curator
“I need to ensure the
information is accurate and
current, and I only work part
time, so time is very
important.”
Who
Are the
players?
Pablo Rivera
project lead
knowledge
skill
responsibilities:
• creates new collections
• specifies purpose
“I need to make sure all
curations are created in a timely
manner in order for the Team to
populate asap.”

7. 7personas
step 1
starting a new collection
Building the initial classification taxonomy,
suggestion, and automation criteria.

8. 8personas
Pablo: project lead
Pablo’s Manager notifies him that he
needs to set up a new curation.
task flow:
• log in to Watson Curator dashboard
• reads notification
• create new curation
• enter base criteria for the Curators & SMEs
• adds note for Sunil

9. 9create | populate | vet information
Pablo Rivera
Project Lead
7
notifications
activity within my collections
22%
68
collections
create new view all metrics
curators
>
>
project leads
>
data analysts
>
subject matter experts
7

10. 10
Pablo Rivera
Project Lead
7
notifications
activity within my collections
22%
68
collections
create new view all metrics
curators
>
>
project leads
>
data analysts
>
subject matter experts
7
create | populate | vet information

11. 11
login / view notifications
Pablo Rivera
Project Lead
7
notifications
activity within my collections
22%
68
collections
create new view all metrics
curators
>
>
project leads
>
data analysts
>
subject matter experts
7
7 notifications Sort by: Urgency
urgent
9/16/16 | 12:32pm | Sunil Pradit | Curation: none specified
Hi Jose, please open a new curation for Bone Cancer. I have attached the baseline description information.
____________________________________________________________________________________________________________
newest
9/15/16 | 2:07pm | Sunil Pradit | Curation: Leukemia
Hi Jose, we may need to change one of the curations from last week, I will let you know.
____________________________________________________________________________________________________________
9/16/16 | 12:32pm | Amy Jackson Curation: Hepatitis C
This curation has been closed now.
____________________________________________________________________________________________________________
9/16/16 | 12:32pm | Sunil Pradit | Curation: none specified
Hi Jose, please open a new curation for Liver Cancer. I have attached the baseline description information.
____________________________________________________________________________________________________________
9/16/16 | 12:32pm | Sunil Pradit | Curation: none specified
Hi Jose, please open a new curation for Skin Cancer. I have attached the baseline description information.
____________________________________________________________________________________________________________
create | populate | vet information

12. 12
login / view notifications
Pablo Rivera
Project Lead
7
notifications
activity within my collections
22%
68
collections
create new view all metrics
curators
>
>
project leads
>
data analysts
>
subject matter experts
7
7 notifications Sort by: Urgency
urgent
9/16/16 | 12:32 pm | Sunil Pradit | Curation: none specified
Hi Jose, please open a new curation for Bone Cancer. I have attached the baseline description information.
REPLY:
9/16/16 | 1:02 pm | Pablo Rivera
Hi Sunil, I will have it created by 1:30 today.
____________________________________________________________________________________________________________
newest
9/15/16 | 2:07 pm | Sunil Pradit | Curation: Leukemia
Hi Jose, we may need to change one of the curations from last week, I will let you know.
____________________________________________________________________________________________________________
9/16/16 | 12:32 pm | Amy Jackson Curation: Hepatitis C
This curation has been closed now.
____________________________________________________________________________________________________________
9/16/16 | 12:32 pm | Sunil Pradit | Curation: none specified
Hi Jose, please open a new curation for Liver Cancer. I have attached the baseline description information.
____________________________________________________________________________________________________________
create | populate | vet information

13. 13
Pablo Rivera
Project Lead
7
notifications
activity within my collections
22%
68
collections
create new view all metrics
curators
>
>
project leads
>
data analysts
>
subject matter experts
create | populate | vet information

14. 14
Cancer
My Collections
Pablo Rivera
Project Lead
Liver Cancer
0
1
Collection 1
23,879
Collection 37
6,925
Collection 2
23,879
Collection 3
6,925
Collection 4
78
Collection 5
1,002
Collection 6
276
Collection 7
276
Collection 8
23,879
Collection 9
6,925
Collection 10
78
Collection 11
1,002
Collection 12
276
Collection 13
276
1
1 1
create | populate | vet information

15. 15
Pablo is presented with the Create New Collection
screen where he can define the collection's
preferences.
The Administration tab is in focus with the admin
preferences ready.
This is where Pablo can set the auto-classification
toggle and accuracy levels.

16. NEW COLLECTION
created: 9/19/14 10:06 by: pRivera
last modified: today by: pRivera
documents: 0 new: 0 recertified: 0 excluded: 0
0
Search keywords
New Collection
Administration Monitor
Root folder for collection
Collection language
Classification (facets)
*Bone Cancer
Suggestions accuracy level
Automation accuracy level
80
90
SaveCancel
Cancer: Blood
Cancer: Breast
Cancer: Cervix
Cancer: Colon
Pablo Rivera
Project Lead
Cancer: Ear Canal
Cancer: Esophageal
Cancer: Gallbladder
Cancer: Kidney
Cancer: Larynx
Cancer: Nasopharynx
Cancer: Ovarian
Cancer: Pancreatic
Categories Bone
>
Collection ID
Scope
Description
Purpose
Expiration 01/01/16 12:00 pm
Cancer Type x
Treatment type x
Symptoms x
Prognosis x
Automation on
Multiselection on
Assign Curator
16create | populate | vet information

17. 17
After all the preferences are set for the new
collection, Pablo notifies the Curator via the
notification tab.
The main fields are auto-populated and Jose
just needs to assign a Curator and hit Send.
(description optional)

18. Bone Cancer
created: 9/19/14 10:06 by: pRivera
last modified: today by: pRivera
documents: 0 new: 0 recertified: 0 excluded: 0
0
Search keywords
Administration
The Collection: Bone Cancer, has been created for your team
Enter details of message here, or leave blank.
Link to collection: Bone Cancer
SendCancel
auto-populated
auto-generated
New Collection
Pablo Rivera
Project Lead
Enter Curator name or dropdown for most recentSelect a Curator
i
Monitor Assign Curator
18create | populate | vet information

19. Bone Cancer
created: 9/19/14 10:06 by: pRivera
last modified: today by: pRivera
documents: 0 new: 0 recertified: 0 excluded: 0
0
Search keywords
Administration
The Collection: Bone Cancer, has been created for your team
Enter details of message here, or leave blank.
Link to collection: Bone Cancer
SendCancel
auto-populated
auto-generated
New Collection
Pablo Rivera
Project Lead
Sunil Pandit
Anna Akhtar
Jen Parker
Ari Sarkesian
Enter Curator name or dropdown for most recentSunil Pandit
i
Monitor Assign Curator
19create | populate | vet information

20. 20
There is an Info slider that Pablo can select
that shows him contextual info for each screen
and he can link to relevant product doc for
that screen on the web.

21. Bone Cancer
created: 9/19/14 10:06 by: pRivera
last modified: today by: pRivera
documents: 0 new: 0 recertified: 0 excluded: 0
0
Search keywords
Administration
The Collection: Bone Cancer, has been created for your team
Enter details of message here, or leave blank.
Link to collection: Bone Cancer
SendCancel
auto-populated
auto-generated
New Collection
Pablo Rivera
Project Lead
Enter Curator name or dropdown for most recentSunil Pandit
i
Monitor Assign Curator
21create | populate | vet information

22. Bone Cancer
created: 9/19/14 10:06 by: pRivera
last modified: today by: pRivera
documents: 0 new: 0 recertified: 0 excluded: 0
0
Search keywords
Administration
The Collection: Bone Cancer, has been created for your team
Enter details of message here, or leave blank.
Link to collection: Bone Cancer
SendCancel
auto-populated
auto-generated
New Collection
Pablo Rivera
Project Lead
Enter Curator name or dropdown for most recentSunil Pandit
i
Monitor Assign Curator
22
Assign a Curator to your
collection.
Description is optional
and not required.
A link will be auto-
generated to this
collection for your
Curator.
more info
expanded
ii
create | populate | vet information

23. 23
step 2
managing collection activity
Overseeing collection activity,
taxonomy progress, and engaging
Subject Matter Experts.

24. 24personas
Curt: curator
Nick clicks on the New
Collection link in his
dashboard,and is taken
to the curation
population screen.
He can now start to
add documents (or can
have others add
documents) to the
collection.

25. 25
Curt Sloan
Curator
1
notifications
activity within my collections
78%
135
collections
view new view all metrics
curators
>
>
project leads
>
data analysts
>
subject matter experts
5
1
1
create | populate | vet information

26. 26
Curt Sloan
Curator
1
notifications
activity within my collections
78%
135
collections
view new view all metrics
curators
>
>
project leads
>
data analysts
>
subject matter experts
1
1
create | populate | vet information

27. 27
Curt is taken to the Curator view of the new collection
called Bone Cancer and is presented with all
possibly relevant files in the local and hosted
systems (auto-collected when Pablo saved the new
collection) that may be relevant to that collection.
Curt can choose to select some or all to add to the
collection for the SME to review. He chooses all and
saves the new collection.

28. 28
Curt Sloan
Curator
New Documents (562) For Curation (0) Excluded (0)
Bone Cancer
created: 9/19/14 10:06 by: pRivera
last modified: today by: cSloan
documents: 0 new: 562 recertified: 0 excluded: 00
Curated (0)
Search by categories
name
Study of Bone D...
Cancer Researc...
Pathology of Bo...
Stanford Medic...
Clevelanc Clini...
University of M...
Holistic Resear...
Boston Medica...
Interaction of C...
Treatments of ...
Bone Density ...
Symptoms of ...
Study of Holi...
classification
Dissease
Dissease
Symptoms
Dissease
Treatment type
Dissease
Dissease
Symptoms
Prognosis
Treatment type
Dissease
Symptoms
Symptoms
path
/My_folder
/xyz
/results
/My folder
/My folder
/My folder
/xyz
/results
/results
/results
/results
/results
/xyz
server
Local
Local
Local
Local
Local
Local
Local
Local
Local
Local
categories
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Search by name
Search by source
Search by classification
Search by categories
Search by path
Search by server
Filter by doc type
treatment
Chemotherapy...
Chemotherapy
Surgical Remo...
Chemotherapy...
Surgical Remo...
Chemotherapy
Surgical Remo...
Chemotherapy
Surgical Remo...
Chemotherapy
symptoms
Lesions...
Breakage, Pain
Pain
Lesions
Breakage
Lesions, Pain
Lesions, Pain
Breakage, Les...
Pain, Lesions...
SaveCancel
1
2
3
4
5
6
7
8
9
10
11
12
13
create | populate | vet information

29. 29
Curt Sloan
Curator
New Documents (562) For Curation (0) Excluded (0)
Bone Cancer
created: 9/19/14 10:06 by: pRivera
last modified: today by: cSloan
documents: 0 new: 562 recertified: 0 excluded: 00
Curated (0)
Search by categories
name
Study of Bone D...
Cancer Researc...
Pathology of Bo...
Stanford Medic...
Clevelanc Clini...
University of M...
Holistic Resear...
Boston Medica...
Interaction of C...
Treatments of ...
Bone Density ...
Symptoms of ...
Study of Holi...
classification
Dissease
Dissease
Symptoms
Dissease
Treatment type
Dissease
Dissease
Symptoms
Prognosis
Treatment type
Dissease
Symptoms
Symptoms
path
/My_folder
/xyz
/results
/My folder
/My folder
/My folder
/xyz
/results
/output
/results
/results
/results
/xyz
server
Local
Local
Local
Local
Local
Local
Hosted
Local
Local
Local
categories
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Cancer: Bone
Filter by doc type?
treatment
Chemotherapy...
Chemotherapy
Surgical Remo...
Chemotherapy...
Surgical Remo...
Chemotherapy
Surgical Remo...
Chemotherapy
Surgical Remo...
Chemotherapy
symptoms
Lesions...
Breakage, Pain
Pain
Lesions
Breakage
Lesions, Pain
Lesions, Pain
Breakage, Les...
Pain, Lesions...
SaveCancel
1
2
3
4
5
6
7
8
9
10
11
12
13
create | populate | vet information

30. 30
Curt now needs to assign an SME.
On Save, Curt is automatically taken to the
Collections view in the mew collection, where he
chooses the Assign tab and assigns Simone Li as
the Curator and leaves her a note.

31. 31
Bone Cancer
created: 9/19/14 10:06 by: pRivera
last modified: today by: cSloan
documents: 462 new: 30 recertified: 0 excluded: 70
462
Search keywords
My Collections
Administration Review Monitor Assign SME
The Collection: Bone Cancer, has been created for you (30 for review)
Simone Li
Simone,
I have assigned you as the main SME for this new Bone Cancer collection.
We will need this populated by mid March.
Let me know if you have any questions.
-Curt
Link to collection: Bone Cancer
SendCancel
auto-populated
auto-generated
Curt Sloan
Curator
Mumtaz Ahmet
Dave Andress
Simone Li
Steven Miller
Diane Timmons
Ahmet Zappa
create | populate | vet information

32. 32
Curt is able to see the collection history by
selecting a collection and viewing the
Collection History.
When he selects an individual event in the
visualization history, he can see all the details
about that event.

33. 33
Cancer
0
Cancer
1
My Collections
Colon Cancer
6,925
Lymphatic Cancer
78
Pancreatic Cancer
1,002
2
Skin Cancer
276
Breast Cancer
23,879
Colon Cancer
6,925
Lymphatic Cancer
78
Pancreatic Cancer
1,002
Throat Cancer
276
Throat Cancer
276
Breast Cancer
23,879
Colon Cancer
6,925
Lymphatic Cancer
78
Pancreatic Cancer
1,002
Throat Cancer
276
Throat Cancer
276
1 1 1
Breast Cancer
23,879
1
Curt Sloan
Curator
create | populate | vet information

34. 34
Cancer
0
Cancer
1
My Collections
Colon Cancer
6,925
Lymphatic Cancer
78
Pancreatic Cancer
1,002
2
Skin Cancer
276
Breast Cancer
23,879
Colon Cancer
6,925
Lymphatic Cancer
78
Pancreatic Cancer
1,002
Throat Cancer
276
Throat Cancer
276
Breast Cancer
23,879
Colon Cancer
6,925
Lymphatic Cancer
78
Pancreatic Cancer
1,002
Throat Cancer
276
Throat Cancer
276
1 1 1
Breast Cancer
23,879
1
Curt Sloan
Curator
Breast Cancer
Created
created: 9/11/13 by: pRivera
reddy
Modified
modified: 9/11/13 by: cSloan
Modified
created: 9/12/13 by: aLi
Notification to SME
emailed: 9/14/13 by: sLi | read on: 9/15/14 by: cSloan, vReddy
DE addition
578 additions: 9/14/13 by: cReddy
Notification to DE
emailed: 9/12/13 by: cSloan | read on: 9/12/14 by: vReddy
>
38% complete
create | populate | vet information

35. 35
step 3
SME input
Classifying documents in a collection:
a. without auto-classification
b. with auto-classification

36. 36personas
Simone: sme
Simone logs into her
dashboard and is
brought to her
dashboard.
She sees that she
has a new collection
waiting, and she
clicks the section.

37. 37
3
notifications
12
batches
activity
17%
5
collections
Simone Li
SME
my ranking
CONGRADULATIONS!
You reached Bronze on 2/07/14!
To reach Silver, you need:
846more Collection additions
and...
12more Collections!
See my stats.
subject matter experts
>
>
3
curators
my teams
3
data analysts
create | populate | vet information

38. Simone Li
SME
Bone Cancer
0
Cancer
1
Collection 1
23,879
Collection 37
6,925
Collection 2
23,879
Collection 3
6,925
Collection 4
78
1 1
3
38
3
create | populate | vet information

39. Simone Li
SME
Bone Cancer
created: 9/19/14 10:06 by: pRivera
last modified: today by: cSloan
documents:0 new: 562 recertified: 0 excluded: 0
0
Upload New
Treatment Type >
Symptoms >
Search keywords
Page < 1 2 3 …..75 > UMDMJ-NJMS, Dept of Pathology
i
Document 1
Source: UMDMJ-NJMS...
Document 2
Source: Sloan Kettering
Document 3
Source: Johnson & ...
Document 4
Source: Sloan-Kettering
Document 5
Source: Korean Society o...
Document 6
Source: Stanford Medical...
Document 7
Source: VA Medical
Showing 1-7 of 562
Review (562)
Cancer: Bone
Cancer: Bone marrow
Cancer: Bone tumor
Submit new
Bone
39
Cancer Type >
3
All documents

40. 40
Four hours have passed and Simone
is only on the 4th document out of
562, and has made little progress.
Simone doesn’t have much more time
to dedicate to this today.

41. Simone Li
SME
Bone Cancer
created: 9/19/14 10:06 by: pRivera
last modified: today by: cSloan
documents:0 new: 557 recertified: 0 excluded: 1
0
Upload New
Search keywords
Page < 1 2 3 …..75 > UMDMJ-NJMS, Dept of Pathology
i
Showing 1-7 of 562
Review (557)
41
7
Document 1
Source: UMDMJ-NJMS...
Document 2
Source: Sloan Kettering
Document 3
Source: Johnson & ...
Document 4
Source: Sloan-Kettering
Document 5
Source: Korean Society o...
Document 6
Source: Stanford Medical...
Document 7
Source: VA Medical
Cancer Type >
Treatment Type >
Symptoms >
Lesions
Metastases
Weakness
Fever
Submit new
All documents
create | populate | vet information

42. 42
Let’s look at Simone’s same scenario
with auto-processing enabled.
Since auto-processing is now on, only 30 documents (out
of 562) have been classified by Watson Curator as low
confidence, and need confirmation from Simone.
She should be done with this collection by the end of the
week, instead of in five weeks!

43. Simone Li
SME
Bone Cancer
created: 9/19/14 10:06 by: pRivera
last modified: today by: cSloan
documents: 500 new: 30 recertified: 0 excluded: 32
0
Upload New
Search keywords
Page < 1 2 3 …..75 > UMDMJ-NJMS, Dept of Pathology
i
Showing 1-7 of 562
Review (30)
43
7
Document 1
Source: UMDMJ-NJMS...
Document 2
Source: Sloan Kettering
Document 3
Source: Johnson & ...
Document 4
Source: Sloan-Kettering
Document 5
Source: Korean Society o...
Document 6
Source: Stanford Medical...
Document 7
Source: VA Medical
Cancer Type >
Treatment Type >
Symptoms >
Lesions
Metastases
Weakness
Fever
Submit new
All documents
create | populate | vet information

44. Simone Li
SME
Search keywords
Page < 1 2 3 …..75 > UMDMJ-NJMS, Dept of Pathology
44
7
Dissease Type
Treatment Type
Symptoms
Submit new
Submit new
Submit new
Bone
chemotherapy
Immunology
Stem Cell
Surgical removal
Transplant
Lesions
Metastases
Weakness
Fever
Nausea
Breakage
Lethargy
Pain
Aching
Insomnia
Swelling
High blood pressure
High white cell count

45. 45universal rule
Users need accurate and efficient auto-
classification in order to maintain collection
integrity, and to direct their attention to only
those documents that need human review in
order to promote the collection for use in a
timely manner.