Lightning Talk from Alfresco DevCon 2019. Overview of an iTime project where I led a small team creating a prototype to automatically file unfiled records.

1. Governance Services
iTime Project:
Automated Filing
Tom Page

2. Learn. Connect. Collaborate.
What Is Filing?

3. Learn. Connect. Collaborate.
What Is Automated Filing?

4. Learn. Connect. Collaborate.
Real Data is Hard
National
Security
Business
Sensitive
Personal
Data

5. Learn. Connect. Collaborate.
Records Documents

6. Learn. Connect. Collaborate.
Planning

7. Learn. Connect. Collaborate.
Data Collection

8. Learn. Connect. Collaborate.
Supervised Learning in One Slide
2. Make model better
3. Check quality
1. Split Data
4. Use!

9. Learn. Connect. Collaborate.
Supervised Learning in One Slide
2. Make model better
3. Check quality
1. Split Data
4. Use!

10. Learn. Connect. Collaborate.
Design
Train Model
Get Suggestions

11. Learn. Connect. Collaborate.
Library Choice
+ One of the above
UI
No UI
Java Other (Python)

12. Learn. Connect. Collaborate.
Weka
+

13. Learn. Connect. Collaborate.
Train: Find most popular site
Test: Guess at that site
Baseline
17.5%

14. Learn. Connect. Collaborate.
Algorithms
Accuracy Train Time
(13k docs)
Test Time
(6k docs)
Can
Update?
k Nearest Neighbours 96% 0 2s Y
Decision Tree (PART) 95% 3s 0 N
Hoeffding Tree 89% 1s 0 Y
Naive Bayes 87% 0 1s Y
Neural Network 75% 15m 10s Y

15. Learn. Connect. Collaborate.
Algorithms
Accuracy Train Time
(13k docs)
Test Time
(6k docs)
Can
Update?
k Nearest Neighbours 96% 0 2s Y
Decision Tree (PART) 95% 3s 0 N
Hoeffding Tree 89% 1s 0 Y
Naive Bayes 87% 0 1s Y
Neural Network 75% 15m 10s Y

16. Learn. Connect. Collaborate.
Kevin Frans
http://kvfrans.com/simple-algoritms-for-solving-cartpole/
In the end, simple methods are
almost always better when
dealing with simple problems.

17. Learn. Connect. Collaborate.
Feature Engineering
cm:createdByUser tpage 361 Identifier
cm:createdAt 2019-01-31T12:59:18 1548939558 Unix Timestamp
Raw Data Feature

18. Learn. Connect. Collaborate.
Feature Engineering
cm:createdByUser tpage 361 Identifier
cm:createdAt 2019-01-31T12:59:18 1548939558 Unix Timestamp
12 Hour of Day
4 Day of Week
cm:name DevCon.pptx DevCon First word
pptx Last word
0,0,0,1,0,0,1,0,... Bag of words
Raw Data Feature

19. Learn. Connect. Collaborate.
Feature Engineering
cm:createdByUser tpage 361 Identifier
cm:createdAt 2019-01-31T12:59:18 1548939558 Unix Timestamp
12 Hour of Day
4 Day of Week
cm:name DevCon.pptx DevCon First word
pptx Last word
0,0,0,1,0,0,1,0,... Bag of words
Raw Data Feature

20. Learn. Connect. Collaborate.
Feature Performance
Author 86%
Created At 59%
Day Of Week 23%
Hour Of Day 29%
First Word 60%
Last Word 34%
MIME Type 30%
File Size 25%
91%

21. Learn. Connect. Collaborate.
Feature Performance
Author 86%
Created At 59%
Day Of Week 23%
Hour Of Day 29%
First Word 60%
Last Word 34%
MIME Type 30%
File Size 25%
91%
97%
Three
guesses

22. Governance Services
iTime Project:
Automated Filing
Thank you!