Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

of

InkSeine: In Situ Search for Active Note Taking Slide 1 InkSeine: In Situ Search for Active Note Taking Slide 2 InkSeine: In Situ Search for Active Note Taking Slide 3 InkSeine: In Situ Search for Active Note Taking Slide 4 InkSeine: In Situ Search for Active Note Taking Slide 5 InkSeine: In Situ Search for Active Note Taking Slide 6 InkSeine: In Situ Search for Active Note Taking Slide 7 InkSeine: In Situ Search for Active Note Taking Slide 8 InkSeine: In Situ Search for Active Note Taking Slide 9 InkSeine: In Situ Search for Active Note Taking Slide 10 InkSeine: In Situ Search for Active Note Taking Slide 11 InkSeine: In Situ Search for Active Note Taking Slide 12 InkSeine: In Situ Search for Active Note Taking Slide 13 InkSeine: In Situ Search for Active Note Taking Slide 14 InkSeine: In Situ Search for Active Note Taking Slide 15 InkSeine: In Situ Search for Active Note Taking Slide 16 InkSeine: In Situ Search for Active Note Taking Slide 17 InkSeine: In Situ Search for Active Note Taking Slide 18 InkSeine: In Situ Search for Active Note Taking Slide 19 InkSeine: In Situ Search for Active Note Taking Slide 20 InkSeine: In Situ Search for Active Note Taking Slide 21 InkSeine: In Situ Search for Active Note Taking Slide 22 InkSeine: In Situ Search for Active Note Taking Slide 23 InkSeine: In Situ Search for Active Note Taking Slide 24 InkSeine: In Situ Search for Active Note Taking Slide 25 InkSeine: In Situ Search for Active Note Taking Slide 26 InkSeine: In Situ Search for Active Note Taking Slide 27 InkSeine: In Situ Search for Active Note Taking Slide 28 InkSeine: In Situ Search for Active Note Taking Slide 29 InkSeine: In Situ Search for Active Note Taking Slide 30 InkSeine: In Situ Search for Active Note Taking Slide 31 InkSeine: In Situ Search for Active Note Taking Slide 32 InkSeine: In Situ Search for Active Note Taking Slide 33 InkSeine: In Situ Search for Active Note Taking Slide 34 InkSeine: In Situ Search for Active Note Taking Slide 35 InkSeine: In Situ Search for Active Note Taking Slide 36 InkSeine: In Situ Search for Active Note Taking Slide 37 InkSeine: In Situ Search for Active Note Taking Slide 38 InkSeine: In Situ Search for Active Note Taking Slide 39 InkSeine: In Situ Search for Active Note Taking Slide 40 InkSeine: In Situ Search for Active Note Taking Slide 41 InkSeine: In Situ Search for Active Note Taking Slide 42 InkSeine: In Situ Search for Active Note Taking Slide 43 InkSeine: In Situ Search for Active Note Taking Slide 44
Upcoming SlideShare
What to Upload to SlideShare
Next
Download to read offline and view in fullscreen.

0 Likes

Share

Download to read offline

InkSeine: In Situ Search for Active Note Taking

Download to read offline

Authors: Ken Hinckley, Shengdong Zhao, Raman Sarin, Patrick Baudisch, Ed Cutrell, Michael Shilman, Desney Tan

Related Audiobooks

Free with a 30 day trial from Scribd

See all
  • Be the first to like this

InkSeine: In Situ Search for Active Note Taking

  1. 1. Ken Hinckley, Shengdong Zhao, Raman Sarin, Patrick Baudisch, Edward Cutrell, Michael Shilman & Desney Tan oronto
  2. 2. In situ search for digital ink  InkSeine :  Ink +  Seine  -n: a fishing net  -v: to fish with a seine  = insanely cool ink search!  InkSeine lets the user fish for useful information directly from ink notes. Fishermen catching salmon on the Columbia River using a seine. (courtesy Wikipedia)
  3. 3. Active note taking  XLibris—pen-based system for active reading (reading + critical thinking + learning)  InkSeine combines pen-based note taking with searching, linking, collecting & sensemaking:
  4. 4. Core interaction pattern: Ink-Search-Gather  Ink – excels at capturing user’s thoughts & ideas with minimum distraction from formatting issues Ink
  5. 5. Ink-Search-Gather interaction pattern  Search – digging through the file system on a tablet is really a pain  Active note taking benefits from low overhead access to supporting materials & related docs  Focus on personal search, but support Web as well Ink
  6. 6. Ink-Search-Gather interaction pattern  Gather – Make it easy to use what you find by pulling content directly into unstructured notes  Thumbnail hyperlinks to documents  Clippings from documents  Queries that can be revisited later Ink
  7. 7. Ink-Search-Gather interaction pattern  InkSeine unifies these three elements in a fluid user experience that is integrated directly with inking Ink
  8. 8. In situ search  Leverage preexisting ink to initiate search  No context switch to “search app” – stay in the flow  No tedious copying of information to a “search box”  Queries as first class objects, commingled with ink notes  Flag some ink for search for later  Visible and salient search history as part of notes  Queries can be copied, pasted, moved, etc.  Interleave inking, searching & gathering  No barrier between inking / searching – note ideas while searching, side-by-side searching, span app boundaries for content gathering  Tightly couple queries with application content  Queries naturally persist in originating context  Easy re-visitation of prior queries  Results of queries become new content
  9. 9. Rich tradeoffs in cost structure of sensemaking  Continuum of time cost – can defer at any point:  1 second: Capture thought “I should search on this”  5 seconds: Trigger search & see initial results list  10s: Open a document from result list, or drag result into notes  10s-30s:  Inspect details of a few results  Apply filters to results  Add a word to the query  Grab a snapshot from a short document  Correct occasional reco errors – but Tablet’s reco is amazingly good!  Longer: sufficient depth for common info needs; not mired by last 10% of complex queries that require full featured search tools  Scroll through longer results lists  Inspect result documents to see if they meet information needs  Sideways searches based on Title, Date, or Author of a result
  10. 10. InkSeine system  VIDEO
  11. 11. Paper Prototype
  12. 12. Paper Prototype
  13. 13. Paper Prototype
  14. 14. Findings  Existing desktop search tool difficult to use  Difficult text entry  Enter and correct text
  15. 15. Findings  Existing desktop search tool difficult to use  Difficult text entry  Enter and correct text  Annoying context switch and flow interruption  Switch among apps and context
  16. 16. Findings  Existing desktop search tool difficult to use  Difficult text entry  Enter and correct text  Annoying context switch and flow interruption  Switch among apps and context  Tedious information gathering  Difficult to link to documents and gather pieces of information
  17. 17. Notebook Control
  18. 18. In Situ Search
  19. 19. Breadcrumb Breadcrumb
  20. 20. Breadcrumb
  21. 21. Trigger Personal Search
  22. 22. Search Panel
  23. 23. Query Area Query Area
  24. 24. Result List Result List
  25. 25. Result List Result List Focus Result
  26. 26. File and Timeline Filters Filters
  27. 27. Gestures for Filters Tap - Select Cross – Multi-select Disjunctive cross – Multi-select Cross & Turn Right – Exclude
  28. 28. Work Flow & Occlusion Selection Correction Search
  29. 29. Work Flow & Occlusion
  30. 30. Work Flow & Occlusion
  31. 31. Crossing Widgets
  32. 32. Resize Search Panel
  33. 33. Examine Document
  34. 34. Document & Tracking Menu
  35. 35. Multiple Search Panels
  36. 36. First Round Observations  Gesture discovery problem
  37. 37. First Round Observations  Gesture discovery problem  Context preservation & occlusion problem
  38. 38. First Round Observations  Gesture discovery problem  Context preservation & occlusion problem  Recognition problem for out-of-vocabulary word UIST List?, Dist?, Gist?, Mist?, Hist? ?
  39. 39. Second Round Observations  Highlighter hints  Smart positioning of search panel  Personalized indexer
  40. 40. Summary  In situ search experience  Optimum workflow / maximum flexibility  Enable rich tradeoffs  Gather content  Minimize search screen real estate  Span application boundaries  Tailored to pen input
  41. 41. Future Directions  Pull in materials for searches from notes
  42. 42. Future Directions  Pull in materials for searches from notes  Support vector-based searches
  43. 43. Questions?

Authors: Ken Hinckley, Shengdong Zhao, Raman Sarin, Patrick Baudisch, Ed Cutrell, Michael Shilman, Desney Tan

Views

Total views

39

On Slideshare

0

From embeds

0

Number of embeds

12

Actions

Downloads

0

Shares

0

Comments

0

Likes

0

×