Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Search Me: Designing Information Retrieval Experiences


Published on

This case study reviews the methods and insights that emerged from an 18-month effort to coordinate and enhance the scattered user experiences of a suite of information retrieval tools sold as services by an investment ratings agency. The session will share a method for understanding user needs in diverse information access contexts; review a collection of information retrieval patterns such as enterprise search and information access, service design, and product and platform management; and consider the impact of organizational and cultural factors on design decisions.

Published in: Business, Technology
  • DOWNLOAD FULL BOOKS, INTO AVAILABLE FORMAT ......................................................................................................................... ......................................................................................................................... ,DOWNLOAD FULL. PDF EBOOK here { } ......................................................................................................................... ,DOWNLOAD FULL. EPUB Ebook here { } ......................................................................................................................... ,DOWNLOAD FULL. doc Ebook here { } ......................................................................................................................... ,DOWNLOAD FULL. PDF EBOOK here { } ......................................................................................................................... ,DOWNLOAD FULL. EPUB Ebook here { } ......................................................................................................................... ,DOWNLOAD FULL. doc Ebook here { } ......................................................................................................................... ......................................................................................................................... ......................................................................................................................... .............. Browse by Genre Available eBooks ......................................................................................................................... Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult,
    Are you sure you want to  Yes  No
    Your message goes here
  • Best one
    Hope you are in good health. My name is AMANDA . I am a single girl, Am looking for reliable and honest person. please have a little time for me. Please reach me back so that i can explain all about myself .
    Best regards AMANDA.
    Are you sure you want to  Yes  No
    Your message goes here
  • Hi Joe - This is a fantastic presentation. I appreciate your sharing this. I would like to go over it a couple of times to understand this better. Would you be willing to share it? I can understand if you do not wish to. My contact address is
    Are you sure you want to  Yes  No
    Your message goes here
  • NICE presentation. Timely for our class MLIS 203 Information Retrieval. Could I have a copy of it? Thanks a lot IN ADVANCE...
    Are you sure you want to  Yes  No
    Your message goes here
  • @timokouwenhoven thanks much for the compliment! what have some of your experiences been? what sort of engagements were you involved with?
    Are you sure you want to  Yes  No
    Your message goes here

Search Me: Designing Information Retrieval Experiences

  1. 1. Designing the Experience of Information Retrieval
  2. 2. Joe Lamantia Strategic Planner & Experience Architect 15 years: design, technology, business write & speak : user experience – ubicomp @mojoe
  3. 4. Today’s Menu <ul><li>Situation </li></ul><ul><li>Understanding Audiences </li></ul><ul><li>Modes </li></ul><ul><li>Patterns </li></ul><ul><li>Lifecycles </li></ul><ul><li>Structures </li></ul><ul><li>(Really) Understanding Audiences </li></ul>
  4. 5. The Situation
  5. 6. Surveyor Project Profile <ul><li>Client: Leading Provider of Credit Ratings, Research and Risk Analysis for Fixed-Income Securities and Other Obligations </li></ul><ul><li>Business Need: Evolve the website into a more compelling information delivery environment that is superior to competitor sites, promotes the company’s overall business objectives, and meets the needs of business users, shareholders, issuers and investors </li></ul><ul><li>Strategic Goals </li></ul><ul><ul><li>Usability : Identify usability issues and recommend areas of improvement to ensure that customers and stakeholders will use it because they want to, not because they have to </li></ul></ul><ul><ul><li>Scalability : Define a site architecture that is clearly capable of supporting future increases in user base and functional capability </li></ul></ul><ul><ul><li>Flexibility : Define a site structure that allows for functional enhancements to made easily within a reasonable time-to-market </li></ul></ul><ul><ul><li>Reliability : Verify that the right architectural components, monitoring tools and operational practices are being used to ensure that the site is stable and continues to run smoothly </li></ul></ul><ul><ul><li>Manageability : Develop a build vs. buy strategy that makes the most efficient use of internal resources </li></ul></ul>Partnership with Keane Information Collection and Business Process Transformation
  6. 7. Current Limitations Barriers to Ratings and Research Expansion <ul><li>Clients can only realize the value of Client research if they can find it </li></ul><ul><li>Business Impacts </li></ul><ul><li>Detracts from the value of Client ratings and research </li></ul><ul><li>Limits ability to attract and retain “non-captive” customers in new markets </li></ul><ul><li>User Issues </li></ul><ul><li>Ineffective Basic & Advanced Search </li></ul><ul><li>No document cross-referencing </li></ul><ul><li>Ability to browse content tedious at best </li></ul> “quick search” for “British Air”; no search results found ! “ Quick search” by “Ticker” for BAY.L; no search results found ! “ You have to know what you’re looking for” — Senior Credit Analyst, AIG Global Investment Group Example Scenario: Search for Relevant Research Senior Credit Analyst Advanced Search; non-intuitive interface ! Leaves and finds desired content on competitor’s website !
  7. 8. Problem Example: Barriers to Value Perception “ I’ll go to (a competitor’s site) first, then I’ll go to (the company’s) if I have the time…” — Director, Global Ratings Advisory Detail page contains assorted links and tabs; content not on one page ! Related Research tab shows a seemingly random list of assorted documents ! Research is split across a number of ill-defined doc types, published at different times ! Goes to competitor’s site first, because competitor’s site is easier to use ! A poor user experience lowered perceptions of Client Example Scenario: View Latest Research Ratings Advisory <ul><li>User Issues </li></ul><ul><li>Research content is inconsistent </li></ul><ul><li>Related research functions are ineffective </li></ul><ul><li>Sites are difficult for users to understand and navigate </li></ul><ul><li>Business Impacts </li></ul><ul><li>Hampers deepening of relationships with established clients </li></ul><ul><li>Detracts from the company’s reputation as an authoritative source of high quality info </li></ul>
  8. 9. Information Retrieval Goals and Recommendations <ul><li>Recommendations </li></ul><ul><li>Develop an information taxonomy and ontology </li></ul><ul><li>Extend metadata collection </li></ul><ul><li>Implement a robust search architecture </li></ul><ul><li>Build user-centric search interfaces </li></ul><ul><li>Goals </li></ul><ul><li>Provide enhanced support for related research identification and retrieval </li></ul><ul><li>Implement robust document and content categorization to enable more effective keyword searches </li></ul><ul><li>Enable efficient topical searching of all documents and content </li></ul><ul><li>Develop advanced search capabilities that align to industry best practices </li></ul>
  9. 10. Information Retrieval Build User-Centric Search Interfaces Integrated and full-featured search interfaces will increase the effectiveness of Client search N/A N/A Current State Future State Search Suggestions (i.e. Did you mean?) Matching Issuers (grouped by business line) Matching Research (Document Title) Matching Research (Full Text) Other Matches (i.e. site content, products, etc…) Search Results Did you mean? Refine Search Save Search Modify Alerts Matching Issuers Matching Research Other Results Suggest Alternate Searches Provides alternate search terms such as corrections of CRSspelled words Group Results Provides user with context to help interpret result sets <ul><li>Integrate Results </li></ul><ul><li>Improves usability of the search interfaces </li></ul><ul><li>Increases the probability of finding the desired result </li></ul><ul><li>Provide Other Matches </li></ul><ul><li>Includes non-research document content such as Rating Definitions eliminating need for users to know what content is and is not searched </li></ul><ul><li>Support Derivative Actions </li></ul><ul><li>Allows refinement of search criteria based on initial results </li></ul><ul><li>Enables saving search criteria for future use </li></ul><ul><li>Provides framework to modify alerts preferences based on search results (and/ or setup RSS feeds) </li></ul>
  10. 11. 36-Month Roadmap Phase 3: Integration & Flexibility Phase 2: Consolidation & Scalability Phase 1: Foundation & Usability Track 1: Information Retrieval Track 2: Unified Service Delivery Track 4: Governance Architecture, Design, & Vendor Selection Search Baseline POC Metadata Collection Baseline Taxonomy/Metadata Mgmt. Baseline Taxonomy/Metadata Mgmt. Automation Support Metadata Collection Automation Support Search Term Expansion Aggregated Market-Centric Pages Track 3: Global Site Support UE Diff. UE POC Site Architecture & Design Core Web Site Implementation Country/Lang Selector Affiliate Integration Support Improved Local Language Support Migration Planning Data Architecture Foundation Imp. Product Migration Migration Planning Global Site Migration Taxonomy/Metadata Mgmt. Social Tagging Search Key Identification Metadata Collection Social Tagging Ongoing Governance & Oversight Product Lifecycle Process Improvement UE Governance Arch Governance Tax./Ont. Governance Content/Publication Governance Governance Planning
  11. 12. What Were We Supposed to Do? <ul><li>The Surveyor resulted in a series of recommendations and a roadmap for implementation; the projects discussed in this case study focused on the highlighted objectives </li></ul>Track 1: Information Retrieval Projects focused on making it easier for Client’s customers to find information on Track 4: Governance Projects and ongoing oversight focused on establishing and maintaining quality, consistency, and integration across and the products Track 3: Global Site Support Projects focused on supporting international growth by extending features to regional sites Track 2: Unified Service Delivery Projects focused on improving the usability, scalability, and flexibility of <ul><li>Redesign the UI and structure </li></ul><ul><li>Integrate research, data, and analytical tools </li></ul><ul><li>Consolidate & standardize content presentation </li></ul><ul><li>Integrate regional/localized sites with </li></ul><ul><li>Implement a high quality search capability </li></ul><ul><li>Implement a reusable services-based architecture </li></ul><ul><li>Standardize the way data is published to </li></ul><ul><li>Establish empowered site oversight groups </li></ul><ul><li>Implement streamlined product lifecycle governance </li></ul>Objectives Roadmap
  12. 13. Understanding Audiences
  13. 14. Audience Scope <ul><li>Address the full spectrum of global finance </li></ul><ul><ul><li>Worldwide and real time </li></ul></ul><ul><ul><li>All activities & topics </li></ul></ul><ul><li>700,000 documents </li></ul><ul><ul><li>Refresh 1000 / day </li></ul></ul><ul><ul><li>Diverse formats; pdf, doc, txt </li></ul></ul><ul><li>Millions of data points (ratings) </li></ul><ul><ul><li>Qualitative and quantitative </li></ul></ul><ul><li>25 Services & products on-line </li></ul><ul><ul><li>Combining documents and data </li></ul></ul><ul><ul><li>Business intelligence, analysis / synthesis capabilities </li></ul></ul><ul><li>Multiple delivery channels </li></ul><ul><ul><li>Web applications, desktop applications, data feeds, document repository, web repository </li></ul></ul><ul><li>Diverse customers </li></ul><ul><ul><li>100,000 users </li></ul></ul><ul><ul><li>All perspectives </li></ul></ul>
  14. 15. Understanding Experiences <ul><li>Why are people here? </li></ul>
  15. 16. Understanding Experiences <ul><ul><li>“ To retrieve information” </li></ul></ul>
  16. 17. Understanding Experiences <ul><li>What are people doing? </li></ul>
  17. 18. Understanding Experiences <ul><ul><li>“ Retrieving information” </li></ul></ul>
  18. 19. Design Research
  19. 20. Understanding User Goals Read operating guidelines Review installation instructions Scan technical support requests Review technical specifications Raw Goals
  20. 21. Understanding User Goals Root Goal Review “ To examine in detail”
  21. 22. User Goals <ul><li>To Assess means to make a judgement or decision about, considering relevant factors </li></ul><ul><li>To Compare means to review the similarities and differences of two or more examples of the same type of thing by looking at them in detail </li></ul><ul><li>To Find means to learn the location and status of </li></ul><ul><li>To Identify means to distinguish by the use of specific criteria </li></ul><ul><li>To Locate means to become aware of where and how a thing may be found, and / or contacted. </li></ul>
  22. 23. User Goals <ul><li>To Monitor means to track the status and location of </li></ul><ul><li>To Obtain means to acquire and retain for other purposes </li></ul><ul><li>To Review means to examine in detail </li></ul><ul><li>To Save means to store and keep </li></ul><ul><li>To See means to be presented with in a manner that makes assumed relationships or characteristics apparent </li></ul><ul><li>To Understand means to consider all available points of view or sources of information on a topic / item / situation, and formulate an opinion and frame of reference for one’s own purposes. </li></ul>
  23. 24. Concept Maps
  24. 25. Understanding User Goals Analyst report Issuer Rating Country Information Objects Security Insurer Rating Type
  25. 26. Understanding User Goals Concrete Goal “ Root goal + [information object]” Review ratings Review issuers Review securities Review reports Review rating types
  26. 27. User Goals
  27. 28. User Needs
  28. 29. “ Personas”
  29. 30. Audiences Group 1 Client Customers <ul><li>Group 1 Needs/Goals: </li></ul><ul><li>Personalized content offered before search </li></ul><ul><li>Balanced portfolio of finding tools </li></ul><ul><li>Stable destinations for common IR scenarios </li></ul><ul><li>Monitoring and syndication capabilities to support internal workflows, processes </li></ul><ul><li>Group 1 Key Opportunities: </li></ul><ul><li>Reduce reliance on search behavior and functionality for all IR needs </li></ul><ul><li>Present commonly needed items on homepage and throughout site </li></ul><ul><li>Create destinations supporting IR scenarios for related items, common focuses </li></ul>Information needs range from constant monitoring of activity to semi-annual gathering of slow cycle publications
  30. 31. Audiences Group 2 Client Users (non-paying) <ul><li>Group 2 Needs/Goals: </li></ul><ul><li>Satisfy diverse IR needs that do not support credit buy/ sell decisions </li></ul><ul><li>Understand range and value of capabilities and offerings to support future purchase decisions </li></ul><ul><li>Monitor Client responses to events and outside activities </li></ul><ul><li>Group 2 Key Opportunities </li></ul><ul><li>Introduce componentized offerings to increase conversion </li></ul><ul><li>Cross-reference content and offerings </li></ul><ul><li>Tailored account types and access levels to increase user experience quality for specialist imperatives (regulatory) </li></ul>Access to limited types of information is needed on regular basis
  31. 32. Client Services Group 3 <ul><li>Client Services Needs/Goals </li></ul><ul><li>Rapid and effective IR capability spanning all Client offerings </li></ul><ul><li>Call management integrated with publishing, other metadata </li></ul><ul><li>Case management capability </li></ul><ul><li>Client Services Key Opportunities </li></ul><ul><li>Integrate customer service and account management processes (update user profiles while talking) </li></ul><ul><li>Focused tools for specialized IR needs </li></ul>Access to all types of information is needed at every moment of every day
  32. 33. Client Analysts Group 4 <ul><li>Analysts Needs/Goals </li></ul><ul><li>Easy access to research written by other Client analysts </li></ul><ul><li>Views of underlying data to support analysis when talking with customers </li></ul><ul><li>Ability to monitor publications on topics and industries related to their expertise </li></ul><ul><li>Analysts Key Opportunities </li></ul><ul><li>Change perceptions of IR effectiveness by creating focused tools for specialized IR needs </li></ul><ul><li>Create focused tools for other job needs, such as document management </li></ul><ul><li>Provide cross-reference capabilities </li></ul>Access to all types of information is needed at every moment of every day
  33. 34. IR Requirements
  34. 35. Understanding Experiences <ul><li>How are they doing __? </li></ul>
  35. 36. Modes
  36. 37. Modes <ul><li>“… a broad but identifiable literary method, mood, or manner that is not tied exclusively to a particular form or genre.” </li></ul>
  37. 38. <ul><li>4 Modes of Information Retrieval </li></ul><ul><li>Seeking & Finding </li></ul><ul><li>Visiting Stable Destinations </li></ul><ul><li>Monitoring </li></ul><ul><li>Taking Delivery </li></ul>
  38. 39. Seeking & Finding <ul><li>Seeking & Finding </li></ul><ul><li>The seeking mode focuses on traditional searching, but includes other activities such as narrowing sets using cumulative parameters, finding with/in faceted systems. </li></ul><ul><li>The key characteristic of seeking mode is that, users bring the situations and contexts (like search results) they encounter into existence by seeking them out. </li></ul><ul><li>When seeking, users encounter fluid destinations within the larger information environment based on what they are looking for, and how they are looking for it. </li></ul><ul><li>A classic example of seeking mode is a user who poses an ad-hoc query via a search interface, and sorts through the list of search results returned in response. </li></ul>Seeking & Finding
  39. 40. Seeking & Finding <ul><li>Seeking & Finding </li></ul><ul><li>Finding could take the form of active searching by posing queries to a search-style input experience. </li></ul><ul><li>Finding could also take the form of refining a list of potentially useful items based on facets of the content. </li></ul><ul><li>Users may not know in advance what finding activities will yield. </li></ul><ul><li>Users may receive a set of search results that includes many different types of items, from many different authors or content sources that conceptually relate to what they began looking for based on mappings of terms and concepts. </li></ul>Seeking & Finding
  40. 41. Destinations <ul><li>Visiting Stable Destinations </li></ul><ul><li>When visiting stable destinations, users encounter stable places within the information environment that exist regardless of the user's activities. </li></ul><ul><li>Destinations will offer users a set of things they know in advance and expect to encounter. Persistence could be conceptual only, reflected in navigation elements, or made part of the user experience via any number of mechanisms. </li></ul><ul><li>All destinations have a focus of some kind, such as a topic, or product, or event, and may be defined by the intersection of several focuses, such as products or documents created by one person that are related to a topic or event. </li></ul>Visiting Stable Destinations
  41. 42. Destinations <ul><li>Visiting Stable Destinations </li></ul><ul><li>Destinations could take the form of pages that assemble content, research, ratings, and functionality either dynamically based on business rules and profile information or manually selected by staff or the users. </li></ul><ul><li>Destinations will likely change based on business rules and user context, as well as changes in the items available within the environment. </li></ul><ul><li>A good example of a stable destination is the Arts page of the New York Time online; the articles and the art they concern change constantly, yet users know what to expect when they visit. The page is a visible part of the environment conceptually (as a category) and in terms of navigation, and is easily accessible directly from outside the environment. </li></ul>Visiting Stable Destinations
  42. 43. Monitoring Monitoring
  43. 44. Monitoring <ul><li>Monitoring </li></ul><ul><li>Monitoring effectively extends the user experience and information retrieval capabilities beyond the boundaries of the originating environment, and allows users to know in advance what they will find or encounter when they enter the environment. </li></ul><ul><li>For example, a user may wish to monitor the publications concerning an issue in their portfolio; while the contents of new publications would vary, every notification they receive would concern a known issue. </li></ul><ul><li>Monitoring requires messages or communication tokens, commonly email, RSS, or SMS, but could take many other forms as well. </li></ul>Monitoring
  44. 45. Delivery <ul><li>Delivery </li></ul><ul><li>In this mode, users do not have to enter the environment at all to retrieve information, enabling them to further goals without increasing acquisition costs or effort. </li></ul><ul><li>Delivery could take the form of packages of documents or other content dispatched to users via numerous channels, such as RSS, email, SMS, etc. </li></ul><ul><li>Receiving delivered items is the least active mode we defined for users, allowing them to retrieve information without actively seeking, visiting a destination, or monitoring the environment. </li></ul><ul><li>Good examples of delivered information are the iconic stock ticker, RSS feeds for blog postings, and email publications. </li></ul>Delivery
  45. 46. Monitoring Seeking Visiting Stable Destinations Delivery Fluidity Activity
  46. 47. Scenarios
  47. 48. Scenarios <ul><li>Forward looking </li></ul><ul><li>Narrative </li></ul><ul><li>Communicate Vision </li></ul><ul><li>Speaks local language </li></ul><ul><li>Persona > Goal = Experience </li></ul>
  48. 49. Understanders and Decision Makers Scenario: Evaluate New Issue William C. | Credit Analyst Customer evaluates new issue quickly William, a Credit Analyst, sees in his Bloomberg console that a hospital he watches has offered a new issue. William turns to, and searches for information on the issue by entering the CUSIP. William is taken directly to the destination for the new issue. The destination lists initial ratings and research for the issue. William also finds the most recent publications on the issuer and the industry the issuer belongs to, and a link to the destination for the issuer. The issue destination also offers a list of peer issuers (similar hospitals, or in the same region), as well as their senior un-secured ratings. A summary and extract of Client most recent credit opinion on the issue and issuer appears as well. William reads the summaries, considers the ratings, and formulates an opinion about the new issue based on the collected information presented. F S F S F S F S F Finding Stable Destination Monitoring Delivery S M D IR Modes Referenced
  49. 50. Research and Ratings Originators Scenario: Rate New Issuer Rebecca M. | Client Analyst Client Analyst understands new domain to rate a new issuer Rebecca is a Banking Analyst for Client, focused on Latin American banks. She needs to rate a new issuer - a Chilean bank whose parent company is domiciled in Japan. Rating this issuer requires Rebecca to understand subjects outside her expertise. Rebecca visits the Latin American banking group destination. She is offered links to destinations for new issuers, all analysts tracking Latin American banks, and recent rating actions taken on issues in Latin American banking. With an overview of the activity in her field by other analysts,Rebecca moves on to the linked new issuer page, which collects all recent publications concerning the issuer, shows the latest rating available for the Japanese parent company, and links to the destination for the parent company. Rebecca visits the destination for the Japanese parent. Here she reviews current ratings and the ratings history for the parent, as well as a summary of the most recent credit outlook and credit opinion Client has published about the parent. Rebecca has stronger context, but would like to speak with someone who knows more about Latin American regional economics, and Chilean fiscal policy. She visits the destination for Latin America, which identifies appropriate analysts from the Sovereign Group, and offers recently published research discussing major trends in econoimc development across the region. Rebecca contacts two of the analysts, to discuss specific questions on economic factors in Latin America, and trends in Chile’s fiscal policy. With her more complete understanding, Rebecca is confident she can rate the Chilean issuer properly. S S S S S F Finding Stable Destination Monitoring Delivery S M D IR Modes Referenced
  50. 51. Reference Users Scenario: Researching Complex Topic Peter N. | Corporate Librarian Non-expert assembles research on complex topic Peter, a Corporate Librarian, must respond to a request from an Analyst for the research that Client has published on the after effects of the Asian currency collapse. Peter logs on to This is a new topic he has not researched before, so he chooses to directly enter a query for “asian currency collapse effects” covering all types of research. The returned results suggest that Peter would be interested in a special topic, “The Asian Financial Crisis”. The results also provide Peter suggestions for related special topics, such as “Korean Financial Market”, and links to destinations for all suggested special topics. The results list items for Peter’s query, and the special topic Asian Financial Crisis. He saves links to both topics. Peter can search again, automatically using the special topics as a basis for the new query, applying additional parameters to the combined query as needed. Peter refines the query, using terms related to the request such as corporate governance, and setting the scope to specific countries the analyst is interested in, such as Korea and Singapore. Peter sorts the returned results by date, and filters out several types of publications he does not need to satisfy the request, and chooses five pieces of research to download at once, in the format the analyst prefers. Peter includes the saved links to the special topic destinations in his response to the analyst’s request. Peter dispatches the downloaded files to the analyst. F F S F S F F F Finding Stable Destination Monitoring Delivery S M D IR Modes Referenced
  51. 52. Understanders and Decision Makers Scenario: Monitor Portfolio (Activity / Research) Anike W. | Portfolio Manager Track research published across portfolio of issuers Anike manages a portfolio of credit issues from a large number of issuers. She has created several groups of issuers on to help her monitor the changes in Client view of the issues and issuers in her portfolios. Anike regularly visits the destinations for her groups to see what new research of interest to her is available. Anike’s group destinations provide a list of recent rating actions for her issuers, gather links to all new research of chosen types on the issues, list industries covered by the group, indicate new research published on the issuers, and offer destinations for the regions where issues are domiciled. Anike needs to know immediately of any changes in the outlook for one issuer in the news for potential difficulties. She creates an alert that will send her notice of an rating action or new research mentioning this issuer or issue. Anike may need to change the mix in her portfolio. Her groups destination includes a cross-reference link to information on three issuers in her group offered by the Market Implied Ratings product. Anike’s firm may purchase MIR, so she follows the link. S M S M S M S M S M F Finding Stable Destination Monitoring Delivery S M D IR Modes Referenced
  52. 53. Reference Users Scenario: Customer Support Margaret T. | Client Service Desk Service desk assists customer A frustrated customer calls the Client Service Desk to retrieve the Annual Default Study, without checking After many failed attempts in the past, the customer refuses to try finding things on… Margaret locates the Annual Default Report in the list of “Most Requested Items” Margaret asks what file format the customer prefers. She emails the Annual Default Study to the customer. She offers to explain three easy ways to obtain the study that are faster than calling. Margaret recommends using the “Most Requested Items” list which gathers the most needed publications across all business lines and document types. She explains where the list appears at key locations throughout, such as the home page. She tells the customer how to directly download the latest version of the ADR and other commonly needed publications in a variety of file formats. Margaret also tells the customer how to bookmark the destination page for the Annual Default Study, where the latest version is always available. She explains how the customer can set an alert to be notified when the Annual Default study is updated. She describes different delivery channels for the alerts, email, RSS, etc. The customer does not want to receive any additional alerts. Margaret explains how the customer can have the latest version of the Annual Default Study automatically sent out. The customer asks how to set this up. Margaret guides the customer through setting up a subscription to the Annual Default Report by activating this feature (from the bookmarked destination page, or other locations). The customer thanks Margaret for making things easier to find without mistakes, wasted time, or making many phone calls. F Finding Stable Destination Monitoring Delivery S M D S D D S M M S S IR Modes Referenced
  53. 54. Understanders and Decision Makers Scenario: Understand & Interpret Methodology Simon L. | Ratings Advisor Customer quickly locates methodology documents Simon, a ratings advisor at an investment bank, needs to understand Client method for rating asset backed securities.. Simon logs on to Simon is presented with recent and frequently requested publications in the area of structured finance, based on his role, profile, and interests. Simon wants a longer term view of Client methodologies for structured finance. He navigates to the linked destination for all methodology publications, and focuses on the segment for structured finance. Simon quickly locates the methodology publications pertaining to asset backed securities. He selects several that meet his needs, indicates that he wants them added to a new packet of documents for later use. Simon chooses to download the methodology documents immediately, as well as save the packet for later. He reviews the packet, chooses the file format, and downloads the individual files all at the same time. On the methodologies page, Simon sees a reference to a recorded Client briefing on emerging markets methodologies. He reviews the summary of the briefing. It includes a list of the other topics addressed in the call, as well as the agenda and Client participants. Simon begins listening to the recorded, to see if he should listen to the entire briefing now, later, or at all. While listening, Simon recognizes the name of a Client analyst in the list of participants. He follows the link to the destination page for the analyst, to see if the analyst has written any interesting publications recently. Simon stops and bookmarks the recorded briefing for later, and begins to review the downloaded methodology documents. S M S M S S S S S F Finding Stable Destination Monitoring Delivery S M D IR Modes Referenced
  54. 55. Patterns
  55. 56. Patterns <ul><li>Repeated combinations of the modes </li></ul><ul><li>Spans goals, roles, objects, products, channels </li></ul><ul><li>Encourages long-term perspective </li></ul>
  56. 57. Information Retrieval Patterns Seeking Seeker Visiting Stable Destinations The Seeker is looking for something. Once found, the Seeker goes elsewhere to accomplish other goals.
  57. 58. Information Retrieval Patterns Delivery Regular Customer Visiting Stable Destinations The Regular Customer visits the same destination(s) consistently for the same reasons. Then the Regular Customer realizes they can save the time and effort of visiting, and switches modes to have the things they need delivered directly to them.
  58. 59. Information Retrieval Patterns Seeking Seeking Explorer Visiting Stable Destinations The Explorer is learning about a new (or changed) environment; exploring it's structure, contents, laws, etc. The Explorer may do this for their own purposes, or for others.
  59. 60. Information Retrieval Patterns Initial Subscriber Seeking Delivery Visiting Stable Destinations The Initial Subscriber seeks what is needed, finds the things needed, goes to their location(s), and then chooses to have these things delivered to allow them to seek other things.
  60. 61. Information Retrieval Patterns Vigilant Subscriber Monitoring Delivery Visiting Stable Destinations The Vigilant Subscriber makes effective use of monitoring and delivery, followed up with visitation of destinations, to ensure they do not miss out on anything that might be useful to them within the environment.
  61. 62. Information Retrieval Patterns Skydiver External Referrer The Skydiver makes a bold entrance from outside the environment, and lands precisely on target. Visiting Stable Destinations
  62. 63. Information Retrieval Patterns Watchdog Seeking Monitoring The Watchdog first finds things, and then places them under careful watch.
  63. 64. Information Retrieval Patterns Returned Expatriate Seeking Delivery Visiting Stable Destinations Monitoring The Returned Expatriate was away, and is back again. They begin by revisiting known places, then seek out what has changed, monitor changes for a while, and eventually begin to have valuable things delivered.
  64. 65. Information Retrieval Patterns Vigilant Customer Monitoring Delivery Visiting Stable Destinations The Vigilant Customer comes by often, but wants to be sure, and so monitors things from afar for a while before deciding delivery is more effective.
  65. 66. Information Retrieval Patterns Curious Subscriber Seeking Delivery Visiting Stable Destinations The Curious Subscriber has things delivered regularly, but visits all the same to see what else may be available. And just to be sure, they seek out the things they suspect are here, but cannot see immediately.
  66. 67. Lifecycles
  67. 68. Lifecycles <ul><li>Link patterns </li></ul><ul><li>Longer evolutionary arcs </li></ul><ul><li>Support strategic planning </li></ul><ul><li>Anticipate needs </li></ul><ul><li>Product management </li></ul><ul><li>Service design </li></ul>
  68. 69. Lifecycles Seeker Seeking Visiting Stable Destinations Regular Customer Delivery Visiting Stable Destinations
  69. 70. Lifecycles Regular Customer Delivery Visiting Stable Destinations Vigilant Subscriber Monitoring Delivery Visiting Stable Destinations
  70. 71. Lifecycles Skydiver External Referrer Visiting Stable Destinations Regular Customer Delivery Visiting Stable Destinations
  71. 72. Structures
  72. 73. Structures <ul><li>Conceptual design for experiences </li></ul><ul><li>Addresses interaction, IA, content strategy </li></ul><ul><li>Cross media </li></ul>
  73. 74. Environmental Context For IR Activities Focus Global Local Regional Global
  74. 75. Seeking Experience Focus-based Seeking Local Seeking Focus Delivery Focus Monitoring Regional Seeking Global Seeking
  75. 76. Seeking Experience Local Seeking Local Seeking Local Monitoring Regional Seeking Global Seeking
  76. 77. Seeking Experience Regional Seeking Regional Monitoring Regional Seeking Global Seeking
  77. 78. Seeking Experience Global Seeking Global Monitoring Global Seeking
  78. 79. Destination Experience Focused Destination Local Seeking Focus Delivery Focus Monitoring Regional Seeking Global Seeking
  79. 80. Destination Experience Local Destination Local Seeking Local Monitoring Regional Seeking Global Seeking Local Delivery
  80. 81. Destination Experience Regional Destination Regional Monitoring Regional Seeking Global Seeking Regional Delivery
  81. 82. Destination Experience Global Destination Global Monitoring Global Seeking Global Delivery
  82. 83. Design
  83. 84. User Experience Reconciliation Design Integration Track 1: Information Retrieval Surveyor Track 2: Unified Service Delivery Interviews & Findings User Roles + User Needs = Matrix Personas Scenarios Monitor credit risk over time Learn about Client Understand the rating agency Identify and compare entities Access ratings, research & opinion Perform customer service Perform credit risk analysis Search for Relevant Research Learn about Client View Latest Research Evaluate New Product Understand Methodology Monitor Portfolio Researching Complex Topic Respond to Customer Call Evaluate/Rate New Issue
  84. 85. Design Highlights <ul><li>The analysis work helps to drive the High-Level Design; to review the design we’ll be focusing in on three key design highlights and using a typical user scenario to illustrate the design </li></ul>Example Scenario: View Latest Research Starting at the Client Rating Service homepage Robert searches for an issuer The issuer page logically organizes all of the relevant content; Robert reads Client opinion The search results enable him to refine the results, he selects to view the desired issuer Robert Jensen Senior Credit Analyst Design Highlights » Two Site Experiences Differences between the “Corporate Users” and the other user groups are addressed by two separate and distinct site experiences Balanced Finding Tools Users can find content by dynamically searching and/or selecting browse categories that are meaningful to them At-A-Glance Pages All the information Client offers for a particular entity is presented in a structured and organized fashion 1 Home 2 Browse 3 Issuer
  85. 86. Surveyor Example Concept Page Consistent Framework Page Title Ratings List Tile Highlighted Research Tile Research List Tile Interactive MIR Tile Interactive Reference Tile Research Research Research Analyze Learn Analyze Product Promotion Tile A page integrates a number of functional tiles within a consistent site framework
  86. 87. Wire Frame
  87. 88. Wire Frame
  88. 89. Wire Frame
  89. 90. Wire Frame
  90. 91. None of this was built.
  91. 92. Fortunately.
  92. 93. Understanding Audiences
  93. 94. User Feedback
  94. 95. User Feedback
  95. 96. User Assessment of IR Capabilities <ul><li>Overall, user needs are not supported by finding mechanisms and modes </li></ul><ul><li>Searching emphasized over all other information seeking modes / behaviors </li></ul><ul><li>Users must rely on search to meet needs better supported by other mechanisms </li></ul><ul><li>Users must search to accomplish even simple IR goals </li></ul><ul><li>Content not offered to users to attempt to meet their needs or goals </li></ul>
  96. 97. User Assessment of IR Capabilities <ul><li>User assessment of search is affected by diverse factors: </li></ul><ul><ul><li>User experience and design of </li></ul></ul><ul><ul><li>Metadata on research documents </li></ul></ul><ul><ul><li>Permissioning errors on research documents </li></ul></ul><ul><ul><li>Customer support model </li></ul></ul><ul><ul><li>Metadata management limitations </li></ul></ul><ul><ul><li>Taxonomy / IA management difficulties </li></ul></ul><ul><ul><li>Internal publishing processes </li></ul></ul><ul><ul><li>Siloed products </li></ul></ul><ul><ul><li>Lack of granularity / compenentization in offerings (products, services, research) </li></ul></ul><ul><li>Many driving factors lie outside current IR project scope… </li></ul>
  97. 98. <ul><li>Search experience is the focus of broader dissatisfaction with ability to meet needs </li></ul><ul><ul><li>Experience does not meet IR needs and usage patterns </li></ul></ul><ul><ul><li>Quality and quantity of finding tools lags business model and offerings </li></ul></ul>
  98. 99. Audiences: Overview of User Groups Client Analysts Client analysts create the valuable research and data delivered to customers via Client Analysts specialize in a particular area of the market, and often have contact with customers needing additional clarification or insight into Client actions and viewpoints. Customers This group includes the range of customers, from Ratings Advisors to Credit Analysts and Portfolio Managers Client Services This group provides customers with service and support for the research and data or analytics offerings delivered via the web site. It includes customer facing roles, as well as IT staff, and Issuer Relations. Internal Association External association Users (non paying) This group utilizes to support diverse purposes inlcuding research and regulation, that are not connected to a credit issue or other buying or selling decision.
  99. 100. User Research Framework Client Customers Client Analysts Subscribers Issuer Relations Client Service Desk Research assessed IR needs of internal and external users. All Information Retrieval Needs
  100. 101. User Research Framework Client Customers Client Analysts Subscribers Issuer Relations Client Service Desk All users rely on user experience to meet IR needs… All Information Retrieval Needs
  101. 102. User Research Framework Product / Service Delivery (.com) Research Creation Ratings Generation Issuer Relations Customer Support Internal Information Retrieval Needs Internal users assessed spanned major Client processes…
  102. 103. User Research Analysis Product / Service Delivery Research Creation Ratings Generation Issuer Relations Customer Support IR IR IR IR IR Internal users rely on to support other processes. Internal Process Needs
  103. 104. <ul><li>User opinions of IR capabilities are driven by unsupported usage and expectations. </li></ul>
  104. 105. <ul><li>Internal users have more intense needs and usage patterns </li></ul><ul><ul><li>Broader range of IR needs </li></ul></ul><ul><ul><li>More specific IR needs </li></ul></ul><ul><ul><li>More complex IR needs </li></ul></ul><ul><ul><li>Greater frequency of use </li></ul></ul><ul><ul><li>Time pressure </li></ul></ul><ul><ul><li>Cumulative frustration </li></ul></ul><ul><ul><li>Reduced forgiveness for error / failures </li></ul></ul>User Assessment of IR Capabilities
  105. 106. <ul><li>Internal usage patterns expose IR problems more quickly & clearly </li></ul><ul><ul><li>Internal users represent Client to customers </li></ul></ul><ul><ul><li>They are expected to know more and have greater capabilities than customers </li></ul></ul><ul><ul><li>Many roles have customer contact / support aspects </li></ul></ul>User Assessment of IR Capabilities
  106. 107. <ul><li>User assessments of IR differ based on association with Client </li></ul><ul><ul><li>Users associated with Client have a negative view. </li></ul></ul><ul><ul><li>Users not associated with Client have a neutral (or positive) view </li></ul></ul>User Assessment of IR Capabilities
  107. 108. Solution Recommendations <ul><li>Revise roadmap to address all information needs </li></ul><ul><li>Provide IR experiences for all levels of structure </li></ul><ul><ul><li>Modes </li></ul></ul><ul><ul><li>Patterns </li></ul></ul><ul><ul><li>Lifecycles </li></ul></ul><ul><ul><li>Structures </li></ul></ul>
  108. 109. Solution Recommendations <ul><li>Offer internal users focused IR solutions and experiences </li></ul><ul><li>Meet other needs (not IR) with dedicated / integrated solutions </li></ul><ul><ul><li>Research and publishing </li></ul></ul><ul><ul><li>Content management </li></ul></ul><ul><ul><li>Document management </li></ul></ul><ul><ul><li>Customer support </li></ul></ul><ul><ul><li>Collaboration </li></ul></ul>
  109. 110. Suggested Vision For IR Architecture Product / Service Delivery Research Creation Ratings Generation Issuer Relations Customer Support IR IR IR IR IR Common IR architecture and services supports all needs. Information Retrieval Architecture
  110. 111. Solution Implications Product / Service Delivery Research Creation Ratings Generation Issuer Relations Customer Support Publishing Document Mgmt Collaboration CRM IR IR IR IR IR Internal needs may be better met by dedicated user experiences.
  111. 112. Q & A @mojoe [email_address] Questions? Thank You!