Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Information Search


Published on

Presentation given at Intranät 2009 in Sweden about how IBM enables search effectiveness

Published in: Technology

Information Search

  1. 1. Information Discovery: Changing the way we work Lars-Olof Allerhed, Technical Director IBM
  2. 2. The people powered information revolution <ul><li>The world is saturated by information </li></ul><ul><ul><li>161 billion gigabytes: the amount of email world-wide </li></ul></ul><ul><ul><li>6 billion gigabytes: person-to-person communications </li></ul></ul><ul><ul><li>>60 million IBM intranet pages </li></ul></ul><ul><ul><li>>160 million IBM documents (teamrooms and repos) </li></ul></ul><ul><li>Grassroots collaboration increases the amount of information (feeds, blogs, wikis) </li></ul><ul><ul><li>57 million: the number of worldwide blogs </li></ul></ul><ul><ul><li>160 million: the number of users in social spaces </li></ul></ul><ul><ul><li>>160K: number of IBMrs registered with WikiCentral </li></ul></ul><ul><ul><li>>31K: number of registered IBM bloggers </li></ul></ul><ul><ul><li>>90K: IBMrs registered with IBM Media Library </li></ul></ul>Finding information is critical to how we make decisions that drive value across the company and how we respond to the industry
  3. 3. <ul><li>Information is generated quickly, and that means even more content needs to be organized and managed </li></ul><ul><li>Top-down control over information and strict categorization of rapidly generated content is difficult and ineffective </li></ul><ul><li>Content is being stored and distributed in silos even more today creating obstacles for accessing the right information </li></ul><ul><li>Different internal brands and portals are all looking for our attention, creating fragmented information user experiences </li></ul>We are generating more content
  4. 4. Information Discovery: Definition & goals <ul><li>The Information Discovery Initiative is focused on improving an employees’ ability to find information by: </li></ul><ul><li>Increasing the relevancy of search results </li></ul><ul><li>Creating a user centered environment that aligns with how employees think and work </li></ul><ul><li>Improving the quality and relevancy of content delivered to employees before they know or need to search for it </li></ul><ul><li>Creating a participative environment in which employees help each other find what they need </li></ul>Result: Employees work more effectively, i.e., employees are more productive, find more innovative ways to work, perform at a higher level, and deliver more value to IBM.
  5. 5. Who we are
  6. 6. Information Discovery: Evolution <ul><li>Information Management Intranet </li></ul><ul><li>Technology-driven </li></ul><ul><li>Search </li></ul><ul><ul><li>Relevancy ranking and algorithms </li></ul></ul><ul><li>Content management </li></ul><ul><ul><li>Metadata standards </li></ul></ul><ul><ul><li>Taxonomy </li></ul></ul><ul><li>Findability </li></ul><ul><li>Discrete experiences/UI </li></ul><ul><li>Portals </li></ul><ul><li>Collaborative Intranet </li></ul><ul><li>End-user participation driven </li></ul><ul><li>Democratizing classification </li></ul><ul><ul><li>Social tagging </li></ul></ul><ul><ul><li>Folksonomy </li></ul></ul><ul><li>Democratizing content creation </li></ul><ul><ul><li>Blog and wikis </li></ul></ul><ul><li>Discoverability </li></ul><ul><li>Architecture of participation </li></ul><ul><li>Information hubs </li></ul>w3, ODW <ul><li>Social Intranet </li></ul><ul><li>Behavior-driven model </li></ul><ul><li>Social search </li></ul><ul><li>Decision support </li></ul><ul><ul><li>Business intelligence </li></ul></ul><ul><li>Recommendations (versus personalization) </li></ul><ul><ul><li>Inference and data mining </li></ul></ul><ul><li>Predictability </li></ul><ul><li>Contextual and adaptive User Experiences </li></ul><ul><li>Semantic web </li></ul><ul><li>Actionable & shared information spaces </li></ul>w3, ODWNext w3_Social Workplace (ODW x)
  7. 7. Opportunities for the Workplace <ul><li>Increase employee communication via new collaboration tools </li></ul><ul><li>Improve employee productivity </li></ul><ul><li>Socially Networked Platform </li></ul><ul><li>Harvesting emerging technology “piece-parts” and sew them together creating an end-to-end social networking experience for the intranet </li></ul><ul><ul><li>Social tagging to the next level </li></ul></ul><ul><ul><li>Information aggregation system </li></ul></ul><ul><ul><li>Wikis, blogs </li></ul></ul><ul><ul><li>Reputation management (IBMr) </li></ul></ul><ul><ul><li>Social Search </li></ul></ul><ul><li>Increase sellers productivity </li></ul><ul><ul><li>Pilot a role-enabled (sellers) workspace that connects people with information and people </li></ul></ul><ul><ul><li>Evaluate emerging technology that is appropriate to solve this problem </li></ul></ul><ul><ul><li>Think creatively about how and where we apply the solutions </li></ul></ul><ul><ul><li>Design a real end-to-end process from innovation to production to market </li></ul></ul><ul><ul><li>Integrate onto ODWNext as sandbox </li></ul></ul>
  8. 8. Information Discovery: Projects <ul><li>Smart user focused search experiences empower the user to improve search </li></ul><ul><ul><li>Quality of content and tagging is a huge contributor – it’s a fallacy to think the search engine will solve our problems </li></ul></ul><ul><ul><li>Searching for information centers around the user – rich user defined experiences are in demand </li></ul></ul><ul><ul><li>Search as a living thing </li></ul></ul><ul><li>Social tagging is the new way we communicate and connect </li></ul><ul><ul><li>Make people the center of the corporation and unleash their knowledge </li></ul></ul><ul><ul><li>Rating, reputation and tagging can connect people based on skills and reputation </li></ul></ul><ul><li>Enhanced personalization capabilities </li></ul><ul><ul><li>People centric profiles emerge </li></ul></ul><ul><ul><li>Topical content and knowledge is delivered to the employees who need it, and no one else </li></ul></ul><ul><li>Smart content recommendations </li></ul><ul><ul><li>Users identify content, people and communities of interest to subscribe to </li></ul></ul><ul><ul><li>Rely on tag data and user profiles to recommend content (content, tags, communities & people) </li></ul></ul><ul><li>Information aggregation in a single view </li></ul><ul><ul><li>Information is organized by employees </li></ul></ul><ul><ul><li>Employees organize how they receive content </li></ul></ul><ul><ul><li>Share information found through shared content collections and social tagging spaces </li></ul></ul>
  9. 9. Search satisfaction is showing progress <ul><li>Overall search satisfaction rose to 52% </li></ul><ul><ul><li>Significant rise in satisfaction to 73% for those who were aware of new search release </li></ul></ul><ul><ul><li>Specific enhancements showed statistically significant increases </li></ul></ul><ul><li>User feedback decreased </li></ul><ul><ul><li>From 37-118 a week to <17 a week </li></ul></ul><ul><li>Saved 2000+ hours per week increasing productivity </li></ul><ul><ul><li>Users time spent searching decreased by ~ 36 seconds </li></ul></ul><ul><li>Social tagging in search works </li></ul><ul><ul><li>“ Pages bookmarked by IBMers” receives 120,000+ clicks per month </li></ul></ul><ul><ul><li>Users stopped searches on tagged pages at a substantially higher rate than “natural results” </li></ul></ul>
  10. 10. Identify quick wins <ul><li>Listen to your colleagues complaints and investigate why search fails (e.g. IBM Global Account Europe Intranet) </li></ul><ul><ul><li>Refer to the w3 Search wiki </li></ul></ul><ul><ul><li>View source and scrutinize the metatags </li></ul></ul><ul><ul><li>Report anomalies through Feedbacks or through the Search Effectiveness Team </li></ul></ul><ul><ul><li>Get clarification on what influences language specific searches and then document/promote. </li></ul></ul><ul><li>Ask IT Advocates or Teachers for the feedbacks they receive </li></ul><ul><li>Leverage your network: ask them to search on their 10 top used sites and to give you unsuccessful searches, tag them and investigate the issue </li></ul><ul><li>Promote tagging </li></ul><ul><li>Report any outdated / broken link through the Feedback function and recommend your peers to do the same </li></ul>w3 Search - Let's improve it!
  11. 11. Track progress <ul><li>Assign yourself challenges (search x urls / day, tag x urls 1 , identify suggested matches if applicable, contact x new persons, review x pages for outdated info) </li></ul><ul><li>Assign others the same challenges and follow them through (e.g. I have weekly meetings with the BT&IT France Search Champions with checkpoints on actions) </li></ul><ul><li>Follow-up/survey on demos, launch contests? </li></ul><ul><li>Only 12 European Search Champions are using Dogear and o/w only 7 did tag since the kick-off (see here ): do you need any help?) </li></ul>w3 Search - Let's improve it! 1 but do not tag for the sake of tagging
  12. 12. Keep Interest <ul><li>Publish/reuse new hive5’s in Beehive </li></ul><ul><li>Try and find videos, hints & tips to share </li></ul><ul><ul><li>E.g. Luis Suarez video on Dogear 2.0 </li></ul></ul><ul><li>Use the broadcast facility in Sametime for unformal chats… </li></ul><ul><li>Use blogs, wikis </li></ul><ul><li>Be sure to give answers on questions raised, follow-up if needed </li></ul>w3 Search - Let's improve it!
  13. 13. Showcase progress & people <ul><li>By asking people to search on the urls they use the most, you demonstrate that more and more searches are successful either on the left or right hand-side of the Search results panel </li></ul><ul><li>Promote individuals’ progress in Beehive , assess individuals’ w3 search skill in IBMr when prompted </li></ul><ul><li>Recognize contributors’ efforts. See my 2 Europe winners of the month </li></ul><ul><li>Each of us should add w3 Search in our PBCs so that our Management line understand the importance of our contribution. By helping improve w3 search in general for the Company we not only contribute to the w3 search satisfaction index, we also: </li></ul><ul><ul><li>Increase our own productivity in locating the information we need to perform our job, </li></ul></ul><ul><ul><li>Simplify our organization’s information discovery and knowledge management </li></ul></ul><ul><ul><li>Help our sales forces to showcase our search experience and sell the services/products outside </li></ul></ul><ul><ul><li>Can demonstrate outside the Company that Enterprise search can be improved and that we, as IBMers can contribute to it through the use of social tagging and other web 2.0 technologies </li></ul></ul>w3 Search - Let's improve it!
  14. 14. Search progress is constant when we focus on our users <ul><li>Social Search: Tagging </li></ul><ul><ul><li>Users actively describe and organize content </li></ul></ul><ul><ul><li>Tagged artifacts create relationships between content and people </li></ul></ul><ul><ul><li>Actively tagged content bubbles to the top - naturally – as information changes </li></ul></ul><ul><ul><li>Tagging creates serendipitous discovery </li></ul></ul><ul><li>Freeing Information: ARKE </li></ul><ul><ul><li>Repositories are unlocked so information isn’t isolated </li></ul></ul><ul><ul><li>A common user experience for searching disparate collections </li></ul></ul><ul><ul><li>Content owners are exposing their data to broader audiences </li></ul></ul><ul><li>Living Search: Aware and Active </li></ul><ul><ul><li>Search results based on user’s feedback creates continuous cycle of change </li></ul></ul><ul><ul><li>Search is personalized - language and geographically aware </li></ul></ul>
  15. 15. Search interface is designed to be more interactive around user’s needs ARKE Personal tagged pages Personalized suggested matches User tags drive relevance Language controls
  16. 16. Search effectiveness is the way we progress <ul><li>Search effectiveness champions </li></ul><ul><ul><li>Drive best practices into their respective organizations </li></ul></ul><ul><ul><li>Drive strong communications plan for end users and content owners with search teams </li></ul></ul><ul><li>Search value chain </li></ul><ul><ul><li>Partner and build relationships across IBM to come up with innovative solutions </li></ul></ul><ul><ul><li>Collaborate with IBM Research teams to test new features </li></ul></ul><ul><ul><li>Feedback loop to product teams </li></ul></ul><ul><li>Search effectiveness metrics program improvements </li></ul><ul><li>Engage high-priority and low-sat stakeholders to rally support and help the cause </li></ul><ul><li>Continue to move the needle with tactical improvements while driving search strategy </li></ul>
  17. 17. Search and tagging begin to create p eople centric profiles User activities will be drive how users consume content Snapshots of activity, opinions, relationships and more become profiles The profiles change based on social networks, giving us the vantage point for seeing the relationship between the collective and the individual Subscribe to people Evaluate Manage reputations and expertise Participate Share & Discover
  18. 18. Enabling enterprise social tagging <ul><li>In 2006, we released the Enterprise Tagging Service </li></ul><ul><li>Designed, documented and deployed a common tagging user experience </li></ul><ul><ul><li>Simple, consistent framework for how people tag content </li></ul></ul><ul><ul><li>Tagging widget that allows developers to easily integrate tagging into applications </li></ul></ul><ul><li>Designed and deployed Enterprise Tagging Service </li></ul><ul><ul><li>A common service for any application to publish and consume tag data (push and pull tags) </li></ul></ul><ul><ul><li>Tag normalization bringing added intelligence to tags in ETS </li></ul></ul><ul><ul><li>Repository for storing tags and all of their associations (tags to tags; tags to people; tags to content) for analytics </li></ul></ul>
  19. 19. What are we doing with the tags from ETS? <ul><li>Meaningful relationships between information and people are captured </li></ul><ul><li>These tags and associations are used in other contexts </li></ul><ul><li>Content is surfaced regardless of the application – remixing experiences </li></ul><ul><li>Surface social information, like: </li></ul><ul><ul><li>How other people think? </li></ul></ul><ul><ul><li>What I need to check out? </li></ul></ul><ul><ul><li>Who do I have something in common with? </li></ul></ul><ul><li>Use social metadata to improve relevancy of search results </li></ul><ul><li>Recommend content based on a user information activity history (footprint) </li></ul>
  20. 20. Today, tags create rich associations in multiple contexts <ul><li>Collaboration: Thinkplace </li></ul><ul><ul><li>Collaboration in Thinkplace is structured by tags </li></ul></ul><ul><ul><li>Idea generators, readers and catalysts form communities helping discover ideas </li></ul></ul><ul><ul><li>Tagging makes sharing ideas and collaboration simple </li></ul></ul><ul><li>Communication: w3 News </li></ul><ul><ul><li>News articles are being tagged by readers </li></ul></ul><ul><ul><li>Readers actively describe content and what it means to them </li></ul></ul><ul><ul><li>Related news, blogs, media and people are recommended based on user activity </li></ul></ul><ul><li>Sharing: MediaLibrary </li></ul><ul><ul><li>MediaLibrary is IBMs youtube – people share and find multimedia content </li></ul></ul><ul><ul><li>Media is organized by authors and end-users </li></ul></ul><ul><ul><li>Media is recommended to users based on participation, attention and activity </li></ul></ul><ul><li>Reputation: IBMr </li></ul><ul><ul><li>Exploration in peer feedback and expertise location </li></ul></ul><ul><ul><li>Skills hierarchy as a base to define common skills </li></ul></ul><ul><ul><li>Tags influence and further define skills by the people who know the skills </li></ul></ul>
  21. 21. <ul><li>In 2008, we will enhance tagging by designing: </li></ul><ul><li>Pervasive “tag it! rate it! and relate it!” widget for w3 </li></ul><ul><ul><li>Pervasive widget will </li></ul></ul><ul><ul><ul><li>Allow users to rate and tag content in any context on the intranet (via plug in or web widget) </li></ul></ul></ul><ul><ul><ul><li>Allow users to receive related content dynamically in the context of a current activity </li></ul></ul></ul><ul><li>Dedicated information “management” space </li></ul><ul><ul><li>Place where users can manage their tags </li></ul></ul><ul><ul><li>Please where users can connect with other people and information through recommendations from a rich profile </li></ul></ul><ul><ul><ul><li>ODW profile joined with the tagging and rating activity) </li></ul></ul></ul><ul><ul><li>Place where users can view tag activity of other IBMrs </li></ul></ul>Tags will be used as base for smart recommendation engine to deliver content Pervasive information delivery in the right context
  22. 22. Profiles and social networks create the next generation of smart systems: w3 recommendation engine <ul><li>Meaningful relationships between information are captured created by people </li></ul><ul><li>We extrapolate a users’ interests through their past activities </li></ul><ul><li>Rich relationships between information and people are derived from the local user and the collective user population </li></ul><ul><li>Interests create the dynamic which are related to the w3 profile </li></ul><ul><li>Recommendations are generated in real-time using memory-based scalable algorithms and sampling methods </li></ul>
  23. 23. How are we bringing all of this together to enable discovery? <ul><li>Why: </li></ul><ul><li>Easy way to stay current on the latest news and information from variety of sources (content comes to you) </li></ul><ul><li>Aggregates content into a single point of access (i.e., saves the trouble of visiting each blog/wiki/site/podcast one at a time) </li></ul><ul><li>Content recommendations based on your active profile </li></ul>Subscription based model letting users decide and actively participate in their information experience.
  24. 24. What we’re doing to enable this work <ul><li>Design integrated end-to-end interaction model for search and tagging user experiences </li></ul><ul><li>Designing a pervasive “tag it rate it and relate it” widget for w3 </li></ul><ul><li>Designing people centric spaces for w3 </li></ul><ul><ul><li>Inventory internal reputation (IBMr), content authoring (blogs), social networking and information sharing solutions across organization </li></ul></ul><ul><ul><li>Model how we bring these piece parts together to create holistic experiences </li></ul></ul><ul><ul><li>Subscription models </li></ul></ul><ul><ul><li>Interact with content, people and tags in the space </li></ul></ul><ul><ul><li>Define how this space interacts with the rest of the intranet and other collaboration tools </li></ul></ul><ul><li>Working on ODWNext as a test platform for collaborative tools </li></ul><ul><li>Success measurements program </li></ul><ul><ul><li>Define metrics to constantly show value of work </li></ul></ul><ul><ul><li>Metrics program being established to show value of tagging </li></ul></ul>
  25. 25. Reality check: We now have more content to manage than when we started and it exists in many different locations
  26. 26. Any ideas, questions? w3 Search - Let's improve it! e-mail: Personal blog: