Successfully reported this slideshow.
Welcome to “ Panning for Gold ” A  “Web” Prospector’s Guide to Mining and Filtering Community Data
Introductions Ben Bassi, President & CEO Seasoned Internet Pioneer At the forefront of online innovation for almost two de...
CommonPlaces e-Solutions <ul><li>Founded in 1998 in Cambridge, MA </li></ul><ul><li>Open Source Development since 2003 </l...
Let ’s Get Started!  “ Panning for Gold ” A  “Web” Prospector’s Guide to Mining and Filtering Community Data
Panning for Gold  <ul><li>There are 4 Steps to Mining For Gold </li></ul><ul><li>(and as it turns out, for mining for usef...
1. Prospecting <ul><li>You Know There's Nuggets of Info Out There   </li></ul><ul><li>Businesses today have access to an u...
Traditional Prospecting Methods <ul><li>Relying on What You Know Already </li></ul><ul><ul><li>“ Like relying on outdated ...
Plenty of Commercial Search Tools <ul><li>Automate the Search Process  </li></ul><ul><li>Provide Sentiment Data  </li></ul...
Plenty of Free, Open Source Applications <ul><li>Automate the Search Process  </li></ul><ul><li>Tell You Who Your Influenc...
These Tools Still Aren ’t “Discovery” Tools <ul><li>The frustration is that most can ’t quite reach or understand the valu...
2. Mining vs. Traditional Search Data Discovery
3. Extracting Social Media Blogging / Micro-Blogging UG and Product Reviews Support Desk CRM Emails Databases
4. Refining  <ul><li>Here ’s where the available Search tools fall down  </li></ul><ul><li>What can you do with the data o...
CP ’s Data Discovery Technology Delivers <ul><li>Timely actionable information discovery for impactful </li></ul><ul><li>b...
What Clients Tell Us They Need For their users : For their business: Discover relevant information in a timely basis – unc...
Why is it Different? Search & Data Mining Exploration & Discovery How it Works Uses search tools where users may key in wo...
Sample Data Sources  Blogs, Polls,  Surveys Call Center  Data Data Discovery Utilizes Both Structured and Unstructured Data
Why is Discovery Technology Different? Take Data  “As-Is” with no need to first clean source files No Pre-Defined Dictiona...
Sample Applications Regulatory Analysis Operational Analysis Strategic & Competitive Intelligence Market Research Call Cen...
Prospecting with CP Data Discovery <ul><li>Interactive Exploration- no programming for user…drag and drop  </li></ul><ul><...
Mining/Extracting with CP Data Discovery  <ul><li>Information Connection Discovery </li></ul><ul><li>Multiple Simultaneous...
Refining with CP Data Discovery <ul><li>Structured and Unstructured Data Correlation </li></ul><ul><li>Development of exce...
Data Discovery Demo
Thank You!  <ul><li>Questions?  </li></ul>CommonPlaces e-Solutions  Follow us on LinkedIn   Ben Bassi President & CEO  [em...
Upcoming SlideShare
Loading in …5
×

OSCON 2010 - Panning for Gold: A Web Prospector's Guide to Mining and Filtering Community Data

2,240 views

Published on

Published in: Technology, Education
  • Be the first to comment

OSCON 2010 - Panning for Gold: A Web Prospector's Guide to Mining and Filtering Community Data

  1. Welcome to “ Panning for Gold ” A “Web” Prospector’s Guide to Mining and Filtering Community Data
  2. Introductions Ben Bassi, President & CEO Seasoned Internet Pioneer At the forefront of online innovation for almost two decades… Bassi was a part of the founding management team of Lycos.com responsible for creating many of the first communities and portals for companies like Microsoft, CompuServe, Prodigy, MTV and GTE. EVP of the Firefly Network (acquired by Microsoft as the basis for the Microsoft Passport for MSN).
  3. CommonPlaces e-Solutions <ul><li>Founded in 1998 in Cambridge, MA </li></ul><ul><li>Open Source Development since 2003 </li></ul><ul><li>We create rewarding and intelligent experiences for online communities… </li></ul><ul><ul><li>CMS Powered Online Communities </li></ul></ul><ul><ul><li>Subscription-Based e-Commerce Applications </li></ul></ul><ul><ul><li>CMS Integration (single sign on, SFA, back-office) </li></ul></ul><ul><ul><li>UG Media / Multimedia Sites </li></ul></ul><ul><ul><li>Advanced Search / Data Collaboration </li></ul></ul>
  4. Let ’s Get Started! “ Panning for Gold ” A “Web” Prospector’s Guide to Mining and Filtering Community Data
  5. Panning for Gold <ul><li>There are 4 Steps to Mining For Gold </li></ul><ul><li>(and as it turns out, for mining for useful </li></ul><ul><li>data from Web and Internal Data) </li></ul><ul><ul><li>Prospecting </li></ul></ul><ul><ul><li>Mining </li></ul></ul><ul><ul><li>Extracting </li></ul></ul><ul><ul><li>Refining </li></ul></ul>
  6. 1. Prospecting <ul><li>You Know There's Nuggets of Info Out There </li></ul><ul><li>Businesses today have access to an unimaginable amount of user data and </li></ul><ul><li>content, both structured and unstructured. </li></ul>Social Media UG and Product Reviews Blogging / Micro-Blogging Support Desk CRM Emails Databases
  7. Traditional Prospecting Methods <ul><li>Relying on What You Know Already </li></ul><ul><ul><li>“ Like relying on outdated maps ”, predetermined keywords, product names, and preconceptions </li></ul></ul><ul><li>Not the best way to discover new ideas </li></ul><ul><li>Best ROI is found on “Discovered” intelligence </li></ul><ul><li>No Competitive Edge </li></ul>
  8. Plenty of Commercial Search Tools <ul><li>Automate the Search Process </li></ul><ul><li>Provide Sentiment Data </li></ul><ul><li>Expensive </li></ul><ul><li>You have to know what you ’re searching for first </li></ul>
  9. Plenty of Free, Open Source Applications <ul><li>Automate the Search Process </li></ul><ul><li>Tell You Who Your Influencers Are </li></ul><ul><li>You have to know what you ’re searching for first </li></ul>
  10. These Tools Still Aren ’t “Discovery” Tools <ul><li>The frustration is that most can ’t quite reach or understand the value of the data with the search tools they’re currently using. </li></ul><ul><li>You ’re Still Searching For What You Already Know </li></ul><ul><li>Like searching for treasure on the beach – the ‘beep’ (or information returned in a report) could be Gold, or a nickel. You have no way of aggregating the data across platforms to know what’s really useful – so they’re really “blind” searches. </li></ul><ul><li>A lot of work for very small ROI. </li></ul>
  11. 2. Mining vs. Traditional Search Data Discovery
  12. 3. Extracting Social Media Blogging / Micro-Blogging UG and Product Reviews Support Desk CRM Emails Databases
  13. 4. Refining <ul><li>Here ’s where the available Search tools fall down </li></ul><ul><li>What can you do with the data once its collected? </li></ul><ul><li>How to keep Context </li></ul><ul><li>How automated is the process (million of spreadsheets? Interns?) </li></ul>
  14. CP ’s Data Discovery Technology Delivers <ul><li>Timely actionable information discovery for impactful </li></ul><ul><li>business results </li></ul><ul><li>Detailed Voice of Customer insights </li></ul><ul><li>Market intelligence to stay ahead of competitors </li></ul><ul><li>Develop new strategies for products and services for revenue growth </li></ul><ul><li>Improve customer satisfaction to increase loyalty and up-sell </li></ul>
  15. What Clients Tell Us They Need For their users : For their business: Discover relevant information in a timely basis – uncover actionable insights. <ul><li>Timely Results </li></ul><ul><li>Quickly see what is in the information </li></ul><ul><li>Guide “me” to what I should look at - Go beyond traditional search listings </li></ul><ul><li>Relevant and interesting information </li></ul><ul><li>Real Information </li></ul><ul><li>Customer/user verbatim: Can I see what they are actually saying? </li></ul><ul><li>See citations from documents </li></ul><ul><li>Show me how information is connected </li></ul><ul><li>Help “Me” </li></ul><ul><li>Address competitive realities and strategies </li></ul><ul><li>Identify new product/process opportunities </li></ul><ul><li>Identify operational improvements </li></ul><ul><li>Quickly find emerging trends for opportunities/risks on the long tails of information </li></ul><ul><li>Maximize the use of my information </li></ul><ul><li>Empower “Me” </li></ul><ul><li>Enable “me” to do my own exploration </li></ul><ul><li>Twist, spindle, and manipulate “my” data at will and see how it actively responds </li></ul><ul><li>See clusters, long tail info, and trends </li></ul>
  16. Why is it Different? Search & Data Mining Exploration & Discovery How it Works Uses search tools where users may key in words or data for which they are interested in matching results. Creates free-form interactive visual displays of information and its characteristics, connections and details. Attributes of the Approach <ul><li>Requires that the user decide what they want to find before they find it. </li></ul><ul><li>Provides no means of narrowing a large set of potentially irrelevant results. </li></ul><ul><li>People develop understanding of large bodies of information before reading in detail. </li></ul><ul><li>Allows people to narrow in to the most important relevant results. </li></ul><ul><li>Requires no presupposition of the outcome prior to application. </li></ul>Discovery Limited to database exposure Utilizes various data inputs- internal, internet, social media, consumer generated content, subscription services all combined for data discovery Result People find only what they decided they wanted to find ahead of time, minimal surprises or novel information. People discover the unexpected. New and emerging ideas are discovered without knowing how to search for them in advance.
  17. Sample Data Sources Blogs, Polls, Surveys Call Center Data Data Discovery Utilizes Both Structured and Unstructured Data
  18. Why is Discovery Technology Different? Take Data “As-Is” with no need to first clean source files No Pre-Defined Dictionary Required No Need To Know What is In Your Data Before Beginning Exploration No Need To Know Data Relationships – Technology Identifies Them for You Real Time Works on the “ Long Tail” of Information Enabling Detection of Emerging Opportunities and Risks Solution Enables “Lenses” Which are Reusable Knowledge Digital Assets That Can be Utilized Throughout the Organization For Discovery in other Fields of Interest The Connection Engine Platform that Enables Real Time Data Exploration and Discovery
  19. Sample Applications Regulatory Analysis Operational Analysis Strategic & Competitive Intelligence Market Research Call Center Operations Warranty Claims Product Development Litigation Support E -Discovery Patent Research Pricing and Packaging Claims Processing Surveys WEB/BLOG Forum Subscribed Content Customer/User Profiling Social Media Exploration Voice of Customer Fraud Related Discovery
  20. Prospecting with CP Data Discovery <ul><li>Interactive Exploration- no programming for user…drag and drop </li></ul><ul><li>Pre-defined dictionary not required </li></ul><ul><li>Cluster & Long Tail Exploration for Advanced Early Detection </li></ul><ul><li>Ability to utilize anywhere internet access availability exists…..mobile field real time applications </li></ul><ul><li>Can set up threshold and alerting system for automated processing of information </li></ul>
  21. Mining/Extracting with CP Data Discovery <ul><li>Information Connection Discovery </li></ul><ul><li>Multiple Simultaneous Data Sets </li></ul><ul><li>Can be utilized as an overlay enhancement to existing programs </li></ul><ul><li>Structured and Unstructured Data Correlation </li></ul><ul><li>Social Media Exploration </li></ul><ul><li>Multi-language capabilities </li></ul>
  22. Refining with CP Data Discovery <ul><li>Structured and Unstructured Data Correlation </li></ul><ul><li>Development of exception reporting based on results of exploration </li></ul><ul><li>Word Proximity and Phrase Analysis </li></ul><ul><li>Information Connection Discovery </li></ul><ul><li>Trend Visualization </li></ul><ul><li>Lens Processing - user created knowledge assets to share, repurpose and drive new discoveries </li></ul>
  23. Data Discovery Demo
  24. Thank You! <ul><li>Questions? </li></ul>CommonPlaces e-Solutions Follow us on LinkedIn Ben Bassi President & CEO [email_address] @BenBassi Michael Reich Director of Business Development [email_address] @CPOpenSource Follow us on Twitter www.CommonPlaces.com 603.329.6760

×