Condos in the BigData Knowledge Garden

1,180 views

Published on

Published in: Education, Self Improvement
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,180
On SlideShare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
18
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Condos in the BigData Knowledge Garden

  1. 1. Condos in the Big Data Knowledge GardenJack Parkjackpark@topicquests.orgBigData Science Meetup © 2012, TopicQuests This work isShyam Sarkar, Organizer Licensed under a Creative Commons Attribution- NonCommercial-ShareAlike 3.0 Unported License.Fremont California, 12 May, 2012
  2. 2. A Personal JourneyBuilt airplane Undergrad study: aero eng. Built windmills/solar homes Built wind/solar sensors AI to analyze data Collective intelligence Knowledge gardens It’s a waterfall life…
  3. 3. Towards a Big Data Rosetta Stone• The term Rosetta stone has been used idiomatically to represent a crucial key to the process of decryption of encoded information, especially when a small but representative sample is recognized as the clue to understanding a larger whole.*• Let us explore that idea with http://en.wikipedia.org/wiki/File:Rosetta_Stone.JPG open source socio-technological infrastructures *http://en.wikipedia.org/wiki/Rosetta_Stone
  4. 4. “Discovery consists ofseeing what everybodyhas seen and thinkingwhat nobody hasthought.” –Albert Szent-Györgyi
  5. 5. Big Data Gardening• Apply ongoing organic (capable of generative self-organization) processes to large and continually growing datasets – Tended from the point of view of individuals, of groups and topic-oriented projects, and of globally connected gardens in the jungle of knowledge. http://en.wikipedia.org/wiki/File:The_Thinker,_Rodin.jpg
  6. 6. What is a Knowledge Garden? A Knowledge Garden fuses Social with Technical and Political Condo Condo (Topic (Topic Garden) Garden) Federated Information ResourcesCollections of participants Condoat topic-centric portals (Topic(condos) with all Garden)information resourcesfederated
  7. 7. What is a Condo• A Social Contract Federation* – Sensemaking • Collaboration • Collective Intelligence – Discovery Games – Learning• User Experience Topic – Epistemic games Other Map – Structured conversations – Social gardening • Tagging Research Tools • Annotating Conversation • Connecting Tools * http://www.knowledgefederation.org
  8. 8. Garden Workflow Big Picture Encyclopedia World of Information Workbench Sources Topic Map•Collect and curate information resources•Transfer them to a Workbench •Annotate, Tag, Connect ideas at the Workbench•Create summary topics in the Encyclopedia •Blogs, Reports, Journalism, …•Organize Workbench resources in Topic Map •Federate, share,…
  9. 9. Topic Maps• A Topic Map is like a library* – A Topic Map is indexical • Like a card catalog – Each topic has its own representation • Improving on a card catalog, a topic can be identified many different ways – A Topic Map is relational • Like a good road map – Topics are connected by associations – Topics point to their occurrences in the territory – A Topic Map is organized • Multiple records on the same topic are co-located in the map *A library without all the books: a map is not its territory
  10. 10. Why Garden?From the perspective ofcomplexity theory, emergencearises from complex systemsthat create new propertiesfrom “autonomous unitiescoming together into larger,more powerful unities” Olen Gunnlaugson (2011). A Complexity Perspective on Presencing. Complicity, Vol 9, No 1 (2012). Online at: http://ejournals.library.ualberta.ca/index.php/complicity/article/view/9624/8561
  11. 11. A Scenario—Federating Disparate Conversations and Discovery Discovery? Similar conversations can occur across disciplines with Big Data
  12. 12. Scenario: Meet Joe Joe is in Medical School studying to be a physician Joe is preparing for a test on Bacterial Infections
  13. 13. Scenario: Joe’s Gardening Bookmark page with these tags Web page discovered by Joe Immune Response Bacterial Infectionmacrophages use free radicals to Macrophage kill bacteria Free Radical Reactive Oxygen Annotate page with this idea Use garden condo tools to record discoveries
  14. 14. Scenario: Meet Sarah Sarah lives a healthy lifestyle Sarah reads that free radicals can cause cancer
  15. 15. Scenario: Sarah’s Gardening Bookmark page with these tagsWeb page discovered by Sarah antioxidants Antioxidant kill free radicals Free Radical Annotate page with this idea Use garden condo tools to record discoveries
  16. 16. Scenario: Meet Ben Ben is a cancer patient with recurring bacterial infections Ben visits a garden condo to research bacterial infections
  17. 17. Scenario: Ben’s Garden ResearchBen becomes curiousabout free radicals—a Ben makes a discoverynew concept to him Free Radical macrophages use antioxidants free radicals to kill kill bacteria free radicals The Free Radical tag has created a kind of wormhole (tunnel) that links ideas together. The opportunity is to recognize the importance of those connections.
  18. 18. Scenario: Ben’s GardeningBen has an epiphany Sounds like I should not take any more antioxidant pills! macrophages use antioxidants free radicals to Must Avoid kill kill bacteria free radicals Emergence: Ben adds a new In philosophy, systems theory, science, Connection between and art, emergence is the way complex the two ideas systems and patterns arise out of a multiplicity of relatively simple interactions.* *http://en.wikipedia.org/wiki/Emergence
  19. 19. Scenario: Meet Olivia Olivia is a Medical Doctor interested in immune system subjects
  20. 20. Scenario: Olivia’s Garden Research macrophages use antioxidants free radicals to Must Avoid kill kill bacteria free radicals “Must Avoid” Need to restate this doesn’t really information convey a proper sense of reality Olivia visits the garden
  21. 21. Scenario: Olivia’s Gardening Bacterial Infection Contraindicates Antioxidants Because macrophages use antioxidants free radicals to kill kill bacteria free radicalsOlivia gets bonuspoints for justifying Create a new set ofher assertion. representations by connecting the two core concepts and explaining the connection Use garden condo tools to record discoveries
  22. 22. Scenario: Starting a Conversation Bacterial Infection Contraindicates Antioxidants A Challenge is posed to Olivia’s primary assertion
  23. 23. Scenario: The Conversation Structured conversation responses to the question “Compromised host” as a newconcept to be represented in the garden’s topic map Use garden condo tools to record discoveries
  24. 24. Scenario: Garden Results Co-created resource in Compromised Host the garden Appropriate ForBacterial Infection Contraindicates Antioxidants Because macrophages use antioxidants free radicals to kill kill bacteria free radicals Use garden condo tools to record discoveries
  25. 25. Big Data
  26. 26. Use Cases for a Big Data Garden• Resource Collection – Federation • bring together and organize without filters• Resource Augmentation – Tagging – Annotating Condo – Debate (Topic• Knowledge Cartography Garden) – Connecting resources Federated – Map maintenance Information – More Debate Resources• Research Augmentation – Crowd-sourced discovery – Automated inferences /reasoning – Knowledge sharing
  27. 27. A View of Big Data Computing• Solr + Hadoop = Big Data Love* – Article gives a hint at an approach to using off-the- shelf open source software to support Big Data – We consider it as a baseline for design *(concept and image)http://architects.dzone.com/articles/solr-hadoop-big-data-love
  28. 28. Candidate Federation Architecture
  29. 29. TopicQuests Garden Topology Medical Topic Other Topic Other TopicAdd-On Agents New Condo New Condo Garden Gardens New Condo Garden Gardens New Condo New Condo New Condo New Condo New Condo New Condo New Condo IdentiMe API Personal Microblog PoliticalTopic Other Topic Education Other Topic New Condo New Condo Garden Gardens New Condo Topic Garden Gardens New Condo New Condo New CondoSupport / R&D Know New Condo New Condo New Condo New Condo Read Only Bulk User Free Access User Knowledge API Federation Server TopicQuests KG Admin TopicQuests Non-Profit Non-Profit Knowledge Garden
  30. 30. A Strong Conjecture• A Knowledge Federation’s topic map provides a Rosetta Stone substrate – Supports reasoning by analogy – Big Data population studies (probabilities and statistics) provide clues added to the map – A well-organized map of the growing territory provides a navigable terrain to support journeys of discovery
  31. 31. Completed Representation Compromised Host Appropriate For Bacterial Infection Contraindicates Antioxidants Because macrophages use Gardens and Co-create antioxidants free radicals to kill kill bacteria Big Data Science Federate free radicalsThanks to Mark Szpakowski , Patrick Durusau , and Martin Radley forvaluable comments

×