Your SlideShare is downloading. ×
  • Like
Hawaii Pacific GIS Conference 2012: Real-Time Data Acquisitions - Social Media Mapping: Unstructured Data Indexing & Geospatial Search
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Now you can save presentations on your phone or tablet

Available for both IPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Hawaii Pacific GIS Conference 2012: Real-Time Data Acquisitions - Social Media Mapping: Unstructured Data Indexing & Geospatial Search

  • 3,762 views
Published

 

Published in Technology , Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
3,762
On SlideShare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
12
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. APAN - Social Media Mapping:UNSTRUCTURED DATA INDEXING & GEOSPATIAL SEARCH Presented By Harley Powers Parks, GISP – Geospatial Visualization Web DeveloperTy Wooldridge – Pacific War Fighting Center DirectorJerry Giles – APAN Technical Director Will Yip – APAN Software Development LeadTim Gramp – APAN Technical Initiatives Manager Todd Hall – APAN Project Manager
  • 2. UNCLASSIFIED 3/14/2012AGENDA BLUF, Where We Are & The Way Forward Why APAN Exists, The Users & The Site Developing & The Team Conclusion & Questions 2
  • 3. BLUF: APAN automated the geographic tagging (Geo-Tag) of social media content, to include blogs, wikis, forums, & media galleries. This GIS implementation demonstrates the interoperability Between APAN and a Geographic Text Searching & Referencing System. https://community.apan.org is tagging automated? What is a Geo-Tag and how Improvements:  Tag is a word or phrase used to make it easier for  Maps display locations of people to find a relevant document while searching. Social Media content.  Geo-Tags are Geographic Locations  Multi-Faceted Searches are  Unstructured data is analyzed to determine if phrases improved with a geographic or nouns are place names facet.  Attributes:  Place Name  Confidence % (relevant to content)  Geo-Tag Anchor (location, length)  data includes attributes, like location and  Place names are matched toa reference (anchor) within Geographic Place Names. document, & source  Attributes: Geographic Name Name  Geographic Place  Point (lat, long)  Weight % (population)  Type (topo, hydro, political, etc.)  Category (city, state, park, lake, building, etc.) 33/14/2012 UNCLASSIFIED
  • 4. WHERE WE ARE – RICH EDITING IN A BLOG, MEDIA, FORUM, OR WIKI Place Names Identified: Tulagi, Florida Islands, Solomon Island, Lunga Point, & Guadalcanal. Other sites located beyond map extent were also identified. Map is displayed when editing post By default, APAN will Geo- Tag content unless the author wants to exclude, create, or remove Geo-Tag Main post is processed for Geo-Tag, while threads and comments are not. Authors Can Move or Edit the Name of a Geo-Tag 43/14/2012 UNCLASSIFIED
  • 5. WHERE WE ARE – READING BLOGS, SHARING DATA, DISCUSSING, TEACHING OR LEARNING. Place Names Identified: Savo Island, Lunga Point, & Guadalcanal Map is displayed for Geo- Tag content. Main post is processed for Geo-Tag, while threads and comments are not. The map placement and some dynamic design is possible at runtime. 53/14/2012 UNCLASSIFIED
  • 6. WAY FORWARD – SEARCH RESULTS, MAP CHIPS Search results page view of map or Map “chips” is a user “facet” choice Map “chip” indicates a Geo-Tag search result Map UI interaction allows for spatial queries Search Term: “Torpedo or Scuttle” 63/14/2012 UNCLASSIFIED
  • 7. WAY FORWARD – SEARCHING, MAP CENTRIC Map Centric Search Result Callout Box summarizes social media content Clustering of points allow for large index returns with no impact on viewing Symbology compliments facet search options Search Term: “Torpedo or Scuttle” 73/14/2012 UNCLASSIFIED
  • 8. WAY FORWARD – GROUP SOCIAL MEDIA MAP LIBRARY  Mapping Library allows users to create thematic maps  Standard spatial data formats & web service distribution  Attention to Branding  Group Customization  Intuitive, Visually Aesthetic  Standard Extension Path  Fluid Data Transitions 83/14/2012 UNCLASSIFIED
  • 9. UNCLASSIFIED 3/14/2012AGENDA BLUF, Where We Are & The Way Forward Why APAN Exists, The Users & The Site Developing & The Team Conclusion & Questions 9
  • 10. UNCLASSIFIED 3/14/2012 WHY APAN EXISTS... STABILITY “To improve regional stability operations coordination and interoperability, U.S. Pacific Command sponsors… APAN, an unclassified internet-based collaboration portal for humanitarian assistance and disaster relief operations.”2007 – Secretary of Defense Report on the Directive 3000.5 Military Support For Stability,Security, Transition and Reconstruction (SSTR)2011 – Defense Information Systems Agency funds APAN for All COCOMs & Partners 10
  • 11. UNCLASSIFIED 3/14/2012THE USERS 30,000+ Registered Users 11
  • 12. UNCLASSIFIED 3/14/2012THE USERS – THE PEOPLE WE SERVE Unclassified Information Sharing (UIS) and Collaboration with APAN Stakeholder & Partners:  U.S. & Joint Military Forces  Multi-National Partners  Non-Government Organizations  U.S. Interagency  Medical Community  Civilian Authorities 12
  • 13. UNCLASSIFIED 3/14/2012THE USERS – USAGE Total Page Views - (2010 - 2011)2,000,000.001,800,000.001,600,000.00 1.7 million page1,400,000.00 Panamax views (Tomodachi)1,200,000.001,000,000.00 233K page 800,000.00 views 600,000.00 400,000.00 200,000.00 - Key growth drivers 2010-2011  Haiti-related awareness  SOUTHCOM adoption  Training and exercise utilization  Continued real-world event response  Focused customer engagement (coaching) 13
  • 14. THE SITE Single Sign On Home Page Single Sign On Join Announcements HA/DR Exercises Communities Support 143/14/2012 UNCLASSIFIED
  • 15. THE SITE – USER PROFILES • Personal profiles • highlighting training, • professional experience • qualifications 153/14/2012 UNCLASSIFIED
  • 16. THE SITE – COMMUNICATION Communication via email, real-time multilingual chat, and private messaging Email hosting (@apanmail.org) Private conversations Browse colleagues Real-time, multilingual text chat (peer-to-peer and group) 163/14/2012 UNCLASSIFIED
  • 17. THE SITE – COLLABORATION Collaboration via blogging, discussion forums and community-managed wiki resources 173/14/2012 UNCLASSIFIED
  • 18. UNCLASSIFIED 3/14/2012AGENDA BLUF, Where We Are & The Way Forward Why APAN Exists, The Users & The Site Developing & The Team Conclusion & Questions 18
  • 19. UNCLASSIFIED 3/14/2012DEVELOPING – REQUIREMENTS  APAN Users’ need to find relevant information within multiple facets, including geography, as part of APAN’s Social Media search capability.  Users will spend little time digitizing the geographic names contained within social media textual content.  Users who choose to map APAN Social Media, require intuitive tools. 19
  • 20. DEVELOPING – DATA SOURCES & SERVICES Google’s Map Services APAN – Services (geo-text-search-referencing) APAN Social Media – Unstructured Data  Blogs  Forums  Wikis  Media ~ limited size, file geotags & unstructured data COCOM & Partner Data Sources
  • 21. UNCLASSIFIED 3/14/2012DEVELOPING – THE ENVIRONMENT Virtualization  Widget Studio -  VMWare workstation  JQuery or fusion  Velocity  Windows 2008 servers  API’s  Web Server & Systems  SqlServer  Windows 7  Team Foundation Server  Visual Studio  C#  Javascript 21
  • 22. UNCLASSIFIED 3/14/2012DEVELOPING – SYSTEMSConceptual View 22
  • 23. UNCLASSIFIED 3/14/2012DEVELOPING – SUB SYSTEMS Social Media Website –  Google Maps Chat, Forum, Blog, Media,  Geographic Search & Wiki, Search Referencing Platform  Telligent  Metacarta Web Map  Debian Linux  Telligent Job Scheduler  Apache –  Tomcat - Solr  Manifold Cf – Web Crawler Scheduler RDBMS  TomCat – application server  Microsoft SQLSever  Solr – Search Engine  Tika – Document Parsing Microsoft Content Portal -  UIMA – unstructured SharePoint information management  PostGreSql GIS  ESRI ArcGIS Server 23
  • 24. UNCLASSIFIED 3/14/2012DEVELOPING – APPROACH Concept Solution Data GeoTag Data, Store, Schedule Solr Index Solr Index as Telligent Search Results. MetaCarta Index 24
  • 25. UNCLASSIFIED 3/14/2012DEVELOPING – PLANSPlanning is integral personal experience  Agile Approach  Sprints – 30 days  Daily Participation  GIS Lifecycle System Planning  Provides the overall iteration direction 25
  • 26. UNCLASSIFIED 3/14/2012THE TEAM Ty Wooldridge – PWC Director Jerry Giles – APAN Technical Director Tim Gramp – APAN Technical Initiatives Manager Will Yip – APAN Software Development Lead Todd Hall – APAN Project Manager  Staffing  10 Developers –  Dan Warner, Jonathan Idica, & Harley Parks  6 Knowledge Managers –  Alex Conway & Jenney Tagorda Pacific Warfighting Center Ford Island  Simulation & Exercises Support Team, IA, UIS, etc. – (15) 26
  • 27. CONCLUSION & QUESTIONS 1. APAN serves DOD U.S. Joint Forces & Mission Partners 2. APAN is for Unclassified Information Sharing & Collaboration 3. APAN supports 30,000 Users & a Site for blogging, discussing, creating wikis, sharing media, mapping, and multi-facet searching 4. APAN is developing Social Media GIS interoperable applications 5. APAN has a Great Team of Leaders, Developers, Knowledge Managers & support. 6. Bottom Line:APAN automated the geographic tagging (Geo-Tag) of social media content, to includeblogs, wikis, forums, & media galleries. This GIS implementation demonstrates theinteroperability between APAN and a Geographic Text Searching & ReferencingSystem. 27 3/14/2012 UNCLASSIFIED
  • 28. THE SPRINT – REQUIREMENTS Knowledge Managers Work With Developers Automate the Metacarta Geotag process when Social Media is created, updated, or deleted During the Solr indexing, provide the stored geotag information Allow users to delete or create points Allow users to modify the location or the name of a geotag 283/14/2012 UNCLASSIFIED
  • 29. THE SPRINT – USER STORIES Interaction From The Users Perspective User Stories Detail’s the experience when interacting with the website UI While suggesting design decisions, the described capability becomes the requirement. 293/14/2012 UNCLASSIFIED
  • 30. THE SPRINT – IMPLEMENTATION DETAILS Images, Proof of Concepts, Task details Capture concepts that will break down difficult tasks into easily completed activities Data Requirements Data Sources It maybe necessary to pull details into a separate document 303/14/2012 UNCLASSIFIED
  • 31. THE SPRINT – TASK SCHEDULE & TEST PLAN General Tasks with Schedule & Test Plan  Task Schedule or time needed to complete the task is the primary concern  As Product near a level of completion, KMs will create test plans  Test Plans list key functionality and the expected UI interaction 313/14/2012 UNCLASSIFIED
  • 32. UNCLASSIFIED 3/14/2012AGENDA BLUF, Product & Way Forward Development & The Sprint The Team, The Vision, Our Mission, Guidelines, Strategy, & The People We Serve Why APAN Exists The Users & The Site Conclusion & Questions 32
  • 33. UNCLASSIFIED 3/14/2012THE VISION APAN is a Community of Communities Portal that combines the benefits of Unstructured Collaboration (wikis, blogs, forums, SMS texting, & mapping) and Structured Collaboration (SharePoint, file sharing, calendar, & GIS) with the personalization of Social Networking. 33
  • 34. UNCLASSIFIED 3/14/2012OUR MISSION Enable our Stakeholders to Connect, Integrate and Collaborate while Building Partnerships and Sharing Unclassified Information. 34
  • 35. UNCLASSIFIED 3/14/2012GIS GUIDELINES Build in Geospatial Data Management Accommodate the overall strategy for APAN going forward Provide Solutions that are Flexible and Scalable 35
  • 36. UNCLASSIFIED 3/14/2012GIS STRATEGY Embrace security policies, Harvest unstructured geographic data sources, Utilize crowd sourcing, Procure or establish data partnerships, and Propose strategic directions while  Supporting continuous Agile development Engage GIS Lifecycle Planning  Build It 36
  • 37. UNCLASSIFIED 3/14/2012GIS GOALS Integrate technologies for real-time response Connect organizations across the globe Provide rescue and relief information for those in need Surface instant photos of disaster areas Present critical data and insight to mission commanders & partners 37
  • 38. UNCLASSIFIED 3/14/2012AGENDA BLUF, Product & Way Forward Development & The Sprint The Team, The Vision, Our Mission, Guidelines, Strategy, & The People We Serve Why APAN Exists The Users & The Site Conclusion & Questions 38
  • 39. UNCLASSIFIED 3/14/2012 WHY APAN EXISTS… DSCA INTERFACE Defense Support of Civil Authorities  Incident Awareness and Assessment Systems (IAA)  requires geospatial data acquisition  Handbook recommends… “Ask what maps the civilian agencies are using and how you can obtain them… so that everyone is operating from the same map.” 39
  • 40. UNCLASSIFIED 3/14/2012WHY APAN EXISTS… OPEN GOVERNMENT Office of Management and Budget Issues Open Government Directive DOD Open Government Plan, April 7, 2010  http://open.dodlive.mil Sites APAN as part of DOD’s Open Government Plan  Haiti Earthquake (1/12/2010) Relief“DISA and the US Southern Command… quickly activatedcollaboration platforms… All Partners Access Network(APAN) …”“Within days over 1,700 organizations and individuals…” 40
  • 41. UNCLASSIFIED 3/14/2012WHY APAN EXISTS… DISA FUNDING! APAN Centrally Funded for all -  Combatant Commands (COCOMs) to use with  Mission Partners in their respective areas of responsibility (See Map) Defense Information Systems Agency  Responsible for the management and funding of the existing “All Partners Access Network”  APAN serves as the baseline for DOD UIS System 41
  • 42. WHY APAN EXIST– OPERATION TOMODACHI Japan Earthquake & Tsunami 2011, Case Study 423/14/2012 UNCLASSIFIED
  • 43. WHY APAN EXIST – AFRICA ENDEAVOR Exercises 433/14/2012 UNCLASSIFIED
  • 44. WHY APAN EXIST – AFRICOM PARTNER NATION TRAINING Training 443/14/2012 UNCLASSIFIED
  • 45. UNCLASSIFIED 3/14/2012AGENDA BLUF, Product & Way Forward Development & The Sprint The Team, The Vision, Our Mission, Guidelines, Strategy, & The People We Serve Why APAN Exists The Users & The Site Conclusion & Questions 45
  • 46. THE SITE – FILE SHARING Document hosting and sharing including pictures and video GIS, as a principal work flow, has always been part of APAN 463/14/2012 UNCLASSIFIED
  • 47. THE SITE – DISCOVERY Information discovery by enterprise search, keyword tagging, Really Simple Syndication (RSS) and email notifications 473/14/2012 UNCLASSIFIED
  • 48. THE SITE – INFORMATION SHARING Improvements Increased platform integration –Inference engine – helping more robust REST web service APIusers find information before and widget framework extensibility.they start looking for it (topical Enhanced SharePoint capabilitiesand geospatial relevance) Mobile and low-bandwidth Accessibility -- Focus on situational awareness & contribution. Enhance discovery through improved navigation and search. 48 3/14/2012 UNCLASSIFIED