NewsPatterns
Simon Price and Ben Joyner
Internet Development / Web Futures
WHO
WHY
• “... pioneer principled methods of
pattern analysis, statistical modelling
and computational learning as core
enabling technologies for multimodal
interfaces that are capable of natural
and seamless interaction with and
among individual human users.”
• Machine learning has a crucial role
in:
– Machine Vision
– Speech
– Haptics
– Brain Computer Interfaces
– Information Extraction
– Natural Language Processing
WHAT
AI Research Group
• Promote public understanding of
pattern analysis research.
• Apply to news on the Web.
• Create audience-specific (not
technology-specific) websites:
– NewsPatterns
– CelebrityWatch
– ElectionWatch
– ScienceWatch
– etc...
ILRT Internet Development
• Advise on Web technologies.
• Develop public facing websites.
• Give the AI Research Group the
capability to re-use designs.
HOW
1. Crawl the Web, fetching news feeds and web pages into a big database.
2. Mine patterns in the big database to create interesting new news feeds.
3. Every 6 hours, transform the new news feeds into thousands of web pages.
A quick sketch of Pattern Analysis
• Some key processing steps:
– Get text
– Parse text
– Get named entities
– Statistical analysis
– Association mining
– Subsequence mining
– Geo-location
• Example: social network analysis:
– Co-occurrence network
– Path analysis
– Rank by connectivity in social network
– Cluster
– Time series
NewsPatterns
CelebrityWatch
ElectionWatch
ScienceWatch
Demo
Summary
• Why I think this is a good project for ILRT
Directly supports research
Visibly publicises research outcomes
Established ongoing relationship for ILRT to
similarly support their future research bids

NewsPatterns - visualisation layer of news feed mining

  • 1.
    NewsPatterns Simon Price andBen Joyner Internet Development / Web Futures
  • 2.
  • 3.
    WHY • “... pioneerprincipled methods of pattern analysis, statistical modelling and computational learning as core enabling technologies for multimodal interfaces that are capable of natural and seamless interaction with and among individual human users.” • Machine learning has a crucial role in: – Machine Vision – Speech – Haptics – Brain Computer Interfaces – Information Extraction – Natural Language Processing
  • 4.
    WHAT AI Research Group •Promote public understanding of pattern analysis research. • Apply to news on the Web. • Create audience-specific (not technology-specific) websites: – NewsPatterns – CelebrityWatch – ElectionWatch – ScienceWatch – etc... ILRT Internet Development • Advise on Web technologies. • Develop public facing websites. • Give the AI Research Group the capability to re-use designs.
  • 5.
    HOW 1. Crawl theWeb, fetching news feeds and web pages into a big database. 2. Mine patterns in the big database to create interesting new news feeds. 3. Every 6 hours, transform the new news feeds into thousands of web pages.
  • 6.
    A quick sketchof Pattern Analysis • Some key processing steps: – Get text – Parse text – Get named entities – Statistical analysis – Association mining – Subsequence mining – Geo-location • Example: social network analysis: – Co-occurrence network – Path analysis – Rank by connectivity in social network – Cluster – Time series
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
    Summary • Why Ithink this is a good project for ILRT Directly supports research Visibly publicises research outcomes Established ongoing relationship for ILRT to similarly support their future research bids