Openkapow At Mashup Camp 5


Published on

Introduction to why there is a need to use unstructured web data in mashups and how to get to that data using Breif overview of Enterprise Mashup Use Cases.

Presentation from Mashup Camp 5 in Dublin.

Published in: Technology
1 Comment
1 Like
  • Not really. Openkapow is based on technology that has been battle tested by large international companies (Audi, Bank of America etc) for over 7 years. It does allow you to have full control over the process flow of the 'web scraping' as well as develop without using any programming. After all you can still do basic web scraping using Perl and PHP, however it doesnt scale, you will have problems with javascript, cookies etc etc.<br /><br/>
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Openkapow At Mashup Camp 5

  1. 1. Where are all the APIs and Web Services? Build APIs to any web site in minutes using Andreas Krohn Product Manager Kapow Technologies
  2. 2. Agenda <ul><li>Building Mashups </li></ul><ul><li> </li></ul><ul><li>Demo </li></ul><ul><li>Enteprise Mashup Use Cases </li></ul>
  3. 3. Building Mashups <ul><li>“ Mashup (web application hybrid), a web application that </li></ul><ul><li>combines data and/or functionality from more than one </li></ul><ul><li>source” </li></ul><ul><li>Wikipedia </li></ul><ul><li>Web application that combines data and/or functionality.... </li></ul><ul><ul><li>IBM QEDWiki </li></ul></ul><ul><ul><li>MS Popfly </li></ul></ul><ul><ul><li>Serena Mashup Composer </li></ul></ul><ul><ul><li>BEA AquaLogic Pages </li></ul></ul><ul><ul><li>Google Mashup Editor </li></ul></ul><ul><ul><li>JackBe </li></ul></ul><ul><ul><li>Excel </li></ul></ul><ul><ul><li>C# </li></ul></ul><ul><ul><li>Java </li></ul></ul><ul><ul><li>Flex </li></ul></ul><ul><ul><li>Ruby on Rails </li></ul></ul><ul><ul><li>PHP </li></ul></ul><ul><ul><li>JavaScript </li></ul></ul><ul><ul><li>Etc... </li></ul></ul>
  4. 4. Building Mashups <ul><li>“ Mashup (web application hybrid), a web application that </li></ul><ul><li>combines data and/or functionality from more than one </li></ul><ul><li>source” </li></ul><ul><li>Wikipedia </li></ul><ul><li>... data and/or functionality from more than one source </li></ul><ul><li>Where is this data? </li></ul><ul><ul><li>Databases - only 15-20% data is structured! </li></ul></ul><ul><ul><li>Proprietary APIs - Classes, Web Services </li></ul></ul><ul><ul><ul><li> </li></ul></ul></ul><ul><ul><li>Feeds </li></ul></ul>
  5. 5. <ul><li>Free Mashup Community </li></ul><ul><li>Based on Kapow Mashup Server ( </li></ul><ul><ul><li>Used by Audi, Bank of America, SimplyHired, Vodafone and 100’s of other Enterprise customer </li></ul></ul><ul><li>Build ”robots” to automate what can be done in a browser </li></ul><ul><ul><li>Share with the community </li></ul></ul><ul><ul><li>Use in your Mashups </li></ul></ul><ul><li>Create REST services or RSS/Atom feeds to almost any website in minutes </li></ul><ul><ul><li>XML, CSV, JSON, HTML </li></ul></ul>
  6. 6. Difficulties with the Web as a data source <ul><li>Unstructured data </li></ul><ul><li>Dynamic data </li></ul><ul><li>HTML Tag Soup </li></ul><ul><li>Navigating multiple pages </li></ul><ul><li>JavaScript </li></ul><ul><li>Cookies, Sessions, Authentication etc </li></ul><ul><li>Stability </li></ul><ul><li>Scalable solutions (quick to build, easy to maintain) </li></ul>
  7. 7. Demo Overview <ul><li>People Search Demo built in Flex </li></ul><ul><li>Searching LinkedIn & Spock via Kapow Robots </li></ul><ul><li>Flex calls these robots as REST services and gets XML back </li></ul><ul><li>The robots interact with and directly, not via a predefined API </li></ul>Flex App openkapow LinkedIn Spock Robots REST XML
  8. 8. Enterprise Mashup Use Cases <ul><li>Opportunistic Applications </li></ul><ul><ul><li>Situational Applications </li></ul></ul><ul><ul><li>Mashups-on-the-fly </li></ul></ul><ul><ul><li>Example: Audi </li></ul></ul><ul><li>Repurposing </li></ul><ul><ul><li>Portal Enablement </li></ul></ul><ul><ul><li>Mobilising Applications </li></ul></ul><ul><ul><li>Example: Deutsche Post </li></ul></ul><ul><li>Web Automation </li></ul><ul><ul><li>Content Migration </li></ul></ul><ul><ul><li>Swivel-chair automation </li></ul></ul><ul><ul><li>Example: GMX </li></ul></ul><ul><li>Data Collection </li></ul><ul><ul><li>Competative Intelligence </li></ul></ul><ul><ul><li>Reputation Management </li></ul></ul><ul><ul><li>Example: SimplyHired </li></ul></ul>
  9. 9. Find me at Speedgeeking and I am going to build REST services on request