SlideShare a Scribd company logo
Using Yahoo Pipes to access data from web pages THATCamp Canberra 2011
Why Yahoo Pipes? Browsers impose same-domain restriction on requesting XML/HTML/CSV content to include in web pages We can use server side technologies to retrieve data from external sources, but what about when we don’t have access to those technologies? (e.g. embedding content in a blog post)  Yahoo Pipes convert data sources to JSON (JavaScript Object Notation) which can be included via JavaScript on web pages without restrictions  http://pipes.yahoo.com
Example mashup
convictbook data sources Trove People & Organisations SLQ convict data Web page : hosted within a Content Management System  (HTML + CSS  + JavaScript + jQuery) CSV SRU Query Result (XML) Google Refine (Data clean up) Yahoo Pipes CSV JSON Visualisation links JSON Yahoo Pipes Google  FusionTables Query (XML) CSV Picture Australia data
Pipe : Trove People by name http://pipes.yahoo.com/pipes/pipe.info?_id=eed133e99c38a68d20d279e46cee66e6
Yahoo Pipes
JSON { "count" : 1,     "value" : {         "title" : "ConvictIDGet",         "description" : "Pipes Output",         "link" : "http:pipes.yahoo.compipespipe.info?_id=c8b70fd9d9f6edcfbb7c0e351992e717",         "pubDate" : "Thu, 06 Oct 2011 22:49:50 -0700",         "generator" : "http:pipes.yahoo.compipes",         "callback" : "",         "items" : [{             "convictid" : "200",             "name" : "Frederick Beadle",             "one_of" : "one of 296 convicts transported on the Pyrenees",             "convicted" : "Central Criminal Court",             "term_duration" : "10 years",             "conviction_date" : "",             "notes" : "Ticket of Leave.",             "vessel" : "Pyrenees",             "departure_date" : "31 January 1853",             "destination" : "Western Australia",             "microfilmref" : "Australian Joint Copying Project. Microfilm Roll 93, Class and Piece Number HO1118, Page Number 3 (3)",             "surname" : "Beadle",             "given_names" : "Frederick",             "y:row" : "2",             "description" : null,             "title" : null         }] }} Tip: Use http://jsonlint.com/ to  validate and format JSON
JSON for Trove People query {     "count" : 1,     "value" : {         "title" : "TrovePeople",         "description" : "Pipes Output",         "link" : "http:pipes.yahoo.compipespipe.info?_id=c3412dfcaf40a54bdcd0273b293174e5",         "pubDate" : "Thu, 06 Oct 2011 22:50:47 -0700",         "generator" : "http:pipes.yahoo.compipes",         "callback" : "",         "items" : [{             "xmlns" : "http:www.loc.govzingsrw",             "version" : "1.1",             "numberOfRecords" : "265",             "resultSetId" : "kc2umf",             "resultSetIdleTime" : "300",             "records”:  {"record" : [{ "recordSchema" : "http:www.w3.org2005Atom", "recordPacking" : "xml", "recordData" : { "entry" : { "id" : "http:nla.gov.aunla.party-529154", "link" : [{ "href" : "http:nla.gov.aunla.party-529154” }, { "href" : "http:nla.gov.auanbd.aut-an35513577", "rel" : "related” }, { "href" : "http:www.adb.online.anu.edu.aubiogsA100015b.htm",  "rel" : "related”}], "author" : { "name" : "National Library of Australia Party Infrastructure”}, "published" : "2008-12-10T15:20:01Z", "title" : "Lawson, H. S. W.", "content" : { "type" : "textplain", "content" : "Alternate names: Lawson, Harry Sutherland Wightman; Lawson, Harry Sutherland Wightman, Sir” }}},  "recordPosition" : "1” },  … }]}}
Including JSON data using jQuery Live example: http://jsfiddle.net/AnnaGerber/cbJrc/ <html><head><title>Demo</title></head> <script type=“text/javascript” src=“jQuery.js”></script> <script type="text/javascript">  function findPeople(pName) {     varurl = "http://pipes.yahoo.com/pipes/pipe.run?_id=eed133e99c38a68d20d279e46cee66e6&_render=json&name=" + pName;     $.getJSON( url, function( data ) {         varoutputHTML = "”;         $.each(data.value.items[0].records.record, function( index,item ) {              var record=item.recordData.entry;             outputHTML += "<li><a target='_blank' href='”  + record.link[0].href  +"'>"                + record.title   + "</a></li>";         });         $('#output').html(outputHTML);      }); }); $(document).ready(function(){ findPeople(‘Lawson’);  }); </script></head><body> <h1>People</h1> <ul id=“output"></ul> </body></html> Tip: use browser inspector + console.log() to inspect data

More Related Content

What's hot

Bachelor Diploma.PDF
Bachelor Diploma.PDFBachelor Diploma.PDF
Bachelor Diploma.PDF
Mindaugas Brazauskas
 
Aap manifesto delhi power
Aap manifesto delhi powerAap manifesto delhi power
Aap manifesto delhi power
Sadanand Patwardhan
 
زُبَرَ الْحَدِيدِ و الْقِطْرِ
زُبَرَ الْحَدِيدِ و الْقِطْرِزُبَرَ الْحَدِيدِ و الْقِطْرِ
زُبَرَ الْحَدِيدِ و الْقِطْرِ
Dr. GM Sherbini
 
Hebrew Bible as Data: Laboratory, Sharing, Lessons
Hebrew Bible as Data: Laboratory, Sharing, LessonsHebrew Bible as Data: Laboratory, Sharing, Lessons
Hebrew Bible as Data: Laboratory, Sharing, Lessons
Dirk Roorda
 
Apn log
Apn logApn log
Apn log
Sangay Rinzin
 
History of Computer Hindi Notes
History of Computer Hindi NotesHistory of Computer Hindi Notes
History of Computer Hindi Notes
SirajRock
 
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue1616 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
Akhil Bharat Mahasabha
 
3 9 july 17 final pdf for print
3 9 july 17 final pdf for print3 9 july 17 final pdf for print
3 9 july 17 final pdf for print
snehalcnp
 
19 january to 25 january 2015 12 18 nav. 12
19 january to 25  january 2015 12 18 nav. 1219 january to 25  january 2015 12 18 nav. 12
19 january to 25 january 2015 12 18 nav. 12
snehalcnp
 
TRB323_023-RR
TRB323_023-RRTRB323_023-RR
TRB323_023-RR
Vic Dal Chele
 

What's hot (10)

Bachelor Diploma.PDF
Bachelor Diploma.PDFBachelor Diploma.PDF
Bachelor Diploma.PDF
 
Aap manifesto delhi power
Aap manifesto delhi powerAap manifesto delhi power
Aap manifesto delhi power
 
زُبَرَ الْحَدِيدِ و الْقِطْرِ
زُبَرَ الْحَدِيدِ و الْقِطْرِزُبَرَ الْحَدِيدِ و الْقِطْرِ
زُبَرَ الْحَدِيدِ و الْقِطْرِ
 
Hebrew Bible as Data: Laboratory, Sharing, Lessons
Hebrew Bible as Data: Laboratory, Sharing, LessonsHebrew Bible as Data: Laboratory, Sharing, Lessons
Hebrew Bible as Data: Laboratory, Sharing, Lessons
 
Apn log
Apn logApn log
Apn log
 
History of Computer Hindi Notes
History of Computer Hindi NotesHistory of Computer Hindi Notes
History of Computer Hindi Notes
 
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue1616 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
 
3 9 july 17 final pdf for print
3 9 july 17 final pdf for print3 9 july 17 final pdf for print
3 9 july 17 final pdf for print
 
19 january to 25 january 2015 12 18 nav. 12
19 january to 25  january 2015 12 18 nav. 1219 january to 25  january 2015 12 18 nav. 12
19 january to 25 january 2015 12 18 nav. 12
 
TRB323_023-RR
TRB323_023-RRTRB323_023-RR
TRB323_023-RR
 

Similar to Using Yahoo Pipes

External Data Access with jQuery
External Data Access with jQueryExternal Data Access with jQuery
External Data Access with jQuery
Doncho Minkov
 
JSON Viewer XPATH Workbook
JSON Viewer XPATH WorkbookJSON Viewer XPATH Workbook
JSON Viewer XPATH Workbook
Suresh Krishna Madhuvarsu
 
Couch Db.0.9.0.Pub
Couch Db.0.9.0.PubCouch Db.0.9.0.Pub
Couch Db.0.9.0.Pub
Yohei Sasaki
 
Illuminated Hacks -- Where 2.0 101 Tutorial
Illuminated Hacks -- Where 2.0 101 TutorialIlluminated Hacks -- Where 2.0 101 Tutorial
Illuminated Hacks -- Where 2.0 101 Tutorial
mikel_maron
 
Web Scraper Shibuya.pm tech talk #8
Web Scraper Shibuya.pm tech talk #8Web Scraper Shibuya.pm tech talk #8
Web Scraper Shibuya.pm tech talk #8
Tatsuhiko Miyagawa
 
Grddl In A Nutshell V1
Grddl In A Nutshell V1Grddl In A Nutshell V1
Grddl In A Nutshell V1
Fabien Gandon
 
Adding timezones into Upcoming feeds
Adding timezones into Upcoming feedsAdding timezones into Upcoming feeds
Adding timezones into Upcoming feeds
Matt Harris
 
REST, the internet as a database?
REST, the internet as a database?REST, the internet as a database?
REST, the internet as a database?
Andrej Koelewijn
 
I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)
Joel Lord
 
Schema design with MongoDB (Dwight Merriman)
Schema design with MongoDB (Dwight Merriman)Schema design with MongoDB (Dwight Merriman)
Schema design with MongoDB (Dwight Merriman)
MongoSF
 
I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)
Joel Lord
 
A brief history of the web
A brief history of the webA brief history of the web
A brief history of the web
Jorge Zapico
 
Preview Of “Preparation Tipitaka Recitation 2008 ”
Preview Of “Preparation Tipitaka Recitation 2008 ”Preview Of “Preparation Tipitaka Recitation 2008 ”
Preview Of “Preparation Tipitaka Recitation 2008 ”
dhammasociety
 
Web 2.0 &amp; Search Engines
Web 2.0 &amp; Search EnginesWeb 2.0 &amp; Search Engines
Web 2.0 &amp; Search Engines
Ambles Kwok
 
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
Dimitris Psounis
 
Bringing Typography to the Web with sIFR 3 at <head>
Bringing Typography to the Web with sIFR 3 at <head>Bringing Typography to the Web with sIFR 3 at <head>
Bringing Typography to the Web with sIFR 3 at <head>
Mark Wubben
 
FOWA 09 - Open Strategy Applied
FOWA 09 - Open Strategy AppliedFOWA 09 - Open Strategy Applied
FOWA 09 - Open Strategy Applied
Dan Theurer
 
Yahoo - Open Applied
Yahoo - Open AppliedYahoo - Open Applied
Yahoo - Open Applied
Carsonified Team
 
Ledtalks vsl lighting
Ledtalks vsl lightingLedtalks vsl lighting
Ledtalks vsl lighting
RolandSyntens
 
HTML5 Web Forms
HTML5 Web FormsHTML5 Web Forms
HTML5 Web Forms
Estelle Weyl
 

Similar to Using Yahoo Pipes (20)

External Data Access with jQuery
External Data Access with jQueryExternal Data Access with jQuery
External Data Access with jQuery
 
JSON Viewer XPATH Workbook
JSON Viewer XPATH WorkbookJSON Viewer XPATH Workbook
JSON Viewer XPATH Workbook
 
Couch Db.0.9.0.Pub
Couch Db.0.9.0.PubCouch Db.0.9.0.Pub
Couch Db.0.9.0.Pub
 
Illuminated Hacks -- Where 2.0 101 Tutorial
Illuminated Hacks -- Where 2.0 101 TutorialIlluminated Hacks -- Where 2.0 101 Tutorial
Illuminated Hacks -- Where 2.0 101 Tutorial
 
Web Scraper Shibuya.pm tech talk #8
Web Scraper Shibuya.pm tech talk #8Web Scraper Shibuya.pm tech talk #8
Web Scraper Shibuya.pm tech talk #8
 
Grddl In A Nutshell V1
Grddl In A Nutshell V1Grddl In A Nutshell V1
Grddl In A Nutshell V1
 
Adding timezones into Upcoming feeds
Adding timezones into Upcoming feedsAdding timezones into Upcoming feeds
Adding timezones into Upcoming feeds
 
REST, the internet as a database?
REST, the internet as a database?REST, the internet as a database?
REST, the internet as a database?
 
I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)
 
Schema design with MongoDB (Dwight Merriman)
Schema design with MongoDB (Dwight Merriman)Schema design with MongoDB (Dwight Merriman)
Schema design with MongoDB (Dwight Merriman)
 
I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)
 
A brief history of the web
A brief history of the webA brief history of the web
A brief history of the web
 
Preview Of “Preparation Tipitaka Recitation 2008 ”
Preview Of “Preparation Tipitaka Recitation 2008 ”Preview Of “Preparation Tipitaka Recitation 2008 ”
Preview Of “Preparation Tipitaka Recitation 2008 ”
 
Web 2.0 &amp; Search Engines
Web 2.0 &amp; Search EnginesWeb 2.0 &amp; Search Engines
Web 2.0 &amp; Search Engines
 
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
 
Bringing Typography to the Web with sIFR 3 at <head>
Bringing Typography to the Web with sIFR 3 at <head>Bringing Typography to the Web with sIFR 3 at <head>
Bringing Typography to the Web with sIFR 3 at <head>
 
FOWA 09 - Open Strategy Applied
FOWA 09 - Open Strategy AppliedFOWA 09 - Open Strategy Applied
FOWA 09 - Open Strategy Applied
 
Yahoo - Open Applied
Yahoo - Open AppliedYahoo - Open Applied
Yahoo - Open Applied
 
Ledtalks vsl lighting
Ledtalks vsl lightingLedtalks vsl lighting
Ledtalks vsl lighting
 
HTML5 Web Forms
HTML5 Web FormsHTML5 Web Forms
HTML5 Web Forms
 

More from Anna Gerber

Internet of Things (IoT) Intro
Internet of Things (IoT) IntroInternet of Things (IoT) Intro
Internet of Things (IoT) Intro
Anna Gerber
 
How the Web works
How the Web worksHow the Web works
How the Web works
Anna Gerber
 
Do you want to build a robot
Do you want to build a robotDo you want to build a robot
Do you want to build a robot
Anna Gerber
 
"Serverless" express
"Serverless" express"Serverless" express
"Serverless" express
Anna Gerber
 
Iot 101
Iot 101Iot 101
Iot 101
Anna Gerber
 
Adding Electronics to 3D Printed Action Heroes
Adding Electronics to 3D Printed Action HeroesAdding Electronics to 3D Printed Action Heroes
Adding Electronics to 3D Printed Action Heroes
Anna Gerber
 
3D Printing Action Heroes
3D Printing Action Heroes3D Printing Action Heroes
3D Printing Action Heroes
Anna Gerber
 
3D Sculpting Action Heroes
3D Sculpting Action Heroes3D Sculpting Action Heroes
3D Sculpting Action Heroes
Anna Gerber
 
International NodeBots Day Brisbane roundup (BrisJS)
International NodeBots Day Brisbane roundup (BrisJS)International NodeBots Day Brisbane roundup (BrisJS)
International NodeBots Day Brisbane roundup (BrisJS)
Anna Gerber
 
JavaScript Robotics
JavaScript RoboticsJavaScript Robotics
JavaScript Robotics
Anna Gerber
 
Intro to Electronics in Python
Intro to Electronics in PythonIntro to Electronics in Python
Intro to Electronics in Python
Anna Gerber
 
Data Visualisation Workshop (GovHack Brisbane 2014)
Data Visualisation Workshop (GovHack Brisbane 2014)Data Visualisation Workshop (GovHack Brisbane 2014)
Data Visualisation Workshop (GovHack Brisbane 2014)
Anna Gerber
 
Supporting Open Scholarly Annotation
Supporting Open Scholarly AnnotationSupporting Open Scholarly Annotation
Supporting Open Scholarly Annotation
Anna Gerber
 
Supporting Web-based Scholarly Annotation
Supporting Web-based Scholarly AnnotationSupporting Web-based Scholarly Annotation
Supporting Web-based Scholarly Annotation
Anna Gerber
 
Annotations Supporting Scholarly Editing (OA European Roll Out)
Annotations Supporting Scholarly Editing (OA European Roll Out)Annotations Supporting Scholarly Editing (OA European Roll Out)
Annotations Supporting Scholarly Editing (OA European Roll Out)
Anna Gerber
 
Annotation Tools (OA European Roll Out)
Annotation Tools (OA European Roll Out)Annotation Tools (OA European Roll Out)
Annotation Tools (OA European Roll Out)
Anna Gerber
 
Intro to data visualisation
Intro to data visualisationIntro to data visualisation
Intro to data visualisation
Anna Gerber
 
Annotations Supporting Scholarly Editing
Annotations Supporting Scholarly EditingAnnotations Supporting Scholarly Editing
Annotations Supporting Scholarly Editing
Anna Gerber
 
Getting started with the Trove API
Getting started with the Trove APIGetting started with the Trove API
Getting started with the Trove API
Anna Gerber
 
Intro to Java
Intro to JavaIntro to Java
Intro to Java
Anna Gerber
 

More from Anna Gerber (20)

Internet of Things (IoT) Intro
Internet of Things (IoT) IntroInternet of Things (IoT) Intro
Internet of Things (IoT) Intro
 
How the Web works
How the Web worksHow the Web works
How the Web works
 
Do you want to build a robot
Do you want to build a robotDo you want to build a robot
Do you want to build a robot
 
"Serverless" express
"Serverless" express"Serverless" express
"Serverless" express
 
Iot 101
Iot 101Iot 101
Iot 101
 
Adding Electronics to 3D Printed Action Heroes
Adding Electronics to 3D Printed Action HeroesAdding Electronics to 3D Printed Action Heroes
Adding Electronics to 3D Printed Action Heroes
 
3D Printing Action Heroes
3D Printing Action Heroes3D Printing Action Heroes
3D Printing Action Heroes
 
3D Sculpting Action Heroes
3D Sculpting Action Heroes3D Sculpting Action Heroes
3D Sculpting Action Heroes
 
International NodeBots Day Brisbane roundup (BrisJS)
International NodeBots Day Brisbane roundup (BrisJS)International NodeBots Day Brisbane roundup (BrisJS)
International NodeBots Day Brisbane roundup (BrisJS)
 
JavaScript Robotics
JavaScript RoboticsJavaScript Robotics
JavaScript Robotics
 
Intro to Electronics in Python
Intro to Electronics in PythonIntro to Electronics in Python
Intro to Electronics in Python
 
Data Visualisation Workshop (GovHack Brisbane 2014)
Data Visualisation Workshop (GovHack Brisbane 2014)Data Visualisation Workshop (GovHack Brisbane 2014)
Data Visualisation Workshop (GovHack Brisbane 2014)
 
Supporting Open Scholarly Annotation
Supporting Open Scholarly AnnotationSupporting Open Scholarly Annotation
Supporting Open Scholarly Annotation
 
Supporting Web-based Scholarly Annotation
Supporting Web-based Scholarly AnnotationSupporting Web-based Scholarly Annotation
Supporting Web-based Scholarly Annotation
 
Annotations Supporting Scholarly Editing (OA European Roll Out)
Annotations Supporting Scholarly Editing (OA European Roll Out)Annotations Supporting Scholarly Editing (OA European Roll Out)
Annotations Supporting Scholarly Editing (OA European Roll Out)
 
Annotation Tools (OA European Roll Out)
Annotation Tools (OA European Roll Out)Annotation Tools (OA European Roll Out)
Annotation Tools (OA European Roll Out)
 
Intro to data visualisation
Intro to data visualisationIntro to data visualisation
Intro to data visualisation
 
Annotations Supporting Scholarly Editing
Annotations Supporting Scholarly EditingAnnotations Supporting Scholarly Editing
Annotations Supporting Scholarly Editing
 
Getting started with the Trove API
Getting started with the Trove APIGetting started with the Trove API
Getting started with the Trove API
 
Intro to Java
Intro to JavaIntro to Java
Intro to Java
 

Recently uploaded

Must Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during MigrationMust Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during Migration
Mydbops
 
High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024
Vadym Kazulkin
 
Christine's Product Research Presentation.pptx
Christine's Product Research Presentation.pptxChristine's Product Research Presentation.pptx
Christine's Product Research Presentation.pptx
christinelarrosa
 
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin..."$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
Fwdays
 
What is an RPA CoE? Session 1 – CoE Vision
What is an RPA CoE?  Session 1 – CoE VisionWhat is an RPA CoE?  Session 1 – CoE Vision
What is an RPA CoE? Session 1 – CoE Vision
DianaGray10
 
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
Fwdays
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
saastr
 
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham HillinQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
LizaNolte
 
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
Jason Yip
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
Alex Pruden
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
ScyllaDB
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
Ajin Abraham
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
PRODUCT LISTING OPTIMIZATION PRESENTATION.pptx
PRODUCT LISTING OPTIMIZATION PRESENTATION.pptxPRODUCT LISTING OPTIMIZATION PRESENTATION.pptx
PRODUCT LISTING OPTIMIZATION PRESENTATION.pptx
christinelarrosa
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Antonios Katsarakis
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
DianaGray10
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
Edge AI and Vision Alliance
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 

Recently uploaded (20)

Must Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during MigrationMust Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during Migration
 
High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024
 
Christine's Product Research Presentation.pptx
Christine's Product Research Presentation.pptxChristine's Product Research Presentation.pptx
Christine's Product Research Presentation.pptx
 
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin..."$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
 
What is an RPA CoE? Session 1 – CoE Vision
What is an RPA CoE?  Session 1 – CoE VisionWhat is an RPA CoE?  Session 1 – CoE Vision
What is an RPA CoE? Session 1 – CoE Vision
 
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
 
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham HillinQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
 
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
PRODUCT LISTING OPTIMIZATION PRESENTATION.pptx
PRODUCT LISTING OPTIMIZATION PRESENTATION.pptxPRODUCT LISTING OPTIMIZATION PRESENTATION.pptx
PRODUCT LISTING OPTIMIZATION PRESENTATION.pptx
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 

Using Yahoo Pipes

  • 1. Using Yahoo Pipes to access data from web pages THATCamp Canberra 2011
  • 2. Why Yahoo Pipes? Browsers impose same-domain restriction on requesting XML/HTML/CSV content to include in web pages We can use server side technologies to retrieve data from external sources, but what about when we don’t have access to those technologies? (e.g. embedding content in a blog post) Yahoo Pipes convert data sources to JSON (JavaScript Object Notation) which can be included via JavaScript on web pages without restrictions http://pipes.yahoo.com
  • 4.
  • 5. convictbook data sources Trove People & Organisations SLQ convict data Web page : hosted within a Content Management System (HTML + CSS + JavaScript + jQuery) CSV SRU Query Result (XML) Google Refine (Data clean up) Yahoo Pipes CSV JSON Visualisation links JSON Yahoo Pipes Google FusionTables Query (XML) CSV Picture Australia data
  • 6. Pipe : Trove People by name http://pipes.yahoo.com/pipes/pipe.info?_id=eed133e99c38a68d20d279e46cee66e6
  • 8.
  • 9. JSON { "count" : 1, "value" : { "title" : "ConvictIDGet", "description" : "Pipes Output", "link" : "http:pipes.yahoo.compipespipe.info?_id=c8b70fd9d9f6edcfbb7c0e351992e717", "pubDate" : "Thu, 06 Oct 2011 22:49:50 -0700", "generator" : "http:pipes.yahoo.compipes", "callback" : "", "items" : [{ "convictid" : "200", "name" : "Frederick Beadle", "one_of" : "one of 296 convicts transported on the Pyrenees", "convicted" : "Central Criminal Court", "term_duration" : "10 years", "conviction_date" : "", "notes" : "Ticket of Leave.", "vessel" : "Pyrenees", "departure_date" : "31 January 1853", "destination" : "Western Australia", "microfilmref" : "Australian Joint Copying Project. Microfilm Roll 93, Class and Piece Number HO1118, Page Number 3 (3)", "surname" : "Beadle", "given_names" : "Frederick", "y:row" : "2", "description" : null, "title" : null }] }} Tip: Use http://jsonlint.com/ to validate and format JSON
  • 10. JSON for Trove People query { "count" : 1, "value" : { "title" : "TrovePeople", "description" : "Pipes Output", "link" : "http:pipes.yahoo.compipespipe.info?_id=c3412dfcaf40a54bdcd0273b293174e5", "pubDate" : "Thu, 06 Oct 2011 22:50:47 -0700", "generator" : "http:pipes.yahoo.compipes", "callback" : "", "items" : [{ "xmlns" : "http:www.loc.govzingsrw", "version" : "1.1", "numberOfRecords" : "265", "resultSetId" : "kc2umf", "resultSetIdleTime" : "300", "records”: {"record" : [{ "recordSchema" : "http:www.w3.org2005Atom", "recordPacking" : "xml", "recordData" : { "entry" : { "id" : "http:nla.gov.aunla.party-529154", "link" : [{ "href" : "http:nla.gov.aunla.party-529154” }, { "href" : "http:nla.gov.auanbd.aut-an35513577", "rel" : "related” }, { "href" : "http:www.adb.online.anu.edu.aubiogsA100015b.htm", "rel" : "related”}], "author" : { "name" : "National Library of Australia Party Infrastructure”}, "published" : "2008-12-10T15:20:01Z", "title" : "Lawson, H. S. W.", "content" : { "type" : "textplain", "content" : "Alternate names: Lawson, Harry Sutherland Wightman; Lawson, Harry Sutherland Wightman, Sir” }}}, "recordPosition" : "1” }, … }]}}
  • 11. Including JSON data using jQuery Live example: http://jsfiddle.net/AnnaGerber/cbJrc/ <html><head><title>Demo</title></head> <script type=“text/javascript” src=“jQuery.js”></script> <script type="text/javascript">  function findPeople(pName) {     varurl = "http://pipes.yahoo.com/pipes/pipe.run?_id=eed133e99c38a68d20d279e46cee66e6&_render=json&name=" + pName;     $.getJSON( url, function( data ) {         varoutputHTML = "”;         $.each(data.value.items[0].records.record, function( index,item ) {              var record=item.recordData.entry;            outputHTML += "<li><a target='_blank' href='”  + record.link[0].href  +"'>"               + record.title   + "</a></li>";         });         $('#output').html(outputHTML);     }); }); $(document).ready(function(){ findPeople(‘Lawson’); }); </script></head><body> <h1>People</h1> <ul id=“output"></ul> </body></html> Tip: use browser inspector + console.log() to inspect data