SlideShare a Scribd company logo
1 of 34
SELECT * FROM
Internet
Using theYahoo! Query Language
Survey...
Who am I?
• Brian DeShong, Senior TechnicalYahoo
• Yahoo! (Atlanta)
• Developer / sys admin since 1998
• Focus on PHP, open source
• Focusing on native mobile apps lately
Agenda
• What’sYQL?
• How to work withYQL
• Demos!
• Data available fromY! and others
• Making your data available viaYQL
What isYQL?
How does it work?
• Web service with an SQL-like query syntax
• SQL is familiar to many developers
• Common interface for any data on the web
• Query, filter, join and update data across any
structured data on the web
• Output formats:
• XML
• JSON, JSONP, JSONPX
Working WithYQL
SELECT {what}
FROM {data table}
WHERE {condition}
SQL syntax
SELECT *
FROM weather.forecast
WHERE location = ‘29424’
Weather forecast
SELECT *
FROM ip.location
WHERE ip = ’153.9.243.13’
Location by IP
SELECT from_user, text,
profile_image_url
FROM twitter.search
WHERE q = ’#barcampchs’
Twitter search
More than SELECT
• Modify data with INSERT, UPDATE and DELETE
• Tweet, add blog posts, update databases, etc.
• We’ll look at Open Data Tables shortly
Demos!
IntegratingYQL
RESTful API
http://query.yahooapis.com/v1/public/yql
?q=[urlencoded YQL query]
&format=[xml|json|etc.]
Weather URL
https://query.yahooapis.com/v1/public/yql
?q=select%20*%20
from%20weather.location%20
where %20location%3D'29424'%3B
PHP
PHP output
brian@roadrunner [~/Dropbox/barcampchs/code]$ php ./twitter.php
XarkGirl: @mguerard need more $$, but loving life. i'm helping w/ #barcampCHS, writing a novel, working on secret project. how the hell iz u?!?
barcampchs: RT @csatcofc: Pecha Kucha on Wednesday 10/10, Barcamp on Saturday, 10/13. Next week is going to be good! #pkchs #barcampchs #csatcofc
csatcofc: Pecha Kucha on Wednesday 10/10, Barcamp on Saturday, 10/13. Next week is going to be good! #pkchs #barcampchs #csatcofc
barcampchs: Cool, just found out that the @lullabot's will be sending someone to join us fm Savannah #barcampchs @chsdug #drupal
carnellm: If you haven't bought your ticket for #BarCampCHS yet, you can try to win a free one! http://www.facebook.com/TheModernConnection
Peter_Lucash:Vote for my proposal - From Idea to Launch! RT @BarCampCHS: RT @pla1: 8 days until BarCamp Charleston Sat Nov 13 2010 #barcampchs
joannepicvu: RT @barcampchs: RT @pla1: 8 days until BarCamp Charleston Sat Nov 13 2010 #barcampchs
barcampchs: RT @pla1: 8 days until BarCamp Charleston Sat Nov 13 2010 #barcampchs
CBSWebDesigns: #barcampchs is coming up.What sessions do you want ? We hope ours is 1. Customizing WP Twenty Ten theme is one of them. http://t.co/nP5aR99
pla1: 8 days until BarCamp Charleston Sat Nov 13 2010 #barcampchs
Yaenette: RT @barcampchs: Only one week left to get your ticket to #barcampchs #chs #nchs
carnellm: I'm attending #BarCampCHS! Have you gotten your ticket yet? http://www.eventbrite.com/s/1EXx
vhanna26: @Yaenette It will be fun. #barcampchs
tybaltknight: I missed the memo on the change of venue for #BarcampCHS planning session #volunteeringfail.
vhanna26:At a #barcampchs planning meeting. Only nine more days!!!
JavaScript
Data
Yahoo! Data
Community data
Open Data Tables
• Create web service for sites that do not expose
public APIs
• Data table is:
• XML document
• TranslatesYQL query into HTTP request
• See datatables.org
Data Table XML example
Storing to Sherpa
• yql.storage and yql.storage.admin tables
• Allows you to store and work with data inYQL itself
• Shares tables, environments and JS with all otherYQL
users
• Layered onYahoo! Sherpa DHT cloud storage
platform
Sherpa Limits and Reqs
• Size Limit
• 1000 records @ 100KB each
• Retention Limit
• 30 day purge
• Record Format
• Records must be in a text-based format;
authentication for New Records
• yql.storage.admin access must be authorized using
two-legged OAuth
Wrap Up
Why YQL?
• Same interface for all of your data
• Process data away from your application
• Rapidly prototype and build applications
• Create APIs for sites that don’t have them
• And let others easily leverage them!
http://developer.yahoo.com/yql/
Thanks!
bdeshong@yahoo-inc.com
http://www.yahoo.com/
brian@deshong.net
http://www.deshong.net/

More Related Content

Similar to SELECT * FROM Internet: Using the Yahoo! Query Language

Power to the People: Manipulating SharePoint with Client-Side JavaScript
Power to the People:  Manipulating SharePoint with Client-Side JavaScriptPower to the People:  Manipulating SharePoint with Client-Side JavaScript
Power to the People: Manipulating SharePoint with Client-Side JavaScriptPeterBrunone
 
Real-time Semantic Web with Twitter Annotations
Real-time Semantic Web with Twitter AnnotationsReal-time Semantic Web with Twitter Annotations
Real-time Semantic Web with Twitter AnnotationsJoshua Shinavier
 
How to build simple web apps to automate your SEO tasks - BrightonSEO Spring ...
How to build simple web apps to automate your SEO tasks - BrightonSEO Spring ...How to build simple web apps to automate your SEO tasks - BrightonSEO Spring ...
How to build simple web apps to automate your SEO tasks - BrightonSEO Spring ...Charly Wargnier
 
Performance tuning
Performance tuningPerformance tuning
Performance tuningEric Phan
 
Clouds are Not Free: Guide to Observability-Driven Efficiency Optimizations
Clouds are Not Free: Guide to Observability-Driven Efficiency OptimizationsClouds are Not Free: Guide to Observability-Driven Efficiency Optimizations
Clouds are Not Free: Guide to Observability-Driven Efficiency OptimizationsScyllaDB
 
PowerShell and SharePoint
PowerShell and SharePointPowerShell and SharePoint
PowerShell and SharePointTalbott Crowell
 
Concurrency, Without the Pain: An Intro to Akka.NET @ Bay.NET
Concurrency, Without the Pain: An Intro to Akka.NET @ Bay.NETConcurrency, Without the Pain: An Intro to Akka.NET @ Bay.NET
Concurrency, Without the Pain: An Intro to Akka.NET @ Bay.NETpetabridge
 
Microsoft SQL Server PASS News July 2010
Microsoft SQL Server PASS News July 2010Microsoft SQL Server PASS News July 2010
Microsoft SQL Server PASS News July 2010Mark Ginnebaugh
 
YQL: Select * from Internet
YQL: Select * from InternetYQL: Select * from Internet
YQL: Select * from Internetdrgath
 
Open Data and Web API
Open Data and Web APIOpen Data and Web API
Open Data and Web APISammy Fung
 
Rapid Prototyping Twitch Extensions: Five Lessons Learned
Rapid Prototyping Twitch Extensions: Five Lessons LearnedRapid Prototyping Twitch Extensions: Five Lessons Learned
Rapid Prototyping Twitch Extensions: Five Lessons LearnedTwitch Developers
 
Creating Open Data with Open Source (beta2)
Creating Open Data with Open Source (beta2)Creating Open Data with Open Source (beta2)
Creating Open Data with Open Source (beta2)Sammy Fung
 
PowerShell and SharePoint @spsnyc July 2012
PowerShell and SharePoint @spsnyc July 2012PowerShell and SharePoint @spsnyc July 2012
PowerShell and SharePoint @spsnyc July 2012Talbott Crowell
 
Oracle REST Data Services: POUG Edition
Oracle REST Data Services: POUG EditionOracle REST Data Services: POUG Edition
Oracle REST Data Services: POUG EditionJeff Smith
 
Java 8 Streams and Rx Java Comparison
Java 8 Streams and Rx Java ComparisonJava 8 Streams and Rx Java Comparison
Java 8 Streams and Rx Java ComparisonJosé Paumard
 
What Goes In Must Come Out: Egress-Assess and Data Exfiltration
What Goes In Must Come Out: Egress-Assess and Data ExfiltrationWhat Goes In Must Come Out: Egress-Assess and Data Exfiltration
What Goes In Must Come Out: Egress-Assess and Data ExfiltrationCTruncer
 

Similar to SELECT * FROM Internet: Using the Yahoo! Query Language (20)

Power to the People: Manipulating SharePoint with Client-Side JavaScript
Power to the People:  Manipulating SharePoint with Client-Side JavaScriptPower to the People:  Manipulating SharePoint with Client-Side JavaScript
Power to the People: Manipulating SharePoint with Client-Side JavaScript
 
Real-time Semantic Web with Twitter Annotations
Real-time Semantic Web with Twitter AnnotationsReal-time Semantic Web with Twitter Annotations
Real-time Semantic Web with Twitter Annotations
 
How to build simple web apps to automate your SEO tasks - BrightonSEO Spring ...
How to build simple web apps to automate your SEO tasks - BrightonSEO Spring ...How to build simple web apps to automate your SEO tasks - BrightonSEO Spring ...
How to build simple web apps to automate your SEO tasks - BrightonSEO Spring ...
 
Performance tuning
Performance tuningPerformance tuning
Performance tuning
 
SQL Bootcamp.pptx
SQL Bootcamp.pptxSQL Bootcamp.pptx
SQL Bootcamp.pptx
 
5/12/10 Inaugural Boston Area SharePoint Users Group Meeting
5/12/10 Inaugural Boston Area SharePoint Users Group Meeting5/12/10 Inaugural Boston Area SharePoint Users Group Meeting
5/12/10 Inaugural Boston Area SharePoint Users Group Meeting
 
Clouds are Not Free: Guide to Observability-Driven Efficiency Optimizations
Clouds are Not Free: Guide to Observability-Driven Efficiency OptimizationsClouds are Not Free: Guide to Observability-Driven Efficiency Optimizations
Clouds are Not Free: Guide to Observability-Driven Efficiency Optimizations
 
6/9/10 Boston Area SharePoint Users Group Meeting
6/9/10 Boston Area SharePoint Users Group Meeting6/9/10 Boston Area SharePoint Users Group Meeting
6/9/10 Boston Area SharePoint Users Group Meeting
 
簡易爬蟲製作和Pttcrawler
簡易爬蟲製作和Pttcrawler簡易爬蟲製作和Pttcrawler
簡易爬蟲製作和Pttcrawler
 
PowerShell and SharePoint
PowerShell and SharePointPowerShell and SharePoint
PowerShell and SharePoint
 
Concurrency, Without the Pain: An Intro to Akka.NET @ Bay.NET
Concurrency, Without the Pain: An Intro to Akka.NET @ Bay.NETConcurrency, Without the Pain: An Intro to Akka.NET @ Bay.NET
Concurrency, Without the Pain: An Intro to Akka.NET @ Bay.NET
 
Microsoft SQL Server PASS News July 2010
Microsoft SQL Server PASS News July 2010Microsoft SQL Server PASS News July 2010
Microsoft SQL Server PASS News July 2010
 
YQL: Select * from Internet
YQL: Select * from InternetYQL: Select * from Internet
YQL: Select * from Internet
 
Open Data and Web API
Open Data and Web APIOpen Data and Web API
Open Data and Web API
 
Rapid Prototyping Twitch Extensions: Five Lessons Learned
Rapid Prototyping Twitch Extensions: Five Lessons LearnedRapid Prototyping Twitch Extensions: Five Lessons Learned
Rapid Prototyping Twitch Extensions: Five Lessons Learned
 
Creating Open Data with Open Source (beta2)
Creating Open Data with Open Source (beta2)Creating Open Data with Open Source (beta2)
Creating Open Data with Open Source (beta2)
 
PowerShell and SharePoint @spsnyc July 2012
PowerShell and SharePoint @spsnyc July 2012PowerShell and SharePoint @spsnyc July 2012
PowerShell and SharePoint @spsnyc July 2012
 
Oracle REST Data Services: POUG Edition
Oracle REST Data Services: POUG EditionOracle REST Data Services: POUG Edition
Oracle REST Data Services: POUG Edition
 
Java 8 Streams and Rx Java Comparison
Java 8 Streams and Rx Java ComparisonJava 8 Streams and Rx Java Comparison
Java 8 Streams and Rx Java Comparison
 
What Goes In Must Come Out: Egress-Assess and Data Exfiltration
What Goes In Must Come Out: Egress-Assess and Data ExfiltrationWhat Goes In Must Come Out: Egress-Assess and Data Exfiltration
What Goes In Must Come Out: Egress-Assess and Data Exfiltration
 

Recently uploaded

Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe中 央社
 
How to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cfHow to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cfdanishmna97
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxFIDO Alliance
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewDianaGray10
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...FIDO Alliance
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Paige Cruz
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data SciencePaolo Missier
 
How to Check GPS Location with a Live Tracker in Pakistan
How to Check GPS Location with a Live Tracker in PakistanHow to Check GPS Location with a Live Tracker in Pakistan
How to Check GPS Location with a Live Tracker in Pakistandanishmna97
 
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptxCyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptxMasterG
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctBrainSell Technologies
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGDSC PJATK
 
Event-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingEvent-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingScyllaDB
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdfMuhammad Subhan
 
Easier, Faster, and More Powerful – Notes Document Properties Reimagined
Easier, Faster, and More Powerful – Notes Document Properties ReimaginedEasier, Faster, and More Powerful – Notes Document Properties Reimagined
Easier, Faster, and More Powerful – Notes Document Properties Reimaginedpanagenda
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuidePixlogix Infotech
 
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...marcuskenyatta275
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceSamy Fodil
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...ScyllaDB
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)Samir Dash
 

Recently uploaded (20)

Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
 
How to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cfHow to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cf
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overview
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data Science
 
How to Check GPS Location with a Live Tracker in Pakistan
How to Check GPS Location with a Live Tracker in PakistanHow to Check GPS Location with a Live Tracker in Pakistan
How to Check GPS Location with a Live Tracker in Pakistan
 
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptxCyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage Intacct
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
Event-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingEvent-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream Processing
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
 
Easier, Faster, and More Powerful – Notes Document Properties Reimagined
Easier, Faster, and More Powerful – Notes Document Properties ReimaginedEasier, Faster, and More Powerful – Notes Document Properties Reimagined
Easier, Faster, and More Powerful – Notes Document Properties Reimagined
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 

SELECT * FROM Internet: Using the Yahoo! Query Language

  • 1. SELECT * FROM Internet Using theYahoo! Query Language
  • 3. Who am I? • Brian DeShong, Senior TechnicalYahoo • Yahoo! (Atlanta) • Developer / sys admin since 1998 • Focus on PHP, open source • Focusing on native mobile apps lately
  • 4. Agenda • What’sYQL? • How to work withYQL • Demos! • Data available fromY! and others • Making your data available viaYQL
  • 6.
  • 7.
  • 8.
  • 9.
  • 10. How does it work? • Web service with an SQL-like query syntax • SQL is familiar to many developers • Common interface for any data on the web • Query, filter, join and update data across any structured data on the web • Output formats: • XML • JSON, JSONP, JSONPX
  • 12. SELECT {what} FROM {data table} WHERE {condition} SQL syntax
  • 13. SELECT * FROM weather.forecast WHERE location = ‘29424’ Weather forecast
  • 14. SELECT * FROM ip.location WHERE ip = ’153.9.243.13’ Location by IP
  • 15. SELECT from_user, text, profile_image_url FROM twitter.search WHERE q = ’#barcampchs’ Twitter search
  • 16. More than SELECT • Modify data with INSERT, UPDATE and DELETE • Tweet, add blog posts, update databases, etc. • We’ll look at Open Data Tables shortly
  • 21. PHP
  • 22. PHP output brian@roadrunner [~/Dropbox/barcampchs/code]$ php ./twitter.php XarkGirl: @mguerard need more $$, but loving life. i'm helping w/ #barcampCHS, writing a novel, working on secret project. how the hell iz u?!? barcampchs: RT @csatcofc: Pecha Kucha on Wednesday 10/10, Barcamp on Saturday, 10/13. Next week is going to be good! #pkchs #barcampchs #csatcofc csatcofc: Pecha Kucha on Wednesday 10/10, Barcamp on Saturday, 10/13. Next week is going to be good! #pkchs #barcampchs #csatcofc barcampchs: Cool, just found out that the @lullabot's will be sending someone to join us fm Savannah #barcampchs @chsdug #drupal carnellm: If you haven't bought your ticket for #BarCampCHS yet, you can try to win a free one! http://www.facebook.com/TheModernConnection Peter_Lucash:Vote for my proposal - From Idea to Launch! RT @BarCampCHS: RT @pla1: 8 days until BarCamp Charleston Sat Nov 13 2010 #barcampchs joannepicvu: RT @barcampchs: RT @pla1: 8 days until BarCamp Charleston Sat Nov 13 2010 #barcampchs barcampchs: RT @pla1: 8 days until BarCamp Charleston Sat Nov 13 2010 #barcampchs CBSWebDesigns: #barcampchs is coming up.What sessions do you want ? We hope ours is 1. Customizing WP Twenty Ten theme is one of them. http://t.co/nP5aR99 pla1: 8 days until BarCamp Charleston Sat Nov 13 2010 #barcampchs Yaenette: RT @barcampchs: Only one week left to get your ticket to #barcampchs #chs #nchs carnellm: I'm attending #BarCampCHS! Have you gotten your ticket yet? http://www.eventbrite.com/s/1EXx vhanna26: @Yaenette It will be fun. #barcampchs tybaltknight: I missed the memo on the change of venue for #BarcampCHS planning session #volunteeringfail. vhanna26:At a #barcampchs planning meeting. Only nine more days!!!
  • 24. Data
  • 27. Open Data Tables • Create web service for sites that do not expose public APIs • Data table is: • XML document • TranslatesYQL query into HTTP request • See datatables.org
  • 28. Data Table XML example
  • 29. Storing to Sherpa • yql.storage and yql.storage.admin tables • Allows you to store and work with data inYQL itself • Shares tables, environments and JS with all otherYQL users • Layered onYahoo! Sherpa DHT cloud storage platform
  • 30. Sherpa Limits and Reqs • Size Limit • 1000 records @ 100KB each • Retention Limit • 30 day purge • Record Format • Records must be in a text-based format; authentication for New Records • yql.storage.admin access must be authorized using two-legged OAuth
  • 32. Why YQL? • Same interface for all of your data • Process data away from your application • Rapidly prototype and build applications • Create APIs for sites that don’t have them • And let others easily leverage them!