SlideShare a Scribd company logo
1 of 18
HACKING WITH YAHOO!
BOSS
Rahul Hampole
Sr Product Manager Yahoo! BOSS
rhampole@yahoo-inc.com
@ysearchboss
WHAT DOES BOSS GIVE YOU?
 Search Data and Infrastructure
 Monetization (We give you Ads!!)
 Support and Tools
BOSS is a service that provides you (the
developer) flexible access to different types of
data from Yahoo and allows you to build
powerful commercial applications with that
data.
BOSS provides you Search Advertising
and simple terms so that you can
monetize that innovative product and
continue to invest your personal time in
it.
BOSS also gives you Support and Tools to
get your product working.
Restful XML and JSON API
Search Data - Web, Image, Spelling, News, Also Try, Blogs and Search Ads
Geo Services – Placefinder & PlaceSpotter
Flexibility to Blend and Re-rank Results
 Create your own look and feel
Change ranking
Mix it with other API’s
oAuth based Authentication
WHAT DOES THAT MEAN?
WHAT ELSE DO YOU GET
Web and Limited Web results (smaller subset)
 Complex query combinations and filters
 Searches for content on multiple markets
Image attributes like height, width, etc
Time span filtering for News Search
Extended abstracts
Recognizes most search filters from Yahoo! and Google (backdoor hacks)
YAHOO! BOSS GEO SERVICS
Placefinder
1. Geocoding – Give it an
address and get back a
Lat/Lon
2. Address normalization
3. Reverse Geocoding – Give
it a lat/long and get an
address
PlaceSpotter
1. Recognize geographical
entities available in textual
content
2. Understand the meaning
of those entities
3. Couple with Geoplanet to
understand geographical
meaning
6
Learn more at http://developer.yahoo.com/boss/geo/
HOW DO I HACK WITH IT?
THE QUERY
Tells you what the user is looking for
Powers secondary APIs
Can be generated by a search box, URL,
tags or keyword extraction from the page.
Generates related topics
The Query is your BFF!
e.g. http://yboss.yahooapis.com/ysearch/web?q=“Dark Knight”&format=xml
SAMPLE CALLS
Getting multiple data sets
 /ysearch/web,images,news?q=obama
 /ysearch/web,images,news?web.q=obama&images.q=flower&news.q=egypt
Searching through sites
 A Simple Movie Search
 /ysearch/web?q=“Dark Knight”&
sites=movies.yahoo.com,netflix.com,imdb.com
AND/OR operators
 /ysearch/web?q="steve
jobs"AND((ipad)OR(iphone))&sites=bestbuy.com,newegg.com
UNARY OPERATORS
Search for Batman but not “Dark Knight”
 q=(batman -“Dark Knight")
Find pages with “Heath Ledger” but not “Dark
Knight”
 q=+”heath ledger”–”Dark
Knight”&sites=movies.yahoo.com
OUTPUT
IMAGE SEARCH PARAMETERS
Search for images that are not offensive
 /ysearch/images?q=“san francisco”&filter=yes
Search for images that are wallpaper size
 /ysearch/images?q=“san francisco”&dimensions=wallpaper
Search for a image at a certain refer URL
 /ysearch/images?q=yahoo&refererurl=http://www.flickr.com
Interesting Output Fields
 format, file size, height, width, title, total result count
NEWS SEARCH PARAMETERS
Search news that is less than 7 days old
/ysearch/news? q=osama&age=7d
Search news that is between 20hrs and 2 days old
/ysearch/news?q=osama&age=20h2d
Re-rank news results by date
/ysearch/news?q=osama&ranking=true
Interesting Output Fields
Source, Date, Source URL
BOSS + YQL
Table Name: boss.search
e.g. select * from boss.search where ck=… and
secret=… and q=„yahoo‟ and service=„news‟
Parameters Example
Consumer Key ck -
Consumer Secret secret -
Query Term q ‘yahoo’
Service service ‘news’
UNDERSTAND OAUTH
Identification
Consumer Key – Used to make a call to the API
Consumer Secret – Used for 3 legged oAuth (not used for BOSS)
Making a call
(www.oauth.net/code)
-Consumer Key
-Nonce – Random string generated by oAuth (prevents replay attacks)
-Signature – Generated by library
-Signature Method – Various types of methods supported (e.g. HMAC-SHA1)
-oAuth Timestamp –Unix time (valid for 5 minutes only)
-oAuth version – 1.0
We have code samples in most languages on BOSS Site
HACK IDEAS AND USEFUL API’S
RealTime
 Twitter/Facebook API
Mobile Applications
Video
 YouTube data API
Vertical search engines
 Programmable web has interesting API‟s
Local + Search
 Pull entities using Placespotter and
recognize relationships between content
Chrome extensions
HACK AWAY
1. We have BOSS Keys available for you
 Find me if you don’t have them
2. Code samples in the BOSS Docs
3. In depth demo later today
 Build a location aware news service
17
HACK AWAY!!
Rahul Hampole
Sr Product Manager Yahoo! BOSS
rhampole@yahoo-inc.com
@ysearchboss

More Related Content

Viewers also liked

November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...
November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...
November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...Yahoo Developer Network
 
Yahoo! Hack India: Hyderabad 2013 | YQL - One API to query them all
Yahoo! Hack India: Hyderabad 2013 | YQL - One API to query them allYahoo! Hack India: Hyderabad 2013 | YQL - One API to query them all
Yahoo! Hack India: Hyderabad 2013 | YQL - One API to query them allYahoo Developer Network
 
April 2014 HUG : Integrating HUE with Multi-tenant cluster
April 2014 HUG : Integrating HUE with Multi-tenant clusterApril 2014 HUG : Integrating HUE with Multi-tenant cluster
April 2014 HUG : Integrating HUE with Multi-tenant clusterYahoo Developer Network
 
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)Yahoo Developer Network
 
October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...
October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...
October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...Yahoo Developer Network
 
Feb 2013 HUG: Large Scale Data Ingest Using Apache Flume
Feb 2013 HUG: Large Scale Data Ingest Using Apache FlumeFeb 2013 HUG: Large Scale Data Ingest Using Apache Flume
Feb 2013 HUG: Large Scale Data Ingest Using Apache FlumeYahoo Developer Network
 
Accenture Technology Vision 2014—Every Business is a Digital Business
Accenture Technology Vision 2014—Every Business is a Digital BusinessAccenture Technology Vision 2014—Every Business is a Digital Business
Accenture Technology Vision 2014—Every Business is a Digital Businessaccenture
 

Viewers also liked (7)

November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...
November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...
November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...
 
Yahoo! Hack India: Hyderabad 2013 | YQL - One API to query them all
Yahoo! Hack India: Hyderabad 2013 | YQL - One API to query them allYahoo! Hack India: Hyderabad 2013 | YQL - One API to query them all
Yahoo! Hack India: Hyderabad 2013 | YQL - One API to query them all
 
April 2014 HUG : Integrating HUE with Multi-tenant cluster
April 2014 HUG : Integrating HUE with Multi-tenant clusterApril 2014 HUG : Integrating HUE with Multi-tenant cluster
April 2014 HUG : Integrating HUE with Multi-tenant cluster
 
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
 
October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...
October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...
October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...
 
Feb 2013 HUG: Large Scale Data Ingest Using Apache Flume
Feb 2013 HUG: Large Scale Data Ingest Using Apache FlumeFeb 2013 HUG: Large Scale Data Ingest Using Apache Flume
Feb 2013 HUG: Large Scale Data Ingest Using Apache Flume
 
Accenture Technology Vision 2014—Every Business is a Digital Business
Accenture Technology Vision 2014—Every Business is a Digital BusinessAccenture Technology Vision 2014—Every Business is a Digital Business
Accenture Technology Vision 2014—Every Business is a Digital Business
 

Similar to BOSS

Open hack 2011-ppt-draft-final
Open hack 2011-ppt-draft-finalOpen hack 2011-ppt-draft-final
Open hack 2011-ppt-draft-finalRahul Hampole
 
Yahoo BOSS Presentation London Open Hack Day Talk Boss
Yahoo BOSS Presentation London Open Hack Day Talk   BossYahoo BOSS Presentation London Open Hack Day Talk   Boss
Yahoo BOSS Presentation London Open Hack Day Talk BossKorben00
 
Hack the BOSS at Open Hack Day - London
Hack the BOSS at Open Hack Day - LondonHack the BOSS at Open Hack Day - London
Hack the BOSS at Open Hack Day - LondonTed Drake
 
Gianluca fiorelli Search Marketing Connect - Visual Search 2020
Gianluca fiorelli   Search Marketing Connect - Visual Search 2020Gianluca fiorelli   Search Marketing Connect - Visual Search 2020
Gianluca fiorelli Search Marketing Connect - Visual Search 2020Gianluca Fiorelli
 
Everything You Didn't Know About Entity SEO
Everything You Didn't Know About Entity SEO Everything You Didn't Know About Entity SEO
Everything You Didn't Know About Entity SEO Sara Taher
 
Finding things on the web with BOSS
Finding things on the web with BOSSFinding things on the web with BOSS
Finding things on the web with BOSSChristian Heilmann
 
Yahoo! BOSS API external 20091001
Yahoo! BOSS API external 20091001Yahoo! BOSS API external 20091001
Yahoo! BOSS API external 20091001Fred Meng
 
Y Boss External 20091017
Y Boss External 20091017Y Boss External 20091017
Y Boss External 20091017JH Lee
 
Yahoo! BOSS in Bucharest
Yahoo! BOSS in BucharestYahoo! BOSS in Bucharest
Yahoo! BOSS in BucharestTed Drake
 
Future of Search | Yury Lifshits, Yahoo! Research
Future of Search | Yury Lifshits, Yahoo! ResearchFuture of Search | Yury Lifshits, Yahoo! Research
Future of Search | Yury Lifshits, Yahoo! ResearchYury Lifshits
 
<ellis>presentation
<ellis>presentation<ellis>presentation
<ellis>presentationajellis01
 
Smx Milano 2014 Semantic SEO with Schema.org
Smx Milano 2014 Semantic SEO with Schema.orgSmx Milano 2014 Semantic SEO with Schema.org
Smx Milano 2014 Semantic SEO with Schema.orgSante J. Achille
 
Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup
Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup
Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup Sante J. Achille
 
Advanced operator-cheat-sheet
Advanced operator-cheat-sheetAdvanced operator-cheat-sheet
Advanced operator-cheat-sheetTanveer Razwan
 
Featured Snippets - How to Get Position Zero
Featured Snippets - How to Get Position ZeroFeatured Snippets - How to Get Position Zero
Featured Snippets - How to Get Position ZeroMichael Marsh
 
Boss hack u-iit-madras-2012
Boss hack u-iit-madras-2012Boss hack u-iit-madras-2012
Boss hack u-iit-madras-2012discoversudhir
 
Yahoo! BOSS and trainspotting
Yahoo! BOSS and trainspottingYahoo! BOSS and trainspotting
Yahoo! BOSS and trainspottingTed Drake
 
Google search - Tips and Tricks
Google search - Tips and TricksGoogle search - Tips and Tricks
Google search - Tips and TricksNaji El Kotob
 

Similar to BOSS (20)

Open hack 2011-ppt-draft-final
Open hack 2011-ppt-draft-finalOpen hack 2011-ppt-draft-final
Open hack 2011-ppt-draft-final
 
Yahoo BOSS Presentation London Open Hack Day Talk Boss
Yahoo BOSS Presentation London Open Hack Day Talk   BossYahoo BOSS Presentation London Open Hack Day Talk   Boss
Yahoo BOSS Presentation London Open Hack Day Talk Boss
 
Hack the BOSS at Open Hack Day - London
Hack the BOSS at Open Hack Day - LondonHack the BOSS at Open Hack Day - London
Hack the BOSS at Open Hack Day - London
 
BOSS HackU IITD
BOSS HackU IITDBOSS HackU IITD
BOSS HackU IITD
 
Gianluca fiorelli Search Marketing Connect - Visual Search 2020
Gianluca fiorelli   Search Marketing Connect - Visual Search 2020Gianluca fiorelli   Search Marketing Connect - Visual Search 2020
Gianluca fiorelli Search Marketing Connect - Visual Search 2020
 
Everything You Didn't Know About Entity SEO
Everything You Didn't Know About Entity SEO Everything You Didn't Know About Entity SEO
Everything You Didn't Know About Entity SEO
 
Finding things on the web with BOSS
Finding things on the web with BOSSFinding things on the web with BOSS
Finding things on the web with BOSS
 
Yahoo! BOSS API external 20091001
Yahoo! BOSS API external 20091001Yahoo! BOSS API external 20091001
Yahoo! BOSS API external 20091001
 
Y Boss External 20091017
Y Boss External 20091017Y Boss External 20091017
Y Boss External 20091017
 
Yahoo! BOSS in Bucharest
Yahoo! BOSS in BucharestYahoo! BOSS in Bucharest
Yahoo! BOSS in Bucharest
 
Future of Search | Yury Lifshits, Yahoo! Research
Future of Search | Yury Lifshits, Yahoo! ResearchFuture of Search | Yury Lifshits, Yahoo! Research
Future of Search | Yury Lifshits, Yahoo! Research
 
<ellis>presentation
<ellis>presentation<ellis>presentation
<ellis>presentation
 
Smx Milano 2014 Semantic SEO with Schema.org
Smx Milano 2014 Semantic SEO with Schema.orgSmx Milano 2014 Semantic SEO with Schema.org
Smx Milano 2014 Semantic SEO with Schema.org
 
Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup
Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup
Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup
 
Advanced operator-cheat-sheet
Advanced operator-cheat-sheetAdvanced operator-cheat-sheet
Advanced operator-cheat-sheet
 
Featured Snippets - How to Get Position Zero
Featured Snippets - How to Get Position ZeroFeatured Snippets - How to Get Position Zero
Featured Snippets - How to Get Position Zero
 
Boss hack u-iit-madras-2012
Boss hack u-iit-madras-2012Boss hack u-iit-madras-2012
Boss hack u-iit-madras-2012
 
Bridging The Google Gap
Bridging The Google GapBridging The Google Gap
Bridging The Google Gap
 
Yahoo! BOSS and trainspotting
Yahoo! BOSS and trainspottingYahoo! BOSS and trainspotting
Yahoo! BOSS and trainspotting
 
Google search - Tips and Tricks
Google search - Tips and TricksGoogle search - Tips and Tricks
Google search - Tips and Tricks
 

More from Yahoo Developer Network

Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media
Developing Mobile Apps for Performance - Swapnil Patel, Verizon MediaDeveloping Mobile Apps for Performance - Swapnil Patel, Verizon Media
Developing Mobile Apps for Performance - Swapnil Patel, Verizon MediaYahoo Developer Network
 
Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...
Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...
Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...Yahoo Developer Network
 
Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan
Athenz & SPIFFE, Tatsuya Yano, Yahoo JapanAthenz & SPIFFE, Tatsuya Yano, Yahoo Japan
Athenz & SPIFFE, Tatsuya Yano, Yahoo JapanYahoo Developer Network
 
Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...
Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...
Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...Yahoo Developer Network
 
Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath
Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, OathBig Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath
Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, OathYahoo Developer Network
 
How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu
How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenuHow @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu
How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenuYahoo Developer Network
 
The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool
The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, AmpoolThe Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool
The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, AmpoolYahoo Developer Network
 
Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...
Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...
Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...Yahoo Developer Network
 
Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...
Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...
Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...Yahoo Developer Network
 
HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath
HDFS Scalability and Security, Daryn Sharp, Senior Engineer, OathHDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath
HDFS Scalability and Security, Daryn Sharp, Senior Engineer, OathYahoo Developer Network
 
Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...
Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...
Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...Yahoo Developer Network
 
Moving the Oath Grid to Docker, Eric Badger, Oath
Moving the Oath Grid to Docker, Eric Badger, OathMoving the Oath Grid to Docker, Eric Badger, Oath
Moving the Oath Grid to Docker, Eric Badger, OathYahoo Developer Network
 
Architecting Petabyte Scale AI Applications
Architecting Petabyte Scale AI ApplicationsArchitecting Petabyte Scale AI Applications
Architecting Petabyte Scale AI ApplicationsYahoo Developer Network
 
Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...
Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...
Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...Yahoo Developer Network
 
Jun 2017 HUG: YARN Scheduling – A Step Beyond
Jun 2017 HUG: YARN Scheduling – A Step BeyondJun 2017 HUG: YARN Scheduling – A Step Beyond
Jun 2017 HUG: YARN Scheduling – A Step BeyondYahoo Developer Network
 
Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies
Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies
Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies Yahoo Developer Network
 
February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...
February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...
February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...Yahoo Developer Network
 
February 2017 HUG: Exactly-once end-to-end processing with Apache Apex
February 2017 HUG: Exactly-once end-to-end processing with Apache ApexFebruary 2017 HUG: Exactly-once end-to-end processing with Apache Apex
February 2017 HUG: Exactly-once end-to-end processing with Apache ApexYahoo Developer Network
 
February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics
February 2017 HUG: Data Sketches: A required toolkit for Big Data AnalyticsFebruary 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics
February 2017 HUG: Data Sketches: A required toolkit for Big Data AnalyticsYahoo Developer Network
 

More from Yahoo Developer Network (20)

Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media
Developing Mobile Apps for Performance - Swapnil Patel, Verizon MediaDeveloping Mobile Apps for Performance - Swapnil Patel, Verizon Media
Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media
 
Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...
Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...
Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...
 
Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan
Athenz & SPIFFE, Tatsuya Yano, Yahoo JapanAthenz & SPIFFE, Tatsuya Yano, Yahoo Japan
Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan
 
Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...
Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...
Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...
 
CICD at Oath using Screwdriver
CICD at Oath using ScrewdriverCICD at Oath using Screwdriver
CICD at Oath using Screwdriver
 
Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath
Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, OathBig Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath
Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath
 
How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu
How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenuHow @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu
How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu
 
The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool
The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, AmpoolThe Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool
The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool
 
Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...
Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...
Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...
 
Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...
Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...
Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...
 
HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath
HDFS Scalability and Security, Daryn Sharp, Senior Engineer, OathHDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath
HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath
 
Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...
Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...
Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...
 
Moving the Oath Grid to Docker, Eric Badger, Oath
Moving the Oath Grid to Docker, Eric Badger, OathMoving the Oath Grid to Docker, Eric Badger, Oath
Moving the Oath Grid to Docker, Eric Badger, Oath
 
Architecting Petabyte Scale AI Applications
Architecting Petabyte Scale AI ApplicationsArchitecting Petabyte Scale AI Applications
Architecting Petabyte Scale AI Applications
 
Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...
Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...
Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...
 
Jun 2017 HUG: YARN Scheduling – A Step Beyond
Jun 2017 HUG: YARN Scheduling – A Step BeyondJun 2017 HUG: YARN Scheduling – A Step Beyond
Jun 2017 HUG: YARN Scheduling – A Step Beyond
 
Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies
Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies
Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies
 
February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...
February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...
February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...
 
February 2017 HUG: Exactly-once end-to-end processing with Apache Apex
February 2017 HUG: Exactly-once end-to-end processing with Apache ApexFebruary 2017 HUG: Exactly-once end-to-end processing with Apache Apex
February 2017 HUG: Exactly-once end-to-end processing with Apache Apex
 
February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics
February 2017 HUG: Data Sketches: A required toolkit for Big Data AnalyticsFebruary 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics
February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics
 

Recently uploaded

Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 

Recently uploaded (20)

Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 

BOSS

  • 1.
  • 2. HACKING WITH YAHOO! BOSS Rahul Hampole Sr Product Manager Yahoo! BOSS rhampole@yahoo-inc.com @ysearchboss
  • 3. WHAT DOES BOSS GIVE YOU?  Search Data and Infrastructure  Monetization (We give you Ads!!)  Support and Tools BOSS is a service that provides you (the developer) flexible access to different types of data from Yahoo and allows you to build powerful commercial applications with that data. BOSS provides you Search Advertising and simple terms so that you can monetize that innovative product and continue to invest your personal time in it. BOSS also gives you Support and Tools to get your product working.
  • 4. Restful XML and JSON API Search Data - Web, Image, Spelling, News, Also Try, Blogs and Search Ads Geo Services – Placefinder & PlaceSpotter Flexibility to Blend and Re-rank Results  Create your own look and feel Change ranking Mix it with other API’s oAuth based Authentication WHAT DOES THAT MEAN?
  • 5. WHAT ELSE DO YOU GET Web and Limited Web results (smaller subset)  Complex query combinations and filters  Searches for content on multiple markets Image attributes like height, width, etc Time span filtering for News Search Extended abstracts Recognizes most search filters from Yahoo! and Google (backdoor hacks)
  • 6. YAHOO! BOSS GEO SERVICS Placefinder 1. Geocoding – Give it an address and get back a Lat/Lon 2. Address normalization 3. Reverse Geocoding – Give it a lat/long and get an address PlaceSpotter 1. Recognize geographical entities available in textual content 2. Understand the meaning of those entities 3. Couple with Geoplanet to understand geographical meaning 6 Learn more at http://developer.yahoo.com/boss/geo/
  • 7. HOW DO I HACK WITH IT?
  • 8. THE QUERY Tells you what the user is looking for Powers secondary APIs Can be generated by a search box, URL, tags or keyword extraction from the page. Generates related topics The Query is your BFF! e.g. http://yboss.yahooapis.com/ysearch/web?q=“Dark Knight”&format=xml
  • 9. SAMPLE CALLS Getting multiple data sets  /ysearch/web,images,news?q=obama  /ysearch/web,images,news?web.q=obama&images.q=flower&news.q=egypt Searching through sites  A Simple Movie Search  /ysearch/web?q=“Dark Knight”& sites=movies.yahoo.com,netflix.com,imdb.com AND/OR operators  /ysearch/web?q="steve jobs"AND((ipad)OR(iphone))&sites=bestbuy.com,newegg.com
  • 10. UNARY OPERATORS Search for Batman but not “Dark Knight”  q=(batman -“Dark Knight") Find pages with “Heath Ledger” but not “Dark Knight”  q=+”heath ledger”–”Dark Knight”&sites=movies.yahoo.com
  • 12. IMAGE SEARCH PARAMETERS Search for images that are not offensive  /ysearch/images?q=“san francisco”&filter=yes Search for images that are wallpaper size  /ysearch/images?q=“san francisco”&dimensions=wallpaper Search for a image at a certain refer URL  /ysearch/images?q=yahoo&refererurl=http://www.flickr.com Interesting Output Fields  format, file size, height, width, title, total result count
  • 13. NEWS SEARCH PARAMETERS Search news that is less than 7 days old /ysearch/news? q=osama&age=7d Search news that is between 20hrs and 2 days old /ysearch/news?q=osama&age=20h2d Re-rank news results by date /ysearch/news?q=osama&ranking=true Interesting Output Fields Source, Date, Source URL
  • 14. BOSS + YQL Table Name: boss.search e.g. select * from boss.search where ck=… and secret=… and q=„yahoo‟ and service=„news‟ Parameters Example Consumer Key ck - Consumer Secret secret - Query Term q ‘yahoo’ Service service ‘news’
  • 15. UNDERSTAND OAUTH Identification Consumer Key – Used to make a call to the API Consumer Secret – Used for 3 legged oAuth (not used for BOSS) Making a call (www.oauth.net/code) -Consumer Key -Nonce – Random string generated by oAuth (prevents replay attacks) -Signature – Generated by library -Signature Method – Various types of methods supported (e.g. HMAC-SHA1) -oAuth Timestamp –Unix time (valid for 5 minutes only) -oAuth version – 1.0 We have code samples in most languages on BOSS Site
  • 16. HACK IDEAS AND USEFUL API’S RealTime  Twitter/Facebook API Mobile Applications Video  YouTube data API Vertical search engines  Programmable web has interesting API‟s Local + Search  Pull entities using Placespotter and recognize relationships between content Chrome extensions
  • 17. HACK AWAY 1. We have BOSS Keys available for you  Find me if you don’t have them 2. Code samples in the BOSS Docs 3. In depth demo later today  Build a location aware news service 17
  • 18. HACK AWAY!! Rahul Hampole Sr Product Manager Yahoo! BOSS rhampole@yahoo-inc.com @ysearchboss

Editor's Notes

  1. Add Images here
  2. Choose a funny image here