Amazon CloudSearch is a fully-managed search service in the cloud that allows customers to easily integrate fast and highly scalable search functionality into their applications. In this session, we cover the basics of search and search engines. We take an introductory look at CloudSearch along with a deep dive showing how to build a CloudSearch-based web application.

3. Search experience = user retention and revenue

7. DNS / Load Balancing AWS Query
Search Domain
Search API Console Doc Command Console Config Command Console
Svc API Line Tools API Line Tools
ACCESS CONTROL ACCESS CONTROL ACCESS CONTROL
SEARCH SERVICE DOCUMENT SERVICE CONFIG SERVICE
Search Documents Add Documents Create Domains
Update Documents Configure Domains
Delete Documents Delete Domains

8. DATA
Document Quantity and Size
SEARCH INSTANCE SEARCH INSTANCE SEARCH INSTANCE
Index Partition 1 Index Partition 2 Index Partition n
Copy 1 Copy 1 Copy 1
TRAFFIC
Search
Request
Volume and SEARCH INSTANCE SEARCH INSTANCE SEARCH INSTANCE
Complexity Index Partition 1 Index Partition 2 Index Partition n
Copy 2 Copy 2 Copy 2
SEARCH INSTANCE SEARCH INSTANCE SEARCH INSTANCE
Index Partition 1 Index Partition 2 Index Partition n
Copy n Copy n Copy n

10. • The Challenge
• The Data: The Million Song Data Set
http://labrosa.ee.columbia.edu/millionsong/
• The Application

11. Field name Description
artist_mbid The musicbrainz.org ID
artist_name Name of the artist
audio_md5 Hash code of the audio
danceability According to The Echo Nest
duration In seconds
loudness General loudness of the track
song_hottnesss According to Echo Nest
title Song title
year Song year

12. • Create an Amazon CloudSearch domain
• Identify use case and supporting data
• Upload data
• Configure the domain
• Improve document ranking
• Integrate with the front end
• Keep documents up-to-date

13. • Create an Amazon CloudSearch domain
• Identify use case and supporting data
• Upload data
• Configure the domain
• Improve document ranking
• Integrate with the front end
• Keep documents up-to-date

15. • Create an Amazon CloudSearch domain
• Identify use case and supporting data
• Upload data
• Configure the domain
• Improve document ranking
• Integrate with the front end
• Keep documents up-to-date

17. Year
Song Title
Artist Name
Familiarity

18. Artist
Genre
Year

19. Title
Artist Name
Genre
Artist Familiarity
Year

20. • Create an Amazon CloudSearch domain
• Identify use case and supporting data
• Prepare and upload data
• Configure the domain
• Improve document ranking
• Integrate with the front end
• Keep documents up-to-date

22. SDF
Batches
Amazon
Million Song CloudSearch
DataSet

23. SDF Batches
[
{"type":"add",
"id": "soaczam12ab0181559",
"version":5,
"lang":"en",
"fields": {
"title":"Ruby Tuesday",
"artist_name":"The Rolling Stones",
"year":"1967",
"artist_familiarity":864830,
"genre":["alternative", "ambient", "dance",
"electronic", "pop", "r&b", "reggae"]
}
},
… ]

24. • Create an Amazon CloudSearch domain
• Identify use case and supporting data
• Prepare and upload data
• Configure the domain
• Improve document ranking
• Integrate with the front end
• Keep documents up-to-date

25. Text fields for
matching user terms
Result enabled to
retrieve source data

26. Literal fields for
Faceting
Facet enabled to
retrieve facet counts
Search enabled for
narrowing

27. Integer fields for
ranking, narrowing

29. • Create an Amazon CloudSearch domain
• Identify use case and supporting data
• Prepare and upload data
• Configure the domain
• Improve document ranking
• Integrate with the front end
• Keep documents up-to-date

33. • Create an Amazon CloudSearch domain
• Identify use case and supporting data
• Prepare and upload data
• Configure the domain
• Improve document ranking
• Integrate with the front end
• Keep documents up-to-date

34. PHP Integration
$results =
file_get_contents(
http://search-mn-songs-5bbplyghbb5tk257rsb7iamlsy." .
"us-east-1.cloudsearch.amazonaws.com" .
"/2011-02-01/search?q=" . $keyword .
"&return-fields=title,artist_name,year&" .
"facet=artist_name,year_facet,genre&" .
"rank=-" . $rank);
$resultsObj = json_decode($results);

35. Simple Search Result
{"rank": "-text_relevance",
"match-expr": "(label 'rolling stone')",
"hits": { "found": 204, "start": 0,
"hit": [ { "id": "sontsst12cf5f88b42"
},
{ "id": "sopvopr12ab017f082"
},
{ "id": "sorzrpw12ac468a13b"
},
] },
...

36. Search Results With Return Values
"hit":
[ { "id": "sontsst12cf5f88b42",
"data": {
"artist_familiarity": [ "925048" ],
"artist_name": [ "The Rolling Stones" ],
"text_relevance": [ "326" ],
"title": [ "Heart Of Stone" ],
"year": [ "1964" ]
}
},

37. Facets In Search Results
{…"hits": { … },
"facets": {
"genre": {
"constraints": [
{ "value": "pop", "count": 126 },
{ "value": "rock", "count": 125 },
{ "value": "alternative", "count": 109 },
{ "value": "electronic", "count": 106 },
{ "value": "jazz", "count": 58 }, ...
] } }

38. X
X

39. • Create an Amazon CloudSearch domain
• Identify use case and supporting data
• Prepare and upload data
• Configure the domain
• Improve document ranking
• Integrate with the front end
• Keep documents up-to-date

47. 26ms

50. https://github.com/pbs/haystack-cloudsearch

53. Get Started Now, Free Trial

54. We are sincerely eager to
hear your feedback on this
presentation and on re:Invent.
Please fill out an evaluation
form when you have a
chance.