This document provides an overview of IndexTank, a real-time search service. It discusses the current state of search implementation on many web applications, which is often lacking. IndexTank aims to improve search capabilities by offering search as a hosted service, allowing developers to focus on their applications instead of building their own search infrastructure. Key IndexTank features highlighted include real-time indexing and search, custom scoring, autocomplete, faceting, geo search, and advanced text search capabilities. The document also presents a case study of reddit.com improving its search with IndexTank.
The document promotes a multi-level marketing company called DreamTrips Life that offers group travel packages at discounted prices. Members can purchase vacation packages for themselves and receive additional discounts when accompanied by other members. The document provides examples of all-inclusive vacation packages to locations like Crested Butte, Colorado; Punta Cana, Dominican Republic; and Cabo San Lucas, Mexico that members can book at prices that are advertised as being hundreds of dollars less than the regular rates.
Finding Anything: Real-time Search with IndexTankYogiWanKenobi
IndexTank provides a real-time search service that allows developers to add powerful search capabilities to their applications without having to implement it themselves. It allows for features like real-time indexing and searching, custom scoring, autocomplete, faceting, geo search, and advanced text search. The speaker discusses how he used IndexTank to build search features for two sample applications in a short period of time with little effort. He also highlights reddit.com as a case study of a large site that uses IndexTank to improve its search capabilities.
The document contains code in QBasic to design a house and a cube. For the house, it uses different LINE and CIRCLE commands to draw the outline of a house with a roof and windows. For the cube, it uses LINE commands to draw the 6 sides of a cube and CIRCLE commands to add details like a doorknob.
32 Ways a Digital Marketing Consultant Can Help Grow Your BusinessBarry Feldman
How can a digital marketing consultant help your business? In this resource we'll count the ways. 24 additional marketing resources are bundled for free.
Finding Anything: Real-time Search with IndexTankYogiWanKenobi
IndexTank provides a real-time search service that allows developers to add powerful search capabilities to their applications without having to implement it themselves. It allows for features like real-time indexing and searching, custom scoring, autocomplete, faceting, geo search, and advanced text search. The speaker discusses how he used IndexTank to build search features for two sample applications in a short period of time with little effort. He also highlights reddit.com as a case study of a large site that uses IndexTank to improve its search capabilities.
The document promotes a multi-level marketing company called DreamTrips Life that offers group travel packages at discounted prices. Members can purchase vacation packages for themselves and receive additional discounts when accompanied by other members. The document provides examples of all-inclusive vacation packages to locations like Crested Butte, Colorado; Punta Cana, Dominican Republic; and Cabo San Lucas, Mexico that members can book at prices that are advertised as being hundreds of dollars less than the regular rates.
Finding Anything: Real-time Search with IndexTankYogiWanKenobi
IndexTank provides a real-time search service that allows developers to add powerful search capabilities to their applications without having to implement it themselves. It allows for features like real-time indexing and searching, custom scoring, autocomplete, faceting, geo search, and advanced text search. The speaker discusses how he used IndexTank to build search features for two sample applications in a short period of time with little effort. He also highlights reddit.com as a case study of a large site that uses IndexTank to improve its search capabilities.
The document contains code in QBasic to design a house and a cube. For the house, it uses different LINE and CIRCLE commands to draw the outline of a house with a roof and windows. For the cube, it uses LINE commands to draw the 6 sides of a cube and CIRCLE commands to add details like a doorknob.
32 Ways a Digital Marketing Consultant Can Help Grow Your BusinessBarry Feldman
How can a digital marketing consultant help your business? In this resource we'll count the ways. 24 additional marketing resources are bundled for free.
Finding Anything: Real-time Search with IndexTankYogiWanKenobi
IndexTank provides a real-time search service that allows developers to add powerful search capabilities to their applications without having to implement it themselves. It allows for features like real-time indexing and searching, custom scoring, autocomplete, faceting, geo search, and advanced text search. The speaker discusses how he used IndexTank to build search features for two sample applications in a short period of time with little effort. He also highlights reddit.com as a case study of a large site that uses IndexTank to improve its search capabilities.
This document provides an agenda and overview for a class on search engine optimization (SEO). It reviews the previous class, discusses upcoming projects that students can choose to work on, and covers the history and mechanics of SEO, including on-page and off-page factors. Students are instructed on using tools like Google Analytics and GitHub for SEO tasks and source code management. Homework involves analyzing and suggesting improvements to a website based on SEO best practices.
Building a Fast and Powerful Search App with Lucidworks Site Search - Andrew ...Lucidworks
The document summarizes Lucidworks' site search product. It introduces the presenters and provides an agenda for the presentation. It then discusses building search applications from scratch and introduces a user story about a man named Gary who needs to build a search app for his company website. The presentation then overviews Lucidworks' site search capabilities, such as automatic crawlers, AI/ML, business logic control, data segmentation, deployment options, and analytics. It demos the product and discusses the technical implementation behind Lucidworks' Fusion platform.
Neil Perlin - We're Going Mobile! Great! Are We Ready?LavaConConference
In this session attendees will learn:
Technical options for going mobile, including responsive design, converting traditional online help to an app, and creating a “true” app using RMAD (Rapid Mobile App Development) tools. The pros and cons of each approach and some of the tools available for creating each option.
Anticipated changes in content creation practices and workflows including the elimination of local formatting, adoption of a “mobile first” philosophy, rethinking the role of tables, and more.
How company issues like terminology standardization, strategic benefit, politics, and the development of metrics and standards can help or hinder a move to mobile.
Building multi billion ( dollars, users, documents ) search engines on open ...Andrei Lopatenko
How to use open source technologies to build search engines for billions of users, billions of revenue, billions of documents
Keynote talk at The 16th International Conference on Open Source Systems.
This document summarizes Django on App Engine, Google's platform that allows developers to build and host web applications in the cloud. It describes App Engine's core features like automatic scaling, pay-as-you-go pricing, and access to Google's infrastructure and APIs. The document also highlights how Django, a popular Python web framework, can be used to develop applications on App Engine for its rapid development capabilities, powerful templates, and security features. Real-world examples of applications built by Potato using these technologies are also provided.
Challenges in Building NLP Applications in Nepali LanguageChandan Goopta
This presentation gives an overview of challenges in building Natual Language Processing for Nepali Language and why python is good for NLP developments.
Single Search For Your Phone - Presented at TRLN Annual Meeting 2014Cory Lown
Presented at TRLN Annual Meeting in 2014 this is an overview of work we've done to design a library single search application applying responsive design techniques to make the application usable on mobile and desktop devices. We also describe a new feature we call "stratified typeahead" to suggest groups of results live as people enter text into the search box.
How Appboy’s Marketing Automation for Apps Platform Grew 40x on the ObjectRoc...MongoDB
Jon Hyman and Kenny Gorman presented on how Appboy scaled their MongoDB platform 40x over a year and a half as data volume and user growth increased dramatically. They started with a single unsharded replica set on AWS that struggled with locking issues as data and users grew. They then scaled vertically, added sharding across multiple servers, implemented write buffering to Redis to address a bottleneck, split collections across databases, and finally isolated large enterprise customers onto their own databases for performance. These changes helped Appboy scale from handling 2.5 million events per day for 8 million users to over 4 billion events per month.
Last year I left PARC after almost nine years in residence, to join Cuil, a start up company then in stealth mode. Three months later, Cuil launched with a lot of buzz and a product that is innovative to the hilt.This was the beginning of an exciting (and bumpy) journey over the unchartered territory of Searchland, part of the larger and (to me) mysterious continent of StartUpLand. In this talk I will discuss this journey and highlights so far, with the help of a little guide.
Mozilla Foundation Metrics - presentation to engineersJohn Schneider
@rossbruniges and I talked with our fellow Mozilla Foundation engineers and development teams about getting the data for building a data driven operation using statsd, graphite, geckoboard, google analytics, and newrelic.
Software developers love tools for coding, debugging, testing, and configuration management. The more these tools improve the How of coding, the more we see that we're behind the curve on improving the What, Why, and When. If you've been on a project that seemed vague, adrift, and endless, this talk can help. Make your projects run SMART.
The document introduces the Google Developer Student Club at IIIT Surat. It discusses their core team, faculty advisor, goals of creating a community of developers and bridging theory and practice. It outlines some of their past events and future plans which include weekly DSA classes, DevHeat, Hacktoberfest, and classes on technologies like Postman and Kotlin. There are also sections on UI/UX design, web and mobile development fundamentals, backend technologies, cloud infrastructure, data analytics, machine learning and how Netflix applies these concepts.
Nondeterministic Software for the Rest of UsTomer Gabel
A talk given at GeeCON 2018 in Krakow, Poland.
Classically-trained (if you can call it that) software engineers are used to clear problem statements and clear success and acceptance criteria. Need a mobile front-end for your blog? Sure! Support instant messaging for a million concurrent users? No problem! Store and serve 50TB of JSON blobs? Presto!
Unfortunately, it turns out modern software often includes challenges that we have a hard time with: those without clear criteria for correctness, no easy way to measure performance and success is about more than green dashboards. Your blog platform better have a spam filter, your instant messaging service has to have search, and your blobs will inevitably be fed into some data scientist's crazy contraption.
In this talk I'll share my experiences of learning to deal with non-deterministic problems, what made the process easier for me and what I've learned along the way. With any luck, you'll have an easier time of it!
So your company has decided to take its documentation mobile. Great!
But just saying “go mobile” is too vague. Is it an app? Responsively designed online help? A mobilized web site? Something else? What effect might going mobile have on your documentation efforts? That’s the subject of this presentation.
We’ll first look at various definitions of “mobile” including apps, responsive design, mobilized web sites, and more – their pros and cons, and tools you can use to create them. We’ll then look at how you might have to change your documentation practices in order to move to mobile, such as requiring greater syntactical rigor, eliminating local formatting, using relative fonts and media queries to create resizable tables and content, and more.
You’ll leave this presentation with a solid understanding of options for going mobile and how your work may have to change to stay on the cutting edge of technical communication.
This document provides an overview of modern web development including products, languages, frameworks, content management systems, architecture, services and case studies. It discusses key concepts like what constitutes a product versus a project, popular programming languages for web and mobile including JavaScript, frameworks like Express and React, CMS options, client-side rendering, and using external services.
The document discusses choosing a platform for building an early-stage startup product. It recommends focusing first on speed of development and getting customers, rather than scalability or complex frameworks. Online prototyping tools that require under an hour are ideal initially to test ideas. For more serious apps, Firebase, Meteor or Parse are good options as they are easy to use and allow hosting on services like Heroku, avoiding server management. The goal should be a minimum viable product rather than perfection at the early stages.
This document provides an agenda and overview for a class on search engine optimization (SEO). It reviews the previous class, discusses upcoming projects that students can choose to work on, and covers the history and mechanics of SEO, including on-page and off-page factors. Students are instructed on using tools like Google Analytics and GitHub for SEO tasks and source code management. Homework involves analyzing and suggesting improvements to a website based on SEO best practices.
Building a Fast and Powerful Search App with Lucidworks Site Search - Andrew ...Lucidworks
The document summarizes Lucidworks' site search product. It introduces the presenters and provides an agenda for the presentation. It then discusses building search applications from scratch and introduces a user story about a man named Gary who needs to build a search app for his company website. The presentation then overviews Lucidworks' site search capabilities, such as automatic crawlers, AI/ML, business logic control, data segmentation, deployment options, and analytics. It demos the product and discusses the technical implementation behind Lucidworks' Fusion platform.
Neil Perlin - We're Going Mobile! Great! Are We Ready?LavaConConference
In this session attendees will learn:
Technical options for going mobile, including responsive design, converting traditional online help to an app, and creating a “true” app using RMAD (Rapid Mobile App Development) tools. The pros and cons of each approach and some of the tools available for creating each option.
Anticipated changes in content creation practices and workflows including the elimination of local formatting, adoption of a “mobile first” philosophy, rethinking the role of tables, and more.
How company issues like terminology standardization, strategic benefit, politics, and the development of metrics and standards can help or hinder a move to mobile.
Building multi billion ( dollars, users, documents ) search engines on open ...Andrei Lopatenko
How to use open source technologies to build search engines for billions of users, billions of revenue, billions of documents
Keynote talk at The 16th International Conference on Open Source Systems.
This document summarizes Django on App Engine, Google's platform that allows developers to build and host web applications in the cloud. It describes App Engine's core features like automatic scaling, pay-as-you-go pricing, and access to Google's infrastructure and APIs. The document also highlights how Django, a popular Python web framework, can be used to develop applications on App Engine for its rapid development capabilities, powerful templates, and security features. Real-world examples of applications built by Potato using these technologies are also provided.
Challenges in Building NLP Applications in Nepali LanguageChandan Goopta
This presentation gives an overview of challenges in building Natual Language Processing for Nepali Language and why python is good for NLP developments.
Single Search For Your Phone - Presented at TRLN Annual Meeting 2014Cory Lown
Presented at TRLN Annual Meeting in 2014 this is an overview of work we've done to design a library single search application applying responsive design techniques to make the application usable on mobile and desktop devices. We also describe a new feature we call "stratified typeahead" to suggest groups of results live as people enter text into the search box.
How Appboy’s Marketing Automation for Apps Platform Grew 40x on the ObjectRoc...MongoDB
Jon Hyman and Kenny Gorman presented on how Appboy scaled their MongoDB platform 40x over a year and a half as data volume and user growth increased dramatically. They started with a single unsharded replica set on AWS that struggled with locking issues as data and users grew. They then scaled vertically, added sharding across multiple servers, implemented write buffering to Redis to address a bottleneck, split collections across databases, and finally isolated large enterprise customers onto their own databases for performance. These changes helped Appboy scale from handling 2.5 million events per day for 8 million users to over 4 billion events per month.
Last year I left PARC after almost nine years in residence, to join Cuil, a start up company then in stealth mode. Three months later, Cuil launched with a lot of buzz and a product that is innovative to the hilt.This was the beginning of an exciting (and bumpy) journey over the unchartered territory of Searchland, part of the larger and (to me) mysterious continent of StartUpLand. In this talk I will discuss this journey and highlights so far, with the help of a little guide.
Mozilla Foundation Metrics - presentation to engineersJohn Schneider
@rossbruniges and I talked with our fellow Mozilla Foundation engineers and development teams about getting the data for building a data driven operation using statsd, graphite, geckoboard, google analytics, and newrelic.
Software developers love tools for coding, debugging, testing, and configuration management. The more these tools improve the How of coding, the more we see that we're behind the curve on improving the What, Why, and When. If you've been on a project that seemed vague, adrift, and endless, this talk can help. Make your projects run SMART.
The document introduces the Google Developer Student Club at IIIT Surat. It discusses their core team, faculty advisor, goals of creating a community of developers and bridging theory and practice. It outlines some of their past events and future plans which include weekly DSA classes, DevHeat, Hacktoberfest, and classes on technologies like Postman and Kotlin. There are also sections on UI/UX design, web and mobile development fundamentals, backend technologies, cloud infrastructure, data analytics, machine learning and how Netflix applies these concepts.
Nondeterministic Software for the Rest of UsTomer Gabel
A talk given at GeeCON 2018 in Krakow, Poland.
Classically-trained (if you can call it that) software engineers are used to clear problem statements and clear success and acceptance criteria. Need a mobile front-end for your blog? Sure! Support instant messaging for a million concurrent users? No problem! Store and serve 50TB of JSON blobs? Presto!
Unfortunately, it turns out modern software often includes challenges that we have a hard time with: those without clear criteria for correctness, no easy way to measure performance and success is about more than green dashboards. Your blog platform better have a spam filter, your instant messaging service has to have search, and your blobs will inevitably be fed into some data scientist's crazy contraption.
In this talk I'll share my experiences of learning to deal with non-deterministic problems, what made the process easier for me and what I've learned along the way. With any luck, you'll have an easier time of it!
So your company has decided to take its documentation mobile. Great!
But just saying “go mobile” is too vague. Is it an app? Responsively designed online help? A mobilized web site? Something else? What effect might going mobile have on your documentation efforts? That’s the subject of this presentation.
We’ll first look at various definitions of “mobile” including apps, responsive design, mobilized web sites, and more – their pros and cons, and tools you can use to create them. We’ll then look at how you might have to change your documentation practices in order to move to mobile, such as requiring greater syntactical rigor, eliminating local formatting, using relative fonts and media queries to create resizable tables and content, and more.
You’ll leave this presentation with a solid understanding of options for going mobile and how your work may have to change to stay on the cutting edge of technical communication.
This document provides an overview of modern web development including products, languages, frameworks, content management systems, architecture, services and case studies. It discusses key concepts like what constitutes a product versus a project, popular programming languages for web and mobile including JavaScript, frameworks like Express and React, CMS options, client-side rendering, and using external services.
The document discusses choosing a platform for building an early-stage startup product. It recommends focusing first on speed of development and getting customers, rather than scalability or complex frameworks. Online prototyping tools that require under an hour are ideal initially to test ideas. For more serious apps, Firebase, Meteor or Parse are good options as they are easy to use and allow hosting on services like Heroku, avoiding server management. The goal should be a minimum viable product rather than perfection at the early stages.
Similar to Indextank east bay ruby meetup slides (20)
2. About the Presenter
Tim Spence
● Senior Infrastructure Engineer at MedHelp
( http://www.medhelp.org/ )
● Former .NET developer
● Recently converted to Ruby
● In love with Open Source Software
● More at http://whyhello.im/tim
3. Agenda
● State of search today
● Quick survey: how much time/effort did
YOU spend implementing search on your
webapp?
● Examples of services that need improved
search
● IndexTank to the rescue
● Case study: reddit.com
4. Agenda, continued
● How I found out about IndexTank
● Two apps I built with IndexTank
● Live Demo
5.
6. The State of Search Today
● Not well implemented at all
– Search works, but...
– Barely
● How many pages of results do you typically
browse through before finding what you
were looking for?
● Or do you give up and head for google site
search instead?
7. Survey Time!
● How much time/effort did YOU spend
implementing search on your webapp?
● How many times have you iterated on your
search feature?
● When was the last time someone thanked
you for building a powerful, reliable search
feature for your webapp?
8. My Opinion
● Search as an in-app feature is an
afterthought
● Minimal implementation is the norm
● If it wasn't for MySQL/MS-SQL full text
indexing, most apps probably wouldn't
even have a search feature
● Most good web apps don't make it easy for
users to find specific content outside of
predetermined navigation
9. Let's pick on some apps!
● These are companies with great products,
but their search comes up short
● Don't worry–they can take it!
12. App #1: Github
● Interface is decent
– Search repos, code, users, or everything
– Search by language
● However...
– Can't do much with results but browse
– Check out this example
14. App #1: Github
● Why these results aren't so hot
– Can't search by most recently maintained
– Can't search by most popular (most
watched)
– Are you ready to browse 1,297 results?
● Advanced search capabilities exist, but not
the best interface
– recency/popularity implemented, but
require specific arguments
15. App #2: Amazon Web Services
● ”Hey, I bet I can find an AMI from the
community for the exact EC2 setup I need”
● Fact: probably not
17. App #2: Amazon Web Services
● Notice something missing?
– No search
– Only sort by date, title
● Ready to browse 934 results?
– I'd rather build my own AMI
● Incredible missed opportunity
– o/s search
– Stack search
– etc...
18. Fact: Github & Amazon aren't the
only ones
● Lots of good web services
● Massive quantities of quality content
● Unfortunately not discoverable in
meaningful ways
19. Interlude: Sites with great search
● Foodspotting
– Proximity
– Recency
– Rating
● Medhelp
– Content category
– Promoted content
● Other sites I overlooked? Whose search
do you like?
20. What was the point of that last
slide?
● Search can be useful if it is valued as a
feature
● Any company willing to invest in the
resources can build and host a high quality
search engine
● However, must you roll your own?
21. Enter Search as a Service
● No need for you to invest in additional
infrastructure
● No need to reinvent the wheel
– Search is a solved problem
– Let the experts refine it
22. IndexTank to the rescue!
● Hosted–no load on your infrastructure
● Powerful
– We'll get into the details next
● Always Improving
– Search IS their product
● Freemium
● Easy to implement
23. Let's talk features
● Real-time search
– Real-time indexing–results immediately
available
● Custom scoring
● Autocomplete
● Faceting
● Geo search
● Advanced text search
24. ●Real-time search
● Real-time indexing
– results immediately available
● Index multiple docs/sec
● Overwrite existing docs as you wish
– Changes also immediately available
25. Custom Scoring
● Implementer has full control over how
results are returned
● Choose which fields are searched
● Use pre-written scoring functions
● Or write your own
27. Everyone loves autocomplete
● Saves users time
● Potentially avoids spelling errors
– Not for hunters/peckers
● Adds a degree of intelligence to the search
process
28. Faceting
● Does it make sense for you to categorize
documents in your index?
– In all cases, YES
● Consider your advanced users and the
narrow results they seek
– Don't make anyone sift through irrelevant
results
30. Geo
● It's 2011
– Location is more relevant than ever before
– Mobile is skyrocketing–every client has a
GPS
● IndexTank has built-in geo proximity
search capability
32. Advanced Text Search (Beta)
● Fuzzy search (Did you mean...?)
● Stemming
– Alternate word forms (tense, possession,
etc...)
● Alternate spellings
– Misspellings
33. Other Benefits
● Zero maintenance
● Scalability included for free
● Easy implementation
– Clients available in many languages
– Excellent documentation–Let's check it out
● Excellent support
– Humans or bots? You decide
● Dog food: their site search is done well
34.
35. Case Study: reddit.com
● High traffic news aggregator (> 1.0E9
pvs/mo) with tons of content
● Who remembers how bad reddit's search
was?
– When it even worked
● Can't blame them for trying
– Many attempts, but none worked
● IndexTank excelled in all areas
● Let's check it out now
36. My experience with IndexTank
● Discovered through Heroku/IndexTank
contest
● Built my first irl Rails app in an
afternoon/evening w/ fellow hacker Chris
Saylor (@cwsaylor)
● Didn't win the contest but learned how
easy it is to quickly create highly targeted
search
37. App #1: Toxosis
● Searchable database of toxic release data
supplied by U.S. E.P.A.
● Hosted at http://toxosis.heroku.com/
● Search enabled on many fields including
city/state/zip, toxin
● Additional fields can be added to index
– When I have time, of course...
38. More personal backstory
● Still in the business of reinventing myself
as a Rails developer
● How to get a Rails gig? Develop an app
multiple Rails apps and show it them off
● Opportunities are everywhere–contests,
hackathons, and weekend hacks for
developer community
39. App #2: SXSWdex
● Searchable database of 2011 SXSW
attendees
● Hosted at http://sxswdex.heroku.com/
● Design goal: do a better job than SXSW
official site
● Search within bio, company, location,
name
● Facets: company, city/state