The expert in the search space
Kamran Khan, President & CEO
Search: The Enabler for Big Data
Big Data for Search
How can Big Data technologies help
us to create better search systems?
Search for Big Data
How can sea...
Search Technologies Overview
Herndon
San Diego
Ascot
Cincinnati
San Jose
Frankfurt
• The leading company
dedicated to Ente...
500+
Customers
What is Big Data?
DATA
DATA
DATA
DATA
DATA
DATADATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
What is Big Data?
 Too Big For A Single Machine
 Data Aggregation & Analysis
 Batch Processing
Message: Lots of Data  ...
Tomorrow’s Enterprise Search Architecture
r
r
r
r
rConnector
Staging
Area
Big Data
Search
&
Analytics
Content
Processing
M...
• More diligent, and detailed
Content Processing delivers
better search, plus automated
matching of CVs to job
description...
THESE ARE EXCITING TIMES
CLICK HERE TO READ MORE…
A
Traditional
Big Data
Approach
Come up with the question
HDFS
Hadoop
A Traditional Big Data Approach
 Decide what data to use from the Data Warehouse
and other sources (Data Anal...
A Traditional Big Data Approach
RESULTS ARE VISUALIZED
PROS
• Able to be very precise
• Analysis is in highly-
trained hands
Traditional Method: PROS AND CONS
CONS
• Need to kno...
HDFS
Hadoop
A Search Approach
Write all meaningful data to HDFS
Search for Big Data
A Search Approach
Run Content Processing jobs to create schema-free content
objects (XML or JSON)
Search for Big Data
HDFS...
A Search Approach
Feed JSON Objects to a search engine
Search for Big Data
HDFS
Hadoop
ContentProcessingwithMapReduce
A Search Approach
Use search, supported by interactive user interfaces
Search for Big Data
PROS
• Everyone knows search
• Everyone can securely access
Big Data capabilities
• Short, iterative, agile cycles —
Innov...
Insurance
Fraud Example
• Search provides interactive
exploration capabilities
across a large set of records,
and supporti...
CONCLUSION
Whichever way you look at it,
technologies, expertise, and
experience from the enterprise
search industry have ...
The expert in the search space
Kamran Khan, President & CEO
kkhan@searchtechnologies.com
QUESTIONS?
SEE US AT BOOTH 9
Upcoming SlideShare
Loading in...5
×

Search: The Enabler for Big Data

430

Published on

Search Technologies' CEO Kamran Khan presents about Search for Big Data, and Big Data for Search at the May 2014 Enterprise Search and Discovery Conference in New York.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
430
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Search: The Enabler for Big Data

  1. 1. The expert in the search space Kamran Khan, President & CEO Search: The Enabler for Big Data
  2. 2. Big Data for Search How can Big Data technologies help us to create better search systems? Search for Big Data How can search help to democratize traditional Big Data? “THE AVERAGE PERSON TODAY PROCESSES MORE DATA IN A SINGLE DAY THAN A PERSON IN THE 1500’S DID IN AN ENTIRE LIFETIME.”
  3. 3. Search Technologies Overview Herndon San Diego Ascot Cincinnati San Jose Frankfurt • The leading company dedicated to Enterprise Search & Big Data Solutions • Implementation, Consulting, Managed Services, Technology • 150 employees and growing • Independent, working with all of the leading software vendors, and open source alternatives
  4. 4. 500+ Customers
  5. 5. What is Big Data? DATA DATA DATA DATA DATA DATADATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA
  6. 6. What is Big Data?  Too Big For A Single Machine  Data Aggregation & Analysis  Batch Processing Message: Lots of Data  “Big Data” CLICK HERE TO VIEW VIDEO…
  7. 7. Tomorrow’s Enterprise Search Architecture r r r r rConnector Staging Area Big Data Search & Analytics Content Processing Machine Knowledge Source s Content Sources Source s Source s Source s Content Sources Content Processing ADVANTAGES • Agility, flexibility, scalability • A platform for Big Data enabled search and analytics applications • Fully embraces structured & unstructured content Big Data for Search
  8. 8. • More diligent, and detailed Content Processing delivers better search, plus automated matching of CVs to job descriptions. • Improved “fill-rates” add directly to the bottom line. Example: Big Data for Search in Recruitment Big Data (Hadoop) New CVs & Jobs Store vectors Top 4K vectors Filter Query + Target SCIP
  9. 9. THESE ARE EXCITING TIMES CLICK HERE TO READ MORE…
  10. 10. A Traditional Big Data Approach Come up with the question
  11. 11. HDFS Hadoop A Traditional Big Data Approach  Decide what data to use from the Data Warehouse and other sources (Data Analyst)  Write the required data to HDFS (Data Administrator)  Run a batch job to produce results MapReduce
  12. 12. A Traditional Big Data Approach RESULTS ARE VISUALIZED
  13. 13. PROS • Able to be very precise • Analysis is in highly- trained hands Traditional Method: PROS AND CONS CONS • Need to know the question ahead of time • Limited bandwidth – requires specialist skills • Lengthy iterations mean slow discovery, and lack of agility
  14. 14. HDFS Hadoop A Search Approach Write all meaningful data to HDFS Search for Big Data
  15. 15. A Search Approach Run Content Processing jobs to create schema-free content objects (XML or JSON) Search for Big Data HDFS Hadoop ContentProcessingwithMapReduce
  16. 16. A Search Approach Feed JSON Objects to a search engine Search for Big Data HDFS Hadoop ContentProcessingwithMapReduce
  17. 17. A Search Approach Use search, supported by interactive user interfaces Search for Big Data
  18. 18. PROS • Everyone knows search • Everyone can securely access Big Data capabilities • Short, iterative, agile cycles — Innovation • Unifies the analysis of structured data & unstructured content • The democratization of Big Data Search For Big Data: PROS AND CONS CONS • This is new, and evolving • Not an out-of-the-box solution • Expertise, experience, & not just technology, are needed
  19. 19. Insurance Fraud Example • Search provides interactive exploration capabilities across a large set of records, and supporting unstructured content • Investigators can interactively follow hunches, check things at low cost, find and pursue outliers that indicate fraudulent activity Search for Big Data
  20. 20. CONCLUSION Whichever way you look at it, technologies, expertise, and experience from the enterprise search industry have a big part to play in the Big Data world. As the leading services company in the sector, we look forward to further engaging with customers on these projects. Big Data for Search Search for Big Data
  21. 21. The expert in the search space Kamran Khan, President & CEO kkhan@searchtechnologies.com QUESTIONS? SEE US AT BOOTH 9
  1. ¿Le ha llamado la atención una diapositiva en particular?

    Recortar diapositivas es una manera útil de recopilar información importante para consultarla más tarde.

×