Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
BIG DATA,We have a communication problem.GINORMOUS SYSTEMSApril 30–May 1, 2013Washington, D.C.Daniel TunkelangHead of Quer...
BIG DATA IS EVERYWHERE
BIG DATA POWERS EVERYTHING
DATA SCIENTISTS WORRY ABOUTVOLUME, VELOCITY, VARIETY, …
BUT THE BOTTLENECKISN’T COMPUTATIONALIT’S COGNITIVE
TOOLS AUGMENTHUMAN INTELLECTBIG DATA IS A TOOLDoug Engelbart, inventor ofthe mouse, hypertext, etc.
NOT EVERYONE SUBSCRIBESTO THIS POINT OF VIEW…Claudia Perlich, Chief Scientist of media6degrees, speaking atTTI/Vanguard 20...
SHE HAS A POINT
BUT PREDICTIVE MODELINGIS NOT ENOUGH
TRAININGDATA?OBJECTIVEFUNCTION?
WE NEED APEOPLE-CENTRICAPPROACH TOBIG DATAINTERPRETABILITYINTERACTIONINSIGHT
LET’S START WITHINTERPRETABILITY
EXAMPLE:SVMvs.DECISION TREE
DECISION TREES HAVE FLAWS…DISCRETE
BUT THEYCOMMUNICATE(if they’re shallow)early splits providebig picture…fat leaves guidefeature engineering…or reveal train...
ITERATION
INTERPRETABILITY DELIVERSKey search leader favors rule-basedapproach for key scoring algorithms.Replaced regression with d...
GO DEEP vs INTERPRETABILITYA KEY DATA SCIENCE TRADE-OFF
ON TOINTERACTION
DON’T OVERPAY FOR PRECISION
BE FAST, CHEAP, AND 98% RIGHThttp://metamarkets.com/2012/fast-cheap-and-98-right-cardinality-estimation-for-big-data/
ARE PEOPLE THAT IMPATIENT?tolerable wait time for web users0.1s increase in latency significantlyreduces # of searches, ad...
IMPATIENCE IS GOODSPEED MATTERS
INSIGHT
http://blog.takejune.com/archives/52334044.html
BE TRENDY AND NORMALIZEvs
Sept. 11thAbu GhraibWeapons InspectorsSOLVE FOR INTERESTINGNESS
COMPUTE POTENTIAL INSIGHTSAPPLY HUMAN INTUITION
SUMMARY: Let’s have aconversation with Big Data.INTERPRETABILITYINTERACTIONINSIGHT
Big Data, We Have a Communication Problem
Big Data, We Have a Communication Problem
Upcoming SlideShare
Loading in …5
×

Big Data, We Have a Communication Problem

36,898 views

Published on

Big Data, We Have a Communication Problem

by Daniel Tunkelang

Presented on April 30, 2013 at the TTI/Vanguard Conference on Ginormous Systems
http://www.ttivanguard.com/conference/2013/ginormous.html

It's a cliché that we live in a world of Big Data. But the bottleneck in understanding data is not computational. Rather, the biggest challenge is designing technical solutions that effectively leverage human cognitive ability. Data analysis systems should augment people's capabilities rather than replace them. This argument is as old as computer science itself: in 1962, Doug Engelbart said that the goal of technology is “the enhancement of human intellect by increasing the capability of a human to approach a complex problem situation.” Algorithms extract signal from raw data, but people fill in the gaps, creating models and evaluating analyses.

Empowering people to understand data is not just a surface problem of building better interfaces and visualizations. We need to interact with data not only after performing computational analysis, but throughout the analysis process in order to improve our models and algorithms. In order to do so, we need tools and processes specifically designed to offer people transparency, guidance, and control.

Human-computer information retrieval has been revolutionizing our approach to information seeking -- no modern search engine limits users to black-box relevance ranking and ten blue links. We need to take similar steps in our analysis of big data, making people the center of the analysis process and developing the technical innovations that enable people to fulfill this role.

Published in: Technology, Education
  • DOWNLOAD FULL BOOKS, INTO AVAILABLE FORMAT ......................................................................................................................... ......................................................................................................................... 1.DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/y3nhqquc } ......................................................................................................................... 1.DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/y3nhqquc } ......................................................................................................................... 1.DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/y3nhqquc } ......................................................................................................................... 1.DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/y3nhqquc } ......................................................................................................................... 1.DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/y3nhqquc } ......................................................................................................................... 1.DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/y3nhqquc } ......................................................................................................................... ......................................................................................................................... ......................................................................................................................... .............. Browse by Genre Available eBooks ......................................................................................................................... Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult,
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD FULL BOOKS, INTO AVAILABLE FORMAT ......................................................................................................................... ......................................................................................................................... 1.DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/y3nhqquc } ......................................................................................................................... 1.DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/y3nhqquc } ......................................................................................................................... 1.DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/y3nhqquc } ......................................................................................................................... 1.DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/y3nhqquc } ......................................................................................................................... 1.DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/y3nhqquc } ......................................................................................................................... 1.DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/y3nhqquc } ......................................................................................................................... ......................................................................................................................... ......................................................................................................................... .............. Browse by Genre Available eBooks ......................................................................................................................... Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult,
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD FULL BOOKS INTO AVAILABLE FORMAT ......................................................................................................................... ......................................................................................................................... 1.DOWNLOAD FULL PDF EBOOK here { https://tinyurl.com/y8nn3gmc } ......................................................................................................................... 1.DOWNLOAD FULL EPUB Ebook here { https://tinyurl.com/y8nn3gmc } ......................................................................................................................... 1.DOWNLOAD FULL doc Ebook here { https://tinyurl.com/y8nn3gmc } ......................................................................................................................... 1.DOWNLOAD FULL PDF EBOOK here { https://tinyurl.com/y8nn3gmc } ......................................................................................................................... 1.DOWNLOAD FULL EPUB Ebook here { https://tinyurl.com/y8nn3gmc } ......................................................................................................................... 1.DOWNLOAD FULL doc Ebook here { https://tinyurl.com/y8nn3gmc } ......................................................................................................................... ......................................................................................................................... ......................................................................................................................... .............. Browse by Genre Available eBooks ......................................................................................................................... Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult,
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • That is my point too. We do not need 10,000 hits and keep searching within those. We want to ask what we want more precisely than a single field affords (or permits). See HyperPlex

    http://www.slideshare.net/putchavn/hyper-plex-high-precision-queryresponse-knowledge-repository-pdf
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Big Data, We Have a Communication Problem

  1. BIG DATA,We have a communication problem.GINORMOUS SYSTEMSApril 30–May 1, 2013Washington, D.C.Daniel TunkelangHead of Query Understanding, LinkedIn
  2. BIG DATA IS EVERYWHERE
  3. BIG DATA POWERS EVERYTHING
  4. DATA SCIENTISTS WORRY ABOUTVOLUME, VELOCITY, VARIETY, …
  5. BUT THE BOTTLENECKISN’T COMPUTATIONALIT’S COGNITIVE
  6. TOOLS AUGMENTHUMAN INTELLECTBIG DATA IS A TOOLDoug Engelbart, inventor ofthe mouse, hypertext, etc.
  7. NOT EVERYONE SUBSCRIBESTO THIS POINT OF VIEW…Claudia Perlich, Chief Scientist of media6degrees, speaking atTTI/Vanguard 2012 Conference on Understanding Understanding:
  8. SHE HAS A POINT
  9. BUT PREDICTIVE MODELINGIS NOT ENOUGH
  10. TRAININGDATA?OBJECTIVEFUNCTION?
  11. WE NEED APEOPLE-CENTRICAPPROACH TOBIG DATAINTERPRETABILITYINTERACTIONINSIGHT
  12. LET’S START WITHINTERPRETABILITY
  13. EXAMPLE:SVMvs.DECISION TREE
  14. DECISION TREES HAVE FLAWS…DISCRETE
  15. BUT THEYCOMMUNICATE(if they’re shallow)early splits providebig picture…fat leaves guidefeature engineering…or reveal trainingdata problems
  16. ITERATION
  17. INTERPRETABILITY DELIVERSKey search leader favors rule-basedapproach for key scoring algorithms.Replaced regression with decisiontree in local search model: gainedaccuracy and insight.Using trees to recognize spam,analyze search abandonment,model / quantify social proof.
  18. GO DEEP vs INTERPRETABILITYA KEY DATA SCIENCE TRADE-OFF
  19. ON TOINTERACTION
  20. DON’T OVERPAY FOR PRECISION
  21. BE FAST, CHEAP, AND 98% RIGHThttp://metamarkets.com/2012/fast-cheap-and-98-right-cardinality-estimation-for-big-data/
  22. ARE PEOPLE THAT IMPATIENT?tolerable wait time for web users0.1s increase in latency significantlyreduces # of searches, ad revenuetl;dr: YES
  23. IMPATIENCE IS GOODSPEED MATTERS
  24. INSIGHT
  25. http://blog.takejune.com/archives/52334044.html
  26. BE TRENDY AND NORMALIZEvs
  27. Sept. 11thAbu GhraibWeapons InspectorsSOLVE FOR INTERESTINGNESS
  28. COMPUTE POTENTIAL INSIGHTSAPPLY HUMAN INTUITION
  29. SUMMARY: Let’s have aconversation with Big Data.INTERPRETABILITYINTERACTIONINSIGHT

×