SlideShare a Scribd company logo
1 of 18
Valuations User
Feedback
Algorithms Team
Valuation Estimates
 Extract features from property data (#
  beds, # baths, sqft, past sales etc)
 Use a very complex algorithm to estimate
  price using these features
 Give users the option to register their
  feedback
What We Do
 Extract features from property data (#
  beds, # baths, sqft, past sales etc)
 Use a very complex algorithm to estimate
  price using these features
 Give users the option to register their
  feedback
User Feedback
Useful Feedback
Useless Junk
Goals
 Auto   correction of the estimate based on
  the feedback?
 Checking for obvious mistakes?
 Facilitating easy review of the feedbacks?
 Discovering new useful features?
Goals
 Auto   correction of the estimate based on
  the feedback? No
 Checking for obvious mistakes?
 Facilitating easy review of the feedbacks?
 Discovering new useful features?
Goals
 Auto   correction of the estimate based on
  the feedback?
 Checking for obvious mistakes? Yes
 Facilitating easy review of the feedbacks?
 Discovering new useful features?
Goals
 Auto   correction of the estimate based on
  the feedback?
 Checking for obvious mistakes?
 Facilitating easy review of the feedbacks?
  Yes
 Discovering new useful features?
Goals
 Auto   correction of the estimate based on
  the feedback?
 Checking for obvious mistakes?
 Facilitating easy review of the feedbacks?
 Discovering new useful features? Perhaps
Unsorted Feedback
http://analyticsnn2.sv2.trulia.com:8111/feedback-2012-05-21.html
After Sorting
After Sorting
What is the Sorting Based on?
 How  detailed is the replay?
 How far off are we?
 Did a registered user submit the
  feedback?
 Normalization/ regularization
Distribution by Geographical
Scope


                 Global Average: 1.2178
Text Clustering (in progress)
 Use   Apache Mahout to cluster feedback
  text
 Discover terms that most frequently occur
  together in feedback texts
Thank you!

More Related Content

Viewers also liked

PitchEngine for Prichard Communications
PitchEngine for Prichard CommunicationsPitchEngine for Prichard Communications
PitchEngine for Prichard Communicationsjennacerruti
 
Nature of educaional psychology
Nature of educaional psychologyNature of educaional psychology
Nature of educaional psychologyDnyaneshwar Darade
 
Lorica Employee Benefits
Lorica Employee BenefitsLorica Employee Benefits
Lorica Employee BenefitsRChandler01
 
Polymorphic Nanocrystalline Metal Oxides
Polymorphic Nanocrystalline Metal OxidesPolymorphic Nanocrystalline Metal Oxides
Polymorphic Nanocrystalline Metal Oxidesshantanusood
 
Asian architecture presentation
Asian architecture presentationAsian architecture presentation
Asian architecture presentationWen Yee
 
Asian Architecture Research Paper
Asian Architecture Research PaperAsian Architecture Research Paper
Asian Architecture Research PaperWen Yee
 
Motherboard
Motherboard Motherboard
Motherboard pepvicky
 
Building Structure Project 2
Building Structure Project 2Building Structure Project 2
Building Structure Project 2Wen Yee
 
theories and urbanism- cognitive mapping
theories and urbanism- cognitive mappingtheories and urbanism- cognitive mapping
theories and urbanism- cognitive mappingWen Yee
 
Gas sensing properties of Nanocrystalline metal oxides
Gas sensing properties of Nanocrystalline metal oxidesGas sensing properties of Nanocrystalline metal oxides
Gas sensing properties of Nanocrystalline metal oxidesshantanusood
 
Nature of educaional psychology
Nature of educaional psychologyNature of educaional psychology
Nature of educaional psychologyDnyaneshwar Darade
 
Basik skills of english language
Basik skills of english language Basik skills of english language
Basik skills of english language Dnyaneshwar Darade
 

Viewers also liked (17)

PitchEngine for Prichard Communications
PitchEngine for Prichard CommunicationsPitchEngine for Prichard Communications
PitchEngine for Prichard Communications
 
Proximo Analytics Presentation April 2011
Proximo Analytics Presentation April 2011Proximo Analytics Presentation April 2011
Proximo Analytics Presentation April 2011
 
Nature of educaional psychology
Nature of educaional psychologyNature of educaional psychology
Nature of educaional psychology
 
Lorica Employee Benefits
Lorica Employee BenefitsLorica Employee Benefits
Lorica Employee Benefits
 
Polymorphic Nanocrystalline Metal Oxides
Polymorphic Nanocrystalline Metal OxidesPolymorphic Nanocrystalline Metal Oxides
Polymorphic Nanocrystalline Metal Oxides
 
Diabetes_Sensor
Diabetes_SensorDiabetes_Sensor
Diabetes_Sensor
 
Trulia Estimates 2.0
Trulia Estimates 2.0Trulia Estimates 2.0
Trulia Estimates 2.0
 
Asian architecture presentation
Asian architecture presentationAsian architecture presentation
Asian architecture presentation
 
Asian Architecture Research Paper
Asian Architecture Research PaperAsian Architecture Research Paper
Asian Architecture Research Paper
 
Motherboard
Motherboard Motherboard
Motherboard
 
Building Structure Project 2
Building Structure Project 2Building Structure Project 2
Building Structure Project 2
 
theories and urbanism- cognitive mapping
theories and urbanism- cognitive mappingtheories and urbanism- cognitive mapping
theories and urbanism- cognitive mapping
 
Educational psychology
Educational psychologyEducational psychology
Educational psychology
 
Gas sensing properties of Nanocrystalline metal oxides
Gas sensing properties of Nanocrystalline metal oxidesGas sensing properties of Nanocrystalline metal oxides
Gas sensing properties of Nanocrystalline metal oxides
 
Nature of educaional psychology
Nature of educaional psychologyNature of educaional psychology
Nature of educaional psychology
 
Basik skills of english language
Basik skills of english language Basik skills of english language
Basik skills of english language
 
Defining psychology 1
Defining psychology 1Defining psychology 1
Defining psychology 1
 

Similar to Valuations User Feedback Algorithms Team Review Goals and Strategies

Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @ChorusRated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @ChorusSease
 
Search Quality Evaluation: Tools and Techniques
Search Quality Evaluation: Tools and TechniquesSearch Quality Evaluation: Tools and Techniques
Search Quality Evaluation: Tools and TechniquesAlessandro Benedetti
 
Haystack London - Search Quality Evaluation, Tools and Techniques
Haystack London - Search Quality Evaluation, Tools and Techniques Haystack London - Search Quality Evaluation, Tools and Techniques
Haystack London - Search Quality Evaluation, Tools and Techniques Andrea Gazzarini
 
Feature Based Opinion Mining from Amazon Reviews
Feature Based Opinion Mining from Amazon ReviewsFeature Based Opinion Mining from Amazon Reviews
Feature Based Opinion Mining from Amazon ReviewsRavi Kiran Holur Vijay
 
IRJET - Online Product Scoring based on Sentiment based Review Analysis
IRJET - Online Product Scoring based on Sentiment based Review AnalysisIRJET - Online Product Scoring based on Sentiment based Review Analysis
IRJET - Online Product Scoring based on Sentiment based Review AnalysisIRJET Journal
 
E-Commerce Product Rating Based on Customer Review
E-Commerce Product Rating Based on Customer ReviewE-Commerce Product Rating Based on Customer Review
E-Commerce Product Rating Based on Customer ReviewIRJET Journal
 
Search Quality Evaluation: a Developer Perspective
Search Quality Evaluation: a Developer PerspectiveSearch Quality Evaluation: a Developer Perspective
Search Quality Evaluation: a Developer PerspectiveAndrea Gazzarini
 
Web Rec Final Report
Web Rec Final ReportWeb Rec Final Report
Web Rec Final Reportweichen
 
IRJET- Classification of Business Reviews using Sentiment Analysis
IRJET-  	  Classification of Business Reviews using Sentiment AnalysisIRJET-  	  Classification of Business Reviews using Sentiment Analysis
IRJET- Classification of Business Reviews using Sentiment AnalysisIRJET Journal
 
Search Quality Evaluation: a Developer Perspective
Search Quality Evaluation: a Developer PerspectiveSearch Quality Evaluation: a Developer Perspective
Search Quality Evaluation: a Developer PerspectiveSease
 
Rated Ranking Evaluator Enterprise: the next generation of free Search Qualit...
Rated Ranking Evaluator Enterprise: the next generation of free Search Qualit...Rated Ranking Evaluator Enterprise: the next generation of free Search Qualit...
Rated Ranking Evaluator Enterprise: the next generation of free Search Qualit...Sease
 
How To Implement Your Online Search Quality Evaluation With Kibana
How To Implement Your Online Search Quality Evaluation With KibanaHow To Implement Your Online Search Quality Evaluation With Kibana
How To Implement Your Online Search Quality Evaluation With KibanaSease
 
Evaluation in hci
Evaluation in hciEvaluation in hci
Evaluation in hcisajid rao
 
Systems Thinking - Shekman Tang
Systems Thinking - Shekman TangSystems Thinking - Shekman Tang
Systems Thinking - Shekman Tanguxbri
 
IRJET- Survey of Classification of Business Reviews using Sentiment Analysis
IRJET- Survey of Classification of Business Reviews using Sentiment AnalysisIRJET- Survey of Classification of Business Reviews using Sentiment Analysis
IRJET- Survey of Classification of Business Reviews using Sentiment AnalysisIRJET Journal
 
Opinion Driven Decision Support System
Opinion Driven Decision Support SystemOpinion Driven Decision Support System
Opinion Driven Decision Support SystemKavita Ganesan
 
ilovepdf_ ( التحليل الوظيفي : العامل الرئيسي في منهجية الهندسة القيمية) المحا...
ilovepdf_ ( التحليل الوظيفي : العامل الرئيسي في منهجية الهندسة القيمية) المحا...ilovepdf_ ( التحليل الوظيفي : العامل الرئيسي في منهجية الهندسة القيمية) المحا...
ilovepdf_ ( التحليل الوظيفي : العامل الرئيسي في منهجية الهندسة القيمية) المحا...Egyptian Engineers Association
 
WebEngage demo at Unpluggd (Nov, 2011)
WebEngage demo at Unpluggd (Nov, 2011)WebEngage demo at Unpluggd (Nov, 2011)
WebEngage demo at Unpluggd (Nov, 2011)Avlesh Singh
 
Rated Ranking Evaluator (FOSDEM 2019)
Rated Ranking Evaluator (FOSDEM 2019)Rated Ranking Evaluator (FOSDEM 2019)
Rated Ranking Evaluator (FOSDEM 2019)Andrea Gazzarini
 
Rated Ranking Evaluator: An Open Source Approach for Search Quality Evaluation
Rated Ranking Evaluator: An Open Source Approach for Search Quality EvaluationRated Ranking Evaluator: An Open Source Approach for Search Quality Evaluation
Rated Ranking Evaluator: An Open Source Approach for Search Quality EvaluationAlessandro Benedetti
 

Similar to Valuations User Feedback Algorithms Team Review Goals and Strategies (20)

Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @ChorusRated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
 
Search Quality Evaluation: Tools and Techniques
Search Quality Evaluation: Tools and TechniquesSearch Quality Evaluation: Tools and Techniques
Search Quality Evaluation: Tools and Techniques
 
Haystack London - Search Quality Evaluation, Tools and Techniques
Haystack London - Search Quality Evaluation, Tools and Techniques Haystack London - Search Quality Evaluation, Tools and Techniques
Haystack London - Search Quality Evaluation, Tools and Techniques
 
Feature Based Opinion Mining from Amazon Reviews
Feature Based Opinion Mining from Amazon ReviewsFeature Based Opinion Mining from Amazon Reviews
Feature Based Opinion Mining from Amazon Reviews
 
IRJET - Online Product Scoring based on Sentiment based Review Analysis
IRJET - Online Product Scoring based on Sentiment based Review AnalysisIRJET - Online Product Scoring based on Sentiment based Review Analysis
IRJET - Online Product Scoring based on Sentiment based Review Analysis
 
E-Commerce Product Rating Based on Customer Review
E-Commerce Product Rating Based on Customer ReviewE-Commerce Product Rating Based on Customer Review
E-Commerce Product Rating Based on Customer Review
 
Search Quality Evaluation: a Developer Perspective
Search Quality Evaluation: a Developer PerspectiveSearch Quality Evaluation: a Developer Perspective
Search Quality Evaluation: a Developer Perspective
 
Web Rec Final Report
Web Rec Final ReportWeb Rec Final Report
Web Rec Final Report
 
IRJET- Classification of Business Reviews using Sentiment Analysis
IRJET-  	  Classification of Business Reviews using Sentiment AnalysisIRJET-  	  Classification of Business Reviews using Sentiment Analysis
IRJET- Classification of Business Reviews using Sentiment Analysis
 
Search Quality Evaluation: a Developer Perspective
Search Quality Evaluation: a Developer PerspectiveSearch Quality Evaluation: a Developer Perspective
Search Quality Evaluation: a Developer Perspective
 
Rated Ranking Evaluator Enterprise: the next generation of free Search Qualit...
Rated Ranking Evaluator Enterprise: the next generation of free Search Qualit...Rated Ranking Evaluator Enterprise: the next generation of free Search Qualit...
Rated Ranking Evaluator Enterprise: the next generation of free Search Qualit...
 
How To Implement Your Online Search Quality Evaluation With Kibana
How To Implement Your Online Search Quality Evaluation With KibanaHow To Implement Your Online Search Quality Evaluation With Kibana
How To Implement Your Online Search Quality Evaluation With Kibana
 
Evaluation in hci
Evaluation in hciEvaluation in hci
Evaluation in hci
 
Systems Thinking - Shekman Tang
Systems Thinking - Shekman TangSystems Thinking - Shekman Tang
Systems Thinking - Shekman Tang
 
IRJET- Survey of Classification of Business Reviews using Sentiment Analysis
IRJET- Survey of Classification of Business Reviews using Sentiment AnalysisIRJET- Survey of Classification of Business Reviews using Sentiment Analysis
IRJET- Survey of Classification of Business Reviews using Sentiment Analysis
 
Opinion Driven Decision Support System
Opinion Driven Decision Support SystemOpinion Driven Decision Support System
Opinion Driven Decision Support System
 
ilovepdf_ ( التحليل الوظيفي : العامل الرئيسي في منهجية الهندسة القيمية) المحا...
ilovepdf_ ( التحليل الوظيفي : العامل الرئيسي في منهجية الهندسة القيمية) المحا...ilovepdf_ ( التحليل الوظيفي : العامل الرئيسي في منهجية الهندسة القيمية) المحا...
ilovepdf_ ( التحليل الوظيفي : العامل الرئيسي في منهجية الهندسة القيمية) المحا...
 
WebEngage demo at Unpluggd (Nov, 2011)
WebEngage demo at Unpluggd (Nov, 2011)WebEngage demo at Unpluggd (Nov, 2011)
WebEngage demo at Unpluggd (Nov, 2011)
 
Rated Ranking Evaluator (FOSDEM 2019)
Rated Ranking Evaluator (FOSDEM 2019)Rated Ranking Evaluator (FOSDEM 2019)
Rated Ranking Evaluator (FOSDEM 2019)
 
Rated Ranking Evaluator: An Open Source Approach for Search Quality Evaluation
Rated Ranking Evaluator: An Open Source Approach for Search Quality EvaluationRated Ranking Evaluator: An Open Source Approach for Search Quality Evaluation
Rated Ranking Evaluator: An Open Source Approach for Search Quality Evaluation
 

Valuations User Feedback Algorithms Team Review Goals and Strategies

  • 2. Valuation Estimates  Extract features from property data (# beds, # baths, sqft, past sales etc)  Use a very complex algorithm to estimate price using these features  Give users the option to register their feedback
  • 3. What We Do  Extract features from property data (# beds, # baths, sqft, past sales etc)  Use a very complex algorithm to estimate price using these features  Give users the option to register their feedback
  • 7. Goals  Auto correction of the estimate based on the feedback?  Checking for obvious mistakes?  Facilitating easy review of the feedbacks?  Discovering new useful features?
  • 8. Goals  Auto correction of the estimate based on the feedback? No  Checking for obvious mistakes?  Facilitating easy review of the feedbacks?  Discovering new useful features?
  • 9. Goals  Auto correction of the estimate based on the feedback?  Checking for obvious mistakes? Yes  Facilitating easy review of the feedbacks?  Discovering new useful features?
  • 10. Goals  Auto correction of the estimate based on the feedback?  Checking for obvious mistakes?  Facilitating easy review of the feedbacks? Yes  Discovering new useful features?
  • 11. Goals  Auto correction of the estimate based on the feedback?  Checking for obvious mistakes?  Facilitating easy review of the feedbacks?  Discovering new useful features? Perhaps
  • 15. What is the Sorting Based on?  How detailed is the replay?  How far off are we?  Did a registered user submit the feedback?  Normalization/ regularization
  • 16. Distribution by Geographical Scope Global Average: 1.2178
  • 17. Text Clustering (in progress)  Use Apache Mahout to cluster feedback text  Discover terms that most frequently occur together in feedback texts