Download to read offline
Uploaded byMassTLC
Andres Corrada-Emmanuel - Ground Truth Problems in Business
The document discusses challenges in obtaining ground truth data in business applications. It notes that ground truth is difficult to acquire for recent data and can be expensive. However, ground truth statistics are valuable for measuring accuracy and performance. The document explores techniques for obtaining approximate ground truth values through methods like wisdom of the crowds, combining multiple independent labels, and data stream algorithms that don't explicitly store ground truth labels.
Andres Corrada-Emmanuel - Ground Truth Problems in Business
- 1. Ground Truth Problems in Business AndrésCorrada-Emmanuel Data Engines github.com/andrescorrada/ground-truth-problems-in-business
- 2.
- 3.
- 4. No Ground Truth because datais recent github.com/andrescorrada/ground-truth-problems-in-business
- 5.
- 6. No Ground Truth because itis expensive to get github.com/andrescorrada/ground-truth-problems-in-business
- 7.
- 8. The journey ofground truth solutions • Measurement • Diagnosis • Solution github.com/andrescorrada/ground-truth-problems-in-business
- 9. Statistics of GroundTruth Statistic(answer key, student exam) = grade Statistic(labels, classifications) = accuracy github.com/andrescorrada/ground-truth-problems-in-business
- 10. The value of ground truthstatistics in business github.com/andrescorrada/ground-truth-problems-in-business
- 11.
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
- 18.
- 19.
- 20.
- 21.
- 22.
- 23.
- 24.
- 25.
- 26.
- 27. github.com/andrescorrada/ground-truth-problems-in-business Ground TruthWisdom ofthe Crowd Best of Three 88% reduction in errors
- 28.
- 29. The Ground Truthis out there, it’s just too large github.com/andrescorrada/ground-truth-problems-in-business
- 30. Data Stream Algorithms- refusing to remember ground truth github.com/andrescorrada/ground-truth-problems-in-business
- 31.
- 32.
- 33.
- 34.
- 35.
- 36.
- 37.
- 38. github.com/andrescorrada/ground-truth-problems-in-business Nov-23-00 Nov-24-00 Nov-25-00 Nov-26-00 Nov-27-00 Nov-28-00 Nov-29-00 Nov-30-00 Dec-01-00 Dec-02-00 Dec-03-00 Dec-04-00 Dec-05-00 Dec-06-00 Nov- 23- 00 Nov-24- 00 Nov- 25- 00 Nov- 26- 00 Nov- 27- 00 Nov- 28- 00 Nov- 29- 00 Nov- 30- 00 Dec- 01- 00 Dec- 02- 00 Dec- 03- 00 Dec- 04- 00 Dec- 05- 00 Dec- 06- 00 First Arrival "Learning" IP Self Match Rate: AppNexus RTB 0 0.2 0.4 0.6 0.8
- 39. Grading an exam without theanswer key github.com/andrescorrada/ground-truth-problems-in-business
- 40. github.com/andrescorrada/ground-truth-problems-in-business • “Do youneed ground truth to calculate a statistic of it?” a. “Yes” b. “No” A question from a multiple-choice exam
- 41.
- 42.
- 43.
- 44.
- 45.
- 46.
- 47.
- 48.
- 49.
- 50.
- 51.
- 52.
- 53.
- 54.
- 55. Why 4,000 Questions? •Correlations! • Small ground truth size or non-independent classifiers require a different model .... Our secret sauce. github.com/andrescorrada/ground-truth-problems-in-business
- 56. Ground Truth forRegressors
- 57. Ground Truth forRegressors
- 58. Ground Truth forRegressors
- 59. Low High Elevations Sample DEMFused DEM Blunders are removed and noise is reduced
- 60.