This document discusses quantifying, modeling, and applying techniques to address descriptor instability in image processing. It introduces the problem of descriptor instability, models the instability using Fisher vectors, and applies the Fisher vector approach on image classification tasks, achieving steady but marginal improvements over previous methods. In conclusion, descriptor instability is modeled as observational variance, with the Fisher vector technique treating it as a physical phenomenon that can be engineered to produce more robust descriptors.

1. GoDataDriven
PROUDLY PART OF THE XEBIA GROUP
ivoeverts@godatadriven.com
Robustifying Descriptor Instability
using FisherVectors
Ivo Everts
Data Driver
IEEETransactions on Image Processing, 2014
Ivo Everts & Jan van Gemert &Thomas Mensink &Theo Gevers

2. Introduction
Koen van de Sande & Theo Gevers, University of Amsterdam at the Visual Concept Detection and Annotation Tasks

3. Introduction

4. Introduction
x1
x2
}
}

5. Outline
Descriptor instability
quantified modeled applied

6. Outline
Descriptor instability
quantified modeled applied

7. Descriptor instability quantified

8. Descriptor instability
—————————— Descriptor norm ——————————
Descriptor instability quantified

9. Descriptor instability
—————————— Descriptor norm ——————————
Descriptor instability quantified

10. Descriptor instability
—————————— Descriptor norm ——————————
Descriptor instability quantified

11. Descriptor instability
—————————— Descriptor norm ——————————
Descriptor instability quantified

12. Descriptor instability
—————————— Descriptor norm ——————————
Descriptor instability quantified

13. Descriptor instability
—————————— Descriptor norm ——————————
Descriptor instability quantified

14. Descriptor instability
—————————— Descriptor norm ——————————
Descriptor instability quantified

15. Outline
Descriptor instability
quantified modeled applied

16. Descriptor instability modeled
The data model:

17. Descriptor instability modeled
The data model:
The old:

18. Descriptor instability modeled
The data model:
The old: The new:

19. Descriptor instability modeled
The data model:
The old: The new:
<

20. Descriptor instability modeled
The FisherVectors:

21. Descriptor instability modeled
D x K
D x K
2 x 5
2 x 5
The FisherVectors:

22. Outline
Descriptor instability
quantified modeled applied

23. Descriptor instability applied

24. Descriptor instability applied

25. Descriptor instability applied

26. Descriptor instability applied

27. Descriptor instability applied

28. Conclusion
Descriptor instability
Solid modelling as observational variance
Physical phenomenon / engineering artefact
Steady but marginal improvements on various problems

29. GoDataDriven
We’re hiring / Questions? / Thank you!
Ivo Everts
Data Driver ivoeverts@godatadriven.com