Contact http://vq.kt.agh.edu.pl

1. “Infrastructure for High-Attendance, Simple
Psychophysical Experiments”
Mikołaj Leszczuk, DSc

2. “Multimedia Information Processing
and Communications” Course
» Several multimedia topics, including
subjective quality evaluation
» Two classes (lessons) on this topic, each
lasting 90 min
» Me personally:
– Fully controlling syllabus
– Actually teaching
» Once or Twice a year (autumn, spring)
2

3. Laboratory
• Reasonable conditions, rather
stable, but not fully BT.500
• Limited illumination control
(“dark”, “dim”, “bright”)
• No 3H distance enforcement
• 12-30 students at once, can
cross-watch
• Homogenous Windows/Linux
PCs, 4+ GB RAM
• Homogenous 720p+ screens
• Gigabit Ethernet access to local
server with file storage & LAMP
• Projector for displaying side info
3

4. Profile of Subjects
» 30-70 “fresh” students
every ½-1 year
» Bias:
– Age (20-25 YO)
– Gender (80-90%
male)
– Background
(geeks)
» Command of English
4

5. Value
» Less control than typical VQEG Test Plan
» More control than crowdsourcing
» Can generate up to 10,000 scores, twice
a year
» Can (should) do extra data processing
» 0 cost
5

6. Software
Quality Crowd
Crowdsourcing QoE
AGH
6

7. Call for…
Experiment
Problem
Definition
Multimedia
Content
7

8. Contact
http://vq.kt.agh.edu.pl