Presentation of the results of a Focus Group on usability issues of smart billing tools

1. . . . . . . . . . .
Giovanni Pede, Vill@ge (Sinergie)
Soller - Mallorca, 06/04/2013
WP 4
Updates on usability testing

2. . . . . . . . . . .
WP 4 – Updates on usability assessment of mock-ups
Usability of mock-ups has been assessed with a Focus Group,
organised in Reggio Emilia on the 31/03/2014
The participants were a panel of experts:
Giuliana Fornaciari, Architect, expert in energy infographics
Giulia Saija, graphic professional
Daria Dolfini, psychologist and expert in ergonomy
Alessandro Borghetti, web designer and developer
Omar Livoni, Energy manager
Faiza Mahri, cultural and linguistic mediator

3. . . . . . . . . . .
WP 4 – Updates on usability assessment of mock-ups
The Focus Group was chaired by Giovanni Pede and Marina Pirazzi.
First session. The participants received four identical 3-item
questionnaires (one for each project pilot) and were given 45’ to
fill them in by looking at the mock-ups hanged on the wall.

4. . . . . . . . . . .
WP 4 – Updates on usability assessment of mock-ups
Second session. There was a debate when each participant had
the opportunity to briefly express their idea on the mock-ups
presented.

5. . . . . . . . . . .
WP 4 – Updates on usability assessment of mock-ups
Some general results for all pilots
- Specify who are the neighbours
- Introduce icons to label graph axes
“thermometer”
“Snowflake”

6. . . . . . . . . . .
WP 4 – Updates on usability assessment of mock-ups
Some general results for all pilots
- The F-pattern: users exhibited an F-shaped pattern when
scanning web content or documents.
- Modify some mock-ups with F pattern

7. . . . . . . . . . .
WP 4 – Updates on usability assessment of mock-ups
Results for Italian mock-ups
- Explain why the integrative information are provided to the
customers, what is their usefulness
- BT and OT appearance are different, they look like as coming
from different utilities
- Provide an icon to explain what is “POD” and where to find this
information
- Users cannot understand what are «degree days»

8. . . . . . . . . . .
WP 4 – Updates on usability assessment of mock-ups
Results for Italian mock-ups
- To provide comparisons among different time bands, pie chart
will be more clear. Also provide % improving on the total

9. . . . . . . . . . .
WP 4 – Updates on usability assessment of mock-ups
Results for Italian mock-ups
- Cumulated consumption: graph not very clear, better to use
line chart

10. . . . . . . . . . .
Taking into account the F-pattern:
- First row (1) is completely read by
the users
- Second row (2) is partially read by
the users
- Third row (3) only the left square
is read by the users
(1)
(2)
(3)

11. . . . . . . . . . .
Taking into account usability tips:
- Users are attracted by icons
- In line (3) in the right square
people expect to find conclusions
(1)
(2)
(3)
17/07/2014

12. . . . . . . . . . .
Taking into account usability tips:
Minor changes will improve the BT
usability
(1)
(2)
(3)

13. . . . . . . . . . .
Results for Italian OT
Insert more comments on graphs to help less
advanced users
The smile indicator is in a position little visible

14. . . . . . . . . . .
Results for Italian OT
Remove the scroll menu. Put directly what the
user expect to see as a first information (last
month/bill) and use arrow to navigate to
previous months (slide left-slide right)

15. . . . . . . . . . .
Results for french mock-ups
Textual part is more detailed
than in other countries, it
will help less advanced users
The textual explanation
should be before the graph.

16. . . . . . . . . . .
Results for french mock-ups
Change the uniform coloring as it is not understandable. It is better
to adopt the (gradation) coloring of the same graph of the Spanish
mock-up

17. . . . . . . . . . .
Results for french mock-ups
Suggestion valid for both french and spanish mock-ups:
Move these labels, this is the position
only for the name of the axis

18. . . . . . . . . . .
Results for spanish mock-ups
In the graphs change the colours with more evocative ones. Icons
should be added.
Include the reasons for the provision of those information and
economic data to a deeper involvement of the users
Remember the F pattern

19. . . . . . . . . . .
Results for spanish mock-ups
It would be more effectiveness to include captions directly in the
graphs, using icons to allow a more rapid reading
Modify color gradation with more evocative: red-yellow-green
gradation
Use infographic tips (add tips in the OT)

20. . . . . . . . . . .
Results for spanish mock-ups
Divide these services in separate rows (and also the related text)

21. . . . . . . . . . .
Results for austrian mock-ups
Graphs are clear and intuitive.
Insert note on the reason for providing these data (also provide a
conclusion)
Insert icons to make more friendly the graphs

22. . . . . . . . . . .
Results for austrian mock-ups
Scales and units not clear
Label axes with icons

23. . . . . . . . . . .
Results for austrian mock-ups
Too equal to energy classes/certification it could be misleading
17/07/2014

24. . . . . . . . . . .
Project partners
The sole responsibility for the content of this presentation lies with the authors. It does not necessarily reflect the opinion of the European Union.
Neither the EACI nor the European Commission are responsible for any use that may be made of the information contained therein.
Thanks for the attention