VERDIKT conference 2010

1. e-government and open
government-
how measurements can help
Mikael Snaprud, Morten Goodwin
Tingtun AS
Verdikt, Oslo, Norway, Nov. 1-2, 2010
This work is licensed under the Creative
Commons Attribution-ShareAlike License. Project no.: Verdikt 183392/S10

2. Building on open results
www.egovmon.no
• Supported by Research Council of Norway, Verdikt.
• User driven project, over three years, end oct. 2011.
Tools
• 21 municipalities and 12 research partners.
• Open source tools to measure eGovernment.
Accessibility and Transparency.
www.egovmonet.eu
• EC, FP6
• 3 years
Methodologies
• 10 partners
• Supported by European Commission, CIP.
• Well over 300 members in ePractice.
• Phase 1: ended May 2010, methods on eGov user
satisfaction and impact, draft measure handbook.
• Phase 2: European network on eGov measurement
methods.

3. Measurements in
Improvement cycles
for web sites
Policy
making
CMS
eGovMon vendors
crawler
Benchmarks
No 1
Editors and
No 2 web masters
No 3
…
●
Check based on UWEM, WCAG 1.0
●
20% of defined tests automated
Lower cost, more frequent possible,
can direct manual testing
●
Manual and automated - correlation

4. Project partners
Pilot Research
Municipalities and policy support
Associate partners invitation opened now
4

5. Use of measurement results
Policy making Status and development
eGov
measure-
ments
Method improvement Practical retrofitting
5

6. Policy making Status and development
eGov
measure-
ments
Method improvement Practical retrofitting
●Measurement of web site barriers in public and
private sector
● Used to estimate cost of retrofitting
●Basis for decisions on regulation coverage and
implementation schedule
●Report on societal impact for Difi (Norwegian
Agency for Public Management and eGovernment)
6

7. Policy making Status and development
Policy making
eGov
measure-
ments
Method improvement Practical retrofitting
9.1.HTML.01
12.3.HTML.04
7.4.HTML.01
7.2.HTML.01
7.2.CSS.02
7.3.HTML.01
12.3.HTML.01
1.1.HTML.06
7.5.HTML.01
3.6.HTML.03
12.1.HTML.01
12.4.HTML.01
UWEM tests
3.5.HTML.03
6.4.HTML.01
1.1.HTML.01
3.2.HTML.01
11.2.HTML.01
12.4.HTML.02
13.1.HTML.01
3.2.CSS.01
3.2.HTML.02
11.2.HTML.02
11.1.HTML.01
0 10 20 30 40 50 60 70 80 90 100
Percantage of pages with barrier
Used in the eGovernment Benchmark Survey 2009, presented by Capgemini.
Municipalities compare neighbor performance. 7

8. Benchmarking results
Policy making Status and development
eGov
measure-
ments
Method improvement Practical retrofitting
Generated
PDF report with
overview of the
21 test results
And full list of tested
web pages and barriers
http://accessibility.egovmon.no
8

9. Policy making Status and development
Status and development
eGov
measure-
ments
Method improvement Practical retrofitting
● Monthly checks of the municipality web sites
● On demand check of
● Web site
● Web page
● PDF document
●Help to locate and fix
many barriers
● Site checks, for discussion with the leading CMS vendors
9

10. Policy making Status and development
eGov
Web page accessibility
PRACTICAL RETROFITTING
measure-
ments
Method improvement Practical retrofitting
http://accessibility.egovmon.no
10

11. Policy making Status and development
eGov
Web site accessibility
measure-
ments
Method improvement Practical retrofitting
Generated
PDF report with
overview of the
21 test results
And full list of tested
web pages and barriers
http://accessibility.egovmon.no
11

12. Policy making Status and development
Method improvement
eGov
measure-
ments
Practical retrofitting
PDF accessibility
http://accessibility.egovmon.no 12

13. Policy making Status and development
Policy making eGov
measure-
ments
Method improvement Practical retrofitting
EU UN
eGovMoNet phase 2 pending to work on United Nations Department of Economic and
Social Affairs (UNDESA)
●
Methodology matrix
"2012 E-Government Survey: Towards a more
●
Recommendations on eGov measurement Citizen-Centric Approach”
methods. back office management,
●
●
Transparency measurement ● citizen usage of e-gov services,
methodologies integration of government websites towards
●
●
Open Source tools the single portal,
● inclusiveness and availability of environment
●
Impact and cost benefit of eGov related information and services
measurements
13

14. Main current issues
●
Migration of UWEM to WCAG 2.0
●
Transparency method and implementation
●
Reporting tool improvements
●
User collaboration
●
eGov efficiency analysis
●
Obtain data for accessibility models
●
Portal requirements for procurement
14

15. Conclusions
● Open method, software and results to
● Facilitate method Improvements
● Share the cost and the improvements
● Build awareness and skills
● Automatic measurements provide
● Good repeatability
● Limited scope - Manual evaluations needed for full coverage
● Information to direct manual (and more costly) evaluations
● Measurements on demand are helpful to
● Give immediate feedback on adjustments
● Maintain awareness between annual benchmarks
● Facilitate a dialogue between customer and portal vendor
15

16. www.egovmon.no
Contact:
www.uia.no
www.tingtun.no
Mikael.snaprud@tingtun.no
16

17. Implemented automatic tests
Test ID Brief description
1.1_HTML_01 check that non-text content has a text equivalent.
1.1_HTML_06 nontext content embedded with the non-standard embed element, such as wrong use videos
3.2_HTML_01 check that the document contains a valid document type declaration.
3.2_HTML_02 find violations against the formal schema for HTML 4.x or XHTML 1.0.
3.5_HTML_03 check that no levels are skipped in the heading hierarchy.
3.6_HTML_03 find paragraphs, line breaks and numbers that are used to simulate numbered lists and which can be replaced with the
old element
6.4_HTML_01 check that mouse-specific event handlers have a keyboard specific (or device independent) version.
7.2_HTML_01 find any blink elements.
7.3_HTML_01 find marquee elements. (Will cause blinking)
7.4_HTML_01 find elements that can cause page refreshing.
7.5_HTML_01 find elements that can cause page redirecting.
9.1_HTML_01 find server-side image maps.
11.1_HTML_01 find out whether the latest versions of W3C technologies for HTML and XHTML have been used.
11.2_HTML_01 find deprecated HTML elements.
11.2_HTML_02 find deprecated HTML attributes.
12.1_HTML_01 find frames without description.
12.3_HTML_01 find fieldsets without legend.
12.3_HTML_04 find optgroup elements without label. Optgroups are often used in menus.
12.4_HTML_01 find form control elements without id.
12.4_HTML_02 find form control elements without label element.
13.1_HTML_01 find a elements with the same title and text with different different link target (href). If no title attribute is provided, only
the element text is checked.
3.2_CSS_01 find violations against the formal grammar for CSS 1.0 or CSS 2.x.
7.2_CSS_02 find CSS rules that cause content to blink.
17