e-government and open government - how open measurements can help, Mikael Snaprud, Tingtun AS

e-government and open government-

how measurements can helpMikael Snaprud, Morten Goodwin

Tingtun AS

Verdikt, Oslo, Norway, Nov. 1-2, 2010

Project no.: Verdikt 183392/S10This work is licensed under the Creative Commons Attribution-ShareAlike License.

Building on open resultswww.egovmon.no

• Supported by Research Council of Norway, Verdikt.• User driven project, over three years, end oct. 2011.• 21 municipalities and 12 research partners.• Open source tools to measure eGovernment.

Accessibility and Transparency.

www.egovmonet.eu

• Supported by European Commission, CIP.• Well over 300 members in ePractice.• Phase 1: ended May 2010, methods on eGov user

satisfaction and impact, draft measure handbook.• Phase 2: European network on eGov measurement

methods.

Met

hod o

logi

esT

ools

• EC, FP6• 3 years• 10 partners

Measurements in Improvement cycles for web sites

eGovMoncrawler

Policy making

Editors and web masters

BenchmarksNo 1No 2No 3…

CMS vendors

● Check based on UWEM, WCAG 1.0● 20% of defined tests automated Lower cost, more frequent possible, can direct manual testing● Manual and automated - correlation

4

Project partners

Pilot Municipalities

Researchand policy support

Associate partners invitation opened now

5

Method improvement

Policy making Status and development

Practical retrofitting

eGov measure-

ments

Use of measurement results

6

● Measurement of web site barriers in public and private sector ● Used to estimate cost of retrofitting● Basis for decisions on regulation coverage and implementation schedule● Report on societal impact for Difi (Norwegian Agency for Public Management and eGovernment)

Method improvement

Policy making Status and development

Practical retrofitting

eGov measure-

ments

7

11.1.HTML.01 11.2.HTML.02

3.2.HTML.02 3.2.CSS.01

13.1.HTML.01 12.4.HTML.02 11.2.HTML.01

3.2.HTML.01 1.1.HTML.01 6.4.HTML.01 3.5.HTML.03

12.4.HTML.01 12.1.HTML.01

3.6.HTML.03 7.5.HTML.01 1.1.HTML.06

12.3.HTML.01 7.3.HTML.01

7.2.CSS.02 7.2.HTML.01 7.4.HTML.01

12.3.HTML.04 9.1.HTML.01

0 10 20 30 40 50 60 70 80 90 100

Percantage of pages with barrier

UW

EM

test

s

Policy making

Used in the eGovernment Benchmark Survey 2009, presented by Capgemini.Municipalities compare neighbor performance.

Method improvement

Policy making Status and development

Practical retrofitting

eGov measure-

ments

8http://accessibility.egovmon.no

Generated PDF report with overview of the 21 test results

And full list of tested web pages and barriers

Benchmarking resultsMethod improvement

Policy making Status and development

Practical retrofitting

eGov measure-

ments

9

Status and development

● Monthly checks of the municipality web sites

● On demand check of ● Web site● Web page● PDF document

● Help to locate and fixmany barriers

● Site checks, for discussion with the leading CMS vendors

Method improvement

Policy making Status and development

Practical retrofitting

eGov measure-

ments

10

PRACTICAL RETROFITTING

http://accessibility.egovmon.no

Method improvement

Policy making Status and development

Practical retrofitting

eGov measure-

ments Web page accessibility

11http://accessibility.egovmon.no

Generated PDF report with overview of the 21 test results

And full list of tested web pages and barriers

Web site accessibilityMethod improvement

Policy making Status and development

Practical retrofitting

eGov measure-

ments

12http://accessibility.egovmon.no

Method improvement

Policy making Status and development

Practical retrofitting

eGov measure-

ments PDF accessibility

13

Policy making

Method improvement

Policy making Status and development

Practical retrofitting

eGov measure-

ments

eGovMoNet phase 2 pending to work on

● Methodology matrix

● Recommendations on eGov measurement methods.

● Transparency measurement methodologies

● Open Source tools

● Impact and cost benefit of eGov measurements

United Nations Department of Economic and Social Affairs (UNDESA)

"2012 E-Government Survey: Towards a more Citizen-Centric Approach”

● back office management,

● citizen usage of e-gov services,

● integration of government websites towards the single portal,

● inclusiveness and availability of environment related information and services

EU UN

14

● Migration of UWEM to WCAG 2.0● Transparency method and implementation● Reporting tool improvements● User collaboration● eGov efficiency analysis● Obtain data for accessibility models● Portal requirements for procurement

Main current issues

15

Conclusions

● Open method, software and results to● Facilitate method Improvements ● Share the cost and the improvements● Build awareness and skills

● Automatic measurements provide● Good repeatability● Limited scope - Manual evaluations needed for full coverage● Information to direct manual (and more costly) evaluations

● Measurements on demand are helpful to● Give immediate feedback on adjustments● Maintain awareness between annual benchmarks● Facilitate a dialogue between customer and portal vendor

16

www.egovmon.no

Contact:www.uia.no

[email protected]

17

Implemented automatic testsTest ID Brief description

1.1_HTML_01 check that non-text content has a text equivalent.

1.1_HTML_06 nontext content embedded with the non-standard embed element, such as wrong use videos

3.2_HTML_01 check that the document contains a valid document type declaration.

3.2_HTML_02 find violations against the formal schema for HTML 4.x or XHTML 1.0.

3.5_HTML_03 check that no levels are skipped in the heading hierarchy.

3.6_HTML_03 find paragraphs, line breaks and numbers that are used to simulate numbered lists and which can be replaced with the old element

6.4_HTML_01 check that mouse-specific event handlers have a keyboard specific (or device independent) version.

7.2_HTML_01 find any blink elements.

7.3_HTML_01 find marquee elements. (Will cause blinking)

7.4_HTML_01 find elements that can cause page refreshing.

7.5_HTML_01 find elements that can cause page redirecting.

9.1_HTML_01 find server-side image maps.

11.1_HTML_01 find out whether the latest versions of W3C technologies for HTML and XHTML have been used.

11.2_HTML_01 find deprecated HTML elements.

11.2_HTML_02 find deprecated HTML attributes.

12.1_HTML_01 find frames without description.

12.3_HTML_01 find fieldsets without legend.

12.3_HTML_04 find optgroup elements without label. Optgroups are often used in menus.

12.4_HTML_01 find form control elements without id.

12.4_HTML_02 find form control elements without label element.

13.1_HTML_01 find a elements with the same title and text with different different link target (href). If no title attribute is provided, only the element text is checked.

3.2_CSS_01 find violations against the formal grammar for CSS 1.0 or CSS 2.x.

7.2_CSS_02 find CSS rules that cause content to blink.