Open Data Charter Measurement Guide
  • Open Data Charter Measurement Guide
  • Executive Summary
  • Introduction
  • Purpose of the Measurement Guide
  • Five open data measurement tools
  • Measuring the Open Data Charter principles
  • PRINCIPLE 1 — Open by Default
  • PRINCIPLE 2 — Timely and Comprehensive
  • PRINCIPLE 3 — Accessible and Usable
  • PRINCIPLE 4 — Comparable and Interoperable
  • PRINCIPLE 5 — For Improved Governance and Citizen Engagement
  • PRINCIPLE 6 — For Inclusive Development and Innovation
  • Appendix
Powered by GitBook
On this page
  • Appendix I: Indicator tables for Charter principles
  • Appendix II: Measurement Guide methodology
  • Appendix III: Useful resources

Appendix

PreviousPRINCIPLE 6 — For Inclusive Development and Innovation

Last updated 7 years ago

Appendix I: Indicator tables for Charter principles

The indicator tables are a result of the analysis conducted through comparative mapping of five indicators based on the indicators provided by ODB, GODI, ODIN, OURdata, and EODMA. See an initial mapping of this work in this , and the document.

Authors (in alphabetical order):

  • Alison Rygh, OECD

  • Ana Brandusescu, Web Foundation

  • Arturo Rivera Perez, OECD

  • Carlos Iglesias, Web Foundation

  • Danny Lämmerhirt, Open Knowledge International

  • Eric Swanson, Open Data Watch

  • Heleen Vollers, Capgemini

  • Jamison Crowell, Open Data Watch

  • Reginald Dadzie, OECD

  • Stephen Gates, Open Data Institute Australian Network

  • Wendy Carrara, Capgemini

The comprehensive Indicator Tables is available in AirTable.

Appendix II: Measurement Guide methodology

As demonstrated in this guide, Charter principle commitments include policy elements, aspects of information management, questions of data quality, but also engagement processes within government and between government and external parties. On the surface, the Charter principles offer valuable commitments. But what exactly do they mean? How are key terms of the Charter principles defined? What indicators can we use to measure progress against Charter commitments? To answer these questions, working group members organised several meetings, firstly extracting key terms in the Charter commitments, and looked how well indicators map onto these. The goal of these exercises was to answer the following questions:

  • How well are key terms in commitments defined?

  • How do Charter commitments relate to one another, where are overlaps and relationships?

  • What reference points and criteria are suited to measure commitments and their key terms?

  • Where do we disagree how indicators should be defined?

  • What is not measurable?

Title

Description

Principle commitment

Listed the text of each principle commitment. This was the basis to list all components of a commitment.

Commitment component

Isolated different aspects that a commitment is talking about. For example, if a commitment says that Charter adopters will provide timely, high-quality data we extracted as components 1) timely data, and 2) high-quality data.

Indicator

Describes the phenomenon that is actually measured.

Target value

What is the best value that can be achieved? How is it defined?

Assessment process of target value

In your assessment process what information do you consult to assess whether a target value is met?

Unit of analysis

A unit of analysis is the ‘thing’ being measured. Every indicator assesses at least one unit of analysis. Often, there are several interpretations of it. For example, data findability can include website observation, naming URLs, or the time it takes to find a dataset. Given this, different measurement tools use different units of analysis.

Type of metric

What metric does the indicator use? (e.g. Boolean value, likert scale, multiple choice, etc)

Appendix III: Useful resources

The Charter MAWG members contributed to a mapping exercise to understand which parts of the Charter principles and their commitments are currently measurable, which could be measured in the future, and which may not be directly measurable. The reflections also helped us understand the extent to which measurement tools cover all of the Charter commitments. This work was exploratory. The purpose was to gather expert views on possible ways to measure the Charter. The include . Simultaneously, the analysis covered how well-suited measurement tools are to assess aspects of the Charter principles. A ‘task force’ was created that includes researchers from five major open government data assessment tools (ODB, GODI, ODIN, OURdata, EODMA), that identified similarities, differences and gaps.

A Maturity Model for Prioritizing Open Government Data. Available at:

Benchmarking open data automatically. Available at:

Data on the Web Best Practices. Available at:

Documenting the development of open standards for data. Available at:

European Open Data Portal in 2015 (”

Governing by indicators. Global Power through Quantification and Rankings. Available at:

Governing by rankings: How the Global Open Data Index helps advance the open data agenda. Available at:

ODI Maturity Model: Guide - Assessing your open data publishing and use. Available at:

OECD Handbook on Constructing Composite Indicators. Methodology and User Guide. Available at:

Open Data Barometer Global Report. Available at:

Open Data Charter Agricultural Open Data Package. Available at: /

Open Data Impact: Open Data Is Changing The World In Four Ways. Available at:

Open Data Maturity Report 2017. Available at:

Open Definition 2.1. Available at:

Sunlight Foundation’s Open Data Policy Guidelines. Available at:

The New European Interoperability Framework. Available at:

The State of Open Government Data in 2017. Available at:

spreadsheet
original indicator tables
document
results
additional observations
https://opengovdata.io/2014/maturity-model-for-prioritization/
https://theodi.org/guides/benchmarking-data-automatically
https://www.w3.org/TR/dwbp/
https://theodi.org/blog/documenting-the-development-of-open-standards-for-data
“Creating Value through Open Data: Study on the Impact of Re-use of Public Data Resources
https://global.oup.com/academic/product/governance-by-indicators-9780199658244?cc=nl&lang=en&
https://research.okfn.org/governing-by-rankings/
https://www.scribd.com/document/260481608/ODI-Maturity-Model-Guide-Assessing-your-open-data-publishing-and-use#download&from_embed
https://www.oecd.org/std/42495745.pdf
https://opendatabarometer.org/4thedition/report/
https://opendatacharter.net/agriculture-open-data-package
http://odimpact.org/
https://www.europeandataportal.eu/en/highlights/open-data-maturity-europe-2017
http://opendefinition.org/
https://sunlightfoundation.com/opendataguidelines/
https://ec.europa.eu/isa2/eif_en
https://blog.okfn.org/files/2017/06/FinalreportTheStateofOpenGovernmentDatain2017.pdf