Five open data measurement tools

Open Data Charter Measurement Guide

Search…

Open Data Charter Measurement Guide

Executive Summary

Introduction

Purpose of the Measurement Guide

Five open data measurement tools

Measuring the Open Data Charter principles

PRINCIPLE 1 — Open by Default

PRINCIPLE 2 — Timely and Comprehensive

PRINCIPLE 3 — Accessible and Usable

PRINCIPLE 4 — Comparable and Interoperable

PRINCIPLE 5 — For Improved Governance and Citizen Engagement

PRINCIPLE 6 — For Inclusive Development and Innovation

Appendix

Five open data measurement tools

There are currently five measurement tools that measure both similar and different aspects of open government data.
​1—Open Data Barometer​
Description
Methodology
Geographic Coverage
An assessment of open data readiness, implementation and impact. It analyses global trends, and provides comparative data on countries and global regions.
Expert survey and secondary data.Assessment based on quantitative and qualitative data that combines contextual data, technical assessments and secondary third-party indicators. Results are peer reviewed and have a QA process. ODB methodology and research handbook.
115 countries covered in 2016. Countries (focuses on national governments). Includes G8, and G20 countries, as well as most of OGP and OECD countries. Expanding coverage from 77 countries in 2013 to 115 countries in 2016.
Data collection
Data Publication
Charter Principle Coverage
4th edition: August- December 2016 / 3rd edition: July-October 2015 / 2nd edition: June-September 2014 / 1st edition: July-October 2013
4th edition: May 2017 / 3rd edition: April 2016 / 2nd edition: January 2015 / 1st edition: October 2013
All six Charter principles, but not fully.
2—Global Open Data Index​
Description
Methodology
Geographic Coverage
An assessment of key datasets in 15 thematic areas available as open data. Includes a summary analysis of trends and roadblocks. Key datasets are developed in collaboration with expert CSOs to ensure relevance for civil society. GODI is developed by Open Knowledge International.
Ongoing crowdsourcing with expert review to create an annual index. Discussions from survey and review displayed publicly. Checklist with qualitative justifications. GODI methodology.  
94 countries covered in 2016/2017. (focuses on national governments). Expanding coverage from 70 countries in 2013 to 94 countries in 2016/17.
Data Collection
Data Publication
Charter Principle Coverage
2016/17 edition: June 2017 / 2015 edition: December 2015 / 2014 edition: December 2014 / 2013 edition: December 2013
2016/17 edition: October 2016-January 2017 / 2015 edition: August 2015 until December 2015 / 2014 edition: August 2014 until December 2014 / 2013 edition: August 2013 until December 2013
Addresses Charter principles 2 and 3.
​
3—Open Data Inventory​
Description
Methodology
Geographic Coverage
An assessment of the coverage and openness of official statistics across 21 data categories. Index focuses on data made available by national statistics offices (NSOs) and other official sources of national data (provided they are linked from NSO websites). ODIN is developed by Open Data Watch.
Research carried out by trained researchers. Inputs from government officials taken into consideration.Two rounds of review conducted by Open Data Watch staff. ODIN methodology.
180 countries covered in 2017;. subnational data assessed at administrative levels 1 and 2.
Data Collection
Data Publication
Charter Principle Coverage
ODIN 2017: June-September 2016 /  ODIN 2016: June-October 2015 / ODIN 2015: June-September 2014 
ODIN 2017: March 2018 / ODIN 2016: February 2017 / ODIN 2015: February 2016
Addresses Charter principles 2, 3 and 4, but not fully.
​
4—OECD OURdata Index​
Description
Methodology
Geographic Coverage
An assessment of open government data policies across OECD countries and partners, focusing on data availability, accessibility and governments’ support for reuse. OURdata is developed by OECD Secretariat.
Government survey completed by public sector officials from OECD countries and partners, with analysis by OECD Secretariat. Includes secondary third-party indicators. A high level overview of the report can be found in the OECD publication Government at a Glance 2017, Section 10, Open Government Data (p192). Note that OURdata methodologies are not publicly available online. The latest methodology is still in draft form.
32 countries covered in the 2017 OURdata Index. 31 OECD countries (focusing on national governments), and 1 country partner (Colombia)

Data Collection
Data Publication
Charter Principle Coverage
2016/2017 Instrument: OECD Open Government Data Survey 3.0. / 2014 Instrument: OECD Open Government Data Survey 2.0 Pilot 
2017 Edition: July 2017 / Pilot index: 2015
All six Charter principles, but not fully.
​
5—European Open Data Maturity Assessment​
Description
Methodology
Geographic Coverage
An assessment of open data maturity across Europe covering the level of open data readiness, assessing the span of national policies promoting open data and the estimated impact of open data, and portal maturity. EODMA is developed by European Data Portal, a project of the European Commission.
Government survey completed by officials with validation and analysis from the European Data Portal team in cooperation with government officials. EODMA methodology in Annex III of report
39 countries covered in 2017. The 28 EU Member States, Liechtenstein, Norway, Switzerland and Iceland. Also EU accession countries (focuses on national governments.
Data Collection
Data Publication
Charter Principle Coverage
2017 edition: June 2016-May 2017 with possibility to update sections until September 2017 / 2016 edition: June 2015-May 2016 with possibility to update sections until August 2016 / 2015 edition: June 2014-May 2015
3rd edition: November 2017 / 2nd edition: October 2016  / 1st edition: November 2015 

All six Charter principles, but not fully.
​