Data in government

DIT's Data Workspace - all our data, in one place

Agnes Coaker - Senior Data Analyst, Department for International Trade, 11 January 2023 - Data Engineering, Data science, Implementation

Data Workspace is a DIT platform providing one place for our people to find data they need. They can search, view and analyse it, all in one place.

Beyond checklists: critical thinking about data ethics, technology and AI

Michael Hodge – MLOps Strategy Lead, Ministry of Justice and Harriet Sands – AI Technical Specialist, NHS England, 9 November 2022 - Data Ethics, Data literacy, People and Skills

On the 6 th December 2022, the Data Ethics and Society Reading Group will run its fourth event of the year, focusing on Artificial Unintelligence. Here, Harriet and Michael talk about the group.

How we are using machine learning to detect GOV.UK feedback spam

Felix Reilly, Data Scientist, Government Digital Service, 3 October 2022 - Data insights, Data science, Machine learning

The GOV.UK feedback form was receiving a lot of spam requests. We developed a machine learning model to detect spam responses — here is how we created it.

Splink: Fast, accurate and scalable record linkage

Robin Linacre - Data scientist, Ministry of Justice, 23 September 2022 - Data Engineering, Data science, Python

A common data quality problem is to have multiple different records that refer to the same entity but no unique identifier that ties these entities together. For example, customer data may have been entered multiple times by accident, or …

Mentoring a Successful RAP Project

Jacob Cole – Data scientist, Office for National Statistics, 8 August 2022 - agile, Reproducible Analytical Pipelines

Reproducible Analytical Pipelines (RAPs) are automated statistical and analytical processes. They ensure that analysis is reproducible, efficient, and high quality. The Analysis Standards and Pipelines team have worked with teams across government to help them implement RAP. From our experiences …

Automatically produce best practice spreadsheets

Rowan Hemsi, Data Scientist, Office for National Statistics, 24 June 2022 - Excel, Python, Reproducible Analytical Pipelines, Spreadsheets

Learn how to create good practice accessible spreadsheets as part of Reproducible Analytical Pipelines using gptables. Learn about how we developed in the open.

Using the Beneficial Ownership Data Standard to support the Economic Crime Bill

Data Standards Authority, CDDO, 31 March 2022 - Beneficial Ownership, Data Standards, Open Standards

The BODS standard creates transparency in corporate governance

Using a federated model for API discovery in government

Bethan Palmer, Data Standards Authority Developer, Central Digital and Data Office, 18 February 2022 - Data Standards, Guidance, Implementation, People and Skills

The CDDO Data Standards Authority are working on the discovery of Application Programming Interfaces (APIs) within and between different government departments and agencies. APIs are a great way to share data as and when it’s needed using agreed open formats, rather than copying and duplicating data in different places.

Comparing ethnicity data for different countries

Darren Stillwell - Head of Quality and Standards, Equality Hub, 25 January 2022 - Data insights, Data Standards, People and Skills, Statistics

The Race Disparity Unit at the Cabinet Office Equalities Hub have analysed different approaches taken by national governments to understanding how they compare on issues such as ethnic diversity and cultural identity.

What is our new Algorithmic Transparency Standard?

Natalia Domagala, Head of Data Ethics - CDDO, 29 November 2021 - Data Ethics

The Central Digital and Data Office has developed the Algorithmic Transparency Standard to help public sector bodies in the UK share information on their use of algorithmic tools with the general public.

Blog Data in government

Joining up the dots: the findings of our recent API discovery