Data Engineering

Using Data Science for Next-Gen Statistics

Brid Roissetter – Data Scientist, The Office for National Statistics and Dominic Bean – Data Scientist, The Office for National Statistics, 14 February 2023 - Data Engineering, Data science, Other tools, Python, Reproducible Analytical Pipelines

As the 21st century progresses, using data effectively has become a priority for many organisations, including the Office for National Statistics (ONS). The ONS's unique focus, however, goes beyond just utilising data effectively. The organisations ultimate goal is to create …

DIT's Data Workspace - all our data, in one place

Agnes Coaker - Senior Data Analyst, Department for International Trade, 11 January 2023 - Data Engineering, Data science, Implementation

Data Workspace is a DIT platform providing one place for our people to find data they need. They can search, view and analyse it, all in one place.

Splink: Fast, accurate and scalable record linkage

Robin Linacre - Data scientist, Ministry of Justice, 23 September 2022 - Data Engineering, Data science, Python

A common data quality problem is to have multiple different records that refer to the same entity but no unique identifier that ties these entities together. For example, customer data may have been entered multiple times by accident, or …

Engineering the data of the future

Sam Tazzyman - Head of Data Engineering, Ministry of Justice, 30 October 2019 - Data Engineering, Data science

Like most organisations today, the Ministry of Justice (MoJ) wants to use its data more effectively. The goal is to make sure that people making decisions have the insights they need at the right time to guide their decision making, whether that’s front-line prison staff or senior civil servants.

Blog Data in government