Data Quality

Strengths and limitations

In order to determine the quality of the statistics that we publish, PHS assesses the risk of data quality concerns (external website) for each publication. Publications are assigned a low, medium or high data quality risk rating. This rating is based on factors such as the number of data suppliers involved, the complexity of the data collection process and the quality assurance checks applied to the data. This publication has been assigned a low risk of data quality concerns.

How can the data in this publication be used?

This data can be used to:

  • Compare areas across Scotland
  • View trends over time
  • Compare activity between different specialties, age and sex groups, or deprivation levels
  • Assess whether patients were treated within or outwith their own Health Board
  • Explore the relationship between hospital activity and living in a deprived area

This data should not be used to:

  • Directly compare with other UK countries
  • Identify areas of affluence
  • Identify how much more deprived an area is from another

Data collection and validation

The data presented in this publication are sourced from hospital administrative systems across Scotland and extracted from the Scottish Morbidity Record (SMR) 01 and 04 datasets held by PHS (formerly ISD Scotland).

The Scottish Government target for SMR submission to PHS is 6 weeks following a hospital admission or discharge, or transfer/death/clinic attendance. For example, all SMR records with a March 2019 date of discharge would be expected to be submitted to PHS by 12th May 2019. NHS Boards know how complete their SMR submissions are and the extent of any backlog (data which are not submitted by the 6-week deadline) and this information is used to produce completeness figures. Further details of SMR data completeness and timeliness can be found on the SMR Completeness and Timeliness web pages respectively.

Image showing a data flow diagram  illustrating the process of data collection and validation

Communication with data supply partners

The SMR01 and SMR04 data used in this publication is processed and monitored by the Data Support & Monitoring Team. More information can be found on the data monitoring page (external website).

Summary of data completeness

NHS Board
  Apr'20-Jun'20 Jul'20-Sep'20 Oct'20-Dec'20 Jan'21-Mar'21 Jul'20-Sep'20 Oct'20-Dec'20 Jan'21-Mar'21
Ayrshire & Arran 100% 100% 100% 100% 100% 100% 100%
Borders 100% 100% 100% 100% 100% 100% 100%
State Hospital         100% 100% 0%
Golden Jubilee 100% 100% 100% 100%      
Fife 99% 99% 99% 99% 100% 100% 100%
Greater Glasgow & Clyde 100% 99% 99% 99% 100% 100% 100%
Highland 99% 99% 99% 99% 100% 100% 100%
Lanarkshire 100% 100% 100% 100% 100% 100% 100%
Grampian 97% 98% 98% 98% 98% 100% 99%
Orkney 100% 100% 100% 99%      
Lothian 99% 99% 97% 98% 100% 100% 100%
Tayside 100% 100% 100% 99% 99% 98% 98%
Forth Valley 98% 97% 96% 97% 100% 100% 100%
Western Isles 100% 100% 100% 100% 100% 100% 100%
Dumfries & Galloway 100% 99% 98% 98% 100% 100% 100%
Shetland 98% 99% 99% 98%      
All NHS Boards 99% 99% 99% 99% 99% 99% 99%

The above table draws upon the data management page (external website) to present completeness for the patient-level datasets. The above completeness estimates were taken on 12 October 2021.

Data quality issues

General issues

For the financial year 2020/21, the SMR01 and SMR04 datasets were both estimated to be 99% complete (as at October 2021). Completeness varied between the NHS boards, and further information on the completeness of individual NHS boards can be found above.

For this release, data from the State Hospital was only available up until 31 December 2020 at the time of data extraction. This was due to systems issues at the State Hospital. The average number of State Hospital discharges since 1997/1998 is 140 per year and as such the missing fourth quarter for 2020/2021 should not affect the data significantly.

Data quality assessment

The PHS Data Quality Assurance (DQA) team is responsible for ensuring that SMR datasets are accurate, consistent and comparable across time and between sources. The DQA team’s assessments web page (external website) contains details of past Data Quality Assurance Assessments of SMR01 and SMR04 data, including findings on the accuracy of submitted data items used in our analysis such as specialty and admission type. In order to assess the quality of recording, the DQA compares samples of records against source evidence in hospital systems and patient case notes. PHS have a 90% standard for accuracy and recording of data.

The Mental Health team who produce this publication also carry out thorough quality assurance (QA) checks on the data after extraction from the databases, in accordance with the PHS checking guidance (external website). For example, they compare figures for the same years between the current and previous publications in order to identify any large changes in the data sources. Additionally, they look at trends within the current publication in order to identify any unusual patterns. For changes or patterns in the data which cannot be explained by the known completeness estimates, the team contact the relevant board to highlight the issue and request an explanation. Any information provided by the board is included in this report.

Data sources

The data presented in this publication are sourced from hospital administrative systems across Scotland and extracted from the Scottish Morbidity Record (SMR) 04 and 01 datasets held by PHS. The specialty of learning disability is excluded from the figures published here.

Last updated: 21 March 2024
Was this page helpful?