Article Text

Accuracy of routine data on paediatric cataract in the UK compared to active surveillance: lessons from the IOLu2 study
  1. Ameenat Lola Solebo1,
  2. Isabelle Russell-Eggitt2,
  3. Jugnoo Sangheeta Rahi1,2,
  4. on behalf of the British Congenital Cataract Interest Group,
  1. 1MRC Centre of Epidemiology for Child Health, Institute of Child Health University College London, London, UK
  2. 2Clinical and Academic Department of Ophthalmology, Great Ormond Street Hospital, London, UK
  1. Correspondence to Professor Jugnoo Sangheeta Rahi, MRC Centre of Epidemiology for Child Health, University College London, Institute of Child Health, 30 Guilford Street, London, WC1N 1EH, UK; j.rahi{at}ich.ucl.ac.uk

Abstract

Background/aims As part of the UK and Ireland study of primary IOL implantation in children under 2, active surveillance has been undertaken to identify children aged <2 years undergoing surgery for cataract. Ascertainment through active surveillance has been compared to the routine NHS capture of episodes of surgery, in order to identify any weaknesses in routine data collection.

Methods NHS information centre data on the number of children undergoing lens extraction in the first two years of life were compared to the number of cases reported through active surveillance.

Results In 2009 and 2010 in the United Kingdom, 483 episodes of lens extraction in children aged <2 years with lens-related disease were reported to NHS databases, compared to 490 cases of lens extraction for congenital / infantile cataract ascertained by the BCCIG through active surveillance. There was also disparity in the coding of procedures.

Conclusions There is evidence of incomplete and inaccurate reporting to NHS information centres of cataract surgery in children aged <2 years. If the accuracy of the coding could be improved then the Hospital Activity Statistics offer a reasonable approach to monitoring trends in the NHS. Nevertheless, active surveillance clinical networks remain a more robust method of case ascertainment for research.

  • Epidemiology
  • Child health (paediatrics)
  • Lens and zonules

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Introduction

Primary intraocular lens (IOL) implantation is the most important recent innovation in the management of early childhood cataract, and has been widely adopted for the youngest children despite unanswered questions regarding best practice, visual benefits and adverse outcomes.1 In order to answer these questions, a prospective observational study on children undergoing congenital or infantile cataract surgery in the first 2 years of life is currently underway. The aim of the ‘UK and Ireland epidemiological study of primary IOL implantation in children aged under 2 years (the IOLunder2 study (IOLu2))’ is to investigate visual, refractive and adverse outcomes following cataract surgery with or without IOL implantation. This study involves systematic, standardised data collection undertaken through an established national clinical research network, the British Isles Congenital Cataract Interest Group (BCCIG), with cases of children undergoing surgery identified through active surveillance.

Episodes of children undergoing cataract surgery can also be identified, retrospectively, using National Hospital Activity Statistics (HAS). The UK National Health Services (NHS) publish annual summary measures of hospital activity through the Hospital Episode Statistics (HES) agency for NHS England,2 Patient Episode Database for Wales (PEWD) agency for NHS Wales3 and HAS agencies for NHS Scotland and NHS Northern Ireland.4 ,5

Patient data are returned to the NHS Information Centres by hospital administrative staff using diagnostic codes taken from the International Classification of Diseases and treatment codes defined by the Office of Population Censuses and Survey (OPCS).6 The OPCS four-character coding system consists of one letter that indicates the anatomical site for the procedure, followed by two digits that indicate the procedure type, with a third digit adding a more precise description. There are 11 possible codes for lens extraction undertaken in the management of cataract (table 1).

Table 1

Three-character and four-character Office of Population Censuses and Survey (OPCS) classification codes for cataract removal

Codes are derived by administrative staff from clinical information within the medical records. They may also, less commonly, be recorded by medical staff within the medical records. HAS are the primary data source for the NHS and the government for uses such as resource management, service development and quality assurance.2 National level aggregated data for adults and children (individuals aged under 18 years) are freely available online. Data derived from narrower defined age groups, such as children aged under 2 years, are available following formal request. Individual level data (such as patient NHS number or date of birth) are only available from the Information Centres where aggregated data will not suffice.

NHS centralised measures of activity within UK hospitals are a potential data source for monitoring trends in hospital-based interventions for disease such as cataract surgery, and may also provide clues to changing trends in disease incidence. With the evolving NHS, it is now essential that routine data sources on ophthalmic surgical activity be accurate. We report an assessment of the accuracy of the reporting of a highly specialised procedure.

Methods

Case reporting to the National Information Centres

Requests for data on the number of cataract surgery episodes were made to the NHS Information Centres for the four-member states of the UK.

An HES data extraction request was made to the NHS England Information Centre for Health and Social Care (NHSIC) through the HES online service (enquiries@ic.nhs.uk). Email requests were also made through the NHS Northern Ireland Hospital Information Branch (statistics@dhsspsni.gov.uk), NHS Scotland Information Services Division (NSS.isdSCT@nhs.net) and NHS Wales Informatics (PDIT.Requests@wales.nhs.uk).

As there is no national agreement on which OPCS code to use for children undergoing cataract surgery (either lens aspiration, or lens removal with posterior capsulotomy/anterior vitrectomy), all  the possible codes for lens removal (table 1) were used in the request for data from the central databases. These requests specified the total number of recorded episodes for procedures under the 3-digit OPCS codes ‘C71’, ‘C72’ and ‘C74’ for children aged 2 years or under at surgery, for the years 2009 and 2010. Diagnostic information was not specified within the requests; thus data on extraction of cataract of any aetiology was sought to ensure an inclusive approach to case capture.

Case reporting through the active surveillance network

Consultants at 32 hospitals across the UK and 2 hospitals in the Republic of Ireland agreed to identify children undergoing cataract surgery for the IOLu2 study. Managing consultants reported cases of children and eyes undergoing surgery for congenital and infantile cataract through an active surveillance scheme, which was supplemented with ad hoc passive notification and review of hospital theatre records at seven centres. Families of identified children were approached by the research team for written formal consent for recruitment to the study and collection of clinical data.

Results

Data are available from the NHS HES database (England) and the NHS Wales and Scotland Information Centres on the numbers of episodes of cataract surgery in children aged 2 years and under occurring during 2009 and 2010, and are available from the Northern Ireland Centre for episodes in 2009.

Over these periods, 203 episodes of ‘extracapsular extraction’, 279 episodes of ‘other extraction of lens’ and 1 episode of ‘intracapsular extraction’ were reported by NHS Trusts to their central national database centres, making a total of 483 episodes.

Over the same period in the UK, 490 episodes of cataract surgery were identified through active surveillance undertaken through the BCCIG. As shown in table 2, in England and Northern Ireland, more cases were ascertained by collaborating clinicians within the BCCIG network than were ascertained through hospital data returns to the NHS.

Table 2

Comparison of the episodes of cataract surgery in children aged under 2 years captured by active surveillance network (BCCIG) and those captured by NHS Information centres between 2009 and 2010*

Following case identification through the BCCIG, 261 children were recruited to the IOLu2 study. Data are currently available for 373 eyes of children who underwent surgery in the UK in 2009 or 2010. All these eyes underwent anterior capsulotomy and lens aspiration, and 86% (320/373) underwent primary posterior capsulotomy and primary anterior vitrectomy. Thus, although at least 320 similar procedures were undertaken, on reporting to the central NHS databases 203 (42% of) procedures were coded as extracapsular cataract extractions, and 279 (58%) were coded as ‘other extraction of lens’.

Discussion

In England and Northern Ireland in 2009 and 2010, there were more episodes of cataract surgery in children aged under 2 years reported through active surveillance in the IOLu2 study than through routine returns to the NHS Information Centres. The episodes of surgery identified through the BCCIG were limited to children diagnosed with congenital and infantile cataract, while episodes of lens extraction for any pathology were reported to the NHS centres. Lens extraction may be undertaken for reasons other than congenital and infantile cataract, for example, for cases of traumatic cataract, cataract due to previous intraocular surgery, and non-cataractous lens disease such as ectopia lentis. The prevalence or incidence of these other lens-related diseases in children under 2 years old is unknown, but they account for approximately 10% of all children aged under 16 years undergoing lens surgery.7 Thus, the NHS centres should have identified up to 10% more episodes of lens extraction than were reported through the active surveillance network of clinicians identifying cases of congenital/infantile cataract extraction.

The under-reporting by hospitals of paediatric cataract surgery that we have found is consistent with previous reports of poor levels of completeness of centralised NHS ‘returned’ data for other specialities such as paediatric cardiothoracic surgery, adult oncology and psychiatry.8–10 Summary measures derived from the central database statistics are used in a variety of administrative and financial pathways, including Government Treasury negotiations for NHS funds, the allocation of funds within the NHS and the identification of trends in specific conditions or performance of operative procedures. The latest Department of Health audit into NHS clinical coding accuracy identified an overall clinical coding error of 10%, with poor clinical documentation, inadequate training of hospital coders and inadequate involvement of clinical staff in the coding process contributing to inaccurate or incomplete data entry.11 This study is unable to quantify the clinical coding error with regards to the method of cataract extraction in children aged under 2 years, as data on the type of surgery undertaken is only available for a proportion of children identified by the BCCIG. The majority of cataract extraction procedures undertaken in children under 2 years in the UK and reported to the databases were coded under the ‘other extraction of lens’ (lensectomy) category. Lensectomy for early childhood cataract, as first popularised in the UK in the early 1980s following the growing popularity of the use of the vitrectomy handpiece in ophthalmology, is defined as removal of the whole lens complete with anterior and posterior capsules and the anterior vitreous.7 However, as modern paediatric cataract surgery involves consideration of either primary or secondary IOL implantation,1 a larger peripheral capsular ring is left behind to provide intracapsular or sulcus support. This procedure can thus more correctly be defined as an extracapsular lens extraction, which may then be followed by a posterior capsulotomy and anterior vitrectomy. Thus, dependent on the surgical definition used, either all 373 of the operated eyes reported by the BCCIG underwent ‘extracapsular lens extraction’, or 320 of the eyes reported by the BCCIG underwent ‘adapted lensectomy’ with 53 undergoing ‘extracapsular lens extraction’. In either case, there was inaccurate and under-reporting of surgical procedures to the NHS databases. The inaccurate reporting of activity to central NHS databases is partly attributable to the use of multiple codes across different hospitals within each country for paediatric cataract surgery, and to the failure by the international ophthalmic community to update the terminology used in modern paediatric cataract surgery.

The NHS is currently facing significant re-organisation and financial constraints. Accurate coding of hospital activity is vital for the commissioning and payment for activities undertaken and for efficient planning of hospital services. The findings presented here suggest that NHS ophthalmic departments may be disadvantaged by failing to ensure that their administrative system accurately records their true level of activity. Clinical governance is part of the duties of every doctor, and the ophthalmic community should play a part in ensuring that the hospital administrative staff responsible for reporting ophthalmic activity to the national databases have the knowledge and understanding they need to generate accurate and complete reports.

Improvements in routine data collection should allow the HAS system to be used for monitoring trends in the NHS. However, the active surveillance schemes established in the UK that have been successful in the paediatric and ophthalmic fields (the British Paediatric and British Ophthalmic Surveillance Units, BPSU and BOSU), and the high level of ascertainment achieved by the BCCIG in the IOLu2 study highlight the strength of active surveillance and a multicentre collaborative approach in research in uncommon diseases.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Files in this Data Supplement:

Footnotes

  • Collaborators British Isles Congenital Cataract Interest Group (BCCIG).

  • Contributors ALS contributed to concept, design, data acquisition and analysis, writing, revision and approval; IRE contributed to concept, revision and approval; JSR contributed to concept, design, data analysis, writing, revision and approval.

  • Funding Lola Solebo is supported by a fellowship awarded by the Ulverscroft Vision Research Group. The Centre for Paediatric Epidemiology and Biostatistics at ICH also benefits from funding support from the Medical Research Council in its capacity as the MRC Centre of Epidemiology for Child Health. This work was undertaken at UCL Institute of Child Health/Great Ormond Street Hospital for children, which received a proportion of funding from the Department of Health's NIHR Biomedical Research Centres funding scheme. Jugnoo Rahi is supported in part by the National Institute for Health Research (NIHR) Biomedical Research Centre based at Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.

  • Competing interests None.

  • Patient consent Obtained.

  • Ethics approval Ethics approval was obtained from the joint UCL/UCLH Type 3 (multi-site) committees and the relevant Hospitals in the Republic of Ireland.

  • Provenance and peer review Not commissioned; externally peer reviewed.