Article Text

PDF

Reduction in screening for retinopathy of prematurity through risk factor adjusted inclusion criteria
  1. A J van Sorge1,
  2. N E Schalij-Delfos1,
  3. F T Kerkhoff2,
  4. L J van Rijn3,
  5. J L A M van Hillegersberg4,
  6. I L A van Liempt5,
  7. P G M Peer6,
  8. H J Simonsz7,
  9. J U M Termote8
  1. 1Department of Ophthalmology, Leiden University Medical Centre, Leiden, The Netherlands
  2. 2Department of Ophthalmology, Maxima Medical Centre, Veldhoven, The Netherlands
  3. 3Department of Ophthalmology, VU Medical Centre, Amsterdam, The Netherlands
  4. 4Department of Neonatology, St Antonius, Nieuwegein, The Netherlands
  5. 5Department of Ophthalmology, Amphia Hospital, Breda, The Netherlands
  6. 6Department for Health Evidence, Radboud University Nijmegen Medical Centre, Nijmegen, The Netherlands
  7. 7Department of Ophthalmology, Sophia Children's Hospital-Erasmus MC, Rotterdam, The Netherlands
  8. 8Department of Neonatology, Wilhelmina Children's Hospital-University Medical Centre, Utrecht, The Netherlands
  1. Correspondence to Dr A J van Sorge, Department of Ophthalmology, Leiden University Medical Centre, PO Box 9600, Leiden 2300 RC, The Netherlands; a.j.van_sorge{at}lumc.nl

Abstract

Aims To develop a new national screening guideline for retinopathy of prematurity (ROP).

Methods Included were infants of the 2009 prospective ROP inventory in The Netherlands with gestational age (GA) <32 weeks and/or birth weight (BW) <1500 g. Five models were studied, based on GA and BW in combination with no, one or a set of five risk factors for ROP. Risk factors were determined by logistic regression. In MEDLINE and EMBASE, additional risk factors were searched. A precondition was that no infants with severe ROP would be missed. Receiver operating characteristic curves or classical measures were used to determine diagnostic accuracy.

Results The model including all infants with severe ROP comprised screening of infants with GA <30 weeks and/or BW <1250 g and a selection of infants with GA 30–32 weeks and/or BW 1250–1500 g, with at least one of the following risk factors: artificial ventilation (AV), sepsis, necrotising enterocolitis (NEC), postnatal glucocorticoids or cardiotonica. This model would not detect 4.8% (95% CI 2.5% to 8.0%) of infants with mild ROP and would reduce infants eligible for screening by 29%.

Conclusions In The Netherlands, screening may be safely reduced using a new guideline based on GA, BW, AV, sepsis, NEC, postnatal glucocorticoids and cardiotonica.

  • Retina
  • Child health (paediatrics)

Statistics from Altmetric.com

Introduction

Retinopathy of prematurity (ROP) is a serious vasoproliferative disease of the retina of the very premature infant, which may lead to visual impairment or blindness.

Treatment is possible and laser therapy is still preferable. As treated eyes have a better visual outcome than untreated eyes, timely detection of ROP through screening is important.1 Different screening criteria are used worldwide and depend mainly on national incidences of ROP, which in their turn mainly depend on socioeconomic factors and local neonatal care. However, highly developed countries vary in their criteria also. The current UK guideline recommends screening of all infants with a birth weight (BW) ≤1500 g or a gestational age (GA) ≤31 weeks.2 The American guideline advises screening all infants with a BW <1500 g or a GA ≤30 weeks and selected infants between 1500 g and 2000 g with an unstable course.3 The screening criterion of Sweden is GA ≤31 weeks.4 The Dutch guideline dating from 1997 advises screening infants with a BW <1500 g and/or a GA <32 weeks or preterm infants treated ≥3 days with ≥40% oxygen.5 These guidelines have in common that they screen infants with GA ≤30 weeks, and most screen infants with GA 30–32 weeks. In the past decade, the incidence of ROP has altered. In Central Netherlands, a significant decrease in the incidence of overall and severe ROP was seen in infants with BW <1000 g in the period 2001–2005 compared with 1991–1995.6 Also, Tan et al7 found a reduction in the incidence of severe ROP in southeast Scotland from 1990 to 2009.

As screening for ROP is uncomfortable for the neonate, and costly and time consuming for the ophthalmologist, the aim of this study was to evaluate whether our inclusion criteria for screening could be reduced on the condition that no infant with severe ROP would be missed.

Methods

The study group consisted of patients included in the NEDROP study, a prospective inventory of ROP in preterm infants born in The Netherlands in 2009. Paediatricians and neonatologists of the 103 Dutch hospitals involved in the care of premature infants reported all infants eligible for ROP screening according to the national guideline to the study centre.5 Ophthalmologists reported all infants actually screened for ROP, any ROP classification, presence of ‘plus disease’, screening schedule and treatment. The NEDROP study was approved by the institutional review board (medical ethics committee of Leiden University Medical Centre, The Netherlands). To extend the clinical data of the study infants, coupling to the national perinatal registry (PRN) was performed. This database contains data of more than 95% of all infants with GA <32 weeks and/or BW <1500 g.8 Because of the lack of data for older and heavier infants, only infants with GA <32 weeks and/or BW <1500 g screened for ROP were included. Infants were categorised into two groups: infants with GA <30 weeks and/or BW <1250 g (high risk (HR) group) and infants with GA 30–32 weeks and/or BW 1250–1500 g who do not fit into the HR group (moderate risk (MR) group). Clinical data, such as infant respiratory distress syndrome (IRDS), bronchopulmonary dysplasia (BPD), sepsis, intra-/periventricular haemorrhage (IVH/PVH), necrotising enterocolitis (NEC) and pre- and postnatal glucocorticoids were classified according to the definitions of the PRN.8 In those cases where one or more characteristics were not recorded, we considered these data as missing.

ROP was classified following the International Classification of ROP.9 ROP was categorised as mild (stages 1–2) or severe (stages 3–5).

A thorough search of the literature for risk factors of ROP was performed in MEDLINE and EMBASE from 2006 to December 2011 using the search terms ROP, risk factor(s), prematurity, screening and guideline. Papers were limited to English, Dutch, French and German language. Reference lists of selected manuscripts were examined for additional relevant publications. Only those factors registered in our PRN, easily accessible and available at the time of the first screening were selected.

To improve the efficacy of our current screening programme, several models were studied and compared with regards to reduction in the number of infants to be screened and the number of infants with ROP that would not have been detected on the precondition that no infant with severe ROP would be missed. A second precondition was that the model should be easy to use clinically and would be implementable. First we investigated if screening could be reduced to infants in the HR group (model 1). Secondly, a prediction model for all infants of the study group was developed, based on GA and BW (model 2). Then one additional risk factor was added to the model based on GA and BW for all study group infants (model 3). Risk factors investigated were pre- and postnatal glucocorticoids, length of stay (LOS) on a neonatal intensive care unit (NICU), duration of artificial ventilation (AV), inhaled nitric oxide (iNO), gender, sepsis, IVH/PVH and NEC. In model 4 we investigated combining screening of the HR group with infants in the MR group with one specific risk factor, apart from GA and BW. Therefore, for infants in the MR group, a model based on BW, GA and one additional risk factor was developed. Risk factors included were those of model 2, as well as patent ductus arteriosus, IRDS, BPD, supplemental oxygen, cardiotonica and erythrocyte transfusions. In model 5, screening of the HR group was combined with screening of infants in the MR group with at least one risk factor of a selected set of risk factors, including AV, postnatal glucocorticoids, cardiotonica, sepsis and NEC.

Statistical analysis

To calculate the probability that a child will develop mild or severe ROP based on GA or BW, a multinomial logistic regression model was applied.

Additional risk factors for the development of ROP were explored with logistic regression. As some of the data consist of observations on multiple births, risk factors and probability of ROP for these neonates will be correlated. To take into account this dependency of the data, a generalised estimating equation approach was used to estimate the coefficients of the logistic regression model.

For each risk factor, a logistic regression model, including GA and BW, was explored. The ability of the model to discriminate between no ROP and ROP was quantified by the area under the receiver operating characteristic curve (AUC). For a model to be clinically useful, the predicted probabilities have to be low for children who do not develop ROP, intermediate for children with mild ROP and high for children with severe ROP. This was assessed graphically by plotting histograms of the predicted probabilities in the three groups.

Classic measures for the diagnostic accuracy of model 1 and model 5 were calculated with 95% CIs.

Results

Neonatologists and paediatricians reported 2193 infants, of whom 160 (7.3%) died before screening was completed. Of the remaining 2033 infants, 1688 (83%) were screened for ROP, of whom 1561 infants had GA <32 weeks and/or BW <1500 g. After coupling to the PRN, 1380 infants were eligible to enter the study (81.8% of the screened population). Among these infants were 352 multiple births to 173 mothers. Infants had a median GA of 29.8 weeks and median BW was 1260 g. Clinical data are shown in table 1.

Table 1

Clinical characteristics of the study group, and incidence of (severe) retinopathy of prematurity for each characteristic

The incidence of overall ROP was 21.9% (302/1380); the incidence of mild ROP was 19.8% (273/1380) and severe ROP, 2.1% (29/1380). A gradual decline in predicted probability for mild as well as severe ROP with increasing GA is seen in figure 1.

Figure 1

Predicted probability of no, mild and severe retinopathy of prematurity (ROP) in relation to gestational age for preterm infants born in 2009 in The Netherlands. Access the article online to view this figure in colour.

In the HR group (n=871), 246 infants (28.2%) developed mild and 28 infants (3.2%) severe ROP. If screening was confined to the HR group (model 1), a sensitivity of 0.91 (274/302) (95% CI 0.86 to 0.94), specificity of 0.45 (481/1078) (95% CI 0.41 to 0.48) and a reduction of infants to be screened of 36.9% (509/1380) was found. However, 10% (27/273) with mild and 3.4% (1/29) with severe ROP would have been missed.

In model 2, a prediction model for all infants of the study group was developed based on GA and BW. GA and BW were the most important risk factors for ROP in our study group (GA, p<0.0001; BW, p <0.0001). The AUC for this model was 0.80. Figure 2 shows the predicted probability of ROP using this model.

Figure 2

Predicted probability of retinopathy of prematurity (ROP) based on gestational age and birth weight  for infants in the study group classified by observed ROP. Access the article online to view this figure in colour.

For infants without ROP, prediction was good, as the predicted probability was ≤0.20 for 71.7% of infants with no ROP. For patients with mild and severe ROP, prediction was less accurate. Only 36.2% of infants with mild ROP had a predicted probability between 0.35 and 0.65, and only 24.1% of infants with severe ROP had a predictive probability ≥0.70.

In model 3, the following risk factors were added to GA and BW, one at a time: pre- and postnatal glucocorticoïds, LOS on NICU, duration of AV, iNO, gender, sepsis, IVH/PVH and NEC. None of these risk factors resulted in improvement in AUC.

In the MR group (n=509), 27 infants (5.3%) developed mild and one infant (0.2%) severe ROP. The AUC of the model, based only on GA and BW, was moderate in the MR group (0.69). Addition of any of the following risk factors gave no improvement in AUC: pre- and postnatal glucocorticoids, gender, sepsis, IVH/PVH, patent ductus arteriosus, IRDS, BPD, duration of AV, LOS on NICU, iNO, supplemental oxygen, cardiotonica, NEC and erythrocyte transfusion (range of AUCs 0.68–0.72) (model 4).

For model 5, a set of risk factors was selected. Of the risk factors found through the literature search, AV, postnatal glucocorticoïds, cardiotonica, sepsis and NEC met our selection conditions. Of the 509 infants in the MR group, 107 needed AV, four postnatal glucocorticoïds, 28 had cardiotonica, 105 had sepsis and 10 had NEC. No risk factors were found in 271 infants (53.2%) and ≥1 risk factors in 177 infants (34.8%); data for 61 infants (12.0%) were incomplete.

The true positive rate (TPR) of model 5 was 0.26 (289/1109) (95% CI 0.23 to 0.29) and the true negative rate (TNR) was 0.95 (258/271) (95% CI 0.91 to 0.98), assuming that children with missing data were also screened. The TPR of this model was low but no infant with severe ROP, and only 13/273 infants with mild ROP, were missed. Introduction of model 5 would result in exclusion from screening of at least 19.6% (271/1380) of infants in the study group, again assuming that infants with missing data are also screened. In comparison with the old guideline, this model would have resulted in a reduction of 29.0% (452/1561) of infants and 21.2% (786/3705) of examinations (table 2).

Table 2

Reduction in number of infants that need to be screened and in number of fundus examinations for different screening criteria in comparison with the old guideline

Discussion

The aim of this study was to develop a new guideline for ROP screening in The Netherlands, on condition that restriction of the inclusion criteria for screening would not lead to infants with severe ROP being missed. For development of the guideline, a predictive ROP model was evolved for which ROP and clinical data for all infants with GA <32 weeks and/or BW <1500 g born in The Netherlands in 2009 and completely screened for ROP were used. Five different models were investigated. The model which included all infants with GA <30 weeks and/or BW <1250 g as well as infants with GA 30–32 weeks and/or BW 1250–1500 g with one or more of the risk factors AV, NEC, sepsis, postnatal glucocorticoids or cardiotonica, predicted the risk of ROP best (TPR 0.26 and TNR 0.95). Using this model, no infant with severe ROP was missed and 4.8% with mild ROP were missed. We performed a literature search to find the most established risk factors for ROP and compared these with those available in our database and found in our study. Apart from being easily accessible, they should be available before the age of 5 weeks postpartum, as this is the time at which ROP screening for many infants already starts. Seiberth et al, Karna et al and Hoogerwerf et al demonstrated that duration of AV is a risk factor for (severe) ROP.6 ,10 ,11 Treatment with dopamine was a risk factor for (severe) ROP in studies of Mizoguchi et al and Liu et al.12 ,13 Hoogerwerf et al, Smolking et al and the systematic review of the Cochrane database showed that (late) treatment with postnatal steroids is a risk factor for ROP.6 ,14 ,15 Lee, Chen et al, Weintraub et al and Jensen et al demonstrated perinatal infection/inflammation or sepsis to be a risk factor for (severe) ROP.1619 Arrøe proved this for NEC.20

Most national ROP guidelines are based on GA and/or BW, the major risk factors for ROP. Another important risk factor, postnatal illness, is seldom considered. Recently, four ROP screening models based on postnatal course were developed: WINROP, ROPscore, cumulative illness severity and a model based on Clinical Risk Index for Babies score, multiple birth, race and gender.2124 All predicted proliferative ROP requiring treatment appropriately.

The former mentioned models could not be applied to our study as the PRN contains only limited information. Due to privacy regulations, data were also not accessible. In order to reflect the postnatal course, we added the risk factors AV, cardiotonica, postnatal steroids, sepsis and NEC, to GA and BW as selection criteria in our new screening guideline.

Our new guideline has two important advantages. First, compared with the old one, this model reduced the number of infants who required eye examinations by 29%, whereas 4.8% of infants with mild ROP and no infants with severe ROP would have gone undetected. This corresponds with a reduction of 21% of fundoscopies. As screening is stressful for the neonate, this decrease is important. On the other hand, we should also consider that screening can be made less uncomfortable for the infant and more efficient for the ophthalmologist by swaddling of the infant, use of a pacifier and/or sucrose, and by good positioning of the infant.

Secondly, our guideline takes several pathological conditions into account that might occur within the first 4 weeks of life and predispose to the onset of ROP.

Our model also has two disadvantages. First, a small percentage of infants with mild ROP will go undiagnosed. Secondly, for the group of infants with GA 30–32 weeks and/or BW 1250–1500 g, who do not fit into the HR group, our model contains five items which have to be assessed. This implies extra work for the attending neonatologist or paediatrician. All items are, however, easily accessible and should be present in the letter of transfer, if patients are already discharged from the NICU before the first screening. If risk factors are not properly recorded, the old criteria (GA <32 weeks and/or BW <1500 g) should be used. External validation is essential for a new guideline.25 Validation of the new guideline is currently underway in The Netherlands since September 2012. Future studies will be necessary for monitoring the accuracy of the model, as it was based on an ROP inventory study in 2009.

In conclusion, in The Netherlands, ROP screening may be reduced by adding risk factors representative for each patient's postnatal course to the well known risk factors of GA and BW. Although this implies an additional effort on the part of the neonatologist, it will reduce the number of infants exposed to these stressful examinations and will allow ophthalmologists to focus on those infants with the highest risk for ROP. Monitoring of the new guideline is necessary.

Acknowledgments

We thank W Lemmens from the Department for Health Evidence, Radboud University Nijmegen Medical Centre, Nijmegen, for data management and statistical analyses.

References

View Abstract

Footnotes

  • Contributors All authors took part in the development of these new screening criteria. AJvS, JUMT and NES-D wrote the manuscript and the remaining authors gave their feedback and modifications. Data calculations were done by PGMP, as were all of the statistical analyses.

  • Funding This study was supported by an unrestricted grant from the ODAS Foundation, Delft, The Netherlands.

  • Competing interests None.

  • Ethics approval The study was approved by the institutional review board (medical ethics committee of Leiden University Medical Centre, The Netherlands).

  • Provenance and peer review Not commissioned; externally peer reviewed.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.