AIM To compare the performance ofprogressor (pointwise linear regression) and statpac2 (comparison with baseline values) in detecting early deterioration in the visual fields of glaucoma patients.
METHODS Visual field series from 19 untreated normal tension glaucoma eyes which were deteriorating on clinical grounds were analysed by progressor and statpac2. Progression criteria forprogressor were (1) inner points: slope < −1 dB/year, p < 0.05 and (2) edge points: slope < −2 dB/year, p < 0.05. Criteria for statpac 2 were p < 0.05 change probability for any point on three consecutive fields. Detection time was defined as the time interval between the initial field and the first field in which at least one progressing point was identified. Detection times produced by the two techniques were compared.
RESULTS progressor and statpac2 agreed on progression in all 19 eyes. Mean detection time for progressor was 1.077 (SD 0.985) years and for statpac 2 was 2.161 (1.357) years. progressor detected progression sooner thanstatpac 2 in 18 eyes (p < 0.01, Wilcoxon matched pairs signed rank test). progressordetected progression earlier by a mean of 1.085 (0.936) years.
CONCLUSIONS progressor consistently detected progression earlier than statpac2. The progressor software is a useful tool for the early detection of visual field deterioration in glaucoma.
Statistics from Altmetric.com
An important goal in the management of chronic glaucoma is the early, reliable detection of deterioration in the visual field. There is inherent ‘noise’ in the data obtained from serial automated field tests (long term fluctuation1): this fluctuation is greater in glaucoma patients than in normals.2 The criteria by which progression should be measured are a continuing subject of debate.3-8 Visual inspection of a series of fields and the use of clinical judgment are unreliable methods for diagnosing progression or stability, even when performed by experienced observers.9 For this reason, and because the results of automated perimetry invite numerical analysis, a number of methods to estimate change in glaucomatous visual fields have been developed.
One group of methods rely on estimates of change in summary measures of the field such as regression analysis of the mean defect value,10 mean deviation,11 other global measures,11 measurement of whole field and quadrantic sensitivity losses,12 and trend and regression analysis of various estimates of the sensitivity of the whole field or parts of it.13-15 However, the analysis of summary measures, whether based on the whole field or on clusters of points within it, has been found to be ‘remarkably poor’16 and ‘of little value’17 in detecting glaucomatous change. Summary measures largely or completely ignore the detailed spatial information contained within computerised field tests and are insensitive to early localised change.18 Furthermore, different regions of the visual field may deteriorate at different rates.41519
A widely available software package for estimating deterioration in serial glaucomatous visual fields is the statpac2 glaucoma change probability analysis20 for the Humphrey field analyser (Humphrey Instruments Inc, San Leandro, CA, USA). This software avoids the problems inherent in the methods discussed above by considering the field on a point by point basis. Two of the three initial fields are selected as a ‘baseline’ and subsequent fields are compared with this baseline in a pointwise manner. Points are labelled with a black triangle (Fig 1) if they are associated with a p value of <0.05 for change against a reference database.
progressor21 is a software package which analyses visual field progression using pointwise linear regression of sensitivity on time. This technique has been used for several years to investigate glaucomatous visual field change22 23 and has recently been re-examined.11progressorproduces a cumulative graphical output as shown in Figure 2A. Each test location is shown as a bar graph in which each bar represents one test. The length of the bar relates to the depth of the defect (longer bars represent lower sensitivities) and the colour of the bar relates to the p value of the regression slope (Fig 2B). The pointwise linear model has been demonstrated to provide a valid framework for detecting and forecasting glaucomatous loss.24
progressor has been found to emulate statpac2 closely in diagnosing individual locations in a single field of a series as either stable or progressing when the appropriate progression criteria are used.25However, the relative ability of the two algorithms to detect the first sign of deterioration has not been investigated directly. This is an important aspect of the technique’s behaviour to compare, since the timely and reliable detection of glaucomatous visual field progression is of paramount clinical importance: in the presence of adequate intraocular pressure control, questions concerning the commencement or alteration of therapy are prompted only when definite visual deterioration is seen.
The Moorfields Eye Hospital visual field database currently contains 64 949 automated visual field records from 9482 patients. Records were selected for study on the basis of the following criteria:
(1) Untreated normal tension glaucoma patients were chosen as it was felt to be important to analyse the natural history of glaucomatous visual damage in the absence of the potentially confounding effects of medical therapy. A cohort of 220 such patients, whose diagnosis had been confirmed on phasing, was identified.
(2) Their visual fields showed progressive deterioration of a typically glaucomatous nature. This was done by inspection of thestatpac overview analysis of serial Humphrey visual fields by an experienced observer.
(3) All subjects were experienced in Humphrey 30-2 tests and able to produce reliable computerised visual fields (less than 30% fixation losses and false negatives and less than 15% false positives). Each had had at least two tests over 4 months before the observation period: this is sufficient to obviate any learning effects2627which may delay the diagnosis of progression.
(4) All subjects had visual acuity of 6/12 or better. None had significant ocular pathology apart from normal tension glaucoma.
On the basis of the foregoing criteria, 19 eyes from 13 subjects were selected.
An indication of the degree of glaucomatous damage in the selected group is given by the following summary measures of the mean deviation (MD) of the initial field in each test series: the mean of the MDs was −6.81 (SD 6.01) dB, the median was −5.43 dB, and the range was −22.40 dB to +1.07 dB.
All tests were performed on a standard Humphrey automated perimeter. The full threshold 30-2 program with standard 4-2 dB staircase strategy was used throughout. Tests were performed at intervals of approximately 4 months.
Glaucoma change probability: statpac2
A field series was regarded as progressing if the glaucoma change probability analysis of statpac 2 marked any test location as showing significant deterioration (p < 0.05) from the baseline relative to the Humphrey normal database on three consecutive occasions. The requirement for a location to be repeatedly ascribed a high probability of change over a series of consecutive fields has been recommended by the originators ofstatpac 220 and has been used in previous studies.2125 The specific criterion of three consecutive fields is currently in use in the Early Manifest Glaucoma Trial in Malmö, and the importance of confirmatory testing to establish progression relative to a baseline has been upheld in the ongoing collaborative normal tension glaucoma study.28
A field series was regarded as progressing ifprogressor identified at least one test location with a negative slope of 1 dB per year or worse associated with p < 0.05 for a two tailed t test of the slope against zero (that is, the null hypothesis of no deterioration). The slope criterion of 1 dB per year represents a rate of sensitivity loss approximately 10 times greater than the normal age related decline.29 Edge points are known to be more subject to fluctuation29 so a stricter slope criterion of 2 dB per year (also with p < 0.05) was introduced for them. These slope criteria, in combination with a less stringent slope significance criterion of p < 0.1, have been demonstrated to compare closely with the Humphrey statpac2 glaucoma change probability analysis.2125
The detection time for a given field series for a given algorithm was defined as the time interval between the initial field in the series and the field when the progression criteria for that algorithm (see above) were first satisfied.
RELIABILITY OF EARLY DETECTION
There is at present no ‘gold standard’ for the identification of visual field progression in glaucoma. Thus, it is very difficult to assess whether a given technique is detecting ‘true’ progression. Some authors have used clinical impression against which to compare the performance of various algorithms,17 but this has been shown to be a largely subjective measure.9 Others have avoided the problem entirely by not attempting to estimate the reliability of their techniques.11
In the field series selected for this study, all three methods of assessing change (clinical expertise, progressor, andstatpac 2) agreed that all of the series showed progression. However, this study was designed to examine early detection of progression by the algorithms, so it was important to assess whether progression detected at a given field in a series was sustained in the rest of the series: it is likely that if progression is diagnosed in one field but not in subsequent fields the diagnosis is incorrect.
The reliability of early detection of progression byprogressor and statpac2 was assessed by examining whether at least one of the locations initially detected as progressing was still progressing in the final field of the series. For statpac2, the criterion of repeatability over three fields was not applied for the final field of the series in this analysis: statpac 2 was judged as reliable if at least one location initially diagnosed as progressing was labelled with a black triangle in the single final field.
For each field series, detection time (see above) was calculated for each algorithm. Detection times for progressor were compared with their correlates for statpac2 using a non-parametric test for paired data from two related samples (Wilcoxon signed rank Z test).30
Statistical analysis was performed using the software packagespss for Windows version 6.0.
All 19 field series satisfied the progression criteria for bothprogressor and statpac2. The mean detection time forprogressor was 1.077 years with a standard deviation of 0.985 years. statpac 2 gave a mean detection time of 2.161 years with a standard deviation of 1.357 years. These findings are displayed in Table 1, and the individual differences between the algorithms for each field series are shown as a drop line graph in Figure 3. statpac 2 has consistently later detection times than progressor: there is only one field series in which the detection time forprogressor is greater than that for statpac2.
Delay in detection was calculated as the difference between the detection time for statpac 2 and that for progressor. The mean delay in detection associated with statpac 2 was 1.085 years and the standard deviation was 0.936 years. As can be seen in Figure 4, the great majority of values of delay are greater than zero. In other words, progressor detects progression sooner thanstatpac 2. This is borne out by the results of the Wilcoxon signed rank Z test (p < 0.01, Table2).
For progressor, at least one of the locations initially detected as progressing was still progressing in the final field of the series in 78.9% (15 out of 19) of the field series. Forstatpac 2, the corresponding figure was 68.4% (13 out of 19).
Previous work has shown that progressor agrees closely with statpac 2 in terms of which test locations are classified as progressing and which are classified as stable.2125 Thus, it seems paradoxical thatprogressor should be found to be superior to statpac2 in the detection of progression. This apparent contradiction may be explained by considering the differences in methodology between this and the previous studies.
In the absence of a gold standard for glaucomatous visual field progression, the previous authors chose statpac2 as an arbitrary gold standard against which to measure progressor. statpac2 was used to identify test locations which had ‘unequivocally deteriorated’ in the last three fields of series consisting of 16 fields each.25 The ability ofprogressor to discriminate between these locations and the other locations (defined as stable by statpac2) was then examined using the kappa statistic31 to assess the level of agreement withstatpac 2. A kappa coefficient of κ = 0.62 (SE = 0.04) was obtained, which represents good agreement for this length of follow up.32 However, as the authors note,2125 this analysis is inherently unable to detect any potential superiority of progressor in detecting progression: it would be interpreted as a lack of specificity.
There are also theoretical explanations for the finding thatprogressor detects progression sooner than statpac2. The two algorithms attempt to diagnose progression in very different ways. statpac2 compares each field under analysis with the baseline: information in fields after the baseline but before the field under analysis is ignored. statpac2 is thus an event type of analysis and would be particularly sensitive to catastrophic, stepwise change. In contrast, progressor uses all the fields up to and including the field under analysis: it is thus a trendtype of analysis and would be more sensitive to gradual, sustained change. The pattern of pointwise change in progressive glaucoma has been investigated: although sudden, stepwise change does occur33 the mode of progression of the visual field of untreated normal tension glaucoma patients is best described by a pointwise linear analysis.24 Furthermore, statpac2 is only able to classify locations if their level of loss can be determined relative to a normal database: previous work comparing progressor with statpac2 has excluded 26% of test locations from analysis because they cannot be classified by statpac2.25
The normal tension glaucoma study group has reported that an event type of analysis can be used to diagnose visual field progression in a timely, sensitive and specific way.28 In this analysis, patients are followed every 3 months with visual field tests. If the criteria for suspected progression are met, the patient returns within 1–4 weeks for one or two confirmatory tests. If progression is confirmed in this way on two consecutive series of visits 3 months apart, true progression is diagnosed. Thus, the minimum time to diagnosis is 3 months and 1 week, which is earlier than for either algorithm in this study. The application of this testing protocol would enable earlier diagnosis of progression with statpac2. However, progressor would also be likely to detect change earlier in this case, since more frequent testing results in the earlier achievement of a significant slope: formal investigation would be required to determine whetherprogressor or statpac 2 would benefit more from this strategy of confirmatory testing. Furthermore, this study protocol entails a high frequency of testing which would have profound resource implications if it were implemented on a routine basis, since it may involve three tests every 3 months.
In summary, this study was not designed to assess the sensitivity or specificity of progressor or statpac2 relative to an arbitrary gold standard (since this has been examined elsewhere17 25), but rather to investigate the performance of the two algorithms in reliably detecting early change in a group of patients known to be deteriorating unequivocally on clinical grounds. The fact that progressorconsistently detected progression earlier than statpac2, and detected it more reliably, suggests that progressor is a useful software tool for the analysis of visual field progression in glaucoma.
Presented in part at the Association for Research in Vision and Ophthalmology annual meeting, 25 April 1996.
Supported in part by grants from the International Glaucoma Association and the Medical Research Council.
The Institute of Ophthalmology retains the intellectual property rights to the progressor software used in this study.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.