|
|
||||||||
1From the Visual Function and 2Ophthalmic Informatics Laboratories, the 4Hamilton Glaucoma Center, and the 3Institute for Neural Computation, Department of Ophthalmology, University of California, San Diego, La Jolla, California; and 5The Salk Institute, La Jolla, California.
| Abstract |
|---|
|
|
|---|
METHODS. In an earlier study, it was shown that a model using vB-ICA-mm can separate normal fields from fields with six different patterns of visual field loss related to glaucomatous optic neuropathy (GON) along maximally independent axes. In the present study, an independent group of 191 patient eyes (66 with ocular hypertension (OHT), 12 with suspected glaucoma by field, 61 with suspected glaucoma by disc, and 52 with glaucoma) with five or more standard visual fields under observation for a mean of 6.24 ± 2.65 years and 8.11 ± 2.42 visual fields were evaluated with the vB-ICA-mm. In addition, eyes with progressive GON (PGON) were identified (n = 39). Each participant had a series of fields tested, with each field entered independently and placed along the axes of the previously developed model. This allowed change in one pattern of visual field defect (along one axis) to be assessed relative to results other areas of that same field (no change along other axes). Progression was based on a slope falling outside the 5th and the 95th percentile limits of all slopes, with at least two axes not showing such a deviation in a given individuals series of fields. Fields were also scored using Advanced Glaucoma Intervention Study (AGIS) and the Early Manifest Glaucoma Treatment Trial (EMGT) criteria.
RESULTS. Thirty-two of 191 eyes progressed on vB-ICA-mm by this definition. Of the 32, 22 had field loss at baseline, 7 had only GON, 3 were OHTs and 12 were from the 39 eyes (31%) with PGON. The vB-ICA-mm identified a higher percentage of progressing eyes in each diagnostic category than did AGIS or and the EMGT.
CONCLUSIONS. The vB-ICA-mm can quantitatively identify progression in eyes with glaucoma by evaluating change in one or more patterns of the visual field loss while other areas or patterns remain stable. This may enable each eye to contribute to the determination of whether change is caused by true progression or by variability.
However, it has been shown that the progression in visual fields occurs most commonly within or adjacent to areas that are already defective.8 9 Hence, a quantitative method that capitalizes on the defective pattern found within an individuals initial visual field could be helpful in facilitating the decision of when to instigate or change treatment.
In a companion study also published in this issue,10 we used the variational Bayesian independent component analysis mixture model (vB-ICA-mm) to develop a model that represents the structure of the patterns of visual field defects from 189 normal and 156 glaucomatous eyes. vB-ICA-mm used a form of unsupervised learning that separated the eyes into two groupscluster G, with 107 of 156 patient eyes and 3 normal eyes, and cluster N, with 186 of 189 normal eyes plus 49 glaucomatous eyeseven though it had no indication of diagnosis or feedback from humans during training. The terms N and G are used to identify the clusters for the purposes of this report; however, the classifier at no time was given information about which diagnostic group a visual field belonged to.
Simultaneously, the classifier determined the optimal number of minimally dependent axes along which it could place the data within a cluster. The fields in cluster N required only one axis to describe them. The vB-ICA-mm placed the 107 glaucomatous and 3 normal eyes in cluster G along six axes. Post hoc analysis of the six axes and the associated standard automated perimetry (SAP) fields indicated that each axis was associated with a particular type of glaucomatous visual field defective pattern (Fig. 1) . This analysis also showed that the pattern of loss for this cross-sectional data varied in severity along each axis. Fields were ordered by standard deviation (SD) from the mean of the eyes in cluster G. The positive SDs generally indicated more extreme defects, and the negative ones indicated smaller and less deep defects. To verify the direction of the SD, we assessed whether deeper defects also moved away from the mean of cluster N while shallower defects moved toward it (Fig. 2) . To summarize, the classifier organized the fields in multidimensional space based on both the pattern of the visual field defect and its severity.
|
|
| Methods |
|---|
|
|
|---|
Inclusion Criteria for DIGS
Simultaneous stereoscopic fundus photographs were obtained of all subjects and were of adequate quality for the subject to be included. All subjects had open angles, best corrected acuity of 20/40 or better, spherical refraction within ±5.0 D, and cylinder correction within ±3.0 D. A family history of glaucoma was allowed. One eye was randomly selected for testing.
Exclusion Criteria for DIGS
Ocular hypertensive subjects were excluded if they had a history of intraocular surgery (except for uncomplicated cataract surgery). We also excluded all subjects with nonglaucomatous secondary causes of elevated IOP (e.g., iridocyclitis or trauma), other intraocular eye disease, other diseases affecting the visual field (e.g., pituitary lesions, demyelinating diseases, HIV positivity or AIDS, or diabetic retinopathy), medications known to affect visual field sensitivity, or problems that affect color vision other than glaucoma.
Criteria for The Current Study
Exclusion criteria for visual fields included unreliable visual fields (defined as any one of either fixation loss, false-negative, or false-positive errors
33%, unless false negatives could be explained by significant field loss). Only subjects with five or more standard visual fields in a series were included.
Participants (n = 191) were placed in one of four diagnostic categories based on the appearance of the optic disc (as described later) and on the presence or absence of repeatable visual field defects at baseline (Table 1) . Ocular hypertensive eyes had IOPs of more than 22 mm Hg on at least two occasions, with normal-appearing optic discs and normal visual fields. Eyes suspected of glaucoma by disc characteristics had normal visual fields, but evidence of glaucomatous optic neuropathy (GON). Those suspected by field defect had no evidence of GON, but had visual field that repeatedly showed abnormality. Patients with primary open-angle glaucoma (POAG) had both evidence of GON and repeatable abnormal visual fields.
|
0.2 between the two eyes. Inconsistencies between the two graders evaluations were resolved by consensus or through adjudication by a third evaluator. In addition, we did a secondary analysis of the above individuals to determine whether there was any history of progressive GON (PGON) at any time during follow-up, as a more stringent definition of glaucoma. To identify progressive GON, the first and last photographs in each participants series of photographs were graded by two independent masked reviewers. The dates of the photographs were masked, and each reviewer was required to state whether A was more advanced than B, B more than A, or no change. A and B are assigned randomly within each pair of photographs. Inconsistencies between the two graders evaluations were resolved through adjudication by a third evaluator.
Visual Field Testing
All subjects had automated full-threshold standard visual field testing with (Humphrey Visual Field Analyzer; Carl Zeiss Meditec Inc., Dublin, CA) with program 24-2 or 30-2. The visual field locations in program 30-2 that are not in program 24-2 were deleted from the data and display. Visual fields were classified as abnormal when a corrected pattern standard deviation was triggered at the 5% value or worse or the Glaucoma Hemifield Test result was outside normal limits. Two abnormal fields in sequence were required for classification as suspect by field or POAG.
The vB-ICA-mm
The complete methods for the vB-ICA-mm are given in the companion article.10 In brief, vB-ICA-mm was used as an unsupervised classifier on the SAP data. vB-ICA-mm identifies the number of clusters and the number of axes in each cluster. Each cluster is then examined and labeled according to the majority of positive-negative data points within. vB-ICA-mm finds the number of clusters and the number of axes in each cluster. For each number of clusters, c (c = 1,2), and each number of axes, m (m = up to 20), it does the following:
P(X|
,H)P(
|H)d
, in which X stands for the dataset, H is the model, and
is the parameters of the model.
is the prior distribution of
in model H. The vB-ICA-mm then iterates between steps 2 and 3 until there is no change in the cluster assignment. The vB-ICA-mm was set to repeat the initial randomization (step 1) 100 times, so that for each c and m, we had 100 models. All the above was repeated while the number of clusters and the number of axes were simultaneously varied. We chose the final model by comparing all the models based on their marginal likelihood values (the larger the value, the better) and the classification accuracy. The chosen model was then used for this report to assess each of the serial visual fields from the 191 participants.
The input to the machine learning classifier included age and the absolute sensitivity in decibels of each of the 52 test locations (not including two locations near the blind spot) in the 24-2 visual field. These were the same input values used in the companion study, which developed the axes and analyses used in the present study. The 52 threshold values were extracted from the perimeter (Peridata 6.2 program; Peridata Software GmbH, Hürth, Germany). Age was provided because it is an important correction factor used in visual field analysis.
In the original vB-ICA-mm, six minimally dependent axes were optimal to describe the cluster holding most of the visual fields from eyes with GON. All six axes passed through the mean of that cluster generated by the classifier. The distance of each visual field from this mean along a given axis was computed in SD units. This allowed each field to be plotted in multidimensional space (Fig. 3) . In the original study using cross-sectional data, each field was associated with a particular axis by calculating the angle at the cluster centroid between the vector for that field and the vector of each of the axes. The individual field was assigned to the axis with which the SAP vector had the smallest angle. In the present study in serial visual fields, each visual field was projected onto the multidimensional space specified by the vB-ICA-mm developed in our prior study. At the same time, the relationship of the field to all six axes was maintained. Each field was placed along each axis according to the projection onto the axis in units of the SD from the mean of the glaucoma group (Fig. 3) . The temporal relationship among all the fields in a given patients series were then evaluated by post hoc analysis.
|
|
We also assessed whether the fields from a given individuals series of fields switched cluster assignment or axis assignment over time. Initial cluster assignment required the first two fields in a series to be in the original cluster and three successive follow-up fields to switch to the other cluster. A switch in axis involved moving from the designated baseline axis (the one with the smallest angle to the SAP vector) to a second axis for three or more subsequent consecutive fields.
Finally, to put the results into a clinical perspective, we graded each individuals series of fields by using the scoring procedures from two major clinical trials, the Advanced Glaucoma Intervention Study (AGIS)1 and the Early Manifest Glaucoma Treatment (EMGT) trial.14
The AGIS algorithm was developed to determine eligibility for the AGIS study and to evaluate visual field progression in patients with advanced glaucoma. Very briefly, the AGIS score is calculated by totaling the number of adjacent depressed test locations on the total deviation plot found in the upper, lower, and nasal hemifields of a standard visual field. The final AGIS score for each field ranges from 0 to 20. Progression requires an increase in score of
4 points between the average score of the two baseline visual fields and the score on each of three consecutive follow-up fields.
The EMGT was designed to compare the effect of immediate therapy with lower IOP versus late or no treatment on the progression of newly diagnosed early glaucoma. The progression algorithm for the EMGT is a modification of the Glaucoma Change Probability (GCP) analysis commercially available on the Humphrey Visual Field Analyzer (Carl Zeiss Meditec, Inc.). The GCP uses the total deviation plot values and the EMGT uses pattern deviation plot values. Progression with the EMGT criteria requires deterioration in at least three of the same locations on three consecutive follow-up field tests.
| Results |
|---|
|
|
|---|
|
Ten of the 32 eyes that progressed changed axis assignment. In all cases, the initial axis assignment was within ±0.43 SDs of the axis they switched to (see e.g., Fig. 4B ), and in all but one case, the switch was to an axis showing progression.
Table 3 gives the number of participants with changes according to axis. Results of the vB-ICA-mm for four participants are shown in Figure 4A . No change in SD outside the percentile limits on at least two axes was required before change within a given pattern along an axis was considered to show progression. This, along with the requirement of a significant slope outside the bounds of the percentile limits, strengthens the determination that the change is due to progression and not to the patients variability. Figure 5 shows the actual visual field gray scales for two participants in the study, the ones also shown in Figures 4A and 4B .
|
|
|
|
| Discussion |
|---|
|
|
|---|
Brigatti et al.19 used a three-layer back-propagation neural network to assess progression in serial fields. A drawback to their study was the use of AGIS scoring as the gold standard for progression. As noted before, there is no agreement on such a standard. Finally, both Brigatti et al.19 and Henson et al.18 20 used supervised learning, that trained the classifiers to identify progression based on AGIS criteria in the first case and defined defects with variability modeling in the second case. The vB-ICA-mm is unsupervised and classifies the data without any training or biases. Its effectiveness in this study could be assessed in the post hoc analyses after the classifier has finished. The specificity of 98.9% shown in our companion study10 and the logical distribution of progressed eyes within the different diagnostic groups of this study (Table 2) suggest that the vB-ICA-mm is classifying both defects and progression in a manner consistent with clinical expectations. For example, this study found the smallest percentage progressing in the OHT group, 5% (3/66). An estimate falling within those in the Ocular Hypertension Treatment Study of 4.4% in the treated group and 9.5% in the untreated group.3 The vB-ICA-mm found 33% to 42% of patients with baseline field loss progressing, which is similar to the 45% in the EMGTs treated group.21 Thirty-one percent of eyes with progressing GON were also identified by the vB-ICA-mm as progressing. This logical breakdown provides some evidence to address the concern that the vB-ICA-mm may be overcalling progression. Although the classifier is finding more eyes progressing than either AGIS or EMGT, the correspondence with the eyes also showing progressive GON is much stronger for vB-ICA-mm (31% compared with 15% by EMGT and 17% by AGIS). It has been shown that AGIS and EMGT often do not agree in their determination of progression.6 7 However, continued work is necessary to determine the true predictive ability of the vB-ICA-mm relative to other algorithms.
In addition, it was rare that individuals switched clusters (i.e., they remained in the mostly glaucoma cluster). Axis assignment over time also generally remained stable, suggesting that the classifier is consistent in its determinations. The exception to this was in individuals who had more than one possible pattern at baseline, but as progression occurred the slightly less obvious one became more and more apparent. We could take into account change along more than one axis as shown in the figures.
More work is needed to optimize the strategies for defining rate or event of progression using this technique. In our first pass with a post hoc analysis of the results using the vB-ICA-mm approach to look at progression, we decided to be as conservative as possible about the definition of progression. The SD does reflect a degree of change along a particular axis that is associated with the range of severity found along that axis. This could eventually allow a quantifiable estimate of progression as an event. At this point, however, we decided to rely on a definition based on linear regression. Pooling the slopes from all axes caused the percentile limits for progres-sion to be derived from those patients showing the greatest progression. This conservative approach most likely underestimated the number progressing according to vB-ICA-mm.
Each of the sponsored clinical trials using progression algorithms1 3 4 22 required a minimum of five visual fields before progression could be assessed: two baseline fields plus three shown in repeated tests to be progressing. The vB-ICA-mm was also able to identify progression with as few as five fields using a quantifiable change on some axes while at least two remained stable. It did this based on the slope of the change and did not require any other a priori definition of progression.
In summary, the main advantage of the vB-ICA-mm for identifying progression is that the definition for progression arises from the classification based on pattern of defect and the quantifiable distance along particular axes in space as the field progresses. This approach incorporates fewer biases. It provides a quantifiable means for making an assessment in serial visual fields, and it allows the individuals own variability to be somewhat taken into account to make the distinction between true progression versus variability.
| Acknowledgements |
|---|
| Footnotes |
|---|
Submitted for publication October 1, 2004; revised February 17 2005; accepted March 4, 2005.
Disclosure: P.A. Sample, Carl Zeiss Meditec, Inc. (F); C. Boden, None; Z. Zhang, None; J. Pascual, None; T.-W. Lee, None; L.M. Zangwill, None; R.N. Weinreb, Carl Zeiss Meditec, Inc. (F); J.G. Crowston, None; E.M. Hoffmann, None; F.A. Medeiros, None; T. Sejnowski, None; M. Goldbaum, None
The publication costs of this article were defrayed in part by page charge payment. This article must therefore be marked "advertisement" in accordance with 18 U.S.C.
1734 solely to indicate this fact.
Corresponding author: Pamela A. Sample, PhD, Department of Ophthalmology, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA 92093-0946; psample{at}glaucoma.ucsd.edu.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
C. Boden, K. Chan, P. A. Sample, J. Hao, T.-W. Lee, L. M. Zangwill, R. N. Weinreb, and M. H. Goldbaum Assessing Visual Field Clustering Schemes Using Machine Learning Classifiers in Standard Perimetry Invest. Ophthalmol. Vis. Sci., December 1, 2007; 48(12): 5582 - 5590. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. P. Pascual, U. Schiefer, J. Paetzold, L. M. Zangwill, I. M. Tavares, R. N. Weinreb, and P. A. Sample Spatial Characteristics of Visual Field Progression Determined by Monte Carlo Simulation: Diagnostic Innovations in Glaucoma Study Invest. Ophthalmol. Vis. Sci., April 1, 2007; 48(4): 1642 - 1650. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. G. Strouthidis, A. Scott, N. M. Peter, and D. F. Garway-Heath Optic disc and visual field progression in ocular hypertensive subjects: detection rates, specificity, and agreement. Invest. Ophthalmol. Vis. Sci., July 1, 2006; 47(7): 2904 - 2910. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. H. Goldbaum, P. A. Sample, Z. Zhang, K. Chan, J. Hao, T.-W. Lee, C. Boden, C. Bowd, R. Bourne, L. Zangwill, et al. Using Unsupervised Learning with Independent Component Analysis to Identify Patterns of Glaucomatous Visual Field Defects Invest. Ophthalmol. Vis. Sci., October 1, 2005; 46(10): 3676 - 3683. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |