|
|
||||||||
1From the Wilmer Eye Institute, The Johns Hopkins University School of Medicine, Baltimore, Maryland; and the 2Maryland School for the Blind, Baltimore, Maryland.
| Abstract |
|---|
|
|
|---|
METHODS. Reaction time (RT) to a secondary task (randomly presented vibrations) was obtained in 28 persons with glaucoma as they walked in four different environments: hallway, high-pedestrian area, approach-to-stairs area, and stairs. Cronbach's
was used to assess the reliability of the secondary-task RT measures from the split-half measures of the high-pedestrian area. The construct validity of the RT measures as an estimate of mental effort was assessed by (1) the association between the RT scores and the item measure scores for similar environments derived from a Rasch analysis of perceived difficulty ratings obtained in a separate group of 83 persons with glaucoma and (2) the association between the RT scores and the severity of visual field loss.
RESULTS. Reliability was supported by a Cronbach's
coefficient of 0.89. Construct validity was also supported by the data: (1) Log RT scores were linearly related to the Rasch analysis item measures for comparable mobility situations (P = 0.008), and (2) the log RT, averaged across the four environments, was linearly related to the mean deviation score of the Humphrey Visual Field Analyzer (estimate of visual field loss; P = 0.003; Carl Zeiss Meditec, Inc., Dublin, CA). A comparison of the log RT scores obtained in the four environments showed significantly higher log RT scores in the stairs area than in the high-pedestrian and hallway environments, whereas the log RT scores in the high-pedestrian and hallway environments were not significantly different.
CONCLUSIONS. The findings in this study demonstrate the reliability and construct validity of the secondary-task RT measure as an estimate of the amount of mental effort required to travel independently. It is sensitive to environmental characteristics and the loss in a walker's visual field. The method could be an objective way to document those who may benefit from professional intervention and to evaluate the effectiveness of an intervention.
Although self-reported measures of perceived difficulty are useful in that they may actually be more closely related to decisions about independent travel than are traditional performance measures, objective measures have the advantage of allowing for a direct comparison across groups, training, and environmental situations. Walking speed or variations of walking speed is the most common outcome measure for quantifying difficulty of independent travel.6 7 8 However, walking speed is not an ideal estimator of travel difficulty, because it varies broadly across individuals and environmental situations, such as in turning corners or walking stairs, due to changes in body mechanics. Decreased walking speed to increase environmental preview and increased walking speed to increase safety when crossing the street challenge the popular notion that faster walking indicates superior travel skills. Other popular outcome measures of travel difficulty (e.g., the number of unwanted contacts or orientation errors)9 10 11 12 13 also fall short of the ideal outcome measure, in that they are relatively rare events, requiring an extensive number of trials because of floor effects. Moreover, in the subjects whose mobility is severely impaired, their performance is so unsafe that they sometimes withdraw from a lengthy test before its completion.
One strategy that shows promise in its ability to quantify difficulty in independent travel is based on secondary-task methodology, whereby reaction time (RT) to a secondary task is measured and used to estimate the amount of mental effort required for performing the primary task. The secondary-task method requires one to maintain performance on the primary task (in our case, walking) while completing a secondary task. In this model, changes in performance on the secondary task reflect the mental effort necessary to maintain performance on the primary task. The paradigm is based on the assumption that mental operations draw from a limited-capacity central mechanism and that interference between a primary and a secondary task can assess the extent to which the primary task makes processing demands on the limited central system.14
Shingledecker15 was the first to introduce the secondary-task methodology to blind mobility research. He measured RT to a wrist-applied vibration in three sighted, blindfolded men who walked with a long cane in each of three outdoor routes. The routes varied in complexity, from a simple obstacle-free straight pathway to a busy shopping district, which consisted of three road crossings, seven decision points, high-pedestrian traffic, and obstacles located at unpredictable positions. The primary task was to travel safely and efficiently, and the secondary task was to respond quickly to the randomly presented vibrations. The study showed that RT to the vibrations increased with route complexity. However, the difference in environmental complexity was so extreme in this study, comparing the RT while walking an obstacle-free path with that while walking in a busy shopping district, that it is unclear whether the method is sensitive enough to detect differences in mental effort for more subtle environmental changes.
Some evidence suggests that the method may be sensitive to more subtle differences in mental effort. Using a secondary-task method, we16 showed poorer secondary task performance (RT to auditory beeps) in a group of 15 persons visually impaired by RP compared with a normally sighted control group of 17 persons, when the primary task was walking an indoor circuitous route with obstacles but not when the primary task was walking an obstacle-free hallway.16
In this study, we assessed the reliability and construct validity of the secondary-task RT measures as an estimate of the amount of mental effort required for independent travel. Reaction time to randomly presented vibrations was obtained in persons with glaucoma as they walked in four different environments: hallway, high-pedestrian area, approach-to-stairs area, and stairs.
| Methods |
|---|
|
|
|---|
Visual Function Tests
Measures of vision function included visual acuity, contrast sensitivity, and visual fields. Visual acuity was measured binocularly at a viewing distance of 3 m with an ETDRS (Early Treatment of Diabetic Retinopathy Study; Lighthouse International, New York, NY) acuity chart17 transilluminated at approximately 100 cd/m2. The number of letters correctly read was converted to the logarithm of the minimum angle of resolution (logMAR) based on the methods of Bailey et al.18 Peak contrast sensitivity was measured binocularly at a viewing distance of 1 m, with the Pelli-Robson chart19 with overhead illumination of 85 cd/m2. Visual fields were measured monocularly with the 24-2 threshold program of the Humphrey Visual Field Analyzer (Carl Zeiss Meditec, Inc., Dublin, CA). This program tests 54 points within the central 24°. Two visual field parameters were extracted from the program, the mean deviation (MD) and the corrected pattern SD (CPSD). Age did not correlate significantly with any of the visual field parameters (r < 0.21 for all). The visual functions of the 28 subjects with glaucoma spanned a wide range and are reported in Table 1 .
|
Mobility Route
The course was an 87.9-m indoor route that consisted of four segments that varied in environmental characteristics: a 21.1-m hallway that was obstacle and pedestrian free (hallway); a 8.35-m, pedestrian-free area immediately adjacent to a descending stairway (approach-to-stairs); a 14.9-m descending stairway (stairs); and a 29.4-m open area with a high number of pedestrians (mean n = 15.6; SD, 5.5; high-pedestrian). The high-pedestrian area was a wide corridor within the Outpatient Center at the Johns Hopkins Hospital, and the pedestrians, who were mainly adults, were moving both in the direction of, and opposite to, the direction in which the study participants were moving. The four segments had natural boundaries and, as such, varied in distance, travel time, and number of samples.
Procedure
The experiment began with instructions given to the subject about how to hold the joystick and how to respond to the vibrations. The subject practiced responding to the vibrations until he or she felt comfortable using the device. A baseline RT was measured while the subject stood for 30 seconds and responded to the vibration. Two baseline RT estimates were obtained, one at the beginning and one at the end of the mobility route, so that time effects (practice or fatigue) could be detected. Because the secondary task method requires that performance on the primary task remain constant with the introduction of the secondary task, a baseline measure of the primary task performance (i.e., walking speed), was needed. Therefore, the subjects walked the mobility route twice, once while responding as quickly as possible to the vibrations and another time, without the vibrating device. They were instructed to walk at their normal pace for both passes on the route. Every other subject performed the secondary task on the first pass, and the other subjects performed the secondary task on the second pass. At the beginning of each route segment, directions were provided in short descriptions. The first and last segments were the hallway. This segment was repeated, and the RT scores from the two samples were averaged to form a composite hallway score, to minimize any effect due to the passage of time. The next segment to be experienced was the approach-to-stairs, followed by stairs, and finally the high-pedestrian area.
Data Analysis
The outcome of interest was the RT to the secondary task. The average RT was calculated for each subject and mobility segment. To reduce the heterogeneity of the variances of the RT scores in the various mobility segments, the scores were transformed by taking the natural logarithm of the average RT. Baseline RT was measured at the beginning and end of the mobility course, and the two measures were averaged to form the baseline RT, which was then used as a covariate in the regression models, to account for natural individual differences in reaction time.
Reliability refers to the extent to which a measurement is consistent. One of the ways to test reliability is to assess the similarity in scores obtained from the same test administered in two or more testing sessions (test–retest reliability). The problem with this type of method is that scores may change over time because of practice or fatigue, if the sessions are spaced close together, or because of disease progression, if the sessions are far apart. One way to avoid the confounding effects associated with time is to assess the similarity in scores obtained in two halves of a single test (e.g., odd- versus even-numbered measures). We chose the split-half method and assessed the reliability of the secondary-task RT measures from the Cronbach's
coefficient. The split-half method entails calculating the score for each randomly divided half of the sample and determining the correlation between the two scores. Cronbach's
is equivalent to the average of all possible split half-correlations. We used the high-pedestrian segment to assess reliability of the secondary-task RT measure because this segment had the most samples (Table 2) . Cronbach's
was computed with commercial software (Excel; Microsoft, Redmond, WA).
|
Construct validity refers to the extent to which different methods that purportedly measure the same construct (or trait) yield similar results.20 To assess the construct validity of the secondary-task RT measures as an estimate of mental effort, we performed two analyses. First, we performed a linear regression analysis on the log RT scores against estimates derived from perceived difficulty ratings for comparable mobility situations. We reasoned that if the amount of mental effort required for walking can be estimated from the RT to a secondary task, then we would expect that situations that have been reported to be difficult by persons with a similar diagnosis would have slower RT than situations that have been reported to be less difficult. The perceived difficulty measures were taken from a previously published study from a separate group of 83 patients with glaucoma who rated the difficulty of 35 mobility situations.3 In that study, a Rasch analysis was performed on the subjects' ordinal difficulty ratings to derive interval measures of estimated visual ability (item measure). The item measure is specified in logit units and corresponds to the ability required for that particular mobility situation, with larger values indicating a greater ability required (more difficulty) for the situation.2 3 Four mobility situations closely matched the predominant characteristic of the four mobility segments tested in the study. The item "avoiding bumping into walls" corresponds to the hallway segment and had an item measure (SE) of –0.92 (0.21). The item "bumping into people" corresponds to the high-pedestrian segment and had an item measure of –0.54 (0.19). The item "detecting descending stairwells" corresponds to the approach-to-stairway segment and had an item measure of 0.51 (0.16). The item "walking down steps" corresponds to the stairs segment and had an item measure of 0.49 (0.16).
Second, since self-reports of perceived difficulty correlate with degree of visual field loss, as indexed by the MD score of the Humphrey Visual Field Analyzer (Carl Zeiss Meditec, Inc.),3 if the two measures are applied to the same construct, we would expect that the secondary-task RT would be associated with the MD score. To test the hypothesis that secondary-task RT increases with decreasing MD score, linear regression was performed on the log RT score as a function of the MD score of the Humphrey Visual Field Analyzer 24-2 test, adjusting for age, gender, and baseline RT.
To assess the associations between the log RT scores in each mobility segment and all measured vision variables, we used linear regression models and modeled log RT in two stages as a function of logMAR, peak log contrast sensitivity (CS), MD, and CPSD. First, we looked at the relationship of each variable to the log RT scores using univariate analyses to identify potential covariates, adjusting the vision variables for age, gender, and baseline RT. Next, we built a model with all the vision variables to determine which vision variables were associated with the log RT scores while adjusting for all other vision variables. Age and gender were included in the multiple linear regression model, despite nonsignificance in univariate analyses, to account for any variations in the vision variables related to these factors. Finally, two-way interaction terms were added to the multivariate linear regression model to determine whether their presence affected the findings of the simpler linear model.
The effect of environment on the amount of mental effort required for independent mobility was tested using a repeated-measures ANOVA of the log RT with mobility segment as the within-subjects factor. Log RT was weighted by the number of samples in each segment. To determine whether a main effect of environment occurs both in persons with early glaucoma and in those with advanced glaucoma, we identified the subjects with early and advanced glaucoma as those whose average MD scores were within the upper and lower quartiles, respectively. A mixed-design ANOVA was performed on the log RT scores with mobility segment as the within-subjects factor and subject group (early glaucoma, advanced glaucoma) as the between-subjects factor.
| Results |
|---|
|
|
|---|
The average difference in the mean baseline RT scores obtained at the beginning and end of the mobility route was 7.9 ms, with a longer RT score at the beginning of the route. A two-tailed, matched t-test, performed on the baseline RT scores showed that the difference was not significant (t25 = –1.05, P = 0.30). Therefore, the scores were averaged, and the mean baseline score was used as an adjustment factor for the log RT scores in the regression analyses. The average difference in the log RT scores for the two hallway tests, measured at the beginning and end of the route, was 0.1, with a longer RT score obtained at the end of the route. A two-tailed t-test, performed on the log RT scores, weighted by the number of samples in each test, indicated that the difference was not significant (t50 = 1.58, P = 0.12). Therefore the scores were averaged. The average number of vibrations (samples), time to complete the mobility segment, and RT scores are listed in Table 2 .
Figure 1 shows the log RT for each participant plotted against average walking speed (meters per second) in the four mobility segments (circles), together with the group means for each segment (diamonds).
|
coefficient for the odd- versus even-numbered RT measures obtained in the high-pedestrian area was 0.89, providing support for the reliability of the secondary-task RT measures. One of the ways we assessed the construct validity of the secondary-task RT scores was by determining the relationship between the log RT and the item measure scores derived from the perceived difficulty ratings (Fig. 2) . The linear relationship between the two factors was significant (P = 0.008), and the best-fit line was: log RT = 5.97 + 0.112 x item measure.
|
|
|
|
The results of a repeated-measures ANOVA showed a significant main effect of mobility segment on the log RT score (F3,25 = 6.07, P = 0.001). Post hoc analyses revealed that the log RT in the stairs segment was significantly higher than the log RT of the high-pedestrian and hallway segments. The log RT in the approach-to-stairs segment was significantly higher than the log RT of the hallway segment. The log RT scores of the high-pedestrian and hallway segments were not significantly different from each other.
The results of a mixed-design ANOVA of log RT showed a significant main effect of subject group (early glaucoma, advanced glaucoma) (F1,29 = 12.14, P = 0.002) with the advanced-glaucoma group having longer log RTs (mean, 6.14) than did the early-glaucoma group (mean, 5.81). There was also a significant main effect of mobility segment (F3,29 = 4.76, P = 0.008). Post hoc analyses revealed the same ordering of log RT scores among the mobility segments as reported above for all the subjects with glaucoma. The only exception was that the difference between the log RT scores in the stairs and high-pedestrian segments (F1,29 = 2.93, P = 0.09), did not reach the 0.05 significance level. The interaction of mobility segment and subject group was not significant (F3,29 = 1.18, P = 0.34) indicating that log RT was dependent on the mobility segment in a similar manner for both early and advanced glaucoma.
| Discussion |
|---|
|
|
|---|
coefficient of 0.89 on the odd- versus even-numbered adjusted RT scores from the high-pedestrian area. Construct validity was supported in two ways: (1) The secondary-task log RT scores were linearly related to the item measure scores for similar environments. The item measure scores were derived from a Rasch analysis of perceived difficulty ratings obtained from a separate group of persons with glaucoma. We reasoned that situations reported as difficult should have slower RT scores than those reported as being less difficult. (2) The log RT scores were linearly related to the magnitude of visual field loss as indexed by the MD score. We reasoned that, since self-reports of perceived difficulty were shown to be correlated with degree of visual field loss,2 3 the average RT score should be associated with the magnitude of visual field loss. Of the four environmental conditions that we tested, the two mobility segments that required the most mental effort for walking were the approach-to-stairs and stairs. The hallway required the least amount of mental effort, and the high-pedestrian area required an amount of mental effort somewhere in between. The finding that the hallway required the least amount of mental effort is not surprising. Many visual cues are available to guide one's walking down a corridor. For example, one could walk so as to keep the optic flow that is generated during self-motion21 equalized with respect to one's midline.22 People with actual23 and simulated24 peripheral visual field loss are able to extract heading direction from optic flow and can use optic flow to guide mobility.25
The absence of obstacles in the hallway segment, which also probably contributed to the ease in walking this segment, contrasts with that in the high-pedestrian area. Walking in the high-pedestrian area would require careful scanning of the environment to locate the obstacles (people) to avoid collision. Kuyk et al.12 have shown that obstacle avoidance is linearly related to scanning ability and visual field extent. To ensure obstacle detection within a scene, people with small visual fields would have to compensate for the reduced information within a glance, perhaps by taking more "snapshots" and piecing them together to estimate distance. In the approach-to-stairs and stairs segments, the stairs and handrail were within the line of sight but were located in an open atrium rather than in a stairwell, with low contrast between the floor and the stairs. The fact that visual search performance is adversely affected in peripheral visual field loss26 and that the risk of falling is high in both of these segments probably contributes to their associated increase in required mental effort. Walking on stairs has long been identified by orientation and mobility specialists as one of the most challenging aspects of travel.27
The MD score and logMAR were the only vision function measures linearly associated with the log RT score. The association of the MD score with the RT score is not surprising, given that most measures of mobility performance are associated with visual field measures.2 3 9 11 12 28 29 30 31 32 33 34 However, the same is not true of visual acuity (but see Brown et al.35 ). In a self-report study,3 logMAR and MD both correlated significantly with the subjects' average perceived ability for independent mobility. One might deduce from these two studies that although performance is not associated with visual acuity, one's perception of the difficulty and amount of mental effort required for independent travel are associated with it.
It was surprising that age was not a significant predictor of the log RT score in any of the mobility segments. The ages of the participants spanned a wide range: 24.8 to 84.3 years. Although it is possible that the visual field effect swamped any effect due to age, this explanation is unlikely to explain the lack of correlation of age with the baseline RT estimate (r = –0.08). The baseline RT scores ranged from 164 to 469 ms (mean, 285). We have no explanation for the lack of an age effect with the baseline RT score.
When the secondary-task method is used, the choice of the stimulus and the task are critical. In a previous secondary task study with mobility performance an auditory stimulus was used.16 However, a concern in that study was whether the stimulus might interfere with the ambient sounds that occur in natural settings (music and conversation indoors and vehicle noise outdoors). The selection of a tactile stimulus avoids this potential problem. In addition to selecting the secondary task stimulus, one must also choose the appropriate task so that the level of difficulty falls within a range that is not so taxing that it cannot be performed at all or that it interferes with performance on the primary task and not so effortless that a response becomes automatic. It is also important that the choice of secondary task does not interfere with primary-task information. Findings in the present study demonstrate that a tactile stimulus is appropriate as a secondary-task stimulus for mobility. Finally, the frequency at which a secondary-task response is required must be appropriately chosen, to obtain a sufficient number of samples. Alternatively, one could have subjects respond to some kind of code or a break in a continuous stimulus stream.
The measurement of the mobility of the visually impaired poses many challenges, including what should be measured and how it should be measured. When severe visual impairment is present, strategies that involve obstacle courses and the measurement of contacts with obstacles can provide meaningful data. When significant vision is remaining, counting mobility events such as contacts with obstacles is less useful, since these events are rare. Our results demonstrate that the secondary-task methodology is sensitive enough to detect differences in mental effort as a function of environmental complexity in persons with mild or severe visual field loss due to glaucoma. Whether it is also able to differentiate degrees of mental effort in persons with full vision remains to be seen.
Measures of mental effort provide a complementary source of information to the traditional measures. It is a continuous variable and, as demonstrated in this study, is sensitive to different environmental characteristics and to degrees of visual field loss. Measures of mental effort can be effective for documenting who may benefit from professional intervention, and it may also be useful for evaluating the effectiveness of an intervention. Clinicians want to know who needs mobility instruction and how much instruction they need. The measure of mental effort has the potential to describe objectively the type of patient who would benefit from mobility instruction. In addition, it may be useful as a measure for describing progress that occurs through instruction and for documenting when services can be terminated.
| Acknowledgements |
|---|
| Footnotes |
|---|
Submitted for publication October 5, 2006; revised March 29 and May 18, 2007; accepted June 22, 2007.
Disclosure: D.R. Geruschat, None; K.A. Turano, None
The publication costs of this article were defrayed in part by page charge payment. This article must therefore be marked "advertisement" in accordance with 18 U.S.C.
1734 solely to indicate this fact.
Corresponding author: Kathleen A. Turano, Wilmer Eye Institute, Lions Vision Center, 550 North Broadway, 6th Floor, Baltimore, MD 21205; kturano{at}jhmi.edu.
| References |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |