Article Text
PDF
Abstract
Aims To investigate agreement between children with visual impairment (VI) and their parents on their ratings of the child's vision-related quality of life (VQoL) and functional vision (FV) using two novel self-report patient-reported outcome measures developed for this population.
Methods 99 children aged 10–15 years (mean age=12.2, SD=1.9) with VI (best corrected acuity (logarithm of the minimum angle of resolution) 0.50 or worse in better eye) and their parents participated in a national postal survey, completing the child and proxy versions of our novel instruments assessing VQoL and FV of children with VI—the vision-related quality of life instrument for children and young people (VQoL_CYP) and the functional vision questionnaire for children and young people (FVQ_CYP), respectively. Parent-child agreement was investigated using the Bland-Altman (BA) method. Variation across key sociodemographic and clinical characteristics was examined using the Intraclass Correlation Coefficient.
Results Average parental ratings of their child's VQoL and FV were significantly lower than the children's own ratings, but the range of disagreement was wide, with parents both overestimating and underestimating their child's VQoL (mean score difference=5.7, BA limits of agreement (LOA): lower −22.10 (CI 95% −24.61 to 19.59) and upper 33.50 (CI 95% 30.99 to 36.01)), but more consistently underestimating the child's FV (mean score difference=−11.8, BA LOA: lower −39.60 (CI 95% −42.12 to 37.08) and upper 16 (CI 95% 13.48 to 18.52)). There was variation in agreement by some child characteristics, including vision level, time of onset and course of VI progression.
Conclusions Visually impaired children and their parents perceive the broader impact of living with VI very differently. There is value in routine capture of information independently from children and their parents for comprehensively gauging the impact of childhood VI and tailoring appropriate interventions.
- Child health (paediatrics)
- Epidemiology
This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/4.0/
Statistics from Altmetric.com
Introduction
Visual impairment (VI) in childhood has significant far-reaching and lifelong impact with consequences for the child's social and educational experiences and future career prospects.1–3 Knowledge about children's own perceptions of the impact of living with VI, in terms of day-to-day functioning and quality of life (QoL) is limited, due to the paucity of vision-specific patient-reported outcome measures (PROMs) for this population.
Health-related QoL (HRQoL) is a complex construct shaped by personal lived experience and expectations in the context of a health condition,4 most accurately assessed by self-reporting, which can be by children as young as 5 years.5 Nevertheless, parents are still frequently asked to report as proxies on their child's HRQoL and functioning. However, an extensive literature shows that there is a high level of child-parent discordance on measures where both child self-report and parent proxy questionnaire versions are used.6 ,7
Agreement between parental proxy and children's own reports of the impact of VI has only previously been examined in two studies,8 ,9 both using the PedsQL,10 a generic HRQoL measure, in the absence, at the time, of a vision-specific measure. Generic measures do not capture vision-specific issues so the nature and the extent of child-parent discordance may not accurately represent the impact of the child's VI per se.
In the present study, we examined agreement between children with VI and their parents, and whether this varied by key clinical and sociodemographic child characteristics, using two novel self-report PROMs we recently developed specifically for this population. One assesses vision-related quality of life (VQoL)11 and the other functional vision (FV),12 each uniquely capturing the impact of living with VI in children.
Method
The study was approved by the National Health Service Research Ethics Committee for University College London (UCL) Institute of Child Health and Great Ormond Street Hospital (GOSH), London, UK, and followed the tenets of the Declaration of Helsinki. The parents and children gave written consent and assent respectively to participation.
Sample
The sample was drawn from (a) patient databases from the Department of Ophthalmology and the Developmental Vision Clinic at GOSH, and the Paediatric Glaucoma Service and Genetic Eye Disease Service at Moorfields Eye Hospital, London, UK and (b) 14 additional Paediatric Ophthalmology Departments UK wide (see Acknowledgements).
Children were eligible if (i) they were visually impaired or blindi (corrected visual acuity (VA) in the better eye logarithm of the minimum angle of resolution (LogMAR) 0.50 or worse, using the WHO's definition of VI13 to capture all eligible children meeting this criteria regardless of severity) due to any visual disorder, but without any other impairment (ie, learning, sensory, motor) that would impact on their ability to self-report on or confound the specific impact of VI and if (ii) they were aged 10–15 years.
Procedures
Eligible children and their parents were invited to participate in a postal survey evaluating the two novel vision-specific PROMs we were developing—the vision-related quality of life instrument for children and young people (VQoL_CYP)11 and the functional vision questionnaire for children and young people (FVQ_CYP).12 Each family received a study pack containing an invitation letter, information sheets for children and parents, consent and assent forms, large print and electronic (CD) versions of the child and parental instrument versions, described below, and a prepaid postage reply envelope.
The VQoL_CYP11 is a 35-item self-report questionnaire capturing the visually impaired child's perception of the impact of their visual disability in the societal context (from social relationships and psycho-emotional well-being to their autonomy and independence). The respondent child reports ‘how much they are like’ (child form) and the respondent parent ‘how much their child is like’ (parent form) the statement presented by each item (eg, ‘ feeling lonely because of my/her eyesight’), using a four-point scale (ranging from ‘1: not at all’ to ‘4: exactly’). The four response categories are converted to 0–3 scores (with negative items reversed) to derive a VQoL summary score, with higher summary scores indicating better VQoL (possible score range 0–105).
The FVQ_CYP12 is a 36-item self-report instrument assessing the visually impaired child's level of difficulty in performing activities for which vision is required. The respondent child or parent is asked to report the level of ‘ease’ with which the child performs the activity presented in each item (eg, ‘watching TV’) using a four-point scale (ranging from ‘very easy’ to ‘very difficult or impossible’). The four categorical responses are converted into 0–3 scores to derive a FVQ_CYP summary score, with higher summary scores indicating greater FV difficulty (possible score range 0–108).
Data analysis
Summary scores on the two instruments were calculated for children and parents and score distribution screened for normality. Internal consistency was examined using Cronbach α coefficients.14 Paired-samples t tests were used to compare the means scores for children and parents.
Agreement between child and parent scores on the two instruments was assessed using the Bland-Altman method of limits of agreement (LOAs)15 and Intraclass Correlation Coefficients (ICCs). The variation in child-parent agreement was examined by children's sociodemographic factors (child age, gender, ethnicity and socioeconomic status using the Index of Multiple Deprivation based on the UK postal code16) and clinical characteristics (ie, VI level, progression and time of onset). To calculate the ICCs corresponding to these variables, in keeping with extant literature on child-parent agreement in paediatric HRQoL,5 a two-way mixed model (absolute agreement, single measure) was used, applying previously defined categories for the magnitude of agreement (≤0.40=poor to fair, 0.41–0.60=moderate, 0.61–0.80=good, 0.81≤excellent).17
Before calculating the summary scores, we carried out multiple regression-based imputation18 to replace the missing score data (threshold for missing data of <20% at item level and <25% at person level12). We report pooled mean score estimates across the multiple imputed datasets (five imputations). The Bland-Altman comparisons, t tests and ICCs were done across all the imputed datasets. As there were no significant variations between the results from different datasets, we report the estimates and plots using the first imputed data set only.19
Analyses were performed using SPSS (V.21.0).
Results
Participants
Ninety-nine families consented/assented to participation. Eighty-two per cent of parent responders were mothers and 85.4% from white ethnic majority backgrounds.
Table 1 shows clinical and sociodemographic characteristics of children and parents. The child participants were representative of the UK population of children with VI and blindness without additional impairments.20
Clinical and sociodemographic characteristics of children
Data screening
Of 99 consenting families, 90 child-parent pairs completed the VQoL_CYP and 93 the FVQ_CYP.
At item level, the amount of missing data for VQoL_CYP was ≤3% and for FVQ_CYP ≤16% (the reasons for missing data on the FVQ_CYP have been discussed elsewhere12). Data of four child-parent pairs had >25% missing data at the person level on FVQ_CYP, so were excluded from the subsequent analyses. The multiple regression-based imputation of missing data and summary score calculation was carried out for 90 and 89 child-parent pairs for VQoL_CYP and FVQ_CYP, respectively.
Score distribution and reliability
The score distributions were within accepted normality limits (skewness between –1.0 and +1.0). Cronbach α coefficients for child and parent scores fell within the reliability criteria required for group and individual comparisons21 (children: 0.90 and 0.97 and parents: 0.92 and 0.95 on VQoL_CYP and FVQ_CYP respectively).
Child-parent agreement
On average, parents rated their children as having significantly poorer VQoL and FV than did children themselves (paired t tests: p<0.001) (table 2). However, the range of child-parent disagreement was wide and in both directions (table 2, figure 1). While parents tended to both underestimate and overestimate their child's VQoL, they consistently underestimated their child's FV ability. This directional pattern of discrepancy appeared consistent across the key clinical (eg, vision level, figure 2) and sociodemographic variables. Furthermore, greater child-parent discrepancy was observed where the parents underestimated rather than overestimated their child (figure 2), the pattern being particularly prominent in children with VI who rated themselves as having better FV (ie, lower scores) (figure 2, section B).
Bland-Altman and ICC agreement between child-parent pairs on VQoL_CYP and FVQ_CYP summary scores
Bland-Altman plots of child-parent scores pair vision-related quality of life instrument for children and young people (VQoL_CYP) (A) and functional vision questionnaire for children and young people (FVQ_CYP) (B). On the VQoL_CYP, higher scores indicate better vision-related quality of life outcome, whereas on the FVQ_CYP, higher scores indicate greater functional vision difficulty.
Discrepancy in child-parent scores vision-related quality of life instrument for children and young people (VQoL_CYP) (A) and functional vision questionnaire for children and young people (FVQ_CYP) (B) in individual pairs by visual impairment level. On the VQoL_CYP, higher scores indicate better vision-related quality of life outcome, whereas on the FVQ_CYP, higher scores indicate greater functional vision difficulty. Visual impairment (VI): visual acuity logarithm of the minimum angle of resolution (LogMAR) in better eye=0.50–1.00; severe VI (SVI)/blind: LogMAR worse than 1.00.
ICCs in table 3 show the variation in magnitude of child-parent agreement by clinical and sociodemographic variables by agreement categories, with average level agreement ranging from ‘moderate’ to ‘good’ across the two measures.
Variation in mean child and parent VQoL and FV scores by clinical and sociodemographic characteristics
There were some notable differences in agreement categories for some characteristics on FVQ_CYP, that is, visually impaired children: ‘moderate’, severely visually impaired or blind children: ‘good’; early VI onset: ‘moderate’, late VI onset: ‘good’; stable VI: ‘moderate’, progressive VI: ‘good’; more deprived socioeconomic background: ‘moderate’, least deprived background: ‘good’. Equally, such differences were noted also for the VQoL_CYP, that is, girls: ‘moderate’, boys: ‘good’; white British majority ethnic background: ‘moderate’, other ethnic minorities: ‘good’; more deprived: ‘good’, least deprived: ‘moderate’.
Additionally, based on the agreement categories, potentially higher (ie, ‘good’ vs ‘moderate’) agreement was observed on FVQ_CYP than on VQoL_CYP on some child characteristics (eg, girls and late and more progressive visual loss).
Discussion
The present study investigated concordance between child self-report and parental proxy report on the impact of the child's VI on his/her VQoL and FV, using novel vision-specific PROMs for children with VI.
We found that visually impaired children's and their parents' perspectives of the impact of VI on the child differed significantly. Parents on average perceived their child's VI as having a greater impact on the child compared with their child's own rating. The range of child-parent disagreement was wide, with parents both underestimating and overestimating their child's own report. The extent of child-parent discrepancy varied by certain clinical and sociodemographic characteristics of the children as well as by instrument. The pattern of parental underestimation was particularly prominent for visually impaired children who rated their outcomes more favourably.
Patterns of agreement/discordance in this study are similar to those in other studies on child-parent agreement on child's health outcomes in other non-VI paediatric populations.6 ,7 They also extend the findings of prior studies examining agreement between children with VI and their parents using a generic HRQoL measure.8 ,9
Our study design and limited variable information precluded the opportunity to assess other variables potentially influencing discordance, such as parental health and well-being, parental age and educational level, and number of siblings,6 ,22 ,23 which we will address in future studies with larger samples. We did not find greater discordance with increasing age of child, as anticipated, which probably reflects the narrow age range of our sample compared with other studies.6 ,24 ,25 Study resources necessitated a postal survey, preventing ascertaining the level of parental help received by children and the extent to which this may have affected informant agreement. The size of our sample, reflecting the vulnerable, heterogeneous and numerically small clinical population of children with VI, precluded us from investigating the nature of and variation in informant discrepancy in greater detail. However, the variation observed is generalisable as our sample is representative of the UK population of children with VI without additional impairments.20 A limitation of the sample size is that the differences in variation by child characteristics did not reach statistical significance. The variation by gender, ethnicity and socioeconomic status is interesting, although complex to interpret given the conflicting wider literature in this area.26
The nature and extent of child-parent discordance is likely to vary by the type and severity of the child's condition, the domain or construct being measured, the child's age, gender, type of condition, duration of illness and treatment status.6 Greater agreement is typically found on more observable, physical characteristics and greater divergence on unobservable emotional and psychosocial characteristics of the impact of the health conditions.7 ,24 We found greater magnitude of agreement, by agreement categories, on FVQ_CYP than on VQoL CYP, irrespective of the direction of disagreement. The FVQ_CYP was designed to capture the difficulty with which a child performs vision-dependent activities (eg, the level of difficulty with which a child navigates around the school or finds friends in the playground) and thus may be objectively more agreement prone than the psychological characteristics that the VQoL_CYP was intended to capture (eg, autonomy, social inclusion, emotional well-being).
Our finding of potentially greater child-parent agreement, especially on FVQ_CYP, in children with progressive VI echoes findings relating to systemic diseases where, arguably, active illness demands greater child-parent communication and parental vigilance about symptoms and illness characteristics than in non-progressive disease, thus resulting in greater child-parent agreement.6 ,27 We also found a potentially greater agreement on FVQ_CYP for children with more severe and late onset VI, both of which tend to coincide with progressive loss of vision. Parents of children with progressive, late onset, visually impairing disorders, such as Stargardt disease, may be more in tune with their child's rapid and/or fluctuating loss of function as their child may become increasingly dependent on parental help and support (especially relating to functional outcomes), which in turn may result in greater child-parent communication and ultimately agreement. These findings may have potentially important clinical implications in the scenario of distress and depression in teenagers with rapid loss of vision and function; knowing the child-parent agreement is higher for this group may be helpful in the clinical monitoring of and research with children who may be too distressed and thus potentially unable to self-report themselves at particular stages.
The reasons for the child-parent disagreement are not fully understood, but there are several possible explanations. For instance, parents of children with VI may underestimate their child's FV because they may focus on a bigger ‘life’ picture and weight their perceptions of their child's visual ability against their own worries and concerns, a particular life demand (eg, independent living), other children's abilities and the general implications for the future. Conversely, children, particularly when younger, may focus on their current level of functioning rather than making comparisons with others. With respect to the VQoL_CYP, the bidirectional pattern of child-parent discordance may be down to the parental reports likely being influenced by the degree to which parents can observe different settings (eg, their child's social lives at school) that are likely to influence on how children feel on a daily basis.6 Finally, the general reasons for disagreement could be methodological as children and parents use different response styles in completing questionnaires whereby children are more likely to provide extreme scores as well as provide different explanations for choosing those response options.28
We are currently adapting our novel PROMs of VQoL and FV to younger and older patients, which will enable the investigation of potential age-related differences. The planned use of these PROMs in routine clinical practice planned in our clinical centres will enable us to evaluate the nature and extent of and need for parental assistance in completing these questionnaires. This future planned work will also enable us to establish with more accuracy a clinically minimally important difference for individual children's scores over time and therefore the clinically significant meaning of the child-parent difference in scores for different measures.
In summary, we report findings on child-parent concordance and divergence in evaluation of the child's VQoL and FV using vision-specific instruments. There is a wide range of disagreement in how visually impaired children and their parents perceive the functional as well as psychological impact of living with VI on the affected child's life, which to an extent is influenced by the child's clinical or sociodemographic characteristics. Clinicians should not disregard this discordance, which is likely to be highly informative for the purpose of clinical management of individual patients, especially in older children. The information provided by children and their parents should be viewed as being complementary, rather than interchangeable. Our findings highlight a potential value in routinely capturing both perspectives for their unique contribution in comprehensively gauging the impact of childhood VI and tailoring appropriate interventions, both in clinical practice and research.
Acknowledgments
The authors would like to acknowledge all the colleagues from the following UK hospitals who helped with patient identification and recruitment: Birmingham Children's Hospital, Bradford Royal Infirmary (Bradford Teaching Hospitals NHS Foundation Trust), Bristol Eye Hospital (University Hospitals Bristol), Addenbrooke's Hospital (Cambridge University Hospitals), Royal Derby Hospital, St James's University Hospital (Leeds Teaching Hospitals), Pinderfields General Hospital (Mid Yorkshire Hospitals NHS Trust), Royal Victoria Infirmary (Newcastle Upon Tyne Hospitals), University Hospital of North Staffordshire, Royal Devon and Exeter Hospital (Wonford), Torbay Hospital (South Devon Healthcare NHS Foundation Trust), Southend Hospital (Southend University Hospitals), University Hospital of Wales (Cardiff and Vale University Hospital Board, Cardiff) and West Suffolk Hospital (Bury St Edmunds).
References
Footnotes
Collaborators VQoL group members: Naomi Dale, Peng Tee Khaw, Anthony Moore, Alison Salt, David Taylor and the study advisory group (Corie Brown, Marianne Craig, Christine Ennals, Sarah Keeley, Lucy Thompson), Jackie Osborne, Nidhi Sobti, Paula Thomas and Jude Thompson.
Contributors VT, PMC, GL-H and JSR: substantial contributions to the conception or design of the work, or the acquisition, analysis or interpretation of data; drafting the work or revising it critically for important intellectual content; final approval of the version published; and agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.
Funding The study was funded by the Guide Dogs for the Blind Association (Project Grant: OR2006-03b) and Fight for Sight (Project Grant: 2014). This work was undertaken at UCL Institute of Child Health/Great Ormond Street Hospital and Moorfields Eye Hospital/UCL Institute of Ophthalmology, both of which are members of UCL Partners Academic Health Science Centre (AHSC), and both receive both receive a proportion of funding from the Department of Health's National Institute of Health Research (NIHR) Biomedical Research Centres funding scheme. Members of the team are supported by the Ulverscroft Foundation. Further support was received from the following sources: National Institute of Health Research (NIHR) Biomedical Research Centre at Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, and NIHR Central and East London Comprehensive Research Network. The Life Course Epidemiology and Biostatistics Section within the Population, Policy and Practice Programme at UCL Institute of Child Health was previously supported in part by the Medical Research Council in its capacity as the MRC Centre of Epidemiology for Child Health (award G0400546).
Competing interests None declared.
Patient consent Obtained.
Ethics approval NHS Research Ethics Committee for Great Ormond Street Hospital and UCL Institute of Child Health.
Provenance and peer review Not commissioned; externally peer reviewed.
↵i For brevity, we consider term visual impairment (VI) in the remainder of the paper.
Linked Articles
- At a glance