Research Article - Current Pediatric Research (2024) Volume 28, Issue 7
Development and content validation of the Pediatric Dizziness Index (PDI).
Devashish Tiwari1*, Mariah Allen2, Rebecca Schulz2, Brittany Gotts2, Catherine Stewart2, Maninderjit Kaur1
1Department of Physical Therapy, MGH Institute of Health Professions, Boston, MA, USA
2Department of Physical Therapy, Simmons University, Boston, MA, USA
- Corresponding Author:
- Devashish Tiwari
Department of Physical Therapy, MGH Institute of Health Professions, Boston, MA, USA
E-mail: dtiwari@mghihp.edu
Received: 25 June, 2024, Manuscript No. AAJCP-24-138957; Editor assigned: 27 June, 2024, Pre QC No. AAJCP-24-138957(PQ); Reviewed: 12 July, 2024, QC No. AAJCP-24-138957; Revised: 19 July, 2024, Manuscript No. AAJCP-24-138957 (R); Published: 26 July, 2024, DOI:10.35841/0971-9032.28.07.2294-2301.
Abstract
Introduction: Approximately, 3 million children are impacted by dizziness nationally, and are at high risk of intellectual and learning disability. Stark differences between children and adults in brain morphology, maturity, and perceptions of injury impact, valid, age-specific patient reported measures are important to capture the breadth of disability from dizziness post-concussion.
Objectives: To develop and examine content validity of the Pediatric Dizziness Index (PDI) to evaluate perceived disability due to dizziness.
Participants: Eight pediatric clinical and research experts participated in PDI development. PDI was developed in four steps: 1) Item development, 2) Item evaluation, 3) Content validity ratio and index calculation, and 4) Cognitive interviews to ensure face validity, and comprehension of the items. Content validation process followed the Consensus based Standards for the selection of health status Measurement Instruments (COSMIN) guidelines.
Main outcome measures: Content Validity Ratio (CVR) was calculated using Lawshe’s formula CVR=(ne–N/2)/N/2 (ne=number of experts identified an item as essential; N=total number of experts). Finally, Content Validity Index (CVI) was calculated (CVI >0.8 indicated good content validity).
Results: Following the modified Delphi process, the initial item bank of 33 items was condensed to 10 items in final version of PDI. Three items were revised post cognitive testing. The final version of PDI demonstrated good content validity (CVI=0.87).
Conclusion: PDI is the first comprehensive patient reported measure specific to dizziness and provides evidence of strong content validity. Further research to establish factor structure and construct validity is recommended.
Keywords
Validity, Children, Dizziness, Disability evaluation.
List of Abbreviations
PDI=Pediatric Dizziness Index; CI=Confidence Interval; PROM=Patient-Reported Outcome Measures; DHI=Dizziness Handicap Inventory; PVSQ=Pediatric Vestibular Symptom Questionnaire; DHI-PC=Vanderbilt Pediatric Dizziness Handicap Inventory for Patient Caregivers; DHI-CA=Dizziness Handicap Inventory-Children and Adolescents; COSMIN=Consensus based Standards for the selection of health status Measurement Instruments; ICF-CY=International Classification of Functioning, Disability, and Health: Children and Youth Version; CVR=Content Validity Ratio; CVR critical=Content Validity Ratio Critical Value; CVI=Content Validity Index.
Introduction
Dizziness is a broad term that includes sensations like vertigo, disequilibrium, presyncope and lightheadedness [1]. Dizziness has been reported in 3.5 (95% CI=3.1-3.9) million children with higher prevalence in the 15-17 years’ age group [2,3]. Multiple factors including trauma, concussion, vestibular migraine, benign paroxysmal positional vertigo, peripheral vestibular syndromes, ear infections, and hemodynamic dysfunction can cause dizziness in children [3].
Dizziness significantly affects mobility and balance, function, participation in age-appropriate activities and health behaviors, and quality of life [4]. Moreover, dizziness has shown to increase anxiety and psychological stress in children and adolescents [5,6]. Children and adolescents with dizziness demonstrate a 6.6 times (95% CI=2.6-16.79) increase in likelihood of intellectual disability, 3.4 times increase in likelihood of learning disability (95% CI=2.18-5.45), and 1.76 times higher likelihood of attention deficit disorder (95% CI=1.06-2.81) as compared to those without vertigo [6].
Additionally, children with dizziness experience developmental delay, emotional difficulty, and behavioral difficulty and are 2.46 times (95% CI=1.48-4.10) times more likely to use special education services as compared to children without vertigo. If left untreated, dizziness can negatively affect child’s recovery, independent functioning and participation in the ageappropriate activities [7].
Given the substantial impact of dizziness on activities of daily living, it is important to accurately assess dizziness to plan targeted rehabilitation intervention. Specifically, given the broad range of experiences a child can associate with dizziness, it is important to examine this problem from a patient perspective. Gathering self-report symptom information from the child is essential to capture true nature of perceived disability that allows for focused assessment and interventions to improve function [8]. This serves as a guide for directing further examination, goal setting and designing targeted rehabilitation interventions to effectively manage dizziness and consider the environmental and social contexts 1) Where the dizziness arises and/or 2) That children and adolescents avoid as a result of dizziness. This information will aid healthcare providers to include all relevant factors to support function.
Patient-Reported Outcome Measures (PROM) capture the impact of a disease and/or intervention on the patient and are important in implementation of patient-centered care model through integrated care in healthcare [9]. Studies suggest that 7-8 years old children demonstrate adequate cognitive skills to respond appropriately to systematic questioning as required in the PROM [10,11]. While PROMs to evaluate dizziness such as the Dizziness Handicap Inventory (DHI) exist in the adult population, the same measures have not been validated in children and have little clinical applicability in the pediatric population as the contextual factors are significantly different from adults. Existing measures to evaluate dizziness in children (Pediatric Vestibular Symptom Questionnaire (PVSQ), The vanderbilt pediatric Dizziness Handicap Inventory for Patient Caregivers (DHI-PC), and The Dizziness Handicap Inventory-Children and Adolescents (DHI-CA)) are either geared towards parents and caregivers, thereby limiting patient experience, or showed questionable validity and comprehensiveness, thereby limiting their clinical applicability in this population of children with dizziness.
Hence, the purpose of this study was to develop and examine content validity of a new PROM i.e., Pediatric Dizziness Index (PDI) to specifically evaluate activity limitation and participation restriction resulting from dizziness in children and adolescents.
Materials and Methods
Development and content validation of the PDI was completed in four steps: 1) Item development, 2) Item evaluation by content experts, 3) Content validity calculation, and 4) Cognitive testing via interviews to ensure readability and comprehension of the items on the PDI. Content validation was done according to the guidelines by the Consensus based Standards for the selection of health status Measurement Instruments (COSMIN) [12].
Item development
The first step in developing a PROM is to identify the constructs intended to be assessed by the measure [11]. A literature search revealed three existing measures to assess dizziness in children, namely, 1) PVSQ, 2) DHI-PC, and 3) DHI-CA [13-15]. The PVSQ is an eleven-item self-report/ parent-caregiver assisted questionnaire which is primarily focused on the frequency of vestibular symptoms. Each item is scored on a 0-3 Likert scale (0=never, 3=most of the time) with a score ranging from 0-33 with higher scores indicating greater symptom severity [13]. DHI-PC is a parent/caregiver reported questionnaire that was designed to assess disability in children in the 5-12 year age group, whereas the DHI-CA was designed for children between 6-14 years of age [14,15]. DHI-PC contains twenty-one items and the DHI-CA twenty five items. Each item on both the measures is scored on a three-point Likert scale (0=no, 2=sometimes, 4=always) with a total score ranging from 0-84 (DHI-PC) and 0-100 (DHI-CA) with higher scores indicating higher perceived disability [14,15]. Content from these existing measures was evaluated to identify some potential items to be included on the PDI.
Additionally, a comprehensive pool of items related to activities and participation was further developed by the team following an exhaustive review of the International Classification of Functioning, disability, and health: Children and Youth version (ICF-CY) model [16]. The ICF-CY was created to facilitate an understanding of how a child’s environment may influence their development and well-being [11]. The items were written in child-friendly language and kept at 3rd grade reading level [17]. As recommended by previous research, the items of the PDI were positively phrased to make the measure appropriate for children [18]. Each item on the PDI was scored on a 0-10 numeric rating scale (0=not difficult at all, 10=extremely difficult) with higher scores indicating higher perceived disability.
Linkage to the International Classification of Functioning, disability, and health: Children and Youth version (ICF-CY). To provide a comprehensive assessment regarding multiple facets of dizziness that impact function, the items on the PDI were constructed based on the ICF-CY model. The functioning and disability section of the ICF-CY model includes body functions and structures and activities and participation along with contextual factors (environmental and personal factors) [16]. ICF-CY classification is organized based on hierarchy and inter-relatedness of levels. Two research team members linked each item from the PDI to the ICF-CY categories.
Expert consultation
A measure has content validity if “it covers all parts of the universe of content and reflects the importance of each part” [19]. A modified Delphi process was used for content validation. Modified Delphi process is a technique to obtain the most reliable consensus from a group of experts [20]. The recommended number of experts for content validation should be a minimum of six and not more than ten [21]. Hence, eight experts in physical therapy were recruited via email to participate in the modified Delphi process [19]. The expert panel comprised of clinicians and researchers with more than 5 years of work experience who had content, clinical, or research expertise in pediatrics and/or vestibular rehabilitation. The experts participated in two rounds of modified Delphi process [22,23]. A detailed explanation of the different items on the list and instructions on how to score the items was provided to assist the experts in their rating. Experts were asked to independently rate each item as “essential”, “useful but not essential” or “not essential” as recommended previously by Lawshe [24]. The experts were requested to provide a rationale for their responses. The experts had three weeks to complete the first round and a reminder email was sent after two weeks. All responses were documented for the next step of content validation. The same procedure was followed for the second round of review.
Content validation
Two research team members completed all analysis. To determine content validity, the Content Validity Ratio (CVR) was calculated using Lawshe’s formula CVR = (ne–N/2)/N/2 where “ne” is the number of experts identifying an item as “essential” whereas N is the total number of experts [23,25]. CVR values range from -1 to +1. A CVR value above zero indicated that over half of the experts agreed the item was “essential”. Lawshe and Schipper’s table of difficult values was used to determine the critical value of CVR (CVR critical) to eliminate chance agreement between experts. Items were retained in their original form if the CVR values were above the CVR critical (Table 1) [24]. Based on the number of experts involved in the modified Delphi process (N=8), the CVR critical was set at 0.75 for item retention [24]. Once all rounds of review were complete, the Content Validity Index (CVI) was calculated to obtain a numeric value of the content validity of the measure [23,25]. The CVI was calculated as the mean of the overall CVRs for all the items included in the final measure. A CVI value of >0.8 was considered an indicator of good content validity [23].
Item number | ICF-CY category | Item details | Content Validity Ratio (CVR) |
---|---|---|---|
1 | Activity | Can do activities normally in a day | 1 |
2 | Body function | Can focus on all classroom activities without feeling dizzy | 0.75 |
3 | Activity | Can stand/sit still comfortably | 1 |
4 | Activity | Can get in and out of bed without feeling dizzy. | 0.75 |
5 | Activity | Can stand up and sit down from a chair or couch without feeling dizzy. | 1 |
6 | Activity | Can ride a bike/scooter without feeling dizzy | 0.75 |
7 | Participation | Can play with friends in gym class or an outdoor game of the choice (hopscotch, soccer, baseball, hockey etc.) without feeling dizzy. | 1 |
8 | Activity, environmental | Can use technology (TV, tablet, phone etc.) for as long as I like without feeling dizzy | 0.75 |
9 | Body structure, activity | Can look up/down/turn my head without getting dizzy. | 0.75 |
10 | Activity | Can walk up and down the stairs without getting dizzy | 1 |
Note: CVR critical value recommended by Lawshe based on the number of experts=0.75. PDI=Pediatric Dizziness Index |
Table 1. Content validity ratio values for individual items of the PDI after two rounds of modified Delphi process.
Cognitive interviewing
Approval from the institutional review board of the Simmons University was obtained (approval number #IRB 22-59). Children and adolescents aged 8-16 years’ old who speak English as a primary language and currently experiencing dizziness or with a history of dizziness were recruited via a flyer posted to the researchers’ social media accounts. After obtaining written consent from the parents and assent from the children, cognitive testing of the PDI was performed via purposive sampling. Parents were given the opportunity to stay with the child during the cognitive interview process. Cognitive interviewing is a form of qualitative interviewing used to obtain insights about a respondent’s thought process as they read or hear an item, and as they respond to a question [26]. The purpose of cognitive interviewing and testing is to explore whether children understand the questions consistently in the way intended by the researchers. Cognitive interviewing was completed by two members of the research team using 1:1 interviews on zoom with children currently experiencing or with a history of dizziness. Recruitment was discontinued once saturation was attained. To control for bias (peer-pressure in a group setting), 1:1 interviews chosen instead of focus group interviews [11]. Additionally, it is difficult for the younger children to stay attentive to the questions in a focus group. All participants received a $15 gift card for participating.
Characteristics of children (N=6) who participated in the cognitive interviews are reported in Table 2. Three out of six participants reported of experiencing dizziness within the last 12 months, one participant was experiencing dizziness currently, and two participants reported of having dizziness more than a year ago. Three participants were interviewed in the first round of cognitive interviews. A copy of the PDI was provided to participants for review prior to the interview. During the interview, a research team member read each item of the PDI to the participant. The participant also had the written copy of PDI available for their reference if needed. The participant was then asked to think out loud and describe their thought process that they utilized to interpret the item and formulate a response [27]. Participants’ input were sought to add/modify items in the PDI. Responses were audio recorded using a digital audio recorder, transcribed, and identified by a research team member.
Participant number | Age | Gender | History of dizziness |
---|---|---|---|
1 | 16 | M | Experienced dizziness more than a year ago |
2 | 10 | M | Experienced dizziness 10-12 months prior to interview |
3 | 15 | M | Currently experiencing dizziness |
4 | 10 | M | Experience dizziness 7-8 months prior to interview |
5 | 11 | M | Experienced dizziness 10-12 months prior to interview |
6 | 8 | F | Experienced dizziness more than a year ago |
Table 2. Characteristics of children who participated in cognitive interviews.
After the first round of cognitive interviews, researchers reviewed the transcripts and agreed on the items that required modification. After revising the PDI based on results from the first round, three additional participants were interviewed in the second round. After fourth and fifth, minor modifications were made to three items (Table 3). Interviews were stopped after the sixth interview as data saturation point was reached, and no further modifications were recommended [28]. Cognitive interviews revealed that the survey items demonstrated face validity and were unambiguous and easy to understand for children.
Item number | Item details | Revised item after first round of cognitive interviews | Revised item after second round of cognitive interviews |
---|---|---|---|
1 | Can do activities in normally days when feeling dizzy | Can still do activities normally in a day when feeling dizzy. | - |
2 | Can still focus even though feeling dizzy | Can still focus on things such as classroom activities even when feeling dizzy. | Can focus on all classroom activities without feeling dizzy |
3 | Can stand up and sit down and move around in bed without feeling dizzy | Can get in and out of bed without feeling dizzy. | - |
4 | Can use technology when feeling dizzy | Can use technology (TV, tablet, smartphone) when feeling dizzy. | Can use technology (TV, tablet, phone etc.) for as long as like without feeling dizzy |
5 | Looking up makes feel more dizzy. | Can look up/down/turn head without getting dizzy. | - |
6 | Can play when feel dizzy | Can play with my friends in gym class or an outdoor game of my choice (hopscotch, soccer, baseball, hockey etc.) without feeling dizzy. | - |
7 | While sitting or standing feel like falling because of dizziness. | Can stand up and sit down from a chair or couch without feeling dizzy | - |
8 | Can drive (riding a bike, riding a scooter) when feeling dizzy | Can ride a bike/scooter without feeling dizzy | - |
9 | Feel more dizzy when bend forward | Can look up/down/turn my head without getting dizzy. | - |
10 | Can able to keep body balanced while standing with eyes closed | Can stand/sit still comfortably | - |
Table 3. Item revision of Pediatric Dizziness Inventory (PDI) after two rounds of cognitive interviews.
Results
Initial draft of the PDI comprised of thirty-three potential items (Appendix 1) Following two rounds of modified Delphi process and CVR calculation, ten items were retained. After the first round of the modified Delphi process, items with CVR <0.75 but >0.5 were modified and the items with CVR <0.5 were removed. After the first round, twelve items were eliminated, and ten items were merged/modified resulting in 21 items underwent a second round of review. After completion of the second round, nine items were eliminated, and two items were merged with the other items of similar construct and PDI was revised to 10 items (Table 3). All ten items demonstrated CVI values equal to or higher than CVR critical (Table 1). The CVI of the items retained in the measure was calculated and was found to be 0.87 that indicated excellent content validity (CVI values >0.7 are considered acceptable) [23,29]. Minor changes to the final items were made following cognitive interviews to improve readability.
Discussion
Dizziness has significant impact on child’s ability to participate in age-appropriate activities and impedes social and community participation [4,7]. Its multifactorial nature and the wide variations in children’s contextual and perceptual processes underscores the need for a comprehensive patientreported assessment linking the symptoms to activities. Studies have reported that children older than 8 years of age can reliably use PROMs [30]. The current study aimed to develop and establish evidence of face and content validity of the PDI utilizing a systematic, evidence-based, and iterative approach. To our knowledge, this is the first PROM designed using robust methodology and incorporating the ICF-CY to evaluate the impact of dizziness on activity limitation and participation restriction in children.
Face and content validity
Establishing content validity of a PROM is the first critical step and must be performed using rigorous methods prior to establishing other measurement properties [31]. Our study utilized a systematic and scientifically rigorous approach towards development of the PDI. The ICF-CY is a universally accepted theoretical framework and has been used extensively for content mapping of numerous PROM [16,32,33]. COSMIN guidelines were followed while developing and establishing the content validity (Appendix 2) along with a literature reviewof existing PROM assessing dizziness in children [12].
Additionally, every item on the PDI was refined to ensure child-friendly language and comprehensibility using cognitive interview.
Advantages of the PDI
PDI offers several advantages over existing measures that assess dizziness in children. Of the two self-report measures (PVSQ and DHI-CA), PVSQ primarily focuses on symptom severity specific to vestibular function [13] unlike PDI. On the other hand, the DHI-CA demonstrated questionable validity due to concerns around valid factor structure, item difficulty levels, and construct validity which limits its clinical applicability [34,35].
DHI-PC is a parent reported measure and uses parents or caregivers as proxy to assess activity limitations due to dizziness [14]. It is noteworthy that the proxy measures may have response bias (over or underestimation) due to parent’s/ caregiver’s unique perception, beliefs and attitudes about the child’s impairments/activity limitation/participation restriction [36]. Additionally, both DHI-CA and DHI-PC include items that fall under the emotional and psychological domains [14,15]. There can be several other factors contributing to emotional and psychological issues apart from dizziness. Since these factors may not be addressed directly by physical therapy intervention, there is a potential for floor effect.
In terms of scoring an item on a PROM, children find it challenging to quantify subjective response categories like “most of the time”, “sometimes”, “often” etc., [37] (as seen in DHI-CA and DHI-PC) which may compromise the validity of responses obtained. In contrast, the numeric rating scale (0-10) has been documented to be valid, reliable, and easy to use for children [38]. Additionally, a response category of “don’t know” (as seen in PVSQ) may reduce a child’s ability to provide a valid response [39]. The “don’t know” category may also be excluded as missing data during interpretation and analysis, and may result in misrepresentation of the data [40,41]. In terms of scoring categories, both DHI-PC and DHICA are scored using 3-point scale (4=yes, 2=sometimes and 0=No) which may limit quantification (as “sometimes” category may range anywhere between 1%-99%) and progress tracking leading to a potential ceiling effect [42-44].
Limitations and future directions
PDI is a novel measure for the clinicians to assess activity limitation and participation restriction in children and adolescents. It is important to note that PDI must be tested in different diagnosis and population subsets to further consolidate generalizability. Additionally, cognitive interviewing was limited to children who spoke English as their primary language and had unequal gender distribution (predominantly males) which may limit generalizability. Hence, cross cultural adaptation is recommended to broaden the application of the PDI. Lastly, future research on examining item-difficulty using robust statistical approaches like item-response theory is recommended to establish factor structure, internal consistency, test-retest reliability, construct and criterion validity and, responsiveness.
Conclusion
PDI is a novel PROM that may fulfil a critical gap in assessment of activity limitation and participation restriction associated with dizziness in children. PDI will provide clinicians with meaningful information to identify specific functional limitations create individualized therapeutic goals and focused intervention strategies. Finally, to provide family centered care, it is important for the clinician to set goals in collaboration with the child and the family. For this purpose, creating goals that are valued by the child and are considered meaningful is critical to obtain improvements in function. In contrast to PVSQ and DHI-PC, item 7 of the PDI provides an opportunity to children to identify their activity of choice.
Declarations
Ethics approval and consent to participate: Approval from the Institutional Review Board of the Simmons University was obtained (approval number #IRB 22-59). Written informed consent from the parents and written assent was obtained from children before collecting data.
Consent for Publication
Not applicable
Availability of Data and Materials
Not Applicable
Competing Interests
The authors report no competing interests or any conflict of interest.
Funding
No funding was obtained for this study.
Authors' Contributions
DT was responsible for the conceptualization, conducting cognitive interviews, development of the measure, manuscript writing and overall supervision of this project. BG, CS, MA and BS significantly contributed to conception, creation and refining of the PDI items, literature review and manuscript writing. MK significantly contributed to manuscript writing and refining of the PDI.
Acknowledgements
We would like to acknowledge all the experts and children who participated in this study.
References
- Kenneth Walker H, Dallas Hall W, Willis Hurst J. Clinical methods: The history, physical, and laboratory examinations. (3rd edn) Boston: Butterworths Copyright 1990, Butterworth Publishers, a division of Reed Publishing. 1990.
- Brodsky JR, Lipson S, Bhattacharyya N. Prevalence of pediatric dizziness and imbalance in the United States. Otolaryngol Head Neck Surg 2020;162(2):241-7.
- Li CM, Hoffman HJ, Ward BK, Cohen HS, Rine RM. Epidemiology of dizziness and balance problems in children in the United States: A population-based study. J Pediatr 2016;171:240-7.e1-3.
- Yang CC, Tu YK, Hua MS, Huang SJ. The association between the post-concussion symptoms and clinical outcomes for patients with mild traumatic brain injury. J Trauma 2007;62(3):657-63.
- Deissler A, Albers L, von Kries R, Weinberger R, Langhagen T, et al. Health-related quality of life of children/adolescents with vertigo: Retrospective study from the german center of vertigo and balance disorders. Neuropediatrics 2017;48(2):91-7.
- Bigelow RT, Semenov YR, Hoffman HJ, Agrawal Y. Association between vertigo, cognitive and psychiatric conditions in US children: 2012 National Health Interview Survey. Int J Pediatr Otorhinolaryngol 2020; 130:109802.
- Herdman SJ, Clandaniel R. Vestibular rehabilitation Philadelphia: FA Davis. Curr Opin Neurol 2014;26(1):96-101.
- O'Rourke D. The measurement of pain in infants, children, and adolescents: From policy to practice. Phys Ther 2004;84(6):560-70.
- Bele S, Chugh A, Mohamed B, Teela L, Haverman L, et al. Patient-reported outcome measures in routine pediatric clinical care: A systematic review. Front Pediatr 2020; 28:8:364.
- De Leeuw ED. Improving data quality when surveying children and adolescents: Cognitive and social development and its. 2011.
- Arbuckle R, Abetz-Webb L. "Not just little adults": Qualitative methods to support the development of pediatric patient-reported outcomes. Patient 2013;6(3):143-59.
- Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: A clarification of its content. BMC Med Res Methodol 2010;10(1):22.
- Pavlou M, Whitney S, Alkathiry AA, Huett M, Luxon LM, et al. The pediatric vestibular symptom questionnaire: A validation study. J Pediatr 2016;168:171-7.e1.
- McCaslin DL, Jacobson GP, Lambert W, English LN, Kemph AJ. The Development Of The Vanderbilt Pediatric Dizziness Handicap Inventory For Patient Caregivers (DHI-PC). Int J Pediatr Otorhinolaryngol 2015;79(10):1662-6.
- Canto SMdG, Orlanda C, Nery DA, Cristina G, Leandro A, et al. Brazilian adaptation of the dizziness handicap inventory for the pediatric population: Reliability of the results. Audiol Commun Res 2015;20(4):327-35.
- Organization WH. International classification of functioning, disability and health: Children and youth version: ICF-CY. World Health Organization. 2007.
- Conners C. Conners CBRS Conners comprehensive behavior rating scales. Multi-Health Systems Inc. North Tonawanda, NY. 2008.
- Borgers N, de Leeuw E, Hox J. Children as respondents in survey research: Cognitive development and response quality. BMS. 2000; 66(1):60-75.
- Portney LG. Foundations of clinical research: Applications to evidence-based practice. (4th edn). Philadelphia. 2020.
- Okoli C, Pawlowski SD. The Delphi method as a research tool: An example, design considerations and applications. Inf Manag 2004;42(1):15-29.
- Yusoff MSB. ABC of content validation and content validity index calculation. Educ Med J 2019;11(2):49-54.
- Zemina CL, Warren M, Yuen HK. Revised Self-Report Assessment of Functional Visual Performance (R-SRAFVP)-PartI: Content validation. Am J Occup Ther 2018;72(5):7205205010p1-7.
- Gilbert GE, Prion S. Making sense of methods and measurement: Lawshe's content validity index. Clin Simul Nurs 2016;12(12):530-1.
- Lawshe CH. A quantitative approach to content validity. Personnel psychology. 1975;28(4):563-75.
- Ayre C, Scally AJ. Critical values for lawshe's content validity ratio: Revisiting the original methods of calculation. Meas Eval Couns Dev 2014;47(1):79-86.
- Willis GB. Cognitive interviewing: A tool for improving questionnaire design. Sage Publications. 2004.
- Ikart E. Questionnaire pretesting methods: A Comparison of cognitive interviewing and respondent debriefing vis-à-vis the study of the adoption of decision support systems by knowledge workers. Int J Busines Inform 2018;13:119.
- Scott K, Ummer O, LeFevre AE. The devil is in the detail: Reflections on the value and application of cognitive interviewing to strengthen quantitative surveys in global health. Health Policy Planning 2021;36(6):982-95.
- Tilden VP, Nelson CA, May BA. Use of qualitative methods to enhance content validity. Nur Res 1990;39(3):172-5.
- Riley AW. Evidence that school-age children can self-report on their health. Ambulatory Pediatrics 2004;4(4):371-6.
- Meadows KA. Patient-reported outcome measures: An overview. Br J Community Nurs 2011;16(3):146-51.
- Tiwari D, Clock C, Gore S, Alsalaheen B. Content comparison of neck pain outcome measures using the international classification of functioning, disability and health. Int J Rehabil Res 2022;45(1):24-32.
- Tucker CA, Escorpizo R, Cieza A, Lai JS, Stucki G, et al. Mapping the content of the Patient-Reported Outcomes Measurement Information System (PROMIS®) using the international classification of functioning, health and disability. Qual Life Res 2014;23(9):2431-8.
- Tiwari D, Gochyyev P. Does the Dizziness Handicap Inventory-Children and Adolescents (DHI-CA) demonstrate properties to support clinical application in the post-concussion population: A Rasch analysis. Children (Basel, Switzerland). 2023;10(9).1428.
- Tiwari D, Yorke A, Goldberg A, Marchetti GF, Alsalaheen B. Measurement properties of the dizziness handicap inventory-children and adolescents for children and adolescents postconcussion. Pediatr Phys Ther 2020;32(4):382-8.
- Bennetts SK, Mensah FK, Westrupp EM, Hackworth NJ, Reilly S. The agreement between parent-reported and directly measured child language and parenting behaviors. Front Psychol 2016;7:1710.
- Vreeman RC, Nyandiko WM, Ayaya SO, Walumbe EG, Inui TS. Cognitive interviewing for cross-cultural adaptation of pediatric antiretroviral therapy adherence measurement items. Int J Behav Med 2014;21(1):186-96.
- Castarlenas E, Jensen MP, von Baeyer CL, Miró J. Psychometric properties of the numerical rating scale to assess self-reported pain intensity in children and adolescents: A systematic review. Clin J Pain 2017;33(4):376-83.
- Krosnick JA, Holbrook AL, Berent MK, Carson RT, Michael Hanemann W, et al. The impact of "no opinion" response options on data quality: Non-attitude reduction or an invitation to satisfice?. Public Opin Q 2002;66(3):371-403.
- Hay JL, Orom H, Kiviniemi MT, Waters EA. "I don't know" my cancer risk: Exploring deficits in cancer knowledge and information-seeking skills to explain an often-overlooked participant response. Medl Deci Making 2015;35(4):436-45.
- Bruine de Bruin W, Fischbeck PS, Stiber NA, Fischhoff B. What number is "fifty-fifty"?: Redistributing excessive 50% responses in elicited probabilities. Risk analysis: An official publication of the society for risk analysis. 2002;22(4):713-23.
- Pritchard-Wiart L, Thompson-Hodgetts S, McKillop AB, Rosychuk R, Mrklas K, et al. A multi-center, pragmatic, effectiveness-implementation (hybrid I) cluster randomized controlled trial to evaluate a child-oriented goal-setting approach in paediatric rehabilitation (the ENGAGE approach): A study protocol. BMC pediatrics 2022;22(1):375.
- Locke EA, Latham GP. New directions in goal-setting theory. Curr Dir Psychol Sci 2006;15(5):265-8.
- King GA, McDougall J, Palisano RJ, Gritzan J, Tucker MA. Goal attainment scaling. Phys Occup Ther Pediatr 2000;19(2):31-52.