Abstract
Purpose
Examine the construct validity, stability, internal consistency, and item–response performance of a self-report health needs assessment for adult survivors of childhood cancer.
Methods
A 190-item mailed survey was completed by 1,178 randomly selected (stratified on age, diagnosis, time since diagnosis) Childhood Cancer Survivor Study participants (mean age, 39.66 [SD 7.71] years; time since diagnosis, 31.60 [SD 4.71] years). Minorities and rural residents were oversampled at a 2:1 ratio.
Results
The final instrument included 135 items comprising nine unidimensional subscales (Psycho-emotional, Health System Concerns, Cancer-Related Health Information, General Health, Survivor Care and Support, Surveillance, Coping, Fiscal Concerns, and Relationships). Confirmatory factor analysis (n = 1,178; RMSEA = 0.020; 90 % CI = 0.019–0.020; CFI = 0.956; TLI = 0.955) and person–item fit variable maps established construct validity. Across subscales, Cronbach’s alpha was 0.94–0.97, and the 4-week test–retest correlations were 0.52–0.91. In a Rasch analysis, item reliability was 0.97–0.99, person reliability was 0.80–0.90, and separation index scores were 2.00–3.01. Significant subscale covariates of higher need levels included demographics, diagnosis, and treatment exposures.
Conclusions
The Childhood Cancer Survivor Study Needs Assessment Questionnaire (CCSS-NAQ) is reliable and construct-valid, has strong item–response properties, and discriminates need levels.
Implications for Cancer Survivors
The CCSS-NAQ potentially can be used to: (1) directly assess adult childhood cancer survivors’ self-reported health-related needs, (2) identify individuals or subgroups with higher-level needs, (3) inform prevention and direct intervention strategies, and (4) facilitate prioritization of health-care resource allocation.
Similar content being viewed by others
References
Hewitt M, Weiner SL, Simone JV. Childhood Cancer Survivorship: improving care and quality of life. Washington: National Academies Press; 2003.
Ries LAG, Melbert D, Krapcho M, Mariotto A, Miller BA, Feuer EJ, et al. SEER cancer statistics review 1975–2004; based on November 2006 SEER data submission, posted to the SEER Web site. 2007. Bethesda, MD: National Cancer Institute; 2007. http://seer.cancer.gov/csr/1975_2004/. Accessed 24 Sept 2012.
Mertens AC, Liu Q, Neglia JP, Wasilewski K, Leisenring W, Armstrong GT, et al. Cause-specific late mortality among 5-year survivors of childhood cancer: the Childhood Cancer Survivor Study. J Natl Cancer Inst. 2008;100:1368–79.
Oeffinger KC, Mertens AC, Sklar CA, Kawashima T, Hudson MM, Meadows AT, et al. Chronic health conditions in adult survivors of childhood cancer. N Engl J Med. 2006;355:1572–82.
Hewitt M, Greenfield S, Stovall E. Committee on Cancer Survivorship: improving care and quality of life: Institute of Medicine and National Research Council. Washington: National Academies Press; 2005. p. 187–321.
Rowland JH, Bellizzi KM. Cancer survivors and survivorship research: a reflection on today’s successes and tomorrow’s challenges. Hematol Oncol Clin North Am. 2008;22:181–200. v.
National Audit Office. Tackling Cancer: improving the patient journey. London: The Stationary Office; 2005.
National Cancer Alliance. Patient-centred cancer services? What patients say. Oxford: NCA; 1996.
Earle EA, Davies H, Greenfield D, Ross R, Eiser C. Follow-up care for childhood cancer survivors: a focus group analysis. Eur J Cancer. 2005;41:2882–6.
Nagel K, Eves M, Waterhouse L, Alyman C, Posgate S, Jamieson J, et al. The development of an off-therapy needs questionnaire and protocol for survivors of childhood cancer. J Pediatr Oncol Nurs. 2002;9:229–33.
Trask CL, Welch JJ, Manley P, Jelalian E, Schwartz CL. Parental needs for information related to neurocognitive late effects from pediatric cancer and its treatment. Pediatr Blood Cancer. 2009;52:273–9.
Arvidson J, Söderhäll S, Eksborg S, Björk O, Krueger A. Medical follow-up visits in adults 5–25 years after treatment for childhood acute leukaemia, lymphoma or Wilms’ tumor. Acta Paediatr. 2006;95:922–8.
Hovén E, Lannering B, Gustafsson G, Boman KK. The met and unmet health care needs of adult survivors of childhood central nervous system tumors. Cancer. 2011;117:4294–303.
Galloway S, Graydon J, Harrison D, Evans-Boyden B, Palmer-Wickham S, Burlein-Hall S, et al. Informational needs of women with a recent diagnosis of breast cancer: development and initial testing of a tool. J Adv Nurs. 1997;25:1175–83.
Graydon J, Galloway S, Palmer-Wickham S, Harrison D, Rich-van der Bij L, West P, et al. Information needs of women during early treatment for breast cancer. J Adv Nurs. 1997;26:59–64.
Gray RE, Fitch M, Greenberg M, Hampson A, Doherty M, Labrecque M. The information needs of well, longer-term survivors of breast cancer. Patient Educ Couns. 1998;33:245–55.
Ganz PA, Rofessart J, Polinsky ML, Schag CC, Heinrich RL. A comprehensive approach to the assessment of cancer patients’ rehabilitation needs: the Cancer Inventory of Problem Situations and a companion interview. J Psychosoc Oncol. 1986;4:27–42.
Ganz PA, Schag CC, Polinsky ML, Heinrich RL, Flack VF. Rehabilitation needs and breast cancer: the first month after primary therapy. Breast Cancer Res Treat. 1987;10:243–53.
Meyerowitz BE, Heinrich RL, Schag CC. A competency-based approach to coping with cancer. In: Burish TG, Bradley L, editors. Coping with chronic disease: research and applications. New York: New York Academic Press; 1983. p. 137–58.
Schag CC, Heinrich RL, Ganz PA. Cancer Inventory of Problem Situations: an instrument for assessing cancer patients’ rehabilitation needs. J Psychosoc Oncol. 1983;1:11–24.
Pearce NJ, Sanson-Fisher R, Campbell HS. Measuring quality of life in cancer survivors: a methodological review of existing scales. Psychooncology. 2008;17:629–40.
Girgis A, Boyes A, Sanson-Fisher RW, Burrows S. Perceived needs of women diagnosed with breast cancer: rural versus urban location. Aust N Z J Public Health. 2000;24:166–73.
Coyle N, Goldstein ML, Passik S, Fishman B, Portenoy R. Development and validation of a patient needs assessment tool (PNAT) for oncology clinicians. Cancer Nurs. 1996;19:81–92.
Mesters I, van den Borne B, De Boer M, Pruyn J. Measuring information needs among cancer patients. Patient Educ Couns. 2001;43:253–62.
Derdiarian AK. Informational needs of recently diagnosed cancer patients. Nurs Res. 1986;35:276–81.
Denger LF, Davison BJ, Sloan JA, Mueller B. Development of a scale to measure information needs in cancer care. J Nurs Meas. 1998;6:137–53.
Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. 3rd ed. Oxford: Oxford University Press; 2003.
Fitzpatrick R, Davey C, Buxton MJ, Jones DR. Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998;2:1–74.
Kirsch I, Jungeblut A, Jenkins L, Kolstad A. Adult literacy in America: a first look at the findings of the Adult Literacy Survey. 3rd ed. Washington: US Department of Education; 2002.
Childhood Cancer Survivor Study. St. Jude Children’s Research Hospital. http://ccss.stjude.org/documents/questionnaires Accessed 24 Sept 2012.
Robison LL, Mertens AC, Boice JD, Breslow NE, Donaldson SS, Green DM, et al. Study design and cohort characteristics of the Childhood Cancer Survivor Study: a multi-institutional collaborative project. Med Pediatr Oncol. 2002;38:229–39.
Robison LL, Armstrong GT, Boice JD, Chow EJ, Davies SM, Donaldson SS, et al. The Childhood Cancer Survivor Study: a National Cancer Institute-supported resource for outcome and intervention research. J Clin Oncol. 2009;27:2308–18.
Greenlee RT, Murray T, Bolden S, Wingo PA. Cancer statistics, 2000. CA Cancer J Clin. 2000;50:7–33.
Retinoblastoma follow-up study. U.S. National Institutes of Health. http://rbstudy.cancer.gov/faqs.html. Accessed 24 Sept 2012.
Hatcher L. A step by step approach to using the SAS system for factor analysis and structural equation modeling. Cary: SAS Institute; 1994.
Hulin CL, Lissak RI, Drasgow F. Recovery of two- and three-parameter logistic item characteristic curves: a Monte Carlo Study. Appl Psychol Meas. 1982;6:249–60.
Chernesky RH, Gutheil IA. Rethinking needs assessment in planning services for older adults. J Gerontol Soc Work. 2008;51:109–25.
Centers for Disease Control and Prevention. 2004 National Health Interview Survey (NHIS): Public use data release, U.S. Department of Health and Human Services. Division of Health Interview Statistics, National Center for Health Statistics. Hyattsville, MD: 2005. Available from URL: http://www.cdc.gov/nchs/data/nhis/srvydesc.pdf. Accessed 9 July 2012.
Rasch G. Probabilistic models for some intelligence and attainment tests. Copenhagen: Danmarks Paedogogiske Institut; 1960.
Bond TG, Fox CM. Applying the Rasch model: fundamental measurement in the human sciences. 2nd ed. New York: Routledge Publishing; 2007.
Hayes RD, Morales LS, Reise SP. Item response theory and health outcomes measurement in the 21st century. Med Care. 2000;38:1128–42.
Reeve BB, Fayers P. Applying item response theory modeling for evaluating questionnaire item and scale properties. In: Fayers P, Hays RD, editors. Assessing quality of life in clinical trials: methods of practice. 2nd ed. New York: Oxford University Press; 2005. p. 55–73.
Sharkness J, DeAngelo L. Measuring student involvement: a comparison of classical test theory and item response theory in the construction of scales from student surveys. Res High Educ. 2011;52:480–507.
Hu L, Bentler P. Cutoff criteria for fit indices in covariance structure analysis; conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.
Smith EV. Evidence for the reliability of measures and validity of measure interpretations: a Rasch model perspective. J Appl Meas. 2001;2:281–311.
Conrad KJ, Conrad KM, Dennis ML, et al. Validation of the Crime and Violence Scale (CVS) to the Rasch measurement model, GAIN Methods Report 1.2. Chicago: Chestnut Health Systems, 2011. Available from URL: http://www.chestnut.org/li/gain/psychometric_reports/Conrad_et_al_2011_CVS_Rasch_Report.pdf. Accessed 9 July 2012.
Conrad KJ, Riley BB, Conrad KM, Chan YF, Dennis ML. Validation of the crime and violence scale against the Rasch measurement model including difference by gender, race, and age. Eval Rev. 2010;34:83–115.
Smith EV. Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002;3:205–31.
Zinbarg R, Yovel I, Revelle W, McDonald R. Estimating generalizability to a universe of indicators that all have an attribute in common: a comparison of estimators for omega. Appl Psych Meas. 2006;30:121–44.
Cronbach LI, Shavelson RJ. My current thoughts on coefficient alpha and successor procedures. Educ Psycho Meas. 2004;64:391–418.
Fox CM, Jones JA. Uses of Rasch modeling in counseling psychology research. J Couns Psychol. 1998;45:30–45.
Helmstadter GC. Principles of psychological measurement. New York: Appleton-Century-Crofts; 1964.
Linacre JM. Data variance explained by measures. Rasch Meas Trans. 2006;20:1045.
Linacre JM. Investigating judge local independence. Rasch Meas Trans. 1997;11:546–7.
Linacre JM. More objections to the Rasch model. Rasch Meas Trans. 2010;24:1298–9.
Hudson MM, Mertens AC, Yutaka Y, Hobbie W, Chen H, Gurney JG, et al. Health status of adult long-term survivors of childhood cancer: a report from the Childhood Cancer Survivor Study. JAMA. 2003;290:1583–92.
Friedman DL, Whitton J, Leisenring W, Mertens AC, Hammond S, Stovall M, et al. Subsequent neoplasms in 5-year survivors of childhood cancer: the Childhood Cancer Survivor Study. JNCI. 2010;102:1083–95.
Norman GR, Sloan JA, Wyrich KW. Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care. 2003;41:582–92.
Conrad KJ, Dennis ML, Bezruckzo N, Funk RR, Riley BB. Substance use disorder symptoms: evidence of differential item functioning by age. J Appl Meas. 2007;8:373–87.
Harlan LC, Lynch CF, Keegan TH, Hamilton AS, Wu XC, Kato I, et al. Recruitment and follow-up of adolescent and young adult cancer survivors: the AYA HOPE Study. J Cancer Surv. 2011;5:305–14.
Cox CL, Hudson MM, Mertens A, Oeffinger K, Whitton J, Montgomery M, et al. Medical screening participation among childhood cancer survivors. Arch Intern Med. 2009;169:454–62.
Castellino SM, Geiger AM, Mertens AC, Leisenring WM, Tooze JA, Goodman P, et al. Morbidity and mortality in long-term survivors of Hodgkin lymphoma: a report from the Childhood Cancer Survivor Study. Blood. 2011;117:1806–16.
Porter SR. Raising response rates: what works? New directions for institutional research. Wiley Periodicals, Inc. 2004;5–21.doi:10.1002/ir.97.
Armstrong GT, Liu Q, Yasui Y, Huang S, Ness KK, Leisenring W, et al. Long-term outcomes among adult survivors of childhood central nervous system malignancies in the Childhood Cancer Survivor Study. J Natl Cancer Inst. 2009;101:946–58.
Nathan PC, Ness KK, Greenberg ML, Hudson MM, Wolden S, Davidoff A, et al. Health-related quality of life in adult survivors of childhood Wilms tumor or neuroblastoma: a report from the Childhood Cancer Survivor Study. Pediatr Blood Cancer. 2007;49:704–15.
Castellino SM, Casillas J, Hudson MM, Mertens AC, Whitton J, Brooks SL, et al. Minority adult survivors of childhood cancer: a comparison of long-term outcomes, health care utilization, and health-related behaviors from the Childhood Cancer Survivor Study. JCO. 2005;23:6499–507.
Armstrong GT, Stovall M, Robison LL. Long-term effects of radiation exposure among adult survivors of childhood cancer: results from the Childhood Cancer Survivor Study. Radiat Res. 2010;174:840–50.
Support
R21 CA142921 (CL Cox, PI), U24 CA55727 (LL Robison, PI), and CA21765 (RJ Gilbertson, PI) of the National Institutes of Health and the American Lebanese Syrian Associated Charities (ALSAC).
Conflict of interest
The authors declare that they have no conflicts of interest.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Cox, C.L., Sherrill-Mittleman, D.A., Riley, B.B. et al. Development of a comprehensive health-related needs assessment for adult survivors of childhood cancer. J Cancer Surviv 7, 1–19 (2013). https://doi.org/10.1007/s11764-012-0249-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11764-012-0249-3