Acessibilidade / Reportar erro

Test-retest reliability of the Health Literacy Questionnaire (HLQ-Br) in Brazilian carers of older people

INTRODUCTION

The rapid aging of the Brazilian population is seeing people living longer but with comorbidities more common in older people and higher dependence in activities of daily living. Due to these factors, support from formal and informal carers is needed more frequently. Many informal carers are family members who manage the health of the older person they are caring for, including accompanying them to medical appointments and advocating for them when they are hospitalized11. Brasil. Instituto Brasileiro de Geografia e Estatística (IBGE). Projeção da população do Brasil e das Unidades da Federação [cited on 2020 Sep 14]. Available from: https://www.ibge.gov.br/apps/populacao/projecao/.
https://www.ibge.gov.br/apps/populacao/p...
,22. Garcez-Leme LE, Leme MD. Costs of elderly health care in Brazil: challenges and strategies. Medical Express São Paulo, (online). 2014:1(1). https://doi.org/10.5935/MedicalExpress.2014.01.02
https://doi.org/10.5935/MedicalExpress.2...
. As such, carers of older people often have a key role in accessing, understanding and supporting the implementation of health-related recommendations for the older person they provide care for.

According to the U.S. Department of Health and Human Services, health literacy is defined as “the degree to which individuals can obtain, process, and understand basic health information needed to make appropriate health decisions”33. U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. National action plan to improve health literacy. 2010 [cited 2013 Feb 27]. Available from: https://health.gov/our-work/health-literacy/national-action-plan-improve-health-literacy.
https://health.gov/our-work/health-liter...
. Carers with low levels of health literacy may fail to implement the recommendations of health professionals, thus compromising care44. Australian Commission on Safety and Quality in Health Care. National Statement on Health Literacy. Canberra, ACT: ACSQHC; 2014. Available from: https://www.safetyandquality.gov.au/sites/default/files/migrated/Health-Literacy-National-Statement.pdf.
https://www.safetyandquality.gov.au/site...
. Data on health literacy in Brazilian carers of older people is scarce. In a previous study on health literacy in carers of older people in Brazil, one-third of the carers of older patients assessed in an outpatient clinic had low health literacy55. Almeida KMV, Toye C, Silveira LVA, Slatyer S, Hill K, Jacinto AF. Assessment of functional health literacy in Brazilian carers of older people. Dement Neuropsychol. 2019;13(2):180-6. https://doi.org/10.1590/1980-57642018dn13-020006
https://doi.org/10.1590/1980-57642018dn1...
.

The Health Literacy Questionnaire (HLQ) is an Australian developed instrument used to assess health literacy66. Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health. 2013;13:658. https://doi.org/10.1186/1471-2458-13-658
https://doi.org/10.1186/1471-2458-13-658...
. The HLQ assesses nine independent health literacy domains to evaluate the experiences of people related to understanding and using health information66. Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health. 2013;13:658. https://doi.org/10.1186/1471-2458-13-658
https://doi.org/10.1186/1471-2458-13-658...
. It has been translated and validated in Brazil77. Moraes KL, Brasil VV, Mialhe FL, Sampaio HAC, Sousa ALL, Canhestro MR, et al. Validation of the Health Literacy Questionnaire (HLQ) to brazilian portuguese. Acta Paul Enferm. 2021;34:eAPE02171. https://doi.org/10.37689/acta-ape/2021AO02171
https://doi.org/10.37689/acta-ape/2021AO...
and is internationally recognized for its clinical applicability. However, the retest reliability of the Brazilian version (HLQ-Br) has not been tested. This study aimed to determine the reliability of the HLQ-Br with a sample of Brazilian carers of older people.

METHODS

This was a test-re-test reliability study.

From May to December 2019, carers of older people who were discharged from inpatient wards at a university hospital were invited to participate. Inclusion criteria were to be 18+ years and be an informal family carer (as described above) of an older person aged 60+ years discharged from an inpatient ward of the participating hospital. A sociodemographic questionnaire was also applied during the baseline assessment.

The COSMIN guidelines88. Prinsen CAC, Mokkink LB, Bouter LM, Alonso J, Patrick DL, de Vet HCW, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147-57. https://doi.org/10.1007/s11136-018-1798-3
https://doi.org/10.1007/s11136-018-1798-...
recommend a minimum sample of 50 completed data sets to provide accurate estimates of measurement stability over time. Therefore, we aimed to recruit 50 carers for this study.

The HLQ-Br77. Moraes KL, Brasil VV, Mialhe FL, Sampaio HAC, Sousa ALL, Canhestro MR, et al. Validation of the Health Literacy Questionnaire (HLQ) to brazilian portuguese. Acta Paul Enferm. 2021;34:eAPE02171. https://doi.org/10.37689/acta-ape/2021AO02171
https://doi.org/10.37689/acta-ape/2021AO...
was administered face-to-face at baseline (pre-discharge from the hospital of the older person) and approximately two weeks later, at time point 2, the HLQ-Br was applied by telephone. The HLQ-Br77. Moraes KL, Brasil VV, Mialhe FL, Sampaio HAC, Sousa ALL, Canhestro MR, et al. Validation of the Health Literacy Questionnaire (HLQ) to brazilian portuguese. Acta Paul Enferm. 2021;34:eAPE02171. https://doi.org/10.37689/acta-ape/2021AO02171
https://doi.org/10.37689/acta-ape/2021AO...
is a 44-item tool comprising nine domains structured as Likert scales. The first five domains use a 4-point scale to assess participants’ agreement with a series of statements (responses range from “strongly disagree” to “agree”). The other four domains require participants to self-report the ease with which they feel they can complete certain health literacy-related tasks (responses range from “cannot do or always difficult” to “always easy”. All HLQ scales (Australian original version), confirmed by factor analysis, have good internal consistency reliability (Cronbach's alpha ranging from 0.80-0.89)66. Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health. 2013;13:658. https://doi.org/10.1186/1471-2458-13-658
https://doi.org/10.1186/1471-2458-13-658...
. A recent reliability study by our team investigating retest reliability of the HLQ among carers of older people being discharged from hospitals in Australia identified moderate to high levels of retest reliability99. Burton E, Toye C, Slatyer S, Jacinto AF, du Preez J, Bronson M, Hill KD. Testing the reliability of the Health Literacy Questionnaire with carers of older adults receiving hospital care. Australas J Aging. 2021;40(2):213-7. https://doi.org/10.1111/ajag.12897
https://doi.org/10.1111/ajag.12897...
.

The study was approved by the Ethics Committee of the institution where the study was conducted (blinded for review), and all informal carers signed a Term of Consent.

Analyses were undertaken using SPSS v25. The categorical variables were expressed as crude and relative values and associations of these variables among groups were determined using the Chi-Square test. Continuous variables were expressed as means and standard deviations (for normal distribution) and compared through Student's t-test. The nine HLQ-Br scale totals were analyzed separately, given that an overall total score for the instrument is not recommended by the authors66. Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health. 2013;13:658. https://doi.org/10.1186/1471-2458-13-658
https://doi.org/10.1186/1471-2458-13-658...
. Correlations were evaluated between baseline and time point 2 scores of the HLQ-Br scales using the intraclass correlation coefficient (ICC) (two-way mixed effects, absolute agreement, 95% confidence interval (95%CI)). ICC ratings were classified as poor <0.5; 0.5–0.74 moderate; 0.75–0.9 good and values greater than 0.9 excellent1010. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155-63. https://doi.org/10.1016/j.jcm.2016.02.012
https://doi.org/10.1016/j.jcm.2016.02.01...
.

RESULTS

Fifty-one carers completed the initial assessment session, with a mean age of 52.5 (±14.0) years and 41 (80.4%) were female. Almost two-thirds (62.7%) of the carers gave care daily and 54.9% lived with the person they cared for, as presented in Table 1.

Table 1
Sociodemographic data of the carers and of the older people being cared.

The mean time for HLQ-Br administration was 11 (±3.7) minutes. The mean time between assessments was 20.8 (±13.3) days.

Only 35 participants completed the second test occasion. The most common reasons for not returning for the retest occasion were “not answering the phone after several trials” (10 (62.5%)) and “refused to participate” (6 (37.5%)). There were no significant differences between those who did and those who did not complete the second assessment except for “frequency of care” (p=0.03), in which those completing the second assessment required higher levels of care. Details of the demographics of the 35 participants who did complete the retest occasion are also shown in Table 1.

Table 2 shows the mean scores for each scale and the reliability data (ICC, 95%CI). The results indicate that the reliability estimates of the HLQ-Br (ICC, n=35) were good (that is, ranging from 0.79 to 0.89) for seven of the nine HLQ-Br scales. On the subscale, “actively managing my health”, the reliability was excellent [0.925 (95%CI 0.846–0.963)]. For the remaining scale, “navigate the healthcare system”, reliability was moderate [0.725 (95%CI 0.452–0.861)].

Table 2
Retest reliability of nine Health Literacy Questionnaire in Brazilian scales.

DISCUSSION

There has been an increase in health literacy research in Brazil over the past few years1111. Moraes KL. Health literacy: a long journey to brazilian health practices. Health Lit Res Pract. 2018;2(3):e161-e162. https://doi.org/10.3928/24748307-20180807-01
https://doi.org/10.3928/24748307-2018080...
. The World Health Organization classifies health literacy as one of the major health promotion factors for achieving or maintaining good health, which makes the topic extremely important in terms of public health1212. United Nations Economic and Social Council. ECOSOC Annual Ministerial Review. Regional preparatory meeting on promoting health literacy. Beijing, China, 29-30 April 2009 [Internet]. Available from: https://www.un.org/en/ecosoc/newfunct/pdf/chinameetinghealthliteracybackgroundpaperv2.pdf.
https://www.un.org/en/ecosoc/newfunct/pd...
. Brazilian health literacy studies have been conducted with participants in the following disease areas — cardiology, infectious and oral diseases1313. Tenani CF, De Checchi MHR, Bado FMR, Ju X, Jamieson L, Mialhe FL. Influence of oral health literacy on dissatisfaction with oral health among older people. Gerodontology. 2020;37(1):46-52. https://doi.org/10.1111/ger.12443
https://doi.org/10.1111/ger.12443...
1717. Firmino RT, Granville-Garcia AF, McGrath CP, Bendo CB, Ferreira FM, Paiva SM. Validation for brazilian portuguese language of the Hong Kong oral health literacy assessment task for paediatric dentistry (BOHLAT-P). Int J Paediatr Dent. 2020;30(2):234-43. https://doi.org/10.1111/ipd.12585
https://doi.org/10.1111/ipd.12585...
. Previously, two Brazilian studies55. Almeida KMV, Toye C, Silveira LVA, Slatyer S, Hill K, Jacinto AF. Assessment of functional health literacy in Brazilian carers of older people. Dement Neuropsychol. 2019;13(2):180-6. https://doi.org/10.1590/1980-57642018dn13-020006
https://doi.org/10.1590/1980-57642018dn1...
,1818. Queiroz JPC, Machado ALG, Vieira NFC. Health literacy for caregivers of elders with Alzheimer's disease. Rev Bras Enferm. 2020;73(Suppl 3):e20190608. https://doi.org/10.1590/0034-7167-2019-0608
https://doi.org/10.1590/0034-7167-2019-0...
undertook health literacy research in carers of older people, however, neither of them used the Health Literacy Questionnaire66. Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health. 2013;13:658. https://doi.org/10.1186/1471-2458-13-658
https://doi.org/10.1186/1471-2458-13-658...
. Instead they preferred using the S-TOFHLA55. Almeida KMV, Toye C, Silveira LVA, Slatyer S, Hill K, Jacinto AF. Assessment of functional health literacy in Brazilian carers of older people. Dement Neuropsychol. 2019;13(2):180-6. https://doi.org/10.1590/1980-57642018dn13-020006
https://doi.org/10.1590/1980-57642018dn1...
and the Canadian instrument called Health Literacy1818. Queiroz JPC, Machado ALG, Vieira NFC. Health literacy for caregivers of elders with Alzheimer's disease. Rev Bras Enferm. 2020;73(Suppl 3):e20190608. https://doi.org/10.1590/0034-7167-2019-0608
https://doi.org/10.1590/0034-7167-2019-0...
.

Australian and Brazilian researchers recently conducted a systematic review1919. Slatyer S, Toye C, Burton E, Jacinto AF, Hill KD. Measurement properties of self-report instruments to assess health literacy in older adults: a systematic review. Disabil Rehabil. 2020;1-17. https://doi.org/10.1080/09638288.2020.1836044
https://doi.org/10.1080/09638288.2020.18...
to identify studies on the psychometric properties of self-report health literacy assessment instruments, focussing on studies of older people or caregivers of older people. This systematic review reported that the Health Literacy Questionnaire66. Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health. 2013;13:658. https://doi.org/10.1186/1471-2458-13-658
https://doi.org/10.1186/1471-2458-13-658...
was the best self-report health literacy tool across the various psychometric properties.

The validation study77. Moraes KL, Brasil VV, Mialhe FL, Sampaio HAC, Sousa ALL, Canhestro MR, et al. Validation of the Health Literacy Questionnaire (HLQ) to brazilian portuguese. Acta Paul Enferm. 2021;34:eAPE02171. https://doi.org/10.37689/acta-ape/2021AO02171
https://doi.org/10.37689/acta-ape/2021AO...
of the Health Literacy Questionnaire in Brazil did not involve older people or caregivers of older people, therefore, testing the reliability of this instrument for this population is important. We found that reliability was good or excellent in most of the nine scales of the instrument, making it a reliable instrument to be used for assisting carers of older people, especially at the time of hospital discharge of the person being cared for.

Limitations of the present study included that the study sample was smaller than the desired sample, because of 31.3% dropouts for the second assessment. However, the final sample of thirty-five did not differ from the participants who did not return for the reassessment, except on one item (frequency of care), in which those completing the second assessment required higher levels of care. In addition, the sample was recruited from inpatient clinics at a single university hospital, and so may not be representative of carers of older people associated with other hospitals, or other recruitment avenues.

CONCLUSIONS

The Brazilian version of the Health Literacy Questionnaire is a reliable tool to assess health literacy in carers of older people.

  • Funding: Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP).

ACKNOWLEDGMENT

We thank all the carers of older people who accepted to participate in the study.

REFERENCES

  • 1
    Brasil. Instituto Brasileiro de Geografia e Estatística (IBGE). Projeção da população do Brasil e das Unidades da Federação [cited on 2020 Sep 14]. Available from: https://www.ibge.gov.br/apps/populacao/projecao/
    » https://www.ibge.gov.br/apps/populacao/projecao/
  • 2
    Garcez-Leme LE, Leme MD. Costs of elderly health care in Brazil: challenges and strategies. Medical Express São Paulo, (online). 2014:1(1). https://doi.org/10.5935/MedicalExpress.2014.01.02
    » https://doi.org/10.5935/MedicalExpress.2014.01.02
  • 3
    U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. National action plan to improve health literacy. 2010 [cited 2013 Feb 27]. Available from: https://health.gov/our-work/health-literacy/national-action-plan-improve-health-literacy
    » https://health.gov/our-work/health-literacy/national-action-plan-improve-health-literacy
  • 4
    Australian Commission on Safety and Quality in Health Care. National Statement on Health Literacy. Canberra, ACT: ACSQHC; 2014. Available from: https://www.safetyandquality.gov.au/sites/default/files/migrated/Health-Literacy-National-Statement.pdf
    » https://www.safetyandquality.gov.au/sites/default/files/migrated/Health-Literacy-National-Statement.pdf
  • 5
    Almeida KMV, Toye C, Silveira LVA, Slatyer S, Hill K, Jacinto AF. Assessment of functional health literacy in Brazilian carers of older people. Dement Neuropsychol. 2019;13(2):180-6. https://doi.org/10.1590/1980-57642018dn13-020006
    » https://doi.org/10.1590/1980-57642018dn13-020006
  • 6
    Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health. 2013;13:658. https://doi.org/10.1186/1471-2458-13-658
    » https://doi.org/10.1186/1471-2458-13-658
  • 7
    Moraes KL, Brasil VV, Mialhe FL, Sampaio HAC, Sousa ALL, Canhestro MR, et al. Validation of the Health Literacy Questionnaire (HLQ) to brazilian portuguese. Acta Paul Enferm. 2021;34:eAPE02171. https://doi.org/10.37689/acta-ape/2021AO02171
    » https://doi.org/10.37689/acta-ape/2021AO02171
  • 8
    Prinsen CAC, Mokkink LB, Bouter LM, Alonso J, Patrick DL, de Vet HCW, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147-57. https://doi.org/10.1007/s11136-018-1798-3
    » https://doi.org/10.1007/s11136-018-1798-3
  • 9
    Burton E, Toye C, Slatyer S, Jacinto AF, du Preez J, Bronson M, Hill KD. Testing the reliability of the Health Literacy Questionnaire with carers of older adults receiving hospital care. Australas J Aging. 2021;40(2):213-7. https://doi.org/10.1111/ajag.12897
    » https://doi.org/10.1111/ajag.12897
  • 10
    Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155-63. https://doi.org/10.1016/j.jcm.2016.02.012
    » https://doi.org/10.1016/j.jcm.2016.02.012
  • 11
    Moraes KL. Health literacy: a long journey to brazilian health practices. Health Lit Res Pract. 2018;2(3):e161-e162. https://doi.org/10.3928/24748307-20180807-01
    » https://doi.org/10.3928/24748307-20180807-01
  • 12
    United Nations Economic and Social Council. ECOSOC Annual Ministerial Review. Regional preparatory meeting on promoting health literacy. Beijing, China, 29-30 April 2009 [Internet]. Available from: https://www.un.org/en/ecosoc/newfunct/pdf/chinameetinghealthliteracybackgroundpaperv2.pdf
    » https://www.un.org/en/ecosoc/newfunct/pdf/chinameetinghealthliteracybackgroundpaperv2.pdf
  • 13
    Tenani CF, De Checchi MHR, Bado FMR, Ju X, Jamieson L, Mialhe FL. Influence of oral health literacy on dissatisfaction with oral health among older people. Gerodontology. 2020;37(1):46-52. https://doi.org/10.1111/ger.12443
    » https://doi.org/10.1111/ger.12443
  • 14
    Costa VRS, Costa PDR, Nakano EY, Apolinário D, Santana ANC. Functional health literacy in hypertensive elders at primary health care. Rev Bras Enferm. 2019;72(suppl 2):266-73. https://doi.org/10.1590/0034-7167-2018-0897
    » https://doi.org/10.1590/0034-7167-2018-0897
  • 15
    Cunha GH, Galvão MTG, Pinheiro PNC, Vieira NFC. Health literacy for people living with HIV/Aids: an integrative review. Rev Bras Enferm. 2017;70(1):180-8. https://doi.org/10.1590/0034-7167-2015-0052
    » https://doi.org/10.1590/0034-7167-2015-0052
  • 16
    Cruvinel AFP, Méndez DAC, Chaves GC, Gutierres E, Lotto M, Oliveira TM, et al. The brazilian validation of a health literacy instrument: the newest vital sign. Acta Odontol Scand. 2018;76(8):587-94. https://doi.org/10.1080/00016357.2018.1484511
    » https://doi.org/10.1080/00016357.2018.1484511
  • 17
    Firmino RT, Granville-Garcia AF, McGrath CP, Bendo CB, Ferreira FM, Paiva SM. Validation for brazilian portuguese language of the Hong Kong oral health literacy assessment task for paediatric dentistry (BOHLAT-P). Int J Paediatr Dent. 2020;30(2):234-43. https://doi.org/10.1111/ipd.12585
    » https://doi.org/10.1111/ipd.12585
  • 18
    Queiroz JPC, Machado ALG, Vieira NFC. Health literacy for caregivers of elders with Alzheimer's disease. Rev Bras Enferm. 2020;73(Suppl 3):e20190608. https://doi.org/10.1590/0034-7167-2019-0608
    » https://doi.org/10.1590/0034-7167-2019-0608
  • 19
    Slatyer S, Toye C, Burton E, Jacinto AF, Hill KD. Measurement properties of self-report instruments to assess health literacy in older adults: a systematic review. Disabil Rehabil. 2020;1-17. https://doi.org/10.1080/09638288.2020.1836044
    » https://doi.org/10.1080/09638288.2020.1836044

Publication Dates

  • Publication in this collection
    06 Sept 2021
  • Date of issue
    Apr 2021

History

  • Received
    14 Dec 2020
  • Accepted
    16 Jan 2021
Associação Médica Brasileira R. São Carlos do Pinhal, 324, 01333-903 São Paulo SP - Brazil, Tel: +55 11 3178-6800, Fax: +55 11 3178-6816 - São Paulo - SP - Brazil
E-mail: ramb@amb.org.br