Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Competencies of health personnel for the practice of health literacy in Brazil: A Delphi consensus survey

  • Flaviane Cristina Rocha Cesar ,

    Contributed equally to this work with: Flaviane Cristina Rocha Cesar, Lizete Malagoni de Almeida Cavalcante Oliveira

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    flaviane_rocha01@hotmail.com

    Affiliations Faculdade de Medicina, Centro Universitário de Mineiros–UNIFIMES, Trindade, Goiás, Brazil, Faculdade de Enfermagem, Centro Universitário UNIFASAM, Goiânia, Goiás, Brazil

  • Thassara Felipe de Sousa ,

    Roles Conceptualization, Formal analysis, Visualization, Writing – original draft, Writing – review & editing

    ‡ TFS, AGA, KLM and MAB also contributed equally to this work.

    Affiliation Faculdade de Medicina, Centro Universitário de Mineiros–UNIFIMES, Trindade, Goiás, Brazil

  • Angela Gilda Alves ,

    Roles Conceptualization, Validation, Visualization, Writing – original draft, Writing – review & editing

    ‡ TFS, AGA, KLM and MAB also contributed equally to this work.

    Affiliation Faculdade de Enfermagem, Centro Universitário UNIFASAM, Goiânia, Goiás, Brazil

  • Katarinne Lima Moraes ,

    Roles Validation, Visualization, Writing – original draft, Writing – review & editing

    ‡ TFS, AGA, KLM and MAB also contributed equally to this work.

    Affiliation Faculdade de Ceilândia, Universidade de Brasília, Brasília, Distrito Federal, Brazil

  • Maria Alves Barbosa ,

    Roles Visualization, Writing – original draft, Writing – review & editing

    ‡ TFS, AGA, KLM and MAB also contributed equally to this work.

    Affiliation Faculdade de Enfermagem, Universidade Federal de Goiás, Goiânia, Goiás, Brazil

  • Lizete Malagoni de Almeida Cavalcante Oliveira

    Contributed equally to this work with: Flaviane Cristina Rocha Cesar, Lizete Malagoni de Almeida Cavalcante Oliveira

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Supervision, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Faculdade de Enfermagem, Universidade Federal de Goiás, Goiânia, Goiás, Brazil

Abstract

Objective

The aim of this study was to identify a set of competencies of health personnel for the practice of health literacy in Brazil.

Methods

Scoping review and online interviews with healthcare practitioners, followed by three rounds of the modified e-Delphi method with health literacy specialists from November/2020 to March/2021. During the rounds, the items were revised, new items added for review, and their importance was rated on a five-point Likert scale in an online form. Those items that achieved a mean Likert rating of 4+ (rated important to very important) and ≥ 90.0% agreement among the experts were maintained in each round.

Results

The initial competencies list contained 30 items from the literature scoping review and online interview with 46 Brazilian healthcare practitioners. 25 experts (health personnel with publications on health literacy) were invited to participate in the e-Delphi rounds. Of the total of 56 items evaluated, 28 reached consensus among the experts. The Brazilian competencies list differed from other consensuses by the emphasis on professional commitment to the literacy in health, autonomy and social context of the patient.

Conclusion

For the Brazilian context, 28 competencies are relevant to the practice of health literacy in health care. This study is an initial step to develop the HL competences of Brazilian health professionals and an update of the skills evidenced in previous international studies.

Introduction

Health literacy (HL) is defined as competences to access, understand, evaluate and use health information and services in order to make decisions for health promotion [1]. HL is more than a mental phenomenon or a set of skills, it must be understood as a set of social practices inserted in a given context [2].

Satisfying the needs of health service users is a challenge for healthcare personnel (HCP), considering the high prevalence of inadequate HL in the population of different countries. Studies suggest that 50.0 to 90.0% of the European, North American and Asian population have insufficient HL [35]. In Brazil, studies with specific populations, such as those with chronic diseases and the elderly, estimate that 45.4% to 66.0% of the population have inadequate HL [69].

Inadequate HL has important implications for well-being and has been associated with increased risk of death [10], non-adherence to medication [11], poor quality of life [12], less control of chronic diseases [13] and increased hospital readmission [14]. Therefore, the HCP need to assume as a universal principle the addition of health care models that incorporate the HL as a public health issue and quality of care.

Professional training for HL has been associated with the development of knowledge, skills and attitudes that enhance the effective response of professionals to the needs of patients with low HL [15]. Thus, professional competence is a starting point for literate health teams.

The first consensus on professional competences in HL was proposed by Coleman, Hudson and Maine [16]. The authors used a literature review and a panel of North American experts to establish a set of competencies in HL for HCP. Subsequent studies showed that most of these listed competencies could be applicable in European countries [17], Chinese [18] or in specific professions, such as nursing [19]. However, the removal and addition of items that occurred in these studies made clear the need to reapply and adapt the skills proposed by the original instrument to other places and cultures.

The establishment of consensus on HL competencies is supported by the new roles expected for HCP as health promoters in clinical settings, as professionals and researchers, according to the Shanghai Declaration on Health Promotion [20]. This declaration focuses on promoting HL, linking the capacity of individuals and communities, as well as the capacity of professionals and health systems to respond to this demand. In addition, the theme is aligned with the need for research in communication and health information provided for in the Agenda of Research Priorities in Brazil [21].

Currently, consensus on HCP competencies in HL is restricted to the European continent [17], North American [16] and Asia [18]. The lack of a model of competence in HL for Latin American countries like Brazil is a barrier to the construction of curricula for the formation of HCP and for the permanent education of professionals in HL. Therefore, this study aimed to identify a set of competencies of HCP for the practice of HL in Brazil.

Methods

We use a modified e-Delphi study [22] composed of two stages: 1) development of a preliminary list of HL competencies through literature review [23] and online interviews with health professionals; 2) establishment of consensus through three evaluation rounds with HL experts. All competences developed in the study were written in Portuguese and only at the time of publication of the manuscript did we translate it into American English. We had co-authors with English (KLM) and Spanish (MAB) language experience during this process.

A scoping review of domains of professional competencies in HL

The first stage of the study was a scoping review of the literature that was published in May 2022 [23]. We searched Medline (PubMed), CINAHL (EBSCO), PsycInfo, ERIC (ProQuest), Lilacs (BVS), and EMBASE (Elsevier) for original studies and documents in April 2020. We combined the descriptors “Health literacy” AND (Competence OR “Health Personnel”) and similar ones in each database. Articles published in English, Spanish and Portuguese were included, regardless of the year of publication. The selected publications should address the topic of health literacy among health professionals in the care or academic environment, including: knowledge: studies that evaluated or described predominantly cognitive aspects of HCP on HL; Skills: studies that evaluated or described actions of HCP considering the patient’s HL, in clinical practice or mental activities that stimulate critical thinking; Attitudes: studies that evaluated or described preferences, values and attitudes of HCP in relation to patients’ HL.

Interviews with healthcare professionals

The results of the scoping review were used to guide the content analysis of the interviews. We identified several competencies in health literacy through the scoping review. These were semantically approximated and repeated competencies were excluded. Thus, the items identified in the literature served to confirm competences with the specialists in national health literacy, allowing for additions.

We considered experts in health literacy to be professionals who had at least six months of experience in a care activity that involved carrying out educational activities with the patient. This time of experience in care can be considered minimal to allow the opportunity to experience HL practices, as shown by the result of a previous study [24].

The experts in health literacy were identified through e-mail accessed in health services, educational institutions and scientific publications on health literacy. Snowball sampling was used to identify other eligible participants by requesting the e-mail indication of reference professionals in patient health education in the survey form.

The process of recruiting participants and conducting the interviews continued until the inclusion of professionals from different categories and regions of the country was verified, and new categories did not enter the data set. The interviews were carried out from March to July 2020.

Individual online interviews lasting 15 to 40 minutes were conducted with 46 health professionals who worked in health services in Brazil. All interviews were conducted by the first author. All study authors have experience in qualitative research and health literacy and contributed to the interpretation of data.

Operationalization of modified e-Delphi method rounds

The competencies identified in the literature review and interviews constituted the previous list that was submitted to the consensus of Brazilian specialists in HL.

Specialists in HL were identified considering the criterion of authorship in books or peer-review articles, this strategy has been used in studies with the Delphi method, indicating mastery of the topic [25].

The identification of participants for this committee of experts was carried out through a search with the term “Health Literacy” and a filter for the region of Brazil, in the last five years, in PubMed, Web of Science and LILACS. The search identified significant authors from different regions of the country, totaling 83 researchers from different professional categories in the health area publishing on HL in the Brazilian context.

All identified HL specialist researchers were invited to participate in the research (n = 83). Subsequently, the specialists who returned the invitation e-mail were submitted to the following inclusion criteria: having a degree in the health area; have experience in direct patient, family or community care, have at least one HL publication in the last five years. Exclusion criteria were being in function deviation; being away from work activities for more than five years; have exercised only administrative function in the health area. The characteristics of the specialists are described in Table 1.

thumbnail
Table 1. Characterization of health literacy specialists (n = 25).

Brazil, 2021.

https://doi.org/10.1371/journal.pone.0271361.t001

The modified e-Delphi method consisted of three rounds of data collection by e-mail, each of which had varied duration, round 1 from 24.11.20 to 07.01.21; round 2 from 16.01.21 to 09.02.21 and round 3 from 15.02.21 to 10.03.21, making a period of 100 days between the months of November 2020 and March 2021. During Delphi, the number of participants varied in round 1 = 25, 100.0%; round 2 = 16, 64.0% and round 3 = 12, 48.0%.

In each round, the experts were invited to evaluate the importance of each question using a five-point Likert scale, ranging from 1 (not important) to 5 (very important), according to a previous study [18].

The experts received feedback and a summary of the results of each round, and their modified individual items were color-coded to avoid misunderstandings while reading in the second and third rounds.

In statements for which consensus was not reached, feedback and comments from participants were used to adjust the statement for the next round. It has been suggested that experts fill out the form preferably within 15 days and reminders of the activity were sent every five days by email.

In round 3, the data were reorganized, giving rise to consensus on skills in HL for Brazilian health professionals.

Data analysis

The transcripts of the interviews with HCP were submitted to thematic content analysis proposed by Bardin [26] with the help of Atlas Ti software. This framework allowed the identification of the corpus of analysis, through the recording units (excerpts from the participants’ speeches). The registration units were approximated by similarity, resulting in initial categories in Atlas Ti. Subsequently, thematic grouping was performed, resulting in intermediate categories or subthemes. These sub-themes originated the themes, they were approximated and resulted in the final categories, presented here as competences.

Data from the e-Delphi rounds were analyzed using the statistical software Statistical Package for the Social Sciences (SPSS) version 20. Initially, a descriptive analysis of the sociodemographic variables and the list of competencies was performed using percentage [27].

Items suggested by participants in rounds 1 and 2 of the modified e-Delphi method were included in the Brazilian version if they reached ≥ 90% agreement among participants [7]. There is no consensus on the standard for the level of agreement between authors in the e-Delphi methodology, with a variation of 51.0% - 80.0% in the literature [6]. The cut-off point of 90.0% allowed: increasing the sensitivity of the participants’ choice, reducing the risk of entering redundant items and increasing the possibility of including items that are really relevant and feasible to be applied to reality.

Items excluded for not reaching 90.0% were checked and approximated by their semantic similarity in order to confirm whether they would have their correspondents represented in the final list. Thus, it was possible to ensure that the 90.0% cut-off point did not exclude relevant items.

The Brazilian consensus was compared by the authors to the three previous consensuses, American, European and Chinese, through the evaluation of the INESC-ID@ASSIN system to identify semantic similarity on a Likert scale divided into: 1. Completely different, on different subjects; 2. Not related, but more or less on the same subject; 3. Something related. They may describe different facts, but share some details; 4. Strongly related, but some details are different; 5. Essentially the same thing [28].

Ethics statement

The project was approved by the Research Ethics Committee of the Federal University of Goiás (CAEE registration number: 17226919.10000.5083). The right of refusal free of damages and the confidentiality of the identity of all participants were guaranteed.

Results

Nurses (n = 16) and physicians (n = 13) constituted the majority of respondents, 58.0% (n = 17) of the participants had a time greater than or equal to 10 years of experience in patient care and health literacy had already been heard by 41.3% (n = 19) or studied during the master’s or doctorate by 8.6% (n = 4) of the participants (Table 1).

Eighteen professional competences were identified for SL practice based on the synthesis of the content of 34 articles. The categorization of the content of the interviews showed 12 professional competencies in health literacy.

The initial competency list contained 30 items distributed in knowledge (5 items), skills (16 items) and attitudes (9 items), resulting from the literature review and interviews. In the first round, 22 items were added and in the second round, three items were added. However, of the total of 56 items evaluated, only 28 reached consensus among experts. Only items that achieved evaluation (3- important; 4- very important or 5- extremely important) in ≥ 90.0% of the evaluations in round 1 and/or 2 were evaluated in the third round (Table 2).

thumbnail
Table 2. Consensus of competencies of health personnel for the practice of health literacy in Brazil (n = 12).

Brazil, 2021.

https://doi.org/10.1371/journal.pone.0271361.t002

The experts attached great importance to the practical knowledge of the HL, encompassing its impact and low HL signals. The skills assessed by experts as important mainly included the aspect of adequacy of language and materials, learning verification and reinforcement strategies. In the context of attitudes, the experts chose items related to the expression of sense or conscience in HL, selecting items with terms of co-responsibility, sensitivity, empathy, respect and commitment. The assessment of the need for social support, the educative attitude and attitudes that make patients co-responsible in the educational process were differentiators of our study in relation to other lists of HCP competences in HL (Table 2).

Discussion

Most of the participants in our study being nurses is consistent with surveys on the composition of health teams in the world, in which 59.0% of the workforce is composed of nurses [52]. In addition, studies suggest that nurses are leaders in building a health-literate society [53]. Thus, the expertise of this professional group brings to the analysis of the study an essential theoretical-practical component, without disregarding the multidisciplinary approach made possible by the inclusion of HL specialists from other professional categories.

The higher frequency of participants with a doctorate observed in our study may be associated with the fact that the HL is still timidly part of the national curricula [54]. It is likely that HCP have a greater chance of coming into contact with the concept of HL in the context of postgraduate studies. This hypothesis can be supported by a review that evidenced the expressive Brazilian scientific production in the master’s and doctorate [55].

The assessment of the need for social support, the educative attitude and attitudes that make patients co-responsible in the educational process were differentials of our study in relation to other lists of HCP competences in HL. Previous studies have suggested that HL theoretical knowledge is an important competency, including concepts, definitions and guidelines [16, 17, 24]. Em contraponto, o conhecimento teórico do HL não foi priorizado pelos nossos especialistas refletindo uma proposta prática para os itens de competência.

The skills related to adaptations in HL practices present in the current study reflect phenomena such as globalization, migratory movements and social disparities. These result in idiomatic, cultural and social determinants challenges in the practice of HL. Recent studies have highlighted the relationship of HL in predicting health disparities among immigrants at the national level [56] and the mediating role of HL in the established social inequalities [57].

The ability to assess HL through instruments was excluded, probably because it is not very applicable to reality, despite being recommended in the literature [18], it may require a time of attention not available by professionals [33]. In addition, current instruments may have complex application or may not address cultural and clinical issues relevant to different care contexts. For example, most instruments are not available in Brazilian Portuguese, they make an indirect assessment through health behaviors and are limited to functional aspects of the HL [58].

In this sense, universal precaution presupposes that health information is offered in a simple way and that health services are organized and accessible to their users, regardless of the HL level of individuals [32, 59]. Our experts, in line with this perspective, have understood that assessment skills are less important than the application or use of HL-based strategies.

In the context of attitudes, items related to empathy, responsibility, respect and commitment reached consensus. Understanding these items as important is associated with the emotional and relational characteristic of the attitude domain [60]. According to Perrenoud [60], this domain of competences is characterized by values and principles, following a subjective perspective and intrinsically linked with knowledge and action.

Our study differed from the other consensuses by developing a list that provides a transversal approach to professional competence in HL, with a view to proposing minimum components for the formation of HCP from graduation to professional training. In addition, the social context, favoring patient autonomy and professional commitment were points that our study identified and that had not been evidenced in other studies on HL competencies [1618].

Although the Delphi method is recognized for allowing consensus, some limitations of this study need to be considered in our results. The limitations of the study included the intentional sampling and the greater number of nurses, doctors and civil servants that may restrict the application of competences in scenarios with different professional profiles. Although the scoping literature review and heterogeneous sampling may have allowed for a large number of items.

Conclusions

The Brazilian consensus resulted in 28 items distributed in knowledge, skills and attitudes for the practice of HL by HCP. Although the consensus has been established to the practice of HL in Brazil, the items included in the Brazilian version may reveal important aspects for HCP in other countries, such as the assessment of the patient’s social context and share responsibility for the educational process with patients (Table 2).

This study is an initial step to develop the HL competences of Brazilian health professionals and an update of the skills evidenced in previous international studies [16, 18].

References

  1. 1. Sorensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, et al. Health literacy and public health: a systematic review and integration of definitions and models. BMC public health [Internet]. 2012 18 maio 2021 [cited 2020 Jun 10]; 12(1):[1–13 pp.]. Available from: pmid:22276600
  2. 2. Pinheiro P. Conceptualizations of health literacy: past developments, current trends, and possible ways forward toward social practice. Health Lit Res Pract [Internet]. 2021 [cited 2021 Jul 21]; 5(2):[e91-e5 pp.]. Available from: https://doi.org/10.3928/24748307-20210316-01.
  3. 3. Sorensen K, Pelikan JM, Röthlin F, Ganahl K, Slonska Z, Doyle G, et al. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Public Health [Internet]. 2015 18 Maio 2019 [cited 2020 jun 10]; 25(6):[1053–8 pp.]. Available from:
  4. 4. Rajah R, Hassali MAA, Murugiah MK. A systematic review of the prevalence of limited health literacy in Southeast Asian countries. Public health [Internet]. 2018 18 Maio 2019 [cited 2020 jun 10]; 167(1):[8–15 pp.]. Available from: pmid:30544041
  5. 5. Kutner M, Greenburg E, Jin Y, Paulsen C. The health literacy of America’s adults: results from the 2003 national assessment of adult literacy. Washington,: National Center for Education Statistics; 2006 [cited 2020 jun 10]. Available from: https://nces.ed.gov/pubs2006/2006483.pdf.
  6. 6. Maragno CAD, Mengue SS, Moraes CG, Rebelo MVD, Guimarães AMM, Pizzol TSD. Teste de letramento em saúde em português para adultos. Rev Bras Epidemiol [Internet]. 2019 18 Maio 2019 [cited 2020 jun 10]; 22(1):[1–12 pp.]. Available from: http://dx.doi.org/10.1590/1980-549720190025
  7. 7. Apolinario D, Braga RCOP, Magaldi RM, Busse AL, Campora F, Brucki S, et al. Short assessment of health literacy for portuguese-speaking adults. Rev Saúde Públ [Internet]. 2012 18 jun 2020 [cited 2020 jun 10]; 46(4):[702–11 pp.]. Available from: pmid:22782124
  8. 8. Carthery-Goulart MT, Anghinah R, Areza-Fegyveres R, Bahia VS, Brucki SMD, Damin A, et al. Performance of a Brazilian population on the test of functional health literacy in adults. Rev Saúde Públ [Internet]. 2009 18 Maio 2019 [cited 2020 jun 10]; 43(4):[631–8 pp.]. Available from: pmid:19488667
  9. 9. Carvalho GS, Araújo MCP, Boff ETO, Tracana RB, Nunes LS. European health literacy scale (HLS-EU-BR) applied in a Brazilian higher education population of Rio Grande do Sul (RS). ESERA 2015 Conference; Maio; Helsinki, Finland: University of Helsinki; 2016. p. 1289–95.
  10. 10. Fan ZY, Yang Y, Zhang F. Association between health literacy and mortality: a systematic review and meta-analysis. Arch Public Health [Internet]. 2021 [cited 2021 Jul 21]; 79(1):[119 p.]. Available from: pmid:34210353
  11. 11. Suhail M, Saeed H, Saleem Z, Younas S, Hashmi FK, Rasool F, et al. Association of health literacy and medication adherence with health-related quality of life (HRQoL) in patients with ischemic heart disease. Health Qual Life Outcomes [Internet]. 2021 Apr 13 [cited 2021 Jul 21]; 19(1):[118 p.]. Available from: pmid:33849547
  12. 12. Zheng M, Jin H. The relationship between health literacy and quality of life: a systematic review and meta-analysis. Health Qual Life Out [Internet]. 2018 18 Maio 2019 [cited 2020 jun 10]; 16(1):[201 p.]. Available from: pmid:30326903
  13. 13. Saeed H, Saleem Z, Naeem R, Shahzadi I, Islam M. Impact of health literacy on diabetes outcomes: a cross-sectional study from Lahore, Pakistan. Public health [Internet]. 2018 18 Maio 2019 [cited 2020 jun 10]; 156(1):[8–14 pp.]. Available from: pmid:29353668
  14. 14. Morley CM, Levin SA. Health literacy, health confidence, and simulation: a novel approach to patient education to reduce readmissions. Prof Case Manag [Internet]. 2021 May-Jun 01 [cited 2021 Jul 21]; 26(3):[138–49 pp.]. Available from: https://www.ingentaconnect.com/content/wk/ncm/2021/00000026/00000003/art00005;jsessionid=1h0rnorog38le.x-ic-live-03.
  15. 15. Koberl S, Nielsen JB. Education of healthcare personal may reduce consequences of low health literacy. Ugeskrift for laeger [Internet]. 2018 Oct 1 [cited 2021 Jul 21]; 180(40):[1–10 pp.]. Available from: https://ugeskriftet.dk/videnskab/uddannelse-af-personalet-kan-mindske-konsekvenser-af-lav-sundhedskompetence. pmid:30274581
  16. 16. Coleman CA, Hudson S, Maine LL. Health literacy practices and educational competencies for health professionals: a consensus study. J Health Commun [Internet]. 2013 18 Maio 2019 [cited 2020 jun 10]; 18(Suppl 1):[82–102 pp.]. Available from: pmid:24093348
  17. 17. Karuranga S, Sørensen K, Coleman C, Mahmud AJ. Health literacy competencies for european health care personnel. Health Lit Res Pract [Internet]. 2017 18 Maio 2019 [cited 2020 jun 10]; 1(4):[e247-e56 pp.]. Available from: pmid:31294270
  18. 18. Chang LC, Chen YC, Wu FL, Liao LL. Exploring health literacy competencies towards patient education programme for Chinese-speaking healthcare professionals: a Delphi study. BMJ open [Internet]. 2017 18 Maio 2019 [cited 2020 jun 10]; 7(1):[e011772 p.]. Available from: pmid:28093428
  19. 19. Toronto CE. Health literacy competencies for registered nurses: an e-Delphi study. J Contin Educ Nurs [Internet]. 2016 18 Maio 2019 [cited 2020 jun 10]; 47(12):[558–65 pp.]. Available from: https://doi.org/10.3928/00220124-20161115-09.
  20. 20. Organização Mundial da Saúde. Shanghai declaration on health promotion. China: OMS; 2016 [cited 2020 jun 10]. Available from: https://www.who.int/healthpromotion/conferences/9gchp/shanghai-declaration.pdf?ua=1.
  21. 21. Ministério da Saúde. Agenda de Prioridades de Pesquisa do Ministério da Saúde—APPMS. Brasília: Ministério da Saúde; 2018 [cited 2021 jun 29]. Available from: https://bvsms.saude.gov.br/bvs/publicacoes/agenda_prioridades_pesquisa_ms.pdf.
  22. 22. Keeney S, Hasson F, McKenna HP. The Delphi technique in nursing and health research. United Kingdom: Wiley Online Library; 2011 [cited 2020 jun 10]. Available from: https://onlinelibrary.wiley.com/doi/book/10.1002/9781444392029.
  23. 23. Cesar FCR, Moraes KL, Brasil VV, Alves AG, Barbosa MA, Oliveira L. Professional Responsiveness to Health Literacy: A Scoping Review. Health literacy research and practice. 2022;6(2):e96–e103. Epub 20220506. pmid:35522856.
  24. 24. Chang LC, Chen YC, Liao LL, Wu FL, Hsieh PL, Chen HJ. Validation of the instrument of health literacy competencies for Chinese-speaking health professionals. PloS one [Internet]. 2017 [cited 2020 jun 10]; 12(3):[e0172859 p.]. Available from: pmid:28264036
  25. 25. Baker J, Lovell K, Harris N. How expert are the experts? An exploration of the concept of ’expert’ within Delphi panel techniques. Nurse Res [Internet]. 2006 18 Maio 2019 [cited 2020 jun 10]; 14(1):[59–70 pp.]. Available from: pmid:17100214
  26. 26. Bardin L. Análise de conteúdo. 3rd ed. São Paulo: Edições; 2016. 277 p.
  27. 27. Tolsgaard MG, Todsen T, Sorensen JL, Ringsted C, Lorentzen T, Ottesen B, et al. International multispecialty consensus on how to evaluate ultrasound competence: a delphi consensus survey. PloS one [Internet]. 2013 18 Maio 2019 [cited 2020 jun 10]; 8(2):[e57687 p.]. Available from: pmid:23469051
  28. 28. Fonseca ER, Santos LB, Criscuolo M, Aluísio SM. Visão geral da avaliação de similaridade semântica e inferência textual. Linguamática [Internet]. 2016 12/31 [cited 2021 sep 04]; 8(2):[3–13 pp.]. Available from: https://linguamatica.com/index.php/linguamatica/article/view/v8n2-1.
  29. 29. Galati C, Adams R, Graham K, Reynolds K, Zametin J. Health literacy and written communication in skilled nursing/subacute facilities. OTJR (Thorofare N J) [Internet]. 2018 [cited 2020 jun 10]; 38(2):[131–8 pp.]. Available from: pmid:28793846
  30. 30. Allenbaugh J, Corbelli J, Rack L, Rubio D, Spagnoletti C. A brief communication curriculum improves resident and nurse communication skills and patient satisfaction. J Gen Intern Med [Internet]. 2019 [cited 2020 jun 10]; 34(7):[1167–73 pp.]. Available from: pmid:30997637
  31. 31. Briggs AM, Jordan JE. The importance of health literacy in physiotherapy practice. Aust J Physiother [Internet]. 2010 [cited 2020 jun 10]; 56(3):[149–51 pp.]. Available from: pmid:20795920
  32. 32. Güner MD, Ekmekci PE. A survey study evaluating and comparing the health literacy knowledge and communication skills used by nurses and physicians. Inquiry: a journal of medical care organization, provision and financing [Internet]. 2019 [cited 2021 Jan 16]; 56(1):[1–10 pp.]. Available from: https://www.ncbi.nlm.nih.gov/pubmed/31342877. pmid:31342877
  33. 33. Quinn F, Smith SK, Dhillon HM, Gillham C, Craig A. What do radiation therapists know about health literacy and the strategies to improve it for patients? A qualitative study. Supportive Care Cancer [Internet]. 2019 18 Maio 2019 [cited 2020 jun 10]; 27(2):[649–57 pp.]. Available from: pmid:30051203
  34. 34. DeMarco J, Nystrom M. The importance of health literacy in patient education. J Consum Health Internet [Internet]. 2010 [cited 2020 jun 10]; 14(3):[294–301 pp.]. Available from: https://www.tandfonline.com/doi/abs/10.1080/15398285.2010.502021.
  35. 35. Allott ML, Sofra T, O’Donnell G, Hearne JL, Naccarella L. Building health literacy responsiveness in Melbourne’s west: a systems approach. Aust Health Rev [Internet]. 2018 Feb [cited 2020 jun 10]; 42(1):[31–5 pp.]. Available from: pmid:29061227
  36. 36. Bloom-Feshbach K, Casey D, Schulson L, Gliatto P, Giftos J, Karani R. Health literacy in transitions of care: an innovative objective structured clinical examination for fourth-year medical students in an internship preparation course. J Gen Intern Med [Internet]. 2016 Feb [cited 2020 jun 10]; 31(2):[242–6 pp.]. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4720643/pdf/11606_2015_Article_3513.pdf.
  37. 37. Mackert M, Ball J, Lopez N. Health literacy awareness training for healthcare workers: improving knowledge and intentions to use clear communication techniques. Patient Educ Couns [Internet]. 2011 [cited 2020 jun 10]; 85(3):[e225-e8 pp.]. Available from: pmid:21474264
  38. 38. Mnatzaganian C, Fricovsky E, Best BM, Singh RF. An interactive, multifaceted approach to enhancing pharmacy students’ health literacy knowledge and confidence. Am J Pharm Educ [Internet]. 2017 Mar 25 [cited 2020 jun 10]; 81(2):[32–42 pp.]. Available from: pmid:28381892
  39. 39. Niemi CA, Payne AM, Bates R. Development and implementation of a health education station by community health nursing students. Public Health Nurs [Internet]. 2018 [cited 2020 jun 10]; 35(6):[581–6 pp.]. Available from: pmid:29989205
  40. 40. Ogrodnick MM, Feinberg I, Tighe E, Czarnonycz CC, Zimmerman RD. Health-literacy training for first-year respiratory therapy students: a mixed-methods pilot study. Respir Care [Internet]. 2020 [cited 2021 Jul 19]; 65(1):[68–74 pp.]. Available from: pmid:31455683
  41. 41. Patel B. Communicating across cultures: proceedings of a workshop to assess health literacy and cross-cultural communication skills. J Pharm Pract Res [Internet]. 2015 [cited 2020 jun 10]; 45(1):[49–56 pp.]. Available from: https://doi.org/10.1002/jppr.1062.
  42. 42. Trujillo JM, Figler TA. Teaching and learning health literacy in a doctor of pharmacy program. Am J Pharm Educ [Internet]. 2015 Mar 25 [cited 2020 jun 10]; 79(2):[1–9 pp.]. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4386748/pdf/ajpe79227.pdf.
  43. 43. Coleman CA, Peterson-Perry S, Bumsted T. Long-term effects of a health literacy curriculum for medical students. Fam Med [Internet]. 2016 18 Maio 2019 [cited 2020 jun 10]; 48(1):[49–53 pp.]. Available from: https://doi.org/10.22454/PRiMER.2017.703541. pmid:26950666
  44. 44. Kripalani S, Jacobson KL, Brown S, Manning K, Rask KJ, Jacobson TA. Development and implementation of a health literacy training program for medical residents. Med Educ Online [Internet]. 2006 Dec [cited 2020 jun 10]; 11(1):[1–9 pp.]. Available from: https://www.tandfonline.com/doi/pdf/10.3402/meo.v11i.4612?needAccess=true. pmid:28253790
  45. 45. Marion GS, Hairston JM, Davis SW, Kirk JK. Using standardized patient assessments to evaluate a health literacy curriculum. Fam Med [Internet]. 2018 17 jul 2020 [cited 2020 jun 10]; 50(1):[52–7 pp.]. Available from: pmid:29346690
  46. 46. Coleman CA, Fromer A. A health literacy training intervention for physicians and other health professionals. Fam Med [Internet]. 2015 May [cited 2020 jun 10]; 47(5):[388–92 pp.]. Available from: https://pubmed.ncbi.nlm.nih.gov/25905883/. pmid:25905883
  47. 47. Green JA, Gonzaga AM, Cohen ED, Spagnoletti CL. Addressing health literacy through clear health communication: a training program for internal medicine residents. Patient Educ Couns [Internet]. 2014 Apr; 95(1):[76–82 pp.]. Available from: https://www.sciencedirect.com/science/article/abs/pii/S0738399114000123?via%3Dihub. pmid:24492156
  48. 48. Holman CK, Weed LD, Kelley SP. Improving provider use of the teach-back method. J Nurses Prof Dev [Internet]. 2019 Jan/Feb [cited 2020 jun 10]; 35(1):[52–3 pp.]. Available from: pmid:30608325
  49. 49. Shaikh U, Yin HS, Mistry KB, Randolph GD, Sanders LM, Ferguson LE. Leveraging medical conferences and webinars for hands-on clinical quality improvement: an intervention to improve health literacy-informed communication in pediatrics. Am J Med Qual [Internet]. 2018 Mar/Apr [cited 2020 jun 10]; 33(2):[213–5 pp.]. Available from: https://doi.org/10.1177%2F1062860617719129.
  50. 50. Kaper MS, Sixsmith J, Koot JAR, Meijering LB, van Twillert S, Giammarchi C, et al. Developing and pilot testing a comprehensive health literacy communication training for health professionals in three European countries. Patient Educ Couns [Internet]. 2018 [cited 2020 jun 10]; 101(1):[152–8 pp.]. Available from: pmid:28823383
  51. 51. Kaper MS, Winter AF, Bevilacqua R, Giammarchi C, McCusker A, Sixsmith J, et al. Positive outcomes of a comprehensive health literacy communication training for health professionals in three european countries: a multi-centre pre-post intervention study. Int J Environ Res Public Health [Internet]. 2019 Oct 15 [cited 2020 jun 10]; 16(20):[1–14 pp.]. Available from: https://res.mdpi.com/d_attachment/ijerph/ijerph-16-03923/article_deploy/ijerph-16-03923-v2.pdf. pmid:31619010
  52. 52. World Health Organization. State of the world’s nursing 2020. Australia: World Health Organization; 2020 [cited 2021 Jul 21]. Available from: https://apps.who.int/iris/bitstream/handle/10665/331673/9789240003293-eng.pdf.
  53. 53. Loan LA, Parnell TA, Stichler JF, Boyle DK, Allen P, VanFosson CA, et al. Call for action: nurses must play a critical role to enhance health literacy. Nurs Outlook [Internet]. 2018 [cited 2021 Jul 19]; 66(1):[97–100 pp.]. Available from: pmid:29331444
  54. 54. Saunders C, Palesy D, Lewis J. Systematic review and conceptual framework for health literacy training in health professions education. Health Prof Educ [Internet]. 2018 17 jul 2020 [cited 2020 jun 10]; 1(1):[3–15 pp.]. Available from: https://doi.org/10.1016/j.hpe.2018.03.003.
  55. 55. Rigolin CCD, Bastos JC Jr, Mello LC, Carvalho CCB. A produção científica brasileira de teses e dissertações sobre health literacy. R Tecnol Soc [Internet]. 2018 18 Maio 2019 [cited 2020 jun 10]; 14(34):[178–95 pp.]. Available from: http://dx.doi.org/10.3895/rts.v14n34.7599.
  56. 56. Lorini C, Caini S, Ierardi F, Bachini L, Gemmi F, Bonaccorsi G. Health literacy as a shared capacity: does the health literacy of a country influence the health disparities among immigrants? Int J Environ Res Public Health [Internet]. 2020 [cited 2021 Jul 19]; 17(4):[1149 p.]. Available from: pmid:32059496
  57. 57. Nutbeam D, Lloyd JE. Understanding and responding to health literacy as a social determinant of health. Annu Rev Public Health [Internet]. 2020 18 maio 2021 [cited 2021 Jan 15]; 42(3):[1–15 pp.]. Available from: https://doi.org/10.1146/annurev-publhealth-090419-102529.
  58. 58. Marques SRL, Lemos SMA. Instrumentos de avaliação do letramento em saúde: revisão de literatura. Audiol Commun res [Internet]. 2017 2017/00; 22(1):[e1757-e pp.]. Available from: https://doi.org/10.1590/2317-6431-2016-1757.
  59. 59. Brega AG, Barnard J, Mabachi NM, Weiss B, DeWalt D, Brach C, et al. Health Literacy Universal Precautions Toolkit. Colorado: University of Colorado; 2020 [cited 2021 Oct 24]. Available from: https://www.ahrq.gov/sites/default/files/publications/files/healthlittoolkit2_4.pdf.
  60. 60. Perrenoud P. Construir competências desde a escola. 1st ed. Porto Alegre: Artes Médicas; 1999. 101 p.