Acessibilidade / Reportar erro

Assessment of the culture of safety in public hospitals in Brazil1 1 Supported by Fundação Cearense de Amparo à Pesquisa (FUNCAP), Brazil, process #12535685-4

ABSTRACT

Objective:

to assess the culture of safety in three public hospitals.

Method:

transversal study undertaken in three Brazilian public hospitals, with health professionals through applying the Safety Attitudes Questionnaire (SAQ). Scores greater than or equal to 75 were considered positive.

Results:

a total of 573 professionals participated in the study, including nurse technicians and auxiliary nurses 292 (51%), nurses 105 (18.3%), physicians 59 (10.3%), and other professionals 117 (20.4%). The mean of the SAQ varied between 65 and 69 in the three hospitals. Among the domains, however, 'Job satisfaction' presented a higher score, and the opposite was observed for the domain 'Perceptions of management'. The outsourced professionals presented a better perception of the culture of safety than did the statutory professionals. The professionals with higher education presented a better perception of the stressing factors than did the professionals educated to senior high school level.

Conclusion:

the level of the culture of safety found is below the ideal. The managerial actions are considered the main contributing factor to the culture's weakness; however, the professionals demonstrated themselves to be satisfied with the work.

Descriptors:
Patient Safety; Organizational Culture; Health Personnel; Hospital

RESUMEN

Objetivo:

evaluar la cultura de seguridad en tres hospitales públicos.

Método:

estudio transversal realizado en tres hospitales públicos brasileños, desarrollado con profesionales de la salud aplicando el Safety Attitudes Questionnaire (SAQ). Fueron considerados positivos puntajes mayores o iguales a 75.

Resultados:

participaron del estudio 573 profesionales, incluyendo técnicos y auxiliares de enfermería 292 (51%), enfermeros 105 (18,3%), médicos 59 (10,3%), y otros profesionales 117 (20,4%). El promedio del SAQ varió entre 65 a 69 en los tres hospitales. Sin embargo, en los dominios, Satisfacción en el Trabajo presentó mayor puntaje y lo opuesto fue observado en el dominio Percepción de la Administración. Los profesionales tercerizados presentaron mejor percepción de la cultura de seguridad que los profesionales estatutarios. Los profesionales de nivel superior presentaron mejor percepción de los factores estresores que los profesionales de nivel medio.

Conclusión:

el nivel de cultura de seguridad encontrado se encuentra debajo de lo ideal. Las acciones administrativas son consideradas como el principal contribuyente para la fragilidad de la cultura, entretanto los profesionales se demostraron satisfechos con el trabajo.

Descriptores:
Seguridad del Paciente; Cultura Organizacional; Personal de Salud; Hospital

RESUMO

Objetivo:

avaliar a cultura de segurança em três hospitais públicos.

Método:

estudo transversal realizado em três hospitais públicos brasileiros, desenvolvido com profissionais de saúde aplicando-se o Safety Attitudes Questionnaire (SAQ). Foram considerados positivos escores maiores ou iguais a 75.

Resultados:

participaram do estudo 573 profissionais, incluindo técnicos e auxiliares de enfermagem 292 (51%), enfermeiros 105 (18,3%), médicos 59 (10,3%), e outros profissionais 117 (20,4%). A média do SAQ variou entre 65 a 69 nos três hospitais. No entanto, entre os domínios, Satisfação no trabalho apresentou maior escore e o oposto foi observado no domínio Percepção da gerência. Os profissionais terceirizados apresentaram melhor percepção da cultura de segurança do que os profissionais estatutários. Os profissionais de nível superior apresentaram melhor percepção dos fatores estressores do que os profissionais de nível médio.

Conclusão:

o nível de cultura de segurança encontrado é abaixo do ideal. As ações gerenciais são consideradas o principal contribuinte para a fragilidade da cultura, entretanto os profissionais demonstraram-se satisfeitos com o trabalho.

Descritores:
Segurança do Paciente; Cultura Organizacional; Profissionais da Saúde; Hospital

Introduction

The culture of safety is defined as the product of values, attitudes, perceptions and skills, both group and individual, which determine a standard of behavior and commitment to safety in the institution, substituting blame and punishment with the opportunity to learn from failures11. Agência Nacional de Vigilância Sanitária - ANVISA (BR). Resolução da Diretoria Colegiada da ANVISA- RDC nº 36 de 35 de julho de 2013. Institui ações para a segurança do paciente em serviços de saúde e dá outras providências. Diário Oficial da União [Internet], 26 de julho de 2013. [Acesso 11 jul 2016]. Disponível em: Disponível em: http://bvsms.saude.gov.br/bvs/saudelegis/anvisa/ 2013/rdc0036_25_07_2013.html
http://bvsms.saude.gov.br/bvs/saudelegis...
.

In Brazil, the topic became more evident in 2013, with the creation of the National Patient Safety Program (PSNP), under which the culture of safety was considered one of the principles for risk management geared towards quality and patient safety. Since then, the recognition of its importance and impact in health organizations has been the basis for undertaking any type of safety program, with emphasis on learning and organizational improvement.

The PNSP instituted, in Brazilian health establishments, the creation of the Nuclei for Patient Safety (NSP), with the aim of promoting and supporting initiatives directed towards patient safety. The nuclei are responsible for the development of a patient safety plan which identifies and describes strategies and actions defined by the Service for mitigating healthcare-associated incidents. One of the initial strategies of the NSP is to establish the culture of safety in the health institutions22. Ministério da Saúde (BR). Documento de Referência do Programa Nacional de Segurança do paciente. Ministério da Saúde, Fundação Oswaldo Cruz, Agência Nacional de Vigilância Sanitária. Brasília: Ministério da Saúde; 2014. [Acesso 11 jul 2016]. Disponível em: Disponível em: http://bvsms.saude.gov.br/bvs/publicacoes/documento_referencia_programa_nacional_seguranca.pdf
http://bvsms.saude.gov.br/bvs/publicacoe...
.

However: prior to undertaking any action which promotes the culture of safety in the institution, the action must firstly be assessed and understood. One of the principal benefits of this assessment is to provide a concrete indicator of the current state of the culture, as well as to monitor its progression after the implementation of improvements. This evaluation may be undertaken rapidly and reliably through questionnaires, so as to obtain the maximum information regarding the organizational factors which influence issues of safety, and it is based on this understanding that the actions may be planned33. Carvalho REFL, Cassiani SHB. Cross-cultural adaptation of the Safety Attitudes Questionnaire - Short Form 2006 for Brazil. Rev. Latino-Am. Enfermagem. [Internet].2012 [Acesso 11 jul 2016].;20(3):575-82. Available from: Available from: http://www.scielo.br/scielo.php ?pid=S0104-11692012000300020&script=sci_abstract
http://www.scielo.br/scielo.php ?pid=S01...
.

Various instruments in various languages are available for evaluating the culture of safety. In Brazil, two instruments are being used for this assessment in hospital institutions33. Carvalho REFL, Cassiani SHB. Cross-cultural adaptation of the Safety Attitudes Questionnaire - Short Form 2006 for Brazil. Rev. Latino-Am. Enfermagem. [Internet].2012 [Acesso 11 jul 2016].;20(3):575-82. Available from: Available from: http://www.scielo.br/scielo.php ?pid=S0104-11692012000300020&script=sci_abstract
http://www.scielo.br/scielo.php ?pid=S01...
-44. Reis CT, Laguardia J, Martins M. Translation and cross-cultural adaptation of the Brazilian version of the Hospital Survey on Patient Safety Culture: initial stage. Cad Saúde Pública. [Internet].2012 [Acesso 11 jul 2016]; 28(11):2199-2210. Available from: Available from: http://www.scielo.br/pdf/csp/v28n11/19.pdf
http://www.scielo.br/pdf/csp/v28n11/19.p...
. For this study, the Safety Attitudes Questionnaire (SAQ) was chosen, in the version adapted and validated for the Portuguese language33. Carvalho REFL, Cassiani SHB. Cross-cultural adaptation of the Safety Attitudes Questionnaire - Short Form 2006 for Brazil. Rev. Latino-Am. Enfermagem. [Internet].2012 [Acesso 11 jul 2016].;20(3):575-82. Available from: Available from: http://www.scielo.br/scielo.php ?pid=S0104-11692012000300020&script=sci_abstract
http://www.scielo.br/scielo.php ?pid=S01...

4. Reis CT, Laguardia J, Martins M. Translation and cross-cultural adaptation of the Brazilian version of the Hospital Survey on Patient Safety Culture: initial stage. Cad Saúde Pública. [Internet].2012 [Acesso 11 jul 2016]; 28(11):2199-2210. Available from: Available from: http://www.scielo.br/pdf/csp/v28n11/19.pdf
http://www.scielo.br/pdf/csp/v28n11/19.p...
-55. Sexton JB, Helmreich RL, Neilands TB, et al. The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Services Res. 2006;6:44. doi:10.1186/1472-6963-6-44.
https://doi.org/10.1186/1472-6963-6-44...
. As well as being one of the instruments used most for assessing the culture of safety in various countries66. Nguyen G, Gambashidze N, Ilyas SA, Pascu D. Validation of the safety attitudes questionnaire (short form 2006) in Italian in hospitals in the northeast of Italy. BMC Health Serv Res. [Internet]. 2015 [Access July 11, 2016]; 24(15):284. doi: 10.1186/s12913-015-0951-8. Available from: Available from: http://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-015-0951-8
http://bmchealthservres.biomedcentral.co...

7. Gabrani A, Hoxha A, Simak A, Gabrani J. Application of the Safety Attitudes Questionnaire (SAQ) in Albanian hospitals: a cross-sectional study. BMJ Open 2015;5:e006528. Available from: http://bmjopen.bmj.com/content/5/4/e006528.full
http://bmjopen.bmj.com/content/5/4/e0065...
-88. Lee WC, Wung HY, Liao HH, Lo CM, Chang FL, Wang PC, Fan A, Chen HH, Yang HC, Hou SM. Hospital safety culture in Taiwan: a nationwide survey using Chinese version Safety Attitude Questionnaire. BMC Health Serv Res . [Internet]. 2010 [Access July 12, 2016]; 10:234. Available from: Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2924859/
https://www.ncbi.nlm.nih.gov/pmc/article...
, this instrument was chosen due to its practicality and the fact that it is possible to complete it rapidly, this process requiring approximately 10 minutes. Furthermore, its results can be associated with the patient safety indicators.

This study's hypothesis is that the in-depth assessment of the culture of safety allows a broader view of the indicators affecting patient safety in the hospital context. This entails the planning of actions geared towards quality care for the patient, with emphasis on organizational improvement.

Considering assessment to be the first step for establishing a safe culture, this study's objective was to assess the culture of safety of three hospitals in the State of Ceará (CE) through the use of the Safety Attitudes Questionnaire (SAQ).

Method

A transversal study was undertaken in the clinical and surgical wards, outpatient centers, surgical centers, intensive care units and emergency units of three hospitals in the State of Ceará (CE), Brazil.

The study was financed by the Research Program for the SUS : shared management in health (Programa Pesquisa para o SUS: gestão compartilhada em saúde ) (PPSUS). A period of two years was established by the financing agencies for the undertaking of the study. In this way, the number of hospitals studied was determined by the time necessary for assessing the culture and hospitals with more than 300 bed spaces, defined in the literature as an approximate time of three months(3). As a result, among the seven hospitals in the State which are centers of excellence, two were excluded due to having participated in the validation of the instrument used in the study, and the remaining five participated in a draw, in which three hospitals were chosen at random.

Hospital A is a center of excellence in mental health in the State of Ceará, hospital B is a center of excellence in attendance to persons with infectious-contagious diseases, and hospital C is a General Hospital which attends various medical specialities. All the hospitals are linked to universities and undertake teaching and research activities.

The professionals who participated in the study were divided into: nursing team (nurses, nurse technicians and auxiliary nurses) and workers from other categories (physician, physiotherapist, psychologist, social worker, nutritionist, occupational therapist and pharmacist).

In order to participate in the study, the health professionals had to work at least 20 hours per week and to have worked in the department for at least one month. Those professionals who were not undertaking work activities in the data collection period were excluded.

The professionals who accepted to participate in the study signed the Terms of Free and Informed Consent. The instrument was filled out in the work environment and was available on paper. In total, 950 instruments were distributed to the professionals from the three hospitals, approached randomly in their workplaces; however, 573 (60%) professionals returned the questionnaire completed.

The data were collected using the Safety Attitudes Questionnaire, validated and adapted for the context of Brazilian hospitals33. Carvalho REFL, Cassiani SHB. Cross-cultural adaptation of the Safety Attitudes Questionnaire - Short Form 2006 for Brazil. Rev. Latino-Am. Enfermagem. [Internet].2012 [Acesso 11 jul 2016].;20(3):575-82. Available from: Available from: http://www.scielo.br/scielo.php ?pid=S0104-11692012000300020&script=sci_abstract
http://www.scielo.br/scielo.php ?pid=S01...
. The instrument contains 41 questions which measure the professionals' perception regarding the culture of safety through six domains: Teamwork Climate, Safety Climate, Job Satisfaction, Stress Recognition, Perceptions of Management and Working Conditions. The response to each question follows a five point Likert scale. The final score varies from 0 to 100. Scores ≥ 75 are considered positive55. Sexton JB, Helmreich RL, Neilands TB, et al. The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Services Res. 2006;6:44. doi:10.1186/1472-6963-6-44.
https://doi.org/10.1186/1472-6963-6-44...
.

After the data collection, the information from each question was inserted and processed using the Statistical Package for the Social Sciences (SPSS) version 18.0. The level of significance considered for the study was 0.05. The categorical variables were described in absolute and percentage numbers, and the quantitative variables were expressed by mean and standard deviation. In order to compare the means, the Fisher two-tailed test was applied for the categorical variables, and the Student t-test or Mann-Whitney test was applied for the ordinal quantitative variables.

The study was approved by the ethics committee of the three institutions, and was documented under protocol number 107,862. Anonymity was guaranteed to the study participants.

Results

In the three hospitals, we obtained 573 completed instruments, representing a return rate of 60.3%, of which 106 (18.5%) were from Hospital A, 183 (31.9%) from Hospital B, and 284 (49.6%) from Hospital C.

In relation to the study subjects' characteristics, females predominated in all three hospitals, with a total of 434 (75.7%). Length of service varied for each hospital; however, in all hospitals, the largest percentage of professionals presented more than five years' service, it being the case that in Hospitals B and C, the largest percentage had between 11 and 20 years of service, while in hospital A, 32.4% of the professionals had length of service of 21 years or over.

The predominant system under which staff were employed was statutary, with 279 (48.7%) professionals - however, in Hospital C, the number of professionals who were outsourced and not statutary or who were employed on a temporary basis, such as the residents, had the highest percentage (54.9%).

Regarding professional category, the nurse technicians and auxiliary nurses were the professionals most likely to complete the instrument, with a total of 292 (51%), followed by nurses 105 (18.3%) and physicians 59 (10.3%).

Descriptive analysis of the responses to the Safety Attitudes Questionnaire

The perception of the climate of safety varied according to hospital, sex, length of service, professional category, system under which staff were employed and the professional's educational level. In relation to the total score obtained, none of the three hospitals presented a positive value. However, among the domains, Job Satisfaction presented the highest score in all the hospitals, while the opposite was observed for the domain Perceptions of Management, which presented the lowest values.

Regarding the total value of the scores, and the values by domain, of the three hospitals, a similar value for the instrument's total mean was found in two hospitals, Hospital C having a mean of four points less, with a statistically significant difference. By domain, the mean varied between 57 and 80 for Hospital A, 58 to 75 for Hospital B, and 53 to 81 for Hospital C, with statistical differences in the domains of Safety Climate, Perceptions of Management and Working Conditions (Table 1).

Table 1
Distribution by domain, of the Safety Attitudes Questionnaire (SAQ), of the means of the three hospitals in the study. Fortaleza, CE, Brazil, 2015

In relation to length of service, the professionals with less than six months of service presented a better score in all the domains and in the total, in comparison with the other professionals whose length of service was superior to six months. A statistically significant difference was observed in relation to the comparison of the means in the domain Working Conditions for those professionals with less than six months (77). The professionals whose length of service was 21 years or over were those who presented the highest score in the domain Job Satisfaction (85). The domains of Perceptions of Management were those that presented the lowest mean with all the professionals (Table 2).

Table 2
Distribution of the mean by category and length of service, by domain and total score of the Safety Attitudes Questionnaire (SAQ). Fortaleza, CE, Brazil, 2015

In order to ascertain whether there was a difference in the perception of the Culture of safety in relation to the nature of employment with the institution, the means of the SAQ were compared with the type of employment. The outsourced staff presented, on average, a total score for the questionnaire which was greater than that of the statutary professionals, 69 and 66, respectively. This difference was considered to be statistically significant (p<0.05).

In relation to the domains, the outsourced professionals presented a difference in that their mean scores were higher than those of the statutary professionals in the domains: Perceptions of Management of the unit and Working Conditions; both with a statistically significant difference. The perception of stress was greater among professionals employed by the state, and the domains of Job Satisfaction and Teamwork Climate obtained the same value for the two types of employment (Table 3).

Table 3
Distribution of the mean by type of employment by domain of the Safety Attitudes Questionnaire (SAQ). Fortaleza, CE, Brazil, 2015

Higher means were observed for the nursing team in the questionnaire's total score. In relation to the domains of Safety Climate, Perceptions of Management of the unit and of the hospital, and Working Conditions, this difference was statistically significant, when compared to the professionals of other categories. The opposite was observed in the domain Stress Recognition, in which the professionals from other categories presented a high-end mean in comparison with the nursing professionals. At this point, the domain of Stress Recognition presented the highest score among the professionals educated to degree high level, with a statistically significant difference (Table 4).

Table 4
Mean of the scores of the professionals educated to higher education level and senior high school level, and of the nursing team and of other categories. Fortaleza, CE, Brazil, 2015

Discussion

The present study assessed the perception of the culture of safety of the professionals from three hospitals in the State of Ceará, through the use of the Safety Attitudes Questionnaire (SAQ). The SAQ is one of the instruments used most for assessing the culture of safety in health institutions66. Nguyen G, Gambashidze N, Ilyas SA, Pascu D. Validation of the safety attitudes questionnaire (short form 2006) in Italian in hospitals in the northeast of Italy. BMC Health Serv Res. [Internet]. 2015 [Access July 11, 2016]; 24(15):284. doi: 10.1186/s12913-015-0951-8. Available from: Available from: http://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-015-0951-8
http://bmchealthservres.biomedcentral.co...
. This study presents the first quantitative assessment of the culture of safety, through the perception of the climate of safety, undertaken in the State of Ceará.

In Brazil, the professionals who make up the nursing team, due to being the majority of the professionals in the health institutions, were also those who most responded to the questionnaire. The physicians were those who most declined to answer the questionnaire, alleging lack of time for filling out the scale. This low frequency in the physicians' responses has also been observed in other studies with the FAQ, as well as in studies using other questionnaires with the same purpose99. Profit J, Etchegaray J, Petersen LA, Sexton JB, Hysong SJ, Mei M, et al. The Safety Attitudes Questionnaire as a tool for benchmarking safety culture in the NICU. Arch Dis Child Fetal Neonatal Ed. [Internet]. 2012 [Access July 12, 2016];97(2):127-32. Available from: Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4030665/
https://www.ncbi.nlm.nih.gov/pmc/article...
-1010. Etchegaray JM, Thomas EJ. Comparing two safety culture surveys: Safety Attitudes Questionnaire and Hospital Survey on Patient Safety. BMJ Qual Saf. [Internet]. 2012 [Access July 12, 2016];21:490-9. Available from: Available from: http://qualitysafety.bmj.com/content/21/6/490.short
http://qualitysafety.bmj.com/content/21/...
.

None of the three hospitals presented a positive general score, corroborating studies undertaken in other Brazilian states, which obtained total scores for the SAQ below 75. The State of Ceará obtained a score above that obtained in a study in a teaching hospital in Brasília1111. Carvalho PA, Göttems LBD, Pires MRGM, Oliveira MLC de. Safety culture in the operating room of a public hospital in the perception of healthcare professionals. Rev. Latino-Am. Enfermagem [Internet]. 2015 Dec [Access Oct 12, 2016]; 23(6):1041-8. Available from:Available from:http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692015000601041&lng=en .
http://www.scielo.br/scielo.php?script=s...
, but similar to that obtained in studies undertaken in public hospitals in the states of São Paulo and Minas Gerais1212. Luiz RB, Simões ALA, Barichello E, Barbosa MHa. Factors associated with the patient safety climate at a teaching hospital. Rev. Latino-Am. Enfermagem [Internet]. 2015 Oct [cited 2016 Oct 12]; 23(5):880-887. Available from: Available from: http://www.scielo.br/scielo.php?script =sci_arttext&pid=S0104-11692015000500880&lng=en .
http://www.scielo.br/scielo.php?script =...
-1313. Santiago THR, Turrini RNT. Cultura e clima organizacional para a segurança do paciente em Unidades de Terapia Intensiva. Rev Esc Enferm USP. [Internet]. 2015 [Access Oct 12, 2016]: 49(spe):123-30. Available from: Available from: http://www.scielo.br/scielo.php?script=sci_arttext &pid=S0080-62342015000700123&Ing=en
http://www.scielo.br/scielo.php?script=s...
.

A statistically significant difference was identified in the comparison of the means of the hospitals' scores. Hospital C presented a general value for the SAQ which was below that of the other hospitals, reflecting the weakness of the culture of safety according to the professionals' perception. However, one explanation for the difference of the mean between the hospitals may be due to the fact that Hospital C is the largest, and the only General Hospital among the three hospitals evaluated, with different specialities.

The majority of the professionals are female, employed on a statutary basis and with length of service in the institution of more than five years. This profile corroborates that found in other studies assessing the culture of safety1212. Luiz RB, Simões ALA, Barichello E, Barbosa MHa. Factors associated with the patient safety climate at a teaching hospital. Rev. Latino-Am. Enfermagem [Internet]. 2015 Oct [cited 2016 Oct 12]; 23(5):880-887. Available from: Available from: http://www.scielo.br/scielo.php?script =sci_arttext&pid=S0104-11692015000500880&lng=en .
http://www.scielo.br/scielo.php?script =...

13. Santiago THR, Turrini RNT. Cultura e clima organizacional para a segurança do paciente em Unidades de Terapia Intensiva. Rev Esc Enferm USP. [Internet]. 2015 [Access Oct 12, 2016]: 49(spe):123-30. Available from: Available from: http://www.scielo.br/scielo.php?script=sci_arttext &pid=S0080-62342015000700123&Ing=en
http://www.scielo.br/scielo.php?script=s...
-1414. Rigobello MCG, Carvalho REFL de, Cassiani SHB, Galon T, Capucho HC, Deus NN de. Clima de segurança do paciente: percepção dos profissionais de enfermagem. Acta Paul Enferm. [Internet]. 2012 [Access Oct 12, 2016];25(5):728-35. Available from: Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0103-21002012000500013&Ing=en
http://www.scielo.br/scielo.php?script=s...
.

The domain Job Satisfaction was the one which received the best result in the three hospitals. When compared with the mean observed in other Brazilian studies(11-15), one can perceive positive scores, of over 75, demonstrating that on average the Brazilian professionals are satisfied with the work that they undertake.

In comparing this study with international baseline studies, one can infer that the Brazilian professionals are more satisfied with their work than are the professionals of other countries such as the United States of America (USA) and Ireland(16-17). The Brazilian professionals' mean was below only the results in Switzerland(18). A score above 80 means that there is a strong consensus among the professionals regarding the institution's climate of safety(5). In other words, the institution has an environment which is propitious for the work and the professionals are satisfied with the work that they carry out, contributing to positive attitudes to safety.

The opposite was also observed; the domain of Perceptions of Management had the lowest score among the six domains. Studies undertaken in other Brazilian cities obtained similar results1212. Luiz RB, Simões ALA, Barichello E, Barbosa MHa. Factors associated with the patient safety climate at a teaching hospital. Rev. Latino-Am. Enfermagem [Internet]. 2015 Oct [cited 2016 Oct 12]; 23(5):880-887. Available from: Available from: http://www.scielo.br/scielo.php?script =sci_arttext&pid=S0104-11692015000500880&lng=en .
http://www.scielo.br/scielo.php?script =...

13. Santiago THR, Turrini RNT. Cultura e clima organizacional para a segurança do paciente em Unidades de Terapia Intensiva. Rev Esc Enferm USP. [Internet]. 2015 [Access Oct 12, 2016]: 49(spe):123-30. Available from: Available from: http://www.scielo.br/scielo.php?script=sci_arttext &pid=S0080-62342015000700123&Ing=en
http://www.scielo.br/scielo.php?script=s...

14. Rigobello MCG, Carvalho REFL de, Cassiani SHB, Galon T, Capucho HC, Deus NN de. Clima de segurança do paciente: percepção dos profissionais de enfermagem. Acta Paul Enferm. [Internet]. 2012 [Access Oct 12, 2016];25(5):728-35. Available from: Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0103-21002012000500013&Ing=en
http://www.scielo.br/scielo.php?script=s...
-1515. Barbosa MH, Sousa EM, Félix MMS, Oliveira KF, Barichello E. Clima de segurança do paciente em um hospital especializado em oncologia. Rev Eletrôn Enferm. [Internet] 2016 [Acesso 12 julho 2016];17(4):1-9. Disponível em: Disponível em: http://www.revistas.ufg.br/fen/article/view/34614 .
http://www.revistas.ufg.br/fen/article/v...
, this was also the case in international studies undertaken in the USA, China and Ireland1616. Taylor F, Dominici J, Agnew D, Gerin L, Morlock M. Do nurse and patient injuries share common antecedents? An analysis of associations with safety climate and working conditions. BMJ Qual Safety. [Internet]. 2012 [Access Ago 12, 2016]; 21:101-11. Available from: Available from: https://www.ncbi.nlm.nih.gov/pubmed/22016377
https://www.ncbi.nlm.nih.gov/pubmed/2201...
-1717. Relihan E, Glynn S, Daly D, Silke B, Ryder S. Measuring and benchmarking safety culture: application of the safety attitudes questionnaire to an acute medical admissions unit. Ir J Med Sci. [Internet]. 2009 [Access Ago 17, 2016];178(4):433-9. Available from: Available from: https://www.ncbi.nlm.nih.gov/pubmed/19437091
https://www.ncbi.nlm.nih.gov/pubmed/1943...
,1919. Huang DT, Clermont G, Kong L, Weissfeld LA, Sexton JB, Rowan KM. Intensive care unit safety culture and outcomes: a US multicenter study. Int J Qual Health Care. [Internet]. 2010 [Access Ago 17, 2016];22(3):151-61. Available from: Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2868527/
https://www.ncbi.nlm.nih.gov/pmc/article...
.

Another domain which deserves to be emphasized is Stress Recognition, in which a score close to the positive value was presented (74.3). It stands out that the professionals educated to graduate level had greater recognition of the stressing factors which influence the undertaking of the work, with higher scores in comparison with the professionals educated to senior high school level. Professionals who participated in an assessment of the culture of safety in a public hospital in the Brazilian capital also demonstrated - by the positive score value - that they recognize when the stressing factors influence the undertaking of the work1111. Carvalho PA, Göttems LBD, Pires MRGM, Oliveira MLC de. Safety culture in the operating room of a public hospital in the perception of healthcare professionals. Rev. Latino-Am. Enfermagem [Internet]. 2015 Dec [Access Oct 12, 2016]; 23(6):1041-8. Available from:Available from:http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692015000601041&lng=en .
http://www.scielo.br/scielo.php?script=s...
.

A study held in Norway and Hungary shows results which are similar to the Brazilian studies, in which the professionals present a good perception of stressing factors in the work environment2020. Bondevik GT, Hofoss D, Holm Hansen E, Deilkås EC. Patient Safety Culture in Norwegian primary care - a study in out-of-hours casualty clinics and GP practices. Scand J Primary Health Care. [Internet]. 2014 [Access Ago 17, 2016];27:1-7. Available from: Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4206561/
https://www.ncbi.nlm.nih.gov/pmc/article...
-2121. Bognár A, Barach P, Johnson JK, Duncan RC, Birnbach D, Woods D, Holl JL, Bacha EA. Errors and the burden of errors: attitudes, perceptions, and the culture of safety in pediatric cardiac surgical teams. Ann Thorac Surg. [Internet]. 2008 [Access Ago 17, 2016];85(4):1374-81. Available from: Available from: http://www.annalsthoracicsurgery.org/article/S0003-4975(07)02358-2/pdf
http://www.annalsthoracicsurgery.org/art...
. Occupational stress is commonly reported by health professionals, principally among professionals from the nursing team2222. Biaggi P, Peter S, Ulich E. Stressors, emotional exhaustion, and aversion to patients in residents and chief residents. Swiss Med Weekly. [Internet]. 2003[Access Ago 17, 2016];133: 339-46. Available from:Available from:http://www.smw.ch/foreaders/archive/backlinks/?url=/docs/archive200x/2003/23/smw-10134.html
http://www.smw.ch/foreaders/archive/back...
. Studies have demonstrated that problems relating to workload and to restrictions on autonomy can result in emotional exhaustion and aversion to the patient2222. Biaggi P, Peter S, Ulich E. Stressors, emotional exhaustion, and aversion to patients in residents and chief residents. Swiss Med Weekly. [Internet]. 2003[Access Ago 17, 2016];133: 339-46. Available from:Available from:http://www.smw.ch/foreaders/archive/backlinks/?url=/docs/archive200x/2003/23/smw-10134.html
http://www.smw.ch/foreaders/archive/back...
-2323. World Health Organization (WHO). Human Factores in patint safety: review of topics and tools [Internet]. 2009. [Access Dec 13, 2014]. Available from: Available from: http://www.who.int/patientsafety/research/methods_measures/ human_factors/human_factors_review.pdf
http://www.who.int/patientsafety/researc...
. Failure to deal with these stressors can result in work errors, reduction in productivity, feelings of discomfort, and illness or poor performance by the team. Stress management, therefore, is of great importance and relevance for patient safety2323. World Health Organization (WHO). Human Factores in patint safety: review of topics and tools [Internet]. 2009. [Access Dec 13, 2014]. Available from: Available from: http://www.who.int/patientsafety/research/methods_measures/ human_factors/human_factors_review.pdf
http://www.who.int/patientsafety/researc...
.

Regarding length of service, the professionals with less than six months' length of service presented better scores in 5 of the 6 domains, and in the total score, in comparison with the other professionals whose length of service was superior to six months.

This difference was equally observed in a Spanish study with the same domains of Job Satisfaction and Perceptions of Management2424. Gutiérrez-Cía I, Merino de Cos P, Juan A Y, Obón-Azuara B, Alonso-Ovies A, Martin-Delgado A, Rodríguez JA, Aibar-Remón C. Percepción de la cultura de seguridad en los servicios de medicina intensiva españoles. Med Clín. (Barcelona). [Internet]. 2010 [Acceso 12 Enero 2016]1;135(Suppl 1):37-44. Disponible en: Disponible en: http://www.elsevier.es/es-revista-medicina-clinica-2-articulo- percepcion-cultura-seguridad-los-servicios-S0025775 310700191
http://www.elsevier.es/es-revista-medici...
. The professionals with less than six months' service in the institution are still attempting to adapt to the work environment and sometimes perceive the institution positively. At this point, the older professionals managed to perceive better the individual and collective skills which determine the institution's commitment and style in relation to issues of safety.

Another point investigated in the study was the interest in knowing whether there was a difference or not between the perception of the culture of safety between the statutary and outsourced professionals. The outsourced staff presented, on average, a total score for the questionnaire which was higher than that of the statutary professionals, 69 and 66, respectively. This difference was considered statistically significant. Moreover, the perception of stress was greater among the state-employed professionals, and the domains of Job Satisfaction and Teamwork Climate obtained the same value for the two types of employment.

This result may be associated with the fact that the casually-employed professional, who does not have stability in the job, presents positive results regarding the culture of safety due to fearing retaliation in the work environment - in spite of the confidentiality of the data having been emphasized innumerable times during the study. It is believed that - due to this being a context which is highly specific to the workers in the area of health in the State of Ceará - studies were not identified which used the comparison of these variables for comparison with the results found in this research.

The nursing professionals present a better perception of the culture of safety in comparison with the other professionals. Regarding the domains of Safety Climate, Perceptions of Management of the unit and of the hospital and Working Conditions, this difference was statistically significant, when compared with the professionals of other categories. The opposite was observed in the domain Stress Recognition, in which the professionals of other categories presented a higher mean in comparison with the nursing professionals, showing that the professionals of other categories recognise better the stressing factors which influence the undertaking of the work than do the nursing professionals. One study undertaken in Norway compared the SAQ scores between physicians and nurses and identified a statistically significant difference in all the domains for nurses2020. Bondevik GT, Hofoss D, Holm Hansen E, Deilkås EC. Patient Safety Culture in Norwegian primary care - a study in out-of-hours casualty clinics and GP practices. Scand J Primary Health Care. [Internet]. 2014 [Access Ago 17, 2016];27:1-7. Available from: Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4206561/
https://www.ncbi.nlm.nih.gov/pmc/article...
.

However, another Brazilian study, undertaken in Minas Gerais, found that physicians had a better perception of the management and of the working conditions in comparison with the nursing team1212. Luiz RB, Simões ALA, Barichello E, Barbosa MHa. Factors associated with the patient safety climate at a teaching hospital. Rev. Latino-Am. Enfermagem [Internet]. 2015 Oct [cited 2016 Oct 12]; 23(5):880-887. Available from: Available from: http://www.scielo.br/scielo.php?script =sci_arttext&pid=S0104-11692015000500880&lng=en .
http://www.scielo.br/scielo.php?script =...
.

The information on safety culture can guide the interventions in the search for quality in the health services. It may be observed that there is a growing interest on the part of health institutions in studies on the assessment of the Safety Culture, as this is considered the first stage for the construction of the patient safety commission established in Ministerial Ordinance 529 of 1st April 2013, which instituted the National Patient Safety Program across Brazil2525. Agência Nacional de Vigilância Sanitária- ANVISA (BR). Portaria nº 359 de 1º de abril de 2013. Institui o Programa Nacional de Segurança do Paciente. Diário Oficial da União [Internet]. 2 de abril de 2013. [Acesso 15 ago 2016]. Disponível em: Disponível em: http://bvsms.saude.gov.br/bvs/publicacoes/documento_referencia_programa_nacional_seguranca.pdf
http://bvsms.saude.gov.br/bvs/publicacoe...
.

Finally, this was the first study on the evaluation of the culture of safety and health institutions in the Northeast of Brazil, which implies difficulty in comparison of results. This type of evaluation is a measurement over time of this construct and there is a need for an assessment with triangulation of methods for a more in-depth analysis.

It is valid to highlight that in any evaluation study, whether on the climate of safety or on the organizational climate, the results generated through the application of questionnaires cannot be interpreted in isolation. They must be evaluated in conjunction with the institution's organizational characteristics and values and mission. As a result, we understand that the SAQ can be used as one more managerial tool for decision-making, with the aim of planning and producing a favorable work environment which is propitious for the professionals' satisfaction and motivation, and which consequently ensures quality care for the patient. Thus, emphasis is placed on the importance of undertaking further studies on the assessment of the patient safety culture.

Conclusion

The professionals do not present a strong agreement regarding the issues of patient safety in the institutions, although they present good satisfaction in the work. The values obtained in the domain Perceptions of Management present values below 60, indicating that there is no general approval of the actions of management in relation to issues of safety.

The professionals educated to graduate level present better perception of the stressor factors than do the professionals educated to senior high school level, and the outsourced professionals presented better means when compared with the professionals educated to graduate level; however, this difference may be attributed to a number of factors, such as poor stability of employment and fear of retaliation.

The nursing team presented higher scores than the other professionals, with the exception of Stress Recognition, in which the professionals seem not to recognize the stressing factors which influence the undertaking of the work.

The level of safety culture found is below the ideal. The managerial actions are considered to be the principal factor contributing to the weakness of the culture; however, the professionals demonstrated satisfaction with the work.

The scores below the satisfactory level represent a warning sign regarding which domains need to be worked on in the institutions. As a result, the investigation and discussion of the domains which concern the culture of safety, through the application of the SAQ, will contribute to the improvement of the health service provided.

References

  • 1
    Agência Nacional de Vigilância Sanitária - ANVISA (BR). Resolução da Diretoria Colegiada da ANVISA- RDC nº 36 de 35 de julho de 2013. Institui ações para a segurança do paciente em serviços de saúde e dá outras providências. Diário Oficial da União [Internet], 26 de julho de 2013. [Acesso 11 jul 2016]. Disponível em: Disponível em: http://bvsms.saude.gov.br/bvs/saudelegis/anvisa/ 2013/rdc0036_25_07_2013.html
    » http://bvsms.saude.gov.br/bvs/saudelegis/anvisa/ 2013/rdc0036_25_07_2013.html
  • 2
    Ministério da Saúde (BR). Documento de Referência do Programa Nacional de Segurança do paciente. Ministério da Saúde, Fundação Oswaldo Cruz, Agência Nacional de Vigilância Sanitária. Brasília: Ministério da Saúde; 2014. [Acesso 11 jul 2016]. Disponível em: Disponível em: http://bvsms.saude.gov.br/bvs/publicacoes/documento_referencia_programa_nacional_seguranca.pdf
    » http://bvsms.saude.gov.br/bvs/publicacoes/documento_referencia_programa_nacional_seguranca.pdf
  • 3
    Carvalho REFL, Cassiani SHB. Cross-cultural adaptation of the Safety Attitudes Questionnaire - Short Form 2006 for Brazil. Rev. Latino-Am. Enfermagem. [Internet].2012 [Acesso 11 jul 2016].;20(3):575-82. Available from: Available from: http://www.scielo.br/scielo.php ?pid=S0104-11692012000300020&script=sci_abstract
    » http://www.scielo.br/scielo.php ?pid=S0104-11692012000300020&script=sci_abstract
  • 4
    Reis CT, Laguardia J, Martins M. Translation and cross-cultural adaptation of the Brazilian version of the Hospital Survey on Patient Safety Culture: initial stage. Cad Saúde Pública. [Internet].2012 [Acesso 11 jul 2016]; 28(11):2199-2210. Available from: Available from: http://www.scielo.br/pdf/csp/v28n11/19.pdf
    » http://www.scielo.br/pdf/csp/v28n11/19.pdf
  • 5
    Sexton JB, Helmreich RL, Neilands TB, et al. The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Services Res. 2006;6:44. doi:10.1186/1472-6963-6-44.
    » https://doi.org/10.1186/1472-6963-6-44
  • 6
    Nguyen G, Gambashidze N, Ilyas SA, Pascu D. Validation of the safety attitudes questionnaire (short form 2006) in Italian in hospitals in the northeast of Italy. BMC Health Serv Res. [Internet]. 2015 [Access July 11, 2016]; 24(15):284. doi: 10.1186/s12913-015-0951-8. Available from: Available from: http://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-015-0951-8
    » https://doi.org/10.1186/s12913-015-0951-8» http://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-015-0951-8
  • 7
    Gabrani A, Hoxha A, Simak A, Gabrani J. Application of the Safety Attitudes Questionnaire (SAQ) in Albanian hospitals: a cross-sectional study. BMJ Open 2015;5:e006528. Available from: http://bmjopen.bmj.com/content/5/4/e006528.full
    » http://bmjopen.bmj.com/content/5/4/e006528.full
  • 8
    Lee WC, Wung HY, Liao HH, Lo CM, Chang FL, Wang PC, Fan A, Chen HH, Yang HC, Hou SM. Hospital safety culture in Taiwan: a nationwide survey using Chinese version Safety Attitude Questionnaire. BMC Health Serv Res . [Internet]. 2010 [Access July 12, 2016]; 10:234. Available from: Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2924859/
    » https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2924859/
  • 9
    Profit J, Etchegaray J, Petersen LA, Sexton JB, Hysong SJ, Mei M, et al. The Safety Attitudes Questionnaire as a tool for benchmarking safety culture in the NICU. Arch Dis Child Fetal Neonatal Ed. [Internet]. 2012 [Access July 12, 2016];97(2):127-32. Available from: Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4030665/
    » https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4030665/
  • 10
    Etchegaray JM, Thomas EJ. Comparing two safety culture surveys: Safety Attitudes Questionnaire and Hospital Survey on Patient Safety. BMJ Qual Saf. [Internet]. 2012 [Access July 12, 2016];21:490-9. Available from: Available from: http://qualitysafety.bmj.com/content/21/6/490.short
    » http://qualitysafety.bmj.com/content/21/6/490.short
  • 11
    Carvalho PA, Göttems LBD, Pires MRGM, Oliveira MLC de. Safety culture in the operating room of a public hospital in the perception of healthcare professionals. Rev. Latino-Am. Enfermagem [Internet]. 2015 Dec [Access Oct 12, 2016]; 23(6):1041-8. Available from:Available from:http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692015000601041&lng=en
    » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692015000601041&lng=en
  • 12
    Luiz RB, Simões ALA, Barichello E, Barbosa MHa. Factors associated with the patient safety climate at a teaching hospital. Rev. Latino-Am. Enfermagem [Internet]. 2015 Oct [cited 2016 Oct 12]; 23(5):880-887. Available from: Available from: http://www.scielo.br/scielo.php?script =sci_arttext&pid=S0104-11692015000500880&lng=en
    » http://www.scielo.br/scielo.php?script =sci_arttext&pid=S0104-11692015000500880&lng=en
  • 13
    Santiago THR, Turrini RNT. Cultura e clima organizacional para a segurança do paciente em Unidades de Terapia Intensiva. Rev Esc Enferm USP. [Internet]. 2015 [Access Oct 12, 2016]: 49(spe):123-30. Available from: Available from: http://www.scielo.br/scielo.php?script=sci_arttext &pid=S0080-62342015000700123&Ing=en
    » http://www.scielo.br/scielo.php?script=sci_arttext &pid=S0080-62342015000700123&Ing=en
  • 14
    Rigobello MCG, Carvalho REFL de, Cassiani SHB, Galon T, Capucho HC, Deus NN de. Clima de segurança do paciente: percepção dos profissionais de enfermagem. Acta Paul Enferm. [Internet]. 2012 [Access Oct 12, 2016];25(5):728-35. Available from: Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0103-21002012000500013&Ing=en
    » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0103-21002012000500013&Ing=en
  • 15
    Barbosa MH, Sousa EM, Félix MMS, Oliveira KF, Barichello E. Clima de segurança do paciente em um hospital especializado em oncologia. Rev Eletrôn Enferm. [Internet] 2016 [Acesso 12 julho 2016];17(4):1-9. Disponível em: Disponível em: http://www.revistas.ufg.br/fen/article/view/34614
    » http://www.revistas.ufg.br/fen/article/view/34614
  • 16
    Taylor F, Dominici J, Agnew D, Gerin L, Morlock M. Do nurse and patient injuries share common antecedents? An analysis of associations with safety climate and working conditions. BMJ Qual Safety. [Internet]. 2012 [Access Ago 12, 2016]; 21:101-11. Available from: Available from: https://www.ncbi.nlm.nih.gov/pubmed/22016377
    » https://www.ncbi.nlm.nih.gov/pubmed/22016377
  • 17
    Relihan E, Glynn S, Daly D, Silke B, Ryder S. Measuring and benchmarking safety culture: application of the safety attitudes questionnaire to an acute medical admissions unit. Ir J Med Sci. [Internet]. 2009 [Access Ago 17, 2016];178(4):433-9. Available from: Available from: https://www.ncbi.nlm.nih.gov/pubmed/19437091
    » https://www.ncbi.nlm.nih.gov/pubmed/19437091
  • 18
    Nordén-Hägg A, Sexton JB, Kälvemark-Sporrong S. Assessing Safety Culture in Pharmacies: The psychometric validation of the Safety Attitudes Questionnaire (SAQ) in a national sample of community pharmacies in Sweden. Clin Pharmacol. [Internet]. 2010 [Access Ago 17, 2016];10(8):1-12. Available from: Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2868807/
    » https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2868807/
  • 19
    Huang DT, Clermont G, Kong L, Weissfeld LA, Sexton JB, Rowan KM. Intensive care unit safety culture and outcomes: a US multicenter study. Int J Qual Health Care. [Internet]. 2010 [Access Ago 17, 2016];22(3):151-61. Available from: Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2868527/
    » https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2868527/
  • 20
    Bondevik GT, Hofoss D, Holm Hansen E, Deilkås EC. Patient Safety Culture in Norwegian primary care - a study in out-of-hours casualty clinics and GP practices. Scand J Primary Health Care. [Internet]. 2014 [Access Ago 17, 2016];27:1-7. Available from: Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4206561/
    » https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4206561/
  • 21
    Bognár A, Barach P, Johnson JK, Duncan RC, Birnbach D, Woods D, Holl JL, Bacha EA. Errors and the burden of errors: attitudes, perceptions, and the culture of safety in pediatric cardiac surgical teams. Ann Thorac Surg. [Internet]. 2008 [Access Ago 17, 2016];85(4):1374-81. Available from: Available from: http://www.annalsthoracicsurgery.org/article/S0003-4975(07)02358-2/pdf
    » http://www.annalsthoracicsurgery.org/article/S0003-4975(07)02358-2/pdf
  • 22
    Biaggi P, Peter S, Ulich E. Stressors, emotional exhaustion, and aversion to patients in residents and chief residents. Swiss Med Weekly. [Internet]. 2003[Access Ago 17, 2016];133: 339-46. Available from:Available from:http://www.smw.ch/foreaders/archive/backlinks/?url=/docs/archive200x/2003/23/smw-10134.html
    » http://www.smw.ch/foreaders/archive/backlinks/?url=/docs/archive200x/2003/23/smw-10134.html
  • 23
    World Health Organization (WHO). Human Factores in patint safety: review of topics and tools [Internet]. 2009. [Access Dec 13, 2014]. Available from: Available from: http://www.who.int/patientsafety/research/methods_measures/ human_factors/human_factors_review.pdf
    » http://www.who.int/patientsafety/research/methods_measures/ human_factors/human_factors_review.pdf
  • 24
    Gutiérrez-Cía I, Merino de Cos P, Juan A Y, Obón-Azuara B, Alonso-Ovies A, Martin-Delgado A, Rodríguez JA, Aibar-Remón C. Percepción de la cultura de seguridad en los servicios de medicina intensiva españoles. Med Clín. (Barcelona). [Internet]. 2010 [Acceso 12 Enero 2016]1;135(Suppl 1):37-44. Disponible en: Disponible en: http://www.elsevier.es/es-revista-medicina-clinica-2-articulo- percepcion-cultura-seguridad-los-servicios-S0025775 310700191
    » http://www.elsevier.es/es-revista-medicina-clinica-2-articulo- percepcion-cultura-seguridad-los-servicios-S0025775 310700191
  • 25
    Agência Nacional de Vigilância Sanitária- ANVISA (BR). Portaria nº 359 de 1º de abril de 2013. Institui o Programa Nacional de Segurança do Paciente. Diário Oficial da União [Internet]. 2 de abril de 2013. [Acesso 15 ago 2016]. Disponível em: Disponível em: http://bvsms.saude.gov.br/bvs/publicacoes/documento_referencia_programa_nacional_seguranca.pdf
    » http://bvsms.saude.gov.br/bvs/publicacoes/documento_referencia_programa_nacional_seguranca.pdf
  • 1
    Supported by Fundação Cearense de Amparo à Pesquisa (FUNCAP), Brazil, process #12535685-4

Publication Dates

  • Publication in this collection
    2017

History

  • Received
    25 Apr 2016
  • Accepted
    02 Nov 2016
Escola de Enfermagem de Ribeirão Preto / Universidade de São Paulo Av. Bandeirantes, 3900, 14040-902 Ribeirão Preto SP Brazil, Tel.: +55 (16) 3315-3451 / 3315-4407 - Ribeirão Preto - SP - Brazil
E-mail: rlae@eerp.usp.br