Effects of a Modified Six-Sigma-Methodology-Based Training Program on Core Competencies in Rehabilitation Nurse Specialists

1. Backgroud

Given Chinese patients’ growing demand for medical treatment, cultivating high-quality rehabilitation specialist nurses is a major task of the China Nursing Career Development Plan (2016~2020) [1], which is of great significance in developing specialist nurse teams and improving the quality of specialist nursing. Rehabilitation nurses play an important role in reducing functional impairment, promoting functional recovery, reducing complications, improving patients’ quality of life, and enabling them to return to society as soon as possible [2]. However, currently, there remains a shortage of rehabilitation nurses in many developing countries and poor areas of the world [3]. In China specifically, the existing rehabilitation nurses lack systematic knowledge and skills in rehabilitation specialties, thus not meeting the patients’ rehabilitation needs [4, 5]. Therefore, improving nurses’ rehabilitation skills is an urgent task.

Rehabilitation nursing is a well-developed specialty in many countries. However, rehabilitation nurses’ training in developing countries and some distressed areas, including China, is still in the exploratory stage [6, 7, 8], and many grassroots hospitals in China have not yet established rehabilitation medicine departments or are currently in the preparatory phase [9]. The Rehabilitation Nursing Committee of the Chinese Society of Rehabilitation Medicine was the first to start a nationwide training course for rehabilitation specialist nurses in 2013, in which recruited nurses worked for more than three years in rehabilitation departments [10]. This course required learners to finish four weeks of theory and six weeks of clinical practice training. In their training model, the committee also pioneered a specialist nurse recertification system that compels learners to place more emphasis on further specialist studies after a short period of training. Learners must pass reassessment and certification after two years to obtain a “Rehabilitation Specialist Nurse Certificate.” Further, since 2012, training courses for rehabilitation nurses have been held in various provinces and cities in China [11, 12]. However, most training courses that include basic rehabilitation nurse training emphasize skill proficiency over educational skills, critical thinking, academic development, and leadership [13]. The Rehabilitation Specialist Nurse Training Base in Hunan, China, has recruited rehabilitation specialist nurses nationwide since 2015. To promote the widespread adoption of rehabilitation nursing across all regions, the screening criteria for admission into rehabilitation specialist education programs in China are kept relatively low [14]. Due to the fact that some hospitals in remote areas of China have not yet established rehabilitation departments many learners who participated in the Hunan Provincial Rehabilitation Specialist Nurse Training Course of China in 2019 came from neurology, neurosurgery, respiratory medicine, orthopedics, and other related departments. Nurses from different departments have different knowledge reserves in rehabilitation nursing and there are also significant differences in the rehabilitation content of patients with functional impairments among different departments, which has led to an uneven reserve level of professional knowledge and different learner training needs. This has led to great difficulties in specialized teaching [15], as the conventional training method does not always meet the needs of rehabilitation specialist nurses or lead to an improvement in their core competencies, in turn, leading to diminished satisfaction with training among learners [16].

The American Association of Rehabilitation Nurses [17] states that rehabilitation specialist nurses’ core competencies are their ability to promote healthy living, provide nursing intervention, ensure interprofessional nursing, and exhibit leadership skills. The International Council of Nurses defines core competencies as personal attributes, including knowledge, skills, and attitudes [18]. A study [19] has identified some areas of the core competency framework for specialist nurses, including clinical care delivery, leadership and management, ethical decision-making, expert guidance, and the ability to conduct clinical research, provide consultations, and collaborate with others. It is also important to emphasize that direct clinical care provision is a central aspect of specialist nurses’ roles, distinguishing them from individuals involved in nursing education or management. In the context of the American Nurses’ Association assessment of nurses’ competencies, the content of the modified Six-Sigma-based training program is mainly based on scoring learners’ core competencies, theoretical knowledge, operational skills, clinical nursing lectures, reviews, and nursing case management skills [20].

The Six Sigma methodology is an American innovation based on the development of total quality management [21]. This approach includes many pioneering achievements at the forefront of management and is a rigorous, focused, and efficient method to improve a company’s process management quality [22]. Six Sigma management is a process-advancing method rather than a quality program and can be used to analyze processes, quantify process characteristics from the status quo to the target, identify process goals and requirements, and discover methods and entry points for quality improvement [23]. Shah & Emerick [24] advocated the future use of Six Sigma to ensure patient safety, acquire quality improvements in anesthesiology, and address the growing healthcare-related challenges. Pocha [25] applied Six Sigma tools to optimize the nursing management process and improve patient satisfaction. Reportedly, lean Six Sigma techniques can reduce the duration and variability of patient inclinic time and increase service capacity in outpatient ophthalmology clinics without additional resource input [26]. Davidson et al. [27] pointed out that this methodology is also beneficial for continuous quality improvement in the education field and summarized the critical success sectors and barriers of Lean Six Sigma in higher education. Vaughn et al. [28] used the Six Sigma define, measure, analyze, improve, and control (DMAIC) strategy as a systematic approach to root cause analysis in their quality improvement course for orthopedic residents and achieved good results.

Therefore, to promote the popularization and development of rehabilitation specialist nurses, as well as enhance the quality of their training, the rehabilitation specialist nurse training base in Hunan Province adopted the Six Sigma method in a teaching reform to explore the effects of short-term rehabilitation specialist nurse training and provide valuable insights for developing countries and distressed areas.

2. Purpose and hypothesis

The purpose of this study was to examine the effect of the modified Six-Sigma-based training program against a conventional educational program on rehabilitation specialist nurses’ core competencies scores, post-training performance, and satisfaction.

The hypotheses are as follows: The modified training program based on the Six Sigma methodology is likely to improve rehabilitation nurses’ training satisfaction and enhance the cultivation of their core competencies.

1. Study design

The DMAIC process improvement method is an important part of the Six Sigma methodology and defines concrete interventions based on five steps: definition, measurement, analysis, improvement, and control. The duration of the intervention in this study was two months, that is, one month each for clinical practice and theoretical lectures, of which clinical practice was seven hours a day, five days a week, while theoretical lectures were forty-five minutes per session, two credit hours per course. Through the five steps of the Six Sigma DMAIC strategy, we improved training quality in three aspects: base management, theoretical teaching, and practical training.

2. The modified six-sigma-based training program

3) Analysis phase

Utilize statistical analysis tools to analyze the data collected to identify the critical factors influencing the process.

In this phase,we have compiled the opinions and suggestions of learners and teachers and conducted a teaching analysis meeting for rehabilitation specialist nurses to identify the reasons for the problems in the training of rehabilitation specialist nurses in recent years. We summarized the problems and reasons from three aspects and proposed countermeasures: training base management, theoretical teaching, and practical training. Further details are listed in Table 1.

Table 1
Analysis of Deficiencies in the Training of Rehabilitation Specialist Nurses and Training and Teaching Reform Program for Rehabilitation Specialist Nurses

• Click for larger image
• Click for full table
• Download as Excel file

3. Setting and sample

This study was conducted as a quasi-randomized controlled trial organized by the government during the 2020 and 2021 academic years, with a limited number of participating trainees. All students attending the training course at Hunan Provincial Rehabilitation Specialist Nurse Training Base (HRSNTB) were eligible for participation, and there were no exclusion criteria for learners. The control group consisted of 56 learners who participated in the 2020 training course at the HRSNTB, whereas the intervention group included 60 learners from the HRSNTB’s 2021 training course. In total, 116 participants were included in the study. All participants were fully engaged in the study and there were no drop-outs during the five steps. The data were collected in the same way for both groups after implementing the modified Six-Sigma-based training program. The effects of these two methods on the rehabilitation specialist nurses’ training were compared by evaluating the nurses’ pre- and post-intervention core competencies and satisfaction scores. The learners’ performance in terms of theoretical knowledge, operational skills, reviews, clinical nursing lectures, and nursing case management post-training was also compared between the two groups. All the learners participated voluntarily in this training and no ethical issues arose. As shown in Table 2, all 116 learners originally in the study completed training and acquired rehabilitation specialist nursing certifications. There were no statistically significant differences in the basic data between the two groups (p > .05).

Table 2
Comparison of Basic Information of the Two Groups of Participants

• Click for larger image
• Click for full table
• Download as Excel file

4. Data collection

5. Data analysis

Statistical analyses were performed using SPSS Statistics (version 22.0, IBM, Armonk, NY, USA) software. Categorical data are presented as case counts and percentages, and a t-test or rank sum test was used for comparisons between the two groups. Measurement data were represented by (X¯ ± s), and the comparison was made by two-sample t-test or variance analysis. Statistical significance was set at p < .05.

The core competencies of the rehabilitation specialist nurses in the two groups were evaluated using directly distributed paper questionnaires for surveys from pre- to post-test. Differences in training satisfaction between the two groups of learners after training were also evaluated. After training, operational skills, theoretical knowledge, reviews, clinical nursing lectures, and nursing case management were compared between the two groups.

6. Ethics considerations

All study participants were trainees of the HRSNTB who gave their informed consent to the study content and specific assessment indicators, which were collected in terms of age, years of work experience, work sector, educational background, and title, and assessment indicators, including theoretical knowledge, operational skills, clinical nursing lectures, reviews, and nursing case management scores. The study was conducted in accordance with the Declaration of Helsinki and approved by the Research Ethics Committee (No. LC2022105).

1. Core competencies

After the modified Six-Sigma-based training program, participants in the intervention group showed significant improvement on all the core competencies. Compared to the control group, the intervention group showed significant improvement in professional rehabilitation nursing ability (t = 16.83, p < .001), critical thinking skills (t = 20.99, p < .001), educational guidance ability (t = 16.61, p < .01), ability to support supervision (t = 18.04, p < .001), ability to communicate and collaborate (t = 19.61, p < .001), rehabilitation nursing management ability (t = 14.74, p < .001), professional development capability (t = 2.16, p = .03), and professional quality (t = 13.89, p < .001) following the intervention. Moreover, the participants in the intervention group showed significant improvement in professional rehabilitation nursing ability (t = 25.92, p < .001), critical thinking skills (t = 18.17, p < .001), educational guidance ability (t = 21.41, p < .001), ability to support supervision (t = 24.66, p < .01), ability to communicate and collaborate (t = 21.07, p < .001), rehabilitation nursing management ability (t = 14.67, p < .001), professional development capability (t = 5.32, p < .001), and professional quality (t = 22.12, p < .001) between the pre- and posttests (see Table 3).

Table 3
Comparison of the Scores of the Core Competencies of Rehabilitation Specialist Nurses between the Two Groups

• Click for larger image
• Click for full table
• Download as Excel file

2. Professional competence

All the participants completed the training program. In Figure 1, the scores (labeled on the y-axis) are broken down by each of the five aspects (labeled on the x-axis). The scores per aspect are represented on the graph, with the boxes indicating interquartile deviation and the marker in the middle of the box indicating the median score. The dotted lines or “whiskers” protruding from the top and bottom of the boxes indicate the minimum and maximum scores for the five aspects of the participants. Additionally, operational skills, reviews, and clinical nursing lectures each have one outlier represented on the graph by small dots at the low end of the scores. At the time of intervention termination, the scores for theoretical knowledge, reviews, clinical nursing lectures, and nursing case management were significantly higher in the intervention group than in the control group (p < .05), while operational skills scores were not statistically significantly different between the two groups (Z = -1.42, p = .156).

Figure 1
Comparison of scores of operational skill, theoretical knowledge, reviews, clinical nursing lectures, and nursing case management. ^*p < 0.05.

• Click for larger image
• Download as PowerPoint slide

3. Satisfaction with the training

As shown in Table 4, at the time of the intervention, base management satisfaction, theoretical teaching satisfaction, and overall satisfaction were significantly higher in the intervention group than in the control group (p < .05), while the difference in the clinical practice satisfaction scores between the two groups was not significant.

Table 4
Comparison of Degree of Satisfaction between the Two Groups of Learners after Training

• Click for larger image
• Click for full table
• Download as Excel file

1. Improvement in the core competencies

Although studies have investigated the effects of training programs on teaching clinical skills in rehabilitation nursing [13], few have discussed the training effectiveness of core competencies for specialized nurses. A systematic and professional rehabilitation nursing education program is important to promote nurses’ understanding of and professional development in the rehabilitation nursing profession. The results of this study show that the conventional teaching model was not effective in improving learners’ rehabilitation nursing management and professional development abilities, while the modified Six-Sigma-based training program promoted all dimensions of the rehabilitation specialist nurses’ core competencies. This is consistent with the study by Xiao et al. [30], which showed that the Six Sigma methodology can improve teaching quality in pediatric nurse training. A study conducted at a private hospital in Ireland demonstrated that the introduction of the Six Sigma model into a basic life support training program for medical staff led to improved satisfaction among participants. Furthermore, the study revealed that the implementation of the Six Sigma model significantly reduced the training time and costs for both the training departments and instructors involved [31].

The defects and deficiencies existing in conventional teaching were fully understood in the measurement- and-analysis stage of the Six Sigma management model, and teaching evaluation was standardized during the improvement stage [26], which resulted in improved teaching quality. Moreover, various assessment indicators were unified and quantified to ensure the scientific nature and rationality of the teaching effect evaluation. Standardized teaching evaluation has been widely implemented in nurse training programs across many countries because it provides an effective and objective method for assessing teaching effectiveness [32, 33]. Furthermore, in the improvement stage, the practice content of the relevant core competencies was added to the practice outline to ensure that training for various core competencies, such as education guidance, rehabilitation nursing management, and professional development abilities, was no longer limited to theory. In addition, a teaching feedback mechanism was established throughout the training to allow theoretical and practical teachers to reflect on and adjust their teaching plans in a timely manner, which promoted improvements in teaching quality.

We extended the training period for education reform. After completing the modified Six-Sigma-based training program, the rehabilitation specialist nurses’ core competencies achieved a marked improvement.

2. Improvement in professional competence

Specialist nurses are practitioners and promoters of professional development [34] who teach and conduct scientific research in clinical nursing work; therefore, improving their professional development abilities is of great importance. In this teaching reform, the scores for theoretical knowledge, reviews, clinical nursing lectures, and nursing case management for the intervention group were significantly higher than that for the control group. This is mainly due to the following reasons. First, we focused on stimulating the nurses’ active learning potential, adhering to problem-oriented teaching methods, and stimulating their desire for learning and exploration, which created a dynamic and innovative learning atmosphere. Thus, learners’ initiative and enthusiasm for learning increased significantly.

Second, in view of the learners’ weak abilities in reviews, clinical nursing lectures, and nursing case management, we provided scientific research nursing lectures throughout the training process to renew their knowledge structure and cultivate critical thinking ability. We extended the credit hours in this part of the training to ensure the teaching effect. We also implemented a one-to-one tutorial system to provide effective guidance for learners, which helped resolve their issues in a timely manner and improve their performance, consistent with the research of Qi & Wang [35]. Their study showed that the application of a “one-to-one” tutorial system combined with reflective teaching in nursing education for the intensive care department can significantly improve the nurses’ theoretical knowledge and operational skills in routine training and is conducive to improving their critical thinking ability.

Third, we paid special attention to students’ oral expression, teaching, and clinical thinking abilities. During the teaching process, we purposefully and relevantly arranged special discussions, special lectures, and health education lectures. We applied the case teaching method to operational training to increase the practicality of specialized operations and required learners to manage typical clinical cases throughout the course. In recent years, several countries have integrated clinical cases into training programs for specialized nurses [36, 37, 38], with the aim of enhancing their problem-solving abilities and bridging the gap between the teaching environment and real-world clinical settings [39]. In the process of clinical case management, we required learners to participate in nursing evaluations, diagnoses, treatment plans, and measures of clinical cases, as well as to track the nursing outcomes of patients. Finally, we summarized and reported the experience of managing the entire case. In this way, the learners’ clinical thinking and practical abilities significantly improved.

Compared with the conventional educational program, the modified Six-Sigma-based training program did not result in a higher operational skills score. Objective structured assessment reflects specialist nurses’ true operational levels and resilience in clinical applications [40]. In this study, we used traditional assessment methods after the teaching reforms. In future research, we need to discuss the impact of assessment methods on outcomes.

In addition, the duration of professional practice teaching was extended from one to two months, with the purpose of improving the clinical application of professional competence in rehabilitation, and the score of the intervention group in terms of nursing case management was significantly improved after the training program. This is consistent with the findings of a previous study [41]. As learning time is an important factor influencing learning outcomes [42, 43], these results suggest that future research should consider the best learning time when developing training programs to increase the effect of training.

3. Improvement in the learners’ satisfaction with the training

Learners’ satisfaction with the training is an indicator of the teaching effect. This study determined that the use of the modified Six-Sigma-based training program for rehabilitation specialist nurses was more beneficial than the use of conventional educational programs regarding training satisfaction, including base management and theoretical teaching.

This is possible for several reasons. First, the Six-Sigma-based education method strengthened the learners’ reward and punishment mechanisms, which increased their learning enthusiasm. Second, the application of emotional teaching in theoretical teaching allowed learners to understand the value of rehabilitation nursing and enhance their professional identity [44]. Third, the operational demonstration teaching method was added to the theoretical courses, fully combining theory and practice and increasing the interest and practicability of training courses [45]. Finally, we respected the feedback of the learners throughout the training and adjusted our teaching methods and content accordingly.

However, the improvement in clinical practice satisfaction was not significant, mainly because of the following reasons: First, the learners in the two groups were from different departments; only 41.1% to 53.3% of the learners were from rehabilitation departments in our education program; therefore, the learning focus and needs of learners were diversified. Furthermore, in the clinical practice stage, we chose different hospitals as clinical practice bases, resulting in uneven teaching levels and affecting the learners’ satisfaction with the clinical practice. Moreover, different teaching bases adopt different teaching methods; some clinical teaching bases still use conventional teaching modes, which cannot meet the diverse learning needs of learners. Although the clinical practice teaching syllabus and manual have been unified, some clinical practice teaching bases have also introduced social participatory teaching, which has been shown to stimulate learners’ empathy and improve their learning interest and communication abilities [46]. However, this type of teaching does not apply to all practice bases. Researchers have also found that diversified teaching methods such as clinical practice teaching, simulated ward teaching, and case teaching are more convenient for deepening learners’ understanding and improving their memory [47, 48]. In future, these practical teaching modes should be implemented to solve this problem.

4. Limitations

There were some limitations in the process of this specialty nursing teaching reform. First, we primarily focused on the improvement of theoretical knowledge and core competencies. Thus, the effect of training on rehabilitation practice was not apparent and needs to be further strengthened. Second, the learners’ clinical practice ability was assessed via specialist operation skills, but a gap remains between theory and practice. In the next step, we will continue to explore ways to improve specialist nurses’ clinical practice training. Third, the control and intervention training sessions were held at different times, approximately a year apart, which may have affected the accuracy of the results. Future research should include more participants and apply teaching reforms to different regions to verify their effectiveness.