http://orcid.org/0000-0001-8733-4406
Figures
Abstract
Objectives
This study sought to develop a tool for evaluating person-centered therapeutic relationships within physiotherapy services, and to examine the content validity of the same.
Methods
A mixed qualitative and quantitative study was performed in three distinct phases: 1) the items were generated based on a literature review and a content analysis of focus groups of patients and physiotherapists; 2) an e-Delphi survey process was performed based on three rounds to select and refine the proposed questionnaire; 3) two rounds of cognitive interviews were conducted to evaluate the comprehension of items, the clarity of language and the appropriateness and relevance of content.
Results
Thirty-one items were generated based on the seven domains identified after the analysis of four focus groups of physiotherapists and four patient focus groups. Nine experts participated in the e-Delphi survey. Fifty-five patients participated in the two rounds of the cognitive pre-tests. Participating patients were from public and private physical therapy services. Based on the participants’ suggestions, four items were removed, and four were added, whereas 16 were reworded.
Citation: Rodríguez Nogueira O, Botella-Rico J, Martínez González MC, Leal Clavel M, Morera-Balaguer J, Moreno-Poyato AR (2020) Construction and content validation of a measurement tool to evaluate person-centered therapeutic relationships in physiotherapy services. PLoS ONE 15(3): e0228916. https://doi.org/10.1371/journal.pone.0228916
Editor: Wen-Jun Tu, Chinese Academy of Medical Sciences and Peking Union Medical College, CHINA
Received: September 16, 2019; Accepted: January 27, 2020; Published: March 2, 2020
Copyright: © 2020 Rodríguez Nogueira et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: Authors JMB, ORN, MMG, MLC, JBR are recipients of a grant from CEU Cardenal Herrera University (www.uchceu.es) and the San Pablo University-Santander Foundation (FUSP). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Many professions recognize person-centered care (PCC) as being both a standard of quality [1], and a primary goal in itself [2]. In addition, PCC is understood as being a moral philosophy for health professionals seeking to provide the highest quality health care [3]. Despite the significance of PCC as an approach to care, there is no clear consensus regarding the definition of the same, nor its underlying dimensions [1,4–9]. Thus, a number of definitions are found for PCC and its components. According to the scientific literature reviewed, the therapeutic relationship established between the professional and the person receiving care is an inherent construct in the definition of PCC, understood as one of the fundamental factors underlying care. To illustrate this, the following different definitions of PCC are noted: “the interactions and alliance between the health professional and the patient, based on communication, health promotion and healthy lifestyles”; concern for providing individualized treatments, respecting people’s rights and the construction of a therapeutic relationship based on understanding and mutual trust [10]; a construct based on at least three different and important domains: communication, collaboration and health promotion [11]; the creation of a therapeutic narrative between the professional and the person, based on mutual trust, understanding, and sharing of knowledge [12]; a holistic approach for providing respectful and individualized care, enabling negotiated care, and offering choices within a therapeutic relationship, facilitating the patient’s involvement in health decisions as far as the person wishes to do so [13]. The model by Mead & Bower, probably the most frequently used for defining PCC, is based on five dimensions [14]: 1) the biopsychosocial perspective; 2) the “patient-as-person”; 3) sharing power and responsibility; 4) the therapeutic alliance; and 5) the “doctor-as person”, establishing the relationship between the professional and the person, as being key for development [4].
In addition, several authors have described certain characteristics of the therapeutic relationship as a means for establishing PCC. Thus, Constand et al [15] speak of communication and partnership; Zimmermann et al [9] highlight interactions and relationships, considering it important for professionals to be friendly and attentive; Hobbs [8] refers to “therapeutic engagement” and trust; Castro et al [4] underline empathy, trust, and individualized treatment; Rathert et al [5] establish the importance of respect, information, education, communication and emotional support; Wijma et al [6] mention trust, verbal communication adapted to the patient, nonverbal communication, and active listening; Scholl et al [16] highlight the importance of a reciprocal relationship characterized by constancy, trust, connection, mutual care, mutual knowledge, construction of a positive relationship and mutual understanding of roles and responsibilities.
Physiotherapy is adopting a biopsychosocial model [17], acknowledging that individual experiences, such as the social, cultural, psychological and contextual factors of a person exercise a strong influence on pathology and recovery [18]. Under this new paradigm, the establishment of PCC and a relationship between physiotherapists and those who receive care appear to be key for therapeutic success [19–21]. Indeed, there is a strong consensus among health professionals who believe quality of care directly depends on the establishment of a therapeutic relationship based on the individual [21,22].
Despite this, the PCC concept in physiotherapy is still poorly understood [6], and there is a lack of means for evaluating the established therapeutic relationship [21,23,24]. To construct an instrument that measures patient perceptions, content validity is the most important measurement property [25]. It is the degree to which the content of the instrument adequately reflects the construct to be measured in terms of relevance, clarity and coherence [26]. In order to obtain a degree of agreement regarding these three characteristics, the Delphi methodology is used, where a panel of experts, through several rounds of consultation, reach a previously established level of consensus [27,28].
Considering the need to establish the model of PCC in the field of physiotherapy and the importance of the person-centered therapeutic relationship within this model, this study sought to design an assessment tool and examine its content validity.
Material and methods
We used a mixed qualitative and quantitative study design. As depicted in Fig 1, our collaborative team of researchers (ORN, JMB, JBR, MCMG, MLC) conducted this study in three stages: 1) item generation, 2) item selection, and 3) pretesting of the questionnaire.
Stage 1. Item generation
The items were generated via a review and analysis of the literature, based on two constructs: person centered care and person-centered therapeutic relationship. These findings enabled us to extract the components of each construct and create a question guide to explore the barriers and facilitators for the establishment of a person-centered relationship in physiotherapy services. This stage was performed via a qualitative study based on focus groups involving physiotherapists [23] and patients of physiotherapy services [29]. The findings from this study were used to develop a conceptual framework comprised of domains and subdomains.
The questionnaire items were created based on the identified subdomains. Thus, each member of the research team independently proposed several items for each subdomain [30]. The wording of the items was based on the quotes of the physiotherapists and patients who participated in the previous qualitative study [30,31].
Subsequently, two members of the research team (ORN, JMB) revised the items, selecting and modifying those which best suited the domains that they sought to improve, in order to enhance understanding of the same, avoid redundancy, maintain the conceptual framework and ensure conceptual coherence with the literature. To resolve any discrepancies between the two members of the research team (ORN, JMB), an independent researcher trained in therapeutic relations and in the study method was consulted (ARMP), who acted as reviewer. Through discussions and consensus directed by (ARMP), the advantages and disadvantages of each of the modified items were analyzed and, based on the same, an informed decision was made [32,33]. The items that were ultimately selected formed part of the initial questionnaire during the subsequent phase.
Stage 2. Item selection
We conducted a three-round modified Delphi survey process via email correspondence to select and refine the proposed questionnaire (Fig 1). The purpose of the e-Delphi survey was to reach a consensus among the target users regarding clarity (ease of understanding), coherence (logical relation with the dimension or indicator that is being measured), and relevance (it is essential or important and therefore it must be included) of the items, as well as whether the items that belong to each dimension were sufficient in order to define and evaluate the dimension, or whether any aspect was overlooked [34].
Settings and participants.
Theoretical sampling was used for the selection of participants in this study. This approach enables the selection of participants according to their relationship with the study phenomenon and following a criteria of suitability [35]. The chosen criteria were: 1) Health professionals interested in the patient-centered therapeutic relationship; 2) With knowledge and experience on this subject; 3) Who had demonstrated their capacity to theorize about the chosen subject, via research projects, theses, articles, communications, etc. during the previous three years [36,37].
A heterogeneous sample was sought in relation to the participants’ profession and age. Several authors have highlighted that a heterogeneous sample produces a higher proportion of quality responses compared to a homogenous group, as there is a certain diversity of points of view, generated by greater interest and reflection [38].
Recruitment took place by email and/or telephone. To do so, we revised which Spanish authors had published anything related with the subject under study during the previous three years, or who were presently conducting research on the subject. Special care was made to ensure that the study participants and their names remained anonymous, and we attempted to avoid recruiting participants belonging from institutions with which we have ties.
Each prospective participant was sent a letter with information on the study and a description of the Delphi process, as well as an informed consent form. Once the informed consent was signed and returned, participants were sent a questionnaire with the preselected items. To ensure that the participants were aware of the meaning of each dimension and sub dimension, we included a document with references to support the same.
Data collection.
During the first round of the survey, the participants were asked to: 1) express their degree of agreement regarding clarity, coherence, and relevance for each of the items (1–4; 1 = strongly disagree, 4 = strongly agree); 2) if participants responded anything other than 4 = strongly agree, they were asked to justify their response, explaining how exactly they considered that item had failed, and providing optional recommendations for the improvement of the same; 3) lastly, considering the criteria of sufficiency, participants were asked to suggest new items for the subdomains treated, or for creating a new subdomain, if they considered this to be necessary.
After two members of the team (ORN, JMB) reviewed the participants’ responses, the questionnaire was sent to the participants, once again, with the modified items, an anonymous summary of the responses of all participants, and the mean results of each item. The participants were asked to repeat the same process considering all items.
After the second round, the questionnaire was revised once again by two members of the team (ORN, JMB) and, once more, a report was sent to all participants who were asked to repeat steps one and two.
Across the three rounds, we applied the same quantitative selection criteria for each item: 1) a mean score of ≥ 3.25 for degree of agreement, and 2) a rating of 3 or higher for degree of agreement among ≥ 70% of the participants in the Delphi survey [36]. Furthermore, we considered the recommendations made by the participants. Thus, when an item received new suggestions regarding wording, these suggestions were included and voted on in the following round. An item passed the selection stage when criteria one and two were fulfilled. If one of the two criteria was not fulfilled, a new wording was added, based on the participants’ recommendations. Likewise, if a new item appeared, this was subsequently voted upon.
Stage 3. Pretesting of questionnaire
With the provisional questionnaire obtained after the performance of the Delphi survey, we performed a cognitive pre-test, with the following objectives: 1) To evaluate the understanding of the items and of the response options; 2) To evaluate the clarity of the language and format; 3) To evaluate the appropriateness and relevance of the content and the possible lack of aspects that were not initially considered; 4) To review any problems related to the order of questions or any interactions among the same; 5) To examine the perception of length or overall burden of the assessment tool.
Individual interviews were conducted using the probing based paradigm, in which the interviewer proactively guides the interaction, asking questions and using probing questions [39]. For this purpose, retrospective probing was used [39], where the participant responds to the complete questionnaire after which the interview takes place. Some authors consider that this is the weakest approach, because the participant may have forgotten what they were thinking when they responded to the question [40]. However, in this study, it was adapted to the circumstances in which the tool was to be applied: i.e. self-administration.
Settings and participants.
The participants in this phase were patients with similar characteristics to those to whom the definitive tool was to be applied. For this, we established the following selection criteria: 1) patients over 18 years old; 2) who had received, at least, 15 physiotherapy treatment sessions; 3) without any cognitive impairments and comprehension difficulties.
The participants were recruited from two hospitals within the Spanish public health system (Madrid, A Coruña) and four private physiotherapy centers (Madrid, Orense, Elche) using convenience sampling methods. The physiotherapists from the centers where the respective patients received care were responsible for selecting and inviting participants. These health professionals participated voluntarily in the research and were previously informed of the study aims and the inclusion criteria for the patients during a designated meeting.
During the interviews, the researcher began by informing the participant of the study aim and provided an informed consent for the participant to sign. The participant subsequently completed the questionnaire. The participant was informed beforehand not to ask the researcher the meaning of any question. Should any participant have a query, they were asked to write the same in a blank text box included in the questionnaire. Once the questionnaire was completed, the researcher asked the participant about the meaning given to each item. This was done using several strategies, such as asking what the person had understood from the question or asking the participant to restate the questions using different wording. Finally, the participants were asked if they considered that any of the questions were inappropriate or unnecessary, whether they felt any item was missing, and to assess the difficulty of the questionnaire on a scale of 0 to 10 (0 = no difficulty; 10 = very difficult). In addition, they were asked whether they considered that the length of the questionnaire was appropriate or too long. The time that each participant took to complete the questionnaire was recorded, as an indirect measure of the difficulty of the same.
Four members of the research team conducted the interviews (ORN, JMB, JBR, MLC). Several interviewers were used, rather than a single interviewer as, although theoretically, the participants responses should be independent of the interviewer [41], there is evidence suggesting that the personality of the interviewer may influence the participants’ responses [41,42]. All the interviewers had training and experience in conducting cognitive interviews.
Data analysis.
All the interviews were transcribed verbatim. Two researchers (ORN and JMB) analyzed the participants’ responses and coded any possible problems. For this purpose, a coding system was created, which corresponded with the four stages of the question-response process of CASM (Cognitive Aspects of survey Methodology)[43], adding a category related to instrument logic (S2 Table). A list was created with the items, the potential problems associated to each item, the proposals for changes, suggestions for new items, changes in the order, the format and the instructions, and data on the perception of difficulty and duration of the questionnaire. This list was presented to the entire research team. Subsequently, the research team met, discussed, and reached an agreement by consensus on whether to keep, modify, or remove each potentially defective item. Any potential problems were addressed from both a quantitative point of view (items with a frequency of acceptance below 85% required revision)[44] as well as a qualitative point of view. This collaborative approach sought to eliminate the potential bias of a single researcher’s perspective.
Ethical considerations.
Each participant in the item generation phase granted consent. Participants provided informed written consent and indicated whether they wanted to be explicitly acknowledged in this paper. This study was approved by the Ethics Committee of the Cardenal Herrera CEU University, the ethical committees of the 12 de Octubre Hospital of Madrid and the General University Hospital of A Coruña.
Results
Item generation
Initially, 215 items were generated, based on the seven domains and 28 subdomains identified in the previous qualitative study (Table 1) [23,29].
After revising the proposed items, 184 items were removed as these were either considered redundant, or they clearly failed to represent the subdomain or because their wording could be improved. Of the 31 remaining items, the wording of 11 items was slightly modified. These items were assigned to the different subdomains of our previous conceptual framework, as follows: personal characteristics of the professional, (n = 6), capacity of communication (n = 6), professional aspects (n = 4), relational aspects (n = 6), personalized therapy (n = 2), partnership (n = 4), and environment (n = 3)
Item selection
Of the 11 participants contacted for participation in the Delphi survey, two failed to respond. The nine remaining participants participated in the three rounds. Table 2 displays the sociodemographic characteristics of the nine participants in the Delphi survey. All had professional experience related with the survey theme or they were, or had been, involved in research projects related with the same.
Round 1 of the Delphi Survey lasted 3.5 months. As a result, 30 items (96.77%) fulfilled at least one of the two quantitative selection criteria, whereas one item failed to fulfill any criteria and was, therefore, removed. Four items did not fulfill one of the two selection criteria, therefore they were reformulated following the suggestions provided by the participants. Among the items that fulfilled the two selection criteria, in many of these, the participants made suggestions to improve the wording (between two and five suggestions), and provided comments about the item (between one and five). For example, in the case of the item The treatment from my physiotherapist makes me feel better, which was scored ≥ 3 by 100% of the participants, obtaining a mean score of 3.89, participants suggested the item be reworded as The treatment from my physiotherapist makes me feel better emotionally. Likewise, the item You agree on the therapeutic objectives and the treatment, which had fulfilled both criteria, was suggested to be reformulated as You make a joint agreement on the therapeutic objectives and the treatment. After reviewing the survey responses, the comments were discussed, together with the best proposals for the wording of the items and a new wording for the questionnaire was agreed by consensus, which included changes in 25 items. Likewise, one new item was included as proposed by participants. Finally, 31 items were included in the questionnaire presented in round two.
Round two lasted two months. Thirty items (96.77%) fulfilled the two quantitative selection criteria. One item, do you feel that what you say is important for him/her and he/she tries to understand you? changed from a score of 88.8% and 3.56 to 77.7% and 3.22, without fulfilling one of the criteria. The item I believe that my physiotherapist and I have connected, although it fulfilled both criteria, received a lower score compared to round one. These two items were reformulated based on the suggestions made by participants. This data is displayed in S1 Table.
In the case of the item does he/she know how to tell you what he/she needs to say, clearly and firmly, without making you feel bad?, which sought to measure assertiveness, 88.8% of participants evaluated this item with ≥ 3 and a mean score of 3.56, and one participant commented that it failed to include all the domains of assertiveness, whereas another participant proposed to change it to does he/she give you the necessary information, clearly and firmly, without making you feel bad?. For the item, after explaining exercises or health advice, later asks you about these and goes over them if necessary, 100% of participants scored it ≥ 3, obtaining a mean score of 3.67, which sought to measure the follow-up of home prescriptions. One participant commented that the term “care advice” could be in conflict with nursing competences, and proposed replacing the term with health advice.
After analyzing and discussing these four cases, a third round took place with all items. This third round lasted three weeks, during which the scores for the modified items fulfilled the selection criteria. The two items which had received lower scores in the second round attained a higher score and the participants did not provide any new suggestions. Therefore, these items were included in the final questionnaire.
Finally, a questionnaire was designed, based on 31 items, which was used for the subsequent stage.
Pretesting of questionnaire
Two rounds of cognitive interviews were performed with 55 participants (n = 45 in the first round and n = 10 in the second round).
The duration of each interview was between 24 and 66 minutes. The mean time that participants took to complete the questionnaire was 6 minutes 40 seconds (3’ 2’” the fastest and 15 minutes the slowest). The perceived length of the same was deemed appropriate for most participants (88%). The mean perceived difficulty of the questionnaire was 2 (0 = very easy; 10 = very difficult).
The sociodemographic characteristics of the participants in both rounds are displayed in Table 3.
The qualitative analysis of the interviews conducted during the first round revealed potential problems affecting 30 items, these concerned the response scale, the format and the structure of the questionnaire. Thus, 239 potential problems were detected in the first round, and 15 in the second round (the results of the cognitive pretest can be consulted in Table 4).
Three people indicated that a central response option was lacking for the entire questionnaire. Comprehension problems affected 24 items in round one and one item in the second round. For example, in the item do you feel that what you say is important for him/her and he/she tries to understand you? some users were unable to understand the item, whereas other understood it with a different meaning to what was initially intended (assuming that the patient was the one who had to understand the physiotherapist). Eleven items presented instrument logic problems in round one, whereas in round 1, only one item was affected. For example, some participants said that the item does he/she give you the necessary information, clearly and firmly, without making you feel bad? contained several questions. Fourteen items presented judgement problems in the first round and two in the second round. For example, for item understands how you feel and tries to put him/herself in your place? one patient stated: “I understand the question, but I have no way of knowing”. Or the item has made you feel judged at any time?, for which two participants stated that it was “a very severe accusation”. Fifteen items presented reporting problems in the first round. For example, two participants told us that in item The treatment from my physiotherapist makes me feel better emotionally, a response option was missing (an intermediate score).
Several participants commented that the introductory sentence which was placed after the items to which they had to respond hampered the comprehensin of the same.
Finally, four items were removed, and 16 were reformulated according to the participants’ suggestions. For example, the item makes you believe in your capabilities to get ahead with your effort? was reworded as… makes you believe that you are able to get ahead with your effort? In addition, based on the participants’ proposals, four new items were added. Lastly, the format of the document was changed, as well as the order of 14 items, and the heading providing the context of the items was removed.
With the refined questionnaire, a second round of cognitive interviews was performed. In this second round, all the items fulfilled the quantitative acceptance criteria, no important potential problem was detected from the qualitative point of view and there were no new suggestions, neither were there any potential problems in the format of the document or with the order of the questions.
The final tool contains 31 items divided into seven domains. The response format is based on a 5-point Likert frequency scale. Response options range from “strongly agree” to “strongly disagree”. A subsequent study will calculate the psychometric properties of this tool.
Discussion
The relationship that is established between professionals and patients is of vital importance for establishing person centered care; a priority for the reorganization of health care in the 21st century [6]. In this study, we present a process of construction and content validation of a questionnaire to measure the therapeutic patient centered relationship in physiotherapy. The content validity guarantees that the elements included in the tool reflect the construct of the same. To the best of our knowledge, no instrument of these characteristics exists in physiotherapy services. The most used instruments to evaluate this relationship are the Working Alliance Inventory (WAI) and The Helping Alliance Questionnaire Version Two (HAQ-II)[21,45]. Both measure the “therapeutic alliance” construct, which means collaboration, warmth and support between the client and the therapist [46]. However, this is only one part of the therapeutic relationship construct [47] necessary for the establishment of PCC[14], thus, a content validation of the remaining domains required for establishing a supportive PCC relationship is clearly called for.
The different processes used for the construction and validation of this questionnaire add strength to its content validity. Firstly, by basing this study on a previous review of the literature, one of the necessary requirements is fulfilled to ensure an adequate psychometric guarantee: the definition of the evaluated construct and its components[48].
One of the strengths of this study is that it considers the point of view of the patients who received the care. Considering that the opinions of the professionals and patients can differ in important elements [49], focus groups were conducted where, besides the perceptions of physiotherapists, [23], the perceptions of the 31 patients were gathered, which was key for establishing the seven domains of the instrument [29] and for generating the items of the same.
In the item generation phase, a method was used that with demonstrated its validity [30,31]. In addition, the team of researchers who participated in this phase were asked to try to create items using the vocabulary that had previously been analyzed in the qualitative study, in order to improve comprehension.
Once the items were generated, a Delphi methodology was used to assess clarity, coherence and relevance, as well as the sufficiency of the items belonging to each dimension to obtain measurement scores. The Delphi method is considered to be the method of choice for a structured group discussion with the objective of reaching a high group consensus [50] and has been used in various types of studies, including the creation and validation of questionnaires [51]. Among other characteristics, it is worth noting that this method allows experts to issue opinions blinded to the opinions of other experts in the first phase, and to achieve an anonymous consensus, avoiding a "leading effect" bias [50]. This is how this process was conducted, preventing experts from knowing the identity of the other experts who collaborated. The high rate of agreement achieved after the consultation rounds, and the fact that all dimensions and subdimensions were recognized as relevant, not including any more feedback by the experts, gives us the idea of the content validity of the instrument. We considered it relevant to indicate that the criteria for the selection of items in our study were similar [36] or even more severe than those commonly used in the literature. In addition, the introduction of a system that allowed participants to make qualitative contributions through open-ended responses improves the validation process.
Two rounds of cognitive pretesting were completed, the first, with 45 patients, and a second round with 10 patients, thus complying with the known sample size for conducting a cognitive pretest which is between five and 15, per round [42]. We were stricter than what the literature tends to advise with regards the review of items after a cognitive pretest as, even the items that were above what the literature suggests as being the percentage of acceptance for revising an item [44], we introduced minor changes based on the participants’ suggestions, when the research team considered that these suggestions would effectively improve the item. These changes were subsequently well received by the participants.
Our intention, among others, was for patients to evaluate both the understanding. of the items, as well as their relevance and a possible lack of important aspects not initially considered. The cognitive pre-test technique, by means of cognitive interviews, is a resource commonly used for this purpose, with good results [36]. This technique involves patients with similar characteristics to those to whom the final tool is addressed, providing us of an idea of the importance given to the patients’ perceptions in the drafting of a tool which intends to measure patient centered care. Thus, after the cognitive pre-test, 10 items were removed, and another 10 were added, as proposed by participants, while a further seven were partially reformulated. All of this was intended to improve the understanding. of the items, as there were no discrepancies regarding the relevance of the same.
One of the key factors for establishing the PCC is teamwork and the establishment of objectives and treatments based on the patient’s beliefs and interests [11–13]. To evaluate this, the questionnaire includes a partnership dimension, consisting of four items. One of these refers to reaching agreements for establishing treatment objectives: My physiotherapist and I agree on what I want to achieve from the physiotherapy treatment, while another refers to agreements concerning treatment plans: My physiotherapist and I agree on which treatment to follow. Some of the most relevant comments made by patients during the cognitive pre-test were that the weight of the decision relies on the physiotherapist or that the patient does what the physiotherapist tells them to do, and that the one who knows what to do is the physiotherapist, or that the patient just agrees to everything. The patients understood the meaning of the items but were not accustomed to establishing objectives based on their preferences and, even less, deciding on treatment options. Typically, they were only provided with information of their problem and the treatment that they were to receive, perceiving that when the physiotherapist tells them to do something, they must comply. This underlines the need to construct and validate the present assessment tool, in order to be able to evaluate the relationship competences of physiotherapists and to influence the education of professionals in order to establish PCC.
Regarding the Delphi methodology, it is important to highlight that this method allows experts to provide opinions blinded to the opinions of other experts during the first stage, and the achievement of an anonymous consensus, avoiding a “leader effect” bias [52]. These methods were used to avoid the experts knowing the identity of the other experts collaborating in the study. Concerning the number of experts necessary when using this methodology, there is no established consensus, although a number of experts of around 10 is usually considered sufficient to be considered valid [53,54]. In our case, the number of experts was nine, which we consider to be sufficient, considering the heterogeneity of the sample [55]. The high rate of agreement achieved after the consultation rounds, and the fact that all the domains and subdomains were recognized as being relevant, without suggestions for further items to be included on behalf of the experts, helps support the validity of the instrument content. Furthermore, the introduction of a system to enable participants to provide qualitative suggestions regarding the aspects studied (clarity, coherence, relevance and sufficiency), allowed participants to propose new items, which improves the process of validation.
This study presents a series of limitations. The most important is the non-inclusion of patients within the Delphi methodology. We feel that the therapeutic relationship is a construct for which its meaning and essence is still being explored [56]. Therefore, we preferred to gather an opinion regarding the domains found and whether the items expressed the subdomains which they hoped to measure by consulting experts on the subject.
In conclusion, we present the content validity of an assessment tool for examining the quality of the therapeutic person centered relationship in physiotherapy services. This tool comprises seven domains and 31 items. We consider that it is a useful and appropriate tool for studying PCC, and that it will be invaluable for facilitating the understanding. and establishment of PCC in physiotherapy services.
Supporting information
S2 Table. Coding system for the analysis of cognitive interviews.
https://doi.org/10.1371/journal.pone.0228916.s005
(PDF)
Acknowledgments
We would like to thank the uninterested and essential collaboration of the 426 experts who participated in the Delphi study as well as the managers, physiotherapists and patients of the following hospitals: 12 de Octubre (Madrid), General University (Valencia), General University and Vinalopó Hospital (Elche), and Physiotherapy Clinic Actualfisio (Madrid). Finally, we would like to acknowledge the financial support given by the Programa de Ayuda para Grupos Precompetitivos FUSP-Santander from Universidad CEU Cardenal Herrera.
References
- 1. Sidani S, Fox M. Patient-centered care: clarification of its specific elements to facilitate interprofessional care. J Interprof Care 2014;28:134–41. pmid:24329714
- 2. Wagner EH, Bennett SM, Austin BT, Greene SM, Schaefer JK, Vonkorff M. Finding Common Ground: Patient-Centeredness and Evidence-Based Chronic Illness Care. J Altern Complement Med 2005;11:s-7–s-15. https://doi.org/10.1089/acm.2005.11.s-7.
- 3. Epstein RM, Franks P, Fiscella K, Shields CG, Meldrum SC, Kravitz RL, et al. Measuring patient-centered communication in patient-physician consultations: theoretical and practical issues. Soc Sci Med 2005;61:1516–28. pmid:16005784
- 4. Castro EM, Van Regenmortel T, Vanhaecht K, Sermeus W, Van Hecke A. Patient empowerment, patient participation and patient-centeredness in hospital care: A concept analysis based on a literature review. Patient Educ Couns 2016. https://doi.org/10.1016/j.pec.2016.07.026
- 5. Rathert C, Williams ES, Mccaughey D, Ishqaidef G. Patient perceptions of patient-centred care: Empirical test of a theoretical model. Heal Expect 2015;18:199–209. https://doi.org/10.1111/hex.12020.
- 6. Wijma AJ, Bletterman AN, Clark JR, Vervoort SCJM, Beetsma A, Keizer D, et al. Patient-centeredness in physiotherapy: What does it entail? A systematic review of qualitative studies. Physiother Theory Pract 2017;33:825–40. pmid:28820617
- 7. Cheng L, Leon V, Liang A, Reiher C, Roberts D, Feldthusen C, et al. Patient-centered care in physical therapy: definition, operationalization, and outcome measures. Phys Ther Rev 2016;21:109–23. https://doi.org/10.1080/10833196.2016.1228558.
- 8. Hobbs JL. A Dimensional Analysis of Patient-Centered Care. Nurs Res 2009;58:52–62. pmid:19092555
- 9. Zimmermann L, Konrad A, Müller C, Rundel M, Körner M. Patient perspectives of patient-centeredness in medical rehabilitation. Patient Educ Couns 2014;96:98–105. pmid:24862911
- 10. Leplege A, Gzil F, Cammelli M, Lefeve C, Pachoud B, Ville I. Person-centredness: Conceptual and historical perspectives. Disabil Rehabil 2007;29:1555–65. pmid:17922326
- 11. Little P, Everitt H, Williamson I, Warner G, Moore M, Gould C, et al. Preferences of patients for patient centred approach to consultation in primary care: observational study. BMJ 2001;322:468–72. pmid:11222423
- 12. McCormack B, McCance T V. Development of a framework for person-centred nursing. J Adv Nurs 2006;56:472–9. pmid:17078823
- 13. Morgan S, Yoder LH. A Concept Analysis of Person-Centered Care. J Holist Nurs 2012;30:6–15. pmid:21772048
- 14. Mead N, Bower P. Patient-centredness: a conceptual framework and review of the empirical literature. Soc Sci Med 2000;51:1087–110. pmid:11005395
- 15. Constand MK, Macdermid JC, Bello-haas VD, Law M. Scoping review of patient-centered care approaches in healthcare 2014;14:1–9.
- 16. Scholl I, Zill JM, Härter M, Dirmaier J. An integrative model of patient-centeredness-A systematic review and concept analysis. PLoS One 2014;9. https://doi.org/10.1371/journal.pone.0107828.
- 17. Kamper SJ, Apeldoorn AT, Chiarotto A, Smeets RJEM, Ostelo RWJG, Guzman J, et al. Multidisciplinary biopsychosocial rehabilitation for chronic low back pain. Cochrane Database Syst Rev 2014;350:h444. https://doi.org/10.1002/14651858.CD000963.pub3.
- 18. Sanders T, Foster NE, Bishop A, Ong BN. Biopsychosocial care and the physiotherapy encounter: physiotherapists’ accounts of back pain consultations. BMC Musculoskelet Disord 2013;14:65. pmid:23421415
- 19. Del Baño-Aledo ME, Medina-Mirapeix F, Escolar-Reina P, Montilla-Herrador J, Collins SM. Relevant patient perceptions and experiences for evaluating quality of interaction with physiotherapists during outpatient rehabilitation: a qualitative study. Physiotherapy 2014;100:73–9. pmid:23778264
- 20. O’Keeffe M, Cullinane P, Hurley J, Leahy I, Bunzli S, O’Sullivan PB, et al. What Influences Patient-Therapist Interactions in Musculoskeletal Physical Therapy? Qualitative Systematic Review and Meta-Synthesis. Phys Ther 2016;96:609–22. pmid:26427530
- 21. Hall AM, Ferreira PH, Maher CG, Latimer J, Ferreira ML. The influence of the therapist-patient relationship on treatment outcome in physical rehabilitation: a systematic review. Phys Ther 2010;90:1099–110. pmid:20576715
- 22. Mudge S, Stretton C, Kayes N. Are physiotherapists comfortable with person-centred practice? An autoethnographic insight. Disabil Rehabil 2014;36:457–63. pmid:23713969
- 23. Morera-Balaguer J, Botella-Rico J, Martínez González M, Medina-Mirapeix F, Rodríguez Nogueira Ó. Physical therapists’ perceptions and experiences about barriers and facilitators of therapeutic patient-centred relationships during outpatient rehabilitation: a qualitative study. Brazilian J Phys Ther 2018;22:328–35. https://doi.org/10.1016/j.bjpt.2018.06.005.
- 24. Murray A, Hall A, Williams GC, McDonough SM, Ntoumanis N, Taylor I, et al. Assessing physiotherapists’ communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool. Disabil Rehabil 2018:1–7. https://doi.org/10.1080/09638288.2018.1443159
- 25. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol 2010;63:737–45. pmid:20494804
- 26. Terwee CB, Prinsen CAC, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, et al. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual Life Res 2018;27:1159–70. pmid:29550964
- 27. Falzarano M, Pinto Zipp G. Seeking consensus through the use of the Delphi technique in health sciences research. J Allied Health 2013;42:99–105. pmid:23752237
- 28. Sampaio FMC, Sequeira C, Lluch Canut T. Content Validity of a Psychotherapeutic Intervention Model in Nursing: A Modified e-Delphi Study. Arch Psychiatr Nurs 2017;31:147–56. pmid:28359426
- 29. Morera-Balaguer J, Botella-Rico JM, Catalán-Matamoros D, Martínez-Segura O-R, Leal-Clavel M, Rodríguez-Nogueira Ó. Patients’ experience regarding therapeutic person-centered relationships in physiotherapy services: A qualitative study. Physiother Theory Pract 2019:1–11. https://doi.org/10.1080/09593985.2019.1603258.
- 30. Kim SC, Boren D, Solem SL. The Kim Alliance Scale: Development and Preliminary Testing. Clin Nurs Res 2001;10:314–31. pmid:11881945
- 31. Medina-Mirapeix F, del Bano-Aledo ME, Martinez-Paya JJ, Lillo-Navarro MC, Escolar-Reina P. Development and Validity of the Questionnaire of Patients’ Experiences in Postacute Outpatient Physical Therapy Settings. Phys Ther 2015;95:767–77. pmid:25413623
- 32. Finger ME, Cieza A, Stoll J, Stucki G, Huber EO. Identification of Intervention Categories for Physical Therapy, Based on the International Classification of Functioning, Disability and Health: A Delphi Exercise. Phys Ther 2006;86:1203–20. pmid:16959669
- 33.
Corbin J SA. Basics of qualitative research: techniques and procedures for developing grounded theory. 3rd editio. Los Angeles: 2008.
- 34. Escobar-Pérez J, Cuervo-Martínez Á. Validez de contenido y juicio de expertos: una aproximación a su utilización. Av En Medición 2008;6:27–36.
- 35. Leal-Costa C, Tirado-González S, Van-Der CJ, Román H, Rodríguez-Marín J. Creación de la Escala sobre Habilidades de Comunicación en Profesionales de la Salud, EHC-PS 2016;32:49–59. https://doi.org/10.6018/analesps.31.3.184701.
- 36. Hamilton CB, Hoens AM, McQuitty S, McKinnon AM, English K, Backman CL, et al. Development and pre-testing of the Patient Engagement in Research Scale (PEIRS) to assess the quality of engagement from a patient perspective. PLoS One 2018;13:1–18. https://doi.org/10.1371/journal.pone.0206588.
- 37. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs 2000;32:1008–15. pmid:11095242
- 38. Powell C. The Delphi technique: myths and realities. J Adv Nurs 2003;41:376–82. pmid:12581103
- 39.
Gordon B. Willis. Cognitive Interviewing in Practice: Think-Aloud, Verbal Probing, and Other Techniques. In: Thousand Oaks CSP, editor. Cogn. Interviewing, 2455 Teller Road, Thousand Oaks California 91320 United States of America: SAGE Publications, Inc.; 2005, p. 42–65. https://doi.org/10.4135/9781412983655.n4.
- 40.
Ericsson A, Simon HA (Herbert A. Protocol analysis: verbal reports as data. MIT Press; 1993.
- 41. Conrad FG, Blair J. Sources of Error in Cognitive Interviews. Public Opin Q 2009;73:32–55. https://doi.org/10.1093/poq/nfp013.
- 42. Beatty PC, Willis GB. Research Synthesis: The Practice of Cognitive Interviewing. Public Opin Q 2007;71:287–311. https://doi.org/10.1093/poq/nfm006.
- 43.
Cognitive Aspects of Survey Methodology. Washington, D.C.: National Academies Press; 1984. https://doi.org/10.17226/930.
- 44.
van der Zouwen J, Smit JH. Evaluating Survey Questions by Analyzing Patterns of Behavior Codes and Question–Answer Sequences: A Diagnostic Approach. Methods Test. Eval. Surv. Quest., Hoboken, NJ, USA: John Wiley & Sons, Inc.; n.d., p. 109–30. https://doi.org/10.1002/0471654728.ch6.
- 45. Besley J, Kayes N, McPherson K. ML Roberts Prize Winner-Assessing the measurement properties of two commonly used measures of therapeutic relationship in physiotherapy. New Zeal J Physiother 2011;39:81–91.
- 46. Elvins R, Green J. The conceptualization and measurement of therapeutic alliance: An empirical review. Clin Psychol Rev 2008;28:1167–87. pmid:18538907
- 47. Mcandrew S, Chambers M, Nolan F, Thomas B, Watts P. Measuring the evidence: Reviewing the literature of the measurement of therapeutic engagement in acute mental health inpatient wards. Int J Ment Health Nurs 2014;23:212–20. pmid:24103061
- 48.
Nunnally JC. Teoría psicométrica. 3a. México DF: Trillas; 1987.
- 49. Benhamou M, Baron G, Dalichampt M, Boutron I, Alami S, Rannou F, et al. Development and Validation of a Questionnaire Assessing Fears and Beliefs of Patients with Knee Osteoarthritis: The Knee Osteoarthritis Fears and Beliefs Questionnaire (KOFBeQ). PLoS One 2013;8:e53886. pmid:23349757
- 50. Zill JM, Scholl I, Härter M, Dirmaier J. Which Dimensions of Patient-Centeredness Matter?—Results of a Web-Based Expert Delphi Survey. PLoS One 2015;10:e0141978. pmid:26539990
- 51. Hsu C-C, Sandford BA. The Delphi Technique: Making Sense of Consensus 2007.
- 52. Stewart J, O’Halloran C, Harrigan P, Spencer JA, Barton JR, Singleton SJ. Identifying appropriate tasks for the preregistration year: modified Delphi technique. BMJ 1999;319:224–9. pmid:10417084
- 53.
Linstone H., Turoff M. The Delphi method: techniques and application. London: Addison-Wesley; 1975.
- 54. Dalkey N., Helmer O. An experimental application of the Delphi method to the use of experts. Manage Sci 1963;9:458–467.
- 55. Christalle E, Zeh S, Hahlweg P, Kriston L, Härter M, Scholl I. Assessment of patient centredness through patient-reported experience measures (ASPIRED): protocol of a mixed-methods study. BMJ Open 2018;8:e025896. pmid:30344183
- 56. Delaney KR. Underestimating or overestimating the power of therapeutic nurse-patient interactions. J Child Adolesc Psychiatr Nurs 2018;31:100–1. pmid:30592121