Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The relationship between psychology practice and complementary medicine in Australia: Psychologists’ demographics and practice characteristics regarding type of engagement across a range of complementary medicine modalities

  • Carrie Thomson-Casey ,

    Roles Conceptualization, Data curation, Formal analysis, Writing – original draft, Writing – review & editing

    Carrie.Thomson-Casey@scu.edu.au

    Affiliations School of Public Health, Faculty of Health, University of Technology Sydney, Sydney, Australia, Faculty of Health, Southern Cross University, Gold Coast, Australia

  • Erica McIntyre,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliation Institute for Sustainable Futures, University of Technology Sydney, Sydney, Australia

  • Kris Rogers,

    Roles Formal analysis, Writing – review & editing

    Affiliation School of Public Health, Faculty of Health, University of Technology Sydney, Sydney, Australia

  • Jon Adams

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliation School of Public Health, Faculty of Health, University of Technology Sydney, Sydney, Australia

Abstract

Introduction

Many people with mental health problems utilise a range of complementary medicine (CM) practitioners, products, and practices. Psychologists are likely to consult with clients who are seeking and using CM, in some form, as part of their wider mental health treatment. The aim of this research is to determine how much, and in what ways, Australian psychologists recommend CM products and/or practices, and/or initiate referrals to CM practitioners as part of their clinical practice and to explore if these behaviours have any association with the characteristics of the psychologist or their wider practice.

Methods

Survey data was collected from psychologists in clinical practice who self-selected to participate between February and April 2021. Participation in the study was via an online 79-item questionnaire exploring core aspects of CM engagement in psychology clinical practice.

Results

Amongst the 202 psychologists who completed the survey, mind/body approaches (90.5%) were the most recommended CM and cultural/spiritual approaches the least recommended CM (7.5%). Participants also reported referring to CM practitioners with naturopaths the most common focus of their referrals (57.9%) and cultural and spiritual practitioners the least common focus of their referrals (6.69%). Our analysis shows the demographic and practice characteristics of a psychologist are generally not predictors of a psychologist’s engagement with CM in their clinical practice.

Conclusions

Substantial numbers of psychologists recommend CM products and practices and/or refer clients to CM practitioners. Alongside subjecting CM interventions for mental health to an evidence-base assessment, the broader discipline of psychology needs to also consider psychologist engagement with CM in clinical practice in order to help ensure cultural-sensitivity, client safety and client choice.

Introduction

Psychologists are likely to have clients who choose complementary medicine (CM), in some form, as part of their wider mental health treatment [1, 2]. CM refers to health care products, services and practices, that are “not part of a country’s own traditions or conventional medicine and are not fully integrated into the dominant health care system” [3] and often includes a wide range of products, services and practitioner types that can vary with cultural and political context [47].

CM use is high among the general population. For example, an Australian study of the general population found 63.1% of participants used some form of CM and 52.8% had consulted a CM practitioner (e.g., massage therapist, naturopath, osteopath) in the last 12 months [8]. Consumers choose CM for a range of reasons including: alignment with cultural and personal beliefs; an expectation of benefit; dissatisfaction with conventional approaches; to help address side effects caused by conventional medication use; to address symptoms related to severe or complex illness; and/or as a preference for a holistic approach to their care [911].

CM use is also high among people with mental health problems who have been found to utilise different types of CM practitioners, including naturopaths and massage therapists, as well as a range of CM products and practices [7, 8, 12, 13]. An Australian study of adults diagnosed with a mental health disorder reported 42.4% consulted a CM practitioner, 56.9 % used a complementary medicine product and 23 % used a complementary medicine practice in the previous three years [14]. Similarly, another Australian study found 21.3% of participants, who were middle aged women with a diagnosis of depression, had consulted at least one CM practitioner in the last 12 months [13].

There is emerging evidence for some CM approaches in addressing mental health symptoms, such as nutraceuticals (e.g., omega 3 fatty acids, probiotics, and zinc) [15], nutrition (e.g., the Mediterranean diet) [16], herbs (e.g., St John’s wort, saffron) [15, 1719] and probiotics [20] for depression. Manual therapies and movement approaches also demonstrate benefit for people experiencing stress, anxiety and depression [2124]. Although these CM approaches show promise as part of preventative and adjunct treatments for mental health, it is acknowledged there is much more research needed to further critically appraise the efficacy of specific CM [2527].

There has been commentary, beyond and within psychology, that criticises the field for what has been seen as a monocultural Westernised approach to mental health care that diminishes the relevance of CM and traditional healing approaches associated with specific cultural and ethnic groups [28, 29]. Meanwhile, others have highlighted the importance of psychologists embracing culturally sensitive practice, which may include acknowledgement of a clients’ preference for CM use [3032].

Consistent with the latest World Health Organisation Traditional Medicine Strategy [33], CM has been integrated into a number of health care settings [34, 35] including those providing mental health services [3640]. CM integration into health care settings may take a variety of forms facilitated through a range of practice circumstances and practitioner networks [41] and CM integration in the context of psychology practice, and for purposes of this study, refers to a psychologist engaging with CM in some form in their clinical practice as part of a client’s mental health treatment planning. Such integration can be via: discussing CM with a client in their care (e.g., asking questions about a client’s CM use), recommending CM to a client in their care (e.g., suggesting a client attend a yoga class for relaxation), referring a client in their care to a CM practitioner (e.g., verbal or written referral to Western herbal medicine practitioner), the psychologist directly practising and applying CM to a client in their care (e.g., explicit dietary instructions to improve nutrition in the context of evidence-based nutritional psychiatry), and/or a combination of these options above.

Some CM approaches have been integrated into psychology practice [4244]. For example, mindfulness, emotional freedom technique (EFT), and eye movement desensitisation and reprocessing (EMDR), all previously considered fringe or beyond the field of psychology, are now considered evidence-based psychology interventions [45, 46]. Similarly, nutritional psychiatry has emerged as a significant paradigm in mental health care [27, 47, 48] and although not traditionally part of psychologists’ tertiary education [49], psychologists are increasingly engaging with this approach [50]. There is limited research describing the referral practices of psychologists to CM practitioners, which may be a reflection of limited guidelines for psychologists on how they might engage with CM in their practice [51].

As novel approaches to mental health care emerge psychologists have sought additional training in CM, are subsequently more inclined to engage with CM, and are discerning about recommending and referring to CM practitioners [30, 5254]. An Indonesian study of clinical psychologists reported approximately 73% were recommending CM to their clients and 39% were referring to a CM practitioner [55]. Reasons psychologists choose to engage with CM in their clinical practice include positive experiences with personal use of CM, receiving education in CM, and wanting to offer a holistic service to clients that includes CM [49, 54, 56]. However, some psychologists express concern about a broader lack of education and guidelines for the integration of CM within psychology [27, 52, 54, 57, 58]. Overall, the acceptance of CM within the discipline of psychology remains contested [5861]—a situation not dissimilar to that for medicine and other health disciplines [62, 63].

Previous work suggesting psychologists in Australia are favourable toward CM [6466] has invariably included focus upon psychology students and interns, academic psychologists, psychologists from other countries, and other mental health professionals. In contrast, the research reported here focusses exclusively on psychologists in clinical practice to examine how often and in what ways these grass-roots practitioners recommend a range of CM products and/or practices to their clients, and/or refer their clients to a range of CM practitioners.

Methods and materials

Aim

The aim of this research was to determine how much, and in what ways, Australian psychologists recommend CM products and/or practices, and/or initiate referrals to CM practitioners as part of their clinical practice and to explore if these behaviours have any association with the characteristics of the psychologist or their wider practice.

Study design

A survey was distributed online to Australian psychologists who were fully registered and working in a clinical practice setting at time of recruitment (between February and April of 2021). Email invitations to participate in the study were sent to psychologists whose contact details were collected from their publicly available websites. Recruitment emails contained information about the study, consent forms, and a link to complete the survey online. A reminder email was sent to psychologists four weeks after the initial invitation email. An advertisement inviting psychologists to participate in the research was also placed on two psychology professional association websites (Australian Association of Psychologists Incorporated and the Australian Psychological Society) and on relevant social media sites including Twitter, LinkedIn, and Facebook. Participants accessed the survey via an anonymous link embedded in the website advert, or social media post, and were directed to the participant information and consent form via the link. The open survey was completed online via Qualtrics software, Version 2021 [67]. The information page at the beginning of the survey included project details such as ethical approval, data protection, and voluntary participation. The information page also served as the participant consent form. Participants indicated their written consent after reading the information and consent page and clicking on the button confirming their agreement to proceed with the survey. Upon completion of the survey participants were invited to supply their email address to enter a prize draw to win a $250 gift voucher. Ethical approval was attained from UTS Human Research Ethics Committee [ETH20-5138].

Sample.

The survey was distributed to 1479 Australian psychologists working in clinical practice at the time of research. All psychologists in Australia (n = 34,872) are considered to hold general registration, which enables them to use the title of psychologist [68]. Some psychologists with additional tertiary training in psychology may also hold an area of practice endorsement (AoPE) enabling them to use a restricted title (e.g., clinical psychologist). These AoPE titles are clinical neuropsychologist, clinical psychologist, community psychologist, counselling psychologist, educational and developmental psychologist, forensic psychologist, health psychologist, organisational psychologist, and sport and exercise psychologist. A psychologist with an AoPE title has general registration plus an AoPE. To clarify, a psychologist with general registration, without an AoPE (i.e., psychologist), can work in clinical practice settings; however, working in clinical practice does not mean a psychologist is necessarily a clinical psychologist. All psychologists (psychologists with general registration and those psychologists with general registration plus an AoPE) were eligible to participate in the study; however, only responses from those psychologists who work in a clinical practice setting (e.g., inpatient hospital, private practice) directly with clients were included in the data analysis for this study.

The initial screening question asked participants if they were a psychologist undertaking work as a psychologist. Participants who selected “No” were redirected out of the survey. Prior to conducting the analyses, raw survey data were screened for any missing or incomplete responses and duplicate IP addresses. While there were no duplicate IP addresses, during this process, nine cases were removed as the data (responses) were incomplete. After removal of the nine cases, 222 cases were included in the initial analyses which identified significant outliers. On review the outlier responses were mostly from cases who did not work in clinical practice settings. These cases were removed resulting in 201 participants in the final data set. The original sample size was planned to be 400, based on achieving a 0.10 confidence interval width on estimates of prevalence of binary questionnaire items. As noted above, we were able to recruit 231 participants, of which 201 passed the inclusion criteria and were used in this study. With this sample size we are able to estimate a confidence interval for the prevalence of a single binary item with a CI width of 0.14; or compare a continuous or binary variable between two equally sized groups with 0.8 power and an effect size of 0.39 (Cohen’s D).

Instrument.

The construction of survey items was informed by previous literature on psychologist engagement with CM to produce survey items that best captured the ways psychologists might be engaging with CM, including the types of CM products and/or practices they had ever recommended and the types of CM practitioners they had ever referred to. The 79-item questionnaire aimed to examine the extent and ways in which psychologists consider CM relevant and/or appropriate to (their) psychology practice, their clients, and the treatment of mental health problems. Participants were also provided with a definition of CM similar to the one provided above and in line with the World Health Organisation Traditional Medicine Strategy [33]. The survey collected participants’ demographics and practice-related information, any relevant qualifications attained or professional memberships outside of psychology, participants’ perspectives on their scope of practice in Australia in relation to any kind of adjunctive additional health qualifications, and finally participants’ perspectives and behaviours regarding engagement with CM in clinical practice in Australia. Prior to recruitment the survey was tested for face validity and functionality by three PhD students from psychology adjacent fields. Changes were made to provide clearer definitions and reduce repetitive questions. Based on feedback from the PhD students who tested the survey, the time required to complete the survey was approximately 15 minutes. Where relevant this paper adhered to the CHERRIES checklist for reporting results of internet e-surveys [69, 70].

Demographics.

The survey collected data regarding each participant’s year of birth, gender identity, and the predominant state in which they practise. Participants were also asked to provide practice characteristics, such as AoPE, their work setting (solo or group setting), and years in practice as a psychologist.

Additional qualifications.

The survey collected data on participants’ tertiary qualifications in addition to their psychology qualification (i.e., business, criminal justice/criminology, dietetics, education, exercise physiology, law, medical, nursing/midwifery, physiotherapy) and CM related professional qualifications (naturopathy, nutrition, traditional Chinese medicine, Western herbal medicine, yoga instructor) as well as the options of “No” or “Other”. If a psychologist selected “Other” they could then add text to describe their additional qualification. If the psychologist indicated they had an additional qualification they were asked further questions in relation to that additional qualification including: highest level of education in that qualification, if they have separate insurance and/or professional membership for that qualification, and whether they integrate that additional qualification into their psychology practice and treatment planning with clients.

Psychologists’ scope of practice.

Psychologists were asked to indicate their level of personal agreement/disagreement with regards to statements describing psychologists using practices/treatments from an additional health-related qualification with their psychology clients (e.g., a psychologist treating a client from two separate qualifications, such as a psychologist and a dietitian). Questions on this topic explored attitudes toward psychologists who utilised an additional health-related qualification in the context of: treatment planning; communication with clients, client outcomes, and impacts on the scope of psychology practice and psychology as a discipline if a psychologist incorporated a second health related discipline into their practice.

Attitudes towards CM in the context of psychology practice.

The last section of the survey invited psychologists to rate their personal agreement/disagreement with statements relating to psychologist engagement with CM products, practices and practitioners. Likert scales were used to record participant attitudes toward CM (six response choices ranging from strongly agree to strongly disagree) and are reported as measured. Participants also reported the types of CM products and/or practices they recommend to clients, and the types of CM practitioners they have referred to at any time as part of their psychology practice.

Data analysis.

IBM SPSS Statistics Premium Edition Version 27 (Armonk, New York, IBM Corp) was used to analyse the data. Descriptive statistics were used to determine the percentages and frequencies. Chi-square analysis was used to assess associations between categorical demographic and practice characteristics and CM engagement related variables (recommending CM products and/or practices, and/or referring to CM practitioner types). A Firth’s correction for logistic regression was employed due to small cell sizes and to address the possibility of separation of data [71]. Descriptive tables reporting the percentage of psychologists who recommend CM products and practice, as well as those who refer to CM practitioners is provided in the appendix. A complete-case analysis was used to deal with item non-response.

Psychologists have general registration; however, some also hold an AoPE. There were an adequate number of participants to create groups for general psychologists and AoPE clinical psychologists, but the remaining individual AoPE categories (community psychology, counselling psychology, educational and developmental psychology, forensic psychology, health psychology) were small (cell size < 5). An additional category was created for these psychologists called other AoPE.

For analysis purposes, the types of CM products and/or practices were categorised into six groups as informed by previous literature [5, 72, 73] and consistent with the definition of CM used in this study: mind/body approaches (hypnotherapy, meditation, yoga), movement approaches (exercise and movement-based activities, such as walking), ingestive therapies (herbal medicine, probiotics, vitamin and nutrition supplements), dietary changes, and manual approaches (acupuncture and massage). The sixth category, cultural and spiritual approaches, included participant’s free text responses indicating recommending or referring to music, creative arts, prayer and spirituality, and Aboriginal and Torres Strait Islander traditional healing.

The types of CM practitioners were categorised into six groups that were informed by previous literature [72, 73] and consistent with the definition of CM used in this study. For the purpose of this this study the six practitioner categories included: mind/body practitioners (i.e., hypnotherapists and yoga teachers), movement practitioners (i.e., exercise and movement trainers and/or coaches), practitioners who predominantly prescribe ingestibles (i.e., naturopaths, herbalists, and traditional Chinese practitioners), prescribes nutrition (i.e., nutritionists), and manual (i.e., acupuncturists, chiropractic, massage therapists). As the number of participants referring to Aboriginal and Torres Strait Islander traditional healers was small, a new category of cultural and spiritual practitioners was created that incorporated participant free text responses which indicated they refer to music, creative arts, kinesiology and energy practitioners.

Results

Of the completed surveys, 65% (n = 134) were completed via email invitation link and the remaining 35% (n = 68) accessed the survey via website or social media link as described above. The completion rate for opened surveys was 77%.

Participant characteristics

The study sample (n = 202) comprised 165 women (81.6%, Table 1), 36 men (17.8%) and one person who identified as other (0.5%). The mean age of participants was 48 years (M = 48, SD = 26). All Australian states and territories were represented within the sample, with highest representation from New South Wales (n = 65) and Queensland (n = 64) and the lowest from Northern Territory (n = 1). Most psychologists identified as holding the AoPE of clinical psychologist (n = 79) or a psychologist with general registration (n = 76). Participants also came from other AoPE including counselling psychologist (n = 25), forensic psychologist (n = 8), health psychologist (n = 7), educational and developmental psychologist (n = 6), and one community psychologist. Solo practice was the most common work setting reported among participants (n = 137). The highest proportion of participants reported having 11 to 20 years of clinical experience (n = 72) and the lowest proportion (n = 31) reported having 31 plus years of clinical experience.

thumbnail
Table 1. Psychologist characteristics.

Psychologist demographic and practice characteristics, number (n) and percent of Area of Practice Endorsement (%).

https://doi.org/10.1371/journal.pone.0285050.t001

More than half of the participants (55.5%) had attained additional qualifications beyond their psychology qualification(s) in one or more of the following fields: education (n = 39), complementary medicine (n = 35), non-health related qualifications (n = 30), and health related qualifications (n = 18).

Psychologists estimates of what percent of their clients use CM ranged from 0% to 100%, with an average of 53% (M = 53.52, SD = 19.42). Psychologists were also asked how frequently they question their clients about possible CM use, with 82.6% (n = 166) reporting ‘most of the time’, 12.9% (n = 26) ‘sometimes’, and 4.5% (n = 9) ‘rarely or never’.

Psychologists recommending CM products and/or practices

Mind/body approaches were the most recommended type of CM products and/or practices (90.5%) and cultural/spiritual approaches the least recommended (7.5%). Table 2 reports the results of the analysis conducted between demographic and practice characteristics and recommending types of CM. Psychologists holding additional qualifications in education (OR = 0.28 [0.11; 0.75]) or complementary medicine (OR = 9.33 [1.22; 1196.31]) were more likely to recommend mind/body approaches to their clients.

thumbnail
Table 2. Characteristics and recommending CM.

Demographic and practice characteristics of psychologists and recommending CM products and/or practices, with odds ratios (OR) for recommending a specific product/practice, and a test (p, likelihood ratio test) of heterogeneity in probability of recommending a specific product/practice.

https://doi.org/10.1371/journal.pone.0285050.t002

Psychologists referring to CM practitioners

Psychologists also refer to CM practitioners, with referrals to practitioners who prescribe ingestible products (e.g., naturopaths) the most common (57.9%), and referrals to cultural/spiritual healers/practitioners (e.g., Aboriginal and Torres Strait Islander traditional healer) the least common (6.9%). The results of Firth-corrected logistic regression yielded some interesting results for psychologists referring to CM practitioner types (see Table 3). While psychologists with 31 plus years experience were more likely (OR = 3.14 [1.27, 8.16]) to refer to manual therapy practitioners (e.g., massage therapists), those who were 65 plus years old were less likely to refer to movement therapy practitioners (OR = 0.93 [0.31, 2.79]) (e.g., personal trainer) indicating rates of referral were similar, with no evidence for difference.

thumbnail
Table 3. Characteristics and referring to CM.

Demographic and practice characteristics of psychologists and their referring to types of CM practitioners with odds ratios (OR) for referring to a CM practitioner for a specific product/practice, and a test (p, likelihood ratio test) of heterogeneity in probability of referring to CM practitioner according to each of the characteristics.

https://doi.org/10.1371/journal.pone.0285050.t003

Psychologists in the group with an AoPE in clinical psychology were less likely than other participating psychologists to refer to mind/body (OR = 0.64 [0.85, 4.15]), movement (OR = 0.84 [1.49, 7.28]) and manual therapy (OR = 1.04 [1.14, 5.16]) practitioner types, indicating rates of referral were similar, with no evidence for difference. Further, dual qualified psychologists, in education, were more likely to refer to movement and cultural/ spiritual practitioners. While those psychologists with dual qualifications, in non-health (e.g., law) were more likely to refer to mind/body practitioners.

Discussion

This is the first study to identify rates of recommending different categories of CM products and/or practices and referring to different types of CM practitioners amongst Australian psychologists in clinical practice. One important finding from this study is that many psychologists appear to be actively engaging with CM in their clinical practice with a vast majority of participants reporting that they question clients about their CM use (95.5%), while a very large majority recommend CM products and/or practices (90.5%), and more than half of the sample refer clients to CM practitioners (57.9%). Although it is important to stress that the sample in our study was self-selecting, it is reasonable to cautiously suggest these levels of CM engagement amongst psychologists may provide first empirical indication of widespread grass-roots CM engagement amongst psychologists in clinical practice in Australia.

This finding from our study is consistent with, and may well be influenced in part by, CM engagement identified amongst general practitioners (GPs) [63, 7476]. Some GPs in Australia report a motivation to engage with CM as part of a patient-centred, whole person approach to health care, as well as to meet demand from client groups that are high CM users, such as those experiencing chronic illness and mental health problems [62, 77, 78]. Given CM use for mental health problems is high [14, 79, 80] and GPs are the main referral pathway for these clients to psychologists, it may be that GPs are partly facilitating the inclusion of CM in the treatment planning for those clients also consulting a psychologist. Apart from common legislation around health professionals referring to health professionals (e.g., maintaining client confidentiality) there is no legislation that explicitly discusses the types of referrals psychologists can provide. Perhaps in lieu of CM specific guidelines from psychology associations in Australia [51], psychologists extend upon GP inclusion of CM to subsequently engage with CM in their own clinical practice with clients. Further research is required to identify what motivates psychologist engagement with CM.

In addition, the present study identified close to 50% of psychologists refer clients to CM practitioners who prescribe nutrition and movement. This may also be influenced by the growth of lifestyle medicine for mental health care among GPs [81, 82] that include CM, such as evidence-based social, nutrition and movement approaches [15, 8387]. Wider acceptance of these approaches among GPs may promote discussion with clients, and subsequently influence discussions between these patients and the psychologist (to whom the GP refers them), regarding the role of nutrition and movement as part of mental health care. However, the specific channels by which such lifestyle medicine options may be introduced into the clinical practice of psychologists—introduced by clients, by the psychologist or by other health professionals whom the client may be consulting—remains unclear and requires further investigation.

The results of our study suggest some psychologists are seeking additional training and formal qualifications in non-psychology disciplines, including CM. More than half (n = 53.5%) of the participants had additional qualifications, including education (n = 19.3%) and CM (n = 17.3%). This is an interesting finding given that the Psychology Board of Australia does not support practitioners holding dual qualifications or applying more than one qualification to care for the same client. Interestingly, in the current study, having an additional qualification in education was associated with recommending mind/body approaches and dietary changes as well as referring to cultural/spiritual practitioners. This finding may be partly explained by psychologists with additional qualifications in education being exposed to CM approaches relevant to student and teacher wellbeing, such as mindfulness, yoga, healthy eating, and positive psychology [8890], indicating they have greater knowledge of these approaches including potential benefits to clients. Further, as part of their training and work experience in educational settings, psychologists with additional tertiary training in education may also be exposed to the importance of cultural practices to mental health and wellbeing [91, 92]. Research on why psychologists seek additional skills from other non-psychology disciplines may assist our understanding of psychologist engagement with CM as an adjunct to conventional psychology approaches and is a topic requiring further empirical examination.

The current study also found psychologists do not engage with all types of CM equally. Only a small minority of psychologists in our study indicated they engage with cultural/spiritual approaches and clinical psychologists specifically were the lowest proportion of the participating psychologists to engage with recommending or referring to cultural/spiritual approaches. Perhaps our finding, that there is a low rate of engagement with cultural/spiritual approaches, partly reflects the critique of psychology as presented by some as a hegemonic Westernised approach to mental health [28, 9395], which potentially minimises the relevance of including cultural/spiritual approaches in client’s care. Furthermore, psychologists in Australia may be reluctant to engage with culturally relevant approaches following the introduction of Medicare items for psychologists in 2006. These items include limited approved psychological therapies that are deemed appropriate to apply to all clients regardless of their ethnocultural background [96]. Any deviation from the approved listed therapies may result in an adverse outcome for a psychologist if they are audited by Medicare [97, 98] and it may be that these circumstances, partly at least, explain the low rates of engagement with culturally relevant or spiritual mental health care approaches amongst our study sample. Ultimately, further investigation is needed to help understand and explain this interesting finding.

The current study also identified psychologists with an AoPE in clinical psychology as less likely to refer to mind/body, movement, and manual therapies. Perhaps there is something unique to clinical psychology training and supervisory programs that influences clinical practice orientations and subsequently reduces engagement with CM. For example, it has been suggested there is risk of a narrowing of the field of psychology, where clinical psychology tertiary programs focus too much on cognitive behavioural therapy (CBT) [99], and not enough on broader social and cultural influences on mental health, as well as the role of client preference and values that might include CM approaches [100102]. The literature also reinforces CBT as the gold standard therapeutic approach for psychologists, and that any drift away from CBT, such as engaging with CM approaches, would be ineffective and potentially harmful to clients [103, 104]. It may be that clinical psychologists are influenced by their clinical psychologist peers. We know for comparison that GPs report their professional networks as influencing their clinical practice through staying abreast of treatment advances as well encouraging them to stay in their professional niche to feel more secure [105]. Similarly, an Australian study of early career psychologists reported factors including postgraduate coursework and peer supervision as highly impactful on their theoretical and clinical practice orientations [106]. Further research is needed to understand what influences clinical psychologist’s reduced engagement with CM in clinical practice. For now, we can only suggest possible explanations for why clinical psychologists are less likely to engage with CM in their clinical practice than other psychologists in the study, and further research should examine this particular topic in more detail.

Strengths and limitations

This study is the first to focus on the rates of recommending and referring to CM amongst a diverse range of psychologists in clinical practice (e.g., in terms of years of experience, AoPE). Although the number of participants in the study was small, it is representative of the Australian psychology workforce according to current workforce demographics provided by the Psychology Board of Australia [68]. There is potential for bias in our research due to participants being self-selecting, which may have resulted in larger numbers of psychologists who have an interest in CM being drawn to participating in the study.

Future research

Future research is required to identify and investigate what motivates CM engagement amongst psychologists in clinical practice. Questions internal to the ranks of psychology that require further attention include: how do psychologists justify their engagement with CM to their clients as well as to others in their profession; and what do psychologists perceive and experience as the core challenges and benefits of CM integration within their practice and the broader field of psychology? Similarly, with a focus beyond the psychology field, we also need to know more details regarding how different CM providers perceive and understand their role in the care of those with mental health issues who also consult a psychologist. There is also a need to examine the perceptions and experiences of clients receiving concurrent and/or co-ordinated mental health care from both CM practitioners and psychologists, such as any detrimental effects that may have occurred as a result of referrals to CM practitioners from psychologists.

Conclusion

A large proportion of Australian psychologists report some form of engagement with CM in their clinical practice. Policy and education development focusing upon this area of grass-roots psychology practice may help ensure the care provided by all psychologists remains evidence-based, safe and optimal for their clients.

Supporting information

S1 Table. Rates of recommending.

Percentage of psychologists who recommend CM products and practices according to demographic and practice characteristics of psychologists and their recommending CM products and/or practices.

https://doi.org/10.1371/journal.pone.0285050.s001

(DOCX)

S2 Table. Rates of referring.

Percentage of psychologists who refer to CM practitioners according to demographic and practice characteristics of psychologists and their recommending CM products and/or practices.

https://doi.org/10.1371/journal.pone.0285050.s002

(DOCX)

References

  1. 1. M. H. Fernandes-Nascimento & Wang Y.-P. Trends in complementary and alternative medicine for the treatment of common mental disorders: A bibliometric analysis of two decades. Complementary Therapies in Clinical Practice 46, 101531 (2022). pmid:35007900
  2. 2. Wemrell M., Olsson A. & Landgren K. The Use of Complementary and Alternative Medicine (CAM) in Psychiatric Units in Sweden. Issues in Mental Health Nursing 41, 946–957 (2020). pmid:32497455
  3. 3. Harnett J. E. et al. Use of complementary medicine products: a nationally representative cross-sectional survey of 2019 Australian adults. BMJ Open 9, 1–12 (2019). pmid:31315853
  4. 4. Adams J, Parker R, Broom A. The Social Science of Traditional, Complementary and Integrative Medicine. Public Health and Health Services Research in Traditional, Complementary and Integrative Health Care: International Perspectives. 2019 Jun 4..
  5. 5. Ng J. Y. et al. Operational definition of complementary, alternative, and integrative medicine derived from a systematic search. BMC Complementary Medicine and Therapies 22, 104 (2022). pmid:35413882
  6. 6. Park C. Mind-body CAM interventions: Current status and considerations for integration into clinical health psychology. Journal of Clinical Psychology 69, 45–63 (2013). pmid:22936306
  7. 7. Solomon D. & Adams J. The use of complementary and alternative medicine in adults with depressive disorders. A critical integrative review. J Affect Disord 179, 101–113 (2015). pmid:25863008
  8. 8. Steel A. et al. Complementary medicine use in the Australian population: Results of a nationally-representative cross-sectional survey. Sci Rep 8, 17325 (2018). pmid:30470778
  9. 9. Ashraf H., Salehi A., Sousani M. & Sharifi M. H. Use of Complementary Alternative Medicine and the Associated Factors among Patients with Depression. Evidence-Based Complementary and Alternative Medicine 2021, 6626394 (2021). pmid:33854557
  10. 10. Chatterjee A. Why do chronic illness patients decide to use complementary and alternative medicine? A qualitative study. Complementary Therapies in Clinical Practice 43, 101363 (2021). pmid:33740591
  11. 11. Tangkiatkumjai M., Boardman H. & Walker D.-M. Potential factors that influence usage of complementary and alternative medicine worldwide: a systematic review. BMC Complementary Medicine and Therapies 20, 363 (2020). pmid:33228697
  12. 12. Avci D. & Sabanciogullari S. Complementary health approaches use in Turkish patients with mental disorders: Related factors and perceived benefits. Perspectives in psychiatric care 57, 1853–1861 (2021). pmid:33682119
  13. 13. Sibbritt D., McIntyre E., Steel A., Peng W. & Adams J. Integrative health services use for depression in middle-aged and older Australian women. European Journal of Integrative Medicine 46, 101367 (2021).
  14. 14. McIntyre E. et al. Conventional and complementary health care use and out-of-pocket expenses among Australians with a self-reported mental health diagnosis: a cross-sectional survey. BMC health services research 21, 1–19 (2021).
  15. 15. Sarris J. et al. Clinician guidelines for the treatment of psychiatric disorders with nutraceuticals and phytoceuticals: The World Federation of Societies of Biological Psychiatry (WFSBP) and Canadian Network for Mood and Anxiety Treatments (CANMAT) Taskforce. The World Journal of Biological Psychiatry, 1–32 (2022). pmid:35311615
  16. 16. Bayes J., Schloss J. & Sibbritt D. The effect of a Mediterranean diet on the symptoms of depression in young males (the "AMMEND" study): A Randomized Control Trial. American Jounral of Clinical Nutrition (2022). pmid:35441666
  17. 17. Ng Q. X., Venkatanarayanan N. & Ho C. Y. X. Clinical use of Hypericum perforatum (St John’s wort) in depression: a meta-analysis. Journal of affective disorders 210, 211–221 (2017). pmid:28064110
  18. 18. Sarris J. Herbal medicines in the treatment of psychiatric disorders: 10-year updated review. Phytotherapy Research 32, 1147–1162 (2018). pmid:29575228
  19. 19. Kuchta K., de Nicola P. & Schmidt M. Randomized, dose‐controlled double‐blind trial: Efficacy of an ethanolic kava (Piper methysticum rhizome) extract for the treatment of anxiety in elderly patients. Traditional & Kampo Medicine 5, 3–10 (2018).
  20. 20. Zhu H. et al. A psychobiotic approach to the treatment of depression: A systematic review and meta-analysis. Journal of functional foods 91, 104999 (2022).
  21. 21. Feng J., Huang W. Y., Lau P. W. C., Wong S. H.-S. & Sit C. H.-P. Movement behaviors and mental health of caregivers of preschoolers in China during the COVID-19 pandemic. Preventive medicine 155, 106913–106913 (2022). pmid:34922994
  22. 22. Hall H. G. et al. The effectiveness of massage for reducing pregnant women’s anxiety and depression; systematic review and meta-analysis. Midwifery 90, 102818–102818 (2020). pmid:32827841
  23. 23. McGregor D. E. et al. Compositional Analysis of the Associations between 24-h Movement Behaviours and Health Indicators among Adults and Older Adults from the Canadian Health Measure Survey. International journal of environmental research and public health 15, 1779 (2018). pmid:30126215
  24. 24. McMahon E. M. et al. Physical activity in European adolescents and associations with anxiety, depression and well-being. European Child & Adolescent Psychiatry 26, 111–122 (2017). pmid:27277894
  25. 25. Nguyen S. A. & Lavretsky H. Emerging Complementary and Integrative Therapies for Geriatric Mental Health. Current treatment options in psychiatry 7, 447–470 (2020). pmid:32904865
  26. 26. Burnett-Zeigler I., Schuette S., Victorson D. & Wisner K. L. Mind-Body Approaches to Treating Mental Health Symptoms Among Disadvantaged Populations: A Comprehensive Review. J Altern Complement Med 22, 115–124 (2016). pmid:26540645
  27. 27. Morkl S. et al. ’An Apple a Day’?: Psychiatrists, Psychologists and Psychotherapists Report Poor Literacy for Nutritional Medicine: International Survey Spanning 52 Countries. Nutrients 13, 02 (2021). pmid:33801454
  28. 28. Canham H., Baloyi L. & Segalo P. in Decoloniality and Epistemic Justice in Contemporary Community Psychology (eds Stevens Garth & Sonn Christopher C.) 193–212 (Springer International Publishing, 2021).
  29. 29. Consoli A. J. & Myers L. J. Alternate Cultural Paradigms in Psychology: Long Overdue Recognition and Further Articulations. Journal of Humanistic Psychology, 00221678211048114 (2021).
  30. 30. Liem A. The possibilities and challenges of integrative medicine implementation in clinical psychology: a qualitative study in Indonesia. BMC Complementary Medicine and Therapies 20, 223 (2020). pmid:32664917
  31. 31. Richmond A. & Jackson J. Cultural Considerations for Psychologists in Primary Care. Journal of Clinical Psychology in Medical Settings 25, 305–315 (2018). pmid:29450797
  32. 32. Welz A. N., Emberger-Klein A. & Menrad K. What motivates new, established and long-term users of herbal medicine: is there more than push and pull? BMC Complementy and Alternative Medicine 19, 170–178 (2019). pmid:31291938
  33. 33. World Health Organization. WHO traditional medicine strategy: 2014–2023. Geneva: World Health Organization; 2013 2013.
  34. 34. Roth I. et al. Employing Evidence in Evaluating Complementary Therapies: Findings from an Ethnography of Integrative Pain Management at a Large Urban Pediatric Hospital. Journal of Alternative & Complementary Medicine 25, S95–S105 (2019). pmid:30870018
  35. 35. Zhang Q., Sharan A., Espinosa S. A., Gallego-Perez D. & Weeks J. The Path Toward Integration of Traditional and Complementary Medicine into Health Systems Globally: The World Health Organization Report on the Implementation of the 2014–2023 Strategy. J Altern Complement Med 25, 869–871 (2019). pmid:31525106
  36. 36. Jacobsen R., Fonnebo V. M., Foss N. & Kristoffersen A. E. Use of complementary and alternative medicine within Norwegian hospitals. BMC Complementary and Alternative Medicine 15, 275 (2015). pmid:26268605
  37. 37. Jong M. C., Busch M. & Baars E. W. Integrative medicine in Dutch curative and long-term healthcare centres: Mapping the field. European Journal of Integrative Medicine 28, 14–19 (2019).
  38. 38. Salamonsen A. & Ahlzen R. Epistemological challenges in contemporary Western healthcare systems exemplified by people’s widespread use of complementary and alternative medicine. Health 22, 356–371 (2018). pmid:28401813
  39. 39. Taylor S. L. et al. What Should Health Care Systems Consider When Implementing Complementary and Integrative Health: Lessons from Veterans Health Administration. The Journal of Alternative and Complementary Medicine 25, S52–S60 (2019). pmid:30870020
  40. 40. Wheeler M. S., Glass C. R., Arnkoff D. B., Sullivan P. & Hull A. The Effect of Mindfulness and Acupuncture on Psychological Health in Veterans: an Exploratory Study. Mindfulness 9, 564–574 (2018).
  41. 41. Adams J. & Tovey P. in Contemporary Primary Care. The Challenges of Change. (ed Tovey Philip) (Open University Press, Buckingham, 2000).
  42. 42. Haller H., Anheyer D., Cramer H. & Dobos G. Complementary therapies for clinical depression: an overview of systematic reviews. BMJ Open 9, e028527 (2019). pmid:31383703
  43. 43. Lorenc A. et al. Scoping review of systematic reviews of complementary medicine for musculoskeletal and mental health conditions. BMJ Open 8, e020222 (2018). pmid:30327397
  44. 44. Moir S., Skues J. & Theiler S. Exploring the Perspectives of Psychologists Who Use Mindfulness in Therapeutic Practice. Australian Psychologist 54, 26–36 (2019).
  45. 45. American Psychological Association. Psychological treatments. Society of Clinical Psychology, Division 12. (2016).
  46. 46. Australian Psychological Society. Evidence-based psychological interventions in the treatment of mental disorders: A review of the literature. (2018).
  47. 47. Adan R. A. H. et al. Nutritional psychiatry: Towards improving mental health by what you eat. European Neuropsychopharmacology 29, 1321–1332 (2019). pmid:31735529
  48. 48. Teasdale S., Mörkl S. & Müller-Stierlin A. S. Nutritional Psychiatry in the treatment of psychotic disorders: current hypotheses and research challenges. Brain, Behavior, & Immunity—Health (2020). pmid:34589852
  49. 49. Nayda C., Gould J. & Roberts R. M. Psychologist attitudes, self-reported competence and practices associated with the use of dietary interventions for children presenting for psychological treatment. Australian Psychologist 56, 394–405 (2021).
  50. 50. Baxter D. & Lovell G. P. Australian mental health practitioners’ reported practice, beliefs, and barriers to the prescription of dietary change for mental health conditions. Australian Psychologist 56, 245–255 (2021).
  51. 51. Thomson-Casey C., Adams J. & McIntyre E. Complementary medicine in psychology practice: an analysis of Australian psychology guidelines and a comparison with other psychology associations from English speaking countries. BMC Complementary Medicine and Therapies 22, 171 (2022). pmid:35752820
  52. 52. Fay V., Fay N., Walla P. & Duregger C. Attitudes of psychology students toward expressive therapies. Cogent Psychology 3, 1241459 (2016).
  53. 53. Hamilton K. & Marietti V. A qualitative investigation of Australian psychologists’ perceptions about complementary and alternative medicine for use in clinical practice. Complementary Therapies in Clinical Practice 29, 105–110 (2017). pmid:29122247
  54. 54. Kassis A. & Papps F. A. Integrating complementary and alternative therapies into professional psychological practice: An exploration of practitioners’ perceptions of benefits and barriers. Complementary Therapies in Clinical Practice 41, 101238 (2020). pmid:32932216
  55. 55. Liem A. & Newcombe P. A. Indonesian provisional clinical psychologists’ knowledge, attitudes, and behaviours towards complementary-alternative medicine (CAM). Complementary therapies in clinical practice 28, 204–211 (2017). pmid:28779931
  56. 56. Wilson L. M. & White K. M. Integrating complementary and alternative therapies into psychological practice: A qualitative analysis. Australian Journal of Psychology 63, 232–242 (2011).
  57. 57. Medeiros N. T. et al. Academic education in health profession programs, knowledge and use of Complementary and Alternative Medicine (CAM) by university students. Complementary Therapies in Medicine 44, 189–195 (2019). pmid:31126555
  58. 58. Liem A. & Newcombe P. A. Knowledge, attitudes, and usage of complementary-alternative medicine (CAM): A national survey of clinical psychologists in Indonesia. Current Psychology 17, 1–11 (2019).
  59. 59. Ditte D., Schulz W., Ernst G. & Schmid-Ott G. Attitudes towards complementary and alternative medicine among medical and psychology students. Psychology, Health and Medicine 16, 225–237 (2011). pmid:21154015
  60. 60. Fasce A. & Adrián-Ventura J. Alternative psychotherapies: Conceptual elucidation and epidemiological framework. Professional Psychology: Research and Practice (2020).
  61. 61. Swan L. K., Skarsten S., Heesacker M. & Chambers J. R. Why psychologists should reject complementary and alternative medicine: A science-based perspective. Professional Psychology: Research and Practice 46, 325–339 (2015).
  62. 62. Ee C. et al. Integrative Medicine in General Practice in Australia: A Mixed-Methods Study Exploring Education Pathways and Training Needs. Global Advances in Health and Medicine 10, 21649561211037594 (2021). pmid:34414016
  63. 63. Pirotta M. et al. Complementary medicine in general practice: A national survey of GP attitudes and knowledge. Australian Family Physician 39, 946–950 (2010). pmid:21301677
  64. 64. Ligorio D. V. & Lyons G. C. B. Exploring differences in psychological professionals’ attitudes towards and experiences of complementary therapies in clinical practice. Australian Psychologist 54, 202–213 (2018).
  65. 65. Stapleton P. et al. Use of complementary therapies by registered psychologists: An international study. Professional Psychology: Research and Practice 46, 190–196 (2015).
  66. 66. Wilson L. M., Hamilton K. & White K. M. Students’ Beliefs about Willingness to Access Complementary and Alternative Therapies (CAT) Training for Future Integration into Psychology Practice. ISRN Education 2012 (2012).
  67. 67. Qualtrics v. 2021 (Provo, Utah, USA, 2022).
  68. 68. Psychology Board of Australia. Psychology Board of Australia registrant data. (2022).
  69. 69. Eysenbach G. Improving the Quality of Web Surveys: The Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res 6, e34 (2004). pmid:15471760
  70. 70. Eysenbach G. Correction: Improving the Quality of Web Surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res 14, e8 (2012).
  71. 71. Firth D. Bias reduction of maximum likelihood estimates. Biometrika 80, 27–38 (1993).
  72. 72. Ng J. Y., Boon H. S., Thompson A. K. & Whitehead C. R. Making sense of “alternative”, “complementary”, “unconventional” and “integrative” medicine: exploring the terms and meanings through a textual analysis. BMC Complementary and Alternative Medicine 16, 134 (2016). pmid:27206976
  73. 73. Wieland L. S., Manheimer E. & Berman B. M. Development and classification of an operational definition of complementary and alternative medicine for the Cochrane collaboration. Alternative therapies in health and medicine 17, 50 (2011). pmid:21717826
  74. 74. Adams J. The positive gains of integration: a qualitative study of GPs’ perceptions of their complementary practice. Primary Health Care Research & Development 4, 155–162 (2003).
  75. 75. Ostermaier A., Barth N. & Linde K. How German general practitioners justify their provision of complementary and alternative medicine–a qualitative study. BMC complementary medicine and therapies 20, 1–8 (2020).
  76. 76. Schwartz M. R. et al. Complementary and Integrative Health Knowledge and Practice in Primary Care Settings: A Survey of Primary Care Providers in the Northwestern United States. Global Advances in Health and Medicine 10, 21649561211023377 (2021). pmid:34249478
  77. 77. Rayner J.-A., Willis K. & Pirotta M. What’s in a name: integrative medicine or simply good medical practice? Family practice 28, 655–660 (2011). pmid:21653251
  78. 78. Mak J. C. S., Mak L. Y. H., Shen Q. & Faux S. Perceptions and attitudes of rehabilitation medicine physicians on complementary and alternative medicine in Australia. Internal Medicine Journal 39, 164–169 (2009). pmid:19383065
  79. 79. Seet V. et al. The use of complementary and alternative medicine in a multi-ethnic Asian population: results from the 2016 Singapore Mental Health Study. BMC Complementary Medicine and Therapies 20, 52–52 (2020). pmid:32054477
  80. 80. Anderson L. N. et al. The Ontario Birth Study: A prospective pregnancy cohort study integrating perinatal research into clinical care. Paediatric & Perinatal Epidemiology 32, 290–301 (2018). pmid:29750375
  81. 81. Egger G. Lifestyle medicine:’The’why’,’what’and’how’of a developing discipline’. Australian Journal of General Practice 48, 665–668 (2019). pmid:31569327
  82. 82. Nunan D., Blane D. N. & McCartney M. Exemplary medical care or Trojan horse? An analysis of the ‘lifestyle medicine’movement. Br J Gen Pract 71, 229–232 (2021). pmid:33926883
  83. 83. Drinkwater C., Wildman J. & Moffatt S. Social prescribing. BMJ (Online) 364, l1285–l1285 (2019). pmid:30923039
  84. 84. Firth J. et al. A meta‐review of “lifestyle psychiatry”: the role of exercise, smoking, diet and sleep in the prevention and treatment of mental disorders. World psychiatry 19, 360–380 (2020). pmid:32931092
  85. 85. Martland R. et al. Can high-intensity interval training improve mental health outcomes in the general population and those with physical illnesses? A systematic review and meta-analysis. Br J Sports Med, bjsports-2021-103984 (2021). pmid:34531186
  86. 86. Sarris J., Glick R., Hoenders R., Duffy J. & Lake J. Integrative mental healthcare White Paper: Establishing a new paradigm through research, education, and clinical guidelines. Advances in Integrative Medicine 1, 9–16 (2014).
  87. 87. Wakefield J. R. H. et al. Social Prescribing as ‘Social Cure’: A longitudinal study of the health benefits of social connectedness within a Social Prescribing pathway. Journal of health psychology 27, 386–396 (2022). pmid:32700974
  88. 88. Nguyen D. et al. Identifying barriers and facilitators to implementing mindfulness-based programmes into schools: A mixed methods study. Applied psychology: health and well-being (2021). pmid:34907664
  89. 89. Kelly R. K., Peralta L. & Nash R. Promoting food literacy in primary school classrooms through the HealthLit4Kids Program in Australia. Health Promotion International 37 (2022). pmid:36367420
  90. 90. Mendes de Oliveira C., Santos Almeida C. R. & Hofheinz Giacomoni C. School-based positive psychology interventions that promote well-being in children: a systematic review. Child Indicators Research 15, 1583–1600 (2022).
  91. 91. Bishop M., Vass G. & Thompson K. Decolonising schooling practices through relationality and reciprocity: embedding local Aboriginal perspectives in the classroom. Pedagogy, culture & society 29, 193–211 (2021).
  92. 92. Jones J., McGlade H. & Davison S. in Indigenous Knowledge and Mental Health 241–253 (Springer, 2022).
  93. 93. Barimah K. B. & Akotia C. S. The promotion of traditional medicine as enactment of community psychology in Ghana. Journal of Community Psychology 43, 99–106 (2015).
  94. 94. Ciofalo N. Indigenous psychologies: A contestation for epistemic justice. Indigenous Psychologies in an Era of Decolonization, 1–38 (2019).
  95. 95. Gone J. P. Alternative knowledges and the future of community psychology: Provocations from an American Indian healing tradition. American Journal of Community Psychology 58, 314–321 (2016). pmid:27216322
  96. 96. King R. Psychological services under Medicare: Broken but not beyond repair. Psychotherapy in Australia 19, 38–42 (2013).
  97. 97. Mathews R. Better access growing pains. Canadian Psychology/Psychologie canadienne 59, 382–386 (2018).
  98. 98. Stiles J. & Fox R. Taking Care of Business: Psychologist Self-care in a Neoliberal Age. Australian Community Psychologist 30, 30–53 (2019).
  99. 99. Salter M. & Rhodes P. On Becoming a Therapist: A Narrative Inquiry of Personal-Professional Development and the Training of Clinical Psychologists. Australian psychologist 53, 486–492 (2018).
  100. 100. Heatherington L. et al. The Narrowing of Theoretical Orientations in Clinical Psychology Doctoral Training. Clinical psychology (New York, N.Y.) 19, 364–374 (2012).
  101. 101. Crowe-Salazar N. Exploring the Experiences of an Elder, a Psychologist and a Psychiatrist: How can Traditional Practices and Healers Complement Existing Practices in Mental Health? First Peoples Child & Family Review 3, 83–95 (2007).
  102. 102. Browne J., Cather C. & Ponce A. N. A Preliminary Study of Clinical Psychology Doctoral Students’ Training in Food Insecurity Assessment and Resource Provision. Journal of health care for the poor and underserved 33, 623–632 (2022). pmid:35574865
  103. 103. Speers A. J. H., Bhullar N., Cosh S. & Wootton B. M. Correlates of therapist drift in psychological practice: A systematic review of therapist characteristics. Clinical Psychology Review 93, 102132 (2022). pmid:35316672
  104. 104. Waller G. & Turner H. Therapist drift redux: Why well-meaning clinicians fail to deliver evidence-based therapy, and how to get back on track. Behaviour Research and Therapy 77, 129–137 (2016). pmid:26752326
  105. 105. Islam M. A. & Awal M. A. Factors Influencing Physicians’ Clinical Decision-making at Upazila Health Complexes in Bangladesh. Global Journal on Quality and Safety in Healthcare 3, 125–133 (2020).
  106. 106. Liao T., Quinlan E. & Mohi S. Factors influencing the theoretical orientations of early career psychologists. Clinical Psychologist 26, 23–33 (2022).