Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Factors impeding the supply of over-the-counter medications according to evidence-based practice: A mixed-methods study

  • Nouf Aloudah ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Software, Supervision, Validation, Visualization, Writing – review & editing

    naloudah@ksu.edu.sa

    Affiliation Clinical Pharmacy Department, King Saud University, Riyadh, Saudi Arabia

  • Areej Alhumsi,

    Roles Data curation, Formal analysis, Investigation, Methodology, Resources, Software, Writing – original draft

    Affiliation Sales and Clinical Specialist Oncology, Becton Dickinson, Riyadh, Saudi Arabia

  • Nada Alobeid,

    Roles Data curation, Methodology, Project administration, Software, Validation, Writing – original draft

    Affiliation Benefit Risk Assessment Department, Saudi Food and Drug Authority, Riyadh, Saudi Arabia

  • Nourah Aboheimed,

    Roles Data curation, Formal analysis, Project administration, Resources, Software, Writing – original draft

    Affiliation Pharmacy Practice Department, Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia

  • Hind Aboheimed,

    Roles Data curation, Formal analysis, Resources, Software, Validation, Writing – original draft

    Affiliation Pharmaceutical Care Services, King Abdulaziz Medical City-Riyadh, National Guard Health Affairs, Riyadh, Saudi Arabia

  • Ghada Aboheimed

    Roles Conceptualization, Supervision, Writing – original draft

    Affiliation Clinical Pharmacy Department, King Saud University, Riyadh, Saudi Arabia

Abstract

Objective

Despite the positive attitudes pharmacists have toward evidence-based practices (EBPs), its application in community pharmacies in Saudi Arabia is lacking. Therefore, this study aimed to explore and assess EBPs by community pharmacists in Saudi Arabia when they dispense over-the-counter (OTC) medications for three minor ailments: diarrhea, cough, and the common cold.

Research design and methods

We used a mixed-methods approach consisting of two study parts. The first was a quantitative investigation that used mystery shoppers. Four researchers, posing as mystery shoppers, visited 214 randomly selected pharmacies in the Riyadh region of Saudi Arabia. They used 14 questions from a standardized checklist to examine EBPs by community pharmacists. The qualitative part of the study entailed three focus-group discussions with 13 pharmacists from different community practice settings and explored factors that affected the application of EBPs when supplying OTC medications from the pharmacists’ point of view.

Results

The analysis indicated that 40% of pharmacists dispensed OTC medications according to EBPs. Logistic regression analysis showed that one question, "Describe your symptoms", predicted the correct supply of OTC medications (p = 0.021). The qualitative section of the study identified nine factors that affected EBP. Some of these factors facilitated EBP, such as established patient-pharmacist relationships, some acted as barriers such as conflicts between available evidence, while other factors could either facilitate or hinder EBPs, such as the health literacy of the patient.

Conclusion

Given that dispensing OTC medication is a core function of pharmacists, this study uncovered low adherence to EBPs by community pharmacists in Saudi Arabia when dispensing OTC medication for three minor ailments: diarrhea, cough, and the common cold. Furthermore, this study identified a number of explanatory factors for this low adherence. Targeting these factors could help change the behavior of pharmacists and decrease undesirable outcomes.

Introduction

Providing medication without a prescription is one of the core functions of community pharmacies [1]. There are more than 300,000 over-the-counter (OTC) medications in the United States market that fall under more than 80 therapeutic classes [1]. In Saudi Arabia, there are more than 9,000 OTC medications registered by the Saudi Food and Drug Authority [2]. While OTC medications reduce the cost of healthcare [1], medication safety mandates that the pharmacist assist patients with choosing an appropriate OTC medication.

Studies investigating why pharmacists do not supply OTC medications according to evidence-based practices (EBPs) have identified a number of influencing factors. First, OTC medications sold in community pharmacies may be based on commercial gain [3]. In addition, pharmacists may not be familiar with how to access EBP information, there may be limited available evidence regarding medication effectiveness, and challenging patients’ requests [4]. Pharmacists play a crucial role in ensuring recommendations are guided by rational EBPs. One previous study has shown that community pharmacists and pharmacy assistants recognized that consumers lack knowledge regarding OTC medication risks and, thus, there was a need to acquire consultation skills [5]. Yet, consumers were not aware of the professional role of pharmacists [5]. High quality OTC consultations are particularly vital in the face of global deregulation of prescription-only medications and the potential for self-selection of medications by patients [6]. For example, one study conducted in Saudi Arabia found that more than 35% of medications were self-selected by patients, of which 50% were prescription-only [7]. Moreover, 45% of the participants did not disclose any prescribed medication being used at home [7]. Therefore, as pharmacists are the most easily accessible healthcare professionals, there is need for pharmacists to use clinical-trial evidence that follows the principles of EBPs.

While several recent studies have reported that community pharmacists held positive attitudes towards EBPs [6, 8], these beliefs were not always put into practice. A study exploring the appropriateness of self-management cases with OTC medications in Scotland using a mystery-shopper approach showed that 96% of the visits were conducted without any consultation. Furthermore, the study identified a lack of pharmacy-specific quality standards [9]. However, to our knowledge, no study has used a mixed-method approach to assess and explore the point of view of community pharmacists in Saudi Arabia. Therefore, we aimed to evaluate the level of EBP adherence by pharmacists and explore the factors underlying the use of EBP when dispensing OTC medications for diarrhea, cough, and the common cold by community pharmacists using a mixed-methods approach.

Research design and methods

This study used a mixed-methods approach that consisted of two study arms: quantitative and qualitative [10]. The quantitative arm used a mystery-shopper method for assessing the use of EBP in community pharmacies that were randomly selected from the Riyadh region of Saudi Arabia. The mystery shoppers acted as patients with one of three developed scenarios for cough, diarrhea, or the common cold. The qualitative study arm consisted of several focus-group (FG) meetings with a sample of community pharmacists working in Riyadh.

The mystery-shopper method

Four researchers posed as mystery shoppers (N.O, A.H., H.A., N.A.B) and used one of three scenarios when visiting the pharmacies. Three minor ailments were chosen based on the following criteria: they were sufficiently common to generate cases during the data collection period, there was available literature regarding evidence for their management, and the ease of diagnosis by the pharmacist from the patients' descriptions of their symptoms.

The Quest/Scholar MAC Checklist was used as a guide for the development of the scenarios. Quest/scholar MAC is an abbreviation mnemonic for two sets of elements. First, the (Qu) and (Scholar MAC) represent: Quickly and accurately assess the patient by asking about the following: Symptoms, Characteristics, History, Onset, Location, Aggravating factors, Remitting factors, Medication use (including prescription and nonprescription products), Allergic reactions, Coexisting conditions; and the abbreviation (Est), which represents the following actions: Establish that the patient can use a self-care product, Suggest an appropriate self-care product, Talk with the patient about the product [11]. Quest/Scholar MAC is a checklist that helps clinicians ask a series of questions to assess a patient’s condition and select the most appropriate OTC medication. It was developed to standardize and improve how patients with self-care issues are treated [11].

To assess the accuracy of supplying OTC medication that aligned with EBPs, a literature review was conducted to identify recent evidence for treating the three minor ailments (Table 1). Mystery shoppers received two training sessions. The first occurred before a pilot study and included role playing and working through possible pharmacy scenarios according to what might happen. Mystery shoppers were given explicit instructions on how to conduct the pharmacy phase of the study, especially in regards to not providing information unless requested by the pharmacist. The second session occurred after the pilot study and provided additional instructions regarding buying products if required. Each researcher was assigned 80 pharmacies to be visited using a list obtained from the Saudi Ministry of Health. Immediately following the visit, the researcher filled out a checklist (audio recordings of the visits were not authorized). No consent was provided by the pharmacist or pharmacy as obtaining it could have biased their responses. Periodically, a decision to buy products occurred, so as to not affect the pharmacists’ reactions.

Data collection

The scenarios and the mystery-shopper approach were piloted with nine community pharmacies to ensure consistency. Modifications of the checklist were undertaken when needed (for instance, adding the appropriate OTC medication to the scenario to facilitate assessment by the mystery shopper). Mystery-shopper visits were conducted between December 2016 and January 2017.

Sample size and statistical analysis

The estimated sample size for the mystery-shopper method was calculated to be 207 pharmacies. The target population was drawn from pharmacies in Riyadh, Saudi Arabia. Riyadh has more than 2,366 pharmacies in the private sector, which include community pharmacies and those incorporated in private hospitals. The sample size was determined using the followed formula:

In this formula, Z is the statistic corresponding to a 95% confidence level, which was 1.96. P is the prevalence (17%) [12], and d is the accuracy level of the precision, which was 5%. Statistical analyses were performed using the Statistical Package for the Social Sciences version 21 (IBM Corp., Armonk, NY, USA). A P-value ≤ 0.05 indicated statistical significance. Odds ratios (ORs) and 95% confidence intervals (CIs) were calculated using multivariable logistic regression analyses. The outcome (dependent variable) was “OTC prescription according to EBP,” and the predictors (independent variables) were the 14 items of the checklist, in addition to the presenting symptoms. All variables were included in the model. Model fitness was tested using the Hosmer-Lemshaw test (p = 0.423).

The FG discussions

Community pharmacists from large chains and individual pharmacies were recruited for discussions. A topic guide was used during the focus groups (see S1 File). The questions were based on the Theoretical Domain Framework (TDF) [13]. TDF is an integrative framework of 33 psychological theories that aims to understand behavior change. The TDF consisted of 14 domain underpinning each theory. The used questions in the topic guide were derived from the questions of a consensus study by Michie [14] and modified to reflect Saudi culture and community pharmacist behavior towards supplying OTC medications according to EBPs. Previous responses by the participants and levels of interest guided the flow of questions. The FG discussions were recorded and transcribed verbatim using Atlas.ti software (Scientific Software Development GmbH, Berlin, Germany) by the researchers (N.O. and H.A.). Moderators took notes during the FGs and wrote a summary following each discussion. The FG discussions were conducted at King Saud University, Pharmacy College and took approximately 60 to 90 minutes each.

Data analysis

FG transcripts were checked against the audio recordings and anonymized. All transcripts and audio-recordings were securely kept in password-protected computers. Thematic content analysis was undertaken to analyze the data. This process involved systematically analyzing the transcripts, assigning codes to ideas, and gathering examples of those codes from the text. Several cycles of coding were required to reach the final version of the coding manual (see S1 Table. Focus Group demographic characteristics and final coding manual).

Ethical approval

Ethical approval for the research project was obtained from the King Saud University Institutional Review Board, College of Medicine, on May 26, 2016 (reference number 16/0344/IRB).

Results

Two hundred and fourteen pharmacies from five different districts in Riyadh, Saudi Arabia were visited by the mystery shoppers. Table 2 lists the number of pharmacies visited in each district and the frequency of each scenario used. All responses were included in the analysis. Thirteen pharmacists participated in the FG discussions. The pharmacists' ages ranged from 24–41 years. All of the pharmacists were male, non-Saudis and their practice experience varied from 2–16 years. Content analysis took place after each FG. Following the third FG no new themes emerged and saturation had been attained. A description of the sample is presented in S1 Table (Focus Group demographic characteristics and final coding manual).

thumbnail
Table 2. Percentages of pharmacies visited in each district of Riyadh City and the frequency of the three scenarios.

https://doi.org/10.1371/journal.pone.0240913.t002

Mystery shopper study results

Eighty-six (40.2%) of the community pharmacists supplied an OTC medication according to EBPs. Table 3 lists the checklist item responses (items 1–14) and an assessment of the OTC medications provided according to EBP (item 15).

thumbnail
Table 3. Results of the checklist items used to assess responses by pharmacists and the percentage who did not supply OTC medications according to EBPs.

https://doi.org/10.1371/journal.pone.0240913.t003

The multivariable logistic analysis revealed that item 6 was a significant determinant of EBP prescription (OR: 2.22; 95% CI (1.13–4.41); p = 0.021), in addition to the symptoms of the clinical scenario (p = 0.001). Patients who had a common cold and cough were more likely to get OTC medication according to EBPs (OR: 5.36; 95% CI (2.46–11.7); p< 0.001 and OR: 5.19; 95% CI (2.4–11.21); p< 0.001, respectively) when compared to patients with diarrhea (Table 4). The estimated odds ratio was nearly two times greater when the pharmacist asked the shoppers to describe their symptoms.

thumbnail
Table 4. Relationship between checklist questions and the provision of OTC medications according to EBPs.

https://doi.org/10.1371/journal.pone.0240913.t004

FG discussions

The content analysis of the community pharmacists' point of view towards supplying OTC medications according to EBP identified nine factors that influenced their behavior. These factors were summarized under three main domains: the system, the pharmacist, and the patient.

The system

Conflict and/or lack of EBP guidelines for OTC medications.

A lack of OTC-medication evidence-based treatment guidelines for some ailments limited application of EBPs by pharmacists. Furthermore, there was a reported lack of national guidelines and, instead, the pharmacists needed to explore and choose from several international guidelines. As one pharmacist stated: ". there are American, Australian, and British guidelines… and not every pharmacist has enough knowledge to choose from them [to answer their queries]" (2–4). Moreover, keeping current with changes in guidelines, as well as conflicts between old and new guidelines, was also described by a pharmacist as problematic: "The other thing is the evidence-based medicine consistently changes; maybe this year it is correct according to evidence-based and next year its not…" (3–1).

Time restrictions and a focus on sales by pharmacy management.

There is limited time available for pharmacist-patient communication. For instance, one pharmacist stated that: "There is not enough time because there are other requirements. The patient expects minimum information, and the time we have does not give us the space to provide each patient with the information he needs. … I cannot even say hello to them." (1–1). Sales also played a role, as one pharmacist stated: "If you want me to supply [medication] according to evidence-base, do not obligate me with sales." (1–1). Another pharmacist said: "Honestly, he [the manager] knows that you may not adhere to the guidelines, but he turns a blind eye because he sees a benefit from another aspect [i.e., sales]" (1–4).

A need for checklists and/or reminders to facilitate pharmacist adherence.

A need for checklists for the evidence-based supply of OTC medications to facilitate pharmacist adherence was reported. As one pharmacist stated: "….if there is a checklist that we rely on" (3–1), and another pharmacist said: "First of all, I need a reminder to remind me to prescribe according to evidence-base until I get used to it.” (1–1).

Pharmacy location.

The influence of and/or conflict between pharmacists reportedly affected their behavior. In one instance, a pharmacist stated: "…the patient said why did you refused to dispense to me while your colleague [the nearby pharmacist] did?" (2–1). The effect of whether a pharmacy location was adjacent to the physician's location was also identified as an important factor in influencing the supply of OTC medication according to EBPs. For example, one pharmacist stated: "Communication with physicians would be more appropriate to prescribe medications according to EBP. So, if a patient comes with ambiguous prescriptions, I refer the patient back to him." (1–3).

The pharmacist

Pharmacists’ knowledge of medication.

Pharmacists’ knowledge of medications (pharmaceutical ingredients) was reported as a reason for not following guidelines. For instance, one pharmacist said: "If I know the composition of the medication, and there is no contraindication to prescribe this medication to a patient six years old or younger, I should provide it to the public if there will not be a medical mistake." (1–2). Pressure was also placed on pharmacists to supply brand name medications rather than generic therapeutic substitutes. According to one pharmacist’s opinion: "If I am committed to using EBP then …. they should be treated based on the scientific name, not the brand name" (1–2).

Pharmacists' perceptions of their professional identity was empowered by giving several OTC medication options.

One pharmacist believed that following EBP guidelines might negatively affect and further weaken the professional identity of pharmacists. He believed that the ability to provide patients with several options, not just EBP options, shaped professional identity. As the following pharmacist stated: "Without counseling, there is no need for the pharmacist in the pharmacy….” (1–2). Another pharmacist stated: "It would be a boring and non-interesting process where I would be directly medicating without having a discussion with the patient." (2–1). Furthermore, a lack of self-confidence and morality, i.e., focusing on pleasing managers, was perceived by some participants to be a barrier. As one pharmacist stated: "There will be a difference between pharmacists due to different experiences, training, and the morality of the pharmacists. If they were dealing with patients as a healthcare provider or directed by something else… It all depends on the conscience of the pharmacist" (2–2). Moreover, some pharmacists expressed negative emotions such as a fear of patient reactions: "If I did or did not prescribe according to EBP [he meant according to patients’ desires and not his own judgment], the patient will shout and overreact.” (1–1).

Incentives.

Some participating pharmacists mentioned that incentives should be given to encourage dispensing OTC medications according to EBPs. For instance, one pharmacist stated that: "… there should be financial and non-financial incentives that will encourage adherence." (1–1). Another participant mentioned the following possible incentive: ‘…it can be…employee of the month, for example, an employee from each district to receive a certain honor’ (3–3).

The patient

Patient health literacy and culture.

A patient’s health literacy and culture also affected pharmacist behavior. One pharmacist stated: "I depend on the patient’s level of education, so if the patient has a high level, I explain this medicine but not the opposite…" (1–1). Participants described a need to educate the community about the role of the pharmacist in providing correct, required, and individualized drug information. For example, a pharmacist stated that: "The problem with the culture is that they [patients] do not appreciate the role of the pharmacist, and they think the pharmacist is just like a salesperson. Also, they do not know that you have enough knowledge, so this will create a gap and resistance between us." (2–3). Some participants also reported conflicts between modern and herbal medicine when dispensing OTC medication according to EBPs. For instance, one pharmacist said, "There was a patient who came to the pharmacy, and I dispensed an antibiotic, and he noted {I don't want antibiotics I read on internet Pomegranate peel may be helpful.} … (1–1).

Patient-pharmacist relationships.

Patient-pharmacist relationships established through counseling, time, and good communication skills facilitated the supply of OTC medications according to EBPs. As one pharmacist stated: "Communication with the patients can the smooth way where you can convince him by explaining what the consequences of the medication are. For example: if I advised a patient by explaining to him what the benefit of such medication is." (1–3).

Discussion

Using a mixed-method approach allowed us to assemble a comprehensive understanding of how pharmacists dispense OTC medications using EBPs in Saudi Arabia. However, other methodologies have been employed to assess how community pharmacists dispense OTC medication according to EBPs. For instance, Collins et al. [15] used more than 500 mystery-shopper visits to 36 community pharmacies in Australia. Their study showed that less than half of the visits (46%) did not provide OTC medications according to EBPs, only 54% of the pharmacists visited provided products according to guidelines. Although their results were slightly better than ours, compliance with EBPs was surprisingly low as the study intervention included repeat visits to the same pharmacies and provided feedback and coaching after each mystery-shopper visit. The Collin et al. study did show improved results by providing continuous coaching to community pharmacists. Although, education and training are not the only interventions needed to improve EBPs. A mixed-methods study conducted by Watson et al in Scotland, which consisted of 195 observed consultations followed by 95 post-consultations, showed that most OTC consultations were not compliant with the British professional and good practice guidelines [16]. Their study further illustrated that, unlike non-product consultations, product requests predominated and received low scores in regards to compliance with the guideline [16].

Investigating the factors that influence whether or not pharmacists supply OTC medications according to EBPs could help with devising and implementing operational interventions [17]. Halila et al. investigated these factors by conducting a cross-sectional study examining more than 8,000 community pharmacists in Brazil using a self-administered, anonymized survey aimed to assess the knowledge of EBP and important factors to consider when recommending an OTC medicine [18]. Their results showed that pharmacists with less experience were significantly more likely to consider customer preference as the most important factor. Moreover, more than 60% of the participants searched Google for answers to questions or problems compared to 50% who consulted books or guides. In addition, their study showed that most pharmacists did not know the meaning of terms related to EBP including meta-analysis, publication bias and p-value. The Halila et al. study identified gaps in pharmacists’ EBP-related knowledge, as well as issues pertaining to how trustworthy information was obtained [17]. Similarly, the quantitative arm of our study demonstrated that most participating community pharmacists did not gather the proper information needed to understand cases and adequately provide OTC medication according to EBPs.

In our study, asking a patient about their symptoms significantly predicted whether OTC medication was provided according to EBPs and appeared to play a key role in the communication between pharmacists and patients. Similarly, the Watson et al. study demonstrated that patients were more likely to exchange information if they asked about symptom treatment as opposed to asking for a product. Furthermore, that study showed that the patients did not engage in this approach due to concerns about their privacy [16]. The results of the mystery shopper arm of our study also confirmed the importance of good patient-pharmacist communication. These results indicate that it is important to explore those factors that contribute to communication failures. This was investigated in our second study arm, the in-depth FG discussions, which identified a number of systemic, pharmacist, and patient-related factors. Similarly, a qualitative study conducted with 26 community pharmacists in Northern Ireland explored the role of EBPs when dispensing products and showed that pharmacists believed product safety was the predominant factor that determined their decision (even if the medication lacked evidence of effectiveness) [19]. Another in-depth interview study with 16 pharmacists in England explored how pharmacists used evidence when supplying OTC medication and demonstrated that product selection was based on personal judgment and patient feedback rather than evidence [20]. The pharmacists in these studies acknowledged that they sold ineffective OTC medications if they were preferred by patients [19, 20].

Our study also illustrated the role of administration-related factors that can further restrict decisions made by pharmacists, such as a focus on sales by management. Moreover, the in-depth-interviews indicated that pharmacists desired incentives to engage in EBP adherence. Empowering pharmacists through corrective managerial actions could be undertaken by designing incentivized schemes that have previously been successfully applied to overcome poor performance [21].

Designing and implementing plans to improve the supply of OTC medication according to EBPs rather than blaming pharmacists for following patient preferences and providing ineffective medications is necessary. To further this goal, we used a systematic approach based on theory by using the TDF to build the topic guide to explore and understand how pharmacists engage in EBPs in Saudi Arabia. Strategically constructing interventions requires considering a full range of options and systematically evaluating them [22]. Such approach can help to sustain EBPs in community pharmacies in everyday practice [22].

Limitations

Our dataset was limited by the available tools used to assess pharmacist behavior. While using mystery shoppers can overcome some of these limitations, their use has its limitations [23]. Blinding mystery-shopper visits was a concern and could have affected the validity had the pharmacists been aware of the visits [24]. Therefore, we took the approach of not informing the pharmacist of the study and count on the researcher answering the checklist as soon as the leave the pharmacy. Furthermore, the mystery shoppers did not have previous experience with mystery shopping. However, our training consisted of providing explicit information, and the shoppers undertook role-playing activities before the pilot study, which was followed by another session to manage any required changes to the process. Our study also used a standardized checklist to build the scenarios and assess the responses of the pharmacists to strengthen outcome validity. The external validity of our study was strengthened by the large number of visits conducted. The internal validity was confirmed as there were no significant differences in the number of OTC medications according to EBPs found between the researchers’ results (p = 0.89).

There are 7,322 community pharmacies and 12,506 pharmacists working in Saudi Arabia [25]. Our data was collected from only one region, and we expect to see differences in other regions of Saudi Arabia. Specifically, there is evidence that gender might influence interactions and patient satisfaction when receiving health care [26]. All community pharmacists in Saudi Arabia were males and most were non-Saudis. However, this situation changed after we had collected our data, as females were not allowed to work in community pharmacies until 2018 [27, 28]. The generalizability of our study may also have been limited as prescription medication is often sold from community pharmacies without prescriptions. Although the law states that prescription medication should be dispensed only on the presentation of a prescription, many community pharmacies do not follow this regulation [7, 29].

Our study was strengthened by using a theory-based approach when designing the qualitative arm. We explored the behavior of community pharmacists using the Theoretical Domain Framework, which helped to explicitly analyze the pharmacist's point of view. Moreover, the quantitative study arm uncovered numerous variables to target for interventions.

Conclusion

Studying the supply of OTC medications according to EBPs using a mixed-method approach suggests that pharmacists are not at fault for taking a non-EBP approach. Given that providing OTC medication is a core function of pharmacists, using the factors underlying non-EBPs that were identified in this study to design interventions should help to change this behavior and decrease undesirable outcomes.

Supporting information

References

  1. 1. U.S. Food and Drug Administration. (2020). Drug Applications for Over-the-Counter (OTC) Drugs. [online] Available at: https://www.fda.gov/drugs/types-applications/drug-applications-over-counter-otc-drugs [Accessed 24 Feb. 2020].
  2. 2. Saudi Food and Drug Authority. Saudi Food and Drug Authority. Available: https://www.sfda.gov.sa/En/Pages/default.aspx
  3. 3. Johnson H. (2013). Selling evidence over the counter: Do community pharmacists engage with evidence-based medicine? Medical Writing, 22(4), pp.275–278.
  4. 4. Hanna LA, Hughes C, Watson M. Where's the evidence? Over-the-counter medicines and pharmacy practice. The International Journal of Pharmacy Practice. 2012 Oct;20(5):275–276. pmid:22953765
  5. 5. Seubert L.J.; Whitelaw K.; Boeni F.; Hattingh L.; Watson M.C.; Clifford R.M. Barriers and Facilitators for Information Exchange during Over-The-Counter Consultations in Community Pharmacy: A Focus Group Study. Pharmacy 2017, 5, 65. pmid:29211054
  6. 6. Burkiewicz J., and Zgarrick D. (2005). Evidence-Based Practice by Pharmacists: Utilization and Barriers. Annals of Pharmacotherapy, 39(7–8), pp.1214–1219 pmid:15956234
  7. 7. Aljadhey H., Assiri G., Mahmoud M., Al-Aqeel S., and Murray M. (2015). Self-medication in Central Saudi Arabia. Community pharmacy consumers' perspectives. SAUDI MEDICAL JOURNAL, 36(4), pp.328–334 pmid:25737176
  8. 8. Paudyal V., Hansford D., Cunningham S., and Stewart D. (2013). Over-the-counter prescribing and pharmacists' adoption of new medicines: Diffusion of innovations. Research in Social and Administrative Pharmacy, 9(3), pp.251–262. pmid:22835710
  9. 9. Inch J., Porteous T., Maskrey V., Blyth A., Burr J., Cleland J., et al. (2017), It's not what you do it's the way that it's measured: quality assessment of minor ailment management in community pharmacies. Int J Pharm Pract, 25: 253–262. pmid:27677423
  10. 10. Morse, Janice M. Mixed Method Design: Principles and Procedures (Developing Qualitative Inquiry). Taylor and Francis. 2009.
  11. 11. Jawaid Parnapy, Sarah A. "Chapter 7. Nonprescription and Self-Care." Community and Clinical Pharmacy Services: A Step-by-Step Approach Eds. Ellis Ashley W., and Justin J. Sherman. New York, NY: McGraw-Hill, 2013, http://accesspharmacy.mhmedical.com/content.aspx?bookid=684&sectionid=45145842.
  12. 12. van Hoof JJ, Cents MH, Megens NM, van der Tang SJ. Druggists and pharmacists as gatekeepers: sales routines and compliance with sales protocols for over-the-counter naproxen 275 mg medicines in the Netherlands. Health Policy. 2014;117(3):353–360. pmid:25106069
  13. 13. Cane J., O'Connor D., and Michie S. (2012). Validation of the theoretical domains framework for use in behavior change and implementation research: implementation Science, 7(1).
  14. 14. Michie S. (2005). Making psychological theory useful for implementing evidence-based practice: a consensus approach. Quality and Safety in Health Care, 14(1), pp.26–33. pmid:15692000
  15. 15. Collins J. C., Schneider C. R., Naughtin C. L., Wilson F., de Almeida Neto A. C., & Moles R. J. (2017). Mystery shopping and coaching as a form of audit and feedback to improve community pharmacy management of non-prescription medicine requests: an intervention study. BMJ open, 7(12), e019462. pmid:29247115
  16. 16. Watson M.C., Hart J., Johnston M., et al. Exploring the supply of non-prescription medicines from community pharmacies in Scotland. Pharm World Sci 30, 526–535 (2008). pmid:18297410
  17. 17. Edwards D. J. (2018). Evidence-based practice: Are we in or not?. Canadian pharmacists journal: CPJ = Revue des pharmaciens du Canada: RPC, 152(1), 16–17. pmid:30719192
  18. 18. Halila G. C., Junior E. H., Otuki M. F., & Correr C. J. (2015). The practice of OTC counseling by community pharmacists in Parana, Brazil. Pharmacy practice, 13(4), 597. pmid:26759614
  19. 19. Hanna LA, Hughes CM. 'First, do no harm': factors that influence pharmacists making decisions about over-the-counter medication: a qualitative study in Northern Ireland. Drug Saf. 2010;33(3):245–255. pmid:20158288
  20. 20. Rutter P. and Wadesango E. (2014) ‘Does evidence drive pharmacist over-the-counter product recommendations?’, Journal of evaluation in clinical practice, 20(4), pp. 425–428. pmid:24854503
  21. 21. Tjin A, Tsoi SLNM, de Boer A, Croiset G, Koster AS, van der Burgt S, et al. How basic psychological needs and motivation affect vitality and lifelong learning adaptability of pharmacists: a structural equation model. Adv Health Sci Educ Theory Pract. 2018;23(3):549–566. pmid:29388088
  22. 22. Michie S., van Stralen M.M. & West R. The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implementation Sci 6, 42 (2011). pmid:21513547
  23. 23. Jacob S., Schiffino N. and Biard B. (2018) ‘The mystery shopper: a tool to measure public service delivery?’, International Review of Administrative Sciences, 84(1), pp. 164–184.
  24. 24. Watson M., Norris P. and Granas A. (2006), A systematic review of the use of simulated patients and pharmacy practice research. International Journal of Pharmacy Practice, 14: 83–93.
  25. 25. Alaqeel S., and Abanmy N. (2015). Counseling practices in community pharmacies in Riyadh, Saudi Arabia: a cross-sectional study. BMC Health Services Research, 15(1). pmid:26669857
  26. 26. Xiong C., Chen X., Zhao X., et al. Patient satisfaction and gender composition of physicians—a cross-sectional study of community health services in Hubei, China. BMC Health Serv Res 18, 217 (2018). pmid:29587723
  27. 27. Bin Saleh G., Rezk N., Laika L., Ali A., and El-Metwally A. (2015). Pharmacist, the pharmaceutical industry and pharmacy education in Saudi Arabia: A questionnaire-based study. Saudi Pharmaceutical Journal, 23(5), pp.573–580. pmid:26594125
  28. 28. Wagner, R. (2020). Saudi women enter pharmaceutical retail industry | Rob L. Wagner | AW. [online] AW. Available at: https://thearabweekly.com/saudi-women-enter-pharmaceutical-retail-industry [Accessed 6 Mar. 2020].
  29. 29. Al-Mohamadi A., Badr A., Bin Mahfouz L., Samargandi D., and Al Ahdal A. (2013). Dispensing medications without prescription at Saudi community pharmacy: Extent and perception. Saudi Pharmaceutical Journal, 21(1), pp.13–18. pmid:23960815