Next Article in Journal
Predictors of Influenza Vaccination Uptake and the Role of Health Literacy among Health and Social Care Volunteers in the Province of Prato (Italy)
Next Article in Special Issue
A Pilot Study on the Association of Lead, 8-Hydroxyguanine, and Malondialdehyde Levels in Opium Addicts’ Blood Serum with Illicit Drug Use and Non-Addict Persons
Previous Article in Journal
Health Effects of Happiness in China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

How Anti-Substance Abuse Campaigns Influence Substance Abusers’ Psychological Health in Chinese Communities: The Mediating Role of Perceived Stigma

1
School of Economics and Statistics, Guangzhou University, Guangzhou 510006, China
2
Department of Social Work, School of Public Administration, South China Agricultural University, Guangzhou 510640, China
3
School of Education Science and Law, Xiangnan University, Chenzhou 423043, China
4
School of Sociology and Anthropology, Sun Yat-sen University, Guangzhou 510275, China
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Int. J. Environ. Res. Public Health 2022, 19(11), 6687; https://doi.org/10.3390/ijerph19116687
Submission received: 17 April 2022 / Revised: 25 May 2022 / Accepted: 28 May 2022 / Published: 30 May 2022

Abstract

:
The current study explored how anti-substance abuse campaigns influence substance abusers’ psychological health through the perception of stigma. The study is based on a sample of substance abusers who received community-based treatments (n = 3457) and used structural equation modeling to estimate the role of perceived stigma in mediating between perceptions of overstatement of harm conveyed in anti-substance abuse campaigns and psychological outcomes. The results revealed that substance abusers’ perception of overstatement of the harm caused by the substances and substance abusers enhanced their perceived stigma and impaired their psychological health in terms of anxiety, depression, and somatization, through both direct and indirect pathways. The results advocate for proper strategies in the design of anti-substance abuse campaigns. Possible initiatives to reduce substance abusers’ perceived stigma are recommended.

1. Introduction

Stigma is a robust correlate of psychological health [1]. Referring to a “mark” or an attribute that defines an individual based on stereotyping, stigma leads to discriminatory behavior against individuals within the inferior stereotyped groups [2,3,4]. Substance abusers frequently face public disapproval due to pre-existing stereotypes, such as being dangerous and irresponsible [5,6]. Substance abusers who are aware of such stereotypes may engage in personal devaluation and internalize these stigmas [7]. As a result, stigma damages several aspects of a substance abuser’s life, including making their access to resources more unequal, diminishing their willingness to seek help, limiting their opportunities for recovery, and creating poor health outcomes [5,8,9].
Anti-substance abuse campaigns are one of the sources of such stigma, e.g., [10]. Although such campaigns have been designed to protect the majority of non-users from substance abuse, the information conveyed in these campaigns usually employs “scare tactics” and defines substance abusers as a “social evil” [11]. Along with harsh criminal sentences for using illegal substances, in some countries anti-substance abuse campaigns appear to further label substance abusers as socially excluded and create stereotypes [11,12]. This social exclusion and discrimination are also risk factors for substance abusers’ psychological health, such as causing depression [13]. Nevertheless, only a few studies have explored anti-substance abuse campaigns’ negative influences, e.g., [14]; how anti-substance abuse campaigns negatively influence substance abusers’ well-being has rarely been examined, e.g., [11].
As a conceptual form of stigma, perceived stigma refers to an individual’s beliefs and perceptions regarding the prevalence of stigmatized attitudes and behaviors that others hold toward them [15]. Perceived stigma is significantly influenced by policy [11], public discourse [10], enacted stigma [16], treatment [17], types of stereotyped behaviors or symptoms [18,19], social supports [20], demographic characteristics, and other factors. It further enhances internalized stigma [15], generates a lower self-concept [6], decreases psychological functioning such as empathy [21] and shame [22], increases mental disorders such as depression [6,15,23], and reduces treatment-seeking behaviors [24] and treatment outcomes [25,26].
Perceived stigma rationally serves as a mediator between perceptions of overstatement of harm conveyed in anti-substance abuse campaigns and psychological symptoms among substance abusers. According to the process of stigma internalization, with pre-existing social categorizations (i.e., stereotypes) shaped by public discourse, substance abusers will gradually see themselves as being part of the stereotyped inferior group and will consistently enact stigma experiences [27], subsequently leading to possible experiential avoidance [28]. Thus, with exposure to the anti-substance abuse messages that are conveyed in anti-substance abuse campaigns, substance abusers perceive a social categorization and identity confirmation with the inferior stereotyped group, which rationally causes avoidance [29], thought suppression [30], and subsequent psychological symptoms such as depression [31]. Nevertheless, how anti-substance abuse campaigns negatively influence substance abusers’ psychological health through perceived stigma remains overlooked.
China has a large population of registered substance abusers who suffer from stigma [32,33,34,35]. According to a report by the China National Narcotic Control Commission (CNNCC), the number of substance abusers, defined as individuals who have been medically diagnosed with an addictive disorder and are registered in an administrative system for substance abusers, reached 1.8 million in 2020. In China, there are four types of substance abuse treatment programs: voluntary rehabilitation, compulsory rehabilitation, community detoxification, and community rehabilitation [36]. Voluntary rehabilitation is one in which the substance abuser participates on a voluntary basis. For substance abusers with any history of arrest or a criminal record, the other three types of compulsory programs are required by the country’s law enforcement agencies [37]. For those whose substance abuse is severe, an institutional compulsory rehabilitation is required, which includes two years of physical recovery, psychological education, and abstinence. For minor substance users and individuals who have completed the compulsory rehabilitation, community detoxification and community rehabilitation (CDCR) are required. CDCR usually lasts no more than three years and includes an individualized plan, facilitated by local community administrators and social workers, and with psychological education and counseling related to health, family relationships, and employment. Community detoxification focuses more on treating the addiction, whilst community rehabilitation emphasizes community reentry. CDCR is one of the most important procedures for substance abusers’ recovery [34]. Nevertheless, the existing literature has focused on the effects of pharmaceutical treatment outcomes, such as the rehabilitation effects of Methadone Maintenance Treatment e.g., [32,38,39]. The impact of non-pharmaceutical programs, especially on the stigma associated with Chinese substance abusers, has barely been investigated [40,41].
There are several variables that contribute to the stigma that Chinese substance abusers experience. As registration with a substance-abuse system is viewed as a lifelong “stamp” on substance abusers [42,43], China’s policy on registering substance abusers exacerbates the internalization of stigma, structurally labeling them as an inferior group. In addition, the drug policy used to view substance abusers as offenders and the corresponding anti-drug campaigns that have been implemented [44,45], including conveying “scare tactic” messages in the communities that emphasize the severe harmfulness and related harsh punishment brought about by the abuse of substances. Although the current policy has begun to treat substance abusers as victims, the ongoing anti-substance abuse campaigns implemented in the communities, with the aim to prevent substance abuse among non-users in the neighborhoods, are still using the same scare tactics [46]. There are usually two types of “scare tactic” messages. The first type of “scare tactics” message focuses on the potential harm caused by substance abusers, such as “if one gets addicted, the entire family would be destroyed.” The second type aims at the potential harm caused by the addictive substances, such as “choosing addictive substances is choosing death”. These “scare tactic” messages are not surprisingly overstating the harmfulness, which rationally enhances perceived stigma among substance abusers. Furthermore, Chinese society is culturally a collectively-oriented one in which individuals tend to emphasize social relationships. As such, the social devaluation that causes stigma is particularly harmful to substance abusers’ well-being [12,47,48]. CDCR substance abusers, who are residentially treated in their communities, are exposed to anti-substance abuse campaigns there, and experience stigma from their families, friends, professional groups, and society, all of whom also have been exposed to anti-substance abuse messages [34,49,50,51]. Thus, CDCR substance abusers might be particularly vulnerable to stigma depending on their treatment setting [26]. Consequently, such stigma is associated with dropping out of treatment programs [52] and a higher risk of unemployment [43], as well as possible psychological symptoms [53]. However, how these anti-substance abuse messages influence CDCR substance abusers’ psychological outcomes remains largely unknown in the Chinese context.
The current study explores CDCR substance abusers’ psychological outcomes, particularly the influence of community anti-substance abuse messages and perception of stigma. According to the above discussions, there are two types of overstatement of harm conveyed in anti-substance abuse campaigns, one is associated with substance abusers (i.e., perceived overstatement of the harm-substance abusers, POH-SA), and the other is associated with the substances themselves (i.e., perceived overstatement of the harm-substances, POH-S). According to the relationships between enacted stigma related experiences and psychological symptoms e.g., [13,16,49], we hypothesized that:
Hypothesis 1 (H1).
POH-SA positively influences psychological symptoms.
Hypothesis 2 (H2).
POH-S positively influences psychological symptoms.
Furthermore, CDCR substance abusers’ perceived stigma should be influenced by these two types of perceived overstatement of the harm conveyed in community anti-substance abuse campaigns, and their perceived stigma further influences their psychological health, e.g., [8,16,25]. We hypothesize that:
Hypothesis 3 (H3).
Perceived stigma positively mediates the effects of the POH-SA and POH-S on psychological symptoms.

2. Materials and Methods

2.1. Data and Sample

Ethical approval for this study was obtained from the Institutional Review Board (IRB) of the Anthropology Department at Sun Yat-sen University in Guangzhou, China. A cross-sectional design with two-stage cluster sampling was employed. First, using “city” as the sampling unit, eight cities in Guangdong Province were randomly selected. Second, using “street” as the sampling unit, fifteen street-level units were randomly selected per city. Then, ten to fifty individuals who received any type of substance abuse treatment were randomly referred by two province-level agencies to participate in the survey.
Online questionnaires were used on a voluntary basis. Only those who agreed with the informed consent on the first page proceeded to answer the questionnaire. A total of 6128 responses were collected, and 3457 were maintained after screening for non-CDRC participants and duplicated responses.

2.2. Measurement

2.2.1. Dependent Variables

Psychological symptoms. As psychological symptoms are associated with stigma among individuals with substance abuse [54], anxiety, depression, and somatization were measured by the Brief Symptom Inventory 18 (BSI-18) [55]. Respondents rated on a 5-point frequency scale their experiences of psychological symptoms in the previous week, from “not at all” = 0 to “very frequently” = 4. Composite scores for three subscales were achieved with good internal consistency (i.e., Cronbach’s α s of 0.92, 0.93, and 0.92 on anxiety, depression, and somatization, respectively).

2.2.2. Independent Variables

Perceived stigma. As mentioned above, stigma impacts people at various social levels [26,50]. The survey focused on the most influential levels of family, society, and official propaganda, and asked about the degree to which respondents perceive stigmatizing attitudes and actions from these three sources. Responses were originally rated on a 4-point scale from “not at all” = 1 to “very much” = 4. The four levels yielded a solid internal consistency (i.e., Cronbach’s α = 0.85), and the composite score was computed.
Perceived overstatement of the harm-substance abusers (POH-SA). A single item statement of “anti-substance abuse campaigns are overstating the harm caused by substance abusers” was used to ask about participants’ degree of perception. It was rated on a 4-point scale from “not at all” = 1 to “very much” = 4.
Perceived overstatement of the harm-substances (POH-S). A single item statement of “anti-substance abuse campaigns are overstating the harm caused by substances” was used to ask about participants’ degree of perception. It was rated on a 4-point scale from “not at all” = 1 to “very much” = 4.

2.2.3. Controlled Covariates

Type of substances. The type of substance that is abused influences the stigma process [56]. According to the substance usage representativeness in the current sample, the substances were classified as one of three types: heroin, methamphetamine, and other. Other substances include opium, cocaine, cannabis, morphine, ketamine, ecstasy, and other psychoactive drugs. The categories were dummy-coded as a history of usage = 1 and no history of usage = 0.
Duration of abstinence. The duration of abstinence was controlled, as it influences stigma [57]. The participants were asked about their estimated number of days of abstinence. As the participants on average had a three-month abstinence period (SD = 1.03), days were transferred into months for analysis.
Physical unhealth. Physical health status was controlled, as it is a robust correlate of psychological symptoms [58]. It was measured by a single question: “how many days did you feel physically unwell in the past week?” Participants reported the number of days, with a larger number representing poorer self-reported physical health status.
Demographic characteristics. Respondents were asked about demographic factors including employment status, gender, education, age, income, and marital status [53,59,60]. Respondents’ employment status was measured by a single question asking about the title of their current job. A score of 1 was given if the respondent reported having a steady job, and 0 was given if the respondent reported being unemployed, in the process of looking for a job, or staying at home. Gender was coded as “male” = 1 and “female” = 0. Education was coded into years of education as “Primary school or below” = 9, “High school/vocational school” = 12, “College degree/Diploma” = 15, “Undergraduate education/Bachelor” = 16, and “Postgraduate education/Master or above” = 19. Age was coded into years of age. Income was coded according to respondents’ personal monthly income. Furthermore, as there was a limited number of respondents who were divorced or had a marital status other than married (1.18%), marital status was coded as “married” = 1 and “other” = 0. A blank report was coded as a missing value.

2.3. Data Analysis

We employed Stata 15.0 (StataCorp LLC, College Station, TX, USA) for zero-order correlations and Structure Equation Modeling (SEM) with Maximum Likelihood estimation. As the current study aimed to understand how stigma influences general psychological symptoms, the psychological symptoms of anxiety, depression, and somatization were modeled as a latent variable to capture the shared variance [61]. The indirect effects of mediation were examined using the Monte Carlo method, as that method was preferred for SEM [62,63]. As the proportions of missing data were smaller than 0.01% among all key variables, the missing data was auto-deleted in the analyses.

3. Results

Regarding the missing data, observations with blank responses were deleted. Key variables reported a low percentage of missing values (i.e., less than 0.01%). Thus, the missing data was auto-deleted in the analyses. Common method bias was checked using the Harman Single Factor technique [64]. All research items exacted one factor that accounts for 39.73% of the total variance, indicating no common method bias.
Sample demographic statistics were presented in Table 1. The current sample of community substance abusers was predominantly male (i.e., 91.29%), with an average age of 37.82. They generally had a secondary school education (i.e., 8.56 years of education) and a low level of monthly income (i.e., M = 2.72, SD = 1.61). Over half of the sample was married (i.e., 55.51%) and 75.12% were currently employed. Regarding the substance type, heroin accounted for one-third, methamphetamine accounted for half, and other types of substances accounted for one-sixth of the sample.
The zero-order correlations between independent variables, mediators, and dependent variables are presented in Table 2. As expected, the three dimensions of psychical symptoms were strongly inter-correlated (i.e., r = 0.84–0.88, p < 0.00). Perceived stigma was slightly correlated with psychological symptoms (i.e., r = 0.18, p < 0.00), and, as expected, strongly correlated with the POH-SA (i.e., r = 0.86, p < 0.00). It failed to show any inter-correlations between the two types of perception of overstatement of harmful, or between the perceived stigma and POH-S.
The SEM results are shown in Figure 1 and Table 3. According to SEM model fit standards [65,66], the current model yielded a good model fit: Χ 2 / d f = 3.57, which falls within the range 2–5. The comparative fit index (CFI) = 0.99 > 0.90, the Tucker–Lewis index (TLI) = 0.98 > 0.90, and the root mean square error of approximation (RMSEA) = 0.03 < 0.05. According to the cutoff values of standardized SEM coefficient [67] p. 208, H1 and H2 were supported in that POH-SA ( β = 0.09 ,   p < 0.05 ) and POH-S ( β = 0.07 ,   p < 0.00 ) positively influenced psychological symptoms with a small effect size. Regarding H3, POH-SA ( β = 0.85 ,   p < 0.00 ) and POH-S ( β = 0.03 ,   p < 0.01 ) positively influenced perceived stigma, whilst perceived stigma positively influenced psychological symptoms ( β = 0.21 ,   p < 0.00 ). Second, according to the cutoff values of the mediation effect size [68], the Monte Carlo method (5000 replications) showed the indirect effects on psychological symptoms of the perceived stigma, mediating the influence of POH-SA in a medium to large effect size ( b = 0.18 ,   S E = 0.03 ,   95 %   CI = 0.12   ~   0.24 ,   p < 0.00 ) and POH-S to a small effect size ( b = 0.01 ,   S E = 0.00 ,   95 %   CI = 0.00   ~   0.01 ,   p < 0.05 ) . Thus, H3 was also supported.

4. Discussion

Stigma serves as one of the most important barriers to recovery for substance abusers [25]. The current study is one of the first to test the negative influences caused by anti-substance abuse campaigns on substance abusers’ psychological health through perceived stigma in Chinese communities. Our findings suggest that a perceived overstatement of the harm in anti-substance abuse campaigns, especially messages related to the substance abusers themselves, greatly enhanced substance abusers’ perception of stigma and reduced their psychological health in terms of anxiety, depression, and somatization. The findings have several implications for research and community healthcare practices.
First, the current study elaborates on the negative effects anti-substance abuse campaigns have on substance abusers’ stigma. Anti-substance abuse campaigns usually have been designed to prevent substance abuse among nonusers, especially those who are vulnerable [14]. To enhance the influence of such campaigns, “scare tactics” that appeal to people’s sense of fear have been a very common approach, e.g., [69]. Regarding the influences of such campaigns on substance abusers, the current findings echo that the public discourse shapes ideas about substance abusers as a “social evil” [10,11]. These anti-substance abuse messages, especially those that overstate the harm caused by substance abusers, negatively influence substance abusers’ perceptions of stigma against them. In comparison, the negative influences of stigma brought about by the perceived overstatement of harm caused by the substances per se was much smaller than the negative influences of the harm resulted from perceptions related to substance abusers. Such findings coincide with the view that stigma that is transmitted through persuasive messages may evoke personal defenses when conflicting with one’s own moral identity [70]. This may be because information related to substance abusers contains greater internal attribution [71], whilst information related only to the substances appears less threatening as it does not involve internal attribution [72]. Future studies may further explore the attribution and persuasion mechanism in substance abusers’ perceptions of anti-substance abuse messages.
Second, as psychological health is one of the most vital outcome variables among substance abusers, we find that substance abusers’ perceptions about overstatement of the harm that is conveyed through anti-substance campaigns has a direct and indirect influence on substance abusers’ psychological symptoms. Moreover, the indirect effect brought about by the perceived overstatement of the harm caused by substance abusers, mediated by the perceived stigma, showed a medium to large effect size. This finding adds to existing knowledge regarding substance abusers’ psychological health, namely, that besides factors such as socio-economic status, informal social supports, substance use history, treatment, and personal dispositions [16,40,42,53,73], perceptions of overstatement of the harm and stigma also matter. It is noteworthy that the current sample only includes CDCR substance abusers. As anti-substance abuse campaigns are usually launched in community settings, abusers are exposed to more anti-substance abuse messages than other types of treatment. Previous findings also suggested the benefits of no perceived stigma in the CDCR treatment as compared to other types of treatment [26]. Possible interventions reducing the risks of stigma, such as acceptance and commitment therapy and cognitive behavioral therapy, should be seriously considered in CDCR treatment [74,75]. Furthermore, possible studies may consider comparing the influences of anti-substance abuse messages and their perceived stigma on psychological health in different treatment settings.
Third, the general effects of anti-substance abuse campaigns are worth discussing. Regarding the general population, the effectiveness of prevention among non-users has long been debated (e.g., see the boomerang effect) [14,76]. The current study further implies that such campaigns may have negative influences on substances abusers’ recovery. Therefore, the design of such campaigns is vital [77,78], implying that further studies could explore proper ways of persuading non-users but with minimal side effects on substance abusers. Furthermore, the current study highlights that such anti-substance abuse messages should not target people and their social relationships. A narrow focus on the harm associated with using substances may cause fewer side effects regarding substance abusers’ stigma and psychological health. Such results expand the literature on substance abuse treatment in mainland China, especially using CDCR substance abusers as the target population. Nevertheless, assessments of the effects of anti-substance abuse campaigns in China are still rare, thus calling for future exploration.
The current study has several limitations. First, it employed a self-reporting questionnaire survey in a voluntary manner, which could lead to a possible response bias, such as self-selection and the tendency toward social desirability. Second, although the SEM method was employed, the study was in a cross-sectional design, which cannot fully justify the causal directions. Further investigations through a longitudinal or experimental design would be necessary to help better understand the proposed causal relationships. Third, given the small effect size found in the results, several measurements would need possible improvements in using well-tested scales, such as the perceived stigma scale [15] and rigorous measurements of perceptions of anti-substance abuse messages. Finally, we only focused on substance abusers involved in the community-based treatment programs, whereas future studies may consider using the full sample or other samples to examine factors influencing the possibilities of entering the community-based treatment program or the institutional program, or other cross-program comparisons.

5. Conclusions

The current study advanced our understanding of how anti-substance abuse campaigns influence substance abusers’ psychological health through their perceptions of stigma. Using a sample of substance abusers from community-based treatment programs in China’s Guangdong Province (n = 3457), the findings revealed that substance abusers’ perception of overstatement of the harm in anti-substance abuse campaigns enhanced their perceived stigma and had negative influences, though slight, on their psychological health. It implies that strategies should be carefully applied in designing anti-substance abuse campaigns, and that the possible protection of substance abusers should also be considered by community governance so as not to associate an overstatement of the harm with the identity of substance abusers. Community health workers should also consider being involved in interventions to reduce the perceived stigma among substance abusers.

Author Contributions

Conceptualization, Y.Z. and Y.C.; methodology, Y.Z. and C.X.J.; software and formal analysis C.X.J.; investigation, resources, and data curation, Y.C. and L.H.; writing—original draft preparation, C.X.J.; writing—review and editing, L.H.; supervision, Y.C. and C.X.J.; project administration, L.H.; funding acquisition, Y.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Social Science Fund of China, grant number 20&ZD122; the Guangzhou Philosophy and Social Science Foundation, grant number 2019GZGJ50; Cooperative Professional Training Program funded by the Guangdong public security Department, grant number skzx2019060.

Institutional Review Board Statement

The current study obtained ethical approval from the Institutional Review Board (IRB) of the Anthropology Department at Sun Yat-sen University, China (protocol code N.A.).

Informed Consent Statement

Online informed consent was obtained online survey from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available upon request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Mak, W.W.; Poon, C.Y.; Pun, L.Y.; Cheung, S.F. Meta-Analysis of Stigma and Mental Health. Soc. Sci. Med. 2007, 65, 245–261. [Google Scholar] [CrossRef] [PubMed]
  2. Goffman, E. Stigma: Notes on the Management of Spoiled Identity; Simon and Schuster: Delran, NJ, USA, 1963; ISBN 1-4391-8833-5. [Google Scholar]
  3. Jones, E.E. Social Stigma: The Psychology of Marked Relationships; WH Freeman: New York, NY, USA, 1984. [Google Scholar]
  4. Link, B.G.; Phelan, J.C. Conceptualizing Stigma. Annu. Rev. Sociol. 2001, 27, 363–385. [Google Scholar] [CrossRef]
  5. Palamar, J.J.; Halkitis, P.N.; Kiang, M.V. Perceived Public Stigma and Stigmatization in Explaining Lifetime Illicit Drug Use among Emerging Adults. Addict. Res. Theory 2013, 21, 516–525. [Google Scholar] [CrossRef]
  6. Schomerus, G.; Lucht, M.; Holzinger, A.; Matschinger, H.; Carta, M.G.; Angermeyer, M.C. The Stigma of Alcohol Dependence Compared with Other Mental Disorders: A Review of Population Studies. Alcohol Alcohol. Oxf. Oxfs. 2011, 46, 105–112. [Google Scholar] [CrossRef] [Green Version]
  7. Hing, N.; Russell, A.M.T. How Anticipated and Experienced Stigma Can Contribute to Self-Stigma: The Case of Problem Gambling. Front. Psychol. 2017, 8, 235. [Google Scholar] [CrossRef] [Green Version]
  8. Pascoe, E.A.; Smart Richman, L. Perceived Discrimination and Health: A Meta-Analytic Review. Psychol. Bull. 2009, 135, 531. [Google Scholar] [CrossRef] [Green Version]
  9. Yang, L.H.; Wong, L.Y.; Grivel, M.M.; Hasin, D.S. Stigma and Substance Use Disorders: An International Phenomenon. Curr. Opin. Psychiatry 2017, 30, 378–388. [Google Scholar] [CrossRef]
  10. Thanh, D.C.; Moland, K.M.; Fylkesnes, K. Persisting Stigma Reduces the Utilisation of HIV-Related Care and Support Services in Viet Nam. BMC Health Serv. Res. 2012, 12, 428. [Google Scholar] [CrossRef] [Green Version]
  11. Hammett, T.M.; Wu, Z.; Duc, T.T.; Stephens, D.; Sullivan, S.; Liu, W.; Chen, Y.; Ngu, D.; Des Jarlais, D.C. ‘Social Evils’ and Harm Reduction: The Evolving Policy Environment for Human Immunodeficiency Virus Prevention among Injection Drug Users in China and Vietnam. Addiction 2008, 103, 137–145. [Google Scholar] [CrossRef]
  12. Rivera, A.V.; DeCuir, J.; Crawford, N.D.; Amesty, S.; Lewis, C.F. Internalized Stigma and Sterile Syringe Use among People Who Inject Drugs in New York City, 2010–2012. Drug Alcohol Depend. 2014, 144, 259–264. [Google Scholar] [CrossRef] [Green Version]
  13. Latkin, C.; Davey-Rothwell, M.; Yang, J.; Crawford, N. The Relationship between Drug User Stigma and Depression among Inner-City Drug Users in Baltimore, MD. J. Urban. Health 2013, 90, 147–156. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Kelder, S.H.; Pechmann, C.; Slater, M.D.; Worden, J.K.; Levitt, A. The National Youth Anti-Drug Media Campaign. Am. J. Public Health 2002, 92, 1211–1212. [Google Scholar] [CrossRef] [PubMed]
  15. Luoma, J.B.; O’Hair, A.K.; Kohlenberg, B.S.; Hayes, S.C.; Fletcher, L. The Development and Psychometric Properties of a New Measure of Perceived Stigma Toward Substance Users. Subst. Use Misuse 2010, 45, 47–57. [Google Scholar] [CrossRef] [PubMed]
  16. Chi, P.; Li, X.; Zhao, J.; Zhao, G. Vicious Circle of Perceived Stigma, Enacted Stigma and Depressive Symptoms Among Children Affected by HIV/AIDS in China. AIDS Behav. 2014, 18, 1054–1062. [Google Scholar] [CrossRef]
  17. Fortney, J.; Mukherjee, S.; Curran, G.; Fortney, S.; Han, X.; Booth, B.M. Factors Associated with Perceived Stigma for Alcohol Use and Treatment among At-Risk Drinkers. J. Behav. Health Serv. Res. 2004, 31, 418–429. [Google Scholar] [CrossRef]
  18. Committee on the Science of Changing Behavioral Health Social Norms; Board on Behavioral, Cognitive, and Sensory Sciences; Division of Behavioral and Social Sciences and Education; National Academies of Sciences, Engineering, and Medicine. Understanding Stigma of Mental and Substance Use Disorders; National Academies Press: Washington, DC, USA, 2016. [Google Scholar]
  19. Brown, S.A. Stigma towards Marijuana Users and Heroin Users. J. Psychoact. Drugs 2015, 47, 213–220. [Google Scholar] [CrossRef]
  20. Smith, R.; Rossetto, K.; Peterson, B.L. A Meta-Analysis of Disclosure of One’s HIV-Positive Status, Stigma and Social Support. AIDS Care 2008, 20, 1266–1275. [Google Scholar] [CrossRef]
  21. Decety, J.; Echols, S.; Correll, J. The Blame Game: The Effect of Responsibility and Social Stigma on Empathy for Pain. J. Cogn. Neurosci. 2010, 22, 985–997. [Google Scholar] [CrossRef]
  22. Dearing, R.L.; Stuewig, J.; Tangney, J.P. On the Importance of Distinguishing Shame from Guilt: Relations to Problematic Alcohol and Drug Use. Addict. Behav. 2005, 30, 1392–1404. [Google Scholar] [CrossRef] [Green Version]
  23. Birtel, M.D.; Wood, L.; Kempa, N.J. Stigma and Social Support in Substance Abuse: Implications for Mental Health and Well-Being. Psychiatry Res. 2017, 252, 1–8. [Google Scholar] [CrossRef]
  24. Keyes, K.M.; Hatzenbuehler, M.L.; McLaughlin, K.A.; Link, B.; Olfson, M.; Grant, B.F.; Hasin, D. Stigma and Treatment for Alcohol Disorders in the United States. Am. J. Epidemiol. 2010, 172, 1364–1372. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Crapanzano, K.A.; Hammarlund, R.; Ahmad, B.; Hunsinger, N.; Kullar, R. The Association between Perceived Stigma and Substance Use Disorder Treatment Outcomes: A Review. Subst. Abus. Rehabil. 2019, 10, 1. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Han, L.; Jia, C.X. Treatments, Perceived Stigma, and Employment Outcomes among Substance Abusers in China. Healthcare 2022, 10, 130. [Google Scholar] [CrossRef] [PubMed]
  27. Luoma, J.B.; Nobles, R.H.; Drake, C.E.; Hayes, S.C.; O’Hair, A.; Fletcher, L.; Kohlenberg, B.S. Self-Stigma in Substance Abuse: Development of a New Measure. J. Psychopathol. Behav. Assess. 2013, 35, 223–234. [Google Scholar] [CrossRef] [Green Version]
  28. Steele, C.M.; Spencer, S.J.; Aronson, J. Contending with Group Image: The Psychology of Stereotype and Social Identity Threat. In Advances in Experimental Social Psychology; Elsevier: Amsterdam, The Netherlands, 2002; Volume 34, pp. 379–440. ISBN 0065-2601. [Google Scholar]
  29. Quinn, D.M.; Kahng, S.K.; Crocker, J. Discreditable: Stigma Effects of Revealing a Mental Illness History on Test Performance. Pers. Soc. Psychol. Bull. 2004, 30, 803–815. [Google Scholar] [CrossRef]
  30. Schmader, T.; Johns, M.; Forbes, C. An Integrated Process Model of Stereotype Threat Effects on Performance. Psychol. Rev. 2008, 115, 336. [Google Scholar] [CrossRef] [Green Version]
  31. Chawla, N.; Ostafin, B. Experiential Avoidance as a Functional Dimensional Approach to Psychopathology: An Empirical Review. J. Clin. Psychol. 2007, 63, 871–890. [Google Scholar] [CrossRef]
  32. Deng, Q.; Hu, M.; Yu, F.; Liu, Q.; Hao, W.; Wu, Q.; Luo, T. A Community-Based Investigation of Stigma Toward Individuals Receiving Methadone Maintenance Treatment in China: A Randomized Case Vignette Study. Front. Psychiatry 2020, 11, 1277. [Google Scholar] [CrossRef]
  33. Li, L.; Liang, L.-J.; Lin, C.; Feng, N.; Wu, Z. Comparison Between Urinalysis Results and Self-Reported Heroin Use Among Patients Undergoing Methadone Maintenance Treatment in China. Subst. Use Misuse 2017, 52, 1307–1314. [Google Scholar] [CrossRef] [Green Version]
  34. Luo, T.; Wang, J.; Li, Y.; Wang, X.; Tan, L.; Deng, Q.; Thakoor, J.P.D.; Hao, W. Stigmatization of People with Drug Dependence in China: A Community-Based Study in Hunan Province. Drug Alcohol Depend. 2014, 134, 285–289. [Google Scholar] [CrossRef]
  35. Zhang, C.; Li, X.; Liu, Y.; Zhou, Y.; Shen, Z.; Chen, Y. Impacts of HIV Stigma on Psychosocial Well-Being and Substance Use Behaviors Among People Living With HIV/AIDS In China: Across the Life Span. AIDS Educ. Prev. 2018, 30, 108–119. [Google Scholar] [CrossRef] [PubMed]
  36. Huang, K.; Yu, C.; Chen, X.; Hao, Y.; Ding, Y.; Wu, Z.; Wang, X. A Quasi-Experimental Study on the Effectiveness of Compulsory and Voluntary Treatment Settings for 1,299 Drug Abusers in Hunan, China. Front. Psychiatry 2021, 12, 613665. [Google Scholar] [CrossRef] [PubMed]
  37. Lin, S.; Zhang, Y. Risk Control and Rational Recreation: A Qualitative Analysis of Synthetic Drug Use among Young Urbanites in China. Int. J. Drug Policy 2014, 25, 769–775. [Google Scholar] [CrossRef] [PubMed]
  38. Duan, S.; Jin, Z.; Liu, X.; Yang, Y.; Ye, R.; Tang, R.; Gao, M.; Ding, Y.; He, N. Tobacco and Alcohol Use among Drug Users Receiving Methadone Maintenance Treatment: A Cross-Sectional Study in a Rural Prefecture of Yunnan Province, Southwest China. BMJ Open 2017, 7, e014643. [Google Scholar] [CrossRef]
  39. Zhang, L.; Zou, X.; Xu, Y.; Medland, N.; Deng, L.; Liu, Y.; Su, S.; Ling, L. The Decade-Long Chinese Methadone Maintenance Therapy Yields Large Population and Economic Benefits for Drug Users in Reducing Harm, HIV and HCV Disease Burden. Front. Public Health 2019, 7, 327. [Google Scholar] [CrossRef]
  40. Li, Y.; Zeng, X.; Zhou, H. Relationship between Anxiety and Drug Abstention Motivation in Men with Substance Use Disorders: A Cross-Sectional Study of Compulsory Isolation Rehabilitation in China. J. Ethn. Subst. Abuse 2021, 39, 171. [Google Scholar] [CrossRef]
  41. Yang, J.; Giummarra, M.J. Compulsory and Voluntary Drug Treatment Models in China: A Need for Improved Evidence-Based Policy and Practice to Reduce the Loaded Burden of Substance Use Disorders. Int. J. Drug Policy 2021, 92, 103063. [Google Scholar] [CrossRef]
  42. Blume, A.W. Advances in Substance Abuse Prevention and Treatment Interventions among Racial, Ethnic, and Sexual Minority Populations. Alcohol Res. Curr. Rev. 2016, 38, 47. [Google Scholar]
  43. Bobrova, N.; Rhodes, T.; Power, R.; Alcorn, R.; Neifeld, E.; Krasiukov, N.; Latyshevskaia, N.; Maksimova, S. Barriers to Accessing Drug Treatment in Russia: A Qualitative Study among Injecting Drug Users in Two Cities. Drug Alcohol Depend. 2006, 82, S57–S63. [Google Scholar] [CrossRef]
  44. Sun, H.; Bao, Y.; Zhou, S.; Meng, S.; Lu, L. The New Pattern of Drug Abuse in China. Curr. Opin. Psychiatry 2014, 27, 251–255. [Google Scholar] [CrossRef]
  45. Lu, L.; Fang, Y.; Wang, X. Drug Abuse in China: Past, Present and Future. Cell. Mol. Neurobiol. 2008, 28, 479–490. [Google Scholar] [CrossRef] [PubMed]
  46. Shi, R.; Hazen, M.D. Applying the Extended Parallel Process Model to Examine Posters in the 2008 Chinese Annual Anti-Drug Campaign. J. Asian Pac. Commun. 2012, 22, 60–77. [Google Scholar] [CrossRef]
  47. Brockner, J.; Chen, Y.-R. The Moderating Roles of Self-Esteem and Self-Construal in Reaction to a Threat to the Self: Evidence from the People’s Republic of China and the United States. J. Pers. Soc. Psychol. 1996, 71, 603. [Google Scholar] [CrossRef] [PubMed]
  48. Mak, W.W.S.; Ho, C.Y.Y.; Wong, V.U.T.; Law, R.W.; Chan, R.C.H. Cultural Model of Self-Stigma among Chinese with Substance Use Problems. Drug Alcohol Depend. 2015, 155, 83–89. [Google Scholar] [CrossRef]
  49. Conner, K.O.; Rosen, D. “You’re Nothing but a Junkie”: Multiple Experiences of Stigma in an Aging Methadone Maintenance Population. J. Soc. Work Pract. Addict. 2008, 8, 244–264. [Google Scholar] [CrossRef]
  50. Gunn, A.; Guarino, H. “Not Human, Dead Already”: Perceptions and Experiences of Drug-Related Stigma among Opioid-Using Young Adults from the Former Soviet Union Living in the US. Int. J. Drug Policy 2016, 38, 63–72. [Google Scholar] [CrossRef] [Green Version]
  51. Notley, C.; Maskrey, V.; Holland, R. The Needs of Problematic Drug Misusers Not in Structured Treatment–a Qualitative Study of Perceived Treatment Barriers and Recommendations for Services. Drugs Educ. Prev. Policy 2012, 19, 40–48. [Google Scholar] [CrossRef]
  52. Gilchrist, G.; Moskalewicz, J.; Nutt, R.; Love, J.; Germeni, E.; Valkova, I.; Kantchelov, A.; Stoykova, T.; Bujalski, M.; Poplas-Susic, T. Understanding Access to Drug and Alcohol Treatment Services in Europe: A Multi-Country Service Users’ Perspective. Drugs Educ. Prev. Policy 2014, 21, 120–130. [Google Scholar] [CrossRef]
  53. Lin, W.; Zhou, W. Factors Associated with the Physical and Mental Health of Drug Users Participating in Community-Based Drug Rehabilitation Programmes in China. Health Soc. Care Community 2020, 28, 584–590. [Google Scholar] [CrossRef]
  54. Chen, L.Y.; Strain, E.C.; Crum, R.M.; Mojtabai, R. Gender Differences in Substance Abuse Treatment and Barriers to Care among Persons with Substance Use Disorders with and without Comorbid Major Depression. J. Addict. Med. 2013, 7, 325. [Google Scholar] [CrossRef] [Green Version]
  55. Derogatis, L.R. BSI Brief Symptom Inventory. In Administration, Scoring, and Procedures Manual; National Computer Systems: Minneapolis, MN, USA, 1993. [Google Scholar]
  56. Calabrese, S.K.; Burke, S.E.; Dovidio, J.F.; Levina, O.S.; Uusküla, A.; Niccolai, L.M.; Heimer, R. Internalized HIV and Drug Stigmas: Interacting Forces Threatening Health Status and Health Service Utilization among People with HIV Who Inject Drugs in St. Petersburg, Russia. AIDS Behav. 2016, 20, 85–97. [Google Scholar] [CrossRef] [PubMed]
  57. Mattoo, S.K.; Sarkar, S.; Gupta, S.; Nebhinani, N.; Parakh, P.; Basu, D. Stigma Towards Substance Use: Comparing Treatment Seeking Alcohol and Opioid Dependent Men. Int. J. Ment. Health Addict. 2015, 13, 73–81. [Google Scholar] [CrossRef]
  58. Ohrnberger, J.; Fichera, E.; Sutton, M. The Relationship between Physical and Mental Health: A Mediation Analysis. Soc. Sci. Med. 2017, 195, 42–49. [Google Scholar] [CrossRef] [PubMed]
  59. Brown, S.A.; Kramer, K.; Lewno, B.; Dumas, L.; Sacchetti, G.; Powell, E. Correlates of Self-Stigma among Individuals with Substance Use Problems. Int. J. Ment. Health Addict. 2015, 13, 687–698. [Google Scholar] [CrossRef]
  60. Meyers, S.A.; Earnshaw, V.A.; D’Ambrosio, B.; Courchesne, N.; Werb, D.; Smith, L.R. The Intersection of Gender and Drug Use-Related Stigma: A Mixed Methods Systematic Review and Synthesis of the Literature. Drug Alcohol Depend. 2021, 223, 108706. [Google Scholar] [CrossRef]
  61. Salkind, N. Encyclopedia of Research Design; SAGE Publications, Inc.: Thousand Oaks, CA, USA, 2010; ISBN 978-1-4129-6127-1. [Google Scholar]
  62. Preacher, K.J.; Selig, J.P. Advantages of Monte Carlo Confidence Intervals for Indirect Effects. Commun. Methods Meas. 2012, 6, 77–98. [Google Scholar] [CrossRef] [Green Version]
  63. Yzerbyt, V.; Muller, D.; Batailler, C.; Judd, C.M. New Recommendations for Testing Indirect Effects in Mediational Models: The Need to Report and Test Component Paths. J. Pers. Soc. Psychol. 2018, 115, 929–943. [Google Scholar] [CrossRef] [Green Version]
  64. Eichhorn, B.R. Common Method Variance Techniques; Cleveland State University: Cleveland, OH, USA, 2014; pp. 1–11. [Google Scholar]
  65. Hu, L.; Bentler, P.M. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Struct. Equ. Model. Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  66. Tabachnick, B.G.; Fidell, L.S.; Ullman, J.B. Using Multivariate Statistics, 7th ed.; Pearson: New York, NY, USA, 2019; ISBN 978-0-13-479054-1. [Google Scholar]
  67. Joseph, F.; Tomas, M.G.; Christian, M.; Marko, S. (Eds.) A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM), 2nd ed.; Sage: Los Angeles, CA, USA, 2017; ISBN 978-1-4833-7744-5. [Google Scholar]
  68. Kenny, D.A. MEDIATION 2021. Available online: https://davidakenny.net/cm/mediate.htm (accessed on 4 March 2022).
  69. Beaudoin, C.E. Exploring Antismoking Ads: Appeals, Themes, and Consequences. J. Health Commun. 2002, 7, 123–137. [Google Scholar] [CrossRef]
  70. Achar, C.; Dunn, L.H.; Agrawal, N. Tainted by Stigma: The Interplay of Stigma and Moral Identity in Health Persuasion. J. Mark. Res. 2022, 59, 392–410. [Google Scholar] [CrossRef]
  71. Lewis, N.; Sznitman, S.R. You Brought It on Yourself: The Joint Effects of Message Type, Stigma, and Responsibility Attribution on Attitudes Toward Medical Cannabis: Narratives and Medical Cannabis Policy. J. Commun. 2017, 67, 181–202. [Google Scholar] [CrossRef]
  72. Dietz-Uhler, B.; Murrell, A. Effects of Social Identity and Threat on Self-Esteem and Group Attributions. Group Dyn. Theory Res. Pract. 1998, 2, 24. [Google Scholar] [CrossRef]
  73. Crockett, K.B.; Kalichman, S.C.; Kalichman, M.O.; Cruess, D.G.; Katner, H.P. Experiences of HIV-Related Discrimination and Consequences for Internalised Stigma, Depression and Alcohol Use. Psychol. Health 2019, 34, 796–810. [Google Scholar] [CrossRef] [PubMed]
  74. Luoma, J.B.; Kohlenberg, B.S.; Hayes, S.C.; Bunting, K.; Rye, A.K. Reducing Self-Stigma in Substance Abuse through Acceptance and Commitment Therapy: Model, Manual Development, and Pilot Outcomes. Addict. Res. Theory 2008, 16, 149–165. [Google Scholar] [CrossRef]
  75. Mittal, D.; Sullivan, G.; Chekuri, L.; Allee, E.; Corrigan, P.W. Empirical Studies of Self-Stigma Reduction Strategies: A Critical Review of the Literature. Psychiatr. Serv. 2012, 63, 974–981. [Google Scholar] [CrossRef] [Green Version]
  76. Fishbein, M.; Hall-Jamieson, K.; Zimmer, E.; von Haeften, I.; Nabi, R. Avoiding the Boomerang: Testing the Relative Effectiveness of Antidrug Public Service Announcements Before a National Campaign. Am. J. Public Health 2002, 92, 238–245. [Google Scholar] [CrossRef]
  77. Dillard, J.P.; Shen, L.; Vail, R.G. Does Perceived Message Effectiveness Cause Persuasion or Vice Versa? 17 Consistent Answers. Hum. Commun. Res. 2007, 33, 467–488. [Google Scholar] [CrossRef]
  78. Worden, J.K.; Slater, M.D. Theory and Practice in the National Youth Anti-Drug Media Campaign. Soc. Mark. Q. 2004, 10, 13–27. [Google Scholar] [CrossRef]
Figure 1. The standardized SEM results. Note. *** p < 0.00, ** p < 0.01, * p < 0.05. POH-SA = Perceived overstatement of the harm-substance abusers; POH-S = Perceived overstatement of the harm-substances.
Figure 1. The standardized SEM results. Note. *** p < 0.00, ** p < 0.01, * p < 0.05. POH-SA = Perceived overstatement of the harm-substance abusers; POH-S = Perceived overstatement of the harm-substances.
Ijerph 19 06687 g001
Table 1. Sample descriptions.
Table 1. Sample descriptions.
FemaleMaleTotal
N30131563457
(8.71%)(91.29%)(100.00%)
N of employed21023872597
(69.77%)(75.63%)(75.12%)
N of married13717711908
(45.97%)(56.42%)(55.51%)
N of using Heroin5210421094
(17.28%)(33.02%)(31.56%)
N of using Methamphetamine18217121894
(60.47%)(54.25%)(54.65%)
N of using other types of substances42455497
(14.24%)(14.67%)(14.34%)
M physical unhealth (days per week)0.550.640.63
(0.08)(0.03)(1.48)
M of personal monthly income (1000 CNY)2.372.752.72
(0.10)(0.03)(1.61)
M of abstinence duration (months)3.263.293.29
(0.06)(0.02)(1.04)
M of years of education8.768.548.56
(0.17)(0.05)(2.80)
M of years of age34.3838.1537.82
(0.50)(0.16)(9.07)
Note. Percentages of the category total and standardized errors are in parentheses. CNY = Chinese Yuan (1000 CNY ≈ 157 USD). N = number, and M = mean value.
Table 2. Zero-order correlational matrix.
Table 2. Zero-order correlational matrix.
123456
1. Anxiety
2. Depression0.88 ***
3. Somatization0.87 ***0.84 ***
4. Perceived stigma0.18 ***0.18 ***0.18 ***
5. POH-SA0.14 ***0.13 ***0.13 ***0.86 ***
6. POH-S0.07 ***0.08 ***0.09 ***0.01−0.01
Note. *** p < 0.00. POH-SA = Perceived overstatement of the harm-substance abusers; POH-S = Perceived overstatement of the harm-substances.
Table 3. Standardized SEM results (n = 2759).
Table 3. Standardized SEM results (n = 2759).
Variables→POH-SA→POH-S→Perceived Stigma→Psychological Symptoms
POH-SA 0.85 ***0.09 *
POH-S 0.03 **0.07 ***
Perceived stigma 0.21 ***
Controlled Covariates
    Type of substance
    (Base = no usage)
     -Heroin−0.030.030.01−0.01
     -Methamphetamines0.06 **0.06 **0.02 *−0.01
     -Other0.000.11 ***0.010.06 **
    Abstinence (months)−0.06 ***0.02−0.03 **−0.05 **
    Physical unhealth 0.06 **0.040.010.34 ***
Demographics
    Employment status−0.03−0.05 *0.03 **−0.07 **
    Monthly income (CNY)−0.030.05 *−0.04 **−0.07 ***
    Male (Base = female)0.020.010.02−0.06
    Married (Base = others)0.06 **−0.04−0.040.03
    Age (years)−0.020.06 **0.03 *0.04
    Education (years)0.010.01−0.01−0.02
Factor loadings for indicators of the latent variable
Psychological symptoms -> AnxietyDepressionSomatization
Factor Loading0.91 ***0.87 ***0.94 ***
Model-fit index
χ 2 / d f = 3.57; CFI = 0.99; TLI = 0.98; RMSEA = 0.03, with 90% CI = [0.02–0.04]
Note. *** p < 0.00, ** p < 0.01, * p < 0.05. POH-SA = Perceived overstatement of the harm-substance abusers; POH-S = Perceived overstatement of the harm-substances.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zeng, Y.; Han, L.; Cheng, Y.; Jia, C.X. How Anti-Substance Abuse Campaigns Influence Substance Abusers’ Psychological Health in Chinese Communities: The Mediating Role of Perceived Stigma. Int. J. Environ. Res. Public Health 2022, 19, 6687. https://doi.org/10.3390/ijerph19116687

AMA Style

Zeng Y, Han L, Cheng Y, Jia CX. How Anti-Substance Abuse Campaigns Influence Substance Abusers’ Psychological Health in Chinese Communities: The Mediating Role of Perceived Stigma. International Journal of Environmental Research and Public Health. 2022; 19(11):6687. https://doi.org/10.3390/ijerph19116687

Chicago/Turabian Style

Zeng, Yonghui, Li Han, Yu Cheng, and Cindy Xinshan Jia. 2022. "How Anti-Substance Abuse Campaigns Influence Substance Abusers’ Psychological Health in Chinese Communities: The Mediating Role of Perceived Stigma" International Journal of Environmental Research and Public Health 19, no. 11: 6687. https://doi.org/10.3390/ijerph19116687

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop