Next Article in Journal
Patient Information and Consent for Care in the Intensive Care Unit
Previous Article in Journal
Health Literacy among Japanese College Students: Association with Healthy Lifestyle and Subjective Health Status
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Prevalence and Determinants of Depressive and Anxiety Symptoms among Transgender People: Results of a Survey

1
Department of Health Economics and Health Services Research, University Medical Center Hamburg-Eppendorf, Hamburg Center for Health Economics, 20246 Hamburg, Germany
2
Division of Plastic, Reconstructive and Aesthetic Surgery, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany
*
Author to whom correspondence should be addressed.
Healthcare 2023, 11(5), 705; https://doi.org/10.3390/healthcare11050705
Submission received: 3 February 2023 / Revised: 23 February 2023 / Accepted: 24 February 2023 / Published: 27 February 2023

Abstract

:
Objectives: The aim was to investigate the prevalence of probable depression and probable anxiety and to investigate the determinants of depressive symptoms and anxiety symptoms among transgender people. Methods: In this “Transgender Survey” (n = 104) we included transgender people who had joined self-help groups to obtain and share information about the gender-affirming surgeries performed at the Division of Plastic, Reconstructive and Aesthetic Surgery at the University Medical Center Hamburg-Eppendorf. Data collection took place between April and October 2022. To measure probable depression, the patient health questionnaire-9 was used. The generalized anxiety disorder-7 was used to quantify probable anxiety. Results: The prevalence of probable depression was 33.3% and it was 29.6% for probable anxiety. Multiple linear regressions showed that both more depressive symptoms and anxiety symptoms were significantly associated with younger age (β = −0.16, p < 0.01; β = −0.14, p < 0.01), being unemployed (e.g., full-time employed compared to unemployment: β = −3.05, p < 0.05; β = −2.69, p < 0.05), worse self-rated health (β = −3.31, p < 0.001; β = −1.88, p < 0.05), and having at least one chronic disease (β = 3.71, p < 0.01; β = 2.61, p < 0.05). Conclusions: Remarkably high prevalence rates were identified among transgender people. Furthermore, risk factors of poor mental health (e.g., unemployment or younger age) were identified—which can help to address transgender people at risk for poor mental health.

1. Introduction

Worldwide, 264 million people (3.6%) suffer from an anxiety disorder and 322 million (4.4%) from a depressive disorder [1]. Thus, depression and anxiety are the most common mental disorders in the general population [2].
Transgender people identify with a different gender from their sex assigned at birth [3]. Trans feminine describes transgender people assigned a male sex at birth who identify as female and trans masculine describes transgender people assigned a female sex at birth who identify as men. Transgender people have diverse sexual orientation identities, attractions, and behaviors. Globally, accurate data concerning the size of the transgender population are lacking and population prevalence depends on the definition of transgender [4]. It is estimated that the prevalence of transgender identity ranges between 0.3% and 0.5% [4].
The gender affirmation, which is defined as a process through which a person’s gender identity is socially recognized, is of high importance for transgender people’s health [5].
For transgender people, health inequities are multifactorial and include increased risks for systematic social and economic marginalization, stigma, and discrimination [1]. Transgender people are at substantially increased risk for various negative mental health outcomes compared to cisgender people [3]. These poor mental health outcomes include depression and anxiety [6,7,8,9,10] and are likely due to social rejection [11,12], stigma, discrimination, and violence [13].
Moreover, transgender people face difficulties in receiving the diagnosis and obtaining care due to, for example, barriers to mental health care or/and experiencing stigma and discrimination by healthcare professionals or/and lack of support by their families [14]. For example, transgender people often find in healthcare that providers lack skills in the area and are confronted with discrimination. Consequently, providers are often seen as unsupportive to transgender people’s healthcare needs [15].
In summary, for transgender people, healthcare is often inadequate and does not meet the needs of their special requirements [16]. Moreover, studies have shown that lack of support by their families is linked to higher levels of depressive symptoms in transgender people [17].
Negative mental health outcomes, such as suicide or substance use are also associated with increased levels of depression and anxiety. Previously, studies have shown that substance use has been described as a coping mechanism of transgender people to manage enhanced levels of stress [18] and that gender incongruent individuals reported higher rates of life time suicidal ideation and life time suicide attempts (about 61% and 31%) than their cisgender peers (about 20% and 7%) [19].
Earlier studies of depression and anxiety used diverse clinical screening cut-points for clinical syndromes, differing timeframes of assessment, and heterogeneous subpopulations of transgender people. However, high rates of negative mental health outcomes have been reported. For example, depression prevalence estimates are as high as 64.2% in 573 [20] and 63.0% in 230 transgender people using Center for Epidemiologic Studies Depression scale [21], while other authors using clinical diagnosis of depression reported depression rates of 31.4% in 207 [22] and 36.2% in 253 transgender people [23]. Moreover, Bockting et al. [24] and Grant et al. [25] found a prevalence of 44% for depression and 33% for anxiety symptoms.
Earlier studies have suggested that there are potential risk factors influencing the negative mental health outcomes for depression and anxiety. For example, puberty blockers, gender-affirming hormones and gender-affirming surgeries have a relevant clinical impact on mental health and decrease rates of adverse mental health outcomes, such as depression and anxiety in transgender people [22,26,27,28]. Puberty blockers and gender-affirming hormones were linked to improved psychological functioning [29] and decreased depressive symptoms [30]. Additionally, the development of mental health problems has been suggested to be correlated with social connectedness [31,32,33,34], academic performance [35], financial aspects [36,37,38], and chronic illnesses [36].
Given the high risk of depression, anxiety, and suicidality among transgender people, there is a pressing need to better characterize mental health and its influencing factors. In light of the restricted knowledge in this area (e.g., studies exclusively focusing on transgender persons and exploring the correlates of mental health in such groups), the aim of our study was to investigate the prevalence of probable depression and probable anxiety and to investigate the determinants of depressive symptoms and anxiety symptoms among transgender people.
In this study, we demonstrate that depression was detected in 33.3% and that anxiety was found in 29.6% of transgender people. Moreover, we show that school education and having chronic diseases were significantly associated with depression and anxiety. Regressions analyses show that depressive and anxiety symptoms were positively significantly associated with younger age, being unemployed, having worse self-rated health, and having at least one chronic disease. These data reveal new aspects regarding the correlates of mental health in transgender people.

2. Materials and Methods

2.1. Sample

The Division for Plastic, Reconstructive and Esthetic Surgery and the Department of Health Economics and Health Services Research (both at the University Medical Center Hamburg-Eppendorf, UKE) collaborated on the “Transgender Survey”. Data were taken from this study.
Regarding inclusion: In this “Transgender Survey” (n = 104) HH-TPCHIVG, we included transgender people who had joined self-help groups (e.g., Facebook, Whatsapp) to obtain and share information about the gender-affirming surgeries performed at the Division of Plastic, Reconstructive and Aesthetic Surgery at the University Medical Center Hamburg-Eppendorf. Included were transgender people before and after gender affirmation surgery at the Division of Plastic, Reconstructive and Aesthetic Surgery at the University Medical Center Hamburg-Eppendorf. The description “transgender people” was accepted by all participants in the study. No particular exclusion criteria, such as those related to age, were used. We programmed, hosted, and carried out the survey using the online survey application “Limesurvey”. Data were gathered between April and October 2022.
All of the study’s participants provided their informed consent. The study was approved by the Local Psychological Ethics Committee of the Center for Psychosocial Medicine of the University Medical Center Hamburg-Eppendorf (number: LPEK-0480).

2.2. Dependent Variables

The established patient health questionnaire-9 (PHQ-9) was used to assess probable depression [39]. It has nine items. Based on these nine items, a sum score can be computed, which ranges from 0 to 27, with higher values reflecting more depressive symptoms. Following the recommendations of prior research [40], we used a PHQ-9 score of ten or higher as the cut-off for probable depression. In this study, Cronbach’s alpha was 0.91 (McDonald’s omega was 0.91).
The established generalized anxiety disorder-7 (GAD-7) [41] was used to assess probable anxiety. The scale has seven items. Based on these items, a sum score was created (from 0 to 21, higher values correspond to more anxiety symptoms). In accordance with the given recommendations [41], we used a cut-off score of ten or higher for probable anxiety. Cronbach’s alpha was 0.91 in our study (McDonald’s omega was 0.91).

2.3. Determinants

According to prior research [42,43,44], we selected these sociodemographic, lifestyle- and health-related determinants: age in years, family situation (five categories: widowed; single; divorced; living separately: married or in partnership; living together: married or in partnership), highest school education (general or subject-specific university entrance qualification (e.g., “Abitur”); completion of polytechnic secondary school; currently in school education; secondary school diploma; intermediate school leaving certificate (e.g., “Realschulabschluss”); without general school leaving certificate), labor force participation (full-time employed; unemployed; part-time employed; marginally employed (450-euro job or mini-job); retired/early retirement; other; in retraining; in vocational training/apprenticeship), migration background (no or yes), religious affiliation (non-denominational; Buddhism; Christianity; Islam; other), already having had gender reassignment surgery (no or yes), frequency of sports activities (no sports activity; less than one hour a week; regularly, 1–2 h a week; regularly 3–4 h a week; regularly, more than 4 h a week), having one or more chronic diseases (no or yes), and self-rated health (single-item, ranging from 1 (very bad) to 5 (very good)).

2.4. Statistical Analysis

The prevalence of probable depression and probable anxiety among transgender people was first displayed. We also displayed the prevalence rates for important subgroups (age bracket, family situation, school education, migration background, labor force participation, having a religious affiliation, already having had gender assignment surgery, and chronic diseases). Additionally, the determinants of depressive symptoms and anxiety symptoms were investigated based on multiple linear regressions. A full-information maximum likelihood (FIML) approach [45] was used to tackle missing values. To calculate McDonald’s omega, a tool was used which was recently developed by Shaw [46]. Statistical significance was defined as p < 0.05. Stata 16.1 (Stata Corp., College Station, TX, USA) was used to conduct the statistical analyses.

3. Results

3.1. Sample Characteristics

In our sample (n = 104), the average age was 30.4 years (SD: 9.6 years), ranging from 19 to 63 years. The prevalence rates are displayed in Table 1. The results are stratified by age group, family situation, school education, migration background, labor force participation, having a religious affiliation, already having had gender assignment surgery, and chronic diseases. The prevalence of probable depression was 33.3% and it was 29.6% for probable anxiety in the total sample. Moreover, 21.4% of transgender people had both probable depression and probable anxiety. In the subgroups, the prevalence rates of probable depression ranged from 10.2% (among transgender people without chronic diseases) to 56.0% (among transgender people with at least one chronic disease). Moreover, the prevalence rates of probable anxiety ranged from 12.5% (among transgender people without chronic diseases) to 54.5% (among transgender people having a migration background). School education and having chronic diseases were significantly associated with both probable depression and probable anxiety. Please see Table 1 for further details.

3.2. Regression Analysis

Results of the multiple linear regression analysis with depressive symptoms and anxiety symptoms as outcome measures are shown in Table 2. With depressive symptoms as the outcome measure, R2 was 0.60 and with anxiety symptoms as the outcome measure, R2 equaled 0.42. Following the variance inflation factors (VIFs; mean VIF was 1.60 and highest VIF was 2.52), multicollinearity may not be a challenge. Regressions showed that among transgender people, both more depressive symptoms and more anxiety symptoms were significantly associated with younger age (β = −0.16, p < 0.01; β = −0.14, p < 0.01), being unemployed (e.g., full-time employed compared to unemployment: β = −3.05, p < 0.05; β = −2.69, p < 0.05), worse self-rated health (β = −3.31, p < 0.001; β = −1.88, p < 0.05) and having at least one chronic disease (β = 3.71, p < 0.01; β = 2.61, p < 0.05).

4. Discussion

Transgender people, in comparison to cisgender people, are disproportionately burdened by poor mental health outcomes [47,48]. In this study, we demonstrate that among transgender people, the prevalence of probable depression is 33.3% and anxiety is 29.6%. Additionally, our data reveal that both increased depressive and anxiety symptoms are significantly linked to younger age, being unemployed, worse self-rated health, and having at least one chronic disease.
When interpreting our prevalence rates, it is important to keep in mind that we focused on transgender persons who have joined a self-help group seeking gender-affirming surgery. This may imply that their mental health is better compared to transgender persons not involved in such groups because their internalized stigma or ambivalence may be lower. Thus, future research, ideally based on representative samples, are desirable to confirm our present findings.
Our detected rate of depression (33.3%) is within the range of 28% to 64% reported in other studies of depression among transgender people [20,21,23,24,49,50,51]; see also: [25]. In general, these rates are much higher than the rate of depression and anxiety of their heterosexual counterparts [47]. In detail, Konrad et al. [47] analyzed a total of 535 transgender people, 535 non-transsexual women, and 535 non-transsexual men, and showed that depression was documented in 20% of transgender people versus 7.7% of non-transsexual women and 5.5% of non-transsexual men. Moreover, this study identified anxiety disorders in 5.8% of transgender people versus 1.9% of non-transsexual women and 1.6% of non-transsexual men [47].
These results may be due to the experience of increased stress due to the permanent confrontation with stigmatization. In general, transgender people are viewed as unnatural and sexually unnatural, resulting in enhanced poor mental health [52]. Several studies showed that social rejection, lack of support from parents [11,12], and bullying [11,53,54], abuse, discrimination [55], and violence [53] are drivers for poor mental health and well-being.
For example, family affirmation has been detected as a protective factor against depression and suicide among transgender youth, since it increases the levels of self-esteem and support networks and decreases depression and suicide levels [56,57]. Research in transgenderism has shown that transgender people have less social support than their cisgender counterparts [58]. Regarding transgender groups, social support is associated with better physical health, smaller likelihood of discomfort, and lower scores of depressive symptoms and stress [59].
Moreover, adolescents and transgender youth are especially exposed to situations with risk of violence [60]. Ryan et al. [60] showed that transgender youth are more frequently victims of discrimination, as a result of actual or perceived sexual orientation than adults with high rates of victimization, particularly in school and community settings. Beyond violence, transgender youth face increased risks of violence and bullying in school [54]. Clark et al. [54] performed a nationally representative survey including more than 8000 students describing that more than half of transgender people were afraid someone at school would hurt or bother them, and nearly one in five transgender students reported experiencing bullying at school on a weekly (or more frequent) basis. Relative to their non-transgender peers, transgender youth had increased health and well-being needs [54]. In particular, approximately 40% of transgender people had significant depressive symptoms, had harmed themselves, and had been unable to access health care when they needed it [54]. Moreover, about 20% of transgender students had attempted suicide in the previous 12 months [54].
Furthermore, transgender youth are often confronted with intolerance at home or school, and drop out of education or leave home [16]. Moreover, at work, transgender people face increased levels of discrimination resulting in enhanced rates of unemployment [16]. Reduced education status and being unemployed force transgender people to live on the margins of society [16]. In consequence, there is an increased risk that transgender people face situations associated with unsafe sexual practices and substance abuse, resulting in risk of further ill-health and wellbeing.
In the general population, the rate of unemployment and youth are known factors which are associated with increased levels of negative mental health outcomes, including depression and anxiety. However, we have to highlight that the transgender population is characterized by even higher rates of unemployment than the general population which may result in even higher rates of depression in this subpopulation. Moreover, transgender youth face even higher levels of stress than the general population, which may result in even higher rates of depression and anxiety.
The majority of studies analyzing mental health among transgender people have analyzed adolescents and adults and reported higher rates of anxiety, depression, and suicidality in comparison to heterosexual people [61,62,63,64]. Interestingly, our data indicate an increased rate of depressed younger transgender people in comparison to older ones. This result is in line with the study by Nuttbrock et al. [21] showing that the association of psychological abuse with depression was stronger among younger rather than among older transgender women. In the study by Nuttbrock et al. [21], the association between psychological gender abuse and major depression was approximately three times higher among younger transgender women (aged 19–30 years) than among older transgender women (aged 31–59 years). The reasons for better resilience to psychological but not physical gender abuse in the older cohort are unknown and should be further studied. However, our finding underlines the importance to address the subset of younger transgender people in multidisciplinary gender care. A recent study has shown that among youths who did not initiate puberty blockers or gender-affirming medical interventions, depressive symptoms and suicidality, as compared to those who received the medical intervention, were 2-fold to 3-fold higher [48]. The authors suggested that risks of depression and suicidality might be mitigated with receiving gender-affirming medications in the context of a multidisciplinary care clinic over the relatively short time frame of 1 year [48]. Interestingly, former research examining the effect of hormonal therapy on anxiety symptoms described that they observed no association between the treatment with medication and the anxiety score [65]. A recent cohort study of transgender youth found that all of their anxiety symptoms improved over a longer follow-up of 11 to 18 months; however, a similar to the study by Tordoff et al. [48] did not observe statistically significant improvements in generalized anxiety. This suggests that anxiety symptoms may take longer to improve after the initiation of medical treatment therapy.
Young transgender people receiving hormonal medication are using gender affirming healthcare, which is also called gender reassignment [66], gender-confirming, or gender affirming healthcare [67]. In general, transgender people use gender affirming healthcare for special health needs. In detail, transgender people do not only need help with their hormonal treatment, they also need help regarding, for example, their reproductive health (e.g., gamete storage) or the use of silicon injections.
Previously, social connectedness has been shown to be an important source of psychological wellbeing and a useful instrument in affirming one’s identity for transgender youth [31,32,33]. Studies have indicated that the social support of family and friends is also an important source of wellbeing in transgender people and result in higher levels of this support are associated with the resilience of individuals [34,68,69]. However, although earlier data suggest that a supportive family is of high importance, we were not able to confirm the importance of the family status. This might be due to differences in the patient cohort or study design—or due to a lack of statistical power. Furthermore, prospective multicenter studies are needed to obtain further insight into this relevant aspect.
Interestingly, our study showed an association between the prevalence of at least one chronic disease and increased levels of anxiety and depression. This result is in line with previous studies that have demonstrated that depression is associated with other health problems, such as cardiovascular, metabolic, and lung diseases [70,71,72]. For example, Bisschop et al. [70] included more than 2000 respondents (age 55–85) in their study and showed that lung disease, arthritis, cardiac disease, and cancer were all positively associated with increased depressive symptoms over time.
Interestingly, we performed our survey during the COVID-19 pandemic. Previously, a study has shown that the prevalence of a probable major depressive disorder was 20.0% and the prevalence of a probable generalized anxiety disorder was 13.4% among the general adult German population during the COVID-19 pandemic [43]. This study showed that probable major depressive disorders and probable generalized anxiety disorders were frequent in the general adult population in Germany and that these prevalence rates were higher compared to almost ten years ago [42]. It can be speculated that these higher rates during the pandemic are caused by several challenges, including social distancing and economic uncertainties of individuals [43].
Individuals with chronic diseases are more often chronically depressed. In fact, an earlier study showed that depression is regarded as one of the most common complications of chronic illnesses, with one-third of those with a serious medical condition experiencing depressive symptoms [73]. Additionally, population-based studies have demonstrated that chronic disease is associated with negative mental health problems, such as depression [74]. Thus, evidence is growing that there might be an increased prevalence of depression in individuals with at least one chronic disease [75].
Another aspect analyzed in our study was the association between labor force participation and depressive, as well as anxiety symptoms in the cohort of transgender people. Here, we were able to show that unemployed transgender people have more depressive and anxiety symptoms, as compared to employed individuals. This result is in line with earlier studies describing that depressive symptoms were significantly associated with labor force participation [37]. In detail, individuals with low or insufficient income and unemployment more often develop mental health issues, whereas individuals with higher income are associated with reduced risk of incident mental health problems [24,37].
To improve the health and well-being of transgender people, beyond social transition, the hormonal and surgical treatments are of high importance to positively influence the health of this group [66].
Regarding our strengths and shortcomings, it should be emphasized that this is one of a few studies dealing with the mental health of transgender individuals. It is a vulnerable population that is commonly quite challenging to access (and often subsumed in the group of LGBT). To measure mental health, valid screening tools were used. However, future studies based on a composite international diagnostic interview [76] are required to confirm our present findings. Additionally, several determinants were included in our study and an FIML approach was used to tackle missing data. The cross-sectional design of this study is a shortcoming of this study and thus future longitudinal studies are needed. Moreover, it is difficult to clarify the generalizability of this hospital sample. It should be noted: an a priori power calculation was not performed. Moreover, a response rate could not be calculated since this was an online sample. Additionally, no data were collected regarding substance use/abuse, adverse childhood experiences, or current stigmatization.
In conclusion, remarkably high prevalence rates for both probable depression and probable anxiety were identified among transgender people. Furthermore, risk factors of poor mental health (e.g., unemployment or younger age) were identified—which can help to address individuals at risk of poor mental health. Upcoming studies in this under researched area are strongly recommended.

Author Contributions

A.H.: conceptualization; data curation; methodology; project administration, visualization; roles/writing—original draft, writing—review and editing, formal analysis. H.-H.K.: resources; writing—review and editing; visualization. E.B.-S.: writing—review and editing; M.B.: writing—review and editing; K.G.: conceptualization; project administration, writing—original draft, writing—review and editing. All authors have read and agreed to the published version of the manuscript.

Funding

We acknowledge financial support from the Open Access Publication Fund of UKE—Universitätsklinikum Hamburg-Eppendorf—and DFG—German Research Foundation.

Institutional Review Board Statement

The study was approved by the Local Psychological Ethics Committee of the Center for Psychosocial Medicine of the University Medical Center Hamburg-Eppendorf (number: LPEK-0480).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The datasets analyzed during the current study are not publicly available due to ethical restrictions involving patient data but are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. United Nations High Commissioner for Human Rights. Discriminatory Laws and Practices and Acts of Violence against Individuals Based on Their Sexual Orientation and Gender Identity; United Nations High Commissioner for Human Rights: Geneva, Switzerland, 2011. [Google Scholar]
  2. de Graaf, R.; Ten Have, M.; van Gool, C.; van Dorsselaer, S. Prevalence of mental disorders and trends from 1996 to 2009. Results from the Netherlands Mental Health Survey and Incidence Study-2. Soc. Psychiatry Psychiatr. Epidemiol. 2012, 47, 203–213. [Google Scholar] [CrossRef]
  3. Newcomb, M.E.; Hill, R.; Buehler, K.; Ryan, D.T.; Whitton, S.W.; Mustanski, B. High burden of mental health problems, substance use, violence, and related psychosocial factors in transgender, non-binary, and gender diverse youth and young adults. Arch. Sex. Behav. 2020, 49, 645–659. [Google Scholar] [CrossRef] [PubMed]
  4. The GenIUSS Group. Best Practices for Asking Questions to Identify Transgender and Other Gender Minority Respondents on Population-Based Surveys; eScholarship; University of California: La Jolla, CA, USA, 2014. [Google Scholar]
  5. Sevelius, J.M. Gender affirmation: A framework for conceptualizing risk behavior among transgender women of color. Sex Roles 2013, 68, 675–689. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Strauss, P.; Cook, A.; Winter, S.; Watson, V.; Toussaint, D.W.; Lin, A. Associations between negative life experiences and the mental health of trans and gender diverse young people in Australia: Findings from Trans Pathways. Psychol. Med. 2020, 50, 808–817. [Google Scholar] [CrossRef] [PubMed]
  7. Kuper, L.E.; Mathews, S.; Lau, M. Baseline mental health and psychosocial functioning of transgender adolescents seeking gender-affirming hormone therapy. J. Dev. Behav. Pediatr. 2019, 40, 589–596. [Google Scholar] [CrossRef]
  8. Olson, J.; Schrager, S.M.; Belzer, M.; Simons, L.K.; Clark, L.F. Baseline physiologic and psychosocial characteristics of transgender youth seeking care for gender dysphoria. J. Adolesc. Health 2015, 57, 374–380. [Google Scholar] [CrossRef] [Green Version]
  9. Reisner, S.L.; Vetters, R.; Leclerc, M.; Zaslow, S.; Wolfrum, S.; Shumer, D.; Mimiaga, M.J. Mental health of transgender youth in care at an adolescent urban community health center: A matched retrospective cohort study. J. Adolesc. Health 2015, 56, 274–279. [Google Scholar] [CrossRef] [Green Version]
  10. Moyer, D.N.; Connelly, K.J.; Holley, A.L. Using the PHQ-9 and GAD-7 to screen for acute distress in transgender youth: Findings from a pediatric endocrinology clinic. J. Pediatr. Endocrinol. Metab. 2019, 32, 71–74. [Google Scholar] [CrossRef]
  11. Johnson, K.C.; LeBlanc, A.J.; Deardorff, J.; Bockting, W.O. Invalidation experiences among non-binary adolescents. J. Sex Res. 2020, 57, 222–233. [Google Scholar] [CrossRef]
  12. Spivey, L.A.; Edwards-Leeper, L. Future directions in affirmative psychological interventions with transgender children and adolescents. J. Clin. Child Adolesc. Psychol. 2019, 48, 343–356. [Google Scholar] [CrossRef]
  13. Chan, A.S.W.; Wu, D.; Lo, I.P.Y.; Ho, J.M.C.; Yan, E. Diversity and inclusion: Impacts on psychological wellbeing among Lesbian, Gay, Bisexual, Transgender, and Queer communities. Front. Psychol. 2022, 13, 82. [Google Scholar] [CrossRef]
  14. Stangl, A.L.; Earnshaw, V.A.; Logie, C.H.; Van Brakel, W.; Simbayi, L.C.; Barré, I.; Dovidio, J.F. The Health Stigma and Discrimination Framework: A global, crosscutting framework to inform research, intervention development, and policy on health-related stigmas. BMC Med. 2019, 17, 31. [Google Scholar] [CrossRef] [Green Version]
  15. Riggs, D.; Due, C. Gender Identity Australia: The Healthcare Experiences of People Whose Gender Identity Differs from That Expected of Their Natally Assigned Sex; Flinders University: Adelaide, Australia, 2013. [Google Scholar]
  16. Winter, S.; Diamond, M.; Green, J.; Karasic, D.; Reed, T.; Whittle, S.; Wylie, K. Transgender people: Health at the margins of society. Lancet 2016, 388, 390–400. [Google Scholar] [CrossRef]
  17. Travers, R.; Bauer, G.; Pyne, J. Impacts of Strong Parental Support for Trans Youth: A Report Prepared for Children’s Aid Society of Toronto and Delisle Youth Services; Trans Pulse: Boise, ID, USA, 2012. [Google Scholar]
  18. Hendricks, M.L.; Testa, R.J. A conceptual framework for clinical work with transgender and gender nonconforming clients: An adaptation of the Minority Stress Model. Prof. Psychol. Res. Pract. 2012, 43, 460. [Google Scholar] [CrossRef]
  19. Eisenberg, M.E.; Gower, A.L.; McMorris, B.J.; Rider, G.N.; Shea, G.; Coleman, E. Risk and protective factors in the lives of transgender/gender nonconforming adolescents. J. Adolesc. Health 2017, 61, 521–526. [Google Scholar] [CrossRef]
  20. Nemoto, T.; Bödeker, B.; Iwamoto, M. Social support, exposure to violence and transphobia, and correlates of depression among male-to-female transgender women with a history of sex work. Am. J. Public Health 2011, 101, 1980–1988. [Google Scholar] [CrossRef] [PubMed]
  21. Nuttbrock, L.; Bockting, W.; Rosenblum, A.; Hwahng, S.; Mason, M.; Macri, M.; Becker, J. Gender abuse and major depression among transgender women: A prospective study of vulnerability and resilience. Am. J. Public Health 2014, 104, 2191–2198. [Google Scholar] [CrossRef]
  22. De Vries, A.L.; Steensma, T.D.; Doreleijers, T.A.; Cohen-Kettenis, P.T. Puberty suppression in adolescents with gender identity disorder: A prospective follow-up study. J. Sex. Med. 2011, 8, 2276–2283. [Google Scholar] [CrossRef]
  23. Pitts, M.K.; Couch, M.; Mulcare, H.; Croy, S.; Mitchell, A. Transgender people in Australia and New Zealand: Health, well-being and access to health services. Fem. Psychol. 2009, 19, 475–495. [Google Scholar] [CrossRef]
  24. Bockting, W.O.; Miner, M.H.; Romine, R.E.S.; Hamilton, A.; Coleman, E. Stigma, Mental Health, and Resilience in an Online Sample of the US Transgender Population. Am. J. Public Health 2013, 103, 943–951. [Google Scholar] [CrossRef]
  25. Grant, J.M.; Motter, L.A.; Tanis, J. Injustice at Every Turn: A Report of the National Transgender Discrimination Survey; National Center for Transgender Equality: Washington, DC, USA, 2011. [Google Scholar]
  26. Chew, D.; Anderson, J.; Williams, K.; May, T.; Pang, K. Hormonal treatment in young people with gender dysphoria: A systematic review. Pediatrics 2018, 141, e20173742. [Google Scholar] [CrossRef] [Green Version]
  27. De Vries, A.L.; McGuire, J.K.; Steensma, T.D.; Wagenaar, E.C.; Doreleijers, T.A.; Cohen-Kettenis, P.T. Young adult psychological outcome after puberty suppression and gender reassignment. Pediatrics 2014, 134, 696–704. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Mahfouda, S.; Moore, J.K.; Siafarikas, A.; Hewitt, T.; Ganti, U.; Lin, A.; Zepf, F.D. Gender-affirming hormones and surgery in transgender children and adolescents. Lancet Diabetes Endocrinol. 2019, 7, 484–498. [Google Scholar] [CrossRef]
  29. Costa, R.; Dunsford, M.; Skagerberg, E.; Holt, V.; Carmichael, P.; Colizzi, M. Psychological support, puberty suppression, and psychosocial functioning in adolescents with gender dysphoria. J. Sex. Med. 2015, 12, 2206–2214. [Google Scholar] [CrossRef]
  30. Achille, C.; Taggart, T.; Eaton, N.R.; Osipoff, J.; Tafuri, K.; Lane, A.; Wilson, T.A. Longitudinal impact of gender-affirming endocrine intervention on the mental health and well-being of transgender youths: Preliminary results. Int. J. Pediatr. Endocrinol. 2020, 2020, 8. [Google Scholar] [CrossRef] [PubMed]
  31. Austin, A.; Goodman, R. The impact of social connectedness and internalized transphobic stigma on self-esteem among transgender and gender non-conforming adults. J. Homosex. 2017, 64, 825–841. [Google Scholar] [CrossRef]
  32. Ceatha, N.; Mayock, P.; Campbell, J.; Noone, C.; Browne, K. The power of recognition: A qualitative study of social connectedness and wellbeing through LGBT sporting, creative and social groups in Ireland. Int. J. Environ. Res. Public Health 2019, 16, 3636. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Garcia, J.; Vargas, N.; Clark, J.L.; Magaña Álvarez, M.; Nelons, D.A.; Parker, R.G. Social isolation and connectedness as determinants of well-being: Global evidence mapping focused on LGBTQ youth. Glob. Public Health 2020, 15, 497–519. [Google Scholar] [CrossRef]
  34. Başar, K.; Öz, G. Resilience in Individuals with Gender Dysphoria: Association with Perceived Social Support And Discrimination. Turk. Psikiyatr. Derg. 2016, 27, 225–234. [Google Scholar]
  35. Brown, C.; Porta, C.M.; Eisenberg, M.E.; McMorris, B.J.; Sieving, R.E. Family relationships and the health and well-being of transgender and gender-diverse youth: A critical review. LGBT Health 2020, 7, 407–419. [Google Scholar] [CrossRef]
  36. Tantirattanakulchai, P.; Hounnaklang, N. Associations between clusters of perceived social support level, depression, and suicidal ideation among transgender women: A latent class analysis. J. Public Health Res. 2022, 11, 2090. [Google Scholar] [CrossRef] [PubMed]
  37. Sareen, J.; Afifi, T.O.; McMillan, K.A.; Asmundson, G.J. Relationship between household income and mental disorders: Findings from a population-based longitudinal study. Arch. Gen. Psychiatry 2011, 68, 419–427. [Google Scholar] [CrossRef] [Green Version]
  38. Yadegarfard, M.; Ho, R.; Bahramabadian, F. Influences on loneliness, depression, sexual-risk behaviour and suicidal ideation among Thai transgender youth. Cult. Health Sex. 2013, 15, 726–737. [Google Scholar] [CrossRef]
  39. Kroenke, K.; Spitzer, R.L.; Williams, J.B. The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 2001, 16, 606–613. [Google Scholar] [CrossRef] [PubMed]
  40. Manea, L.; Gilbody, S.; McMillan, D. Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): A meta-analysis. CMAJ 2012, 184, E191–E196. [Google Scholar] [CrossRef] [Green Version]
  41. Spitzer, R.L.; Kroenke, K.; Williams, J.B.; Löwe, B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch. Intern. Med. 2006, 166, 1092–1097. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Hajek, A.; König, H.-H. Prevalence and correlates of individuals screening positive for depression and anxiety on the phq-4 in the German general population: Findings from the nationally representative German socio-economic panel (GSOEP). Int. J. Environ. Res. Public Health 2020, 17, 7865. [Google Scholar] [CrossRef]
  43. Hajek, A.; König, H.-H. The prevalence and correlates of probable major depressive disorder and probable generalized anxiety disorder during the COVID-19 pandemic. Results of a nationally representative survey in Germany. Int. J. Environ. Res. Public Health 2021, 18, 12302. [Google Scholar] [CrossRef]
  44. Hajek, A.; Sabat, I.; Neumann-Böhme, S.; Schreyögg, J.; Barros, P.P.; Stargardt, T.; König, H.-H. Prevalence and determinants of probable depression and anxiety during the COVID-19 pandemic in seven countries: Longitudinal evidence from the European COvid Survey (ECOS). J. Affect. Disord. 2022, 299, 517–524. [Google Scholar] [CrossRef]
  45. Enders, C.K. The performance of the full information maximum likelihood estimator in multiple regression models with missing data. Educ. Psychol. Meas. 2001, 61, 713–740. [Google Scholar] [CrossRef]
  46. Shaw, B.P. Meeting assumptions in the estimation of reliability. Stata J. 2021, 21, 1021–1027. [Google Scholar] [CrossRef]
  47. Konrad, M.; Kostev, K. Increased prevalence of depression, anxiety, and adjustment and somatoform disorders in transsexual individuals. J. Affect. Disord. 2020, 274, 482–485. [Google Scholar] [CrossRef] [PubMed]
  48. Tordoff, D.M.; Wanta, J.W.; Collin, A.; Stepney, C.; Inwards-Breland, D.J.; Ahrens, K. Mental health outcomes in transgender and nonbinary youths receiving gender-affirming care. JAMA Netw. Open 2022, 5, e220978. [Google Scholar] [CrossRef]
  49. Owen-Smith, A.A.; Sineath, C.; Sanchez, T.; Dea, R.; Giammattei, S.; Gillespie, T.; Helms, M.F.; Hunkeler, E.M.; Quinn, V.P.; Roblin, D. Perception of community tolerance and prevalence of depression among transgender persons. J. Gay Lesbian Ment. Health 2017, 21, 64–76. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Budge, S.L.; Adelson, J.L.; Howard, K.A. Anxiety and depression in transgender individuals: The roles of transition status, loss, social support, and coping. J. Consult. Clin. Psychol. 2013, 81, 545. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  51. Reisner, S.L.; White, J.M.; Mayer, K.H.; Mimiaga, M.J. Sexual risk behaviors and psychosocial health concerns of female-to-male transgender men screening for STDs at an urban community health center. AIDS Care 2014, 26, 857–864. [Google Scholar] [CrossRef] [Green Version]
  52. Winter, S.; Chalungsooth, P.; Teh, Y.K.; Rojanalert, N.; Maneerat, K.; Wong, Y.W.; Beaumont, A.; Ho, L.M.W.; Gomez, F.C.; Macapagal, R.A. Transpeople, transprejudice and pathologization: A seven-country factor analytic study. Int. J. Sex. Health 2009, 21, 96–118. [Google Scholar] [CrossRef]
  53. Aparicio-García, M.E.; Díaz-Ramiro, E.M.; Rubio-Valdehita, S.; López-Núñez, M.I.; García-Nieto, I. Health and well-being of cisgender, transgender and non-binary young people. Int. J. Environ. Res. Public Health 2018, 15, 2133. [Google Scholar] [CrossRef] [Green Version]
  54. Clark, T.C.; Lucassen, M.F.; Bullen, P.; Denny, S.J.; Fleming, T.M.; Robinson, E.M.; Rossen, F.V. The health and well-being of transgender high school students: Results from the New Zealand adolescent health survey (Youth’12). J. Adolesc. Health 2014, 55, 93–99. [Google Scholar] [CrossRef] [Green Version]
  55. Bazargan, M.; Galvan, F. Perceived discrimination and depression among low-income Latina male-to-female transgender women. BMC Public Health 2012, 12, 663. [Google Scholar] [CrossRef] [Green Version]
  56. Lampis, J.; De Simone, S.; Belous, C.K. Relationship satisfaction, social support, and psychological well-being in a sample of Italian lesbian and gay individuals. J. GLBT Fam. Stud. 2021, 17, 49–62. [Google Scholar] [CrossRef]
  57. Reyes, M.E.S.; Davis, R.D.; Yapcengco, F.L.; Bordeos, C.M.M.; Gesmundo, S.C.; Torres, J.K.M. Perceived Parental Acceptance, Transgender Congruence, and Psychological Well-Being of Filipino Transgender Individuals. N. Am. J. Psychol. 2020, 22, 135–152. [Google Scholar]
  58. Factor, R.J.; Rothblum, E.D. A study of transgender adults and their non-transgender siblings on demographic characteristics, social support, and experiences of violence. J. LGBT Health Res. 2007, 3, 11–30. [Google Scholar] [CrossRef]
  59. Fredriksen-Goldsen, K.I.; Cook-Daniels, L.; Kim, H.-J.; Erosheva, E.A.; Emlet, C.A.; Hoy-Ellis, C.P.; Goldsen, J.; Muraco, A. Physical and mental health of transgender older adults: An at-risk and underserved population. Gerontologist 2014, 54, 488–500. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  60. Ryan, C.; Rivers, I. Lesbian, gay, bisexual and transgender youth: Victimization and its correlates in the USA and UK. Cult. Health Sex. 2003, 5, 103–119. [Google Scholar] [CrossRef]
  61. Almeida, J.; Johnson, R.M.; Corliss, H.L.; Molnar, B.E.; Azrael, D. Emotional distress among LGBT youth: The influence of perceived discrimination based on sexual orientation. J. Youth Adolesc. 2009, 38, 1001–1014. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  62. Clements-Nolle, K.; Marx, R.; Katz, M. Attempted suicide among transgender persons: The influence of gender-based discrimination and victimization. J. Homosex. 2006, 51, 53–69. [Google Scholar] [CrossRef]
  63. Colizzi, M.; Costa, R.; Todarello, O. Transsexual patients’ psychiatric comorbidity and positive effect of cross-sex hormonal treatment on mental health: Results from a longitudinal study. Psychoneuroendocrinology 2014, 39, 65–73. [Google Scholar] [CrossRef]
  64. Haas, A.P.; Eliason, M.; Mays, V.M.; Mathy, R.M.; Cochran, S.D.; D’Augelli, A.R.; Silverman, M.M.; Fisher, P.W.; Hughes, T.; Rosario, M. Suicide and suicide risk in lesbian, gay, bisexual, and transgender populations: Review and recommendations. J. Homosex. 2010, 58, 10–51. [Google Scholar] [CrossRef]
  65. Kuper, L.E.; Stewart, S.; Preston, S.; Lau, M.; Lopez, X. Body dissatisfaction and mental health outcomes of youth on gender-affirming hormone therapy. Pediatrics 2020, 145, e20193006. [Google Scholar] [CrossRef]
  66. Coleman, E.; Bockting, W.; Botzer, M.; Cohen-Kettenis, P.; DeCuypere, G.; Feldman, J.; Fraser, L.; Green, J.; Knudson, G.; Meyer, W.J. Standards of care for the health of transsexual, transgender, and gender-nonconforming people, version 7. Int. J. Transgend. 2012, 13, 165–232. [Google Scholar] [CrossRef]
  67. Global Action for Trans Equality. It’s Time for Reform: Trans Health Issues in the ICD; Global Action for Trans Equality: New York, NY, USA, 2012. [Google Scholar]
  68. Ehrensaft, D.; Giammattei, S.V.; Storck, K.; Tishelman, A.C.; Keo-Meier, C. Prepubertal social gender transitions: What we know; what we can learn—A view from a gender affirmative lens. Int. J. Transgend. 2018, 19, 251–268. [Google Scholar] [CrossRef]
  69. Budge, S.L.; Katz-Wise, S.L.; Tebbe, E.N.; Howard, K.A.; Schneider, C.L.; Rodriguez, A. Transgender emotional and coping processes: Facilitative and avoidant coping throughout gender transitioning. Couns. Psychol. 2013, 41, 601–647. [Google Scholar] [CrossRef]
  70. Bisschop, M.I.; Kriegsman, D.M.; Deeg, D.J.; Beekman, A.T.; Van Tilburg, W. The longitudinal relation between chronic diseases and depression in older persons in the community: The Longitudinal Aging Study Amsterdam. J. Clin. Epidemiol. 2004, 57, 187–194. [Google Scholar] [CrossRef] [PubMed]
  71. Han, B. Depressive symptoms and self-rated health in community-dwelling older adults: A longitudinal study. J. Am. Geriatr. Soc. 2002, 50, 1549–1556. [Google Scholar] [CrossRef] [PubMed]
  72. Kessler, R.C.; Akiskal, H.S.; Ames, M.; Birnbaum, H.; Greenberg, P.; Robert, M.A.; Jin, R.; Merikangas, K.R.; Simon, G.E.; Wang, P.S. Prevalence and effects of mood disorders on work performance in a nationally representative sample of US workers. Am. J. Psychiatry 2006, 163, 1561–1568. [Google Scholar] [CrossRef]
  73. Boing, A.F.; Melo, G.R.; Boing, A.C.; Moretti-Pires, R.O.; Peres, K.G.; Peres, M.A. Associação entre depressão e doenças crônicas: Um estudo populacional. Rev. Saúde Pública 2012, 46, 617–623. [Google Scholar] [CrossRef] [Green Version]
  74. Unützer, J.; Patrick, D.L.; Marmon, T.; Simon, G.E.; Katon, W.J. Depressive symptoms and mortality in a prospective study of 2558 older adults. Am. J. Geriatr. Psychiatry 2002, 10, 521–530. [Google Scholar] [CrossRef]
  75. Noël, P.H.; Williams, J.W.; Unützer, J.; Worchel, J.; Lee, S.; Cornell, J.; Katon, W.; Harpole, L.H.; Hunkeler, E. Depression and comorbid illness in elderly primary care patients: Impact on multiple domains of health status and well-being. Ann. Fam. Med. 2004, 2, 555–562. [Google Scholar] [CrossRef] [Green Version]
  76. Essau, C.A.; Wittchen, H.-U. An overview of the composite international diagnostic interview (CIDI). Int. J. Methods Psychiatr. Res. 1993, 3, 79–85. [Google Scholar]
Table 1. Prevalence of probable depression and probable anxiety among several groups.
Table 1. Prevalence of probable depression and probable anxiety among several groups.
nProbable Depressionp-ValueProbable Anxietyp-Value
Total sampleN = 9933.3% 29.6%
Age bracket 0.83 0.39
    18 to 29 yearsN = 5332.1% 28.3%
    30 years and olderN = 3834.2% 36.8%
Family situation 0.09 0.048
    Living separately: married or in partnership; divorced; single; widowedN = 50540.8% 40.8%
    Living together: Married or in partnershipN = 4223.8% 21.4%
School education <0.01 <0.01
    Absence of general or subject-specific university entrance qualificationN = 5244.2% 44.2%
    Presence of general or subject-specific university entrance qualificationN = 3917.9% 15.4%
Migration background 0.10 0.09
    NoN = 8030.0% 28.7%
    YesN = 1154.5% 54.5%
Labor force participation 0.10 0.18
    UnemployedN = 1650.0% 43.8%
    Full-time employedN = 3420.6% 20.6%
    OtherN = 4136.6% 36.6%
Having a religious affiliation 0.04 0.39
    Non-denominationalN = 5324.5% 28.3%
    Having a religious affiliationN = 3844.7% 36.8%
Already having had gender reassignment surgery 0.71 0.77
    NoN = 5035.4% 31.3%
    YesN = 3831.6% 34.2%
Chronic diseases <0.001 <0.001
    NoneN = 5210.2% 12.5%
    Presence of at least one chronic diseaseN = 5056.0% 46.0%
Notes: Chi2 tests were performed (p-values). Probable depression: PHQ-9 score of ten or higher; probable anxiety: GAD-7 score of ten or higher.
Table 2. Determinants of depressive symptoms and anxiety symptoms. Findings of the multiple linear regressions.
Table 2. Determinants of depressive symptoms and anxiety symptoms. Findings of the multiple linear regressions.
Independent VariablesDepressive
Symptoms
Anxiety
Symptoms
Age (in years)−0.16 ** (0.05)−0.14 ** (0.05)
Family situation: -Living together: married or in partnership (reference category: other including [living separately: married or in partnership; divorced; single; widowed])−0.64 (0.95)−0.53 (0.84)
School education: -General or subject-specific university entrance qualification (e.g., “Abitur”) (reference: lower school education including [completion of polytechnic secondary school; currently in school education; secondary school diploma; intermediate school leaving certificate (e.g., “Realschulabschluss”); without general school leaving certificate])−1.93 + (0.99)−2.08 * (1.03)
Labor force participation: -Full-time employed (reference category: unemployed)−3.05 * (1.34)−2.69 * (1.13)
-other including [part-time employed; marginally employed (450-euro job or mini-job); retired/early retirement; other; in retraining; in vocational training/apprenticeship−4.16 *** (1.15)−2.69 * (1.28)
Migration background: Yes (reference category: no)−0.83 (1.47)−0.09 (1.25)
Religious affiliation: Having a religious affiliation including [Buddhism;
Christianity; Islam; other] (reference category: non-denominational)
0.93 (1.03)0.47 (0.93)
Already having had gender reassignment surgery: -Yes (reference category: no)0.35 (0.95)0.73 (0.97)
Frequency of sports activities: -Less than one hour a week (reference category: no sports activity)−0.68 (1.28)−0.27 (1.23)
-Regularly, 1–2 h a week1.05 (1.40)−0.09 (1.46)
-Regularly, 3–4 h a week−0.06 (1.38)−1.29 (1.31)
-Regularly, more than 4 h a week0.24 (1.54)0.40 (1.39)
Self-rated health (from 1 = very bad to 5 = very good)−3.31 *** (0.70)−1.88 * (0.76)
Having at least one chronic disease: Yes (Reference category: no)3.71 ** (1.17)2.61 * (1.31)
Constant26.91 *** (3.37)20.24 *** (4.08)
R20.600.42
Observations104104
Notes: Unstandardized beta-coefficients are displayed; robust standard errors in parentheses; *** p < 0.001, ** p < 0.01, * p < 0.05, and + p < 0.10; FIML was used to tackle missing data.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hajek, A.; König, H.-H.; Buczak-Stec, E.; Blessmann, M.; Grupp, K. Prevalence and Determinants of Depressive and Anxiety Symptoms among Transgender People: Results of a Survey. Healthcare 2023, 11, 705. https://doi.org/10.3390/healthcare11050705

AMA Style

Hajek A, König H-H, Buczak-Stec E, Blessmann M, Grupp K. Prevalence and Determinants of Depressive and Anxiety Symptoms among Transgender People: Results of a Survey. Healthcare. 2023; 11(5):705. https://doi.org/10.3390/healthcare11050705

Chicago/Turabian Style

Hajek, André, Hans-Helmut König, Elzbieta Buczak-Stec, Marco Blessmann, and Katharina Grupp. 2023. "Prevalence and Determinants of Depressive and Anxiety Symptoms among Transgender People: Results of a Survey" Healthcare 11, no. 5: 705. https://doi.org/10.3390/healthcare11050705

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop