Introduction

Innovative approaches are needed to eliminate mother-to-child HIV transmission (MTCT) in high-burden (priority) countries. With the adoption of universal treatment for people living with HIV in most countries, including for pregnant women, 6-week MTCT rates have fallen dramatically in the 21 priority countries, declining from 28% [25–30%] in 2009 to 14% [12–16%] in 2014 [1]. However, 160,000 children were newly infected with HIV in 2018 [2]. Significant barriers remain that are not specific to HIV and that interfere with uptake of HIV treatment among pregnant women. These barriers include inequitable gender norms, HIV-related stigma, and inadequate mother and child health (MCH) knowledge [3,4,5,6]. Interventions to address these barriers have included community health promotion and education activities, and engagement strategies [4, 7]. However, many of these approaches focus on increasing knowledge, with insufficient attention paid to attitudes and norms; which is necessary to enable sustainable behavior change at the community level [8]. In addition, barriers to prevention of mother-to-child HIV transmission (PMTCT) services are often interlinked; in that interventions which target both community and individual levels, may be more effective than interventions focused on one level. There are few examples of combined community-level interventions for PMTCT outcomes [9]. We tested an innovative community intervention package which included a social learning and action component (community leader engagement), community days (with community dialogues around selected MCH and PMTCT topics), and peer discussion groups, on the demand for, uptake of, and retention of HIV-positive pregnant/postpartum women in MCH/PMTCT services in Eswatini (formerly Swaziland), Uganda, and Zimbabwe from 2013 to 2015.

In this paper, we report on the effect of three interventions on MCH and PMTCT knowledge, attitudes, and beliefs (KAB) among community members in the study areas. This was a secondary analysis of the trial data focused on the community effects of the interventions. We assessed gender-equitable norms, HIV-related stigma attitudes, and knowledge on maternal, neonatal, and childcare. We hypothesized that the three interventions together (community leader engagement, community days, and peer discussion groups) would result in the most significant increase in MCH beliefs and gender-equitable norms, as well as the most significant decrease in HIV stigma, when compared to the community leader engagement intervention alone for both women and men, when comparing pre- and post-intervention data.

Methods

Study Design and Population

The methodology of this multi-country, multi-component, three-arm randomized trial has been reported elsewhere [10]. In brief, in each of the three countries, three subunits (regions or districts) were identified, each consisting of 15 clusters (facilities) (Fig. 1). The regions or districts were then randomly allocated, one to each study arm. Arm 1 included the community leader engagement intervention, which involved identifying and training formal and informal community leaders to have dialogues with their community about MCH, HIV care, and PMTCT. Arm 2 included the community leader engagement intervention plus a community days intervention (i.e., community health fairs that combined service provision such as HIV testing, blood pressure screening, etc., with community dialogues about HIV issues, PMTCT, and HIV testing. Arm 3 included the community leader engagement intervention, the community days intervention, plus men’s and women’s peer discussion groups, where peer-led discussions provided information and education on MCH and PMTCT. The women’s peer groups were held with women attending antenatal care (ANC); the men’s groups included, but were not limited to, partners of the women attending ANC.

Fig. 1
figure 1

Reprinted from “Evaluating the effectiveness of selected community-level interventions on key maternal, child health, and prevention of mother-to-child transmission of HIV outcomes in three countries (the ACCLAIM project): a study protocol for a randomized controlled trial,” by Woelk, G.B., Kieffer, M.P., Walker, D., Mpofu, D., Machekano, R., and the Project ACCLAIM study group. Trials, 17(88) 2016, p.5

Trial design.

There was no control group, as there was already a high level of background community programming in the form of national PMTCT programs in study countries. The study team concluded therefore, that a true control group would be infeasible and unethical [6, 10].

In each country, Elizabeth Glaser Pediatric AIDS Foundation (EGPAF)-supported regions with no recent history of intensified community-level PMTCT interventions and low research activity but moderate to high maternal HIV yield were identified as potential intervention areas. The three subunits (one for each of the three study arms) were identified corresponding to the administrative structures (that is, regions or districts) existing in that country, also took into account the ability to implement interventions, with the support of the appropriate health authorities. In each of these districts/regions, five clusters (with a cluster defined as the lowest level of health facility that implements PMTCT services, together with its population catchment area [populations 7300–27,500]) were identified. Criteria for potential selection included recording at least 14 HIV-positive pregnant women in the most recent year, the smallest catchment population size, and catchment area completely within the district/region with no overlap, and mix of facility type. Referral facilities and urban facilities were excluded. All clusters meeting these criteria were selected.

In order to assess potential changes in MCH knowledge, attitudes, and beliefs, we undertook pre- and post-intervention KAB cross-sectional surveys among women and men aged 18–60 years in randomly selected households in the selected clusters in each country. With the cross-sectional design, different households were likely to be selected pre- and post-intervention. One participant per household was selected. If there was more than one eligible participant per household, research assistants randomly selected a participant through a process involving the listing of all eligible participants. The randomization was based on sampling frames drawn from census lists and augmented by household lists or maps held by community leaders and/or the relevant administrative offices. The surveys were enumerated by trained research assistants with appropriate supervision and the data were captured directly into an EPIINFO v7.1 database on laptop computers in the field. The survey was translated into the local languages (Runyankole, SiSwati, and Shona) and pre-tested.

Survey Questions and Scoring

The survey questions (statements) were drawn from items of validated scales and indicator compendiums of the Gender Equitable Men (GEMScale [11], the Tanzania Stigma Indicator and Community Baseline (Individual Questionnaire) [12], the World Bank Social Capital Assessment Tool (A-SCAT) [13], and the Rapid CATCH + 2009 Maternal and Neonatal Care Module [14]. The main outcomes for this analysis are MCH beliefs scores, (from the Rapid CATCH + 2009 Maternal and Neonatal Care Module), HIV stigma scores (from the Tanzania Stigma Indicator and Community Baseline (Individual Questionnaire), and the GEM norms scores. Table 1 shows an example of some of these questions.

Table 1 Survey questions used for outcome scores

The three outcome scores were numeric, and these outcomes were scored according to the scheme below:

MCH beliefs score: Responses to questions regarding MCH beliefs were scored based on a scale of 0–4; from “strongly agree” (4) to “strongly disagree” (1), and “neither agree nor disagree” (0) for true statements. False statements were reverse scored; “strongly agree” (1), to “strongly disagree” (4). Scores from each question were added up for each individual. A higher score indicated a better community understanding of MCH issues and a greater confidence in the community to address MCH-related HIV issues. For the pre-intervention surveys, Cronbach’s alpha scores ranged from 0.31 to 0.48 across the three countries. For the post-intervention surveys, these scores ranged from 0.40 to 0.52.

HIV stigma score: Responses to HIV-related stigma questions were scored 4-1; “strongly agree” (4) to “strongly disagree” (1). Scores for each question were added for each individual, with a lower composite score reflective of less HIV-related stigma. Cronbach’s alpha scores ranged from 0.38 to 0.47 across the three countries for the pre-intervention surveys. For the post-intervention surveys, these scores ranged from 0.27 to 0.60. Measuring HIV stigma was important, as other studies pointed out that HIV stigma is a key barrier to HIV prevention and treatment efforts [15].

Gender-equitable norms score: Scoring for the gender-equitable norms section was based on the GEM Scale [11]. This section contained questions with statements that reflect gender inequitable norms. An “Agree” response was given a score of 1, “Partially agree” a score of 2, and “Disagree” a score of 3. Scores for each question were summed to a composite score for each individual. A higher score was indicative of a higher degree of gender-equitable norms. Cronbach’s alpha scores for the pre-intervention surveys across the three countries were 0.60–0.73, and 0.64–0.75 for the post-intervention surveys.

Out of several outcomes, these three scores were chosen because previous studies have failed to address community MCH support, HIV stigma within the community, and gender norms that affect women’s participation in PMTCT programs [10]. In addition to these outcomes, the questionnaire consisted of items in the following areas: problems in accessing health care; individual MNCH knowledge, attitudes, perceptions and barriers; sexually transmitted infections; HIV knowledge; HIV testing and disclosure; PMTCT knowledge; pregnancy and postnatal care (for women), GEM-equitable norms; household decision-making; contraception; and social capital (groups and networks).

We selected the three outcomes, as they were the most discriminant across the study arms and countries (data not shown). In addition, the outcome measures selected represent indicators of barriers and facilitators to PMTCT services. Factors that affect pregnancy outcomes overall are relevant for HIV-positive pregnant women. For example, the measure of “Vaginal bleeding during pregnancy is caused by pregnant mother working too hard” is an indicator of knowledge that working burden (working too hard) during pregnancy could result in a negative outcome of vaginal bleeding. The statement that maternal or infant death being caused by evil spirit or breaking taboos is a measure of superstition that is relevant for PMTCT as a belief that for example, death of an infant due to HIV could be because of evil spirits. The other MCH statements reflect a degree of self-efficacy and community cohesion; that a mother is able to act to have a successful birth outcome, and that the community members can work together to have healthy outcomes for mother and children, including PMTCT. Stigma is, of course, is a barrier to PMTCT, and so is gender inequity, where husbands for example, may be less supportive of their wives in pregnancy (especially for PMTCT), or unwilling to financially support women’s attendance at ANC. These three outcomes were measured for both women and men, as previous studies did not assess men’s attitudes in the community towards MCH support, which can affect women’s health seeking behaviors and participation in PMTCT programs.

Analysis

We analyzed data by country and gender from the KAB community pre- and post-intervention surveys. Women completed 1783 pre-intervention surveys and 1807 post-intervention surveys. Men completed 1554 pre-intervention surveys and 1355 post-intervention surveys. We tested the distribution of scores for MCH beliefs, HIV stigma, and GEM for normality. Mean MCH beliefs scores, HIV stigma scores, and GEM scores for each study arm were calculated from the pre-intervention surveys and the post-intervention surveys. T-tests were used to assess the difference between the mean pre-intervention scores and the mean post-intervention scores.

Although randomization was used for intervention assignment, descriptive data were compared for potential confounders across groups. The main potential confounders included age, highest level of education, number of years in the community, whether one is living away from home, source of income, and marital status.

We undertook a differences-in-differences analysis, comparing arms 2 and 3 against arm 1. We used generalized linear models with contrast analysis to test whether the post- vs. pre-intervention mean score difference was significantly different in arms 2 and 3, compared to arm 1. A total of 6479 records were available for analysis. All analyses were undertaken using SAS 9.4.

Results

Response rates were over 85% for both surveys and men and women. Table 2 presents the demographic characteristics of the study participants.

Table 2 Demographic characteristics of survey participants by country

The women in Zimbabwe were older (mean age 36.2 years), while those in Eswatini were younger (mean age 34.7 years). While men in Eswatini were the youngest participants, with a mean age of 33.9 years, Ugandan men were the oldest (mean age 39.8 years). The Zimbabwean women and men had higher levels of education, at 66% and 79%, respectively, having attained secondary and above education. The Ugandan participants had the lowest education, at 20% of the women and 35% of men having secondary or more education. In Zimbabwe and Eswatini, participants tended to be Apostolic or Pentecostal Christian faiths, while the majority of Ugandan participants held more traditional Christian beliefs identifying as Protestant (Anglican) and Roman Catholic. Of note however, was that over 20% of Zimbabwean men reported having no religion.

Over 75% of the participants were long-term community residents (> 5 years). Around one-third of Zimbabwean participants, 32% of women and 39% of men, reported that they had been away from home for > 1 month in the past 12 months, suggesting that they may have migrated for work. Over 75% of the Zimbabwean and Ugandan participants reported being married or living as married, as compared with 58% of women and 42% of men in Eswatini. Participants in Eswatini and Uganda came from larger households, (median household size 6). Among the Ugandan participants, 77% of women and 57% of men were engaged in farming as their main source of income. Only 31% of men and 25% of women in Eswatini farmed, while 37% of the women and 27% of the men received remittances.

Except for the gender equity score in arm 1 for men (p = 0.31), all the interventions led to improvements in scores for both men and women (p < 0.01), as shown in Table 3.

Table 3 Indicators scores by study arm and gender, all countries combined

The difference in mean indicator score changes by study arms for arms 2 and 3, compared to arm 1, is summarized in Table 4.

Table 4 Difference (t-test) in indicator mean score changes pre- vs post-intervention between study arms by gender

For both men and women, at least one of the combined intervention arms (2 and 3) resulted in improved MCH beliefs and GEM scores (p < 0.05), compared with arm 1 (community leader engagement intervention only). For both men and women, adding peer groups led to significant improvements in the MCH beliefs score (arm 3 vs. arm 2) (p < 0.05). However, the GEM score did not change significantly with the addition of the peer groups. For both men and women, the community days and peer group interventions (arms 2 and 3) did not lead to significantly greater improvements in the stigma score, when compared with arm 1(community leader engagement only).

When stratifying these results by country, the combined intervention arms (2 and 3) showed score improvements, for both men and women, for two of the three outcomes (Table 5). However, this improvement is mainly seen for mean community MCH scores and mean stigma scores for two out of the three countries. The only country to have significant improvements in mean GEM scores from the combined interventions for both men and women was Uganda (p < 0.01). The combined intervention improved GEM scores significantly among women in Zimbabwe and Eswatini (p < 0.01), but not among the men. However, similar to the combined country analysis, the addition of the peer group intervention in arm 3 led to improvements in mean MCH beliefs scores, compared to arm 2, for most of the groups studied (p < 0.05). However, the peer group intervention did lead to significant improvements in mean stigma scores for most groups across all three countries (p < 0.01).

Table 5 Changes in mean indicator scores by study arm, country and gender

Women in arm 3 had significantly greater improvements in mean outcomes scores than the women in arm 1 in Zimbabwe and Uganda. For women in Zimbabwe, those in arm 3 had greater increases in mean MCH beliefs score (diff = 1.15, p = 0.012) than those in arm 1. Among women in Uganda, those in arm 3 had a greater increase in mean MCH beliefs score (diff = 1.71, p = 0.0009), greater reduction in mean HIV stigma score (diff =  − 2.129, p < 0.0001), and greater increase in mean gender equitable norms score (diff = 2.741, p < 0.0001) than those in arm 1.

Among the men, the results were more varied. In Uganda, however, men in arm 3 had a significantly greater increase in mean MCH beliefs score (p < 0.0001), greater decrease in mean HIV stigma score (p < 0.0001), and greater increase in mean GEM scores (p < 0.0001) than men in arm 1.

Discussion

In this rural population, the results show that for both women and men, arm 2 (community leader engagement plus community days), and arm 3 (community leader engagement, community days, and peer groups) led to greater mean score changes than that of arm 1 (community leader engagement only), for at least two of the three outcome scores. These interventions led to the intended changes in MCH beliefs, HIV stigma, and gender equitable norms among women in the countries studied. However, because both men and women were intentionally included in all three interventions, mean score improvements were seen among the men as well. This showed an increase in MCH beliefs, reduction in HIV stigma, and increased gender equitable norms among men. This is a desirable secondary outcome, as men’s increased MCH and PMTCT beliefs and knowledge, reduced HIV stigma, and increased gender equitable norms could lead to more male involvement in MCH and PMTCT issues. Overall, the educational interventions seemed to be effective for all study arms, with greater improvements in outcomes for the cumulative interventions. These educational interventions could potentially reduce the MTCT rate by increasing MCH beliefs, reducing HIV-related stigma, and encouraging gender equitable norms.

Although there were some differences between the country-by-country and combined analysis results, they both showed that the combined interventions (arms 2 and 3) were more effective than the community leader engagement intervention alone (arm 1), for both women and men. Some of the country differences may have been due to the socioeconomic and demographic differences. Due to the setting, the Ugandan population was less educated, and more traditional, while the population in Eswatini was generally younger, and the Zimbabwean population was the most educated.

Unlike the community leader engagement intervention, the community days and peer group interventions were targeted towards individuals in smaller groups. In the community days, individuals were encouraged to test for HIV and get HIV counseling. In the peer groups, individuals were educated about gender-based violence, safe sex practices, ANC, and PMTCT. This suggests that individuals may be more likely to address their health behaviors regarding HIV prevention and PMTCT when given the chance to discuss these issues in small groups. Other studies have also shown the positive effects of small group and peer interventions on health behaviors regarding HIV prevention behavior and attitudes [16,17,18].

There were several advantages to the design and analysis of this study. The study of the interventions was done in the form of a randomized trial. This study design controlled for confounding factors, such as demographic variables. Furthermore, it minimized the effect of these confounding factors on the exposure and outcome variables. The sample used for the study was representative of the population.

In addition, the specific targeting of men as important players in MCH likely accounted for the level of change seen at the community level. Since the interventions were designed to improve MCH knowledge and gender-equitable norms in the community, the study was able to reach a much broader audience than it would have if it had focused only on HIV-positive women and men.

However, there were limitations to this study design as well. Generalization of the results of this study may be limited to only EGPAF-supported regions or districts, since results differed by country and gender. The pre-/post-intervention assessment design may also be prone to confounding by temporal changes that could have occurred between assessments. In addition, the fact that this was a serial cross-sectional study, rather than a longitudinal study, limits the analytical methods that could be used. The low Cronbach’s alpha scores for MCH beliefs, which suggest low reliability of the measures, could be related to the low number of items in the scales, as well as the fact that the measures used were part of a questionnaire that had number of other questions. The t-test was the most optimal option for analyzing the outcome in this study. An advantage of the t-test was that it allowed for a simple comparison of pre- vs. post-intervention changes in scores for each study arm. However, the t-test did not account for potential demographic confounders. To account for this, t-tests were used to compare mean score changes among demographic categories, but generalized linear models were also used to compare mean score changes between study arms. Therefore, having demographic t-tests, as well as generalized linear model analysis, accounted for the limitations of the initial t-tests. The generalized linear model analysis accounted for potential clustering of participants through inclusion of random effects in the model.

Conclusion

Arm 3, which combined all three interventions and arm 2 (community leader engagement and community days) led to improvements in outcome scores, compared to the community leader engagement intervention along (arm 1). This suggests that a package of community interventions may be most effective in increasing community HIV knowledge and improving gender equitable norms.