Skip to main content

The effectiveness of older insecticide-treated bed nets (ITNs) to prevent malaria infection in an area of moderate pyrethroid resistance: results from a cohort study in Malawi

Abstract

Background

A previous cohort study in Malawi showed that users of new insecticide-treated bed nets (ITNs) were significantly protected against malaria compared to non-users, despite moderate levels of pyrethroid resistance among the primary mosquito vectors. The present study investigated whether ITNs that were 1–2 years old continued to protect users in the same area with moderate pyrethroid resistance.

Methods

One year following a baseline cross-sectional malaria parasitaemia prevalence survey and universal distribution of deltamethrin ITNs (May 2012), a fixed cohort of 1223 children aged 6–59 months was enrolled (April 2013). Children were tested for parasitaemia at monthly scheduled visits and at unscheduled sick visits from May to December 2013 using rapid diagnostic tests. ITN use the prior night and the condition of ITNs (based on presence of holes) was assessed by caregiver self-report. The incidence rate ratio (RR) comparing malaria infection among users and non-users of ITNs was modelled using generalized estimating equations adjusting for potential confounders and accounting for repeated measures on each child. The protective efficacy (PE) of ITN use was calculated as 1 − RR.

Results

In this cohort, self-reported ITN use remained consistently high (> 95%) over the study period. Although users of ITNs were slightly more protected compared to non-users of ITNs, the difference in incidence of infection was not statistically significant (RR 0.83, 95% confidence interval [CI] 0.54–1.27). Among ITN users, malaria incidence was significantly lower in users of ITNs with no holes (of any size) compared to users of ITNs with ≥ 1 hole (RR 0.82, 95% CI 0.69–0.98).

Conclusions

There was no significant PE of using 1–2 year-old ITNs on the incidence of malaria in children in an area of moderate pyrethroid resistance, but among ITN users, the authors found increased protection by ITNs with no holes compared to ITNs with holes. Given the moderate levels of pyrethroid resistance in the primary malaria vector and recent evidence of added benefits of ITNs with synergists or non-pyrethroid insecticides, next-generation ITNs may be a useful strategy to address pyrethroid resistance and should be further explored in Malawi.

Background

Insecticide-treated bed nets (ITNs) have contributed substantially to declines in malaria morbidity and all-cause mortality across sub-Saharan Africa [1, 2]. ITNs prevent mosquito blood feeding by physically inhibiting human-mosquito contact and by chemically deterring, irritating, and killing mosquitoes. The physical barrier of the ITN prevents mosquito entry, while the pyrethroid treatment induces mosquito excito-repellency and causes paralysis leading to mosquito death. At high levels of coverage, ITNs reduce the overall density and life-span of mosquito populations, resulting in community-wide malaria protection both for those sleeping under ITNs and for neighbouring non-users of ITNs [3].

The emergence of mosquito resistance to pyrethroids has led to concerns about the continued effectiveness of ITNs. Resistance can occur due to upregulation of metabolic enzymes, which promote faster clearance of the insecticide, and/or mutations in target site genes, such as the knockdown resistance gene (kdr), which limit the binding of the insecticide to initiate paralysis. Either of these mechanisms leads to reduced deterrence and mortality, which could compromise the mass killing effect of ITNs. However, ITNs may continue to provide partial protection through other mechanisms. To date, entomologic evidence from a meta-analysis of laboratory and field studies has shown that the effectiveness of ITNs was not significantly reduced due to insecticide resistance alone [4]. Similarly, epidemiologic evidence from studies in Benin [5], Côte d’Ivoire [6], Malawi [7], Kenya [8], and a multi-country study [9] have shown that ITN use remains protective against malaria infection even in areas with moderate-to-high levels of pyrethroid resistance. However, it is unclear whether ITNs will continue to be effective in areas with pyrethroid resistance as the nets develop holes or tears over time and the insecticide content on the net declines.

Entomologic studies have shown that the development of holes in nets combined with pyrethroid resistance leads to increased mosquito blood feeding. Experimental hut trials conducted in an area of high pyrethroid resistance in Benin found that blood-feeding rates in Anopheles gambiae were almost three times greater in ITNs with 80 holes (32%) compared to ITNs with 6 holes (12%) [10]. In another experimental hut study conducted in two sites in Benin with different levels of pyrethroid resistance, among ITNs that were cut to simulate holed nets, blood feeding was substantially reduced in the site where mosquitoes were susceptible, while no impact on blood feeding was observed in the site with high levels of pyrethroid resistance [11]. In an area of high pyrethroid resistance in western Kenya, a significantly higher number of mosquitoes was observed resting inside ITNs with larger hole areas compared to ITNs with no holes (risk ratio 1.9; 95% confidence interval [CI] 1.2–3.1) [12]. Although these findings are consistent with reduced deterrence due to pyrethroid resistance, studies examining the outcome of mosquito mortality have been mixed; similar rates of mosquito mortality were observed in experimental huts using ITNs with and without holes in a setting of pyrethroid-resistant Culex quinquefasciatus and An. gambiae sensu lato (s.l.) [13], while another study of equivalently-holed ITNs found significantly reduced mortality in a setting of high kdr resistance (19%) compared to a setting of kdr susceptibility (98%) [11].

The development of holes in ITNs in settings of pyrethroid resistance may increase blood feeding and potentially reduce mosquito mortality, but few studies have examined whether this compromises the operational effectiveness of ITNs. The use of older nets and nets with holes compared to no use of nets was associated with reduced odds of malaria in cross-sectional surveys of children in Benin [14], Equatorial Guinea [15], and Malawi [15]; however, the protective effect decreased with increasing deterioration of the nets. In Malawi, which has moderate levels of pyrethroid resistance [7], repeat analysis of cross-sectional survey data for 3 years following a national distribution campaign found that ITN use was associated with reduced prevalence of malaria in children aged 5–15 years (school-aged), but associations were null among other age groups [16]. A health facility-based case–control study conducted in children aged 6–59 months found no significant personal protective effect of ITNs approximately 1 year after ITNs were distributed in an area of moderate pyrethroid resistance in Malawi [17]. Given the potential for selection bias introduced by health facility-based controls [18] and limitations of cross-sectional surveys, results from prospective studies are needed to understand if protection by ITNs becomes compromised once holes develop in settings of pyrethroid resistance.

In 2012–2013, a cohort study of children aged 6–59 months was carried out in an area of moderate pyrethroid resistance in Malawi to determine the protective efficacy (PE) of newly distributed ITNs on incidence of malaria parasitaemia. Over the 1-year study period, ITN use was associated with a significant PE of 30% (rate ratio [RR] 0.7; 95% CI 0.5–0.8) compared to no use of ITNs [7]. Although this study demonstrated that ITNs were still effective in settings of moderate pyrethroid resistance, the ability of ITNs to continue to prevent malaria infection once the physical condition of nets degraded and insecticide content declined over time remained uncertain. The objective of the present study was to evaluate the PE of ITNs 1–2 years after use in a setting of moderate pyrethroid resistance.

Methods

Study area and population

This study was a follow-up to a cohort study (first cohort) conducted by Lindblade et al. [7] to determine the PE of ITNs on incidence of malaria parasitaemia in an area of moderate pyrethroid resistance in Malawi. The entire population of Malawi is at risk of malaria infection by Plasmodium falciparum year-round, with heightened transmission during the rainy season between December and March. Universal coverage of ITNs has been a major component of the malaria control strategy and, between 2010 and 2014, the proportion of households owning at least one ITN increased from 58 to 70% following several universal distribution campaigns [19, 20].

The study area included the same six villages in the Traditional Authority of Sitola, Machinga District, Malawi, where the first cohort study was conducted. All households in the villages were mapped and enumerated in February–March 2012, just preceding the enrollment of the first cohort in March 2012, which was followed until March 2013. A second census was carried out in November 2012, and all children 6–59 months old as of April 1, 2013 were invited to participate in the present study (Fig. 1). The new, fixed cohort of children (second cohort) was enrolled in April 2013 and followed from May to December 2013.

Fig. 1
figure 1

Study profile of second cohort, Liwonde, Malawi 2013

Entomologic surveillance occurred every fortnight in 10 clusters of the study area during the first cohort and ended at the start of the second cohort. Just prior to the enrollment of the second cohort (March 2013), mortality of Anopheles funestus measured by World Health Organization (WHO) resistance assays ranged from 8 to 31% following exposure to deltamethrin 0.05% and from 13 to 67% following exposure to permethrin 0.75%, respectively. Mortality was slightly higher in An. gambiae s.l., at 53% as measured from a single village in Machinga district exposed to deltamethrin 0.05% and ranging from 6 to 91% in four villages in Machinga and neighbouring Balaka district exposed to permethrin 0.75%. From mosquitoes collected during the first cohort, the primary mechanism of resistance was found to be metabolic with no evidence of target site mutation in kdr.

Sample size determination

The sample size for the second cohort was determined based on the same assumptions as the first cohort [7]. Using a generalized estimating equations (GEE) approach [21], assuming a Poisson distribution with exchangeable correlation structure for repeated measurements on children and an incidence rate of malaria parasitaemia among children not using ITNs of 1.0 episode per person-year (assuming 30% of children would not use ITNs), the sample size required for 70% power to detect a 30% reduction in incidence of malaria parasitaemia among ITN users at a two-sided alpha equal to 5% was 981 children. After accounting for a 5% refusal rate, 15% loss-to-follow-up over 9 months, and a mortality rate of 1.5% per year, enrollment was planned for 1335 children.

Enrollment, monthly visits and sick visits

Similar procedures for enrollment, monthly visits and unscheduled sick visits were followed for the first [7] and second cohorts. Children were eligible to participate if they were 6–59 months old, not taking daily cotrimoxazole for human immunodeficiency virus infection or exposure, weighed 5 kg or more, and planned to stay in the study area for at least 1 month. Participants of the first cohort study could enroll in the second cohort if they met the eligibility criteria. Enrollment and monthly visits took place at central locations within the communities, and no incentives or transportation reimbursement were provided to attend scheduled monthly visits. Malaria parasitaemia was measured at scheduled monthly visits and at unscheduled sick visits if the child fell ill in between monthly visits. Caregivers were encouraged to bring their children for examination by a study clinician at Machinga District Hospital, one of the only health care providers in the area, for any illnesses occurring between scheduled visits. Caregivers were reimbursed for transportation to the study clinic for up to one unscheduled sick visit per month.

At enrollment, monthly visits and unscheduled sick visits, caregivers were interviewed about their child’s history of illness over the past 2 weeks, use of anti-malarials, and use of ITNs the night prior to the visit. Caregivers were also asked about the condition of the child’s ITN, including age and the presence of holes of any size, holes between fist and head-sized (large holes, 10–25 cm), or holes that were head-sized or larger (extra-large holes, > 25 cm) [22]. The child’s axillary temperature was measured using a thermometer and a blood sample was collected by finger stick for malaria testing and haemoglobin measurement (g/dL). Malaria testing was performed using histidine-rich protein 2 (HRP-2) P. falciparum rapid diagnostic test (RDT; SD Bioline Malaria Ag Pf® ref. 05FK53, Kyonggi-do, Republic of Korea). Haemoglobin was measured using a Hemocue® (Angelholm, Sweden) portable haemoglobinometer. Children with positive RDT results were treated with an appropriate anti-malarial as per national guidelines.

At enrollment only, all children were cleared of parasites with a full, weight-appropriate treatment course of dispersible artemether-lumefantrine (Coartem®-D, Novartis, Basel, Switzerland). Dried blood spots were also collected on filter paper for molecular testing by polymerase chain reaction (PCR) for P. falciparum, Plasmodium vivax, Plasmodium ovale, or Plasmodium malariae to determine malaria prevalence at enrollment. Anthropometric measures of height and weight were taken.

Study staff made three attempts within 1 week to complete a follow-up visit for children who missed their scheduled monthly visit. Children who missed three or more consecutive scheduled visits were withdrawn from the study.

ITN ownership and use

Study staff distributed Permanet 2.0 long-lasting ITNs (Vestergaard, Lausanne, Switzerland), treated with deltamethrin, in the study area in May 2012, just after enrollment of the first cohort. One ITN was distributed per two individuals in each household, and an additional ITN was provided for households with an odd number of residents. Outside of the study area, the National Malaria Control Programme of Malawi conducted a national ITN distribution campaign with Olyset Nets (Sumitomo Chemical Co., Japan) in July 2012 using the same allocation scheme. No additional ITN distributions were conducted in the study area after the study distribution; however, during enrollment of the second cohort, caregivers of participants were provided with an ITN by the study if the child’s ITN was reported to be lost, stolen, or damaged. All bed nets were considered ITNs following the study distribution in May 2012.

At each study visit, caregivers were asked about their child’s ITN use the night before the visit, during the 2-week period before the visit, and about “typical use” during the current season. The reliability of caregiver-reported ITN use was assessed in two cross-sectional surveys employing home visits during the first and second cohort studies; the proportion of positive agreement between caregiver-reported and actual use was high (> 93%), while the proportion of agreement in negative responses was low (< 29%) [23].

Data management and analysis

To explore the effect of holes on the effectiveness of ITNs, the caregiver-reported condition of ITNs used by study participants was categorized as i) use of an ITN with no holes, use of an ITN with a small or medium hole (no large or extra-large holes), use of an ITN with a large or extra-large hole, and ii) use of an ITN with any holes vs. use of an ITN with no holes. Children with haemoglobin levels < 11 grams per deciliter were considered anaemic. Age- and sex-specific WHO growth reference charts [24] were used to classify stunting (height-for-age) or wasting (weight-for-age) in children with Z-scores that were ≤ 2 standard deviations below the median at enrollment.

Several variables were considered as potential confounders in this analysis based on previous associations documented in the literature. Age was dichotomized as 6 to < 12 months and 12 months or older. A dummy variable to indicate whether the child was a returning member of the first cohort was included. To control for the geographic heterogeneity of malaria transmission, individual risk of malaria infection was estimated using inverse distance-weighted (IDW) malaria prevalence at enrollment within 1 km of each child. Study visits were categorized as occurring during high (April–June 2013) or low (July–December 2013) malaria season. To account for the community protection conferred by widespread use of ITNs, the number of ITNs within a 300-m radius [3] as enumerated during the November 2012 census was included. Altitude of the household was measured at enrollment. Household wealth was differentiated by principal components analysis of household assets [25]. The following household assets were included: electricity, paraffin lamp, battery lamp, radio, television, cell phone, mattress, sofa set, table and chairs, refrigerator, bicycle, motorcycle, car, source of water, type of toilet, type of floor material, type of roof material, type of wall material and number of sleeping rooms. Educational attainment of the primary caretaker was dichotomized into completion of primary school (or greater) versus no completion of primary school. All continuous variables were divided into terciles and analysed categorically.

Monthly and unscheduled sick visits were combined for analysis and person-time at risk accumulated from enrollment through the final study encounter (either a monthly visit or unscheduled sick visit) was calculated for each child. Children who were withdrawn from the study were censored at their last encounter date. Person-time at risk was adjusted for malaria treatment and diagnostic characteristics. The half-life of lumefantrine (10.5 days) [26] was subtracted from the person-time at risk following the baseline parasite clearance dose. In addition, the HRP-2 parasite antigen detected by RDTs can persist in peripheral blood after an infection has been cleared, potentially resulting in a false positive test result. Based on data from previous studies [27, 28], the at-risk time for participants with consecutive positive RDTs was removed such that a second positive result occurring < 17 days from a prior positive visit was considered as a false positive, while consecutive positive results ≥ 17 days apart were considered as new infections and contributed towards person-time at risk.

Malaria incidence was modelled using Poisson regression with log-transformed person-time as an offset in GEE [29] using SAS version 9.4 (SAS Institute, Inc., Cary, NC, USA) and the GENMOD procedure. Analysis using GEE was selected because estimates are robust and amenable to misspecification of correlation structure for a large number of clusters [30]. Fixed effects were estimated by least squares means and standard error estimates for model parameters were adjusted for repeated measures by considering an independent working correlation structure. An independent correlation structure was selected because parameter estimates using other correlation structures (exchangeable and unstructured) were unstable. The full model included the main predictor of interest, sleeping under an ITN, which was treated as time-varying, and all potential confounders based on reported associations in literature, including both time-variant and time-invariant variables. Collinearity was assessed from an information matrix for variables with condition indices greater than 30 with two or more variance decomposition proportions greater than 0.5 [31]. Potential confounders were evaluated using the 10% change in estimate approach, in which the change in effect measures for ITN use were compared for all possible subsets (combinations) of covariates to identify reduced models that sufficiently control for confounding [32, 33]. The final model was selected among the reduced models based on precision (smaller standard error) of the effect estimate for ITN use and model fit statistics (lower Akaike Information Criterion). Adjusted incidence per person-year (iPPY) was estimated for each variable of interest by assigning mean values for other dependent variables. Rate ratios (RR) and 95% CIs were estimated from models accounting for correlated data (univariate and multivariate analyses) and adjusted for confounders (multivariate analysis). PE was calculated as 100%*(1 − R1/R0) where R1 is the rate of malaria infection among ITN users and R0 is the rate among non-ITN users. p-values < 0.05 were considered statistically significant.

Results

Coverage and use of insecticide-treated bed nets in the study area

As measured in the censuses conducted in the study area in households with and without enrolled children, the proportion of households with at least one ITN per two residents (universal coverage) doubled following the ITN distribution campaigns from 23% (95% CI 22–25%) in February 2012 to 56% (95% CI 54–58%) in November 2012. ITN use among all residents increased from 58% (95% CI 57–59%) to 70% (95% CI 69–71%) in February 2012 and November 2012, respectively.

Cohort profile

A total of 1922 age-eligible children from two sources: 1571 children with birth dates that would put them between 6 and 59 months of age as of April 2013 were identified from 2657 households that were mapped and enumerated in November 2012 (second census) and an additional 351 children were identified at the time of enrollment. These 351 children were not enumerated during the second census, but were either age-eligible members of the first cohort or a sibling of a first cohort participant. A total of 1223 children were enrolled in April 2013 from 980 households and, among these, 648 (53%) children were returning participants of the first cohort study. Children were not enrolled due to the following reasons: 58 (3%) did not meet additional eligibility criteria, 521 (27%) declined to participate (mainly due to study fatigue), 41 (2%) had moved out of the study area, 76 (4%) could not be located, and 3 (< 1%) died prior to enrollment (Fig. 1). Characteristics of enrolled and unenrolled children were compared among the 1571 children identified from the second census; participating and non-participating children did not differ significantly by gender (Chi squared test p-value = 0.489) or age (median ages 27 and 28 months, respectively; Wilcoxon signed-rank test p-value = 0.310). However, enrolled children were significantly more likely to sleep under an ITN (84%) compared to children who were not enrolled (75%; Chi square test p-value < 0.001).

Enrolled participants made 10,566 encounters with the study between April and December 2013. The median follow-up time was 0.66 years (IQR 0.65–0.67) per child, and 1082 (89%) children completed 8 months of follow-up. Reasons for incomplete follow-up included: caretaker withdrawal of consent (n = 16, 1%), permanent relocation outside the study area (n = 66, 5%), inability to be traced (n = 58, 5%) or death (n = 1, 0%) (Fig. 1). Monthly visit attendance ranged from 91% (May 2013) to 84% (December 2013). More than half (58%) of children made at least one unscheduled sick visit and, among those children, the median number of unscheduled visits was 2 (IQR 1–4).

Baseline characteristics

At baseline of the second cohort, a quarter (25%, 95% CI 22–27%) of children were infected with P. falciparum by PCR, which was significantly lower compared to the baseline malaria prevalence of the first cohort (37%, 95% CI 34–40%, [7]). Caregivers reported that most (98%) children slept under an ITN the night prior to the survey. At enrollment, 34% of participants slept under an ITN with at least one hole of any size, 14% slept under an ITN with ≥ 1 large sized hole, and 3% slept under ITNs with ≥ 1 extra-large sized hole (3%) (Table 1). Most ITNs under which children slept were approximately 1 year old (84%) and reported to be from the study ITN distribution (73%). The remaining ITNs were obtained from the National Malaria Control Programme’s universal coverage campaign in July 2012 (9%), hospital/health centres (14%), or from shops or markets (3%). At subsequent monthly visits, a majority of ITNs (> 83%) were obtained from the study or national distributions and fewer than 5% each month were reported to be obtained from shops or markets.

Table 1 Descriptive characteristics of the study cohort, Liwonde, Malawi April—December 2013

Protective effectiveness of insecticide-treated bed nets

Over the 8-month study period, cohort participants experienced 825 total malaria infections and contributed 640 person-years at risk (PYAR) for a crude incidence of 1.3 iPPY and median iPPY of 0 (interquartile range 0–1.8) (Table 1). Malaria incidence was highest in May and June 2013 following the rainy season, but remained markedly lower in comparison to the same period during the first cohort (Fig. 2). By the end of the study period, 64% of children remained malaria-free while 19% were infected at least twice.

Fig. 2
figure 2

Monthly incidence of malaria infection and timeline of study activities in first and second cohorts, Liwonde, Malawi. Error bars indicate standard error of rate. * Published data from Lindblade et al. [7]

ITN use the night prior to the survey was recorded for 620 PYAR (97%) and no ITN use was recorded for 19 PYAR (3%) (Table 2, rows 5–6). The proportion of children at each monthly visit who slept under an ITN remained consistently high (between 96.4 and 98.5%) from May to December 2013.

Table 2 Predictors of malaria incidence in a fixed cohort of 1,223 children, Liwonde, Malawi April—December 2013

Unadjusted malaria incidence did not differ by age or sex. Users of ITNs experienced similar incidence of malaria (1.27 iPPY) as non-ITN users (1.35 iPPY) (RR: 0.94, 95% CI 0.60–1.49, p = 0.801). Higher malaria incidence was significantly associated with being a member of the first cohort, higher baseline Plasmodium prevalence, higher IDW malaria prevalence, high malaria transmission season (April to June 2013), and fewer ITNs within a 300-m radius. Children living in wealthier households and those who had primary caregivers that completed primary school experienced significantly lower malaria incidence (Table 2).

After adjusting for age, IDW malaria prevalence, malaria season, number of ITNs within 300 m, household altitude, household wealth, and caregiver education, malaria incidence was slightly lower among children using ITNs compared to those who did not use ITNs (adjusted RR [aRR]: 0.83, 95% CI 0.54–1.27), but the PE of 16.7% was not statistically significant (p = 0.389) (Table 2).

Effect of holes in ITNs on malaria incidence

Trends in malaria incidence by ITN use and use of ITNs with varying size holes were explored in Table 3. Malaria incidence was lowest among ITN users of nets with no holes (adjusted iPPY 0.75, 95% CI 0.55–1.02; Table 3) and there was no association with increasing size of holes in ITNs and malaria incidence.

Table 3 Malaria incidence by ITN use and net hole size in a fixed cohort of 1223 children, Liwonde, Malawi April–December 2013

Given the lack of clear trend between size of holes in ITNs and malaria incidence, the effect of holes in ITNs was examined by considering use of ITNs with no holes and use of ITNs with ≥ 1 hole. Use of ITNs with no holes was recorded for 345 PYAR (58%). After adjusting for potential confounders, malaria incidence was significantly lower in children who used ITNs with no holes (of any size) compared to children who used ITNs with ≥ 1 hole (aRR: 0.82, 95% CI 0.69–0.98; p = 0.0268; Table 4), although the magnitude of the effect was similar to ITN users versus non-ITN users.

Table 4 Effect of net holes on malaria incidence in a fixed cohort of 1223 children, Liwonde, Malawi April–December 2013

Discussion

In a setting of moderate pyrethroid resistance where mosquito mortality to pyrethroids ranged from 25 to 38% in An. funestus and 53–57% in An. gambiae s.l., malaria infection among users of ITNs that were 1–2 years old (some with holes) was lower than infection among non-users of ITNs, although the number of non-users was very small and the reduction was not statistically significant. Among users of ITNs, use of ITNs with no holes significantly reduced malaria incidence compared to use of ITNs with holes, with a similar magnitude of reduction as comparing the use of ITNs versus no ITNs. In contrast, the results from the first cohort in the same study area showed that new ITNs provided significant personal protection to users compared to non-users during the previous year (RR 0.7, 95% CI 0.5–0.8) [7]. Collectively, these findings suggest that, in a setting of moderate pyrethroid resistance and older ITNs, ITNs without holes may still provide partial protection, but the community effect and personal protection may be waning.

There could be several explanations for the lack of significant PE of ITNs observed in this study. First, given the high use of ITNs (> 95%) by participants, the study was underpowered to detect significant differences in malaria incidence between ITN users and non-users. Although the effect was imprecise, the direction suggested that ITN use was protective (PE: 17%). An effect of similar magnitude was found in the cohort enrolled at the western Kenya site of a large multi-country study, which also had high use of ITNs (> 90%, but lower than the present study) and high levels of pyrethroid resistance, but the results in the Kenya study were statistically significant [8, 9]. Second, the small reduction in malaria incidence between users and non-users of ITNs could be a result of reduced personal protection of ITNs, in the context of moderate levels of pyrethroid resistance and deterioration of the ITNs. Malaria incidence was lowest among users of ITNs with no holes and was similar among users of ITNs with holes and non-users of ITNs. The PE of using an ITN with no holes compared to no ITN use was higher than that for using an ITN with no holes versus an ITN with holes (PE 25% versus 18%); however, only the latter was statistically significant, likely because of limited power due to the low number of non-users of ITNs. Additionally, there was no clear trend in malaria incidence and use of ITNs with holes of increasingly larger size. The threshold at which a net is deemed “damaged” has been debated and may depend on the size, number and location of holes and the criteria by which (i.e. field based or laboratory-based) holes are characterized [34, 35]. Several studies have shown an association between nets with greater damage (i.e. larger holes or poorer condition) and increased malaria [15, 36], while other studies have indicated no association [37, 38]. None of these studies have examined the effect of ITNs with holes on malaria prospectively. The ITNs used by participants in this study were approximately 1 to 2 years old and a large proportion (35%) had holes of any size at the start of the second cohort study. Although ITN holes were assessed throughout the study and concurrently with ITN use based on caregiver self-report, the field-based categorization used may overestimate [35] the size of holes. These findings suggest that holes of any size may increase the risk of malaria infection among ITN users in a setting of moderate pyrethroid resistance. The loss of personal protection mirrors results from entomological studies which found that pyrethroid resistant mosquitoes were able to successfully feed on the occupants of nets as their physical condition deteriorated [10, 11].

Despite the absence of observed personal protection among users of ITNs with declining physical integrity, there was a significant association between a higher number of nets within a 300-m radius and lower malaria incidence, suggesting some evidence of a community effect [3]. There was a larger reduction in malaria incidence among ITN users compared to non-ITN users in the first cohort, which suggests that the community effect may have weakened. The apparent decline in personal protection but evidence of a community effect is somewhat contradictory. However, ITN use was high in the study area and despite the moderate levels of pyrethroid resistance, ITNs likely provided some protection, even if primarily as a physical barrier. Furthermore, measures of insecticide resistance are usually based on 24-hour survivorship after exposure to a fixed dose for a fixed time. Recent studies have suggested a delayed effect of insecticide exposure on mosquito mortality which may partially explain the apparent continued effectiveness of ITNs despite high levels of pyrethroid resistance throughout much of sub-Saharan Africa [39]. The presence of a community effect may also partially explain the lack of personal protection as non-users of ITNs receive some protection from malaria transmission, reducing the differences in incidence between users and non-users of ITNs [40].

Phenotypic and molecular evidence have demonstrated that pyrethroid resistance in An. funestus in Malawi is largely driven by oxidase enzymes that contribute to metabolic detoxification of pyrethroids [41, 42]. In settings of moderate intensity of monooxygenase-based resistance, such as Malawi, the WHO recommends the deployment of ITNs with the synergist piperonyl-butoxide (PBO) [43]. PBO inhibits certain mosquito oxidase enzymes, which prevents metabolization of the insecticide. A cluster-randomized trial in setting of high pyrethroid resistance in Tanzania demonstrated that malaria prevalence was significantly lower in clusters that received PBO ITNs compared to pyrethroid-only ITNs up to 21 months post-deployment [44]. Similarly, a mathematical modeling study showed that although new ITNs are highly protective even at higher levels or resistance, their effectiveness may rapidly wane as the net deterioration and declining insecticide content compromises the mass killing effect [45]. The study also found that deployment of PBO ITNs could avert up to 0.5 clinical malaria cases in settings of moderate pyrethroid resistance compared to pyrethroid-only ITNs [45]. Given the oxidase based resistance observed in An. funestus and the substantial impact of PBO ITNs on malaria in Tanzania, PBO ITNs are likely to provide additional benefit in Malawi. However, a recent study in an area of high oxidase-based pyrethroid resistance in Mozambique found complete loss of An. funestus susceptibility following exposure to permethrin or deltamethrin that was only moderately restored after pre-exposure to PBO [46] suggesting that other next-generation ITNs incorporating chlorfenapyr [47] or pyriproxyfen [48] might be needed in settings of high pyrethroid resistance. In Malawi, Centers for Disease Control and Prevention bottle bioassays indicated that An. funestus from two sites are susceptible to chlorfenapyr and that susceptibility to pyrethroids is restored after pre-exposure to PBO (T. Mzilahowa and J. Gimnig, unpublished data). However, bed net efficacy analyses conducted on mosquitoes from southern Malawi in 2014 indicated only partial restoration of susceptibility after exposure to the PBO Olyset® Plus net (24-hour mortality rate of 67%). Thus, additional field studies might be needed to confirm the choice between PBO and next-generation ITNs in Malawi.

This study had several limitations. High ITN use reduced statistical power to detect differences in malaria incidence between ITN users and non-users. Although potential confounders were carefully ascertained and adjusted for in analyses, it is possible that residual and/or unmeasured confounding (due to heterogeneity in insecticide resistance, condition of ITNs, and insecticide content) could have biased the findings of this observational study. While several observational studies have found limited impact of pyrethroid resistance on the effectiveness of ITNs [5,6,7,8,9], studies comparing PBO [44] or dual-treated ITNs [48] to pyrethroid-only ITNs have demonstrated a clear benefit of these nets over pyrethroid-only ITNs in cluster-randomized designs, suggesting that some of the protection, such as through the community effect, may be underestimated in observational studies of the impact of resistance on ITNs. Additionally, the measurement of the physical integrity of ITNs was imperfect since caregiver self-report may be subject to recall and social desirability biases and assessing the presence or absence of holes of varying size does not capture other forms of net deterioration (e.g. many small holes compared to a single large hole) that can lead to increased malaria risk. Also, the insecticide content on the ITNs used by study participants was not measured, which could also provide an explanation for the minimal protection provided by ITNs in the present study. Measurement of insecticide content requires destructive sampling of nets followed by intensive laboratory analysis and results may be variable due to factors such as sun exposure, washing, and net storage. Finally, enrolled participants were significantly more likely to use ITNs compared to non-enrolled participants (84% vs 75%, p < 0.0001), raising the potential for selection bias if study participation was also associated with malaria risk. Because malaria testing was not performed during the second census, the association between study participation and malaria risk could not be evaluated directly.

Despite these limitations, this study provides evidence on the effectiveness of older ITNs in a setting where pyrethroid resistance has become a concern. These results are in line with other observational studies that indicate continued effectiveness of ITNs in areas with high pyrethroid resistance. However, recent cluster-randomized trials of PBO and next-generation ITNs suggest that observational studies may underestimate the impact of pyrethroid resistance. Furthermore, given that pyrethroid resistance in southern Africa is increasing, implementation of PBO or next-generation ITNs may help to maintain or increase the PE of ITNs in Malawi and similar settings, particularly as the physical integrity of ITNs deteriorates over time.

Conclusions

In an area with moderate pyrethroid resistance and high use of older ITNs, the use of ITNs (some of which had holes) did not offer significant protection against incidence of malaria parasitaemia compared to no ITN use. However, among ITN users, ITNs without holes were significantly more protective against malaria compared to ITNs with holes. Additionally, an inverse relationship between number of ITNs in an area and malaria incidence was found, suggesting that high coverage of ITNs offered some community protection. These results suggest that ITNs without holes may continue to confer personal protection and ITNs (some with holes) may provide partial protection via a community effect in settings of moderate pyrethroid resistance. ITNs should remain an integral part of control programmes in malaria-endemic areas with pyrethroid resistance, and the deployment of next-generation ITNs such as PBO ITNs and dual-insecticide nets should be considered in these settings.

Availability of data and materials

The datasets generated and/or analysed during the current study are not publicly available but are available from the corresponding author on reasonable request.

Abbreviations

CI:

confidence interval

GEE:

generalized estimating equations

HRP-2:

histidine-rich protein 2

IDW:

inverse distance-weighted

iPPY:

incidence per person year

IQR:

interquartile range

ITN:

insecticide-treated bed net

Kdr:

knockdown resistance

PBO:

piperonyl-butoxide

PCR:

polymerase chain reaction

PE:

protective efficacy

PYAR:

person-years at risk

RDT:

rapid diagnostic test

RR:

rate ratio

WHO:

World Health Organization

References

  1. Bhatt S, Weiss DJ, Cameron E, Bisanzio D, Mappin B, Dalrymple U, et al. The effect of malaria control on Plasmodium falciparum in Africa between 2000 and 2015. Nature. 2015;526:207–11.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Lengeler C. Insecticide-treated bed nets and curtains for preventing malaria. Cochrane Database Syst Rev. 2004;2:CD000363.

    Google Scholar 

  3. Hawley WA, Phillips-Howard PA, ter Kuile FO, Terlouw DJ, Vulule JM, Ombok M, et al. Community-wide effects of permethrin-treated bed nets on child mortality and malaria morbidity in western Kenya. Am J Trop Med Hyg. 2003;68:121–7.

    Article  PubMed  Google Scholar 

  4. Strode C, Donegan S, Garner P, Enayati AA, Hemingway J. The impact of pyrethroid resistance on the efficacy of insecticide-treated bed nets against African anopheline mosquitoes: systematic review and meta-analysis. PLoS Med. 2014;11:e1001619.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Damien GB, Djenontin A, Rogier C, Corbel V, Bangana SB, Chandre F, et al. Malaria infection and disease in an area with pyrethroid-resistant vectors in southern Benin. Malar J. 2010;9:380.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Henry MC, Assi SB, Rogier C, Dossou-Yovo J, Chandre F, Guillet P, et al. Protective efficacy of lambda-cyhalothrin treated nets in Anopheles gambiae pyrethroid resistance areas of Cote d’Ivoire. Am J Trop Med Hyg. 2005;73:859–64.

    Article  CAS  PubMed  Google Scholar 

  7. Lindblade KA, Mwandama D, Mzilahowa T, Steinhardt L, Gimnig J, Shah M, et al. A cohort study of the effectiveness of insecticide-treated bed nets to prevent malaria in an area of moderate pyrethroid resistance, Malawi. Malar J. 2015;14:31.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  8. Ochomo E, Chahilu M, Cook J, Kinyari T, Bayoh NM, West P, et al. Insecticide-treated nets and protection against insecticide-resistant malaria vectors in Western Kenya. Emerg Infect Dis. 2017;23:758–64.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Kleinschmidt I, Bradley J, Knox TB, Mnzava AP, Kafy HT, Mbogo C, et al. Implications of insecticide resistance for malaria vector control with long-lasting insecticidal nets: a WHO-coordinated, prospective, international, observational cohort study. Lancet Infect Dis. 2018;18:640–9.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Ngufor C, N’Guessan R, Boko P, Odjo A, Vigninou E, Asidi A, et al. Combining indoor residual spraying with chlorfenapyr and long-lasting insecticidal bed nets for improved control of pyrethroid-resistant Anopheles gambiae: an experimental hut trial in Benin. Malar J. 2011;10:343.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. N’Guessan R, Corbel V, Akogbeto M, Rowland M. Reduced efficacy of insecticide-treated nets and indoor residual spraying for malaria control in pyrethroid resistance area, Benin. Emerg Infect Dis. 2007;13:199–206.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Ochomo EO, Bayoh NM, Walker ED, Abongo BO, Ombok MO, Ouma C, et al. The efficacy of long-lasting nets with declining physical integrity may be compromised in areas with high levels of pyrethroid resistance. Malar J. 2013;12:368.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Irish S, N’Guessan R, Boko P, Metonnou C, Odjo A, Akogbeto M, et al. Loss of protection with insecticide-treated nets against pyrethroid-resistant Culex quinquefasciatus mosquitoes once nets become holed: an experimental hut study. Parasit Vectors. 2008;1:17.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Bradley J, Ogouyemi-Hounto A, Cornelie S, Fassinou J, de Tove YSS, Adeothy AA, et al. Insecticide-treated nets provide protection against malaria to children in an area of insecticide resistance in Southern Benin. Malar J. 2017;16:225.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Rehman AM, Coleman M, Schwabe C, Baltazar G, Matias A, Gomes IR, et al. How much does malaria vector control quality matter: the epidemiological impact of holed nets and inadequate indoor residual spraying. PLoS ONE. 2011;6:e19205.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Buchwald AG, Coalson JE, Cohee LM, Walldorf JA, Chimbiya N, Bauleni A, et al. Insecticide-treated net effectiveness at preventing Plasmodium falciparum infection varies by age and season. Malar J. 2017;16:32.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Mathanga DP, Mwandama DA, Bauleni A, Chisaka J, Shah MP, Landman KZ, et al. The effectiveness of long-lasting, insecticide-treated nets in a setting of pyrethroid resistance: a case-control study among febrile children 6 to 59 months of age in Machinga District, Malawi. Malar J. 2015;14:457.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  18. Abdulla S, Schellenberg JR, Mukasa O, Lengeler C. Usefulness of a dispensary-based case-control study for assessing morbidity impact of a treated net programme. Int J Epidemiol. 2002;31:175–80.

    Article  CAS  PubMed  Google Scholar 

  19. National Malaria Control Programme. Malawi National malaria indicator survey 2010. Lilongwe: Ministry of Health; 2010.

    Google Scholar 

  20. I National Malaria Control Programme. Malawi malaria indicator survey 2014. Lilongwe and Rockville: NMCP and ICF International; 2014. p. 2014.

    Google Scholar 

  21. Rochon J. Application of GEE procedures for sample size calculations in repeated measures experiments. Stat Med. 1998;17:1643–58.

    Article  CAS  PubMed  Google Scholar 

  22. WHO. Guidelines for monitoring the durability of long-lasting insecticidal mosquito nets under operational conditions. Geneva: World Health Organization; 2011.

    Google Scholar 

  23. Wong J, Shah MP, Mwandama D, Gimnig JE, Lindblade KA, Mathanga DP. Home visits to assess the reliability of caregiver-reported use of insecticide-treated bednets by children in Machinga District, Malawi. Am J Trop Med Hyg. 2015;92:825–7.

    Article  PubMed  PubMed Central  Google Scholar 

  24. World Health Organization Multicentre Growth Reference Study. WHO Child Growth Standards based on length/height, weight and age. Acta Paediatr Suppl. 2006;450:76–85.

    Google Scholar 

  25. Filmer D, Pritchett LH. Estimating wealth effects without expenditure data—or tears: an application to educational enrollments in states of India. Demography. 2001;38:115–32.

    CAS  PubMed  Google Scholar 

  26. Ezzet F, van Vugt M, Nosten F, Looareesuwan S, White NJ. Pharmacokinetics and pharmacodynamics of lumefantrine (benflumetol) in acute falciparum malaria. Antimicrob Agents Chemother. 2000;44:697–704.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Grandesso F, Nabasumba C, Nyehangane D, Page AL, Bastard M, De Smet M, et al. Performance and time to become negative after treatment of three malaria rapid diagnostic tests in low and high malaria transmission settings. Malar J. 2016;15:496.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Marquart L, Butterworth A, McCarthy JS, Gatton ML. Modelling the dynamics of Plasmodium falciparum histidine-rich protein 2 in human malaria to better understand malaria rapid diagnostic test performance. Malar J. 2012;11:74.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Zeger SL, Liang KY. Longitudinal data analysis for discrete and continuous outcomes. Biometrics. 1986;42:121–30.

    Article  CAS  PubMed  Google Scholar 

  30. Hubbard AE, Ahern J, Fleischer NL, Van der Laan M, Lippman SA, Jewell N, et al. To GEE or not to GEE: comparing population average and mixed models for estimating the associations between neighborhood risk factors and health. Epidemiology. 2010;21:467–74.

    Article  PubMed  Google Scholar 

  31. Belsley DA. Conditioning diagnostics: collinearity and weak data in regression. New York: J. Wiley; 1991.

    Google Scholar 

  32. Kleinbaum DG. Epidemiologic methods: the “art” in the state of the art. J Clin Epidemiol. 2002;55:1196–200.

    Article  PubMed  Google Scholar 

  33. Kleinbaum DG, Klein M, Pryor ER. Logistic regression: a self-learning text. 3rd ed. New York: Springer; 2010.

    Book  Google Scholar 

  34. Vanden Eng JL, Chan A, Abilio AP, Wolkon A, de Ponce Leon G, Gimnig J, et al. Bed net durability assessments: exploring a composite measure of net damage. PLoS One. 2015;10:e0128499.

    Article  CAS  Google Scholar 

  35. Vanden Eng JL, Mathanga DP, Landman K, Mwandama D, Minta AA, Shah M, et al. Assessing bed net damage: comparisons of three measurement methods for estimating the size, shape, and distribution of holes on bed nets. Malar J. 2017;16:405.

    Article  Google Scholar 

  36. Mejia P, Teklehaimanot HD, Tesfaye Y, Teklehaimanot A. Physical condition of Olyset(R) nets after five years of utilization in rural western Kenya. Malar J. 2013;12:158.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Minta AA, Landman KZ, Mwandama DA, Shah MP, vanden Eng JL, Sutcliffe JF, et al. The effect of holes in long-lasting insecticidal nets on malaria in Malawi: results from a case-control study. Malar J. 2017;16:394.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Obala AA, Mangeni JN, Platt A, Aswa D, Abel L, Namae J, et al. What is threatening the effectiveness of insecticide-treated bednets? A case-control study of environmental, behavioral, and physical factors associated with prevention failure. PLoS ONE. 2015;10:e0132778.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  39. Viana M, Hughes A, Matthiopoulos J, Ranson H, Ferguson HM. Delayed mortality effects cut the malaria transmission potential of insecticide-resistant mosquitoes. Proc Natl Acad Sci USA. 2016;113:8975–80.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Howard SC, Omumbo J, Nevill C, Some ES, Donnelly CA, Snow RW. Evidence for a mass community effect of insecticide-treated bednets on the incidence of malaria on the Kenyan coast. Trans R Soc Trop Med Hyg. 2000;94:357–60.

    Article  CAS  PubMed  Google Scholar 

  41. Mzilahowa T, Chiumia M, Mbewe RB, Uzalili VT, Luka-Banda M, Kutengule A, et al. Increasing insecticide resistance in Anopheles funestus and Anopheles arabiensis in Malawi, 2011–2015. Malar J. 2016;15:563.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Riveron JM, Irving H, Ndula M, Barnes KG, Ibrahim SS, Paine MJ, et al. Directionally selected cytochrome P450 alleles are driving the spread of pyrethroid resistance in the major malaria vector Anopheles funestus. Proc Natl Acad Sci USA. 2013;110:252–7.

    Article  CAS  PubMed  Google Scholar 

  43. WHO. Conditions for deployment of mosquito nets treated with pyrethroid and piperonyl butoxide. Geneva: World Health Organization; 2017.

    Google Scholar 

  44. Protopopoff N, Mosha JF, Lukole E, Charlwood JD, Wright A, Mwalimu CD, et al. Effectiveness of a long-lasting piperonyl butoxide-treated insecticidal net and indoor residual spray interventions, separately and together, against malaria transmitted by pyrethroid-resistant mosquitoes: a cluster, randomised controlled, two-by-two factorial design trial. Lancet. 2018;391:1577–88.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. Churcher TS, Lissenden N, Griffin JT, Worrall E, Ranson H. The impact of pyrethroid resistance on the efficacy and effectiveness of bednets for malaria control in Africa. Elife. 2016;5:e16090.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  46. Riveron JM, Huijben S, Tchapga W, Tchouakui M, Wondji MM, Tchoupo M, et al. Escalation of pyrethroid resistance in the malaria vector Anopheles funestus induces a loss of efficacy of PBO-based insecticide-treated nets in Mozambique. J Infect Dis. 2019 (in press).

  47. N’Guessan R, Odjo A, Ngufor C, Malone D, Rowland M. A chlorfenapyr mixture net interceptor® G2 shows high efficacy and wash durability against resistant mosquitoes in West Africa. PLoS ONE. 2016;11:e0165925.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  48. Tiono AB, Ouedraogo A, Ouattara D, Bougouma EC, Coulibaly S, Diarra A, et al. Efficacy of Olyset Duo, a bednet containing pyriproxyfen and permethrin, versus a permethrin-only net against clinical malaria in an area with highly pyrethroid-resistant vectors in rural Burkina Faso: a cluster-randomised controlled trial. Lancet. 2018;392:569–80.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors are grateful to the Machinga District Hospital management team, traditional chiefs, study staff, and study participants and their caregivers for their cooperation and support for this study. The authors also thank Adam Wolkon for his advice and consultation on data collection and management activities.

Disclaimer

The opinions expressed in this manuscript are those of the authors and do not necessarily represent the views of the U.S. Centers for Disease Control and Prevention.

Funding

The study was made possible with funding from the US President’s Malaria Initiative and CDC through Cooperative Agreement No. 3U01CK000135 between the CDC and the University of Malawi, College of Medicine.

Author information

Authors and Affiliations

Authors

Contributions

KAL, JEG and DPM conceived of the study. KAL, DM, TM, LCS, JEG, MPS, AB, JW, RW, JZ, JC, and DPM participated in its design and coordination. MPS, LCS, JEG, and KAL drafted the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Monica P. Shah.

Ethics declarations

Ethics approval and consent to participate

Parents or caregivers were asked to provide verbal consent for their child to be screened for eligibility and written informed consent for eligible children to participate. The protocol was reviewed and approved by the Malawi College of Medicine Research Ethics Committee (Blantyre, Malawi) and by the U.S. Centers for Disease Control and Prevention institutional Review Board (Atlanta, GA, USA).

Consent for publication

Not applicable.

Competing interests

The authors declare they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shah, M.P., Steinhardt, L.C., Mwandama, D. et al. The effectiveness of older insecticide-treated bed nets (ITNs) to prevent malaria infection in an area of moderate pyrethroid resistance: results from a cohort study in Malawi. Malar J 19, 24 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s12936-020-3106-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12936-020-3106-2

Keywords