Skip to main content

Analysis of malaria surveillance data in Ethiopia: what can be learned from the Integrated Disease Surveillance and Response System?

Abstract

Background

Routine malaria surveillance data is useful for assessing incidence and trends over time, and in stratification for targeting of malaria control. The reporting completeness and potential bias of such data needs assessment.

Methods

Data on 17 malaria indicators were extracted from the Integrated Disease Surveillance and Response System database for July 2004 to June 2009 (Ethiopian calendar reporting years 1997 to 2001). Reporting units were standardized over time with 2007 census populations. The data were analysed to show reporting completeness, variation in risk by reporting unit, and incidence trends for malaria indicators.

Results

Reporting completeness, estimated as product of unit-month and health facility reporting, was over 80% until 2009, when it fell to 56% during a period of reorganization in the Ministry of Health. Nationally the average estimated annual incidence of reported total malaria for the calendar years 2005 to 2008 was 23.4 per 1000 persons, and of confirmed malaria was 7.6 per 1,000, with no clear decline in out-patient cases over the time period. Reported malaria in-patient admissions and deaths (averaging 6.4 per 10,000 and 2.3 per 100,000 per year respectively) declined threefold between 2005 and 2009, as did admissions and deaths reported as malaria with severe anaemia. Only 8 of 86 reporting units had average annual estimated incidence of confirmed malaria above 20 per 1,000 persons, while 26 units were consistently below five reported cases per 1,000 persons per year.

Conclusion

The Integrated Disease Surveillance and Response System functioned well over the time period mid 2004 to the end of 2008. The data suggest that the scale up of interventions has had considerable impact on malaria in-patient cases and mortality, as reported from health centres and hospitals. These trends must be regarded as relative (over space and time) rather than absolute. The data can be used to stratify areas for improved targeting of control efforts to steadily reduce incidence. They also provide a baseline of incidence estimates against which to gauge future progress towards elimination. Inclusion of climate information over this time period and extension of the dataset to more years is needed to clarify the impact of control measures compared to natural cycles on malaria.

Background

Malaria prevention and control interventions have recently undergone major scale-up in Africa, and malaria disease burden is reported to be declining in several countries [1], including Ethiopia and other East African countries [2–5]. However, there is complexity within countries, including large geographical variation in incidence and differing upward or downward trends between indicators, hospitals or areas [2, 6, 7]. Repeated representative nationwide malaria prevalence surveys are now becoming the norm, and there is a welcome emphasis on improving estimates of the impact of control measures on malaria mortality [8]. However, comprehensive longitudinal data sources measuring several malaria indicators monthly or weekly at multiple sites are relatively few, and more are needed [9, 10].

While most countries have routine morbidity and mortality reporting systems, distrust of their quality for malaria surveillance is widespread [11, 12] and may sometimes be justified. However, there are many examples of carefully assessed routine malaria surveillance data making essential contributions to understanding the malaria burden, how it varies over space and time, and the impact of control measures and climate on malaria [5, 13–20]. A more frequent problem is the collection of large amounts of data that are never collated or used, with consequent degrading of reporting as health workers receive no feedback for their surveillance effort. There is little alternative to routine surveillance for understanding inter-annual and seasonal trends over sub-national areas, and since there are often multiple sources, triangulation between them can assess which ones are providing high quality data as well as lend reassurance that observed trends are real.

Recognition of the importance of improvement of quality of routine surveillance for infectious diseases [21] led to major input by WHO and CDC into strengthening and streamlining of this effort through the Integrated Disease Surveillance and Response (IDSR) system [22] starting in the 1990s. The IDSR matrix included originally 19 diseases (pandemic influenza being later added) in three categories: 1) major endemic diseases of public health importance; 2) diseases targeted for eradication and elimination; and 3) epidemic prone diseases. Malaria comes under the first category in many countries but may be in the third category in less endemic countries like Ethiopia and Eritrea.

Some important features of IDSR and its training materials were the use of standard case definitions, the establishment of action thresholds for epidemics, the use of information in response, provision of feedback, and continuous evaluation [22]. Evaluations of IDSR systems have occurred [21, 23], but there has been no detailed use and evaluation of IDSR for monitoring trends in malaria in Ethiopia.

The total estimated population of Ethiopia in 2007 was 73,918,505 [24]. Administrative levels of Ethiopia consist of regional states usually divided into zones, which have populations (in 2007) averaging 785,000 and ranging from 35,000 to 2,970,000. There are some ‘special districts’, administratively equivalent to zones. The next levels are woredas (districts) with populations averaging 140,000 and ranging from 8,000 to 340,000, followed by kebeles (the lowest government administrative unit, divided into villages or ‘development teams’). Kebeles have at least 900 families or about 4,500 to 5,000 persons. The number of hospitals per region varies, with at least one in each region. Zones may or may not have a hospital, but have at least one health centre. Each woreda (district) usually has one or more health centres and a number of health posts or stations in more rural areas. Starting in 2005, the health station category was phased out and each kebele is now intended to have at least one health post staffed by two Health Extension Workers, reporting to the cluster health centre. The national health management information system has recently undergone major reorganization. Each health facility reports quarterly on morbidity, mortality, and health resource and preventive indicators through that system.

Ethiopia implemented Integrated Disease Surveillance (IDSR) reporting from all hospitals and health centres using a one page form (see Additional file 1). Most diseases were reported on the monthly form, but certain high priority indicators were to be reported immediately. Health stations and health posts were not formally included in the initial phase. While IDSR data exist on paper at the district level, they were available in electronic form at zone and Regional Health Bureau level in an EpiInfo database entered in Addis Ababa, formerly under the Disease Prevention and Control Department, but now at the Public Health Emergency Management (PHEM) center at Ethiopian Health and Nutrition Research Institute.

This paper presents and assesses national surveillance malaria data from the IDSR system at the zone (reporting unit) level in Ethiopia over a five-year period July 2004-June 2009. The goals are 1) to investigate the completeness of reporting for malaria indicators in the IDSR system, 2) to stratify malaria risk by area of the country (zone); 3) to contribute to the information on whether and how the malaria burden in the country is changing over the time period, which coincided with the time of major scale up of malaria control efforts in the country. After this time period (in 2009), the reporting format changed, health posts were included in reporting, and the time interval for reporting changed to weekly during major Ministry of Health reorganization.

Methods

Malaria indicators in IDSR

The IDSR reporting form (see Additional file 1) includes 17 malaria items encompassing total malaria cases (clinical and confirmed) for out-patients, in-patients and deaths; confirmed out-patient malaria cases by species; in-patient cases and deaths for malaria with severe anaemia; and out-patients, in-patients and deaths for malaria in pregnancy. All are given by age group <5 years and > = 5 years except malaria in pregnancy indicators which only apply to women of childbearing age.

The Epi Info (Windows) IDSR database was imported into Access 2003 and expanded to include all eligible zone-months. Several variables were renamed for clarity and some summary malaria indicators were created in Access 2007, such as combining different age groups and estimating total confirmed malaria by summing cases of both species (see Additional file 2).

Incidence estimates for summary malaria indicators by year and month were obtained by summing the appropriate indicator over the time period in question using the relevant population denominator for each reporting unit (see Additional file 3).

Reporting time periods sites, units and population denominators

The Ethiopian Calendar (EC) is used in the country, rather than the Gregorian (Western) calendar (GC). There are 13 months in the EC, 12 of 30 days and a short remaining month. The EC year runs from the equivalent of GC September to August, with a 7 to 8 year lag period behind the GC, whereas the reporting year for the Ministry of Health is GC July to June. The time period of this report is July 2004 to June 2009, which with the lag period is equivalent to EC reporting years 1997 to 2001.

In 2004 (EC 1997), there were 87 original IDS reporting units entered in the database at national level. Reporting units are mostly zones, but also include special woredas (districts), sub-cities, towns and referral hospitals that report separately. For convenience, these are referred to as ‘reporting units’ or just ‘units’ rather than zones. The number of reporting units had gradually increased to 108 by 2008–2009 (EC 2001) by the splitting of zones and the addition of referral hospitals and towns, and the strategy to adjust for this change is described below. In July 2007, five referral hospitals in Addis Ababa were added, five zone splits occurred, and 10 towns were split from their local zones and added as separate reporting units. One more referral hospital in Addis was added in July 2008. One zone in Somali region started reporting in July 2005 (one year late). Zones in Somali region that stopped reporting (9 in number) after June or December 2007 have been excluded from the count of ‘eligible months’ (reporting denominator) for the appropriate periods.

Reporting completeness was assessed based on the information available in the 108 units, after allocating eligible reporting time periods to each unit. Each monthly report showed a number of sites ‘expected to report’ which was taken as the number of eligible sites, totaled over each reporting unit.

For assessing malaria incidence, the 108 units reported by 2009 were collapsed into the original 87 units of 2004 to ensure consistent population denominators, estimated from the 2007 census. One of the original 87 units (Gambella Special Woreda) did not have a separately reported population so was combined with its surrounding area, giving 86 units. Recently added referral hospitals and newly demarcated towns were assigned to their original local zone for malaria incidence estimates. Split zones were reunited to their original zone as in 2004 (EC 1997) (see Additional file 3).

Most data were obtained in digital form from the database in the Public Health Emergency Management (PHEM) center, Addis Ababa; missing month reports from Amhara region that had never been submitted or entered were obtained by visiting the Regional Health Bureau in Bahir Dar in early 2010.

Data quality

Factors affecting quality of IDSR data for reflecting disease trends include accuracy of the diagnosis according to the case definitions, accuracy of data recording and entry, completion and correct summary of the monthly forms at all levels, submission of the forms to next higher level, timeliness of reporting, and consistency in reporting over time.

While case definitions for the reporting form were clear and had been the subject of training, diagnosis is done by hundreds of staff members at the health centers and hospitals and its accuracy therefore cannot be assessed here. If accuracy of diagnosis remains relatively constant over time, it should not introduce bias. Occasional outliers or missing items within a unit-month due to either reporting or data entry errors (unresolvable at this time) were observed. Clear outliers or inconsistencies such as the number of confirmed cases of a disease being greater than the total number of cases, or cases of one species exceeding the total number of cases of both species were re-coded to ‘missing’. If reports existed but were not submitted from woreda to zone level, or received but never entered, this was reflected in the database as a completely missing unit-month report.

Data timeliness, completeness and consistency

While timeliness of reports is vital for detecting and responding to epidemics, it is not evaluated here since the focus is on completeness of reporting to observe relative incidence between zones as well as trends over a five-year period. The numbers of sites (health facilities) reporting on time and those reporting late were therefore combined to arrive at an overall proportion of sites reporting for each unit-month.

The first focus of this evaluation is reporting completeness and consistency based on the expected number of eligible sites, reporting units and months. Increase in number of both eligible sites and reporting units (due to reconfiguration of boundaries) affected reporting consistency. One would expect a slow increase in the number of eligible sites as new health centres and hospitals were built (and this was observed in increase in number of eligible sites), but since the population served remains relatively constant, this increase in sites would not necessarily bias the disease trend unless access to care increased greatly. Boundary reconfiguration was addressed in the compilation of the incidence data by re-combining newly defined areas (e.g. split zones or separate reporting from towns) with their previous reporting units for assessing disease trends, depending on availability of population denominators. Thus 108 reporting units were compressed into 86. Change in reporting completeness over time is the factor most likely to bias disease trends.

Since the database initially did not contain any zone-months lacking reports, a full list of eligible months for each year and reporting unit was first generated. The completeness of reporting was calculated as the product of the following two proportions:

  1. 1)

    percentage of unit-month reports: For each zone (reporting unit), the number of months with any report divided by the eligible months.

  2. 2)

    percentage of site reports: For each unit-month: the proportion of reports from eligible sites (health centres or hospitals) that were received at the reporting unit level and included in their reports.

Results

Reporting completeness

Reporting was assessed after adjustment for the time each unit was supposed to be reporting (‘eligible months’). Details of the reporting units and eligible months are given in Additional files (see Additional files 4 and 5). Overall there were 5,508 unit-months eligible for reports.

The number of units actually reporting each month is shown in Figure 1. An increase in July 2007 occurred, when many new reporting units were added. There was a progressive drop off in reporting starting in January 2009 during Ministry of Health reorganization and planning for conversion to a weekly system.

Figure 1
figure 1

Number of zone units reporting by month, Ethiopia, July 2004 to Jun 2009.

Within each reporting unit, there was a variable number of reporting sites (health centres and hospitals) ranging from 1 to 51. The total number of eligible sites per month increased from 818 in January 2005 to 1258 in December 2008 as new facilities were built; it averaged 844 per month over the five year period. The reported number of eligible sites fluctuated unexpectedly in some zones, suggesting that the denominator of reporting sites was not always reported correctly. However, both the number of eligible sites and the number of sites reporting increased overall with similar time trends, and the proportion of sites reporting was equal to or less than the number of eligible sites in all but one case.

Overall the proportion of eligible unit-months for which reports were received was 92.8%. There were 392 missing month reports (7.1%) out of a potential 5,508. The percent of sites reporting was 88.0% in available unit-month reports (44,607 sites stated to have reported out of 50,667 eligible). Multiplying unit-month and site reporting percentages gave an overall estimate of 81.7% reporting completeness (Table 1).

Table 1 Reporting completeness for zones (unit-months), sites and overall by region

By region, reporting completeness ranged from 50.3% in Somali region to 90.8% in Dire Dawa (Table 1). By reporting unit, reporting completeness varied from 34.3% in Korahe zone in Somali region to 100% for two referral hospitals in Addis Ababa (see Additional file 5).

The percent of months for which there were reports dropped from 98.4% in 2004–2005 to 78.3% in 2008–2009, mainly due to the drop off in early 2009 (Table 2). Until Jan 2009, over 90% of units were reporting each month. The percent of sites reporting within units did not decline over time, ranging from a low of 86.3% in Jan to Jun 2005 to 89.8% in Jan to Jun 2009 (Table 2), suggesting that where the system was still in operation sites were still reporting, but unit months were not being compiled or forwarded. Overall reporting rate (unit-months multiplied by sites) was over 80% for each six month period up to the end of 2008.

Table 2 Reporting completeness for zones (reporting units), sites and overall by six-month period

Examining reporting rates by region over time shows some important differences between them (Table 3). Most regions show the drop off in submitting monthly reports in early 2009, but it was more severe in some regions (Amhara and Harari for example) than others (Oromia and SNNPR), and the decline started earlier in 2008 in some cases (Afar, Benishangul Gumuz and Gambella). There were also low reporting rates in Amhara and Gambella in late 2007.

Table 3 Reporting completeness by region and six month period

National level malaria indicators

Table 4 shows the summary national level malaria indicators by six month period. Incidence is by six month period and per 1000 persons for out-patient indicators, per 10,000 for in-patients and per 100,000 for mortality. Taking into account the drop off in reporting in early 2009, the malaria cases data for Jan- June 2009 are not regarded as being representative or valid. Therefore, malaria indicators by month are reported only up to the end of 2008 in the figures below, including Figure 2 (Total Out-patient Cases) and Figure 3 (Confirmed Cases). Annual incidence is reported by calendar year (GC) for 2005 to 2008 in Table 5.

Table 4 Reported national incidence for malaria indicators from IDSR surveillance data, by six month intervals
Figure 2
figure 2

Reported Total Malaria Out-patient Cases at Health Centres and Hospitals, Ethiopia, July 2004 to December 2008.

Figure 3
figure 3

Reported Confirmed Malaria Out-patient Cases at Health Centres and Hospitals, Ethiopia, July 2004 to December 2008. P. falciparum, P. vivax.

Table 5 Reported national annual incidence for malaria indicators from IDSR surveillance data, GC calendar year

Nationally the average estimated annual incidence of reported total malaria in the overall population was 23.4 per 1000 persons and of confirmed malaria was 7.6 per 1,000 per year over the four calendar years 2005 to 2008 (Table 5). Thus total cases were about three times higher than confirmed cases. Reported malaria in-patient admissions and deaths averaged 6.4/10,000 and 2.3 per 100,000 per year respectively. Reported malaria in-patient admissions and deaths, including deaths from malaria with severe anaemia, declined two- to threefold during this period (Table 5, Figures 4, 5 and 6). However, there was no clear declining trend in the number of malaria out-patients, either total malaria or confirmed malaria (Figures 2 and 3) over this time period. There did appear to be increasing relative numbers of Plasmodium vivax among confirmed malaria cases (Figure 7).

Figure 4
figure 4

Reported Malaria In-patients at Health Centres and Hospitals, Ethiopia, July 2004 to December 2008.

Figure 5
figure 5

Reported Malaria In-patient Deaths at Health Centres and Hospitals, Ethiopia, July 2004 to December 2008. Open bars = Malaria deaths; Filled bars = Malaria in pregnancy deaths.

Figure 6
figure 6

Reported Malaria with Severe Anaemia In-patients and Deaths at Health Centres and Hospitals, Ethiopia, July 2004 to December 2008. Open bars = in-patients with malaria and severe anaemia; Filled bars = deaths with malaria and severe anaemia.

Figure 7
figure 7

Reported Confirmed Malaria Out-patient Cases by Species at Health Centres and Hospitals, Ethiopia, July 2004 to December 2008. Open bars = P. falciparum; Filled bars = P. vivax.

Relatively few malaria deaths are reported, so the number of in-patients is a more robust and precise indicator of severe cases than mortality. As a further indicator of severe malaria and mortality potentially caused by malaria, the IDSR system also reported the number of in-patients and deaths with malaria and severe anaemia, which also demonstrated declining trends particularly in the first two years studied (Table 5 and Figure 5). Few malaria in pregnancy cases, admissions or deaths were reported making these less useful indicators than total and confirmed malaria out-patient cases and admissions.

Zone (reporting unit) level malaria indicators

To contribute to geographical stratification of malaria risk in Ethiopia, estimates were also derived for annual incidence per 1000 persons by reporting unit, for both total malaria and confirmed malaria out-patient cases. The average annual incidence over the five year period is shown, stratified by five levels, in Figures 8 and 9, with data by reporting unit given in Additional files (see Additional files 6 and 7). Note that Somali region zone data are missing for 2007–2008 and 2008–2009, so the average incidence is estimated based on the earlier three years for these zones. Also, the under-reporting in many zones in late 2009 biases the annual incidence estimates for 2008–2009 downwards.

Figure 8
figure 8

Average annual incidence of total reported malaria out-patients per 1000 population, by reporting unit, Ethiopia, July 2004 to June 2009.

Figure 9
figure 9

Average annual incidence of reported confirmed malaria cases per 1000 population, by reporting unit, Ethiopia, July 2004 to June 2009.

Due to variation in size of zone populations, the highest expected annual number of cases is not necessarily in zones with the highest incidence. Therefore, in addition to incidence, maps are presented showing the estimate of actual number of cases reported annually. Figure 10 shows estimated total malaria cases, and Figure 11 confirmed cases.

Figure 10
figure 10

Average annual number of total reported malaria out-patients by reporting unit, Ethiopia, July 2004 to June 2009.

Figure 11
figure 11

Average annual number of reported confirmed malaria cases by reporting unit, Ethiopia, July 2004 to June 2009.

By reporting unit, the annual incidence of reported total malaria (clinical plus confirmed - Figure 8) in out-patients ranged from an average of 0.3 cases per 1,000 per year in Addis Ababa - Bole subcity to 535.2 per 1000 per year in Benishangul Gumuz – Pawe special woreda [see Additional file 6]. Average reported confirmed malaria incidence per 1000 per year (Figure 9) ranged from 0.2/1000 per year in Addis Ababa –Bole subcity to 73.2/1000/year in SNNPR – Alaba special woreda [see Additional file 7].

The reporting units predicted to have the highest number of malaria out-patient cases (>50,000) in an ‘average’ year are zones 4 and 5 in Afar region; North Wello, Oromia and Waghimra zones in Amhara region; Pawe special woreda in Benishangul Gumuz region; and Arsi zone (combined Arsi and West Arsi) in Oromia region (Figure 10; [see Additional file 6]). The units predicted to have the highest number (>15,000) of confirmed malaria cases in an ‘average’ year were all in SNNPR region: Alaba, Gamo Gofa, Guraghe, Kembata-Tembaro, Sidama, and Wolayta (Figure 11 [see Additional file 7]).

Discussion

This study carefully examined the completeness of reporting of malaria indicators for the IDSR system in Ethiopia between 2004 and 2009, and concluded that at over 80% it was of sufficient quality to provide estimates of malaria incidence by reporting unit (usually zone) and month until the end of 2008. The results suggest marked decline in numbers of malaria and malaria-related in-patients and deaths over the period, perhaps as a result of scale up of interventions in 2007, although little drop in out-patient case numbers was observed.

It must be remembered that the IDSR system in 2004–2009 expected reports from health centers and hospitals only. During the last few years, there has been a large expansion in the number of health posts in the country [25], which diagnose and treat an increasing proportion of out-patient malaria cases. This could bias the number of out-patient cases seen at higher-level facilities downwards, although this factor may be counteracted if health post cases are reported through their supervisory health centre. However, health posts do not accept in-patients. It is possible that expansion of access to diagnosis and treatment through Health Extension Workers contributed to earlier and more effective care-seeking and effective treatment, with consequent reduced incidence of severe malaria cases and mortality at health centers and hospitals. Since 2004, reports of outbreaks or epidemics due to malaria in the study zones of the country have also been very low.

A limitation of the data set was that it was not possible to independently verify the accuracy of the reported number of eligible sites in each reporting unit, and under-reporting of the number of such sites would overestimate the completeness of eligible site reporting. However, examination of time trends did not indicate any significant changes over time that would bias the results.

Incidence of total malaria out-patients (clinical and confirmed malaria) in the overall population averaged 23.4 per 1,000 persons per year over 2005 to 2008, and was about three fold higher than incidence of confirmed malaria at 7.6 per 1,000 per year. Both indicators should be taken into account in stratification of risk between zones (reporting units), since the true incidence probably lies between the two. Differences in ranking of units by the level of risk observed and by predicted absolute number of total and confirmed malaria cases (Figures 8, 9, 10, and 11) emphasize the need to consider more than one malaria indicator (including in-patient admissions) in stratification schemes and prediction of needs for prevention interventions and drugs. It would also help to assess effectiveness of malaria control if intervention planning was conducted in the same geographical units as the incidence estimates.

A separate source of malaria incidence estimates over the period of this study is the Health Management Information System (HMIS), Federal Democratic Republic of Ethiopia, in which the estimated annual incidence of reported malaria for the whole country was 107 per 1,000 in 2004 and 55 per 1,000 in 2009. Severe malaria cases reported through the HMIS declined from 148 per 100,000 in 2004 to 54 per 100,000 in 2009. Thus a steeper decline in severe cases than out-patient cases was also observed in the national statistics reported through a different system, although incidences of overall reported cases and of severe cases were higher in the national HMIS data than in the IDSR reports. This is expected given that IDSR data compiled here are only from health centres and hospitals rather than all health facilities, and thus do not capture the cases treated at the large network of health posts and also private facilities. The importance of the dataset here is to show trends and comparisons between zones/reporting units over time and to stratify by reporting unit.

The IDSR dataset is a rich source of information for stratification of malaria risk by zone in Ethiopia, using reported empirical data rather than climate predictions. It is known that not all of Ethiopia is at malaria risk since some areas are too high and others too dry for transmission [26]. However, it was not possible to adjust the incidence estimates for reporting units by a standard factor of population at malaria risk because the proportion of each zone or reporting unit at risk was highly variable. The overall incidence by reporting unit is affected both by the proportion of zone at risk and the intensity of transmission in the area at risk. Incidence defined by sub-zonal units such as woredas would be highly valuable in future.

While the pattern of incidence stratification shown by these empirical data fits reasonably well with maps predicted from climate data [27–29], reviewed in [30], the data suggest that some areas of the country such as Afar and Beneshangul Gumuz regions have higher incidence than generally realized and deserve increased control programme attention. In arid regions where incidence is higher than expected, irrigation projects may be influencing malaria transmission.

It is also important to note that patients do not always seek treatment in their zone of residence. In most zones, boundary crossing may occur in both directions and hence is unlikely to introduce systematic bias, but it may inflate estimates in urban areas. For example, those living in the surrounding areas of towns like Harar or Dire Dawa may cross the reporting unit boundary and inflate the incidence estimates in such towns. While this may overestimate the risk of malaria within the town, it is nevertheless a useful estimate of need for services in those places. Without detailed studies of patients’ residence, this must be accepted as a limitation of the data.

Prediction of the absolute numbers of cases expected, generated here by reporting unit from the IDSR data, confirms the important contribution of highly populated zones such as those in Eastern Amhara Regional State and the rift valley of Oromia and SNNPR to the large numbers of cases reported in Ethiopia annually [26]. These large regions and zones tend to be the ones already given the most attention by the malaria control programme, but the current study may assist in refining the programme’s efforts. Obviously it would be ideal to generate risk maps by woreda rather than zone, but even at zone level clear seasonal and inter-annual patterns are apparent and can be used to establish thresholds for defining future epidemics. In general, both absolute case numbers and the use of incidence when comparing between zones and regions will improve the ability of Regional Health Bureaus and the FMOH to plan resources appropriately, improve targeting of malaria control efforts, and allow better evaluation of the programme.

Since these data were reported, a new weekly system has been instituted, in which the malaria indicators have been condensed and reconciled with HMIS indicators to reduce workload for health staff in filling multiple forms. All health facilities down to health posts are now required to report. The number of persons tested for malaria confirmation (by slide or rapid test) has been included as well as total malaria and confirmed malaria cases to provide a denominator for test positivity rate. The change to the new system occurred during extensive business process restructuring in the Ministry of Health and was not implemented across all the states at once.

It remains to be seen whether these low rates in many zones and for the country overall remained at such levels in 2010 and 2011. Inclusion of climate information over this time period [31] and extension of the dataset to more years is needed to clarify the role of control measures compared to natural cycles. It is possible that the declines seen merely represent the down side of an epidemic cycle, but it may be real and sustainable, due to improved health system delivery, better malaria prevention (LLIN and IRS) and use of effective drugs. Given that Ethiopia is considering malaria elimination [32], it is useful to note that between 2004 and 2009, only 8 reporting units had average annual estimated incidence of confirmed malaria (reported to IDSR) above 20 per 1,000 persons, while 26 units (excluding Somali region) were consistently below five reported cases per 1,000 persons per year. Elimination at least from selected zones thus appears a possibility while attention is given to reducing incidence further in the other zones.

Conclusion

The Integrated Disease Surveillance and Response System functioned well over the time period mid 2004 to the end of 2008. The data suggest that the scale up of interventions has had considerable impact on malaria in-patient cases and mortality, as reported from health centres and hospitals. These trends must be regarded as relative (over space and time) rather than absolute, since reports were received from health centres and hospitals only and cover a period of expansion in access to care as well as variation in diagnostic capacity and/or reporting accuracy over time. The data can be used to stratify areas for improved targeting of control efforts to steadily reduce incidence. Geographical units (zones or similar defined areas) reported incidence of confirmed malaria ranging from 0.2/1,000 per year to 73.2 cases per 1,000 per year, with 26 of 86 units averaging less than five confirmed cases per 1,000 persons per year. The incidence estimates for all malaria indicators also provide a baseline against which to gauge future progress towards elimination. Alignment of control planning and reporting with disease reporting units would facilitate assessment of control effectiveness. Inclusion of climate information over this time period and extension of the dataset to more years is needed to clarify the impact of control measures compared to natural cycles on the observed changes.

Abbreviations

CDC:

Centers for disease control and prevention

EC:

Ethiopian calendar

FMOH:

Federal Ministry of Health

GC:

Gregorian calendar

HMIS:

Health Management Information System

IDSR:

Integrated disease surveillance and response

IRS:

Indoor residual spraying

LLIN:

Long-lasting insecticidal net

PHEM:

Public Health Emergency Management

SNNPR:

Southern Nations Nationalities and Peoples’ Region

WHO:

World Health Organization.

References

  1. O'Meara WP, Mangeni JN, Steketee R, Greenwood B: Changes in the burden of malaria in sub-Saharan Africa. Lancet Infect Dis. 2010, 10: 545-555. 10.1016/S1473-3099(10)70096-7.

    Article  PubMed  Google Scholar 

  2. Okiro EA, Hay SI, Gikandi PW, Sharif SK, Noor AM, Peshu N, Marsh K, Snow RW: The decline in paediatric malaria admissions on the coast of Kenya. Malar J. 2007, 6: 151-10.1186/1475-2875-6-151.

    Article  PubMed Central  PubMed  Google Scholar 

  3. O'Meara WP, Bejon P, Mwangi TW, Okiro EA, Peshu N, Snow RW, Newton CR, Marsh K: Effect of a fall in malaria transmission on morbidity and mortality in Kilifi, Kenya. Lancet. 2008, 372: 1555-1562. 10.1016/S0140-6736(08)61655-4.

    Article  PubMed Central  PubMed  Google Scholar 

  4. Otten M, Aregawi M, Were W, Karema C, Medin A, Bekele W, Jima D, Gausi K, Komatsu R, Korenromp E, Low-Beer D, Grabowsky M: Initial evidence of reduction of malaria cases and deaths in Rwanda and Ethiopia due to rapid scale-up of malaria prevention and treatment. Malar J. 2009, 8: 14-10.1186/1475-2875-8-14.

    Article  PubMed Central  PubMed  Google Scholar 

  5. Bhattarai A, Ali AS, Kachur SP, Martensson A, Abbas AK, Khatib R, Al-Mafazy AW, Ramsan M, Rotllant G, Gerstenmaier JF, Molteni F, Abdulla S, Montgomery SM, Kaneko A, Björkman A: Impact of artemisinin-based combination therapy and insecticide-treated nets on malaria burden in Zanzibar. PLoS Med. 2007, 4: e309-10.1371/journal.pmed.0040309.

    Article  PubMed Central  PubMed  Google Scholar 

  6. Okiro EA, Bitira D, Mbabazi G, Mpimbaza A, Alegana VA, Talisuna AO, Snow RW: Increasing malaria hospital admissions in Uganda between 1999 and 2009. BMC Med. 2011, 9: 37-10.1186/1741-7015-9-37.

    Article  PubMed Central  PubMed  Google Scholar 

  7. Okiro EA, Alegana VA, Noor AM, Mutheu JJ, Juma E, Snow RW: Malaria paediatric hospitalization between 1999 and 2008 across Kenya. BMC Med. 2009, 7: 75-10.1186/1741-7015-7-75.

    Article  PubMed Central  PubMed  Google Scholar 

  8. Rowe AK, Steketee RW: Predictions of the impact of malaria control efforts on all-cause child mortality in sub-Saharan Africa. AmJTrop Med Hyg. 2007, 77: 48-55.

    Google Scholar 

  9. de Savigny D, Binka F: Monitoring future impact on malaria burden in sub-saharan Africa. AmJTrop Med Hyg. 2004, 71: 224-231.

    Google Scholar 

  10. Cibulskis RE, Bell D, Christophel EM, Hii J, Delacollette C, Bakyaita N, Aregawi MW: Estimating trends in the burden of malaria at country level. AmJTrop Med Hyg. 2007, 77: 133-137.

    Google Scholar 

  11. Rowe AK, Kachur SP, Yoon SS, Lynch M, Slutsker L, Steketee RW: Caution is required when using health facility-based data to evaluate the health impact of malaria control efforts in Africa. Malar J. 2009, 8: 209-10.1186/1475-2875-8-209.

    Article  PubMed Central  PubMed  Google Scholar 

  12. Chilundo B, Sundby J, Aanestad M: Analysing the quality of routine malaria data in Mozambique. Malar J. 2004, 3: 3-10.1186/1475-2875-3-3.

    Article  PubMed Central  PubMed  Google Scholar 

  13. Ceccato P, Ghebremeskel T, Jaiteh M, Graves PM, Levy M, Ghebreselassie S, Ogbamariam A, Barnston AG, Bell M, del Corral J, Connor SJ, Fesseha I, Brantly EP, Thomson MC: Malaria stratification, climate, and epidemic early warning in Eritrea. AmJTrop Med Hyg. 2007, 77: 61-68.

    Google Scholar 

  14. Graves PM, Osgood DE, Thomson MC, Sereke K, Araia A, Zerom M, Ceccato P, Bell M, Del Corral J, Ghebreselassie S, Brantly EP, Ghebremeskel T: Effectiveness of malaria control during changing climate conditions in Eritrea, 1998–2003. Trop Med Int Health. 2008, 13: 218-228. 10.1111/j.1365-3156.2007.01993.x.

    Article  PubMed  Google Scholar 

  15. Olana D, Chibsa S, Teshome D, Mekasha A, Graves PM, Reithinger R: Malaria, Oromia regional state, Ethiopia, 2001–2006. Emerg Infect Dis. 2011, 17: 1336-1337. 10.3201/eid1707.100942.

    Article  PubMed Central  PubMed  Google Scholar 

  16. Over M, Bakote'e B, Velayudhan R, Wilikai P, Graves PM: Impregnated nets or DDT residual spraying? Field effectiveness of malaria prevention techniques in Solomon Islands, 1993–1999. AmJTrop Med Hyg. 2004, 71: 214-223.

    Google Scholar 

  17. Wickremasinghe AR, Gunawardena DM, Mahawithanage ST: Use of routinely collected past surveillance data in identifying and mapping high-risk areas in a malaria endemic area of Sri Lanka. Southeast Asian J Trop Med Public Health. 2002, 33: 678-684.

    CAS  PubMed  Google Scholar 

  18. Deressa W, Olana D, Chibsa S: Magnitude of malaria admissions and deaths at hospitals and health centers in Oromia, Ethiopia. Ethiop Med J. 2004, 42: 237-246.

    PubMed  Google Scholar 

  19. Thomson MC, Mason SJ, Phindela T, Connor SJ: Use of rainfall and sea surface temperature monitoring for malaria early warning in Botswana. AmJTrop Med Hyg. 2005, 73: 214-221.

    Google Scholar 

  20. Nyarango PM, Gebremeskel T, Mebrahtu G, Mufunda J, Abdulmumini U, Ogbamariam A, Kosia A, Gebremichael A, Gunawardena D, Ghebrat Y, Okbaldet Y: A steep decline of malaria morbidity and mortality trends in Eritrea between 2000 and 2004: the effect of combination of control methods. Malar J. 2006, 5: 33-10.1186/1475-2875-5-33.

    Article  PubMed Central  PubMed  Google Scholar 

  21. Nsubuga P, Eseko N, Tadesse W, Ndayimirije N, Stella C, McNabb S: Structure and performance of infectious disease surveillance and response, United Republic of Tanzania, 1998. Bull World Health Organ. 2002, 80: 196-203.

    PubMed Central  PubMed  Google Scholar 

  22. Perry HN, McDonnell SM, Alemu W, Nsubuga P, Chungong S, Otten MW, Lusamba-dikassa PS, Thacker SB: Planning an integrated disease surveillance and response system: a matrix of skills and activities. BMC Med. 2007, 5: 24-10.1186/1741-7015-5-24.

    Article  PubMed Central  PubMed  Google Scholar 

  23. Nsubuga P, Brown WG, Groseclose SL, Ahadzie L, Talisuna AO, Mmbuji P, Tshimanga M, Midzi S, Wurapa F, Bazeyo W, Amri M, Trostle M, White M: Implementing integrated disease surveillance and response: four African countries' experience, 1998–2005. Glob Public Health. 2010, 5: 364-380. 10.1080/17441690903334943.

    Article  CAS  PubMed  Google Scholar 

  24. Population and Census Commission, Federal Democratic Republic of Ethiopia: Summary and statistical report of the 2007 population and housing census. 2008, http://www.csa.gov.et/pdf/InCen2007firstdraft.pdf.

    Google Scholar 

  25. Federal Ministry of Health, Ethiopia: HSDP IV Woreda Based Annual Core Plan. 2010, Addis Ababa, Ethiopia: Federal Democratic Republic of Ethiopia

    Google Scholar 

  26. Tedros Adhanom Ghebreyesus: Epidemiology and Ecology of Health and Disease in Ethiopia. Edited by: Berhane Y, Mariam DH, Kloos H. 2006, Addis Ababa: Shama Books, 849-

    Google Scholar 

  27. Abeku TA, von Oortmarssen GJ, Borsboom G, de Vlas SJ, Habbema JDF: Spatial and temporal variation of malaria epidemic risk in Ethiopia: factors involved and implications. Acta Trop. 2003, 87: 331-340. 10.1016/S0001-706X(03)00123-2.

    Article  PubMed  Google Scholar 

  28. Craig MH, Snow RW, le Sueur D: A climate-based distribution model of malaria transmission in sub-Saharan Africa. Parasitol Today. 1999, 15: 105-111. 10.1016/S0169-4758(99)01396-4.

    Article  CAS  PubMed  Google Scholar 

  29. Cox J, Craig M, le Sueur D, Sharp B: Mapping malaria risk in the highlands of Africa. 1999, London: LSHTM MARA/HIMAL Technical report

    Google Scholar 

  30. Graves PM, Richards FO, Ngondi J, Emerson PM, Shargie EB, Endeshaw T, Ceccato P, Ejigsemahu Y, Mosher AW, Hailemariam A, Zerihun M, Teferi T, Ayele B, Mesele A, Yohannes G, Tilahun A, Gebre T: Individual, household, and environmental risk factors for malaria infection in Amhara, Oromia and SNNP regions of Ethiopia. Trans R Soc Trop Med Hyg. 2009, 103: 1211-1220. 10.1016/j.trstmh.2008.11.016.

    Article  PubMed  Google Scholar 

  31. Dinku T, Asefa K, Hilemairam K, Grimes D, Connor S: Improving availability, access and use of climate information. Bull World Meteorological Organ. 2011, 60:

    Google Scholar 

  32. Federal Ministry of Health Ethiopia: National five-year strategic plan for malaria prevention and control in Ethiopia. 2011–2015, Addis Ababa, Ethiopia: Federal Democratic Republic of Ethiopia

    Google Scholar 

Download references

Acknowledgements

Funding was provided by The Carter Center. We are grateful to all health workers and information officers who completed IDSR reporting forms, and to the staff who compiled them and forwarded them at woreda, zone and regional level. We are grateful to Dr Estifanos Biru Shargie, Dr Richard Luce, and Dr Amy Patterson for advice, assistance and discussion. Thanks to Dr Greg Noland for comments on the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Patricia M Graves.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

DJ, MW, AAl, AT, NA, and AAd set up and managed the IDSR database; DJ, WD, ZT, TG, FOR and PG devised data management and analysis plan and did data analysis; AWM did the mapping; PG and DJ wrote the draft manuscript with extensive input from TG, FOR, AT, MW, AAl and NA; all authors commented on the draft manuscript and approved the final version.

Electronic supplementary material

12936_2012_2553_MOESM1_ESM.doc

Additional file 1: IDSR reporting form, 2004 to 2009. Scanned copy of IDSR monthly form used during 2004 to 2009 at health centres and hospitals showing data items reported. (DOC 160 KB)

12936_2012_2553_MOESM2_ESM.doc

Additional file 2: Malaria indicators (original and generated) in the IDSR database. List of variables relating to malaria in the IDSR database, name changes and variable definitions for old and newly created variables. (DOC 48 KB)

12936_2012_2553_MOESM3_ESM.doc

Additional file 3: Regions, Zones and Populations of IDSR reporting units, 2007. Lists of 108 reporting units in 2008/2009 showing their regions and names, names as spelled in census, name of original zone in 2004/2005, populations of each unit from Census 2007 and how the 108 reporting units were assigned in collapsing of new to old units. (DOC 45 KB)

12936_2012_2553_MOESM4_ESM.doc

Additional file 4: Reporting periods and number of eligible months for 108 IDSR reporting units. List of 108 eligible units, the starting and ending year and month of eligibility for reporting and the number of eligible months. (DOC 44 KB)

12936_2012_2553_MOESM5_ESM.doc

Additional file 5: Reporting completeness by month, site and overall for 108 reporting units. List of 108 reporting units by region; the number of eligible months and the number and % of months actually reported; the number of eligible sites and the number and % actually stated to be reporting. (DOC 52 KB)

12936_2012_2553_MOESM6_ESM.doc

Additional file 6: Average annual incidence of reported total (clinical and confirmed) out-patient malaria per 1000 persons by zone, Ethiopia 2004–2009. List of 86 collapsed reporting units by region, with census 2007 population, annual incidence/1000 of total out-patient malaria cases each year from 2004/2005 to 2008/2009, average annual incidence per year for 2004 to 2009, and expected annual number of total malaria cases. The reporting units with >50,000 expected total malaria cases per year are highlighted. (DOC 46 KB)

12936_2012_2553_MOESM7_ESM.doc

Additional file 7: Average annual incidence of confirmed outpatient malaria per 1000 persons by zone, Ethiopia 2004–2009. List of 86 collapsed reporting units by region, with census 2007 population, annual incidence/1000 of confirmed out-patient malaria cases each year from 2004/2005 to 2008/2009, average annual incidence per year for 2004 to 2009, and expected annual number of confirmed cases. The reporting units with >15,000 expected confirmed malaria cases per year are highlighted. (DOC 45 KB)

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Jima, D., Wondabeku, M., Alemu, A. et al. Analysis of malaria surveillance data in Ethiopia: what can be learned from the Integrated Disease Surveillance and Response System?. Malar J 11, 330 (2012). https://0-doi-org.brum.beds.ac.uk/10.1186/1475-2875-11-330

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1475-2875-11-330

Keywords