- Case study
- Open Access
Incorporating a quiz into informed consent processes: Qualitative study of participants' reactions
© Molyneux et al; licensee BioMed Central Ltd. 2007
Received: 18 April 2007
Accepted: 10 November 2007
Published: 10 November 2007
Formal checks of participant understanding are now widely recommended to improve informed consent processes. However, the views of the participants these assessments are designed to protect are rarely considered. In this paper the findings of a qualitative study aimed at documenting community reactions to a semi-structured questionnaire ('quiz') are reported. The quiz was administered to 189 mothers after consenting for their children to participate in a malaria vaccine trial on the Kenyan Coast.
Once the malaria vaccine trial was underway, focus group discussions were held with some of these mothers (nine groups; 103 mothers), and with community-based field staff attached to the malaria vaccine trial (two groups of five workers). Individual interviews with other trial staff were also held.
The quiz prompted community members to voice concerns about blood sampling and vaccine side-effects, thereby encouraging additional discussions and interactions between the research team and potential study participants. However, it also caused significant upset and concern. Some of the quiz questions, or the way in which they were asked, appeared to fuel misconceptions and fears, with potentially negative consequences for both the study and community members.
Formal approaches to checking study understanding should be employed with sensitivity and caution. They are influenced by and impact upon complex social relationships between and among researchers and community members. Adequate consideration of these contexts in assessments of understanding, and in responding to the issues raised, requires strong social science capacity.
Individual informed consent is a key ethical obligation for clinical studies. However, empirical studies show that the key requirements are often not met [1–5]. Suggestions for improving informed consent abound [2–12], but few have been evaluated in the field.
There is some evidence that a formal assessment, administered during the informed consent process, improves understanding. Checks of study comprehension, often in the form of a simple quiz with a check-list of facts, are, therefore, increasingly recommended for clinical studies[10, 13, 14]. In a recently published Nuffield discussion document, the monitoring of participants' understanding by a separate team was described as a 'valuable addition to many trials conducted in developed countries, where participants may have an incomplete understanding of the implications of their participation' . The need to assess participants' general understanding of the implications of the trial, rather than to simply test their retention of information with a check-list, was emphasized.
The Social and Behavioural Research (SBR) group coordinate community liaison activities at the KEMRI-Wellcome Trust Research Programme. SBR members (SM, CG and VM) adapted a quiz passed by the local and national ethics review committees into a semi-structured questionnaire (hereafter 'quiz') administered to 189 caretakers, primarily mothers (see Additional file 1). The quiz was administered by four experienced SBR fieldworkers, all of whom were from the same locality as the participants and had been carefully trained in communication skills. To avoid disrupting consenting and clinical screening processes, caretakers were interviewed just prior to their departure from the dispensary on the screening day (Step 3; Figure 1). Community reactions to the quiz itself were initially raised by the community to the trial field staff and PI (PB) and were then explored by CG through focus group discussions with community members (n = 9) and fieldworkers (n = 2) once the trial was underway. Community members were mothers of children in the trial, selected on the basis of village of residence. Focus Group Discussions (FGDs) continued to be held until a point of redundancy was reached (no new information being presented in the groups).
Results and Discussion
Correct and don't know answers on key vaccine trial study information
Correct response %
Stating DK %
What is this research for?
Why vaccine can't be given to all Kenyan children at the moment?
If you're child is healthy, and take part, how many injections will they receive?
Will all children be given a malaria vaccine?
Why will you have to stay at the clinic for one hour after the injection
Will children who have received a vaccine be able to get malaria?
No concerns were openly vocalized about the quiz itself while it was being administered. However, over the course of quiz one mother became increasingly agitated and finally withdrew from the study, demanding that her child's blood sample be returned and destroyed to prevent 'devil-worshipping'. Many other potential participants observed this dramatic and public event. Discussions around it revealed that rumours were widespread in the community: rumours that the information given by the research team is a lie; that unnecessarily large samples of blood are taken to be sold or given to devils (often associated with 'wazungus', or foreigners); that children will fit and die immediately after the vaccine is administered; that children will slowly die off after the end of the vaccine trial; and that biscuits and juice are given to children to increase their blood for further blood taking for devils.
Recognition of the huge sensitivity around blood sampling led to public meetings at which the PI showed and answered questions about how blood is processed and used in the laboratory; including demonstrations of microscope slides and assay wells. These meetings were an opportunity to focus on an area that had not been covered in depth in previous information giving sessions. More importantly, they were an additional opportunity for community members to test the research teams' openness and consistency in messages. These are behaviours supportive of trust-building, and appeared essential to the successful conduct of the trial (see also Gikonyo et al ).
Nevertheless, the quiz was clearly an unnerving experience for some participants (Figure 2; Quote 6), particularly given the relatively low education level of many mothers compared with the field assistants interviewing them. One person wondered what good the quiz did for those who decided not to join, because many of the rumours circulating in the community were proven untrue (for example children did not die immediately after receiving the first vaccine), and because those not in the trial did not benefit from careful monitoring and free treatment: P: (Interrupted a discussion on the positive aspects of the quiz)... it helped some; those who decided to continue coming. But then those that misunderstood, it didn't help them because they ran away! So, did they finish the journey?
Formal approaches to checking study understanding are increasingly popular for clinical research. The findings presented in this paper suggest that any such checks should be employed with sensitivity and caution. In the absence of other studies that have formally explored this issue, the experiences in Kenya suggest the following key issues influencing community reactions and the validity of the quiz itself:
The interviewer. The value of quizzes is dependent on the interpersonal skills of the people administering it, and their ability to ask questions in an open and non-threatening way. Difficulties were faced in Kenya even with fieldworkers fluent in the local language who were carefully trained in qualitative methodologies and in communication skills. Interviewers from within the team may have been more appropriate in this case.
Qualitative versus quantitative data. The findings of quantitative data acquired can be misleading without complementary qualitative data. Using quiz data alone to make definitive comments on individual levels of understanding or eligibility to access a trial is not therefore recommended. Imbalances in resources and research knowledge between researchers and community members can also make individual interviews intimidating for participants. In Kenya, a qualitative, group based, or less formal quiz may well have achieved the same positive impacts for all with fewer concerns raised for community members.
The follow up provided after a quiz. A formal check of understanding can lead to difficulties for individuals, for the community and for researchers in the short term. Nevertheless, this is an opportunity for the issues raised to be dealt with, leading to better understanding on both sides, and a stronger relationship between participants and researchers. This is particularly the case if the assessment is incorporated into and informs a broader strategy for involving communities in aspects of the research.
Expertise is required. Developing, administering and responding to assessments of understanding for clinical trials requires significant social science capacity. Strengthening the role of good quality social science in clinical trials is an important strategy for improving ethical practice.
The findings may be specific to the study population and to the socio-cultural and institutional context of the study. Use of a similar quiz in phase 1 trials, on a much smaller sample size of well-educated parents, provoked less controversy. However this was not formally explored. Further studies on quizzes would indicate the generalizability of the findings and identify important contextual influences. A greater understanding of community perspectives on quizzes, and of other ethical requirements, will help give research participants and communities a voice in national and international debates on how to strengthen ethical practice.
We are grateful to local community and the vaccine trial staff members who answered our questions and shared their insights and experiences with us. We are also indebted to the SBR fieldworkers who carried out many of the individual interviews and transcribed the FGD data. This work was conducted with financial support from the Kenya Medical Research Institute (KEMRI) and the Wellcome Trust Bioethics for Medical Research Programme, UK. The paper is published with the permission of the Director, KEMRI.
- Silverman AW: The myth of informed consent: in daily practice and in clinical trials. Journal of Medical Ethics. 1989, 15: 6-11.PubMed CentralView ArticlePubMedGoogle Scholar
- Bosk CL: Obtaining voluntary consent for research in desperately ill patients. Med Care. 2002, 40 (9 Suppl): V64-8.PubMedGoogle Scholar
- Lidz CW, Appelbaum PS: The therapeutic misconception: problems and solutions. Med Care. 2002, 40 (9 Suppl): V55-63.PubMedGoogle Scholar
- Fitzgerald DW, Marotte C, Verdier RI, Johnson WD, Pape JW: Comprehension during informed consent in a less-developed country. Lancet. 2002, 360 (9342): 1301-1302. 10.1016/S0140-6736(02)11338-9.View ArticlePubMedGoogle Scholar
- Molyneux CS, Peshu N, Marsh K: Understanding of informed consent in a low-income setting: three case studies from the Kenyan Coast. Soc Sci Med. 2004, 59 (12): 2547-2559. 10.1016/j.socscimed.2004.03.037.View ArticlePubMedGoogle Scholar
- Agre P, Campbell FA, Goldman BD, Boccia ML, Kass N, McCullough LB, Merz JF, Miller SM, Mintz J, Rapkin B, Sugarman J, Sorenson J, Wirshing D: Improving informed consent: the medium is not the message. Irb. 2003, Suppl 25 (5): S11-S19. 10.2307/3564117.View ArticlePubMedGoogle Scholar
- Agre P, Rapkin B: Improving informed consent: a comparison of four consent tools. Irb. 2003, 25 (6): 1-7. 10.2307/3564285.View ArticlePubMedGoogle Scholar
- Allmark P, Mason S, Gill AB, Megone C: Obtaining consent for neonatal research. Arch Dis Child Fetal Neonatal Ed. 2003, 88 (3): F166-7. 10.1136/fn.88.3.F166.PubMed CentralView ArticlePubMedGoogle Scholar
- Edwards SJ, Lilford RJ, Thornton J, Hewison J: Informed consent for clinical trials: in search of the "best" method. Soc Sci Med. 1998, 47 (11): 1825-1840. 10.1016/S0277-9536(98)00235-4.View ArticlePubMedGoogle Scholar
- Kass NE, Maman S, Atkinson J: Motivations, understanding, and voluntariness in international randomized trials. Irb. 2005, 27 (6): 1-8.PubMed CentralView ArticlePubMedGoogle Scholar
- Molyneux CS, Peshu N, Marsh K: Trust and informed consent: insights from community members on the Kenyan coast. Soc Sci Med. 2005, 61 (7): 1463-1473. 10.1016/j.socscimed.2004.11.073.View ArticlePubMedGoogle Scholar
- Smyth RL, Weindling AM: Research in children: ethical and scientific aspects. Lancet. 1999, 354 Suppl 2: SII21-4. 10.1016/S0140-6736(99)90253-2.View ArticlePubMedGoogle Scholar
- Hyder AA, Wali SA: Informed consent and collaborative research: perspectives from the developing world. Developing World Bioeth. 2006, 6 (1): 33-40. 10.1111/j.1471-8847.2006.00134.x.View ArticleGoogle Scholar
- NCOB: The ethics of research related to health care in developing countries: a follow-up discussion paper. 2005, London , Nuffield Council of BioethicsGoogle Scholar
- Bejon P, Mwacharo J, Kai O, Mwangi T, Milligan P, Todryk S, Keating S, Lang T, Lowe B, Gikonyo C, Molyneux C, Fegan G, Gilbert SC, Peshu N, Marsh K, Hill AV: A Phase 2b Randomised Trial of the Candidate Malaria Vaccines FP9 ME-TRAP and MVA ME-TRAP among Children in Kenya. PLoS Clin Trials. 2006, 1 (6): e29-10.1371/journal.pctr.0010029.PubMed CentralView ArticlePubMedGoogle Scholar
- Gikonyo C, Bejon P, Marsh V, Molyneux CS: Taking social relationships seriously: lessons learned from the informed consent practices of a vaccine trial on the Kenyan Coast. Social Science and Medicine. 2006, Submitted:Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.