The effectiveness and acceptability of multimedia information when recruiting children and young people to trials: the TRECA meta-analysis of SWATs

Knapp P, Martin-Kerry J, Moe-Byrne T, Sheridan R, Coleman E, Roche J, Young B, Higgins S, Preston J, Bower P, Gamble C, Stones C
Record ID 32018005436
English
Authors' objectives: The information provided to potential trial participants plays a crucial role in their decision-making. Printed participant information sheets for trials have received recurrent criticism as being too long and technical, unappealing and hard to navigate. An alternative is to provide information through multimedia (text, animations, video, audio, diagrams and photos). However, there is limited evidence on the effects of multimedia participant information on research recruitment rates, particularly in children and young people. The study objectives were as follows: to develop template multimedia information resources through participatory design, for use when recruiting children and young people to trials to evaluate the multimedia information resources in a series of Studies Within A Trial, to test their effects on recruitment and retention rates, and participant decision-making, by comparing the provision of multimedia information resources instead of printed participant information sheets, and comparing the provision of multimedia information resources in addition to printed participant information sheets. There is insufficient evidence on how we should treat children and young people across a range of health conditions, in part due to a lack of trial evidence. The information provided to potential trial participants plays a crucial role in their decision-making about participation. In most cases, mandated recruitment information is provided to patients as printed participant information sheets, which have received recurrent criticism as being too long and technical, unappealing and hard to navigate. An alternative is to provide information digitally, enabling the use of multimedia information in trial recruitment, that is, through animations, video, audio, diagrams and photos, as well as written text. There is limited evidence on the effects of multimedia participant information on research recruitment rates, particularly in children and young people. The study objectives were as follows: to develop template multimedia information resources through participatory design, for use when recruiting children and young people to trials to obtain and analyse qualitative data from interviews and focus groups with members of key stakeholder groups (i.e. young patients; parents or guardians; and clinicians) to ensure the content, format and delivery of the multimedia information resources reflect their preferences to user-test the multimedia information resources with children and young people (and parents/guardians), to test the ability of the multimedia information resources to inform potential users to establish a Patient and Parent Advisory Group and actively liaise with them in the development and evaluation of the multimedia information resources to evaluate the multimedia information resources in a series of Studies Within A Trial, to test their effects on recruitment and retention rates, and participant decision-making, by comparing the provision of multimedia information resources instead of printed participant information, and the provision of multimedia information resources in addition to printed participant information.
Authors' results and conclusions: Phase 1 generated two multimedia information resource templates: (1) for children aged 6–11 years; (2) for children aged 12–18 years and parents. In the Phase 2 Studies Within A Trial the multimedia information resources improved trial recruitment, when compared to printed information alone [odds ratio (OR) = 1.54; 95% confidence interval (CI) 1.05 to 2.28; p = 0.03; I2 = 0%]. When printed participant information sheet-only provision was compared to combined multimedia information resource and printed participant information sheet provision, there was no effect on trial recruitment (OR = 0.89; 95% CI 0.53 to 1.50; I2 = 0%). There were no differences between multimedia information resource and printed participant information sheet on trial retention or participant decision-making quality. In a study within a hypothetical trial setting, multimedia information resource-only provision produced higher ratings of ‘information was easy to understand’ (Z = 3.03; p = 0.003) and ‘I had confidence in decision-making’ (Z = 2.00; p = 0.044) than printed participant information sheet-only provision. Use of multimedia information increased the rate of recruitment to trials involving children and young people compared to standard patient information sheets. Qualitative study Participants were 62 individuals (21 children and young with long-term health conditions, aged 6–19; 24 parents; 17 clinicians or researchers) who took part across a two-round study. Participants emphasised the need for the views of children and young people to be central to multimedia information resource design. Content seen as important included the following: that leaving a trial was ok; what participation would involve; ensuring that multimedia information resource imagery was not ‘scary’; what the trial was testing; potential risks associated with the trial; possible benefits of participation; confidentiality. Sources of trial funding, and payments to participants were seen as less important. They wanted multimedia information resources to be colourful but also appear ‘professional’. They selected from a choice of animation character sets. They had strong preferences for: plain fonts; clear multimedia information resource structure; concise animations with engaging voiceover. A strong theme was being able to identify with participation, possibly through use of video testimony from trial leaders, participants and parents. There were mixed views on interactivity within the multimedia information resources. The study produced two multimedia information resource templates (one for younger children aged 6–11; and one for older children aged 12–18 and parents), which were informed by significant empirical co-design work to ensure they met the preferences and information needs of potential trial participants and those recruiting them. The qualitative study found that children and young people, and their parents, said they would place high value on knowing about the experiences of trial participation, when making consent decisions themselves. Trials should consider including short video, audio or written accounts from trial personnel and current trial participants in their recruitment information. The multimedia information resources were acceptable to host trials and Research Ethics Committees, and there was no evidence of resistance to this format of recruitment information. Six Studies Within A Trial were undertaken with host trials recruiting children and young people; three were successful in providing data but three were not successful due to funding, governance and COVID-19 challenges to recruitment. Providing multimedia trial information rather than standard participant information sheets increased trial recruitment rates, which could reduce trial recruitment periods. Trials should consider using multimedia information as an alternative to print, although further evaluation is needed before it can be recommended for routine use. Providing multimedia trial information rather than standard participant information sheets did not increase trial retention or quality of participant decision-making. Providing multimedia trial information in addition to standard participant information sheets did not increase trial recruitment or retention, and resulted in lesser quality of participant decision-making, and it does not appear to be beneficial for trials to develop both formats of information for concurrent provision to potential participants, although further evidence is needed to test this conclusion. Further evaluation of the use of multimedia information in trial recruitment involving other population groups (including trials involving adults) is needed, as the current evidence base is lacking. There is a need for research to evaluate which elements of multimedia information are used by potential trial participants when making consent decisions. There is a need for research to evaluate the impact of multimedia information on communication between potential trial participants and those involved in recruiting them. Research studies using novel information formats in research recruitment or retention processes should ideally use a form of co-design and/or user testing before implementing the information.
Authors' methods: Two-phase study: multimedia information resources development including qualitative study; user testing study; readability metrics; enhanced patient and public involvement multimedia information resources’ evaluation comprising Studies Within A Trial undertaken within host trials recruiting children and young people. United Kingdom trials involving patients aged under 18. Development phase: n = 120 (children and young people, parents, clinicians, trial personnel). Evaluation phase: n = 1906 (children and young people being asked to take part in trials). Multimedia information resources (comprising text, audio, ‘talking heads’ video, trial-specific and trial-generic animations). Printed participant information sheets. Primary outcome: trial recruitment rate comparing multimedia information resource-only with printed participant information sheet-only provision. Secondary outcomes: trial recruitment rate comparing combined multimedia information resource and printed participant information sheet with printed participant information sheet-only provision; trial retention rate; quality of participant decision-making. Results for each trial were calculated and combined in a two-stage random-effects meta-analysis. It was not possible to include data from three Studies Within A Trial in the meta-analysis due to limited sample size, and questionnaire return rates were low, which reduced the strength of the findings. The study involved a two-phase design: development of the multimedia information resources, followed by evaluation. The Phase 1 development included the following four elements: A qualitative study with stakeholder groups, who participated across a two-round study. In the first round, participants discussed information priorities in relation to trial recruitment, and preferences for multimedia information resource appearance and content. In the second round, participants commented on a prototype multimedia information resource for a trial. Data collection used individual or joint interviews, and focus discussion groups. Data analysis was initially deductive descriptive, to rapidly inform the multimedia information resource development; subsequent analyses were iterative and thematic. A user testing study involved performance-based testing on two versions of the prototype trial multimedia information resource, one for children aged 6–11 and the other for children aged 12–18 and parents. Participants used one of two prototype multimedia information resources to answer ten factual questions on its content. For each question participants had to find the relevant information in the multimedia information resource and, once found, show their understanding. Amending the written text within the multimedia information resources. Enhanced patient and parent involvement. The Phase 2 evaluation phase comprised a series of Studies Within A Trial within six host trials recruiting children and young people. Participants were randomised to receive trial recruitment information in one of three formats: multimedia information resource-only; participant information sheet-only; or combined multimedia information resource and participant information sheet. The primary outcome was trial recruitment in the multimedia information resource-only versus the participant information sheet-only arms. Secondary outcomes were as follows: trial retention; participant decision-making (assessed by Likert scale); and trial recruitment, trial retention and participant decision-making when comparing combined multimedia information resource and participant information sheet with participant information sheet-only. Data from the Studies Within A Trial were combined in a pre-planned statistical meta-analysis. We also undertook a trial in a hypothetical trial setting, comparing the effects on multimedia information resource-only and participant information sheet-only provision on decision-making quality.
Details
Project Status: Completed
Year Published: 2023
URL for additional information: English
English language abstract: An English language summary is available
Publication Type: Full HTA
Country: England, United Kingdom
MeSH Terms
  • Clinical Trials as Topic
  • Patient Participation
  • Child
  • Adolescent
  • Social Media
  • Video-Audio Media
Contact
Organisation Name: NIHR Health Services and Delivery Research programme
Contact Address: NIHR Journals Library, National Institute for Health and Care Research, Evaluation, Trials and Studies Coordinating Centre, Alpha House, University of Southampton Science Park, Southampton SO16 7NS, UK
Contact Name: journals.library@nihr.ac.uk
Contact Email: journals.library@nihr.ac.uk
This is a bibliographic record of a published health technology assessment from a member of INAHTA or other HTA producer. No evaluation of the quality of this assessment has been made for the HTA database.