Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Testing persuasive messages about booster doses of COVID-19 vaccines on intention to vaccinate in Australian adults: A randomised controlled trial

  • Maryke S. Steffens ,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

    maryke.steffens@health.nsw.gov.au

    Affiliations National Centre for Immunisation Research and Surveillance, Kids Research, Sydney Children’s Hospitals Network, Westmead, NSW, Australia, Faculty of Medicine and Health, The Children’s Hospital at Westmead Clinical School, The University of Sydney, Sydney, NSW, Australia

  • Bianca Bullivant,

    Roles Conceptualization, Methodology, Project administration, Writing – review & editing

    Affiliations National Centre for Immunisation Research and Surveillance, Kids Research, Sydney Children’s Hospitals Network, Westmead, NSW, Australia, Faculty of Medicine and Health, The Children’s Hospital at Westmead Clinical School, The University of Sydney, Sydney, NSW, Australia

  • Jessica Kaufman,

    Roles Conceptualization, Investigation, Methodology, Writing – review & editing

    Affiliations Vaccine Uptake Research Group, Murdoch Children’s Research Institute, Melbourne, VIC, Australia, Department of Paediatrics, University of Melbourne, Melbourne, VIC, Australia

  • Catherine King,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliations National Centre for Immunisation Research and Surveillance, Kids Research, Sydney Children’s Hospitals Network, Westmead, NSW, Australia, Faculty of Medicine and Health, The Children’s Hospital at Westmead Clinical School, The University of Sydney, Sydney, NSW, Australia

  • Margie Danchin,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliations Vaccine Uptake Research Group, Murdoch Children’s Research Institute, Melbourne, VIC, Australia, Department of Paediatrics, University of Melbourne, Melbourne, VIC, Australia, Department of General Medicine, Royal Children’s Hospital, Melbourne, VIC, Australia

  • Monsurul Hoq,

    Roles Conceptualization, Formal analysis, Methodology, Writing – review & editing

    Affiliations Vaccine Uptake Research Group, Murdoch Children’s Research Institute, Melbourne, VIC, Australia, Clinical Epidemiology and Biostatistics Unit, Murdoch Children’s Research Institute, Parkville, Australia, The National Child Health Poll, The Royal Children’s Hospital, Parkville, Australia

  • Mathew D. Marques

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Writing – review & editing

    Affiliation School of Psychology and Public Health, La Trobe University, Melbourne, VIC, Australia

Abstract

Introduction

Achieving high COVID-19 vaccine booster coverage is an ongoing global challenge. Health authorities need evidence about effective communication interventions to improve acceptance and uptake. This study aimed to test effects of persuasive messages about COVID-19 vaccine booster doses on intention to vaccinate amongst eligible adults in Australia.

Methods

In this online randomised controlled trial, adult participants received one of four intervention messages or a control message. The control message provided information about booster dose eligibility. Intervention messages added to the control message, each using a different persuasive strategy, including: emphasising personal health benefits of booster doses, community health benefits, non-health benefits, and personal agency in choosing vaccination. After the intervention, participants answered items about COVID-19 booster vaccine intention and beliefs. Intervention groups were compared to the control using tests of two proportions; differences of ≥5 percentage points were deemed clinically significant. A sub-group analysis was conducted among hesitant participants.

Results

Of the 487 consenting and randomised participants, 442 (90.8%) completed the experiment and were included in the analysis. Participants viewing messages emphasising non-health benefits had the highest intention compared to those who viewed the control message (percentage point diff: 9.0, 95% CI -0.8, 18.8, p = 0.071). Intention was even higher among hesitant individuals in this intervention group compared to the control group (percentage point diff: 15.6, 95% CI -6.0, 37.3, p = 0.150). Conversely, intention was lower among hesitant individuals who viewed messages emphasising personal agency compared to the control group (percentage point diff: -10.8, 95% CI -33.0, 11.4, p = 0.330), although evidence in support of these findings is weak.

Conclusion

Health authorities should highlight non-health benefits to encourage COVID-19 vaccine booster uptake but use messages emphasising personal agency with caution. These findings can inform communication message development and strategies to improve COVID-19 vaccine booster uptake.

Clinical trial registration: Registered with the Australian New Zealand Clinical Trials Registry (ACTRN12622001404718); trial webpage: https://www.anzctr.org.au/ACTRN12622001404718.aspx

Introduction

COVID-19 vaccination has been critical for controlling the COVID-19 pandemic by protecting vulnerable individuals from severe disease, safeguarding health systems and helping return society to normal functioning [1, 2]. Booster doses of COVID-19 vaccines (additional doses given after completion of the two-dose primary course) are necessary to provide ongoing immunity to SARS-CoV-2 and offer increased protection against severe disease [3].

Suboptimal uptake of COVID-19 booster doses has occurred globally. In Australia, completion of a primary course of COVID-19 vaccine for individuals ≥16 years is >96%, but booster dose (third dose) coverage has stalled at just over 70% [4]. In other countries, the United Kingdom (UK) has achieved approximately 70% booster dose coverage in the eligible population [5], while Europe and the United States (US) have achieved just over 50% and 43% respectively [6, 7].

While many factors can contribute to low vaccine uptake, including both access and acceptance barriers, low motivation may continue to act as a barrier to uptake if not addressed [8]. This has been the experience with other pandemic vaccines, for example the 2009 H1N1 influenza pandemic vaccine [9, 10]. There are a range of factors that influence motivation to receive a COVID-19 vaccine. Both personal and collective health benefits have been found to shape acceptance and motivation [1113], building on evidence from strategies to increase vaccine uptake more broadly [1416]. Non-health benefits, i.e. the broader benefits of vaccination beyond direct protection from disease such as ability to travel, have been found to be motivating factors [12, 17]. Attaching importance to certain moral values, such as individual liberties and the agency or freedom to make personal health decisions, have been linked to hesitancy about COVID-19 vaccines [18] as well as routine vaccines [19].

Considering these findings, emphasising motivational factors in persuasive messaging could potentially be a successful strategy to support higher intention to receive a COVID-19 vaccine. There is evidence that persuasive messages can support higher intentions towards vaccination in general [8, 20, 21]. For COVID-19 vaccination specifically, a systematic review has found that messages emphasising personal or community health benefits of vaccination can be effective in supporting higher intentions, although results are mixed [22]. Three survey experiments in US and UK adults comparing the effect of a range of messages on intention to receive a COVID-19 vaccine found that messages emphasising personal health benefits of vaccination have a larger effect than those emphasising benefits to others [13, 23, 24]. By contrast, another large survey experiment in US adults found that messages emphasising non-health benefits (such as freedom from public health restrictions) and community benefits were effective. The community messages were the most effective of all, while those emphasising personal health benefits were not more effective than the control [25]. Evidence of the effectiveness of messaging promoting altruistic behaviour (i.e. behaviour beneficial to the community) on COVID-19 vaccine intention has also been found in other experiments in US and UK adults [26, 27]. There is limited research investigating the effectiveness of messages emphasising personal agency in making COVID-19 vaccination decisions.

Given the current state of evidence, it remains unclear what types of messages have the greatest effect on intention to receive a booster dose of COVID-19 vaccine. This is especially the case in populations that have experienced relatively low risk of encountering COVID-19, combined with restrictive public health measures. These were the conditions experienced in Australia at the time of this experiment, where COVID-19 case numbers were relatively low during the first two years of the pandemic, while public health restrictions, such as border closures and lockdowns, were applied liberally due to the country’s pursuit of a COVID-19 elimination strategy [28]. Such evidence can inform communications from health authorities and other stakeholders to encourage uptake of COVID-19 booster doses, especially written communications (e.g. emails), which were used to communicate with the public in Australia during the COVID-19 vaccine rollout. This study aimed to compare the effect of persuasive messages on intention to get a booster dose of COVID-19 vaccine in Australian adults. This study is part of a larger study investigating factors influencing COVID-19 vaccine acceptance in Australia and elsewhere [11, 12, 29, 30] and developing messaging to support acceptance of COVID-19 vaccines in various populations [31].

Methods

Experimental design

This was a parallel group, randomised, controlled, online experiment comparing intention to receive a COVID-19 vaccine booster dose and beliefs about COVID-19 vaccine booster doses between subjects after receiving persuasive message interventions. This study obtained ethics approval from the Sydney Children’s Hospitals Network Human Research Ethics Committee (2021/ETH00181). The study aims, methods, and data analysis plan were pre-registered on the Open Science Framework (https://osf.io/xajmz). In response to the skewed distribution of responses, a post hoc variation to the pre-registration was made to analyse intention to vaccinate and participant responses to belief items as dichotomous variables. See S1 File for original frequency distribution of intention to vaccinate. The trial was retrospectively registered with the Australian New Zealand Clinical Trials Registry (ACTRN12622001404718, https://www.anzctr.org.au/ACTRN12622001404718.aspx).

Participants

Participants were adults 18 years or older residing in Australia who had received at least one primary dose of a COVID-19 vaccine but had not yet received a booster (third) dose and had access to the internet. Research company Quality Online Research (QOR) recruited a random sample of participants via email invitation from its accredited online panel. The QOR panel has >85,000 active members; original panel members were recruited via the Australia Post Lifestyle Survey, distributed to all Australian households. Ongoing recruitment is by invitation only. The panel reflects Australian Bureau of Statistics census data by age, gender, and state. Participants took part in the study via an online portal hosted by the research company and were offered points as incentive for participation equivalent to between AUD$1.00-$2.00, redeemable as payouts by PayPal, eGift cards or cheques. Participants gave written (digital) informed consent. Participants were recruited between 17–24 December 2021, with recruitment stopping when targets were met.

For context, at the time of data collection, the Australian population had experienced multiple rounds of restrictions on movement, limits on indoor and outdoor gatherings, closure of restaurants, gyms and non-essential retail, and interstate and international border closures. Approximately two months prior to data collection (in October 2021), people living in the states of New South Wales and Victoria had exited strict and lengthy lockdowns in response to the Delta wave. In December 2021, domestic border closures had started to lift, however strict international border closures, put in place in March 2020 to prevent people from leaving and entering the country, were still in place at the time. In December 2021, Australia was anticipating the occurrence of a further Omicron wave, with cases rising rapidly [32, 33].

Pre-intervention survey items

After consenting, participants provided demographic information (age, gender, education, and state of residence). They were asked to respond to screening items about their COVID-19 vaccination status (‘Have you received a first/second/third dose of a COVID-19 vaccine?’, response options = yes/no). Participants were asked to indicate their hesitancy towards COVID-19 vaccines with a single item (‘How much do you agree with the following statement: “I feel hesitant about COVID-19 vaccines”‘, response options were on a 5-point scale from strongly disagree to strongly agree) informed by previous vaccination research [34, 35]. This item was used to categorise the participants into vaccine hesitant and accepting participants. Responses were recoded where (strongly agree, slightly agree, neither agree nor disagree) = hesitant, and (slightly disagree, strongly disagree) = accepting.

Intervention

Participants received one of four intervention messages according to their randomised group. The intervention was a short piece of written material (a message of approximately 70–140 words) designed to encourage uptake of booster doses of COVID-19 vaccines. The material was modified from a public email communication campaign disseminated by an Australian health authority in November 2021. These modifications were made by the research team, based on the current state of evidence on the types of messages that may have an effect on intention to vaccinate. The control message informed recipients of eligibility requirements for a booster dose of COVID-19 vaccine. The four intervention messages added to this message, each using a different persuasive strategy. Table 1 shows the full intervention messages. The ’Personal health benefits’ message emphasised the reduction in risk of becoming infected, sick or dying that getting a booster dose of COVID-19 vaccine offers. The ’Community health benefits’ message emphasised the altruistic nature of receiving a COVID-19 vaccine, i.e., the reduction in risk of giving the virus to family members or people in the community. The ’Non-health benefits’ message emphasised the broader benefits that getting vaccinated could bring such as the possibility of freedom from future public health restrictions. The ’Personal agency’ message emphasised the control over one’s health gained by choosing vaccination. Survey software required participants to view the intervention text for a minimum of 30 seconds.

Post-intervention outcome measures

Immediately after the intervention, participants responded to items measuring outcomes. The primary outcome measure was intention to receive a COVID-19 vaccine booster dose. This was assessed with a single item (‘How likely is it that you will get a booster dose of COVID-19 vaccine?’, with 5 response options: definitely, probably, I’m not sure, probably not, definitely not), consistent with survey questions used in previous research [36]. Responses were transformed into a dichotomous variable where (definitely, probably) = ’intends to receive a COVID-19 vaccine’ and (I’m not sure, probably not, definitely not) = ’does not intend to receive a COVID-19 vaccine’. Participants then answered an attention check question (‘Please select strongly disagree for this item’, response options ranged from strongly disagree to strongly agree).

Secondary outcome measures were beliefs about COVID-19 vaccine booster doses. These were assessed by asking participants to indicate their agreement with belief statements about COVID-19 vaccine booster dose safety, effectiveness, necessity for protecting one’s own health, necessity for protecting others’ health, and risks associated with not vaccinating (response options were a 5-point scale: strongly disagree, slightly disagree, neither agree nor disagree, slightly agree, strongly agree. See S1 File for belief statements). Responses were transformed into dichotomous variables where (Strongly disagree, Slightly disagree, Neither agree nor disagree) = ’does not agree with belief’ and (Strongly agree, Slightly agree) = ’agrees with belief’.

Sample size

The study aimed to recruit 480 participants to ensure a sample size of 430 participants, allowing for a drop-out/poor quality response rate of approximately 10%. The sample size was calculated using G*Power (an a priori power analysis tool) to estimate an effect size of Cohen’s d = 0.2 (the difference between two independent means) [37] with a specified power of 80% at 0.01 level of significance using analysis of variance (ANOVA) tests to compare outcomes between intervention groups, as specified in the pre-registered protocol. In line with the post hoc variation to analyse participant’s intention to vaccinate and belief items as dichotomous variables, the sample size of 85 participants per intervention group was adequate to estimate a difference in proportion of 15 percentage points or more between two groups using two-sample test of proportion (z-test) with a level of significance of 0.05 and power of 80%. Participants with incomplete surveys or who failed to answer the quality control attention check question correctly were excluded.

Randomisation

Participants were randomly assigned at recruitment via a randomisation sequence embedded within the online system to receive one of the four intervention messages or the control message. Because some participants were excluded after randomisation (they either failed the attention check or did not complete the experiment, see Fig 1), a second randomisation sequence was generated to ensure intervention and control groups were of equal size. This sequence prioritised the least filled group when 80% of the recruitment was complete.

thumbnail
Fig 1. Flow diagram showing progress of participants through the online experiment.

https://doi.org/10.1371/journal.pone.0286799.g001

Statistical methods

The difference in proportion of participants intending to receive a COVID-19 vaccine and agreeing with COVID-19 vaccine booster dose belief statements was compared between the control group and each of the four intervention groups using tests of two proportions (z test). A subgroup analysis included data from vaccine hesitant participants only.

Previous studies have shown that an effect size of ≥5 percentage points may have practical (clinical) significance [3840]. Hence, when reporting differences in intention and beliefs for each intervention group compared to the control group, differences of ≥5 percentage points were considered practically meaningful from a public health perspective, regardless of the p value [41]. The difference in proportion was interpreted with respect to the upper and lower limit of the confidence intervals.

All analyses were conducted using SPSS (Statistical Package for Social Sciences, version 27).

Role of the funding source

This research was funded by a grant from NSW Health. The sponsor had no role in the study design; in the collection, analysis and interpretation of data; in the writing of the report; or in the decision to submit the article for publication.

Results

Of the 487 participants who consented and were randomised, 442 (90.8%) completed the experiment, answered the attention check question correctly, and were included in the analysis. Fig 1 shows the progress of participants through the online experiment.

Participants had a mean age of 51.14 years (SD 16.32); 51.1% (226/442) were female; 97.5% (431/442) had reported having received a second dose of COVID-19 vaccine; 37.8% (167/442) reported feeling hesitant about COVID-19 vaccines. Table 2 shows participant characteristics between groups, which are similar in age, gender, education, state, completion of second dose, or hesitancy between groups.

Primary outcome (Intention to vaccinate)

Most participants (84.6%, 374/442) indicated a positive intention to get a booster dose of COVID-19 vaccine. Table 3 shows intention to vaccinate, compared between groups. All intervention groups had a qualitatively higher intention to vaccinate compared to the control group except one (see Fig 2). Participants who viewed the message emphasising non-health benefits showed the largest difference compared to the control group (percentage point diff: 9.0, 95% CI -0.8, 18.8, p = 0.071), although the evidence in support of this finding is weak. Participants who viewed the message emphasising personal agency had a slightly lower intention compared to the control group (percentage point diff: -4.2, 95% CI -15.1, 6.7, p = 0.445), although there is a lack of evidence in support of this finding.

thumbnail
Fig 2. Difference in intention to vaccinate in each intervention group compared to the control group.

https://doi.org/10.1371/journal.pone.0286799.g002

thumbnail
Table 3. Comparing intention to vaccinate between intervention groups and the control group.

https://doi.org/10.1371/journal.pone.0286799.t003

In the sub-analysis of hesitant participants, more than half of participants (64.7%; 108/167) intended to get a booster dose of COVID-19 vaccine; this proportion is lower than for the whole study population. Table 4 shows intention to vaccinate in hesitant participants, compared between groups. As with the whole population, all intervention groups had a qualitatively higher intention to vaccinate compared to the control group except one (see Fig 3). Participants who viewed the message emphasising non-health benefits showed a higher intention compared to the control group (percentage point diff: 15.6, 95% CI -6.0, 37.3, p = 0.150), while participants who viewed the personal agency message had a lower intention compared to the control group (percentage point diff: -10.8, 95% CI -33.0, 11.4, p = 0.330), although there is a lack of evidence in support of these findings. Results for non-hesitant participants are reported in S1 File.

thumbnail
Fig 3. Difference in intention to vaccinate in each intervention group compared to the control group in hesitant participants (sub-analysis).

https://doi.org/10.1371/journal.pone.0286799.g003

thumbnail
Table 4. Comparing intention to vaccinate between intervention groups and the control group in hesitant participants (sub-analysis).

https://doi.org/10.1371/journal.pone.0286799.t004

Secondary outcome (Beliefs)

Most participants agreed that booster doses are safe (71.7%, 317/442), prevent disease (75.3%, 333/442), protect their health (78.7%, 348/442), protect the health of others (77.4%, 342/442). A slightly smaller majority agreed that they were at risk of getting COVID-19 without a booster dose (63.8%, 282/442).

Table 5 shows COVID-19 vaccine booster dose beliefs, compared between groups. Three of the intervention groups showed differences ≥5 percentage points in their agreement with some beliefs compared to the control, although there is a lack of evidence in support of these findings. Participants who viewed the message emphasising personal health benefits showed a higher agreement compared to the control group with beliefs about COVID-19 booster dose safety (percentage point diff: 5.1, 95% CI -7.6, 17.9, p = 0.424) and the necessity of booster doses for protecting other people’s health (percentage point diff: 7.0, 95% CI -5.4, 19.3, p = 0.266). Participants who viewed the message emphasising non-health benefits showed a higher agreement compared to the control with beliefs about booster doses being effective (percentage point diff: 7.6, 95% CI -4.4, 19.6, p = 0.210) and the necessity of booster doses for protecting other people’s health (percentage point diff: 6.7, 95% CI -5.2, 18.6, p = 0.266). Participants who viewed the message emphasising personal agency showed lower agreement compared to the control with beliefs about COVID-19 booster dose safety (percentage point diff: -5.2, 95% CI -17.7, 7.2, p = 0.404).

thumbnail
Table 5. Comparing beliefs between intervention groups and the control group.

https://doi.org/10.1371/journal.pone.0286799.t005

In the sub-analysis of hesitant participants, fewer hesitant participants agreed with beliefs compared to the whole study population. A slight majority of hesitant participants agreed that booster doses protect their health (55.7%, 93/167) and the health of others (53.9%, 90/167). In contrast, a slight minority of hesitant participants agreed that booster doses are safe (43.1%, 72/167), that booster doses prevent disease (48.5%, 81/167), or that they were at risk of getting COVID-19 without a booster dose (46.1%, 77/167). Looking at specific intervention groups, there were more differences ≥5 percentage points compared to the control in hesitant participants compared to the whole study population, although there is a lack of evidence in support of these findings. The full results are included in S1 File.

Discussion

This experiment found some evidence that messages emphasising non-health benefits of getting a COVID-19 booster dose, like travelling, enjoying family occasions like weddings, and seeing family and friends, may increase intention to vaccinate, especially in hesitant populations. In this study, intention was qualitatively higher in participants who viewed messages about non-health benefits compared to those who viewed messages about health benefits for themselves and the community. This is somewhat consistent with findings from an experiment in US adults [25], which found some evidence of persuasive messages about non-health benefits being effective, however not more so than other persuasive strategies. This finding from the current study could be explained by the point in time in which this experiment was conducted. At the time, the Australian population had endured almost two years of public health restrictions, including lockdowns and international and domestic border closures. Being able to live more normally, free from restrictions, may have been top of mind, and hence what participants found the most persuasive. Equally, participants may have found the benefits of vaccination beyond the prevention of severe disease more appealing, especially younger participants. While evidence from a cross-national study early in the pandemic suggested age was not associated with risk perceptions relating to COVID-19 [42], Australian participants in this current study may have experienced or observed others experiencing mild COVID-19 during the first Omicron wave in Australia in December 2021 and thus may not have felt vulnerable to the severe effects of COVID-19.

This study also found some evidence that messages emphasising benefits of COVID-19 vaccine booster doses to people’s personal health and the health of the community may increase intention to vaccinate. These findings are consistent with a systematic review of COVID-19 vaccine interventions [22]. Despite qualitatively increasing intention, however, reminding participants about the personal or community health benefits of booster doses was only slightly more effective than informing participants about their eligibility to receive a booster dose (the control message). This is consistent with findings from an experimental study that found that information about where to get a vaccine was not rendered more effective when combined with information about the community or personal benefits of getting vaccinated [43]. In keeping with conclusions from the systematic review [22], reminders about the health benefits of COVID-19 vaccination for one’s self and others may have had less of an effect due to participants’ over-familiarity with this information after more than 12 months of communication from health authorities.

This study found that messages emphasising personal agency may have negative impacts, especially with hesitant individuals. This finding contrasts with previous findings, which suggest that individual liberty and a sense of personal agency when choosing vaccination may motivate people to vaccinate [18, 19]. The emphasis this message placed on the act of choosing a booster dose as ‘the right decision’ may help explain this result. Hesitant individuals may have reacted negatively (psychological reactance) [44] to suggestions about how they ought to behave, and what others approve or disapprove of regarding vaccination decisions. Research suggests infringement on freedom is associated with less positive attitudes towards vaccination [45] and, in cases where vaccination mandates are applied, this may lead to lower intentions to vaccinate [46], although findings in this area are mixed [47]. Equally, liberty as a moral value driving vaccination decision-making may vary by country and political views and may not resonate strongly with Australian audiences.

Finally, in terms of COVID-19 vaccine booster dose beliefs, this study found more increased changes in beliefs in hesitant participants compared to the whole study population. This suggests that hesitant participants have beliefs that are possibly less fixed and more amenable to change, a result that has been found in studies about childhood vaccination [48]. This would not necessarily hold for staunch vaccine refusers, but rather individuals who are more undecided or “fence sitters” [49].

These have practical implications for communications from health authorities and other stakeholders to encourage uptake of COVID-19 booster doses, especially communications directed at individuals consuming vaccination information online. Health authorities should consider using a range of messages; an emphasis on non-health benefits may be particularly useful, although personal and community health benefits may also be effective. Any message should be pre-tested with target audiences; message effectiveness will depend on current circumstances and sentiment. Interventions specifically designed for and targeting hesitant, undecided populations are likely to bear the most fruit. For this population, messages emphasising personal agency should be used with caution. Until more evidence emerges, caution should also be taken with messages that leverage prescriptive norms that tell people how they ought to act (i.e., what the ‘right’ vaccination behaviour is). In all instances, messages should be tailored for specific communities, taking into account differences in factors affecting motivation to vaccinate and health literacy. Caution should be used when extrapolating this evidence for use with messages directed at individuals hesitant about other vaccines. Research with the community during the initial rollout of COVID-19 vaccines indicates the vaccines are perceived to be considerably different from other vaccines give their use of novel technologies (such as mRNA) and rapid development. Some individuals who report being accepting of most vaccines have indicated hesitancy in relation to COVID-19 vaccines [29, 30].

Future research could use qualitative methodologies to explore message development and testing to better understand the negative effects observed in this study. Research to better understand the effect of messages that leverage prescriptive norms would be useful. Exploring the effects of messaging on different age groups, as well as messaging that caters for varying literacy levels, would provide evidence to support development of more nuanced and targeted communications. Likewise, developing and testing different message formats beyond written information, such as videos and infographics, and channels beyond a static webpage would also be useful. Research focusing specifically on at-risk groups and hesitant populations would ensure greater vaccine equity and would provide useful insights into intervention effectiveness in key target populations. At-risk groups could include the elderly, pregnant women and people, people from different cultural or Indigenous communities, and people with disabilities. Several years into the COVID-19 pandemic, it would also be useful to understand ‘vaccine information fatigue’ (i.e., the extent to which communities have switched off from and appear immune to communication about COVID-19 vaccines), and how to continue encouraging uptake. This is particularly important if health authorities are to consider additional booster doses or an annual COVID-19 vaccine. Furthermore, given the overall high intentions found among the sample in this study, future research may need to shift the focus to interventions that translate intention into vaccination behaviour (i.e., people getting vaccinated). This could involve the use of behavioural nudges, such as text message reminders, which has shown some positive results early in the COVID-19 vaccination rollout, as well as with other vaccines such as influenza [38, 43].

This study has limitations. In this study, participants only saw the message once from a single source; multiple exposures from multiple sources over time may be required for long term changes to intention and behaviour to occur. This study did not measure changes in behaviour, but rather measured vaccination intention as an outcome. While in keeping with similar studies, behaviour in the form of vaccination uptake would provide a more accurate measure of the effectiveness of such interventions. Some of the intervention texts had a slight overlap. There was a clear emphasis on a single area of focus in each text via a bolded title and repetition of the particular benefit throughout the text. Future research, however, should use a manipulation check to verify that participants can identify the condition they are in, as well as checks to assess comprehension. The sample was highly educated, likely a result of the nature of the panel used. Online research panels in general are likely to represent people who are digitally literate and are willing and able to spend time responding to email invitations and surveys [50]. While this group is the target population for this study, these results may not be generalisable to other populations, such as individuals with low health literacy or from culturally and linguistically diverse backgrounds. While the study is underpowered due to a post hoc variation to the protocol, the findings reported as difference in proportion is practically more meaningful and easier to communicate. Participants were quasi-randomised due to use of the sequence to prioritise the least filled group. Given equal distribution of participants among intervention groups, however, the threat to internal validity is limited. An appropriate, validated measure of hesitancy towards COVID-19 vaccines that did not include intention items was not available at the time of this study. As such, the measure used may not have accurately captured this construct. The study measured group differences rather than using a pre-post within-subject design, and thus did not capture changes in individual participants’ intentions after viewing persuasive messages. Checks to assess comprehension would further strengthen the study.

Conclusions

Health authorities should consider emphasising the broader benefits of vaccination beyond prevention of severe disease to encourage uptake of COVID-19 vaccine booster doses, as well as benefits to people’s personal health and the health of the community. Communication using personal agency should be used with caution. The findings of this research can inform future communication about booster doses of COVID-19 vaccines.

Supporting information

S1 Checklist. CONSORT 2010 checklist of information to include when reporting a randomised trial*.

https://doi.org/10.1371/journal.pone.0286799.s001

(DOC)

S2 File. Protocol for persuasive COVID-19 vaccination message testing.

https://doi.org/10.1371/journal.pone.0286799.s003

(DOCX)

References

  1. 1. Moghadas SM, Vilches TN, Zhang K, Wells CR, Shoukat A, Singer BH, et al. The Impact of Vaccination on Coronavirus Disease 2019 (COVID-19) Outbreaks in the United States. Clin Infect Dis. 2021;73(12):2257–64. pmid:33515252
  2. 2. Rossman H, Shilo S, Meir T, Gorfine M, Shalit U, Segal E. COVID-19 dynamics after a national immunization program in Israel. Nat Med. 2021;27(6):1055–61. pmid:33875890
  3. 3. Lustig Y, Gonen T, Meltzer L, Gilboa M, Indenbaum V, Cohen C, et al. Superior immunogenicity and effectiveness of the third compared to the second BNT162b2 vaccine dose. Nat Immunol. 2022;23(6):940–6. pmid:35534723
  4. 4. Australian Government Department of Health and Aged Care. Vaccination numbers and statistics [Internet]. 2022 [cited 2022 8 September]. Available from: https://www.health.gov.au/initiatives-and-programs/covid-19-vaccines/numbers-statistics
  5. 5. Government of the United Kingdom. Vaccination in United Kingdom 2022 [cited 2022 8 September]. Available from: https://coronavirus.data.gov.uk/details/vaccinations
  6. 6. European Centre for Disease Prevention and Control. COVID-19 vaccine tracker 2022 [cited 2022 8 September]. Available from: https://vaccinetracker.ecdc.europa.eu/public/extensions/COVID-19/vaccine-tracker.html#uptake-tab
  7. 7. Centers for Disease Control (US Department of Health and Human Services). COVID data tracker 2022 [cited 2022 8 September]. Available from: https://covid.cdc.gov/covid-data-tracker/#vaccinations_vacc-people-additional-dose-totalpop
  8. 8. Brewer NT, Chapman GB, Rothman AJ, Leask J, Kempe A. Increasing Vaccination: Putting Psychological Science Into Action. Psychological Science in the Public Interest. 2017;18(3):149–207. pmid:29611455
  9. 9. Commonwealth of Australia. Review of Australia’s Health Sector Response to Pandemic (H1N1) 2009: Lessons Identified Canberra; 2011.
  10. 10. Peretti-Watel P, Seror V, Cortaredona S, Launay O, Raude J, Verger P, et al. A future vaccination campaign against COVID-19 at risk of vaccine hesitancy and politicisation. The Lancet Infectious Diseases. 2020;20(7):769–70. pmid:32445713
  11. 11. Bolsewicz KT, Steffens MS, Bullivant B, King C, Beard F. "To Protect Myself, My Friends, Family, Workmates and Patients…and to Play My Part": COVID-19 Vaccination Perceptions among Health and Aged Care Workers in New South Wales, Australia. Int J Environ Res Public Health. 2021;18(17):8954.
  12. 12. Steffens MS, Bullivant B, Bolsewicz K, King C, Beard F. Factors Influencing COVID-19 Vaccine Acceptance in High Income Countries Prior to Vaccine Approval and Rollout: A Narrative Review. Int J Public Health. 2022;67:1604221. pmid:35250430
  13. 13. Freeman D, Loe BS, Yu LM, Freeman J, Chadwick A, Vaccari C, et al. Effects of different types of written vaccination information on COVID-19 vaccine hesitancy in the UK (OCEANS-III): a single-blind, parallel-group, randomised controlled trial. Lancet Public Health. 2021;6(6):e416–e27. pmid:33991482
  14. 14. Betsch C, Bohm R, Korn L. Inviting free-riders or appealing to prosocial behavior? Game-theoretical reflections on communicating herd immunity in vaccine advocacy. Health Psychol. 2013;32(9):978–85. pmid:24001248
  15. 15. Betsch C, Böhm R, Korn L, Holtmann C. On the benefits of explaining herd immunity in vaccine advocacy. Nature Human Behaviour. 2017;1(3).
  16. 16. Bohm R, Betsch C. Prosocial vaccination. Curr Opin Psychol. 2022;43:307–11. pmid:34517200
  17. 17. Chapman G, Al Imam MH, Khan A, Smoll N, Adegbija O, Kirk M, et al. "Scary to get, more scary not to": COVID-19 vaccine acceptance among healthcare workers in Central Queensland, Australia, a cross-sectional survey. Commun Dis Intell (2018). 2022;46. pmid:35591752
  18. 18. Schmidtke KA, Kudrna L, Noufaily A, Stallard N, Skrybant M, Russell S, et al. Evaluating the relationship between moral values and vaccine hesitancy in Great Britain during the COVID-19 pandemic: A cross-sectional survey. Soc Sci Med. 2022;308:115218. pmid:35870299
  19. 19. Amin AB, Bednarczyk RA, Ray CE, Melchiori KJ, Graham J, Huntsinger JR, et al. Association of moral values with vaccine hesitancy. Nat Hum Behav. 2017;1(12):873–80. pmid:31024188
  20. 20. Jarrett C, Wilson R, O’Leary M, Eckersberger E, Larson HJ, Sage Working Group on Vaccine Hesitancy. Strategies for addressing vaccine hesitancy—A systematic review. Vaccine. 2015;33(34):4180–90.
  21. 21. World Health Organization. Data for action: achieving high uptake of COVID-19 vaccines. Geneva; 2021.
  22. 22. Batteux E, Mills F, Jones LF, Symons C, Weston D. The Effectiveness of Interventions for Increasing COVID-19 Vaccine Uptake: A Systematic Review. Vaccines (Basel). 2022;10(3). pmid:35335020
  23. 23. Ashworth M, Thunstrom L, Cherry TL, Newbold SC, Finnoff DC. Emphasize personal health benefits to boost COVID-19 vaccination rates. Proceedings of the National Academy of Sciences of the United States of America. 2021;118(32). pmid:34315824
  24. 24. Berliner Senderey A, Ohana R, Perchik S, Erev I, Balicer R. Encouraging Uptake of the COVID-19 Vaccine Through Behaviorally Informed Interventions: National Real-World Evidence From Israel. SSRN Electronic Journal. 2021.
  25. 25. James EK, Bokemper SE, Gerber AS, Omer SB, Huber GA. Persuasive messaging to increase COVID-19 vaccine uptake intentions. Vaccine. 2021;39(49):7158–65. pmid:34774363
  26. 26. Pfattheicher S, Petersen MB, Bohm R. Information about herd immunity through vaccination and empathy promote COVID-19 vaccination intentions. Health Psychol. 2022;41(2):85–93. pmid:34570535
  27. 27. Trueblood JS, Sussman AB, O’Leary D. The Role of Risk Preferences in Responses to Messaging About COVID-19 Vaccine Take-Up. Social Psychological and Personality Science. 2021;13(1):311–9.
  28. 28. Baker MG, Wilson N, Blakely T. Elimination could be the optimal response strategy for covid-19 and other emerging pandemic diseases. BMJ. 2020;371:m4907. pmid:33561814
  29. 29. Bullivant B, Bolsewicz KT, King C, Steffens MS. COVID-19 vaccination acceptance among older adults: A qualitative study in New South Wales, Australia. Public Health Pract (Oxf). 2023;5:100349. pmid:36532098
  30. 30. Steffens MS, Bullivant B, King C, Bolsewicz K. "I’m scared that if I have the vaccine, it’s going to make my lung condition worse, not better." COVID-19 vaccine acceptance in adults with underlying health conditions—A qualitative investigation. Vaccine X. 2022;12:100243. pmid:36447620
  31. 31. Kaufman J, Steffens MS, Hoq M, King C, Marques MD, Mao K, et al. Effect of persuasive messaging about COVID-19 vaccines for 5- to 11-year-old children on parent intention to vaccinate. J Paediatr Child Health. 2023;59(4):686–93. pmid:36807943
  32. 32. Australian Bureau of Statistics. COVID-19 Mortality by wave. Australian Bureau of Statistics [Internet]. 16 Nov 2022 Date accessed 6 March 2023. Available from: https://www.abs.gov.au/articles/covid-19-mortality-wave.
  33. 33. Sas N, Timms P. Omicron COVID-19 variant: Experts say vaccine protection against severe disease remains high, but spread will continue. Australian Broadcasting Corporation [Internet]. 15 Dec 2021 Date accessed 10 March 2023. Available from: https://www.abc.net.au/news/2021-12-15/omicron-variant-australia-covid-how-severe-vaccine-protection/100701012.
  34. 34. Corben P, Leask J. Vaccination hesitancy in the antenatal period: a cross-sectional survey. BMC public health. 2018;18(1):566. pmid:29716556
  35. 35. McDonald C, Leask J, Chad N, Danchin M, Fethney J, Trevena L. A Consent Support Resource with Benefits and Harms of Vaccination Does Not Increase Hesitancy in Parents-An Acceptability Study. Vaccines (Basel). 2020;8(3). pmid:32887503
  36. 36. Nyhan B, Reifler J. Does correcting myths about the flu vaccine work? An experimental evaluation of the effects of corrective information. Vaccine. 2015;33(3):459–64. pmid:25499651
  37. 37. Cohen J. Statistical Power Analysis for the Behavioral Sciences. New York: Routledge; 1988.
  38. 38. Milkman KL, Patel MS, Gandhi L, Graci HN, Gromet DM, Ho H, et al. A megastudy of text-based nudges encouraging patients to get vaccinated at an upcoming doctor’s appointment. Proceedings of the National Academy of Sciences of the United States of America. 2021;118(20). pmid:33926993
  39. 39. Pink SL, Chu J, Druckman JN, Rand DG, Willer R. Elite party cues increase vaccination intentions among Republicans. Proceedings of the National Academy of Sciences of the United States of America. 2021;118(32). pmid:34312254
  40. 40. Tironi PA, Barham E, Zuckerman Daly S, Gerez JE, Marshall J, Pocasangre O. Messages that increase COVID-19 vaccine acceptance: Evidence from online experiments in six Latin American countries. PloS one. 2021;16(10):e0259059. pmid:34710168
  41. 41. Amrhein V, Greenland S, McShane B. Scientists rise up against statistical significance. Nature. 2019;567(7748):305–7. pmid:30894741
  42. 42. Dryhurst S, Schneider CR, Kerr J, Freeman AL, Recchia G, Van Der Bles AM, et al. Risk perceptions of COVID-19 around the world. Journal of Risk Research. 2020;23(7–8):994–1006.
  43. 43. Dai H, Saccardo S, Han MA, Roh L, Raja N, Vangala S, et al. Behavioural nudges increase COVID-19 vaccinations. Nature. 2021;597(7876):404–9. pmid:34340242
  44. 44. Brehm SS, Brehm JW. Psychological Reactance: A Theory of Freedom and Control. Burlington: Elsevier Science; 2013.
  45. 45. Hornsey MJ, Harris EA, Fielding KS. The psychological roots of anti-vaccination attitudes: A 24-nation investigation. Health Psychol. 2018;37(4):307–15. pmid:29389158
  46. 46. Sprengholz P, Betsch C, Bohm R. Reactance revisited: Consequences of mandatory and scarce vaccination in the case of COVID-19. Appl Psychol Health Well Being. 2021;13(4):986–95. pmid:34032388
  47. 47. Albarracin D, Jung H, Song W, Tan A, Fishman J. Rather than inducing psychological reactance, requiring vaccination strengthens intentions to vaccinate in US populations. Scientific Reports. 2021;11(1):1–9.
  48. 48. Betsch C, Korn L, Holtmann C. Don’t try to convert the antivaccinators, instead target the fence-sitters. Proceedings of the National Academy of Sciences. 2015;112(49):E6725. pmid:26598650
  49. 49. Leask J. Target the fence-sitters. Nature. 2011;473(7348):443. pmid:21614055
  50. 50. Loosveldt G, Sonck N. An evaluation of the weighting procedures for an online access panel survey. Survey Research Methods. 2008;2(2).