Exposure to COVID-19 Vaccine Hesitancy Is as Impactful as Vaccine Misinformation in Inducing a Decline in Vaccination Intentions in New Zealand: Results from Pre-Post Between-Groups Randomized Block Experiment

Introduction

As of May 2021, more than 170 million people have been infected and 3.54 million have died due to the coronavirus disease (COVID-19) according to the World Health Organization (https://covid19.who.int). In an unprecedented scientific endeavor, a number of COVID-19 vaccines have been developed and are being currently administered in several countries only 1 year after the COVID-19 pandemic was declared in January 2020 (Zimmer et al., 2021).

Yet the challenge of public vaccination rates prevails with a significant proportion of the population hesitant or skeptical about the safety and the benefits of vaccination (de Figueiredo et al., 2020; Fadda et al., 2020; Palamenghi et al., 2020; Verger and Dubé, 2020; Motta et al., 2021). In a survey conducted in 19 countries, differences in COVID-19 vaccine acceptance ranged from 90% in Asian countries such as China to less than 55% in countries such as Russia (Lazarus et al., 2021). Health experts say that a high proportion of the population—with estimates ranging from 60% to 85%—need to be vaccinated to achieve herd or population immunity (Sanche, 2020).

A primary concern of health experts and governments is low public acceptance of a COVID-19 vaccine, even as new variants continue to add pressure on the healthcare workers. There is increasingly scholarly interest to identify factors that drive COVID-19 vaccination intentions so that health communication campaigns can address public concerns and improve vaccination rates (Kerr and Wilson, 2018; Freeman et al., 2021; Motta et al., 2021; Schwarzinger et al., 2021). Public concerns about COVID-19 vaccines include perceived side effects of the vaccine, long-term impact of vaccination, and perceived rush to approve a vaccine (Hotez et al., 2021).

These concerns are aided by widely circulating false or misleading information on social media platforms about the origins of the virus, distrust with government and experts, and risks and long-term effects of COVID-19 vaccine, among others (Vicario et al., 2016; Burki, 2019; Tokojima Machado et al., 2020). Up to two million flyers containing some of these allegations about the COVID-19 vaccines have been dropped in letterboxes across New Zealand by the “Voices of Freedom” group in May 2021 (Doyle, 2021).

New Zealand has been declared as one of the best countries that has dealt with the COVID-19 pandemic through tough border controls, contact tracing, and effective health communication (Roy, 2020; World Health Organization, 2020; Hong et al., 2021). Yet, about 40% of the population are either hesitant or skeptical towards COVID-19 vaccines (Authors). According to the New Zealand government’s Ministry of Health surveys, about 10% of the population say they will “definitely not” take a vaccine, with a further 20% unlikely to take one. Further 11% are unsure to take a vaccine (COVID-19: Vaccine research insights, 2021). The New Zealand government plans to start vaccinating the general public only in July 2021 and the current low rates of COVID-19 vaccination intent poses a challenge to the government’s largest vaccination program.

This study contributes to health communication research on COVID-19 in three unique ways. First, a majority of previous research has largely focused on how respondents’ demographic characteristics, values, beliefs, and knowledge are associated with COVID-19 vaccination intentions (Romer and Jamieson, 2020; Roozenbeek, 2020). Similarly, researchers have tested how lab-manufactured health messages shape public COVID-19 vaccination intentions, mostly through post-exposure items only (Freeman et al., 2021; Kerr et al., 2021; Motta et al., 2021; Schwarzinger et al., 2021). While important, they do not reflect real-world “infodemic”—the enormous amount of information including false or misleading information on COVID-19. Second, there are very few studies focusing on the impact of exposure to real-world misinformation on vaccination intentions using more robust pre-post experimental studies (Loomba et al., 2021). This study aims to bridge this gap.

Second, researchers have ignored if exposure to outright vaccine misinformation compared to exposure to vaccine hesitancy information differentially impacts public intentions for a COVID-19 vaccine. It is possible that outright vaccine misinformation, such as COVID-19 interfering with DNA, may be construed as unreal and rejected by a majority of the public. Yet, vaccine hesitancy information, such as the perceived rush to develop a COVID-19 vaccine compared to the long delay in developing other vaccines, may be construed as true and likely impact health behaviors. Indeed, Loomba and others (2021) found that exposure to information that highlights scientific imagery or links had the most impact on lowering vaccination intent among the public in the United States and United Kingdom.

Based on nationally representative data, this study tests if the impact of misinformation will be different from the impact of hesitancy information on COVID-19 vaccine intentions when compared to exposure to factual information by government health authorities. Moreover, as previous studies indicate that altruistic messaging could affect public acceptance of a vaccine [Loomba et al., 2021; also see (Rabb et al., 2021)], this study further differentiates between intentions to vaccinate to protect oneself and intentions to vaccinate to protect vulnerable groups, family, and friends.

For the purpose of this research, COVID-19 misinformation refers to false or misleading information that contradicts the best expert evidence available at the time (Vraga and Bode, 2020). In this study, widely circulated social media post about COVID-19 vaccines interfering with DNA is operationalized as misinformation. COVID-19 vaccine hesitancy is defined as reluctance or refusal to vaccinate despite its accessibility (MacDonald, 2015) and is operationalized in this study as information showcasing an individual’s story about hesitancy to a COVID-19 vaccine who is otherwise vaccine compliant. The key difference is that hesitancy may appear to be more authentic and accurate than compared to outright misinformation, thereby impacting vaccination intentions.

Materials and Methods

A nationally representative sample survey of the New Zealand adults (N = 1,083) was conducted between February 15 and March 6, 2021, to coincide with the vaccine rollout (https://www.health.govt.nz/our-work/diseases-and-conditions/covid-19-novel-coronavirus/covid-19-data-and-statistics/covid-19-vaccine-data). The web-based survey was fielded by Qualtrics, an international survey agency. Qualtrics maintains an active online panel that is representative of the target population (Qualtrics Panel, n.d.). The panelists receive an incentive such as a flat fee or discount gift card based on the length of the survey, their specific profile, and target acquisition difficulty.

Respondent quotas were set to match the official Census estimates on age, gender, education, and ethnicity. The sample demographics closely matched with the Census estimates on gender, age, and ethnicity but had a higher proportion of educated and fewer Pasifika respondents. The average time to complete the survey was 22 min. Ethics approval was filed at the (Massey) University’s human research review board and the study was determined to be exempt from a full review. Participants provided informed consent after reading the brief aims of the survey, namely, to understand public opinion about current issues facing the country and the world.

Study Design

The study design was a pre-post within- and between-groups design with a total of three conditions. Prior to the assignment, all respondents answered COVID-19 vaccination intentions. The respondents then answered other questions unrelated to the primary goal of the survey as a “distraction,” specifically questions related to sustainability attitudes and behaviors. Based on equal proportions of gender, ethnicity, education, and income, participants were randomly assigned to one of the three conditions: misinformation, hesitancy, and factual condition. After the exposure, participants were asked about their intentions to vaccinate against COVID-19 and the following post-only measures of self-reported change, believability, fact-check, and share information. The sample characteristics between the experimental and control conditions are given in Table 1 and show no significant differences in demographics between the three groups.

TABLE 1

TABLE 1. Demographic composition of the sample and experimental conditions.

After the survey, participants were debriefed with the following statement: “The aim of this study was to monitor your perceptions towards a COVID-19 vaccine and to assess whether the images we showed you changed your perceptions towards vaccinating. Some of the images we showed you are examples of online information that may contain either misleading or incorrect information about a COVID-19 vaccine. For up-to-date information surrounding the COVID-19 pandemic, please consult the government’s official information page: https://covid19.govt.nz/

Selection of Images

We surveyed popular misinformation on COVID-19 vaccines in New Zealand using the AFP Fact Check website for New Zealand and Pacific Islands that documents and corrects misinformation on a variety of issues (https://factcheck.afp.com/afp-new-zealand-and-pacific-islands). The following were chosen based on the criteria of prominence and popularity: 1) a widely shared vaccine misinformation social media post, included by a New Zealand political party, that the vaccine will interfere with genetic material (New Zealand party spreads misinformation about Covid-19 vaccines, 2020) and 2) a newspaper article in the national press detailing a mother’s concern to vaccinate son against COVID-19 who is otherwise vaccine compliant (Rindelaub, 2021). For control, we used a social media post from “Unite Against COVID,” a government Facebook page, announcing vaccine approval and rollout (see Supplementary Information).

The first misinformation post was selected because it was not only shared widely in New Zealand but also popular worldwide. The Center for Countering Digital Hate (2021) identified the source, Dr. Robert F. Kennedy Jr, as the second most important “Disinformation Dozen” spreading vaccine misinformation online. The second newspaper article is sourced from the most circulated newspaper in New Zealand, The New Zealand Herald, read by 54 percent of the population (New Zealand Herald, 2021). As such, the news would have been read widely by the New Zealand public. The third image was the first government announcement about the safety and regulatory approval of the vaccine.

While these selected experimental stimuli are not exhaustive of the universe of misinformation, hesitancy, and factual information from the government, they provide a model to test its impact on public intentions.

Respondents were primed to treat the exposure as information shared on social media: “Please read the information presented in the image and answer the following questions. While answering these questions, imagine that the image were shared by your friends, followers, or people you follow on any social media platform that you use.”

Measures

The primary outcome was the post-treatment measure of COVID-19 vaccination intention. The pre-treatment and post-treatment measures of COVID-19 vaccination intentions were the same and were adopted from previous studies (e.g., Loomba et al., 2021). Specifically, the respondents were asked, “When a coronavirus (COVID-19) vaccine becomes available—Would you accept the vaccine for yourself?” The responses were measured on a four-point scale from “Yes, definitely” (1), “Unsure, but leaning towards Yes” (2), “Unsure, but leaning towards No” (3), and “No, definitely not” (4). The mean pre-test score to vaccinate to protect oneself was 1.73 (SD = 0.99) and the mean post-test score was 1.56 (SD = 1.78). A higher score indicates higher vaccine hesitancy.

Similarly, respondents were asked, “When a coronavirus (COVID-19) vaccine becomes available—Would you accept the vaccine if it meant protecting friends, family, or at-risk groups?” The responses options were the same as above. The mean pre-test score was 1.56 (SD = 0.86) and mean post-test score was 1.66 (SD = 0.92).

The pre-test scores for intention to vaccinate to protect self and to protect others were significantly correlated (r = 0.87, p < 0.001). Similarly, post-test scores were also significantly correlated (r = 0.83, p < 0.001). All the four measures of pre-post scores to vaccinate for self and others were strongly correlated with each other (r’s ranged from 0.79 to 0.87, p < 0.001).

Self-Reported Change in Vaccination Intention

After exposure to the three conditions, respondents were asked “Overall, the information provided in this image makes me....” The responses were measured on a five-point scale from, “Much less inclined to be vaccinated” (1), “A little less inclined to be vaccinated” (2), “No less or more inclined to get vaccinated” (3), “A little more inclined to get vaccinated” (4), and “Much more inclined to get vaccinated” (5).

Believability of Information

Respondents were asked, “Overall, how likely are you to believe the information presented in this image.” The responses were measured on a five-point scale from “Extremely likely” (1) to “Extremely unlikely” (5). The responses were reverse coded so that a higher value would indicate respondents were more likely to believe in the information presented.

Fact-Check Information

Respondents were asked, “Overall, how likely are you to fact-check the information in this image via other sources?” The responses were measured on a five-point scale from, “Extremely likely” (1) to “Extremely unlikely” (5). The responses were reverse coded so that a higher value would indicate greater intention to fact-check the information.

Share Information

Respondents were asked, “Overall, how likely are you to share this image with your friends or followers?” The responses were measured on a five-point scale from “Extremely likely” (1) to “Extremely unlikely” (5). The responses were reverse coded so that a higher value would indicate greater intention to share information.

Statistical Analyses

To check for similar composition between the conditions on demographics and intentions on COVID-19 vaccine pre-exposure, a one-way analysis of variance (ANOVA) was used. To test differences across the conditions on intentions to take a vaccine to protect self was statistically significant, an analysis of covariance (ANCOVA) was conducted with the post-test vaccination intention as the dependent variable, experimental condition as the independent variable, and the pre-test vaccination intention as the covariate. A similar strategy was followed to test if exposure to experimental conditions differentially impacted intentions to take a vaccine to protect others. Additional robustness checks were conducted using ANOVA on post-test only measures of self-reported change in vaccination intention, believability in information, intentions to fact-check, and willingness to share information.

Less than 1% of the data contained missing values, with the largest missing values for willingness to share information (n = 16): these respondents were equally distributed across the misinformation (n = 5), hesitancy (n = 7), and control (n = 4) conditions. According to Jakobsen et al. (2017, p.3) “Complete case analysis may be used as the primary analysis if the proportions of missing data are below approximately 5%....” Therefore, missing values were excluded from the analysis.

These analyses were conducted using IBM SPSS version 27.

Results

There was no significant difference in gender, age, education, and ethnicity between the three conditions (see Table 1). Similarly, there was no significant difference between the three conditions on pre-test measure of intention to vaccinate against COVID-19 to protect self [F (2, 1,079) = 1.10, p = 0.33] and intention to vaccinate against COVID-19 to protect others [F (2, 1,079) = 1.61, p = 0.20]. These findings show that the composition of the three groups was similar on demographics and COVID-19 vaccination intentions before exposure.

As a manipulation check, respondents were asked, “Which of the following statements best represents information in the image?” The response options were, “Information is supportive of getting vaccinated for COVID-19” and “Information is opposed to getting vaccinated against COVID-19.” There was a significant difference between the two experimental conditions and control on correctly identifying if the information in the image was supportive or opposed to getting vaccinated against COVID-19 [χ² (2) = 436.008, p <. 001]. A large majority of respondents in both the misinformation (75%) and hesitancy condition (64%) said that the information is opposed to getting vaccinated, whereas almost all respondents in the factual information control (97%) said information was supportive of getting vaccinated against COVID-19.

Descriptive within-subject differences in COVID-19 vaccination intention for self are reported in Figure 1 and COVID-19 vaccination intention to protect others are shown in Figure 2. They show that both the misinformation and hesitancy exposure conditions increased vaccine hesitancy compared to the control group.

FIGURE 1

FIGURE 1. Mean (pre-post) difference in COVID-19 vaccination intentions to protect self by treatment groups: misinformation (M = 0.09, 95% CI 0.03–0.14), hesitancy (M = 0.08, 95% CI 0.04–0.13), and control (M = −0.02, 95% CI −0.06–0.02). Error bars represent 95% confidence intervals.

FIGURE 2

FIGURE 2. Mean (pre-post) difference in COVID-19 vaccination intentions to protect others by treatment groups: misinformation (M = 0.14, 95% CI 0.07–0.20), hesitancy (M = 0.12, 95% CI 0.07–0.17), and control (M = 0.05, 95% CI 0.01–0.09). Error bars represent 95% confidence intervals.

The ANCOVA revealed a significant main effect of the treatments on COVID-19 vaccination intention to protect self [F (2, 1,074) = 7.50, p < 0.001, η_p² = 0.02]. Post hoc multiple comparisons using the Bonferroni adjusted marginal means indicated that vaccine hesitancy was higher in the misinformation condition (x̅ = 0.11, SE = 0.03, p < 0.01, d = 0.14) compared to the control. Vaccine hesitancy was also higher in the hesitancy condition compared to the control (x̅ = 0.11, SE = 0.03, p < 0.01, d = 0.21). There was no significant difference between the misinformation and hesitancy conditions (x̅ = 0.004, p = 1.00, d = 0.06).

In addition, there was no change in the above reported results after accounting for demographic variables. Among demographic variables, the more educated were less hesitant (B = −0.05, SE = 0.01, t = −3.361, p < 0.001). Compared to European New Zealanders, the Pasifika were more hesitant to take a COVID-19 vaccine to protect themselves (B = −0.22, SE = 0.07, t = −3.14, p < 0.01). There was no significant difference for the Māori (B = 0.04, SE = 0.04, p = 0.31) and Asians (B = −0.01, SE = 0.03, p = 0.72), compared to European New Zealanders. There was no significant association between gender (B = 0.01, SE = 0.03, p = 0.63), age (B = −0.01, SE = 0.01, p = 0.38) and income (B = −0.02, SE = 0.01, p = 0.05) with intention to vaccinate to protect self.

Similarly, ANCOVA revealed a significant main effect of the treatments on COVID-19 vaccination intentions to protect others [F (2, 1,072) = 5.74, p < 0.01, η_p² = 0.01]. Post hoc multiple comparisons indicated that vaccine hesitancy was higher in the misinformation condition (x̅ = 0.12, SE = 0.04, p < 0.01, d = 0.15) compared to the control. Vaccine hesitancy was also higher in the hesitancy condition compared to the control (x̅ = 0.11, SE = 0.04, p < 0.05, d = 0.20). There was no significant difference between the misinformation and hesitancy conditions (x̅ = 0.01, p = 1.00, d = 0.04).

There was no change in the above findings after including demographic variables in the model. Among demographic variables, only age was significantly associated with intentions to vaccinate to protect others, with older respondents less likely to vaccinate to protect others compared to younger respondents (B = −0.02, SE = 0.01, t = −2.43, p < 0.05). Gender (B = −0.02, SE = 0.03, p = 0.57), education (B = −0.03, SE = 0.02, p = 0.08), income (B = −0.01, SE = 0.01, p = 0.25), and ethnicity was not significantly associated with intention to vaccinate to protect others.

As additional robustness checks, we examined association between exposure to treatment conditions and several post-test only measures. There was a significant main effect of experimental conditions on self-reported change in willingness to get a COVID-19 vaccine, F (2, 1,064) = 32.70, p < 0.001. Post hoc comparisons using Games-Howell test indicated that perceived change in willingness to get a COVID-19 vaccine was lower in misinformation (M = 3.10, SD = 1.15, p < 0.001, d = 0.49) and hesitancy (M = 3.06, SD = 0.97, p < 0.001, d = 0.57) conditions compared to the control condition (M = 3.64, SD = 1.09), respectively. There was no significant difference between the misinformation and hesitancy conditions (p = 0.89).

There was a significant main effect of condition on believability of information presented in the image, F (2, 1,076) = 171.79 p < 0.001. Post hoc comparisons indicated that believability was the lowest in misinformation (M = 2.53, SD = 1.36, p < 0.001, d = 1.33) and hesitancy (M = 3.31, SD = 1.05, p < 0.001, d = 0.79) conditions compared to the control condition (M = 4.11, SD = 0.98). There was also significant difference between the misinformation and hesitancy conditions (p < 0.001, d = 0.64) such that the respondents in the hesitancy conditions were more likely to believe in the information presented in the image. There was no significant difference between the conditions on fact-checking information presented in the image, F (2, 1,072) = 0.09, p = 0.91.

There was a significant main effect of condition on self-reported intention to share the image with friends and followers, F (2, 1,069) = 36.17, p < 0.001. Post hoc comparisons indicated that respondents in misinformation (M = 2.26, SD = 1.36, p < 0.001, d = 0.61) and hesitancy (M = 2.54, SD = 1.25, p < 0.001, d = 0.41) conditions were less likely to share with friends and followers compared to the control condition (M = 3.08, SD = 0.1.30). Respondents were more likely to share information in the hesitancy condition than the misinformation condition (p = 0.01, d = 0.21) (Figure 3).

FIGURE 3

FIGURE 3. Mean post-measure between conditions on (A) self-reported change in COVID-19 vaccination intentions, (B) belief in information, (C) fact-check information, and (D) sharing information with family and friends. All the above variables were measured on a five-point scale. Error bars represent 95% confidence intervals.

Discussion

A unique contribution of this study is that not only exposure to outright vaccine misinformation (COVID-19 vaccine interfering with DNA) but also exposure to vaccine hesitancy can reduce COVID-19 vaccination intentions to protect self and protect others, compared to control. This finding is robust and is based on pre-post change in COVID-19 vaccination intention as well as post-test only self-reported change in vaccination intention measure. In addition, there was no difference between exposure to hesitancy information and exposure to vaccine misinformation in the self-reported change in vaccination intentions.

Previous research has largely tested if exposure to lab-generated persuasive health messages results in a change in vaccination intentions, including vaccine characteristics and benefits for self and others (Freeman et al., 2021; Kerr et al., 2021; Motta et al., 2021; Schwarzinger et al., 2021). Moreover, a majority of these studies focus on post-test measures only, which may not control for differences in intentions prior to exposure. In contrast, a few studies examine how real-world vaccine information exposure affects vaccination intentions (Loomba et al., 2021). Exposure to vaccine hesitancy information is as potent as exposure to outright misinformation in reducing public intentions for a COVID-19 vaccine.

Respondents who were exposed to hesitant information were more likely to believe the information and share it among family and friends compared to respondents exposed to misinformation, however. While beyond the scope of this research, one of the possible pathways through which hesitancy affects vaccine intentions is by being more believable compared to outright misinformation, thereby increasing the shareability of information among family and friends. Previous research indicates that social norms or perceived popularity of behaviors (descriptive norms) and expectations from significant others to follow such behaviors (injunctive norms) play an important role in public health behaviors (Rimal and Lapinski, 2015; Rimal and Storey, 2020). Dissemination of information among social networks is likely to affect how individuals perceive what significant others are doing, thereby affecting their own behavior. For example, Motta and others (2021) found that “ordinary people” communicating the personal risks and collective benefits of COVID-19 vaccination were comparatively more effective than medical experts communicating such messages.

Limitations

One of the limitations of the study is the lack of equivalence between the message conditions, even though all the respondents were primed to respond to them as seen in their social media feed. Unlike lab experiments, real-world misinformation about vaccines is likely to be different in content, structure, and visuals. Nonetheless, future research should test for equivalency between treatment conditions for exposure to hesitancy and exposure to misinformation on vaccination intentions. Moreover, none of the previous studies evaluated the longitudinal impact of exposure to misinformation and hesitancy, including this article. There is a need to evaluate how exposure to misinformation and hesitancy affects in the long term. Previous research indicates that even brief exposure to misinformation can lead to long-term false memories (Zhu, 2012). Therefore, there is a need to continuously assess if intentions shift with the vaccine rollout as news stories about evidence about the efficacy of the vaccine as well anecdotal stories about vaccine side effects are likely to influence vaccination intentions.

Another limitation is the Hawthorne effect, which we tried to minimize by asking questions unrelated to the study between the pre- and post-vaccine intention measures so that participants are less likely to remember their initial choice. Previous meta-analyses indicate the risk of such bias on health-related behaviors may be small and overestimated (Rodrigues et al., 2015). Future research can ask respondents after a few days or weeks of being exposed to the experimental stimulus. Finally, additional variables of attitudes towards vaccines, trust in government, and social norms should be evaluated in future research.

Conclusion

Implications of this study are important not just for New Zealand, which has scheduled vaccination for the general public starting in July 2021, but also for other countries where after the initial rush, vaccination rates have been stagnant (Caldwell, 2021; Pelley and Warren, 2021). For example, Israel (Law, 2021) was one of the first countries to quickly vaccinate its citizens but the proportion of the population receiving at least one dose of vaccine has been at 60% from March 2021 (https://ourworldindata.org/covid-vaccinations). Reaching herd or population immunity now lies in the arms of the vaccine-hesitant. Misinformation correction campaigns should not only focus on outright misinformation but also on vaccine hesitancy, such as side effects, the need for vaccination across age groups, and clarifying the extremely rare risks associated with vaccines. Public health officials should not hesitate to transparently inform people of the limitations of vaccinations either, providing them with an authoritative resource rather than driving them to alternative sources that may misinform the public. A recent study shows that transparent communication does not reduce intentions to be vaccinated against COVID-19 (Kerr et al., 2021).

Messages addressing individuals’ concerns, through messengers they trust, are likely to help overcome vaccine hesitancy and improve COVID-19 vaccination rates (Motta et al., 2021).

Data Availability Statement

The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.

Ethics Statement

This project has been evaluated by peer review and judged to be low risk. Consequently, it has not been reviewed by one of the University’s Human Ethics Committees. The researchers named in this document are responsible for the ethical conduct of this research. If you have any concerns about the conduct of this research that you want to raise with someone other than the researchers, please contact Professor Craig Johnson, Director-Ethics, telephone: 06 3569099 ext 85271, email: humanethics@massey.ac.nz. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

JT conceived the study, was responsible for the fielding of the survey, and wrote the article. AS helped with the data analysis.

Funding

Massey University provided funding for data collection.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fcomm.2021.721982/full#supplementary-material

References

Burki, T. (2019). Vaccine Misinformation and Social media. Lancet Digit Health 1 (6), e258–e259. doi:10.1016/S2589-7500(19)30136-0

CrossRef Full Text | Google Scholar

Caldwell, T. (2021). The Slowing Covid-19 Vaccination Rate Is Worrying Experts. Here’s what Some States Are Doing to Change the Trend. CNN. Available at: https://www.cnn.com/2021/06/05/health/us-coronavirus-saturday/index.html (Accessed June 7, 2021).

Google Scholar

Center for Countering Digital Hate (2021). The Disinformation Dozen. Available at: https://252f2edd-1c8b-49f5-9bb2-cb57bb47e4ba.filesusr.com/ugd/f4d9b9_b7cedc0553604720b7137f8663366ee5.pdf (Accessed July 13, 2021).

Google Scholar

COVID-19: Vaccine research insights (2021). COVID-19: Vaccine Research Insights. Minist. Health N. Z. Available at: https://www.health.govt.nz/our-work/diseases-and-conditions/covid-19-novel-coronavirus/covid-19-vaccines/covid-19-vaccine-strategy-planning-insights/covid-19-vaccine-research-insights (Accessed June 7, 2021).

Google Scholar

de Figueiredo, A., Simas, C., Karafillakis, E., Paterson, P., and Larson, H. J. (2020). Mapping Global Trends in Vaccine Confidence and Investigating Barriers to Vaccine Uptake: a Large-Scale Retrospective Temporal Modelling Study. The Lancet 396, 898–908. doi:10.1016/S0140-6736(20)31558-0

CrossRef Full Text | Google Scholar

Del Vicario, M., Bessi, A., Zollo, F., Petroni, F., Scala, A., Caldarelli, G., et al. (2016). The Spreading of Misinformation Online. Proc. Natl. Acad. Sci. U S A. 113, 554–559. doi:10.1073/pnas.1517441113

PubMed Abstract | CrossRef Full Text | Google Scholar

Doyle, K. (2021). Misinformation on Covid-19 Vaccines Dropped in Letterboxes. RNZ. Available at: https://www.rnz.co.nz/news/national/441968/misinformation-on-covid-19-vaccines-dropped-in-letterboxes (Accessed June 1, 2021).

Google Scholar

Fadda, M., Albanese, E., and Suggs, L. S. (2020). When a COVID-19 Vaccine Is Ready, Will We All Be Ready for it? Int. J. Public Health 65, 711–712. doi:10.1007/s00038-020-01404-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Freeman, D., Loe, B. S., Yu, L.-M., Freeman, J., Chadwick, A., Vaccari, C., et al. (2021). Effects of Different Types of Written Vaccination Information on COVID-19 Vaccine Hesitancy in the UK (OCEANS-III): a Single-Blind, Parallel-Group, Randomised Controlled Trial. The Lancet Public Health 6, e416–e427. doi:10.1016/S2468-2667(21)00096-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Hong, J., Chang, R., and Varley, K. (2021). These Are the Best Places to Be during Covid. Bloomberg.Com. Available at: https://www.bloomberg.com/graphics/covid-resilience-ranking/(Accessed June 7, 2021).

Google Scholar

Hotez, P. J., Cooney, R. E., Benjamin, R. M., Brewer, N. T., Buttenheim, A. M., Callaghan, T., et al. (2021). Announcing the Lancet Commission on Vaccine Refusal, Acceptance, and Demand in the USA. The Lancet 397, 1165–1167. doi:10.1016/S0140-6736(21)00372-X

CrossRef Full Text | Google Scholar

Jakobsen, J. C., Gluud, C., Wetterslev, J., and Winkel, P. (2017). When and How Should Multiple Imputation Be Used for Handling Missing Data in Randomised Clinical Trials - a Practical Guide with Flowcharts. BMC Med. Res. Methodol. 17, 162. doi:10.1186/s12874-017-0442-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Kerr, J. R., Freeman, A. L. J., Marteau, T. M., and van der Linden, S. (2021). Effect of Information about Covid-19 Vaccine Effectiveness and Side Effects on Behavioural Intentions: Two Online Experiments. Vaccines 9, 379. doi:10.3390/vaccines9040379

PubMed Abstract | CrossRef Full Text | Google Scholar

Kerr, J. R., and Wilson, M. S. (2018). Perceptions of Scientific Consensus Do Not Predict Later Beliefs about the Reality of Climate Change: A Test of the Gateway Belief Model Using Cross-Lagged Panel Analysis. J. Environ. Psychol. 59, 107–110. doi:10.1016/j.jenvp.2018.08.012

CrossRef Full Text | Google Scholar

Law, T. (2021). Israel’s COVID-19 Vaccination Rollout Is Slowing at a Critical Moment. That’s a Warning for the Rest of Us. Time. Available at: https://time.com/5947967/israel-covid-vaccine-rollout/(Accessed June 8, 2021).

Google Scholar

Lazarus, J. V., Ratzan, S. C., Palayew, A., Gostin, L. O., Larson, H. J., Rabin, K., et al. (2021). A Global Survey of Potential Acceptance of a COVID-19 Vaccine. Nat. Med. 27, 225–228. doi:10.1038/s41591-020-1124-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Loomba, S., de Figueiredo, A., Piatek, S. J., de Graaf, K., and Larson, H. J. (2021). Measuring the Impact of COVID-19 Vaccine Misinformation on Vaccination Intent in the UK and USA. Nat. Hum. Behav. 5, 337–348. doi:10.1038/s41562-021-01056-1

PubMed Abstract | CrossRef Full Text | Google Scholar

MacDonald, N. E. (2015). Vaccine Hesitancy: Definition, Scope and Determinants. Vaccine 33, 4161–4164. doi:10.1016/j.vaccine.2015.04.036

PubMed Abstract | CrossRef Full Text | Google Scholar

Motta, M., Sylvester, S., Callaghan, T., and Lunz-Trujillo, K. (2021). Encouraging Covid-19 Vaccine Uptake through Effective Health Communication. Front. Polit. Sci. 3. doi:10.3389/fpos.2021.630133

CrossRef Full Text | Google Scholar

New Zealand Herald (2021). NZ Herald Readership Hits New High. stoppress.co.nz. Available at: https://www.nzherald.co.nz/nz/nz-herald-readership-hits-new-high-herald-on-sunday-cracks-400000-readers-and-kiwis-flock-to-herald-magazines/EROGHC3JJYEDHWOESBEAURVI4Q/ (Accessed July 13, 2021).

Google Scholar

New Zealand party spreads misinformation about Covid-19 vaccines (2021). Attributed to Robert F Kennedy Jr | Fact Check (2020). Available at: https://factcheck.afp.com/new-zealand-party-spreads-misinformation-about-covid-19-vaccines-attributed-robert-f-kennedy-jr (Accessed June 7, 2021).

Google Scholar

Palamenghi, L., Barello, S., Boccia, S., and Graffigna, G. (2020). Mistrust in Biomedical Research and Vaccine Hesitancy: the Forefront challenge in the Battle against COVID-19 in Italy. Eur. J. Epidemiol. 35, 785–788. doi:10.1007/s10654-020-00675-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Pelley, L., and Warren, E. (2021). Canada Now Among Top Countries for 1st Doses of COVID-19 Vaccines. So How High Can We Go? | CBC News. CBC. Available at: https://www.cbc.ca/news/health/canada-now-among-top-countries-for-1st-doses-of-covid-19-vaccines-so-how-high-can-we-go-1.6050268 (Accessed June 7, 2021).

Google Scholar

Rabb, N., Glick, D., Houston, A., Bowers, J., and Yokum, D. (2021). No Evidence that Collective-Good Appeals Best Promote COVID-Related Health Behaviors. Proc. Natl. Acad. Sci. USA 118, e2100662118. doi:10.1073/pnas.2100662118

PubMed Abstract | CrossRef Full Text | Google Scholar

Rimal, R. N., and Lapinski, M. K. (2015). A Re-explication of Social Norms, Ten Years Later. Commun. Theor. 25, 393–409. doi:10.1111/comt.12080

CrossRef Full Text | Google Scholar

Rimal, R. N., and Storey, J. D. (2020). Construction of Meaning during a Pandemic: The Forgotten Role of Social Norms. Health Commun. 35, 1732–1734. doi:10.1080/10410236.2020.1838091

PubMed Abstract | CrossRef Full Text | Google Scholar

Rindelaub, J. (2021). On Covid Vaccines, Please Listen to Scientists, Not Random Accountants. The Spinoff. Available at: https://thespinoff.co.nz/science/02-02-2021/on-covid-vaccines-please-listen-to-scientists-not-random-accountants/(Accessed June 7, 2021).

Google Scholar

Rodrigues, A. M., O'Brien, N., French, D. P., Glidewell, L., and Sniehotta, F. F. (2015). The Question-Behavior Effect: Genuine Effect or Spurious Phenomenon? A Systematic Review of Randomized Controlled Trials with Meta-Analyses. Health Psychol. 34, 61–78. doi:10.1037/hea0000104

PubMed Abstract | CrossRef Full Text | Google Scholar

Romer, D., and Jamieson, K. H. (2020). Conspiracy Theories as Barriers to Controlling the Spread of COVID-19 in the U.S. Soc. Sci. Med. 263, 113356. doi:10.1016/j.socscimed.2020.113356

PubMed Abstract | CrossRef Full Text | Google Scholar

Roozenbeek, J., Schneider, C. R., Dryhurst, S., Kerr, J., Freeman, A. L. J., Recchia, G., et al. (2020). Susceptibility to Misinformation about COVID-19 Around the World. R. Soc. Open Sci. 7, 201199. doi:10.1098/rsos.201199

PubMed Abstract | CrossRef Full Text | Google Scholar

Roy, E. (2020). Three Quarters of New Zealand Public Intend to Get Covid Vaccine, Study Finds. The Guardian. Available at: http://www.theguardian.com/world/2020/aug/20/three-quarters-of-new-zealand-public-intend-to-get-covid-vaccine-study-finds (Accessed June 7, 2021).

Google Scholar

Sanche, S., Lin, Y. T., Xu, C., Romero-Severson, E., Hengartner, N., and Ke, R. (2020). High Contagiousness and Rapid Spread of Severe Acute Respiratory Syndrome Coronavirus 2. Emerg. Infect. Dis. 26, 1470–1477. doi:10.3201/eid2607.200282

PubMed Abstract | CrossRef Full Text | Google Scholar

Schwarzinger, M., Watson, V., Arwidson, P., Alla, F., and Luchini, S. (2021). COVID-19 Vaccine Hesitancy in a Representative Working-Age Population in France: a Survey experiment Based on Vaccine Characteristics. The Lancet Public Health 6, e210–e221. doi:10.1016/S2468-2667(21)00012-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Tokojima Machado, D. F., de Siqueira, A. F., and Gitahy, L. (2020). Natural Stings: Selling Distrust about Vaccines on Brazilian Youtube. Front. Commun. 5. doi:10.3389/fcomm.2020.577941

CrossRef Full Text | Google Scholar

Verger, P., and Dubé, E. (2020). Restoring Confidence in Vaccines in the COVID-19 Era. Expert Rev. Vaccin. 19, 991–993. doi:10.1080/14760584.2020.1825945

CrossRef Full Text | Google Scholar

Vraga, E. K., and Bode, L. (2020). Defining Misinformation and Understanding its Bounded Nature: Using Expertise and Evidence for Describing Misinformation. Polit. Commun. 37, 136–144. doi:10.1080/10584609.2020.1716500

CrossRef Full Text | Google Scholar

World Health Organization (2020). New Zealand Takes Early and Hard Action to Tackle COVID-19. Available at: https://www.who.int/westernpacific/news/feature-stories/detail/new-zealand-takes-early-and-hard-action-to-tackle-covid-19 (Accessed October 20, 2020).

Google Scholar

Zhu, B., Chen, C., Loftus, E. F., He, Q., Chen, C., Lei, X., et al. (2012). Brief Exposure to Misinformation Can lead to Long-Term False Memories. Appl. Cognit. Psychol. 26, 301–307. doi:10.1002/acp.1825

CrossRef Full Text | Google Scholar

Zimmer, C., Corum, J., and Wee, S.-L. (2021). Coronavirus Vaccine Tracker. N. Y. Times. Available at: https://www.nytimes.com/interactive/2020/science/coronavirus-vaccine-tracker.html (Accessed February 24, 2021).doi:10.5962/bhl.title.10255

CrossRef Full Text | Google Scholar