Skip to main content

BRIEF RESEARCH REPORT article

Front. Public Health, 04 July 2022
Sec. Digital Public Health

Utilizing Internet Search Volume to Monitor Stages of Change in Vaccine Hesitancy During the COVID-19 Outbreaks

\nYu-Tung LanYu-Tung Lan1Shiow-Ing WuShiow-Ing Wu2Yu-Hsuan Lin,,,
Yu-Hsuan Lin2,3,4,5*
  • 1Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, United States
  • 2Institute of Population Health Sciences, National Health Research Institutes, Miaoli, Taiwan
  • 3Department of Psychiatry, National Taiwan University Hospital, Taipei, Taiwan
  • 4Department of Psychiatry, College of Medicine, National Taiwan University, Taipei, Taiwan
  • 5Institute of Health Behaviors and Community Sciences, College of Public Health, National Taiwan University, Taipei, Taiwan

Real-time vaccine hesitancy surveillance is needed to better understand changes in vaccination behaviors. We aim to understand the association between coronavirus disease 2019 (COVID-19) outbreaks and population vaccine hesitancy and to monitor the dynamic changes in vaccination behaviors. We used the autoregressive integrated moving average model to examine the association between daily internet search volume for vaccines and two waves of COVID-19 local outbreaks in Taiwan from 19 March to 25 May, 2021. During the small-scale outbreak, the search volume increased significantly for 7 out of 22 days with an average increase of 17.3% ± 10.7% from the expected search volume. During the large-scale outbreak, the search volume increased significantly for 14 out of 14 days, with an average increase of 58.4% ± 14.7%. There was a high correlation between the search volume and the number of domestic cases (r = 0.71, P < 0.001). Google Trends serves as a timely indicator to monitor the extent of population vaccine willingness.

Introduction

Vaccination is critical to prevent serious illness and obtain herd immunity from coronavirus disease 2019 (COVID-19), yet vaccine hesitancy is a major threat to reaching those goals. In addition to identifying vaccine-hesitant people, there is a spectrum of hesitancy among those unvaccinated, ranging from resistant, through neutral and receptive to avidly seeking (1). This spectrum can be framed as a health-seeking behavior with different stages of change, including pre-contemplation, contemplation, and preparation—before finally taking action (2). Until late April 2021, Taiwan was often cited as a model of pandemic control despite its low vaccination rate; but beginning on 20 April, the country has been facing a mass transmission event. The dynamic changes in vaccine willingness demonstrated a longitudinal model different from previous findings reported in cross-sectional surveys.

Emerging studies based on infodemiology have shown to be a powerful tool in public health research (38). With the benefits of high temporal resolution and real-time collection of data, it is possible to monitor population health behaviors in a time-sensitive manner. A previous study had used internet search data to accurately estimate where and when the influenza outbreak would be (6). There was also a study using Google Trends to identify seasonal depression on a global scale (7). In addition, our previous multinational longitudinal study found that increased internet search for insomnia were an important indicator of mental health burden during the COVID-19 pandemic (8). In the current study, we aim to investigate the temporal association between the number of domestic COVID-19 cases and the vaccine willingness in Taiwan by internet search data.

Methods

Daily confirmed COVID-19 cases, including domestic and imported cases, and the cumulative vaccination rate were obtained from the Taiwan Centers for Disease Control (9). Utilizing data from Google Trends, we used daily search for “疫苗” (yimiao), the Mandarin word for “vaccine,” from 19 March 2021 to 25 May 2021, as a surrogate for the Taiwanese vaccine willingness. This period includes three significant events: a vaccination campaign starting on 22 March, a small-scale local outbreak starting on 20 April, and a large-scale local outbreak beginning on 12 May. Then, we selected 3 months (19 December 2020 to 18 March 2021) before the vaccination campaign as the baseline for future search volume prediction. The 3-month baseline was selected to inform our prediction since a longer time window could be contaminated by other past relevant events. The search category was set to all categories.

Google Trends does not provide information on the absolute number of search. Instead, it provides a relative search value to display search activity for a given term according to a specific period, time, and area. Each data point is divided by the total search of the geography and time range it represents to compare relative popularity. This value is scaled from 0 to 100. A value of 100 is the peak popularity of the term, while a value of 50 means that the term is half as popular in a given period with search volumes for the days given relative to this.

We estimated the expected daily search volume using Hyndman and Khandakar's algorithm for the autoregressive integrated moving average (ARIMA) model (10). ARIMA model is a forecasting algorithm that uses time-series data to predict future trends. Using the daily search data from 19 December 2020 to 18 March 2021, we forecasted the expected daily search volume of a counterfactual scenario in which two waves of local outbreaks had not occurred from 19 March 2021 to 25 May 2021. We then examined the number of days with the observed daily search volume being higher than the upper limit of the 95% confidence interval of the expected search volume. In addition, Pearson's correlation coefficient test was performed to examine the association between daily search volume for “疫苗” and daily confirmed domestic and imported cases. Statistical analyses were performed using R software, version 3.6.1.

Results

The search volume and the number of domestic cases were highly correlated (r = 0.71, P < 0.001). Figure 1A shows that a low search volume for “疫苗” corresponds to the low number of domestic COVID-19 cases (Figure 1B) until April 20, 2021, even though vaccination began during this period. The search volume increased significantly for 7 out of 22 days during the small-scale outbreak (20 April to 11 May, 2021), with an average increase of 17.3 ± 10.7% from the expected search volume. During the large-scale outbreak (12–25 May), the search volume significantly increased for 14 out of 14 days, with an average increase of 58.4 ± 14.7% from the expected search volume. However, the search volume was less associated with the number of imported COVID-19 cases (r = 0.33, P = 0.006), which stayed mainly the same during the study period.

FIGURE 1
www.frontiersin.org

Figure 1. Internet search volume of “vaccine” in Taiwan from 19 December 2020 to 25 May 2021, the number of daily confirmed COVID-19 cases, and the cumulative vaccination doses administered during this time period. (A) The relative search volume for “vaccine”. The gray area indicates the 95% confidence interval of the expected search volume (black line). The first dotted line corresponds to the start of vaccination on March 22. The second dotted line corresponds to the start of the small-scale outbreak on April 20. The third dotted line corresponds to the start of the large-scale outbreak on May 12. (B) The log-transformed number of daily confirmed domestic (in blue) and imported (in gray) cases from 19 December 2020 to 25 May 2021. (C) The cumulative vaccination doses administered from 22 March 2021 (when vaccination began) to 25 May 2021.

Figure 1C shows the cumulative vaccine doses administered in Taiwan by date. Before the two local outbreaks, fewer than 35,000 doses were administered. After the small-scale outbreak and before the large-scale outbreak, more than 95,000 doses were administered over 22 days. From the start of the large-scale outbreak until the end of the study (14 days), almost 190,000 doses were administered.

Discussion

To the best of our knowledge, this is the first study using real-time population-level data to investigate the association between domestic outbreaks and population vaccine willingness. Our study found that Taiwanese vaccine willingness was associated with local outbreaks rather than the beginning of the vaccination campaign or imported COVID-19 cases. These findings suggest that the internet search volume for “疫苗” serves as a timely indicator to monitor the extent of population vaccine willingness and the dynamics through three time periods corresponding to Prochaska's behavior change model (2).

Being vaccinated is a health-seeking behavior and could be framed by the stage of change model to become vaccinated (11). During the first month of the vaccination campaign, the search volume and the vaccination rates were very low despite a sufficient amount of vaccines being available, indicating that most Taiwanese were at the stage of pre-contemplation. During the small-scale outbreak, the search volume and vaccination rates increased. However, less than one-third of the days in this period showed significantly higher search volume compared to the baseline. The top related query for vaccines on Google Trends was the side effects of vaccination. These search patterns suggest that the public was aware of the threat of COVID-19 and started to weigh the risks and benefits of vaccination but had not yet taken action during this contemplation stage. During the large-scale outbreak, there was a significant increase in the search volume for “疫苗”, as well as the national vaccination rates. The related queries, including vaccine appointments and information related to the AstraZeneca vaccine (the only vaccine available in Taiwan at that time), suggested that the public was in the preparation/action stage.

Vaccine hesitancy is a delay in acceptance or refusal of vaccination despite the availability of vaccination services (12). It can be influenced by factors such as complacency, confidence, and convenience. Thus, as risk perceptions increase, vaccine acceptance is likely to increase as well. Previous studies had found a positive association between the two (13, 14). In the current study, it is possible that Taiwanese' vaccine willingness increased due to other factors besides domestic confirmed cases; yet, given adequate vaccines in the first month of vaccination and the top related query alongside “疫苗”, it is more likely that vaccine willingness was related to local outbreaks.

This study utilizes daily internet search data to demonstrate the dynamic change in vaccine willingness through the two waves of COVID-19 local outbreaks. We show a higher temporal resolution compared to previous longitudinal studies, in which self-reported questionnaires with intervals of several weeks to months were the primary way to gain information (15). Therefore, our findings were able to sensitively detect changes in vaccine willingness through the two waves of outbreaks that happened within one month. In addition, the vaccine willingness was associated with the local outbreaks rather than the beginning of the national vaccination campaign or imported COVID-19 cases. This supports the idea that messaging to the public is more effective when addressing personal benefits (e.g., preventing serious illness) rather than collective benefits (e.g., obtaining herd immunity) (16). However, as Google Trends is a type of crowdsourcing data, it is inherent to the limitations raised by using these databases (1720). First, the search for “疫苗” may not reflect the willingness to vaccination. Factors other than local outbreaks, such as the advertisement of vaccination on media and the reported side effects of vaccination, may influence internet search behaviors. Second, Google Trends does not represent a random sampling of the population and may exclude the vulnerable group with limited access to the internet. Third, since Google Trends represents population data, we were unable to determine the demographic and socioeconomic status of each conducting the search. Thus, crowdsourcing is not meant to replace but supplement traditional methods in public health surveillance. Nevertheless, the collective phenomenon of internet search behavior can be a meaningful tool to monitor vaccine willingness at the population level. Further research is needed to clarify the findings of this study, including the relationship between domestic cases and vaccination willingness and interventions to reduce vaccine hesitancy, based on the stages of change model.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Author Contributions

Y-TL, Y-HL, and S-IW: conceptualized the study and analyzed and interpreted the data. Y-TL and Y-HL: drafted the manuscript. All authors have read and approved the final version of the manuscript.

Funding

This study was supported by a grant from the National Health Research Institutes of Taiwan (11A1-PHGP13-052).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Ratzan S, Schneider EC, Hatch H, Cacchione J. Missing the Point - How Primary Care Can Overcome Covid-19 Vaccine “Hesitancy”. N Engl J Med. (2021) 384:e100. doi: 10.1056/NEJMp2106137

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Norcross JC, Krebs PM, Prochaska JO. Stages of change. J Clin Psychol. (2011) 67:143–54. doi: 10.1002/jclp.20758

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Eysenbach G. Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet. J Med Internet Res. (2009) 11:e11. doi: 10.2196/jmir.1157

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Mavragani A, Ochoa G, Tsagarakis KP. Assessing the Methods, Tools, and Statistical Approaches in Google Trends Research: Systematic Review. J Med Internet Res. (2018) 20:e270. doi: 10.2196/jmir.9366

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Lin YH, Liu CH, Chiu YC. Google searches for the keywords of “wash hands” predict the speed of national spread of COVID-19 outbreak among 21 countries. Brain Behav Immun. (2020) 87:30–2. doi: 10.1016/j.bbi.2020.04.020

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Dugas AF, Jalalpour M, Gel Y, et al. Influenza forecasting with Google Flu Trends. PLoS ONE. (2013) 8:e56176. doi: 10.1371/journal.pone.0056176

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Yang AC, Huang NE, Peng CK, Tsai SJ. Do seasons have an influence on the incidence of depression? The use of an internet search engine query data as a proxy of human affect. PLoS ONE. (2010) 5:e13728. doi: 10.1371/journal.pone.0013728

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Lin YH, Chiang TW, Lin YL. Increased internet searches for insomnia as an indicator of global mental health during the COVID-19 pandemic: multinational longitudinal study. J Med Internet Res. (2020) 22:e22181. doi: 10.2196/22181

PubMed Abstract | CrossRef Full Text | Google Scholar

9. COVID-19 Dashboard. Taiwan Centers for Disease Control. Available online at: https://covid-19.nchc.org.tw/index.php (accessed June 2, 2021)

10. Hyndman R, Khandakar Y. Automatic Time Series Forecasting: The Forecast Package for R. J Stat Soft. (2008) 27:1–22. doi: 10.18637/jss.v027.i03

CrossRef Full Text | Google Scholar

11. Rhodes SD, Hergenrather KC. Using an integrated approach to understand vaccination behavior among young men who have sex with men: stages of change, the health belief model, and self-efficacy. J Community Health. (2003) 28:347–62. doi: 10.1023/a:1025444629753

PubMed Abstract | CrossRef Full Text | Google Scholar

12. World Health Organization. Report of the SAGE Working Group on Vaccine Hesitancy. Available online at: https://www.who.int/immunization/sage/meetings/2014/october/SAGE_working_group_revised_report_vaccine_hesitancy.pdf (accessed August 28, 2021).

13. Brewer NT, Chapman GB, Gibbons FX, Gerrard M, McCaul KD, Weinstein ND. Meta-analysis of the relationship between risk perception and health behavior: the example of vaccination. Health Psychol. (2007) 26:136–45. doi: 10.1037/0278-6133.26.2.136

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Caserotti M, Girardi P, Rubaltelli E, Tasso A, Lotto L, Gavaruzzi T. Associations of COVID-19 risk perception with vaccine hesitancy over time for Italian residents. Soc Sci Med. (2021) 272:113688. doi: 10.1016/j.socscimed.2021.113688

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Daly M, Jones A, Robinson E. Public trust and willingness to vaccinate against COVID-19 in the US from October 14, 2020, to March 29, 2021. JAMA. (2021) 325:2397–9. doi: 10.1001/jama.2021.8246

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Freeman D, Loe BS Yu LM, et al. Effects of different types of written vaccination information on COVID-19 vaccine hesitancy in the UK (OCEANS-III): a single-blind, parallel-group, randomised controlled trial. Lancet Public Health. (2021) 6:e416–27. doi: 10.1016/S2468-2667(21)00096-7

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Brabham DC, Ribisl KM, Kirchner TR, Bernhardt JM. Crowdsourcing applications for public health. Am J Prev Med. (2014) 46:179–87. doi: 10.1016/j.amepre.2013.10.016

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Ranard BL, Ha YP, Meisel ZF, et al. Crowdsourcing–harnessing the masses to advance health and medicine, a systematic review. J Gen Intern Med. (2014) 29:187–203. doi: 10.1007/s11606-013-2536-8

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Edgar J, Murphy J, Keating M. Comparing traditional and crowdsourcing methods for pretesting survey questions. SAGE Open. (2016) 6:1–14. doi: 10.1177/2158244016671770

CrossRef Full Text | Google Scholar

20. Shen Y, Powell G, Ganser I, et al. Monitoring non-pharmaceutical public health interventions during the COVID-19 pandemic. Sci Data. (2021) 8:225. doi: 10.1038/s41597-021-01001-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: COVID-19, Google Trends, stages of change, vaccine hesitancy, vaccine willingness

Citation: Lan Y-T, Wu S-I and Lin Y-H (2022) Utilizing Internet Search Volume to Monitor Stages of Change in Vaccine Hesitancy During the COVID-19 Outbreaks. Front. Public Health 10:844543. doi: 10.3389/fpubh.2022.844543

Received: 23 February 2022; Accepted: 02 June 2022;
Published: 04 July 2022.

Edited by:

Andrea Gramegna, IRCCS Ca' Granda Foundation Maggiore Policlinico Hospital, Italy

Reviewed by:

Oriol Yuguero, Lleida Institute for Biomedical Research (IRBLleida), Spain
Mayank Kejriwal, University of Southern California, United States

Copyright © 2022 Lan, Wu and Lin. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Yu-Hsuan Lin, yuhsuanlin@nhri.edu.tw

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.