Original Research Article
A cross-sectional study to assess COVID-19 vaccine hesitancy among health care providers in a tertiary care centre, Tamil Nadu
1Madras Medical College, Chennai, Tamil Nadu, India
2Institute of Community Medicine, Madras Medical College, Chennai, Tamil Nadu, India
Received: 07 April 2022
Revised: 01 May 2022
Accepted: 02 May 2022
*Correspondence:
Dr. Eshwar Rajesh,
E-mail: eshwar1999@hotmail.com
Copyright: © the author(s), publisher and licensee Medip Academy. This is an open-access article distributed under the terms of the Creative Commons Attribution Non-Commercial License, which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
ABSTRACT
Background: The only way to reduce a person's likelihood of contracting COVID-19 infection, hospitalization, and death from it is to get vaccinated. Healthcare providers are indefinitely exposed to the virus and are also a source of knowledge about the sickness and vaccination. However hesitancy towards vaccination among healthcare providers persists. To estimate the prevalence of COVID-19 vaccine hesitancy among healthcare providers and to assess its predictors.
Methods: This cross-sectional study was conducted using an interviewer administered pretested semi-structured questionnaire adapting 5C vaccine acceptance/hesitancy questionnaire among 310 healthcare providers like doctors, nurses, multipurpose workers, support and paramedical staffs and students in a Tertiary care centre in Tamil Nadu selected by multistage random sampling from March to April of 2021. The collected data was analyzed by using Statistical package for social sciences (SPSS) version 16.
Results: The results showed that overall, 29.35% (n=91) of healthcare providers had hesitancy towards vaccination. 48.7% of the total respondents were not vaccinated against COVID-19 (n=151) and 24.5% of them were unwilling to be vaccinated. The mean of 5C questionnaire score was taken as cut off and the psychological antecedents of COVID-19 vaccination were compared between those vaccinated and not vaccinated. Among those vaccinated, it was observed that they had high confidence in vaccination, collective responsibility and calculation.
Conclusions: To battle misinformation and poor vaccination rates in future COVID-19 vaccination program, interventional educational efforts focusing on mitigating the constraints and complacence is urgently needed.
Keywords: COVID-19, Healthcare providers, Vaccination, Vaccine hesitancy, 5C questionnaire
INTRODUCTION
In December 2019, the coronavirus disease 2019 (COVID-19) outbreak caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) was first detected in Wuhan, China.1 Since then, the lethal virus has spread rapidly across the globe, prompting the World Health Organization (WHO) to proclaim a worldwide pandemic on March 11, 2020.2 By the end of July 2021, the cumulative numbers had reached over 194 million reported cases and over 4 million deaths globally since the start of the pandemic.3
In the beginning, before the vaccine against COVID-19 was developed, the best methods for controlling the spread of the virus included social distancing, mask-wearing, frequent hand washing and geographical lockdowns.4 The multi-faceted catastrophic consequences caused among the panic-stricken citizens intensified global efforts in developing an effective prevention method to keep outbreaks under control. This grueling challenge thereby led to several candidate vaccines in different stages of development since the beginning of 2020.5,6
Vaccines play a vital role in mitigating the spread and communicability of infectious diseases, severity of the disease, hospitalization and deaths caused by infectious diseases.7 Emerging data on effectiveness indicates that licensed COVID-19 vaccines are contributing to controlling the spread of the disease.8,9 Almost 21 different vaccines are currently used globally with different country preferring one over other while several different vaccines are still under final stages of development phase.10,11 The Government of India launched the biggest-ever mass vaccination program nationwide to vaccinate all adults above 18 years in the country (Total population 1.380 billion, Census 2021) with the COVID-19 vaccines in various stages based on the guidance from The National Expert Group on Vaccine Administration for COVID-19 (NEGVAC).12,13 The Covishield vaccine developed by AstraZeneca/Oxford and manufactured by the Serum Institute of India and SK Bio respectively was given Emergency Use Authorization (EUA) on 16 February 2021 and the COVAXIN, by Bharat Biotech is developed in collaboration with the Indian Council of Medical Research (ICMR) - National Institute of Virology (NIV) are widely used in India. Sputnik-V developed by the Gamaleya Research Institute of Epidemiology and Microbiology in Russia was approved by the Drugs Controller General of India (DCGI) on 12 April, for emergency use in India.14
COVID-19 vaccine was introduced in a phased manner with first phase focusing on health care providers and frontline workers. The prioritization of groups was based upon the disease incidence and prevailing pandemic situation. The Phase-1 of vaccination was implemented to vaccinate nearly 30 million Health Care Providers (HCPs) in Public and Private health care settings, including ICDS workers.13,15 Despite priority being given to health care providers, the number of beneficiaries vaccinated were lesser than expected (9.3 million) as on 02.03.2021.16
At this point, the next major hurdle to controlling the pandemic is the public hesitancy towards vaccination. The term vaccine hesitancy comprises refusal to vaccinate, delaying vaccines, accepting vaccines but remaining uncertain about their use, or using certain vaccines but not others.17,18 In general, vaccine hesitancy has risen so substantially that it is considered by WHO as one of the major threats to Global Health. Vaccine hesitancy is not a novel concept. It has existed ever since the notion of vaccination against infectious diseases began.19,20
Healthcare workers play a significant role in the battle against COVID-19 both as frontline warriors and as role-models to the general public. They have wide knowledge on the effectiveness of the vaccines against COVID-19 and their adverse effects following vaccination.21 HCPs have easy access to the vaccination site, timing for vaccination as the sites are in their workplace and the knowledge on the eligibility criteria.8,9,22 Only a few studies have looked into healthcare providers’ willingness to vaccinate against COVID-19. Thus, the present study was conducted to assess the prevalence of the COVID-19 vaccine hesitancy and its associated factors among healthcare providers in a tertiary health care center in Tamil Nadu.
METHODS
Study design and population
A cross-sectional study was conducted to estimate the prevalence of vaccine hesitancy among the healthcare providers in a tertiary care center in Tamil Nadu between March to April 2021 using an interviewer-administered questionnaire. The sample size was calculated based on the prevalence of vaccine hesitancy of 23.1% from previous study conducted by Paris et al with an absolute precision of 5% and applying 10% non-response rate.23 The final sample size derived was 310. The participants were selected by multistage random sampling. A tertiary care center was chosen randomly by random number generator. The list of all the healthcare providers was obtained and they were categorized as students, paramedical staff, nurses, doctors and support personnel. Proportionate sampling was done among each category based on the sample size (Figure 1).
Inclusion criteria
All adult healthcare providers working in the tertiary care centre and its affiliated institutions during the COVID-19 pandemic in various departments.
Exclusion criteria
Healthcare providers who did not give consent to participate in the study.
Survey instrument
The questionnaire was designed with three components comprising of the demographic profile of the participants, intention to vaccinate against COVID-19 and the 5C scale by Betsch et al.24 The following demographic variables were included as the independent variables of this study: age, sex, religion, marital status, type of family, educational attainment, place of residence, occupation, income and history of previous COVID-19 infection. Two questions were used to measure COVID-19 vaccine hesitancy. The respondents were asked, “Have you received the COVID-19 vaccine?” The responses to this question were: Yes, or No. Those who responded ‘No’ will be directed to the next question; “If not vaccinated earlier, are you willing to get vaccinated against COVID-19 in the near future?” And the responses were: Yes, No, and Unsure.
The 5C scale was used to assess five psychological antecedents of vaccination and gives insights into individual perceptions, attitudes and behavioural tendencies that are influenced by their immediate environment (nonspecific for any one vaccination.24,25 The 15-item 5C scale was previously validated with sensitivity of 66% and specificity of 63.4%. It comprises of the following determinants: confidence in the safety and efficacy of vaccines, as well as trust in the providers of the service, such as policymakers and healthcare providers ; complacency, which is defined by a low perception of disease risk; constraints, which include physical and psychological barriers that make vaccination inconvenient; calculation, which entails active engagement in searching for information about the vaccine and its utility; collective responsibility, defined by the extent of willingness to benefit others by receiving vaccination to help in achieving herd immunity. The survey was assessed for clarity and minor edits were made to the wording to correct any potential misinterpretations. The questionnaire responses were based on a four-point Likert scale scoring from 1 to 4. The higher the 5C score (the closer to 4), the more likely the respondent is to accept vaccination. The inverted score will more likely represent the vaccine hesitancy.24,25 For the interpretation, the mean scores were calculated for hesitancy and across each item of the 5C antecedents were measured independently and analyzed.
For each 5C antecedent and validation construct, Cronbach’s alpha was calculated to assess the scale’s internal consistency. To assess the reliability of the scale, the Cronbach’s alpha value should be above 0.70 for each 5C antecedent. Assuming that α≥0.70, the mean values are calculated per antecedent. Three four-point Likert scale questions were used to measure the Confidence towards vaccination (α=0.722) against COVID-19, three for Complacency towards COVID-19 vaccination which had an α of 0.556, three for Constraints against COVID-19 vaccination (α=0.702), three for Calculation towards COVID-19 vaccination (α=0.725) and three for Collective responsibility towards vaccination which had an α of 0.605.
The selected participants were contacted individually and were explained on the purpose of the study and the respondents who completed the survey received a note thanking them for their participation in the study. The questionnaire was developed in English and was then translated into Tamil. Back translation was done to know the quality of translation through experts. Questions were presented bilingually in both English and Tamil language depending on the preference of the study participants. Prior to the administration of the questionnaire, local experts validated the content of the questionnaire and the questionnaire was pilot tested among the peers and experts from the institute. After final approval the study was conducted among the participants.
Statistical analysis
We analyzed the data using the Statistical Package for Social Sciences (SPSS) software, version 16. The results are presented as means and standard deviations for normally distributed data, or as percentages for categorical data. Continuous variables were compared using t-test. Chi-square test was used to analyze the determinants. For all the analysis, p≤0.05 was assumed to be statistically significant.
RESULTS
Demographic characteristics
Overall, 310 HCPs had completed the survey (Table 1). The average age of the respondents was 33.61 years, with an SD of 12.88.
The highest proportion of respondents were between the age group of 18 to 45 years 247 (79.7%). About 67.4% of the respondents were women, while most of the respondents (75.2%) were Hindus. Nearly half of the respondents (58.4%) were married, and 12.3% of the respondents had less than a secondary education level and 58.7% had some form of under-graduate educational qualification. About two-thirds of the respondents (70%) were living a nuclear family, while 27.4% were students from the tertiary care centre. Among the study population, 84.8% had no co-morbidity and are not on any form of medication. The mean household income was Rs.29108 excluding the students.
About 10.6% of the respondents reported that they were tested positive for COVID-19 infection during the pandemic, which was confirmed by standard laboratory investigation. 39.3% of the laboratory confirmed COVID-19 patients utilized Government hospitals for treatment while 33.3% were on home isolation for the same. 17.4% of the respondents had history of family members infected by COVID-19 and 20.4% among them had lost someone in the family due to the infection during pandemic.
*p value significant <0.05
*p value significant <0.05.
Intention of vaccination against COVID-19
The results showed that overall, 29.35% (n=91) of healthcare providers had hesitancy towards vaccination. 48.7% of the total respondents were not vaccinated against COVID-19 (n=151) (Table 2) and 24.5% of them were unwilling to be vaccinated. 53% of them were willing to vaccinate in the future and 22.5% were not sure about vaccination. 9.2% of the respondents were apprehensive regarding the side effects and the underlying medical conditions as the reason for not yet vaccinated.
51.3% of participants were already vaccinated against COVID-19 infection (n=159). Among those who took vaccine against COVID-19 infection, 27.7% responded that it was mandatory at work place to take the COVID-19 vaccine, 6% knew how it helps in preventing the infection, 7% knew how important the vaccination is to protect others and 19.2% believed it will help in protection against the infection. Majority of the participants 40.1% responded with more than one of the above options. Overall majority 57.2% preferred vaccination as its mandatory for their job rather than knowing its importance.
5C antecedents of vaccination
The mean of 5C questionnaire score was taken as cut off and the psychological antecedents of COVID-19 vaccination were compared (Table 3) between those vaccinated and not vaccinated (n=151). The mean of 5C questionnaire among those not vaccinated to calculate the antecedents of vaccine hesitancy was calculated as 2.132 with mean of confidence 2.166, complacence 1.792, constraints 2.772, calculative behaviour 1.962 and collective attitude 1.962. Based on the interpretation 45% were not confident about the vaccine while 35.1% had poor complacence towards vaccination and 48.3% had poor constraints towards vaccination. On the other hand, 66.9% did not assess different calculation for receiving COVID-19 vaccine and 63.6% of the respondents had lack of (absence of) collective responsibility. On the other hand, the mean of antecedents to vaccinate was calculated among those vaccinated with mean 5C score of 2.523 with high mean confidence value of 3.101, calculative measure of 3.055 and collective responsibility of 3.222. The mean score of complacence and constraints were low with 2.104 and 1.792 which shows high vaccine acceptance among those vaccinated compared to hesitancy among those not vaccinated.
DISCUSSION
This study confirms the strong differences in COVID-19 vaccine intention among healthcare providers. In the present study, the overall vaccine hesitancy among the HCWs was 29.35%. Of note, the proportion of unvaccinated healthcare providers declaring that they would receive the COVID-19 vaccine was lesser among those unvaccinated when compared to the study by Paris et al and Hossain et al. There was no striking difference across occupations in regards to vaccination as the predictors of vaccination hesitancy among them wasn’t much varied when compared to study by Paris et al, where there was significant variation in regards to type of job among the healthcare providers.26 Among the unvaccinated healthcare professionals, a higher vaccine hesitancy was observed among the blue-collar workers or support personnel than the doctors and nurses. This is contradictory to the study by Paris et al. ‘COVID-19 vaccine hesitancy among healthcare workers’ where a lower vaccine hesitancy was observed among the cleaners. Only a few people in our study said they had been personally infected with COVID-19 or had observed a family member or friend being affected by the disease. Few respondents from the study have already lost someone during the COVID-19 pandemic. At the same time, only a small percentage of respondents regarded their odds of contracting COVID-19 as "very likely" or were unduly concerned about the disease's consequences if infected. Several studies were conducted during the 2021 COVID-19 pandemic to first assess the desire to accept the COVID-19 vaccination, and then to study the actual uptake among healthcare providers.27-30 In a study conducted in France, by Paris et al. 23.1% categorized themselves as ‘hesitant’, and 3.9% as ‘against’ the COVID-19 vaccine.23
In our study, the age group of 45-60 years showed having the maximum vaccine hesitancy among HCPs. Further analysis (Table 4) showed that certain variables were associated with a lower intent to receive COVID-19 vaccines among HCPs in India. These variables included female sex, lower educational qualification, a lower income group, being single and living in a non-nuclear family. A higher degree of vaccine hesitancy among females appears to be a recurring pattern that has been observed in a variety of research from diverse time periods and geographical areas.31 Significance in regard to vaccine acceptance and history of COVID-19 infection to self and family could be due to the burden of the disease observed and provided insight towards vaccination to mitigate further burden. Whereas salary, religion, marital status and type of family were not significantly associated which has to be further analyzed in the upcoming studies. Another interesting finding in our study was the increased hesitancy among people with comorbidities. This usually is due to the unknown side effects which may exacerbate the comorbidity or initiate a new complication. Lack of information regarding this aspect demands increased research in this field.
Healthcare providers’ vaccination behaviors are associated with various psychological determinants and additional barriers and drivers. In our study subjects, 51.3% of healthcare providers were vaccinated and a majority actively recommended vaccination to their contacts. In general, lower levels of confidence and collective responsibility and higher levels of complacency, constraints, and calculation is associated with significant hesitancy of COVID-19 vaccines. Healthcare providers’ own vaccination status is significantly associated with them recommending vaccines to their contacts, which suggests that Healthcare providers are a stronger leverage to promote vaccination if they generally accept vaccinations themselves.
In our study, using the 5C questionnaire to calculate the antecedents of vaccine hesitancy and vaccine acceptancy among the healthcare providers, confidence and collective responsibility in the safety of vaccines was identified as an issue of special importance. Since it was associated with both own vaccination and recommendation behavior, the safety and effectiveness of vaccines should be a major topic to be addressed in communication activities targeting healthcare providers. However, activities aiming at healthcare providers own vaccination and recommendation behavior should go beyond confidence in vaccination, since other psychological determinants such as stressful environment, inconvenience to vaccination, over confidence in one’s own immune system and visiting vaccination centers were negatively associated with own vaccination status.
The overall tendency for acceptance of a vaccine was high among those not vaccinated, with more than half (53%) of the participants expressing a definite intention to take the COVID-19 vaccine and 22.5% declared that they are not sure of vaccination. 24.5% were not willing to take the COVID-19 vaccine which is much higher than the study conducted in Bangladesh as 14% by Hossain et al. When enquired on the delay in vaccination among those willing for vaccination, 16.8% replied upcoming university exams were the delay in vaccination while 13.6% were on treatment for medical condition as delay in vaccination and 10% replied fear of side effects as delay in vaccination following controversies over vaccine tolerance similar to study by Paris et al. Of note, intervention is needed for COVID-19 vaccine refusals as well as healthcare providers with possible and probable intention to ensure high actual vaccination uptake.
Limitations
The timing of the study is one of its major limitations. It was carried out before the onset of the second wave of COVID-19 in India. Due to the extreme difference in mortality and morbidity rates, acceptance and hesitancy among health care providers and the general public must have improved during the second wave of COVID-19. Additionally, the 5C subscales' internal consistency could have been improved by adding more items, particularly for the complacence and collective responsibility antecedents. Furthermore, the cross-sectional character of this study should not be neglected, as vaccine hesitancy is context-dependent, particularly in terms of the location and timing of any survey.
CONCLUSION
Overall, 29.35% (n=91) of the total HCPs had hesitancy towards vaccination of which 40.65% (n=37) were not willing for vaccination due to high constraints and complacence. Healthcare workers play a significant role in the battle against COVID-19 both as frontline warriors and as role-models to the general public. They are regarded as the ambassadors for vaccine acceptance among the general population. However, if they themselves are vaccine-hesitant, the patients who look up to them cannot be rid of their doubt and uncertainty. Hence, the findings in this study may be used by policy makers to implement promotion campaigns in the future to increase vaccine acceptance among the people. Interventions targeting constraints and complacence could be effective in increasing the uptake of the vaccine. To battle misinformation and avoid poor vaccination rates, interventional educational efforts like focused group discussions on vaccine hesitancy and acceptance, seminars on effects of vaccination including the benefits of vaccination and adverse effects following vaccination and collective responsibilities targeting health workers at risk of vaccine hesitancy are urgently needed. To eliminate any potential hurdles to a future COVID-19 vaccination program, swift action to mitigate even a small number of healthcare providers with vaccine hesitancy is crucial as general public rely on healthcare workers for their decision before vaccination.
ACKNOWLEDGMENTS
We would like to thank the participants of this study for their contribution amidst this challenging time of the COVID-19 pandemic.
Funding: No funding sources
Conflict of interest: None declared
Ethical approval: Ethical approval was obtained from the Institutional Ethics Committee of Madras Medical College, Chennai (No. 31032021).
REFERENCES
- 1. Lu H, Stratton CW, Tang YW. Outbreak of pneumonia of unknown etiology in Wuhan, China: The mystery and the miracle. J Med Virol. 2020;92(4):401-2.
- 2. WHO Director-General’s opening remarks at the media briefing on COVID-19 - 11 March 2020. Available at: https://www.who.int/director-general/speeches/detail/who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19-11-march-2020. Accessed on 14 September 2021.
- 3. Weekly epidemiological update on COVID-19 - 27 July 2021. Available at: https://www.who.int/publications/m/item/weekly-epidemiological-update-on-covid-19---27-july-2021. Accessed on 12 September 2021.
- 4. Health Ministry releases SOP on Preventive Measures in Markets to contain spread of COVID-19. Available at: https://pib.gov.in/PressReleasePage.aspx?PRID=1677644. Accessed on 14 September 2021.
- 5. Accelerating a safe and effective COVID-19 vaccine. Available at: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/global-research-on-novel-coronavirus-2019-ncov/accelerating-a-safe-and-effective-covid-19-vaccine. Accessed on 14 September 2021.
- 6. Update on COVID-19 vaccine development. Available at: https://www.who.int/docs/default-source/coronaviruse/risk-comms-updates/update45-vaccines-developement.pdf?sfvrsn=13098bfc_5. Accessed on 14 September 2021.
- 7. Abedin M, Islam MA, Rahman FN, Reza HM, Hossain MZ, Hossain MA, et al. Willingness to vaccinate against COVID-19 among Bangladeshi adults: Understanding the strategies to optimize vaccination coverage. PLoS One. 2021;16(4):e0250495.
- 8. Verger P, Scronias D, Dauby N, Adedzi KA, Gobert C, Bergeat M, et al. Attitudes of healthcare workers towards COVID-19 vaccination: a survey in France and French-speaking parts of Belgium and Canada, 2020. Euro Surveill. 2021;26(3).
- 9. Kaur SP, Gupta V. COVID-19 Vaccine: A comprehensive status report. Virus Res [Internet]. 2020 Oct 15 [cited 2021 Sep 13];288.
- 10. Coronavirus disease (COVID-19): Vaccines. Available at: https://www.who.int/news-room/q-a-detail/coronavirus-disease-(covid-19)-vaccines. Accessed on 14 September 2021.
- 11. Status of COVID-19 Vaccines within WHO EUL/PQ evaluation process. Available at: https://extranet.who.int/pqweb/sites/default/files/documents/Status_COVID_VAX_20Jan2021_v2.pdf. Accessed on 14 September 2021.
- 12. High Level Committee for Distribution and Administration of COVID-19 Vaccines. Available at: https://pib.gov.in/Pressreleaseshare.aspx?PRID=1694439. Accessed on 14 September 2021.
- 13. Central Government gears up for roll out of COVID19 Vaccine. Available at: https://pib.gov.in/Pressreleaseshare.aspx?PRID=1683529. Accessed on 13 September 2021.
- 14. COVID-19 Vaccine FAQs. Available at: https://www.mohfw.gov.in/covid_vaccination/vaccination/faqs.html. Accessed on 14 September 2021.
- 15. COVID -19 Vaccine OG111 Chapter16. Available at: https://www.mohfw.gov.in/pdf/COVID19VaccineOG111Chapter16.pdf. Accessed on 14 September 2021.
- 16. COVID19 Vaccination-Day 46. Available at: https://pib.gov.in/Pressreleaseshare.aspx?PRID=170 2073. Accessed on 14 September 2021.
- 17. Vaccine Hesitancy: what it means and what we need to know in order to tackle it. Available from: https://www.who.int/immunization/research/forums_and_initiatives/1_RButler_VH_Threat_Child_Health_gvirf16.pdf. Accessed on 14 September 2021.
- 18. MacDonald NE. Vaccine hesitancy: Definition, scope and determinants. Vaccine. 2015;33(34):4161-4.
- 19. Dubé E, Vivion M, MacDonald NE. Vaccine hesitancy, vaccine refusal and the anti-vaccine movement: influence, impact and implications. Expert Rev Vaccines. 2015;14(1):99-117.
- 20. Salmon DA, Dudley MZ, Glanz JM, Omer SB. Vaccine Hesitancy: Causes, Consequences, and a Call to Action. Am J Prev Med. 2015;49(4):S391-8.
- 21. Neufeind J, Betsch C, Habersaat BK, Eckardt M, Schmid P, Wichmann O. Barriers and drivers to adult vaccination among family physicians - Insights for tailoring the immunization program in Germany. Vaccine. 2020;38(27):4252-62.
- 22. Joshi A, Kaur M, Kaur R, Grover A, Nash D, El-Mohandes A. Predictors of COVID-19 Vaccine Acceptance, Intention, and Hesitancy: A Scoping Review. Front Public Heal. 2021;0:1152.
- 23. C P, F B, M G, E P, M B, V T, et al. COVID-19 vaccine hesitancy among healthcare workers. Infect Dis now. 2021;51(5):484-7.
- 24. Betsch C, Habersaat KB, Deshevoi S, Heinemeier D, Briko N, Kostenko N, et al. Sample study protocol for adapting and translating the 5C scale to assess the psychological antecedents of vaccination. BMJ Open. 2020;10(3).
- 25. Ghazy RM, ElHafeez SA, Shaaban R, Elbarazi I, Abdou MS, Ramadan A, et al. Determining the Cutoff Points of the 5C Scale for Assessment of COVID-19 Vaccines Psychological Antecedents among the Arab Population: A Multinational Study. J Prim Care Community Health. 2021;12:2150.
- 26. Wong LP, Alias H, Wong PF, Lee HY, AbuBakar S. The use of the health belief model to assess predictors of intent to receive the COVID-19 vaccine and willingness to pay. Hum Vaccin Immunother. 2020;16(9):2204-14.
- 27. El-Elimat T, AbuAlSamen MM, Almomani BA, Al-Sawalha NA, Alali FQ. Acceptance and attitudes toward COVID-19 vaccines: A cross-sectional study from Jordan. PLoS One. 2021;16(4):e0250555.
- 28. Di Gennaro F, Murri R, Segala FV, Cerruti L, Abdulle A, Saracino A, et al. Attitudes towards Anti-SARS-CoV2 Vaccination among Healthcare Workers: Results from a National Survey in Italy. Viruses. 2021;13(3).
- 29. Bai W, Cai H, Liu S, Liu H, Qi H, Chen X, et al. Attitudes toward covid-19 vaccines in chinese college students. Int J Biol Sci. 2021;17(6):1469-75.
- 30. Panda DS, Giri RK, Nagarajappa AK, Basha S. Covid-19 vaccine, acceptance, and concern of safety from public perspective in the state of Odisha, India. Hum Vaccin Immunother. 2021;17(10).
- 31. Al-Sanafi M, Sallam M. Psychological Determinants of COVID-19 Vaccine Acceptance among Healthcare Workers in Kuwait: A Cross-Sectional Study Using the 5C and Vaccine Conspiracy Beliefs Scales. Vaccines. 2021;9(7):701.