ORIGINAL RESEARCH article

Front. Physiol., 17 August 2021
Sec. Autonomic Neuroscience
https://doi.org/10.3389/fphys.2021.692098

Fatigue Is Associated With Diminished Cardiovascular Response to Anticipatory Stress in Patients With Coronary Artery Disease

Julija Gecaite-Stonciene1*, Brian M. Hughes2, Julius Burkauskas1, Adomas Bunevicius1, Nijole Kazukauskiene1, Lisanne van Houtum3, Julija Brozaitiene1, Julius Neverauskas1 and Narseta Mickuviene1
  • 1Laboratory of Behavioral Medicine, Neuroscience Institute, Lithuanian University of Health Sciences, Palanga, Lithuania
  • 2School of Psychology, National University of Ireland, Galway, Ireland
  • 3Department of Clinical Psychology, Leiden University, Leiden, Netherlands

Background: Fatigue and psychophysiological reactions to mental stress are known to be problematic in coronary artery disease (CAD) patients. Currently, studies exploring the relationship between fatigue and cardiovascular reactivity to stress are scarce and inconsistent. The current study aimed to investigate the links between cardiovascular response to mental stress and fatigue in CAD patients after acute coronary syndrome (ACS).

Methods: The cross-sectional study investigated 142 CAD patients (85% males, 52 ± 8 years) within 2–3 weeks after recent myocardial infarction or unstable angina pectoris. Fatigue symptoms were measured using Multidimensional Fatigue Inventory 20-items, while cardiovascular reactivity to stress [i.e., systolic (S) and diastolic (D) blood pressure (ΔBP), and heart rate (ΔHR)] was evaluated during Trier Social Stress Test (TSST). In addition, participants completed psychometric measures, including the Hospital Anxiety and Depression scale and the Type D Scale-14. Multivariable linear regression analyses were completed to evaluate associations between fatigue and cardiovascular response to TSST, while controlling for confounders.

Results: After controlling for baseline levels of cardiovascular measures, age, gender, education, heart failure severity, arterial hypertension, smoking history, use of nitrates, anxiety and depressive symptoms, Type D Personality, perceived task difficulty, and perceived task efforts, cardiovascular reactivity to anticipatory stress was inversely associated with both global fatigue (ΔHR: β = –0.238; p = 0.04) and mental fatigue (ΔSBP: β = –0.244; p = 0.04; ΔHR β = –0.303; p = 0.01) as well as total fatigue (ΔSBP: β = –0.331; p = 0.01; ΔHR: β = –0.324; p = 0.01).

Conclusion: In CAD patients after ACS, fatigue was linked with diminished cardiovascular function during anticipation of a mental stress challenge, even after inclusion of possible confounders. Further similar studies exploring other psychophysiological stress responses are warranted.

Introduction

Despite medical advances that have improved coronary artery disease (CAD) outcomes over the past fifty years, CAD remains the most common cause of premature mortality, accounting for almost one third of all deaths worldwide (Piepoli et al., 2016; Al-Mallah et al., 2018). CAD typically includes diagnoses of angina pectoris, and may lead to acute coronary syndrome (ACS) (De Lemos and Omland, 2017). Acute stress can act as a trigger for ACS, such as myocardial infarction and unstable angina pectoris (Amsterdam et al., 2014). Meanwhile, prolonged or chronic stress is considered an important risk factor for the development and progression of cardiovascular diseases (Holmes et al., 2006).

The traditional reactivity hypothesis states that higher cardiovascular response to emotional stressors contributes to the etiology of cardiovascular pathology (Steptoe and Kivimäki, 2012). However, a growing body of evidence posits that maladaptive regulation of the autonomic nervous system (ANS) can be expressed not only by exaggerated but also by blunted cardiovascular response to stress, both of which may signal physiological dysregulations (Lovallo, 2011). Prolonged psychological stress may disrupt biological regulatory systems, such as ANS, and so may lead to maladaptive blunted cardiovascular response (Hughes et al., 2018). Low cardiovascular responses to stress have been found to be associated with indices of poor health, such as physical disability (Phillips et al., 2011) and obesity (Phillips et al., 2012). Blunted cardiovascular response have also been associated with characteristics of psychological distress in cardiac patients, including Type D (Distressed) personality (Denollet, 2005) as well as anxiety and depressive symptoms (Howard et al., 2011; Kupper et al., 2013; Gecaite et al., 2019). Even though there are no clear cut-off points for determining whether the cardiovascular response is exaggerated or diminished (often referred to as “blunted”) (Turner, 1994), a burgeoning scientific literature suggests that blunted stress reactions are themselves associated with adverse health outcomes (Phillips et al., 2013).

Fatigue, defined as the multidimensional subjective experience of persistent and extreme tiredness, mental and physical exhaustion (Smets et al., 1995; Ream and Richardson, 1996; Aaronson et al., 1999), is one of the most frequent and distressing symptoms reported by patients with CAD after ACS (Burkauskas et al., 2017; Johnston and Eckhardt, 2018). In patients with CAD, the prevalence of moderate to severe fatigue has been reported to be as high as 39% during cardiac rehabilitation (CR), remaining up to 28% after 1 year (van Geffen et al., 2015). Meanwhile, mental fatigue is considered a risk factor for the development of heart diseases (Guan et al., 2017), while unusual fatigue is a strong predictor of longer prehospital delay (Zègre-Hemsey et al., 2018), poor health-related outcomes, and increased mortality (Irvine et al., 1999). Considering fatigue within the context of emotional stress, it may not only be a distressing symptom itself but also may play an important role in determining the effort and motivation to perform a task (Wright, 2014), and so in turn may shape variations of cardiovascular response to stress (Wright, 2009).

To date, there have been several studies suggesting positive associations between higher fatigue and higher perceived stress in patients with CAD after ACS (Cameron et al., 2005; Fredriksson-Larsson et al., 2015). However, to our knowledge, no study has examined links between psychophysiological stress parameters, such as cardiovascular response to stress, and fatigue in patients with heart related conditions (Johnston and Eckhardt, 2018), even though the psychophysiological research underlying the interplay between ANS and fatigue in this population is often proposed (Matura et al., 2018). Only several earlier studies in different populations reported that heart rate (HR) reactivity to mental stressor was lower in patients with chronic fatigue syndrome (CFS) than in healthy controls (Soetekouw et al., 1999). Meanwhile, significant inverse associations between the systolic blood pressure (SBP) and diastolic BP (DBP) response during mental stress and fatigue severity were detected in young women (Nolte et al., 2008). Nevertheless, conflicting results (Wright et al., 2008) and non-significant associations (Nelesen et al., 2008) have also been documented.

Considering the limited and inconsistent research regarding fatigue and its effects on cardiovascular response during mental stress, the current study aimed to investigate the relationship between cardiovascular response to mental stress and subjective fatigue in patients with CAD after ACS. Taking into account the results from previous studies (Soetekouw et al., 1999; Nolte et al., 2008), it was hypothesized that higher subjective fatigue would be associated with diminished cardiovascular response (ΔSBP; ΔDBP; ΔHR) to mental stress, even after possible confounders were considered.

Materials and Methods

Study Procedure

A total of 251 consecutive patients with CAD attending an inpatient CR clinic were invited to participate in this study. Inclusion criteria were: (a) meeting diagnostic criteria for ACS as evaluated by a cardiologist; (b) attending a standard CR program based on previously established secondary prevention guidelines for CAD (Steg et al., 2012); (c) no history of arrhythmic disorder and/or implantation of a cardioverter defibrillator; and (d) ability to communicate in the local vernacular language (Lithuanian). Exclusion criteria were: (a) severe comorbid illness; (b) unstable cardiovascular condition as determined by a cardiologist; (c) age above 80; (d) significant communicative difficulties or cognitive impairment; and (e) unwillingness to participate in the study. In sum, 92 (36.7%) potential participants were excluded from the study. The final sample thus comprised 159 participants (84.5% men, age 53 ± 8.2 years).

After an informed consent form was signed by the patient, clinical and sociodemographic data were gathered, primarily from medical records during the first 2–3 days of admission to CR. The clinical data included formal diagnosis, severity of heart failure as classified using the New York Heart Association (NYHA) functional classification standard (Levin et al., 1994), left ventricular ejection fraction, percutaneous coronary intervention, arterial hypertension (AH), obesity [body mass index (BMI) > 30 kg/m2], medication use, and smoking behavior. Sociodemographic data comprised age, education, and gender. Self-report assessment for fatigue, depression and anxiety symptoms, Type D personality, and mental stress test were completed within 10 days after admission. The Trier Social Stress Test (TSST) was employed to measure cardiovascular response (ΔSBP,- ΔDBP, and ΔHR) before, during and after mental stress (Kirschbaum et al., 1993). Participants were asked to have a standard breakfast and lunch and were instructed to abstain from food 1 h prior to the afternoon session as well as from caffeine, alcohol, exercise, soda, beverages etc. The study patients were instructed to use beta-blockers in the day the experimental procedures took place, according to their treatment plan designated by the cardiologist. The experimental session of procedure took place at 2:30 p.m. The procedure room is always maintained the optimal temperature between 22 and 25°C. After the TSST, participants were debriefed about the goal of the experiment and remaining questions were answered.

This study was conducted in accordance with the principles stated in the Declaration of Helsinki and was approved by the Kaunas Regional Ethics Committee for Biomedical Research in Lithuania. All patients were monitored by the cardiologist during the study process in order to ensure their medical safety.

Measures

Multidimensional Fatigue Inventory, MFI-20

Fatigue was evaluated using the original version of the Multidimensional Fatigue Inventory (MFI-20) created by Smets and colleagues (Smets et al., 1995). The MFI-20 includes five subscales: General fatigue, physical fatigue, mental fatigue, reduced activity, and reduced motivation. Each subscale has 4 items with possible answers on a 5-point Likert scale. General fatigue is assessed using general statements about overall fatigue, and reduced functioning is assessed based on questions related to how fatigue affects daily functioning. The physical fatigue subscale involves questions about physical feelings related to fatigue. Mental fatigue relates to cognitive functioning, including concentration problems. Reduced activity refers to the influence of physical and psychological factors on the level of activity. Reduced motivation relates to the lack of motivation to start any activity due to tiredness. Adequate psychometrics properties (Cronbach’s coefficients α of all scales ranged between 0.70 and 0.80) were found in previous studies using this scale with patients with CAD in Lithuania (Staniute et al., 2014). The MFI-20 has also been recently validated in a large sample of CAD patients (Gecaite-Stonciene and Bunevicius, 2020). The total score ranges from 4 to 20 on each subscale, and 20–100 for total fatigue score with a higher score indicating higher fatigue levels.

Hospital Anxiety and Depression Scale, HADS

The Hospital Anxiety and Depression Scale (HADS) was employed to assess patients’ anxiety and depressive symptoms during the past week (Snaith, 2003). HADS is a self-administered, 14-item questionnaire, comprised of two independent subscales for measuring anxiety (HADS-A, 7 items) and depressive (HADS-D, 7 items) symptoms. It is based on 4-point Likert scale (0–3), with total scores ranging from 0 to 21 per subscale, while a higher sum of scores representing greater symptom severity. Cut-off values of ≥ 8 were considered for screening significant anxiety (HADS-A) and depressive (HADS-D) symptoms. In a previous study with patients with CAD, HADS showed acceptable internal consistency, Cronbach‘s coefficients α = 0.84 for HADS-A, and α = 0.60 for HADS-D (Gecaite et al., 2019).

Type D Scale-14, DS-14

The Type D Scale-14 (DS14) (Denollet, 2005) was employed to determine the presence of Type D personality, which is a common clinical risk factor in patients with CAD (Kupper and Denollet, 2018). Overall, the DS14 is comprised of 14-items, having two subscales of negative affectivity (NA) (7 items) and social inhibition (SI) (7 items). The total score of ≥ 10 on both subscales indicates the presence of Type D personality. Previous studies in patients with CAD indicated good psychometric parameters of DS14 (Cronbach α = 0.75) (Gecaite et al., 2019).

Mini-Mental State Examination, MMSE

The Mini-Mental State Examination (MMSE) was employed to test for possible cognitive impairment (Folstein et al., 1975). This instrument is divided into two parts with an overall maximum score of 30. The first section covers orientation, memory and attention abilities (total score range from 0 to 21). The second section includes the evaluation of ability to name, follow verbal/written instructions, and ability to write sentences and to copy a complex polygon figure (total score range from 0 to 9) (Folstein et al., 1975). The total sum of scores of the two sections ≤ 24 is considered to represent cognitive impairment (Blake et al., 2002; Burton and Tyson, 2015). Previous studies have reported high internal consistency for the MMSE (Cronbach α = 0.91) (Marioni et al., 2011).

Trier Social Stress Test, TSST

Stress responses were evaluated based on a conventional Trier Social Stress Test (TSST) (Kirschbaum et al., 1993). The first phase of TSST started with 10 min of baseline rest (Kirschbaum et al., 1993). Next, participants were asked to prepare a 5-min free form speech for a simulated job interview to convince the committee members that they were the best applicant for a job. Anticipatory stress was taken to represent the period starting with the task instructions, during which patients were introduced to the evaluating committee of three trained researchers. Cardiovascular measures were recorded during speech preparation. Participants were then given time to make an interview-style presentation (5 min). Following this, participants underwent a mental arithmetic test (8 min). The arithmetic task comprised a Paced Auditory Serial Addition Test (Gronwall, 1977). After this, the TSST concluded with a 10-min recovery period, during which participants rested on their own.

Cardiovascular measures (i.e., SBP, DBP, and HR) were assessed during each stage of the TSST, and were recorded every 2 min (e.g., during task instruction at 1, 3, and 5 min) before being averaged for each stage. Detailed procedural nuances of this standardized TSST are reported elsewhere (Kirschbaum et al., 1993; Birkett, 2011; Frisch et al., 2015; Allen et al., 2017). Our procedure was based on previously established protocols (Kirschbaum et al., 1993) with modifications only to the arithmetic task, as reported elsewhere (Girdler et al., 2005; Mechlin et al., 2007; Cox et al., 2015).

Cardiovascular parameters were recorded using a Oscar2 24-HR ABP monitor (SunTech Medical Inc., Morrisville, NC, United States) (Jones et al., 2004). Participants were observed so that the TSST could be terminated if the participant were to be at risk of excessively elevated BP, defined for CAD patients as BP ≥ 210/115 mmHg (Fletcher et al., 2013).

Visual Analog Scales, VAS

During the study, patients filled in two Visual Analog Scales (VAS) 5 min after the TSST, in order to measure perceived efforts and perceived difficulty of the tasks. This method was chosen based on previously established study protocols involving the TSST (von Dawans et al., 2011). The two scales ranged from 0 (maximum difficulty/efforts) to 100 (minimum difficulty/efforts). The method of VAS is considered a valid and applicable tool to evaluate subjective experience in various experimental clinical settings (Wewers and Lowe, 1990).

Statistical Analysis

Statistical analyses were completed using SPSS version 17.0. To test for assumptions, normality was assessed using the Kolmogorov-Smirnov test and skewness and kurtosis were scrutinized. Descriptive statistics were generated to summarize clinical and sociodemographic characteristics. The internal validity of all scales was calculated using α-coefficients of Standardized Cronbach.

In order to confirm that the TSST induced laboratory-based social stress in this sample, a linear mixed model was computed. Based on this analysis, the mean differences between cardiovascular parameters of baseline and other TSST stages were evaluated.

Due to relatively small number of participants, analysis for identification of outliers was completed and outliers were eliminated from the further analysis. Univariate outliers were considered if z-scores were greater than 2.26 (p < 0.001, two-tailed). Mahalanobis distances, using a chi-square cut-off (p < 0.001), were employed in order to identify and eliminate multivariate outliers.

Measures of cardiovascular response were obtained by subtracting the averaged values of the HR, SBP and DBP during baseline rest from the averaged scores during other TSST periods. Two-tailed Student’s t-test, Mann Whitney U test and Fisher’s χ2 were used to evaluate patients’ characteristics of socio-demographic and clinical data, fatigue, depressive/anxiety symptoms, Type D personality, as well as cardiovascular response to stress. The analysis for multicollinearity was also performed by using variance inflation factor (VIF) values < 4.

Univariate linear regression analysis was completed to measure the links between cardiovascular response to TSST and fatigue, sociodemographic/clinical characteristics, anxiety/depressive symptoms, Type D personality (in order to identify possible confounders). Benjamini-Hochberg adjustment for multiple comparisons was applied to control for Type I error, setting a critical value for false discovery rate of 0.10 (Benjamini and Hochberg, 1995). Multivariable linear regression was used to assess associations between cardiovascular response to TSST and fatigue, while controlling for possible confounders.

Covariates were chosen either based on the previous literature or those which were significant in univariate models. This procedure was followed based on earlier established statistical guidelines on multivariable linear analysis in order to test the hypothesis on associations between the variables when controlling for covariates (Katz, 2011).

Results

Based on the criteria outlined above, 17 univariate outliers were identified, which were removed from the analysis. Thus, the remaining analysis was completed with 142 study patients. In terms of internal consistency, all study questionnaires and subscales showed adequate Cronbach α-coefficients (Tavakol and Dennick, 2011) as depicted in Table 1, and were used in the remaining analysis.

TABLE 1
www.frontiersin.org

Table 1. Internal consistency results for MFI-20, HADS, and DS14 (N = 142).

Sample Characteristics

As presented in Table 2, patients’ mean age was 52 years (SD = 8.2), and were predominantly males (85.2%) with mostly high school degrees (47.2%) and College/University degrees (52.8%). More than half of the participants met the criteria for obesity (51.4%) and had either past or present experience of nicotine use (58.5%). Most of the patients were admitted to the hospital due to acute myocardial infarction (73.2%), while the rest met the criteria for unstable angina pectoris (26.8%). According to the NYHA functional classification system, most patients met the criteria for Class II (82.6%), representing limitation of physical activity but comfort at rest. The majority had a comorbid diagnosis of AH (82.4%) and all were under current pharmacological treatment. 4.9% (n = 7) had moderate to severe systolic dysfunction (left ventricular ejection fraction < 40%), 91% (n = 129) had percutaneous coronary intervention. All participants were within the normal range of cognitive functioning, and thus were able to comprehend the instructions of the scales and complete the TSST. Around one third (29.6%) of the patients met the criteria for Type D personality and had significant anxiety symptoms (26.1%), while 8.5% of the patients has significant depressive symptoms. The detailed information of baseline characteristics is depicted in Table 2.

TABLE 2
www.frontiersin.org

Table 2. Descriptive statistics for demographics and clinical characteristics (n = 142).

Baseline Characteristics of Stress Evoking Task (TSST)

The results of the linear mixed models confirmed that there was a significant increase in cardiovascular parameters as a response to TSST [SBP: F(5,795) = 75.38, p < 0.001, η2 = 0.322; DBP: F(5, 795) = 72.24, p < 0.001, η2 = 0.312]; HR: [F(5, 795) = 26.24, p < 0.001, η2 = 0.142; see Figure 1]. Of the participants, 22 (15.5%) did not complete the job interview task and a further 6 (4.2%) discontinued the TSST at the arithmetic task, due to maladaptive increases in cardiovascular parameters.

FIGURE 1
www.frontiersin.org

Figure 1. Descriptive statistics of cardiovascular characteristics and comparison with baseline cardiovascular measures during Trier Social Stress Test in the study patients. p < 0.05, ∗∗p < 0.01, ∗∗∗p < 0.001 as compared with baseline rest.

Univariate Linear Regression Analysis

Univariate regression analysis showed that global fatigue was significantly linked with ΔHR during the TSST task instruction (anticipatory stress): Mental fatigue was significantly associated with ΔSBP, ΔDBP and ΔHR, while the total fatigue was significantly associated with ΔSBP and ΔHR during TSST task instruction (anticipatory stress; see Table 3). Reduction in self-reported motivation was associated with ΔSBP during TSST arithmetic task (see Table 3), however after adjustment for multiple comparisons, this association was no longer significant and so was not included in further analysis. In addition, cardiovascular responses to the TSST were significantly linked with several sociodemographic and clinical characteristics (see Table 4), which were included in the further analysis as possible covariates.

TABLE 3
www.frontiersin.org

Table 3. The associations between cardiovascular reactivity during Trier Social Stress Test (TSST) in six stages and different domains of fatigue in study patients.

TABLE 4
www.frontiersin.org

Table 4. The associations between cardiovascular reactivity during Trier Social Stress Test in six stages and sociodemographic and clinical factors.

Multivariable Linear Regression Analysis

The main study hypotheses were tested using multivariable linear regression models. Multivariate outliers based on the analysis of Mahalanobis distance were not detected in any of the models. Analyses for multicollinearity showed adequate results (VIF values < 4). The covariates included in all models were: Baseline levels of cardiovascular measure (i.e., DBP, SBP or HR, respectively); age; gender; education; NYHA functional class; AH; smoking history; use of nitrates; anxiety and depressive symptoms; Type D Personality; perceived difficulty; and perceived efforts.

After controlling for possible covariates, global fatigue was found to predict diminished ΔHR (β = –0.238; p = 0.04) during TSST task instruction (anticipatory stress), explaining 20.5% of the variance (see Table 5). Mental fatigue was found to predict diminished ΔSBP (β = –0.244; p = 0.04) as well as lower ΔHR (β = –0.303; p = 0.01) during TSST task instruction (anticipatory stress), explaining 19.5 and 22.6% of the variance, respectively (see Table 6). Total fatigue score predicted diminished ΔSBP (β = –0.331; p = 0.01) and ΔHR (β = –0.324; p = 0.01) during TSST task instruction (anticipatory stress), explaining 21.7 and 24.0% of the variance, respectively (see Table 7). No significant associations were found between fatigue and other cardiovascular responses to TSST during other phases. There was also no association between fatigue and baseline cardiovascular measures.

TABLE 5
www.frontiersin.org

Table 5. Multivariable Linear Regression model, examining global fatigue score associations with cardiovascular reactivity during Trier Social Stress Test (TSST) anticipatory stress (task instruction), while controlling for possible covariates.

TABLE 6
www.frontiersin.org

Table 6. Multivariable Linear Regression model, examining mental fatigue score associations with cardiovascular reactivity during Trier Social Stress Test anticipatory stress (task instruction), while controlling for possible covariates.

TABLE 7
www.frontiersin.org

Table 7. Multivariable Linear Regression model, examining total fatigue score associations with cardiovascular reactivity during Trier Social Stress Test anticipatory stress (task instruction), while controlling for possible covariates.

Discussion

The present study investigated whether subjectively experienced fatigue is associated with cardiovascular function before, during and after mental stress in CAD patients who have experienced ACS. It was hypothesized that higher subjective fatigue would be linked with diminished cardiovascular function during mental stress. In the present study, effects were observed for cardiovascular function during anticipatory stress, while participants were preparing an oral presentation as part of the TSST. Associations were found for global fatigue, mental fatigue, and total fatigue. All measures of fatigue were associated with diminished cardiovascular function during anticipatory stress. These effects remained significant even after controlling for gender, age, education, heart failure severity, history of smoking, use of nitrates, anxiety/depressive symptoms, and presence of Type D personality, as well as perceived efforts and difficulty of the task. While the observed effects for fatigue arose for anticipatory stress, fatigue was not predictive of cardiovascular function during active stress phases of the TSST.

The current study is the first to explore links between fatigue and cardiovascular responses to stress in patients with CAD. It extends prior research investigating similar associations in other populations. For example, Nolte et al. (2008) investigated associations between cardiovascular stress reactivity and naturally occurring fatigue in undergraduate women, and found that blood pressure during stress was inversely associated with fatigue. Their study drew attention to the potential role of subjective task difficulty and effort in such effects (Nolte et al., 2008; Wright et al., 2008; Wright, 2009). Taking this into consideration, in the present study, all observed associations for fatigue and cardiovascular function during anticipatory stress remained significant even while controlling for subjective difficulty and efforts, as well as for other sociodemographic and clinical parameters.

Similar to the current study results, Soetekouw et al. (1999) reported that persons with CFS exhibited suppressed HR during mental arithmetic stress compared to controls, indicating maladaptive cardiac sympathetic reactivity to mental stress. While the methodology and study population differed, the present study yielded broadly similar findings. Together, both studies further implicate diminished cardiovascular stress reactivity as an indicator of maladaptive autonomic response that characterize poor states of health (Lovallo, 2011; Hughes et al., 2018).

Despite the consistent findings with previous research (Soetekouw et al., 1999; Nolte et al., 2008), the findings of the present study contrast with other published results. For instance, Wright et al. (2008) found an association between high fatigue and higher cardiovascular reactivity to an emotional stressor in female college students. Another study by Nelesen et al. (2008) reported no effect of fatigue with regards to cardiovascular reactivity during a mental stress challenge. These different results likely arise due to their methodological and population differences, chiefly the age and disease status of the participants, but also differences in the measurement of fatigue.

The current study revealed that an apparently blunted cardiovascular response to anticipatory stress is associated with subjectively experienced fatigue in CAD patients who have experienced ACS. Phillips et al. (2013) have summarized several reasons why diminished cardiovascular stress responsivity can arise, including lower task effort, reduced stress perception, disproportionate feelings of task difficulty, reduced physiological capacity to respond, and motivational dysregulation within brain activity. In this study, even while controlling for subjective efforts and assumed difficulty of the task, associations between lower cardiovascular stress reactivity and fatigue remained, suggesting—perhaps—that the effects were related more to central dysfunction than to perceptual factors. However, it was beyond the scope of this study to investigate the reduced physiological capacity to respond to stressful stimuli or motivational dysregulation.

Neither blunted nor exaggerated stress reactions can be considered adaptive (Phillips et al., 2013). In this study it was found that in CAD patients who were more fatigued, cardiovascular reactivity was more diminished during anticipatory stress. Anticipation ordinarily helps the body to prepare for oncoming stress. When an individual is suffering with fatigue, it may lead to poor bodily preparation for the upcoming stressor, thereby compounding the maladaptive effects of fatigue. It is well established that individuals with CFS show significant changes in the function of sympathetic as well as parasympathetic nervous systems (Soetekouw et al., 1999). The sympathetic nervous system predominance in persons with chronic fatigue highlights the way in which fatigued individuals are constantly under stress (Luyten et al., 2011), which leads to sympathetic over-activity (Martínez-Martínez et al., 2014). It has been argued that constant sympathetic over-activity could be partly responsible for lost functional capacity to confront life stressors (Siegrist et al., 1989). If that is the case, the current finding of blunted anticipatory cardiovascular stress response and its independent association with fatigue in patients with CAD after ACS may reflect maladaptive cardiac functioning.

Despite the consistent findings, several limitations should be noted. First, this study was completed in a single unit of a CR clinic. Therefore, generalizability to other cohorts should not be assumed until corroborated. Secondly, the current research followed a cross-sectional study design, thus a possible causational relationship between cardiovascular stress reactivity and subjective fatigue could not be drawn and further longitudinal studies are required. Thirdly, there was no inclusion of a healthy control group, which could have allowed for comparison of the cardiovascular stress response between those with CAD after ACS, and healthy individuals otherwise.

Nevertheless, the major strength of this study is the opportunity to isolate effects of fatigue in patients with CAD, for whom subtle variations in cardiovascular function during stress is likely of greater clinical significance than in health populations. Given the preponderance of past research on healthy populations, especially college students, the present findings also serve to complement the existing literature in cardiovascular reactivity and related factors. This research also examined variety of sociodemographic and clinical characteristics, which helped to isolate possible confounders for existing associations between cardiovascular reactivity during mental stress and fatigue in study patients. Given the severe illness of the study participants, the sample size was somewhat restricted in scope, but nonetheless large enough to demonstrate important effects.

Future replications will be of high importance in larger and more diverse samples. Such research should concentrate on not only cardiovascular reactivity, but also on neuroendocrinological stress responses (i.e., cortisol responses), as such responses are intricately intertwined with physical fatigue. Fatigue is a problematic symptom commonly experienced by patients with CAD. As such, the current findings draw attention to the way diminished stress responses in fatigued patient can serve as possible indicators of adverse health that may bolster clinical understanding, as well as diagnostic evaluation and treatment.

Conclusion

In the current study it was found that global, mental and overall fatigue were linked to cardiovascular reactivity during anticipatory stress in patients with severe cardiovascular pathology. The effects remained significant after comprehensively controlling for potential confounds, both medical, psychological, and perceptual. This is the first study to investigate psychophysiological stress response and its relationship with fatigue in an acutely ill cardiac population.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.

Ethics Statement

This study involving human participants were reviewed and approved by the Kaunas Regional Ethics Committee for Biomedical Research in Lithuania. The participants provided their written informed consent to participate in this study.

Author Contributions

JG-S: conceptualization, methodology, formal analysis, writing—original draft, review, and editing, and investigation. BH and LH: writing—review and editing. JBr and NM: conceptualization and supervision. AB, JBu, JN, NK, and NM: revision and supervision. All authors provided critical revision to its further development, read and approved the final manuscript.

Conflict of Interest

JG-S served as a consultant at FACITtrans. In the past several years JBu has been serving as a consultant to Cogstate, Ltd.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

We would like to thank the staff of the Laboratory of Behavioral Medicine for their great help in conducting this research, especially for statistician Elena Bovina, who made a significant impact in analyzing the data.

References

Aaronson, L. S., Teel, C. S., Cassmeyer, V., Neuberger, G. B., Pallikkathayil, L., Pierce, J., et al. (1999). Defining and measuring fatigue. Image J. Nurs. Sch. 31, 45–50.

Google Scholar

Allen, A. P., Kennedy, P. J., Dockray, S., Cryan, J. F., Dinan, T. G., and Clarke, G. (2017). The trier social stress test: principles and practice. Neurobiol. Stress 6, 113–126. doi: 10.1016/j.ynstr.2016.11.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Al-Mallah, M. H., Sakr, S., and Al-Qunaibet, A. (2018). Cardiorespiratory Fitness and Cardiovascular Disease Prevention: an Update. Curr. Atheroscler. Rep. 20:1. doi: 10.1007/s11883-018-0711-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Amsterdam, E. A., Wenger, N. K., Brindis, R. G., Casey, D. E., Ganiats, T. G., Holmes, D. R., et al. (2014). 2014 AHA/ACC guideline for the management of patients with non–ST-elevation acute coronary syndromes: executive summary: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J. Am. Coll. Cardiol. 64, 2645–2687.

Google Scholar

Benjamini, Y., and Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc. Series B Methodol. 57, 289–300. doi: 10.1111/j.2517-6161.1995.tb02031.x

CrossRef Full Text | Google Scholar

Birkett, M. A. (2011). The Trier Social Stress Test protocol for inducing psychological stress. J. Vis. Exp. 56:e3238.

Google Scholar

Blake, H., McKinney, M., Treece, K., Lee, E., and Lincoln, N. B. (2002). An evaluation of screening measures for cognitive impairment after stroke. Age Ageing 31, 451–456. doi: 10.1093/ageing/31.6.451

PubMed Abstract | CrossRef Full Text | Google Scholar

Burkauskas, J., Bunevicius, A., Brozaitiene, J., Neverauskas, J., Fineberg, N. A., Wellsted, D., et al. (2017). Exploring Cognitive Concomitants of Mental Fatigue in Patients with Coronary Artery Disease. Neuropsychobiology 76, 151–160. doi: 10.1159/000489713

PubMed Abstract | CrossRef Full Text | Google Scholar

Burton, L., and Tyson, S. F. (2015). Screening for cognitive impairment after stroke: a systematic review of psychometric properties and clinical utility. J. Rehabil. Med. 47, 193–203. doi: 10.2340/16501977-1930

PubMed Abstract | CrossRef Full Text | Google Scholar

Cameron, L. D., Petrie, K. J., Ellis, C., Buick, D., and Weinman, J. A. (2005). Symptom experiences, symptom attributions, and causal attributions in patients following first-time myocardial infarction. Int. J. Behav. Med. 12, 30–8. doi: 10.1207/s15327558ijbm1201_5

PubMed Abstract | CrossRef Full Text | Google Scholar

Cox, E. Q., Stuebe, A., Pearson, B., Grewen, K., Rubinow, D., and Meltzer-Brody, S. (2015). Oxytocin and HPA stress axis reactivity in postpartum women. Psychoneuroendocrinology 55, 164–172. doi: 10.1016/j.psyneuen.2015.02.009

PubMed Abstract | CrossRef Full Text | Google Scholar

De Lemos, J., and Omland, T. (2017). Chronic Coronary Artery Disease: A Companion to Braunwald’s Heart Disease. Amsterdam: Elsevier Health Sciences.

Google Scholar

Denollet, J. (2005). DS14: standard assessment of negative affectivity, social inhibition, and Type D personality. Psychosom. Med. 67, 89–97. doi: 10.1097/01.psy.0000149256.81953.49

CrossRef Full Text | Google Scholar

Fletcher, G. F., Ades, P. A., Kligfield, P., Arena, R., Balady, G. J., Bittner, V. A., et al. (2013). Exercise standards for testing and training: a scientific statement from the American Heart Association. Circulation 128, 873–934. doi: 10.1161/cir.0b013e31829b5b44

PubMed Abstract | CrossRef Full Text | Google Scholar

Folstein, M. F., Folstein, S. E., and McHugh, P. R. (1975). “Mini-mental state”: a practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12, 189–198.

Google Scholar

Fredriksson-Larsson, U., Alsén, P., Karlson, B. W., and Brink, E. (2015). Fatigue two months after myocardial infarction and its relationships with other concurrent symptoms, sleep quality and coping strategies. J. Clin. Nurs. 24, 2192–2200. doi: 10.1111/jocn.12876

PubMed Abstract | CrossRef Full Text | Google Scholar

Frisch, J. U., Häusser, J. A., and Mojzisch, A. (2015). The Trier Social Stress Test as a paradigm to study how people respond to threat in social interactions. Front. Psychol. 6:14. doi: 10.3389/fpsyg.2015.00014

PubMed Abstract | CrossRef Full Text | Google Scholar

Gecaite, J., Burkauskas, J., Brozaitiene, J., and Mickuviene, N. (2019). Cardiovascular Reactivity to Acute Mental Stress: the importance of type d personality, trait anxiety, and depression symptoms in patients after acute coronary syndromes. J. Cardiopulm. Rehabil. Prev. 39, E12–E18. doi: 10.1097/hcr.0000000000000457

PubMed Abstract | CrossRef Full Text | Google Scholar

Gecaite-Stonciene, J., and Bunevicius, A. (2020). Validation of the multidimensional fatigue inventory with coronary artery disease patients. Int. J. Environ. Res. Public Health 17:8003. doi: 10.3390/ijerph17218003

PubMed Abstract | CrossRef Full Text | Google Scholar

Girdler, S. S., Maixner, W., Naftel, H. A., Stewart, P. W., Moretz, R. L., and Light, K. C. (2005). Cigarette smoking, stress-induced analgesia and pain perception in men and women. Pain 114, 372–385. doi: 10.1016/j.pain.2004.12.035

PubMed Abstract | CrossRef Full Text | Google Scholar

Gronwall, D. (1977). Paced auditory serial-addition task: a measure of recovery from concussion. Percept. Mot. Skills 44, 367–373. doi: 10.2466/pms.1977.44.2.367

PubMed Abstract | CrossRef Full Text | Google Scholar

Guan, S., Xiaerfuding, X., Ning, L., Lian, Y., Jiang, Y., Liu, J., et al. (2017). Effect of Job Strain on Job Burnout, Mental Fatigue and Chronic Diseases among Civil Servants in the Xinjiang Uygur Autonomous Region of China. Int. J. Environ. Res. Public Health 14:872. doi: 10.3390/ijerph14080872

PubMed Abstract | CrossRef Full Text | Google Scholar

Holmes, S. D., Krantz, D. S., Rogers, H., Gottdiener, J., and Contrada, R. J. (2006). Mental stress and coronary artery disease: a multidisciplinary guide. Prog. Cardiovasc. Dis. 49, 106–122. doi: 10.1016/j.pcad.2006.08.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Howard, S., Hughes, B. M., and James, J. E. (2011). Type D personality and hemodynamic reactivity to laboratory stress in women. Int. J. Psychophysiol. 80, 96–102. doi: 10.1016/j.ijpsycho.2011.02.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Hughes, B. M., Lü, W., and Howard, S. (2018). Cardiovascular stress-response adaptation: conceptual basis, empirical findings, and implications for disease processes. Int. J. Psychophysiol. 131, 4–12. doi: 10.1016/j.ijpsycho.2018.02.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Irvine, J., Basinski, A., Baker, B., Jandciu, S., Paquette, M., Cairns, J., et al. (1999). Depression and risk of sudden cardiac death after acute myocardial infarction: testing for the confounding effects of fatigue. Psychosom. Med. 61, 729–737. doi: 10.1097/00006842-199911000-00001

PubMed Abstract | CrossRef Full Text | Google Scholar

Johnston, S., and Eckhardt, A. L. (2018). Fatigue and acute coronary syndrome: a systematic review of contributing factors. Heart Lung 47, 192–204. doi: 10.1016/j.hrtlng.2018.03.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Jones, S. C., Bilous, M., Winship, S., Finn, P., and Goodwin, J. (2004). Validation of the OSCAR 2 oscillometric 24-hour ambulatory blood pressure monitor according to the International Protocol for the validation of blood pressure measuring devices. Blood Press Monit. 9, 219–223. doi: 10.1097/00126097-200408000-00007

PubMed Abstract | CrossRef Full Text | Google Scholar

Katz, M. H. (2011). Multivariable Analysis: A Practical Guide for Clinicians and Public Health Researchers. Cambridge: Cambridge university press.

Google Scholar

Kirschbaum, C., Pirke, K. M., and Hellhammer, D. H. (1993). The ‘Trier Social Stress Test’–a tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology 28, 76–81. doi: 10.1159/000119004

PubMed Abstract | CrossRef Full Text | Google Scholar

Kupper, N., and Denollet, J. (2018). Type D Personality as a Risk Factor in Coronary Heart Disease: a Review of Current Evidence. Curr. Cardiol. Rep. 20, 104–104. doi: 10.1007/s11886-018-1048-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Kupper, N., Denollet, J., Widdershoven, J., and Kop, W. J. (2013). Type D personality is associated with low cardiovascular reactivity to acute mental stress in heart failure patients. Int. J. Psychophysiol. 90, 44–49. doi: 10.1016/j.ijpsycho.2013.01.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Levin, R., Dolgin, M., Fox, C., and Gorlin, R. (1994). The Criteria Committee of the New York Heart Association. inNomenclature and criteria for diagnosis of diseases of the heart and great vessels. LWW Handbooks 9, 253–256.

Google Scholar

Lovallo, W. R. (2011). Do low levels of stress reactivity signal poor states of health? Biol. Psychol. 86, 121–128. doi: 10.1016/j.biopsycho.2010.01.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Luyten, P., Kempke, S., Van Wambeke, P., Claes, S., Blatt, S. J., and Van Houdenhove, B. (2011). Self-critical perfectionism, stress generation, and stress sensitivity in patients with chronic fatigue syndrome: relationship with severity of depression. Psychiatry 74, 21–30. doi: 10.1521/psyc.2011.74.1.21

PubMed Abstract | CrossRef Full Text | Google Scholar

Marioni, R. E., Chatfield, M., Brayne, C., Matthews, F. E., Medical Research, Council Cognitive, F., et al. (2011). The reliability of assigning individuals to cognitive states using the Mini Mental-State Examination: a population-based prospective cohort study. BMC Med. Res. Methodol. 11:127. doi: 10.1186/1471-2288-11-127

PubMed Abstract | CrossRef Full Text | Google Scholar

Martínez-Martínez, L.-A., Mora, T., Vargas, A., Fuentes-Iniestra, M., and Martínez-Lavín, M. (2014). Sympathetic nervous system dysfunction in fibromyalgia, chronic fatigue syndrome, irritable bowel syndrome, and interstitial cystitis: a review of case-control studies. J. Clin. Rheumatol. 20, 146–150. doi: 10.1097/rhu.0000000000000089

PubMed Abstract | CrossRef Full Text | Google Scholar

Matura, L. A., Malone, S., Jaime-Lara, R., and Riegel, B. (2018). A systematic review of biological mechanisms of fatigue in chronic illness. Biol. Res. Nurs. 20, 410–421. doi: 10.1177/1099800418764326

PubMed Abstract | CrossRef Full Text | Google Scholar

Mechlin, B., Morrow, A. L., Maixner, W., and Girdler, S. S. (2007). The relationship of allopregnanolone immunoreactivity and HPA-axis measures to experimental pain sensitivity: evidence for ethnic differences. Pain 131, 142–152. doi: 10.1016/j.pain.2006.12.027

PubMed Abstract | CrossRef Full Text | Google Scholar

Nelesen, R., Dar, Y., Thomas, K., and Dimsdale, J. E. (2008). The relationship between fatigue and cardiac functioning. Arch. Intern. Med. 168, 943–949. doi: 10.1001/archinte.168.9.943

PubMed Abstract | CrossRef Full Text | Google Scholar

Nolte, R. N., Wright, R. A., Turner, C., and Contrada, R. J. (2008). Reported fatigue, difficulty, and cardiovascular response to a memory challenge. Int. J. Psychophysiol. 69, 1–8. doi: 10.1016/j.ijpsycho.2008.02.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Phillips, A. C., Der, G., Shipton, D., and Benzeval, M. (2011). Prospective associations between cardiovascular reactions to acute psychological stress and change in physical disability in a large community sample. Int. J. Psychophysiol. 81, 332–337. doi: 10.1016/j.ijpsycho.2011.08.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Phillips, A. C., Ginty, A. T., and Hughes, B. M. (2013). The other side of the coin: blunted cardiovascular and cortisol reactivity are associated with negative health outcomes. Int. J. Psychophysiol. 90, 1–7. doi: 10.1016/j.ijpsycho.2013.02.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Phillips, A. C., Roseboom, T. J., Carroll, D., and de Rooij, S. R. (2012). Cardiovascular and cortisol reactions to acute psychological stress and adiposity: cross-sectional and prospective associations in the Dutch Famine Birth Cohort Study. Psychosom. Med. 74, 699–710. doi: 10.1097/psy.0b013e31825e3b91

PubMed Abstract | CrossRef Full Text | Google Scholar

Piepoli, M. F., Hoes, A. W., Agewall, S., Albus, C., Brotons, C., Catapano, A. L., et al. (2016). 2016 European Guidelines on cardiovascular disease prevention in clinical practice: the Sixth Joint Task Force of the European Society of Cardiology and Other Societies on Cardiovascular Disease Prevention in Clinical Practice (constituted by representatives of 10 societies and by invited experts) Developed with the special contribution of the European Association for Cardiovascular Prevention & Rehabilitation (EACPR). Eur. Heart J. 37, 2315–2381. doi: 10.1093/eurheartj/ehw106

PubMed Abstract | CrossRef Full Text | Google Scholar

Ream, E., and Richardson, A. (1996). Fatigue: a concept analysis. Int. J. Nurs. Stud. 33, 519–529.

Google Scholar

Siegrist, J., Klein, D., and Matschinger, H. (1989). “Occupational stress, coronary risk factors and cardiovascular responsiveness,” in Frontiers of Stress Research, (Toronto: Hans Huber Publishers), 323–335.

Google Scholar

Smets, E., Garssen, B., Bonke, B. D., and De Haes, J. (1995). The Multidimensional Fatigue Inventory (MFI) psychometric qualities of an instrument to assess fatigue. J. Psychosom. Res. 39, 315–325. doi: 10.1016/0022-3999(94)00125-o

CrossRef Full Text | Google Scholar

Snaith, R. P. (2003). The hospital anxiety and depression scale. Health Qual. Life Outcomes 1:29.

Google Scholar

Soetekouw, P., Lenders, J., Bleijenberg, G., Thien, T., and van der Meer, J. (1999). Autonomic function in patients with chronic fatigue syndrome. Clin. Auton. Res. 9, 334–340.

Google Scholar

Staniute, M., Bunevicius, A., Brozaitiene, J., and Bunevicius, R. (2014). Relationship of health-related quality of life with fatigue and exercise capacity in patients with coronary artery disease. Eur. J. Cardiovasc. Nurs. 13, 338–344. doi: 10.1177/1474515113496942

PubMed Abstract | CrossRef Full Text | Google Scholar

Steg, P. G., James, S. K., Atar, D., Badano, L. P., Blomstrom-Lundqvist, C., Borger, M. A., et al. (2012). ESC Guidelines for the management of acute myocardial infarction in patients presenting with ST-segment elevation. Eur. Heart J. 33, 2569–2619. doi: 10.1093/eurheartj/ehs215

PubMed Abstract | CrossRef Full Text | Google Scholar

Steptoe, A., and Kivimäki, M. (2012). Stress and cardiovascular disease. Nat. Rev. Cardiol. 9, 360–70.

Google Scholar

Tavakol, M., and Dennick, R. (2011). Making sense of Cronbach’s alpha. Int. J. Med. Educ. 2, 53–55. doi: 10.5116/ijme.4dfb.8dfd

PubMed Abstract | CrossRef Full Text | Google Scholar

Turner, J. R. (1994). Cardiovascular Reactivity and Stress: Patterns of Physiological Response. Berlin: Springer Science & Business Media.

Google Scholar

van Geffen, M. E., Ter Hoeve, N., Sunamura, M., Stam, H. J., van Domburg, R. T., and van den Berg-Emons, R. J. (2015). Fatigue during and after cardiac rehabilitation. J. Rehabil. Med. 47, 569–574. doi: 10.2340/16501977-1967

PubMed Abstract | CrossRef Full Text | Google Scholar

von Dawans, B., Kirschbaum, C., and Heinrichs, M. (2011). The Trier Social Stress Test for Groups (TSST-G): a new research tool for controlled simultaneous social stress exposure in a group format. Psychoneuroendocrinology 36, 514–522. doi: 10.1016/j.psyneuen.2010.08.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Wewers, M. E., and Lowe, N. K. (1990). A critical review of visual analogue scales in the measurement of clinical phenomena. Res. Nurs. Health 13, 227–236. doi: 10.1002/nur.4770130405

PubMed Abstract | CrossRef Full Text | Google Scholar

Wright, R. A. (2009). “Drained: Studies of fatigue influence on engagement and associated cardiovascular responses,” in Psychological Factors and Cardiovascular Disorders: The Role of Stress and Psychosocial Influences, ed. L. Sher (New York: Nova Science), 195–212.

Google Scholar

Wright, R. A. (2014). Presidential address 2013: fatigue influence on effort—Considering implications for self-regulatory restraint. Motiv. Emot. 38, 183–195. doi: 10.1007/s11031-014-9406-5

CrossRef Full Text | Google Scholar

Wright, R. A., Stewart, C. C., and Barnett, B. R. (2008). Mental fatigue influence on effort-related cardiovascular response: extension across the regulatory (inhibitory)/non-regulatory performance dimension. Int. J. Psychophysiol. 69, 127–133. doi: 10.1016/j.ijpsycho.2008.04.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Zègre-Hemsey, J. K., Burke, L. A., and DeVon, H. A. (2018). Patient-reported symptoms improve prediction of acute coronary syndrome in the emergency department. Res. Nurs. Health 41, 459–468. doi: 10.1002/nur.21902

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: stress, cardiovascular response, fatigue, physiology, coronary artery disease, acute coronary syndrome, cardiovascular measures, cardiovascular dysfunction

Citation: Gecaite-Stonciene J, Hughes BM, Burkauskas J, Bunevicius A, Kazukauskiene N, van Houtum L, Brozaitiene J, Neverauskas J and Mickuviene N (2021) Fatigue Is Associated With Diminished Cardiovascular Response to Anticipatory Stress in Patients With Coronary Artery Disease. Front. Physiol. 12:692098. doi: 10.3389/fphys.2021.692098

Received: 07 April 2021; Accepted: 13 July 2021;
Published: 17 August 2021.

Edited by:

Carlos C. Crestani, São Paulo State University, Brazil

Reviewed by:

Antonio Roberto Zamunér, Catholic University of Maule, Chile
Bruno Rodrigues, State University of Campinas, Brazil

Copyright © 2021 Gecaite-Stonciene, Hughes, Burkauskas, Bunevicius, Kazukauskiene, van Houtum, Brozaitiene, Neverauskas and Mickuviene. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Julija Gecaite-Stonciene, Julija.Gecaite@lsmuni.lt

Download