Brief Research Report ARTICLE
Death Associated With Coronavirus (COVID-19) Infection in Individuals With Severe Mental Disorders in Sweden During the Early Months of the Outbreak—An Exploratory Cross-Sectional Analysis of a Population-Based Register Study
- 1Division of Psychiatry, Department of Clinical Sciences, Umeå University, Umeå, Sweden
- 2Department of Clinical Neuroscience, Center for Psychiatry Research & Stockholm Health Care Services, Stockholm County Council, Karolinska Institutet, Stockholm, Sweden
- 3Division of Psychiatry, Sunderby Research Unit, Department of Clinical Sciences, Umeå University, Umeå, Sweden
- 4Department of Clinical Microbiology, Umeå University, Umeå, Sweden
Background: Individuals with severe mental disorder (SMD) have a higher risk of somatic comorbidity and mortality than the rest of the population. We set up a population-based study to assess whether individuals with SMD had a higher risk of death associated with a COVID-19 infection (COVID-19 associated death) than individuals without SMD.
Methods: Exploratory analysis with a cross-sectional design in the framework of a population-based register study covering the entire Swedish population. The Swedish Board for Health and Welfare (Socialstyrelsen) provided anonymized tabulated summary data for further analysis. We compared numbers of COVID-19 associated death in individuals with SMD (cases) and without SMD (controls). We calculated the odds ratio (OR) for the whole sample and by age group and four comorbidities, namely diabetes, cardiovascular disease, hypertension, chronic lung disease.
Results: The sample comprised of 7,923,859 individuals, 103,999 with SMD and 7,819,860 controls. There were 130 (0.1%) COVID-19 associated deaths in the SMD group and 4,945 (0.06%) in the control group, corresponding to an OR of 1.98 (CI 1.66-2.35; p < 0.001). The odds were 4-fold for the age groups between 60 and 79 years and 1.5-fold for cardiovascular diseases. Individuals with SMD without any of the risk factors under study had 3-fold odds of COVID-19 associated death.
Conclusion: Our preliminary results identify individuals with SMD as a further group at increased risk of COVID-19 associated death. In regard to comorbidities, future studies should explore the potential confounding or mediation role in the relationship between SMD and COVID-19 associated deaths.
Severe mental disorders (SMD), such as bipolar or psychotic disorders are associated with premature mortality. SMD has a substantial impact on life expectancy, which may be shortened by 10 to 20 years (1–3). Somatic disorders account for at least 50% of this shortened life expectancy (3). Cardiovascular conditions are the main cause of premature death (3–5). Infectious diseases also seem to contribute to a shortened life expectancy in individuals with SMD (1, 2). It currently remains unclear whether individuals with severe SMD have an increased risk of death associated with coronavirus SARS-CoV-2 (COVID-19) infection. The question is important, since individuals with SMD may have an excess risk of factors linked to an adverse outcome of COVID-19 infection. Such include comorbidities such as cardiovascular conditions, diabetes, chronic respiratory disease, hypertension and obesity (6, 7). At the same time, individuals with SMD have less access to somatic health care (5, 8). Therefore, there are reasons to believe that individuals with SMDs experience a higher mortality associated with COVID-19 infection than the rest of the population. If this assumption held true, individuals with SMD would join the category of individuals at increased risk of an adverse clinical course of COVID-19 infection, along with people who are older, obese or who have pre-existing somatic conditions. We set up a national register study to examine this hypothesis. In order to be able to make health professionals aware of this potential risk group as soon as possible, we conducted a first exploratory analysis, which we report here.
To assess the risk of death associated with COVID-19 infection (COVID-19 associated death) in individuals with SMD. We tested the following hypothesis: Individuals with SMD have a higher risk of COVID-19 associated death than individuals without SMD (reference population).
The current study is part of a longitudinal population-based register study based on the Swedish National Patient Register, the Swedish National Death Register, and the Swedish Prescribed Drug Register. All registers are held by the Swedish Board for Health and Welfare (Socialstyrelsen). For this exploratory analysis, we chose a cross-sectional design, linking the Swedish National Patient Register and the Swedish National Death Register. The data manager at the Swedish Board for Health and Welfare linked the respective registers through the unique personal identification number (Swedish personal number). Anonymized tabulated summary data was made available to the research team for further analysis. We checked our whole method against the Strobe checklist (Appendix 1) (9).
The Swedish National Patient Register is based on diagnoses for both in and outpatient care in specialized medicine (secondary care). Diagnoses from general practitioners (primary care) are not included in this register. The Swedish National Death Register includes all Swedish persons that have died. The cause of death is established in either primary or secondary care, depending on where the death has occurred. The Swedish Prescribed Drug Register contains data on treatments that were dispensed at a pharmacy.
We included the whole Swedish population of at least 20 years of age by 31 Dec 2019. We defined individuals with a diagnosis of SMD as cases and all other individuals as controls. As the sample covered the whole adult Swedish population, all individuals fell either into the category “SMD” or the category “without SMD.” Therefore, there were no other exclusion criteria other than age < 20 years. The cut-off of 20 years was chosen, because we used multiples of 10 years to stratify our data. Eighteen to twenty years was left out, because of the short age span and expected low risk of COVID-19 associated death in young people.
In Sweden, the first confirmed case of COVID-19 infection was reported on 31st January 2020 (10). The first COVID-19 related death was reported on 11th March 2020 (11). Our outcome was COVID-19 associated death, registered as such by the Swedish Board for Health and Welfare. We included all COVID-19 associated deaths occurring over a 3 month period, from 11 March 2020 until 15 June 2020.
We analyzed COVID-19 associated deaths as a dichotomous yes/no variable. The Swedish Board for Health and Welfare bases the criteria COVID-19 associated death on the underlying cause of death recorded on the death certificates. Two codes of the 10th version of the International Classification of Diseases (ICD-10) (12) are currently used, U07.1 or U07.2. Both codes fall into the ICD-10 chapter for provisional assignment of new diseases of uncertain etiology or emergency use (U00–U49). U07.1 is used when COVID-19 has been confirmed by laboratory testing irrespective of severity of clinical signs or symptoms. U07.2 is used when COVID-19 is diagnosed clinically or epidemiologically, but laboratory testing is inconclusive or not available (12). The World Health Organization (WHO) defines as “epidemiologically linked” “being linked to a cluster with at least one confirmed case” (13).
The main exposure was SMD. Into the SMD variable, we included psychotic disorders with ICD-10 codes F20, F22, F25, and bipolar disorders/single manic episodes with ICD-10 codes F30, or F31. We combined these disorders into one category to increase the sample size for our relatively rare outcome, death. We focused on psychotic and bipolar disorders, since this allowed comparison with a previous Swedish register study reporting on somatic comorbidities, including lung diseases, and excess mortality in both conditions (1, 2). Individuals were included in the SMD category when there were at least two registered diagnoses between 1998 and 2019.
We also explored four somatic comorbidities, diabetes, cardiovascular diseases, hypertension and chronic respiratory diseases, which were available in the registers. In our choice of comorbidities, we were guided by the Swedish National Board of Health and Welfare, which defined groups deemed to have increased risk for severe course of Covid-19 infection in April 2020. This list was last updated 2 June 2020. Besides age over 70, this list includes cardiovascular disease, hypertension, diabetes, chronic renal disease, chronic respiratory disorders and other somatic disorders (14). From this list, we then chose our four comorbidities for two reasons, (a) being known to be associated with severe mental disorders, and (b) being of sufficient sample size to explore the relatively rare outcome of death. Comorbidities with lover prevalence would lead to only few individuals to be included, in which case the Swedish Board of Health and Social Welfare would withhold much of the information due to confidentiality reasons.
We introduced a fifth category “none of the above,” which included all other individuals. As the use of the term risk factor is ambiguous, we have used the term comorbidities instead, as a personal attribute linked to the (binary) outcome death and assumed to be present at the same time as the outcome or potentially having a role in the aetiological mechanism (15). We checked these comorbidities for a time period from 2015 to 2019, based on diagnosis or pharmacological treatment received, using ICD and Anatomical Therapeutic Chemical Classification System (ATC) codes. We used the following ICD and ATC codes, (a) diabetes ICD E10-14, ATC A10, (b) cardiovascular diseases ICD I20-25, I48, I50, I61, I63, I64.9, I69.1, I69.3, I69.4, I69.8, I70, (c) hypertension ICD I10.9, I11–13, I15, ATC C02, C03, C07AB02, C08CA, C09, and (d) chronic respiratory diseases ICD J40–47, J60–67, J68.4, J70.1, J70.3, J96.1, J96.8, E 84.0. We stratified age into the following groups, 20–39, 40–59, 60–69, 70–79, and 80+ years.
The data was provided as summary data in anonymized form by the Swedish Board of Health and Welfare. Statistical analysis underlying this summary data was performed by a statistician at the National Board of Health and Welfare. The research group then analyzed this data further. The data included information stratified according to case and controls on number of individuals in each age group and number of individuals in each comorbidity category. From this data, we calculated the odds ratios (OR) for COVID-19 associated death for (a) the whole sample, (b) for each age group, and (c) for each risk factor category. For OR according to age-group, each death was only counted once. For OR according to comorbidity category, a death could be counted several times when it appeared in more than one comorbidity category. As for this preliminary report we only had access to summary data, we could therefore only stratify by one variable at the time, age or comorbidity but not age and comorbidity. We calculated confidence intervals (CI) using Woolf's formula for the standard error. Significance was tested with z-test. The significance level as a measure of random variability as a source of error (16) was set to 0.05 throughout, corresponding to a 95% CI. As we had to rely on summary data and had no access to individual level data, we constructed the respective formulae in Excel (Figure 1). We then confirmed our analysis using the internet based statistical software MedCalc (17). We also used MedCalc to derive our p-values. Where available, we compared the results of our z-test to the results of the Fisher exact test, provided by the National Board of Health and Welfare. Identification of significant relationships was 100% concordant.
The number of deaths was available for all age groups. However, for some comorbidity categories, the number of deaths had been withheld due to confidentiality reasons. For summary estimates of comorbidities in the whole age group, we set missing data to 0.
Ethics and Consent Procedures
The study was approved by the Swedish Ethical Review Authority (DNR 2020-02759) and conducted according to the declaration of Helsinki. The data originated from routine information collected by the Swedish Board of Health and Welfare, then made available as summary data in anonymized form for this first exploratory analysis. As only anonymized data was provided and potentially identifiable data was withheld, informed consent was not required.
Baseline Characteristics of the Samples
The sample comprised of 7,923,859 individuals, 103,999 (1.3%) with SMD and 7,819,860 (98.7%) controls. As to be expected with a sample of that size, all differences regarding age groups and comorbidities under study were significant with p < 0.001 (Table 1).
Table 1. Age and risk factor distribution in patients with severe mental disorders vs. reference population.
COVID-19 Associated Death
There were 130 (0.13%) deaths associated with COVID-19 infection in the SMD group and 4,945 (0.06%) in the control group. In the SMD group, 90.0% of COVID-19 diagnoses were ascertained by test (U07.1). In the reference group, 91.2% of COVID-19 diagnoses were ascertained by test (U07.1). There were no significant differences in the proportion of COVID-19 diagnoses ascertained by test (U07.1) in both groups (p = 0.419). The SMD group had double odds of COVID-19 associated death (OR 1.98, CI 1.66–2.35; p < 0.001). Regarding age, higher odds were found for individuals with SMD in the older age groups, about 4-fold in the age groups of 60–69 years and 70–79 years, and about 2-fold in the age group 80+ years (all p < 0.001). For the age group of 40–59 years the OR narrowly missed the pre-defined significance level (p = 0.052). For the age group 20–29 years, the OR could not be calculated since data were withheld due to confidentiality reasons. Regarding comorbid conditions in individuals with SMD, 1.5-fold odds were found for cardiovascular diseases (p < 0.007). The other three comorbidities, diabetes, hypertension and chronic lung disease did not reach significance in terms of the pre-defined significance level. Individuals with SMD who had none of the sampled comorbid conditions had about 3-fold increased odds of COVID-19 associated death (p < 0.001) (Table 2).
Table 2. COVID-19 associated death having occurred between 1 January 2020 and 15 June 2020 in patients with severe mental disorder vs. reference population according to age or risk factors.
This is one of the first population-based studies reporting on the risk of COVID-19 associated mortality in individuals with SMD during the early months of the coronavirus outbreak. We found that individuals with SMD had almost double odds of COVID-19 associated death compared to the reference population without SMD. Individuals with SMD aged between 60 and 79 years were particularly vulnerable with more than 4-fold odds of COVID-19 associated death. Of the four comorbidities available for study, cardiovascular disease increased the odds of COVID-19 associated death by 50%. Individuals without any of the four comorbidities under study, had 3-fold odds of COVID-19 associated death. Our findings are in line with other recently published population-based studies from the US and the UK. One US study covered health records of 61 million adult patients across the country until 29 July 2020. This study compared patients with a recent diagnosis of mental disorder, including ADHD, bipolar disorder, depression or schizophrenia with all other patients without mental disorder defined in this way. Patients with mental disorder and COVID-19 infection also had a nearly 2-fold increased death rate with 8.5% vs. 4.7% among COVID-19 patients without mental disorder (18). Another analysis from the same database until 15 June 2020 showed that patients with substance use disorder (SUD) and COVID-19 had an approximately 30% increased death rate with 9.6% vs. 6.6% among COVID-19 patients without SUD (19). A UK biobank study explored the association between death, COVID-19 infections with tests performed between 16 March 2020 and 26 April 2020, and pre-existing medical conditions as ascertained between 2006 and 2010. This study included 269,070 COVID-19 positive individuals aged between 65 and 86 years. There were 507 COVID-19 positive inpatients, 141 (27.8%) of whom died. Five pre-existing conditions significantly increased the odds of dying. Dementia increased the odds of dying 7.3-fold, diabetes 3.1-fold, chronic obstructive pulmonary disease (COPD) 1.9-fold, pneumonia 1.9-fold, and depression 1.8-fold (20).
Severe Mental Disorder and Risk of Death From Other Respiratory Infections
At the time of writing, evidence regarding the association between SMD and COVID-19 infection is only emerging. But our findings are also in line with studies exploring the association between SMD and other (non-COVID-19) respiratory infections. A Swedish register study showed a 3- to 4-fold increased risk of death due to influenza or pneumonia in individuals with bipolar disorder (1). In individuals with schizophrenia, the risk was increased 7-fold (2). An American study also found a 7-fold increased risk of death due to pneumonia or influenza in adults with schizophrenia (21). A Danish register study explored all individuals hospitalized for any infection between 1995 and 2011. Individuals with bipolar or psychotic disorder had 52% increased mortality risk within 30 days after their infection (22). We could not find any study that explicitly explored risk factors associated with death from respiratory infections in individuals with SMD.
Underlying Medical Conditions Associated With a Severe Outcome From COVID-19 Infection in the General Population
The evidence regarding risk factors for a severe outcome from COVID-19 infection is rapidly evolving. The US Centers for Disease Control and Prevention (CDC) have collated a list of underlying medical conditions that increase a person's risk of severe illness from COVID-19, defined as hospitalization, admission to the ICU, intubation or mechanical ventilation, or death. On this list, these conditions are rated into three categories according to quality of evidence, (a) strongest and most consistent evidence, (b) mixed evidence, and (c) limited evidence. Conditions with the strongest and most consistent evidence include cancer, chronic kidney disease, COPD, heart conditions such as heart failure, coronary artery disease, or cardiomyopathies, obesity with a body mass index (BMI) > 30 kg/m2, severe obesity with a body mass index (BMI) > 40 kg/m2, sickle cell disease, smoking, solid organ transplantation and type-2 diabetes mellitus. Conditions with mixed evidence include asthma, cerebrovascular disease, hypertension, pregnancy, use of corticosteroids and other immunosuppressive medications. Conditions with limited evidence include bone-marrow transplantation, HIV, immune deficiencies, inherited metabolic disorders, liver disease, neurological conditions specific to pediatric conditions, other chronic lung diseases, overweight with a BMI > 25 but <30 kg/m2, complex pediatric conditions, thalassaemia and type-1 diabetes mellitus (23). Notably, SMD is not mentioned in this list.
The CDC list identifies a large number of potentially underlying medical conditions. Most of these could increase mortality risk in their own right. Thus, COVID-19 associated death may not necessarily be caused by COVID-19 infection. CDC statistics show that in just 6% of deaths involving COVID-19 infection, COVID-19 was the only cause mentioned. For the 94% deaths with conditions or causes in addition to COVID-19, there were on average 2.6 additional conditions or causes per death (24). An audit of 122 Covid-19 associated deaths from Östergötland County, Sweden, came to similar results. In only 15% of deaths, COVID-19 infection was given as the direct cause. In 70% COVID-19 infection was thought to be a contributory factor but not the main cause. In the remaining 15%, the death could not be related to COVID-19 infection (25).
Underlying Medical Conditions Associated With Death From COVID-19 Infection in Individuals With Severe Mental Disorder
In bipolar disorder and schizophrenia, comorbidity with at least one somatic condition is very common (26, 27). When acute physically ill, individuals with SMD may then be sicker. One insurance claims study from Taiwan compared the risk of death in an intensive care unit (ICU) between 203 patients with schizophrenia and 2,036 matched controls. In ICU, patients with schizophrenia were sicker, had a higher risk of acute organ dysfunction and death (28). Therefore, it is plausible that individuals with SMD may have a higher risk of COVID-19 associated death.
For our study, we chose four comorbidities thought to be more prevalent in individuals with SMD (21). We chose these comorbidities during the set-up of the study. At the time, evidence regarding comorbidities and other risk factors was only emerging. Therefore, we made an informed guess that these four risk factors could affect the risk of COVID-19 associated mortality. But only cardiovascular disease led to a significantly increased OR in individuals with SMD. Cardiovascular conditions belong to the CDC category of risk factors with the strongest and most consistent evidence (23). For hypertension and chronic lung disease, we did not find an increased risk of death. Hypertension belongs to the CDC category of risk factors with mixed evidence (23). Chronic lung disease includes conditions that fall in the CDC categories of either mixed or limited evidence (23). Surprisingly, diabetes did not significantly increase the risk of COVID-19 associated death in our study. However, our study is only exploratory, sampling the first 3 months of the outbreak. There is also a chance that diabetes was underestimated in individuals with SMD. Despite rising awareness, diabetes may be one of the comorbidities easily missed in individuals with SMD (29, 30).
Our current analysis is exploratory, covering the first 3 months of the COVID-19 outbreak in Sweden. Therefore, the comorbidity profile may change in future analyses. In our study, the OR was highest for the individuals with SMD who did not have any of our chosen four comorbidities. There is no plausible mechanism which could explain a direct role of SMD in the pathophysiology of COVID-19 infection, which would make SMD a risk factor in its own right. More likely, there were other factors and/or comorbidities, not captured by our study, that increased the mortality risk from COVID-19 infection in individuals with SMD. Yet, this clear excess mortality risk identified makes individuals with SMD a risk group of their own, even if SMD per se is not involved in the pathophysiology of COVID-19 infections or its clinical course. As already argued by Wang et al. based on their finding of excess mortality in patients with mental disorder (18), individuals with SMD should be added to the groups already known to be at risk of serious illness from COVID-19 infection, i.e., the elderly, the obese or those with somatic comorbidities. Ultimately, longitudinal studies are required to identify the factors and comorbidities that increase the risk of an adverse outcome from COVID-19 infection including death. This puts clinicians and policy makers at a moral dilemma. In view of the second wave of the pandemic and its threats to human health and lives clinicians and policy makers need to act according to the available evidence even if this evidence is currently incomplete.
Other Medical Factors and Conditions That May Specifically Associated With Severe Mental Disorder and/or Its Treatment
There may be other factors in individuals with SMD that can increase the risk for COVID-19 associated mortality. Such factors may either be associated with SMD itself, its pharmacological treatment or with a combination of both underlying SMD and its pharmacological treatment.
Factors associated with SMD include smoking and substance use disorder (SUD). Both remain highly prevalent in individuals with SMD (31–33). They increase the risk of pneumonia, cardiovascular disease, and compromised immunity. Increased risk for infection and subsequent worse outcomes may also result from difficulties to adhere to preventive measures (34).
Medical conditions associated with the pharmacological treatment include medication associated pneumonia, neutropenia and QT prolongation. Exposure to first-generation antipsychotics (FGA) or second-generation antipsychotics (SGA) may double the risk of pneumonia (35). Mortality from pneumonia may also increase (36). Mood stabilizers such as valproate and carbamazepine may be risk neutral. Lithium may be protective (37, 38), for reasons yet to be explained. Benzodiazepines and benzodiazepine related drugs (BZRD), taken by 30 to 60% of individuals with schizophrenia or bipolar disorder, are other concerns (39–42). Neutropenia and its extreme form agranulocytosis can occur with a variety of antipsychotics and mood-stabilizers, particularly with clozapine and carbamazepine (43). Some of the agents used to treat COVID-19 infection such as chloroquine, hydroxychloroquine, azithromycin, and lopinavir can also cause neutropenia (44). Hence, individuals with SMD taking such agents need careful monitoring (45). QT prolongation is a potentially dangerous adverse effect increasing the risk of torsade de pointes and current cardiac death. Many antipsychotics can prolong QT interval. Citalopram, escitalopram, tricyclic antidepressants and methadone can also prolong the QT interval. Intravenous administration, combination therapy or excess doses also increase the risk for QT prolongation (43). These psychotropic agents may become problematic in combination with somatic drugs also increasing QT interval, used for treating a COVID-19 infection. The latter group includes some antibiotics and antiarrhythmics, chloroquine, hydroxychloroquine and the antiviral and histamin-2 antagonist famotidine (44). It currently remains unclear how often such interactions with psychotropic drugs occur in the context of COVID-19 treatment.
Medical conditions associated with the underlying SMD and its treatment include obesity and venous thromboembolism (VTE). The likelihood of obesity is 2.8 to 4.4 times increased in individuals with schizophrenia and about 1.2 to 1.7 times increased in individuals with bipolar disorder or major depression (46). In part, this increased risk is associated with psychotropic medications. Antipsychotics are of particular concern. Of all antipsychotics, clozapine and olanzapine have the highest risk of weight gain (43, 46). Both schizophrenia and bipolar disorder are associated with an increased risk venous thromboembolism (VTE) in form of deep-vein thrombosis (DVT) or pulmonary embolism (PE). This increased risk of venous thromboembolism may be related to a higher risk of smoking and obesity in individuals with SMD. Immobilization, including lack of exercises, restraints and lower leg paralysis, and treatments with antipsychotics may constitute further risk factors for VTE (47, 48). Antipsychotics have also been implicated to increase the risk of VTE. Risk estimates range from 50% to 3-fold increased risk, depending on substance class (49, 50).
Based on previous experience from accounts of the Spanish flu 1918–1919 and recent respiratory infection outbreaks such as the SARS outbreak in 2002–2003, there is reason for concern that psychiatric conditions and suicide rates may increase under the ongoing pandemic. Anxiety, depression and post-traumatic stress syndrome (PTSD) may all become more prevalent (51–53). A COVID-19 infection, or fear of it, or physical distancing and related income loss and unemployment would represent the types of stresses that could exacerbate severe mental illness (54–57). Added economic stress and particularly unemployment could then further elevate levels of severe mental illness and suicide (57–59). Individuals with SMD may be particularly vulnerable because SMD in itself and its co-morbidities are likely associated with lower socioeconomic status (57). This would be consistent with findings from the US that COVID-19 mortality is more frequent in lower socioeconomic ethnic minority groups (60, 61). The impact of socioeconomic status and ethnicity on the risk of COVID-19 infection and mortality in individuals with SMD requires further study. As demonstrated, individuals with SMD are more vulnerable to stress, and in turn, stress may make affected individuals more vulnerable to a COVID-19 infection. Susceptibility to respiratory infections has been shown to increase under stressful conditions (62, 63). Possibly, prolonged stressors result in glucocorticoid receptor resistance, which then alters the local pro-inflammatory cytokine response to an infectious agent (64). In summary, a circularity could ensue between SMD, comorbid conditions, economic disruption and COVID-19 infection, where all factors precipitate or amplify each other. Similar circularities have been observed previously, for instance during the Great Depression in the US in the 1930 (57).
The major strength of this study is its large sample-size and representativeness with register data covering the entire Swedish population aged 20 years and older. Therefore, there is no scope for selection bias. Individuals fell into one group (SMD) or the other group (reference population); no further exclusion criteria were warranted. The summary data was prepared independently from the research group by a statistician at the Swedish Board of Health and Welfare. Hence, the scope for observation bias was minimized. A further strength lies in the accuracy of Swedish register data. For instance, the Swedish Cause of Death Register covers more than 99% of all deaths. Obviously, despite covering the whole Swedish population, our findings may not automatically generalizable to all population groups within Sweden, or as it matters to populations outside of Sweden. However, our findings are in line with other population-based studies from the US and the UK who found excess of COVID-19 associated mortality of similar magnitude.
Our data covered the early months of the COVID-19 outbreak in Sweden. In these early months, numbers of deaths were much higher with an average of 54 deaths per day during our observation period. The numbers of deaths then substantially dropped off from the beginning of August and the mortality curve has flattened out to an average of 4 deaths per day in October. At the time of writing at the end of November, the numbers of death have risen again, but nowhere near to previous levels and not in keeping the number of infections (65). Equally it remains unclear how this would affect the odds of COVID-19 associated death in individuals with SMD. In this preliminary report based on register data, it was not possible to distinguish if any increased odds of death due to COVID-19 in individuals with SMD was due to an increased risk of contracting the SARS-CoV-2 virus, or due to an increased risk of a severe course of COVID-19 illness resulting in death.
Individuals were classified as having severe mental disorders if they were diagnosed twice between 1998 and 2019. Theoretically, an individual diagnosed early on, for instance in 1998, but then remained symptom-free could be entered in the SMD category. This could have led to misclassification. However, this would most likely have resulted in an underestimation rather than an overestimation of the odds of COVID-19 associated death in individuals with SMD. Such a misclassification would therefore not invalidate our results. The scope for misclassification was further reduced by the requirement of having two such diagnoses registered. Besides, bipolar disorder and schizophrenia are both chronic disorders, often of life-long duration. Symptomatic remission may not be equated with functional recovery and residual symptoms may persist (66, 67). We intend to extend our analysis, which is currently based on summary data, with individual level data as soon as possible.
In order to maximize power, we amalgamated bipolar and psychotic disorders into SMD as one exposure category. Several other examples of epidemiological studies exist, where mood and psychotic disorders are amalgamated in similar ways (3, 22, 48, 68–70). Here, we combined psychotic and bipolar disorders into one category because the prevalence for somatic comorbidities and excess mortality are similar for both conditions (1, 2). We did not include severe depression in our SMD variable, since severe depression is a more heterogeneous group. For this group, based on register data alone, it can be difficult to establish whether depression is the cause or consequence of somatic comorbidity. However, based on the available literature, we have reason to believe that including individuals with depression into our study would not have substantially altered the results.
The US study examining the association between mental disorder and death associated with COVID-19 infection did not only find a 2-fold death rate in patients with mental disorder as compared with patients without any mental disorder. The death rate was also approximately double for patients with depression only (8.2%) (18). The UK study exploring the association between pre-existing comorbidities, COVID-19 infection and death found 80% increased odds of dying with a pre-existing diagnosis of depression (20). As pointed out previously, these figures are very similar to our own. Including the ICD code F30, manic episode, could lead to an inclusion of individuals with one single hypomanic episode under the ICD sub-category of F30.0. However, as each individual required at least two registered diagnosis, the scope of including such individuals is virtually non-existent.
Another source of misclassification could arise if individuals with SMD were less likely to be tested for COVID-19 than the rest of the population. This again would lead to an underestimation rather than an overestimation of COVID-19 associated mortality in individuals with SMD. In the beginning of the pandemic, testing was not ubiquitously available. Thus, diagnoses were also made clinically. This is reflected by the provisional ICD code U07.2. Thus, there was scope for misclassification due to false positive COVID-19 diagnoses. In both groups, about 90% of diagnoses were confirmed by laboratory testing (U07.1). Hence, the scope for misclassification was comparably low in both groups. As acknowledged earlier in this discussion, not every death associated with COVID-19 infection may have been caused by COVID-19 infection (24, 25). Distinguishing between causation and association may have been particularly difficult in the early months of the COVID-19 outbreak. However, this would have affected cases and controls in the same way without any impact on the OR.
As pointed out previously, for this exploratory analysis, we had to rely on summary data. Summary data are much less detailed than individual level data. However, we decided to report our summary data at this point to alert clinicians to this new risk group. We intend to conduct further analyses with individual level data as soon as possible. With individual level data it will be possible to adjust for baseline variables, such as age and sex, specific mental disorder (psychotic vs. bipolar disorder), psychotropic drugs used, residence (urban vs. rural), and other variables of potential importance as outlined in our discussion. The association between COVID-19 associated mortality and SMD involves most likely a large quantity of biological and psychosocial factors. Some of these will be confounders, but others may actually lie as mediators on exposure-outcome causal pathways. Thus, even though our finding that SMD doubles the odds of COVID-19 associated death is crude and preliminary, it is nevertheless noteworthy. We intend to expand our analysis on individual data level and more detailed stratification and adjustment for confounders and mediators next year, when more longitudinal data is available. To further study the impact of SMD on the risk of COVID-19 infection or associated deaths, both register and clinical studies are needed. Register studies have the advantage of large sample sizes, but clinical information is limited. Clinical studies will be smaller, but risk factors can be explored in more detail.
It could be argued that it would be more informative to wait until more longitudinal data was available. However, our time frame is in keeping with the time frame chosen in the US studies reporting on mental disorders and SUD (18, 19). Our time frame is substantially longer than the time frame of the UK study reporting on depression (20). At the same time individuals with SMD may be particularly vulnerable at the beginning of a pandemic when health care resources are redirected toward acute somatic care. Finally, although a vaccine is not yet available, decisions about its allocation are made now. The Public Health Agency of Sweden states that those most in need of help to prevent serious illness from COVID-19 infection will be given top priority and which groups are given priority will be determined by the state of knowledge available when the vaccine arrives (71). Therefore, waiting for more longitudinal data would deprive individuals with SMD from the opportunity to be considered a risk group meriting priority (72).
Our preliminary results suggest that individuals with SMD may be a further group at increased risk of COVID-19 associated death. It is important that clinicians are alerted to this new risk group. This increased mortality can be associated with a higher prevalence of somatic morbidity and life-style related factors. In regard to comorbidities, future studies should explore the potential confounding or mediation role in the relationship between SMD and COVID-19 associated deaths. Such clarification will help to enabling clinicians to provide the best physical and mental health care tailored to special requirements of this risk group.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
The studies involving human participants were reviewed and approved by Swedish Ethical Review Authority (DNR 2020-02759). Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.
MM, UW, MB, LÖ, and MW: conception and design of the work and revising and providing the final approval of the work. MM, UW, and LÖ: acquisition and analysis of data. UW, MM, and MB: drafting the work. All authors contributed to the article and approved the submitted version.
This work was supported by the County Council of Jämtland/Härjedalen, the Department of Clinical Sciences, Umeå University, and the Department of Psychiatry, Sunderby Hospital, Luleå, Region Norrbotten, Sweden.
Conflict of Interest
UW has received funding for educational activities on behalf of Norrbotten Region (Masterclass Psychiatry Programme 2014–2018 and EAPM 2016, Luleå, Sweden): Astra Zeneca, Eli Lilly, Janssen, Novartis, Otsuka/Lundbeck, Servier, Shire, and Sunovion.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
We gratefully acknowledge Olga Filson for her assistance with the data analysis. This manuscript has been released as a pre-print at medRxiv (73).
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2020.609579/full#supplementary-material
1. Crump C, Sundquist K, Winkleby MA, Sundquist J. Comorbidities and mortality in bipolar disorder: a Swedish national cohort study. JAMA Psychiatry. (2013) 70:931–9. doi: 10.1001/jamapsychiatry.2013.1394
2. Crump C, Winkleby MA, Sundquist K, Sundquist J. Comorbidities and mortality in persons with schizophrenia: a Swedish national cohort study. Am J Psychiatry. (2013) 170:324–33. doi: 10.1176/appi.ajp.2012.12050599
3. Nordentoft M, Wahlbeck K, Hallgren J, Westman J, Osby U, Alinaghizadeh H, et al. Excess mortality, causes of death and life expectancy in 270,770 patients with recent onset of mental disorders in Denmark, Finland and Sweden. PLoS ONE. (2013) 8:e55176. doi: 10.1371/journal.pone.0055176
4. Westman J, Eriksson SV, Gissler M, Hallgren J, Prieto ML, Bobo WV, et al. Increased cardiovascular mortality in people with schizophrenia: a 24-year national register study. Epidemiol Psychiatr Sci. (2018) 27:519–27. doi: 10.1017/S2045796017000166
5. Westman J, Hallgren J, Wahlbeck K, Erlinge D, Alfredsson L, Osby U. Cardiovascular mortality in bipolar disorder: a population-based cohort study in Sweden. BMJ Open. (2013) 3:e002373. doi: 10.1136/bmjopen-2012-002373
6. Simonnet A, Chetboun M, Poissy J, Raverdy V, Noulette J, Duhamel A, et al. High prevalence of obesity in severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) requiring invasive mechanical ventilation. Obesity. (2020) 28:1994. doi: 10.1002/oby.23006
7. Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in china: summary of a report of 72314 cases from the Chinese Center for Disease Control and Prevention. JAMA. (2020) 323:1239–42. doi: 10.1001/jama.2020.2648
8. Werneke U, Horn O, Maryon-Davis A, Wessely S, Donnan S, McPherson K. Uptake of screening for breast cancer in patients with mental health problems. J Epidemiol Community Health. (2006) 60:600–5. doi: 10.1136/jech.2005.039065
9. Strobe Initiative. Strobe Statement. Strengthening the Reporting of Observational Studies in Epidemology. Available online at: https://www.strobe-statement.org/index.php?id=available-checklists (accessed August 27, 2020).
10. Folkhälsomyndigheten (Swedish Public Health Agency). Bekräftat fall i Jönköping av nya Coronaviruset (2019-nCoV). (2020). Available online at: https://www.folkhalsomyndigheten.se/nyheter-och-press/nyhetsarkiv/2020/januari/bekraftat-fall-av-nytt-coronavirus-i-sverige/ (accessed August 27, 2020).
12. International Classification of Diseases: ICD-10 version. Provisional Assignment of New Diseases of Uncertain Etiology or Emergency Use (U00-U49). (2019). Available online at: https://icd.who.int/browse10/2019/en#/U00-U49 (accessed August 27, 2020).
13. World Health organization (WHO). WHO-COVID-19 Case Definition. Available online at: https://www.who.int/publications/i/item/WHO-2019-nCoV-Surveillance_Case_Definition-2020.1 (accessed August 27, 2020).
14. Swedish Board of Health and Social Welfare (Socialstyrelsen). Uppdatering av Tidigare Rapport gäLlande Identifiering av Riskgrupper som LöPer StöRst Risk att Drabbas av ett SäRskilt Allvarligt SjukdomsföRlopp vid Insjuknande i Covid-19. (2020). Available online at: https://www.socialstyrelsen.se/globalassets/sharepoint-dokument/dokument-webb/ovrigt/identifiering-av-riskgrupper-covid19.pdf (accessed November 25, 2020).
16. Greenland S, Senn SJ, Rothman KJ, Carlin JB, Poole C, Goodman SN, et al. Statistical tests, P-values, confidence intervals, and power: a guide to misinterpretations. Eur J Epidemiol. (2016) 31:337–50. doi: 10.1007/s10654-016-0149-3
17. MedCalc Software Ltd. MedCalc. Easy to Use Statistical Software. Free Statistical Calculators. Odds Ratio Calculator. (2020). Available online at: https://www.medcalc.org/calc/odds_ratio.php (accessed November 25, 2020).
18. Wang Q, Xu R, Volkow ND. Increased risk of COVID-19 infection and mortality in people with mental disorders: analysis from electronic health records in the United States. World Psychiatry. (2020) doi: 10.1002/wps.20806. [Epub ahead of print].
19. Wang QQ, Kaelber DC, Xu R, Volkow ND. COVID-19 risk and outcomes in patients with substance use disorders: analyses from electronic health records in the United States. Mol Psychiatry. 14:1–10. (2020) doi: 10.1038/s41380-020-00880-7
20. Atkins JL, Masoli JAH, Delgado J, Pilling LC, Kuo CL, Kuchel GA, et al. Preexisting comorbidities predicting COVID-19 and mortality in the UK biobank community cohort. J Gerontol A Biol Sci Med Sci. (2020) 75:2224–30. doi: 10.1093/gerona/glaa183
21. Olfson M, Gerhard T, Huang C, Crystal S, Stroup TS. Premature mortality among adults with schizophrenia in the United States. JAMA Psychiatry. (2015) 72:1172–81. doi: 10.1001/jamapsychiatry.2015.1737
22. Ribe AR, Vestergaard M, Katon W, Charles M, Benros ME, Vanderlip E, et al. Thirty-day mortality after infection among persons with severe mental illness: a population-based cohort study in Denmark. Am J Psychiatry. (2015) 172:776–83. doi: 10.1176/appi.ajp.2015.14091100
23. Centers for Disease Control and Prevention (CDC). Evidence Used to Update the List of Underlying Medical Conditions That Increase a Person's Risk of Severe Illness from COVID-19. Available online at: https://www.cdc.gov/coronavirus/2019-ncov/need-extra-precautions/evidence-table.html (accessed October 28, 2020).
24. Centers for Disease Control Prevention (CDC). Weekly Updates by Select Demographic Geographic Characteristics. Provisional Death Counts for Coronavirus Disease 2019 (COVID-19). Available online at: https://www.cdc.gov/nchs/nvss/vsrr/covid_weekly/index.htm?fbclid=IwAR3-wrg3tTKK5-9tOHPGAHWFVO3DfslkJ0KsDEPQpWmPbKtp6EsoVV2Qs1Q (accessed September 6, 2020).
25. Pramsten S. Covid-19 Oftast inte Ensam Dödsorsak Bland Äldre- Läkartidningen. (2020). Available online at: https://lakartidningen.se/aktuellt/nyheter/2020/08/covid-19-oftast-inte-ensam-orsak-vid-dodsfall-bland-aldre/#:~:text=D%C3%B6dsorsaken%20i%20d%C3%B6dsorsaksintyget%20har%20varit,samsjuklighet%20och%2011%20m%C3%A5ttlig%20samsjukligh (accessed September 6, 2020).
26. Carney CP, Jones L, Woolson RF. Medical comorbidity in women and men with schizophrenia: a population-based controlled study. J Gen Intern Med. (2006) 21:1133–7. doi: 10.1111/j.1525-1497.2006.00563.x
28. Shen HN, Lu CL, Yang HH. Increased risks of acute organ dysfunction and mortality in intensive care unit patients with schizophrenia: a nationwide population-based study. Psychosom Med. (2011) 73:620–6. doi: 10.1097/PSY.0b013e3182280016
29. Fleischhacker WW, Cetkovich-Bakmas M, De Hert M, Hennekens CH, Lambert M, Leucht S, et al. Comorbid somatic illnesses in patients with severe mental disorders: clinical, policy, and research challenges. J Clin Psychiatry. (2008) 69:514–9. doi: 10.4088/JCP.v69n0401
30. Briskman I, Bar G, Boaz M, Shargorodsky M. Impact of co-morbid mental illness on the diagnosis and management of patients hospitalized for medical conditions in a general hospital. Int J Psychiatry Med. (2012) 43:339–48. doi: 10.2190/PM.43.4.d
31. Dickerson F, Stallings CR, Origoni AE, Vaughan C, Khushalani S, Schroeder J, et al. Cigarette smoking among persons with schizophrenia or bipolar disorder in routine clinical settings, 1999–2011. Psychiatr Serv. (2013) 64:44–50. doi: 10.1176/appi.ps.201200143
32. Gardner-Sood P, Lally J, Smith S, Atakan Z, Ismail K, Greenwood KE, et al. Cardiovascular risk factors and metabolic syndrome in people with established psychotic illnesses: baseline data from the IMPaCT RCT study–corrigendum. Psychol Med. (2015) 45:2631. doi: 10.1017/S0033291715001154
33. Toftdahl NG, Nordentoft M, Hjorthoj C. Prevalence of substance use disorders in psychiatric patients: a nationwide Danish population-based study. Soc Psychiatry Psychiatr Epidemiol. (2016) 51:129–40. doi: 10.1007/s00127-015-1104-4
34. van Haaster I, Lesage AD, Cyr M, Toupin J. Problems and needs for care of patients suffering from severe mental illness. Soc Psychiatry Psychiatr Epidemiol. (1994) 29:141–8. doi: 10.1007/BF00796495
36. Boivin Z, Perez MF, Atuegwu NC, Metersky M, Alvarez CA, Anzueto A, et al. Association of atypical antipsychotics and mortality for patients hospitalised with pneumonia. ERJ Open Res. (2019) 5:00223-2018. doi: 10.1183/23120541.00223-2018
37. Landen M, Lichtenstein P, Larsson H, Song J. Respiratory infection during lithium and valproate medication: a within-individual prospective study of 50,000 patients with bipolar disorder. medRxiv. (2020). doi: 10.1101/2020.05.04.20090084
38. Yang SY, Liao YT, Liu HC, Chen WJ, Chen CC, Kuo CJ. Antipsychotic drugs, mood stabilizers, and risk of pneumonia in bipolar disorder: a nationwide case-control study. J Clin Psychiatry. (2013) 74:e79–86. doi: 10.4088/JCP.12m07938
39. Dong M, Zeng LN, Zhang Q, Yang SY, Chen LY, Najoan E, et al. Prescription of antipsychotic and concomitant medications for adult Asian schizophrenia patients: findings of the 2016. Research on Asian Psychotropic Prescription Patterns (REAP) survey. Asian J Psychiatr. (2019) 45:74–80. doi: 10.1016/j.ajp.2019.08.010
40. Sun GQ, Zhang L, Zhang LN, Wu Z, Hu DF. Benzodiazepines or related drugs and risk of pneumonia: a systematic review and meta-analysis. Int J Geriatr Psychiatry. (2019) 34:513–21. doi: 10.1002/gps.5048
41. Tiihonen J, Mittendorfer-Rutz E, Torniainen M, Alexanderson K, Tanskanen A. Mortality and cumulative exposure to antipsychotics, antidepressants, and benzodiazepines in patients with schizophrenia: an observational follow-up study. Am J Psychiatry. (2016) 173:600–6. doi: 10.1176/appi.ajp.2015.15050618
42. Wingard L, Taipale H, Reutfors J, Westerlund A, Boden R, Tiihonen J, et al. Initiation and long-term use of benzodiazepines and Z-drugs in bipolar disorder. Bipolar Disord. (2018) 20:634–46. doi: 10.1111/bdi.12626
44. Bishara D, Kalafatis C, Taylor D. Emerging and experimental treatments for COVID-19 and drug interactions with psychotropic agents. Ther Adv Psychopharmacol. (2020) 10:2045125320935306. doi: 10.1177/2045125320935306
45. Siskind D, Honer WG, Clark S, Correll CU, Hasan A, Howes O, et al. Consensus statement on the use of clozapine during the COVID-19 pandemic. J Psychiatry Neurosci. (2020) 45:200061. doi: 10.1503/jpn.200061
46. Correll CU, Detraux J, De Lepeleire J, De Hert M. Effects of antipsychotics, antidepressants and mood stabilizers on risk for physical diseases in people with schizophrenia, depression and bipolar disorder. World Psychiatry. (2015) 14:119–36. doi: 10.1002/wps.20204
47. Hsu WY, Lane HY, Lin CL, Kao CH. A population-based cohort study on deep vein thrombosis and pulmonary embolism among schizophrenia patients. Schizophr Res. (2015) 162:248–52. doi: 10.1016/j.schres.2015.01.012
48. Lin CE, Chung CH, Chen LF, Chien WC. Increased risk for venous thromboembolism among patients with concurrent depressive, bipolar, and schizophrenic disorders. Gen Hosp Psychiatry. (2019) 61:34–40. doi: 10.1016/j.genhosppsych.2019.10.003
49. Barbui C, Conti V, Cipriani A. Antipsychotic drug exposure and risk of venous thromboembolism: a systematic review and meta-analysis of observational studies. Drug Saf. (2014) 37:79–90. doi: 10.1007/s40264-013-0127-6
52. Rossi R, Socci V, Talevi D, Mensi S, Niolu C, Pacitti F, et al. Pandemic and lockdown measures impact on mental health among the general population in Italy. Front Psychiatry. (2020) 11:790. doi: 10.3389/fpsyt.2020.00790
53. Yang L, Rui CC, Zhonghui X, Roger HC, Ho CSH. A systematic review of the impact of viral respiratory epidemics on mental health: an implication on the coronavirus disease 2019 pandemic. Front Psychiatry. (2020) 11:1247. doi: 10.3389/fpsyt.2020.565098
54. Hayes L, Hawthorne G, Farhall J, O'Hanlon B, Harvey C. Quality of life and social isolation among caregivers of adults with schizophrenia: policy and outcomes. Commun Ment Health J. (2015) 51:591–7. doi: 10.1007/s10597-015-9848-6
55. Tremeau F, Antonius D, Malaspina D, Goff DC, Javitt DC. Loneliness in schizophrenia and its possible correlates. An exploratory study. Psychiatry Res. (2016) 246:211–7. doi: 10.1016/j.psychres.2016.09.043
56. Torales J, Ríos-González C, Barrios I, O'Higgins M, González I, García O, et al. Self-perceived stress during the quarantine of COVID-19 pandemic in Paraguay: an exploratory survey. Front Psychiatry. (2020) 11:1155. doi: 10.3389/fpsyt.2020.558691
57. Brenner MH. Social class and mental health: the impact of international recessio and austerity. In: Bhugra D, Bhui K, Wong SYS, Gilman SE, editors. Oxford Textbook of Public Mental Health. Oxford: Oxford University Press (2018). p. 159–72.
59. Bastiampillai T, Allison S, Looi JC, Licinio J, Wong ML, Perry SW. The COVID-19 pandemic and epidemiologic insights from recession-related suicide mortality. Mol Psychiatry. (2020) 25:3445–7. doi: 10.1038/s41380-020-00875-4
60. Mahajan UV, Larkins-Pettigrew M. Racial demographics and COVID-19 confirmed cases and deaths: a correlational analysis of 2886 US counties. J Public Health. (2020) 42:445–7. doi: 10.1093/pubmed/fdaa070
63. Pedersen A, Zachariae R, Bovbjerg DH. Influence of psychological stress on upper respiratory infection–a meta-analysis of prospective studies. Psychosom Med. (2010) 72:823–32. doi: 10.1097/PSY.0b013e3181f1d003
64. Cohen S, Janicki-Deverts D, Doyle WJ, Miller GE, Frank E, Rabin BS, et al. Chronic stress, glucocorticoid receptor resistance, inflammation, and disease risk. Proc Natl Acad Sci USA. (2012) 109:5995–9. doi: 10.1073/pnas.1118355109
65. Worldometer. Sweden Coronavirus. Available online at: https://www.worldometers.info/coronavirus/country/sweden/ (accessed November 27, 2020).
67. Judd LL, Schettler PJ, Akiskal HS, Coryell W, Leon AC, Maser JD, et al. Residual symptom recovery from major affective episodes in bipolar disorders and rapid episode relapse/recurrence. Arch Gen Psychiatry. (2008) 65:386–94. doi: 10.1001/archpsyc.65.4.386
68. Barber S, Thornicroft G. Reducing the mortality gap in people with severe mental disorders: the role of lifestyle psychosocial interventions. Front Psychiatry. (2018) 9:463. doi: 10.3389/fpsyt.2018.00463
71. Folkhälsomyndigheten (The Public Health Agency of Sweden). COVID-19: FAQ/ Vaccination. (2020). Available online at: https://www.folkhalsomyndigheten.se/the-public-health-agency-of-sweden/communicable-disease-control/covid-19/vaccination/?exp=81455#_81455 (accessed October 26, 2020).
73. Maripuu M, Bendix M, Öhlund L, Widerström M, Werneke U. Death associated with coronavirus (COVID-19) infection in individuals with severe mental disorders in Sweden during the early months of the outbreak - a exploratory cross-sectional analysis of a population-based register study. mdedRxiv. (2020). doi: 10.1101/2020.09.14.20193987
Keywords: coronavirus, COVID-19, severe mental disorder, death, risk factors, mortality, psychotic disorder, bipolar disorder
Citation: Maripuu M, Bendix M, Öhlund L, Widerström M and Werneke U (2021) Death Associated With Coronavirus (COVID-19) Infection in Individuals With Severe Mental Disorders in Sweden During the Early Months of the Outbreak—An Exploratory Cross-Sectional Analysis of a Population-Based Register Study. Front. Psychiatry 11:609579. doi: 10.3389/fpsyt.2020.609579
Received: 23 September 2020; Accepted: 07 December 2020;
Published: 08 January 2021.
Edited by:Wulf Rössler, Charité – Universitätsmedizin Berlin, Germany
Reviewed by:Julio Torales, National University of Asunción, Paraguay
João Mauricio Castaldelli-Maia, Faculdade de Medicina Do ABC, Brazil
M. Harvey Brenner, Johns Hopkins University, United States
Copyright © 2021 Maripuu, Bendix, Öhlund, Widerström and Werneke. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Ursula Werneke, email@example.com