Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 03 January 2022
Sec. Forensic Psychiatry
https://doi.org/10.3389/fpsyt.2021.777388

Aggression Amongst Outpatients With Schizophrenia and Related Psychoses in a Tertiary Mental Health Institution

  • 1Research Division, Institute of Mental Health, Singapore, Singapore
  • 2Department of Developmental Psychiatry, Institute of Mental Health, Singapore, Singapore
  • 3Department of Mood and Anxiety, Institute of Mental Health, Singapore, Singapore
  • 4Department of Psychosis, Institute of Mental Health, Singapore, Singapore

Aims: Aggression is defined as “any behavior intended to cause physical, emotional, or psychological harm to another.” The aims of the current study were to (i) examine underlying factor structure of the Buss-Perry Aggression Questionnaire (BPAQ) and (ii) explore socio-demographic and clinical correlates (symptom severity, substance use and alcohol use) among patients with schizophrenia and related psychoses in a multi-ethnic Asian population.

Methods: Data collected from 397 participants who were seeking outpatient treatment for schizophrenia and related psychoses at a tertiary psychiatric hospital were included in the analyses. BPAQ, a 29-item, four-factor instrument that measures physical aggression, verbal aggression, anger and hostility was used to assess aggression. Data on socio-demographic variables, age of onset of illness, drug use, alcohol use and symptom severity were also collected. Confirmatory factor analysis (CFA) was performed to establish the underlying factor structure of the BPAQ. Multiple regression analyses were utilized to examine socio-demographic and clinical correlates of the BPAQ factors.

Results: The mean age of the participants was 36.2 years (SD = 10.9, range: 21–65). Factor structure obtained from the CFA indicated that a higher order four-factor solution had an acceptable fit to the observed data (WLSMV χ2 = 1,025.35, df = 320, RMSEA = 0.07, CFI = 0.94, TLI = 0.93, SRMR = 0.05). Females had lower physical aggression and hostility scores as compared to males. Those with lower education had higher physical aggression scores as compared to those with higher education. Participants who received a diagnosis after the age of 30 years had higher physical aggression and anger scores as compared to those who received a diagnosis at or before 20 years of age. Symptom severity was positively associated with higher BPAQ scores.

Conclusion: The study findings demonstrated high internal consistency and applicable measurement factor structure of BPAQ in this study sample, making it an appropriate questionnaire for assessing aggressive behavior in this population. We also identified socio-demographic and clinical factors that were associated with aggression in patients with schizophrenia and related psychoses.

Introduction

Mental illnesses are a leading cause of disability worldwide and about 25% of the world's population develop mental illness at some stage of their life (1). Various studies have shown an increased prevalence of aggressive behavior among persons with serious mental illness as compared to persons without such illness (24).

Schizophrenia is a chronic and severe mental illness affecting 20 million people worldwide (5). A recent study conducted in Singapore reported that ~2.3% of Singapore's general adult population are affected by schizophrenia and related psychoses in their lifetime (6). People with schizophrenia are commonly perceived as unpredictable and dangerous (7), with fears of being injured by an individual with severe mental illness being fairly common in the general public (8). However, such negative attitudes increase self-stigma among people with severe mental disorders leading to poor treatment outcomes (9, 10) perpetuating a cycle of stigma.

Individuals with schizophrenia have a higher rate of aggressive behavior (4 – 6 times higher) than the general population (11, 12). The association between aggressive behavior and mental illness is highly complex, more so when a patient with psychoses' inner world is imprecise and his or her belief or reality is affected (13). Prior studies have found that aggressive behavior is associated with clinical factors such as positive symptoms (14), failure to treat patients with schizophrenia (15), incomplete adherence to medication (16), as well as social factors such as lack of empathy and emotional detachment (17). Studies have also shown that substance-related disorders are significantly associated with aggressive behavior during a psychotic episode (18, 19). Nationwide psychosis studies from the United Kingdom and the Netherlands have reported that substance use disorders were closely related to increased rates of aggressive behavior (20). Research over the last few years has also reported high rates of victimization in people with severe mental health problems. People with mental disorders are more frequently victims of violence, rather than perpetrators of violence (21, 22). Victimized individuals are more likely to have worsening of symptoms, engage in alcohol or substance use to cope with the trauma, all of which may lead to violent behavior (21, 23).

Socio-demographic factors have been examined in relation to aggressive behavior among patients with schizophrenia. Some studies have reported that males scored significantly higher on the physical aggression, verbal aggression and hostility subscales (24, 25). A study conducted by Sher et al. (26) reported that participants with lower education showed more aggressive behavior (26). Similarly, others have concluded that younger age groups (27), widowed status and lower socioeconomic status (28) are associated with higher aggressive behavior among patients with schizophrenia.

While many researchers in Western countries have studied aggression in patients with schizophrenia and related psychoses, few have examined aggression among this group in Singapore. Singapore is a multi-ethnic, city-state located in Southeast Asia with a population of 4.04 million in 2020 (29). A 2005 study done in Singapore established that 37.0% of patients with first episode psychosis had aggression (13.7% had severe aggression and 23.3% had lesser aggression) (13). The authors found a significant association between aggression and duration of untreated illness. The multi-ethnic population, low prevalence of alcohol and other substance use disorders (30, 31), relatively low treatment gap (32) and high medication compliance (33), emphasize the need for local data in Singapore. Thus, the current study aims to (i) examine underlying factor structure of the Buss-Perry Aggression Questionnaire (BPAQ) and (ii) explore the socio-demographic and clinical associations (symptom severity, drug and alcohol use) of aggression as assessed by BPAQ among patients with schizophrenia and related psychoses in a multi-ethnic Asian population.

Method

The present study used data from a cross-sectional survey that was conducted at the Institute of Mental Health (IMH) between October 2019 and March 2021. IMH is the sole tertiary care psychiatric hospital in Singapore that serves a patient population with a wide range of mental illnesses. The study commenced in October 2019 but was suspended during the lockdown period (April 2020–June 2020) in Singapore due to the Coronavirus pandemic. It was resumed in June 2020 while adhering to safe distancing and masking policies, while also providing participants with the option to participate via an online platform. The informed consent form and questionnaire were administered via the ZOOM platform if the online mode was preferred.

A total of 400 participants were recruited through convenience sampling. However, three cases were excluded due to: (i) recruiting the same person twice, (ii) one participant requested to withdraw from the study, and (iii) one participant was above the age limit of 65 years. Hence, a final sample size of 397 was utilized. Patients seeking treatment at IMH outpatient clinics and affiliated satellite clinics were enrolled in the study. The study included patients who were Singapore residents (including Singapore Citizens and Permanent Residents); aged 21–65 years; belonging to Chinese, Malay, Indian or Other ethnic groups; capable of providing consent; able to understand and read English; and having a clinical diagnosis of schizophrenia and related psychoses, as determined by a psychiatrist using Diagnostic and Statistical Manual of Mental Disorders, fourth edition (DSM-IV) criteria (34). Patients who had intellectual disabilities or cognitive impairment, or were not literate in English were excluded from the study. Study brochures informing attending patients of the ongoing study and the eligibility criteria were placed in the Clinician's rooms along with the phone numbers and email addresses of the study team members. Emails were sent to all treating clinicians and other health care professionals who were requested to refer eligible patients to participate in the study. All participants provided written informed consent prior to their participation. Data were collected through self-administered questionnaires which participants completed either on physical copies or online via a QuestionPro link (an option provided since June 2020 due to Coronavirus pandemic). Each participant took ~45–60 mins to complete the survey.

The study was initiated after receiving ethics approval from the relevant institutional ethics review board [National Healthcare Group Domain Specific Review Board (NHG DSRB Ref: 2019/00918)]. The research was carried out in accordance with the Declaration of Helsinki and the ethical principles of the Belmont Report.

Measures

All participants completed a study questionnaire which included the following instruments:

1. Socio-demographic questionnaire: This included data on age, gender, ethnicity, marital status, education and monthly personal income. Clinical history was collected through a medical records review, which included information on age of onset of illness and clinical diagnosis of participants.

2. Buss-Perry Aggression Questionnaire (BPAQ) (25) is a 29-item, four-factor instrument that measures physical aggression, verbal aggression, anger, and hostility. Aggression was measured by the total score of the BPAQ and scores of the subscales including physical aggression (items 1–9), verbal aggression (items 10–14), anger (items 15–21) and hostility (items 22–29). The total BPAQ score could range from 29 to 145 with higher levels of aggression indicated by higher scores. Each question on the BPAQ employs a five-point Likert rating scale, where 1 = extremely uncharacteristic of me, 2 = somewhat uncharacteristic of me, 3 = neither uncharacteristic nor characteristic of me, 4 = somewhat characteristic of me, and 5 = extremely uncharacteristic of me. Subscale scores were derived by summing the ratings for the questions that define each of the subscales. The four-factor conceptualization of aggression is considered a gold standard for the measurement of aggression (35). The first two factors i.e., physical and verbal aggression represents the instrumental components. The third factor of anger implies physiological activation and represents the emotional component, the fourth factor of hostility involves feelings of opposition and injustice thus representing the cognitive component. The researchers suggest that anger acts as psychological bridge connecting instrumental and cognitive components (25).

3. Symptoms Checklist- 90 Revised (SCL-90-R) is a widely used 90-item psychiatric symptoms checklist that assesses psychiatric symptomatology measure of general psychiatric distress. It is a self-report instrument consisting of a series of 90 descriptions of symptoms that participants rate in terms of their severity (ranging from 0 = Not at all, to 4 = Extremely). The SCL-90-R is scored and interpreted in terms of nine primary symptom dimensions and three global indices of distress. A global severity index (GSI) can be obtained by taking the average of all 90-items, with higher scores reflecting higher distress and severity of symptoms. The primary symptom dimensions and global indices are labeled as follows: Somatization (SOM); Obsessive-Compulsive (OC); Interpersonal Sensitivity (IS); Depression (DEP); Anxiety (ANX); Hostility (HOS); Phobic Anxiety (PHOANX); Paranoid Ideation (PI); and Psychoticism (PSY). A large number of studies have been conducted demonstrating the reliability, validity and utility of the instrument (36). Psychometric evaluations have reported good internal consistency (alpha coefficients 0.77–0.90), test-retest reliability, and concurrent, construct, and discriminant validity (37). It is one of the most widely used measures of psychological distress in clinical practice and research. The internal consistency reliability for SCL-90-R (Cronbach's alpha = 0.99) was high in the current study.

4. Cut-annoyed-guilty-eye (CAGE) questionnaire (38): The CAGE questionnaire uses four items to assess self-reported problems related to alcohol use in the present sample. The 4 items were prefaced by a screening question, “Was there ever a period in your life when you drank at least 12 drinks in a year?” (a drink was defined as “a glass of wine, a can/bottle of beer, or a shot/jigger of liquor either alone or in a mixed drink”). Participant who indicated they had never had an alcoholic drink or drank less than 12 drinks per year were directed to skip the CAGE items. Those who answered “yes” to the screening question were asked about 4 aspects of their drinking habits: (1) Feeling that they should cut down on their drinking; (2) Being annoyed about criticism of their drinking; (3) Feeling bad or guilty about their drinking; and (4) Having a drink first thing in the morning to steady their nerves or to get rid of a hangover (eye opener). Endorsing two or more items in the CAGE tool was indicative of problematic alcohol use in this study. The questionnaire has demonstrated high test-retest reliability and adequate convergent validity (39) and has been validated in Singapore among older adults (40). A moderate internal consistency of this scale was obtained for this sample (Cronbach's alpha = 0.69).

5. Drug Abuse Screen Test (DAST-10) (41) is a brief screening instrument that can be used in clinical and non-clinical populations to detect potential drug abuse, which excludes alcohol or tobacco use, during the past 12-months. This 10-item tool may be self-administered or interviewer-administered. 1 point is scored for each “yes” response, except for question 3 to which a “no” response receives 1 point. Scores of 0–2 indicate low-level or no drug use problems; 3–5 indicates moderate problems; 6–8 indicates substantial problems and 9–10 severe problems. In the current study, a cut-off of ≥3 was applied to indicate problematic drug use (42). Internal consistency reliability of DAST-10 (Cronbach's alpha = 0.73) was high in the current study.

Statistical Analysis

Analyses in the present study were conducted with MPlus version 8.2 and Stata version 15. Mean and standard deviation are presented for continuous variables while frequencies and percentages are displayed for categorical variables. Confirmatory factor analysis (CFA) and unidimensional exploratory factor analysis (EFA) were estimated and tested using MPlus to evaluate the factor structure of the BPAQ. As the items of the BPAQ were measured on an ordinal scale, a weighted-least-square with mean- and variance-adjusted (WLSMV option) estimation was used to model the polychoric correlation matrix (CATEGORICAL option). The following fit indices were utilized to compare the overall fit of the CFA models and their complexities: (i) root mean square error of approximation (RMSEA), (ii) comparative fit index (CFI), (iii) Tucker-Lewis index (TLI), (iv) Standardized Root Mean Square Residual (SRMR). Both CFI and TLI values range from 0 to 1, with higher values representing better fit. CFI values above 0.95 and TLI values above 0.90 are considered to be of excellent fit (43). With regard to RMSEA, values below 0.08 indicate moderate fit, while values of 0.05 or less indicate close fit to the observed data (44). Standardized root mean squared residual (SRMR) values were also evaluated, which indicates acceptable fit when values are smaller than 0.08 (43, 44). The unidimensional EFA employed a WLSMV estimator and an oblique (GEOMIN) rotation. Internal consistency of measures was assessed via Cronbach's alpha values. First order and second order CFA models were tested. Items of the BPAQ were summed to form a total score and their four respective factor scores based upon results of the final CFA model. Five multiple regression analyses were conducted using the “enter” method to examine correlates of the BPAQ total score and its individual factors. Correlates entered into these regression models include socio-demographic variables (i.e., age, gender, ethnicity, education, marital status, and age of onset) and clinical variables (i.e., problematic drug use, alcohol use, and SCL-90-R global severity index). Following this, five multiple regression analyses were run in which the nine subscales of the SCL-90-R (i.e., somatization, obsessive-compulsive, interpersonal sensitivity, depression, anxiety, hostility, phobic-anxiety, paranoid ideation, and psychoticism) were entered into each model while adjusting for the effects of socio-demographic and clinical variables to further examine the association between symptom severity and aggression factors.

Results

Socio-Demographic and Clinical Characteristics of the Sample

Socio-demographic and clinical characteristics of the sample are presented in Table 1. The mean age of participants (n = 397) was 36.2 ± 10.9 years, (range: 21–65), with the majority being Chinese (n = 297, 74.8%), single (n = 320, 80.6%), with highest education level of A-level/Polytechnic/Vocational School/Institute of Technical Education (ITE) (n = 182, 45.8%), and with monthly personal income of below 2,000 (in Singapore dollars) (n = 202, 50.9%). Approximately half of the sample were males (n = 201, 50.6%).

TABLE 1
www.frontiersin.org

Table 1. Socio-demographic and clinical characteristics of sample (n = 397).

The mean age of onset of diagnosis of illness was 26.1 years (SD = 8.1), 5.8% had problematic drug use (n = 23), and 5.3% had problematic lifetime drinking (n = 21). Mean BPAQ total score was 65.45, (SD = 21.6). Mean SCL-90-R Global severity index score was 0.94 (SD = 0.9).

Confirmatory Factor Analysis in the Overall Sample

Descriptive information regarding the 29 items of the BPAQ can be found in Supplementary Table 1. A CFA was first conducted utilizing the model suggested by its developers (25), in which a four-factor model with 29 items was tested. However, upon examination of the CFA model, and a unidimensional EFA model, two items were removed. Firstly, item 9 “I am an even-tempered person” was removed from subsequent iterations for the following reasons: (i) it demonstrated a poor standardized factor loading (0.053) with its respective factor within the initial first order CFA model, (ii) examination of the underlying polychoric correlation matrix revealed that this item had poor correlations (ranging from −0.121 to 0.290) with all other items, and (iii) the unidimensional EFA with all 29 items indicated that item 9 had a factor loading of 0.06, below a recommended cut-off of 0.4 (45), indicating that the item performs poorly in the unidimensional assessment of aggression. Secondly, item 4 “I tell my friends openly when I disagree with them” was also removed as it had a factor loading of 0.36 within the unidimensional EFA. Estimates of the 29-item unidimensional EFA can be found in Supplementary Table 2. A CFA of a first-order four-factor model using the remaining 27-items indicated a solution with acceptable fit (WLSMV χ2 = 1027.41, df = 318, RMSEA = 0.075, CFI = 0.94, TLI = 0.93, SRMR = 0.05). In order to support the generation of a total score, a single higher order four-factor model was also tested. Standardized factor loadings of the single higher order four factor solution and model's corresponding fit statistics can be found in Table 2. Results indicate that the higher order four-factor solution had acceptable fit to the observed data (WLSMV χ2 = 1,025.35, df = 320, RMSEA = 0.07, CFI = 0.94, TLI = 0.93, SRMR = 0.05) and was thus chosen as the final solution. No modification indices were specified. Standardized factor loadings of the items to their respective factors were moderate to high, ranging from 0.47 to 0.84. All four factors loaded strongly with the higher order factor, with values ranging from 0.89 to 0.97. In the calculation of the factor scores, the present study opted to sum without any reverse scoring. Internal consistency assessed by Cronbach alpha values was high: Total score (27-items; α = 0.94), Anger (6 items; α = 0.84), Physical Aggression (9 items; α = 0.85), Verbal Aggression (4-items; α = 0.76), Hostility (8 items; α = 0.86). It is to note that although item 16 “I can think of no good reason for ever hitting a person” was negatively worded, it demonstrated a positive and acceptable standardized factor loading (0.47) with its respective factor of Physical Aggression”, and was thus summed in the calculation of that factor.

TABLE 2
www.frontiersin.org

Table 2. Standardized factor loadings and fit indices of the higher order four factor model.

Socio-Demographic and Clinical Correlates of Aggression

Results of the multiple regression analyses can be found in Table 3. Females had lower scores of physical aggression (β = −1.6; p = 0.04) and hostility (β = −1.6; p = 0.03) compared to male participants with schizophrenia. In terms of education, those who had lower education levels (i.e., primary and below, secondary, A-level/polytechnic/vocational school/ITE) had higher scores in physical aggression (β = 4.6; p = 0.03, β = 2.4; p = 0.04, β = 2.1; p = 0.05 respectively) when compared to those with a qualification of an undergraduate degree and above. Participants who had an age of onset of diagnosis after the age of 30 years (31 years or older) had higher total BPAQ (β = 7.4; p = 0.03) and physical aggression scores (β = 2.7; p = 0.03) when compared to those whose age of onset was 20 years and below. Additionally, those whose age of onset was 21–25 years (β = 1.8; p = 0.02) and 31 years and older (β = 2.6; p = 0.003), had higher anger scores. Higher scores on the SCL-90-R Global Symptoms Index were positively associated with higher sub domain scores and total score of BPAQ (p < 0.001).

TABLE 3
www.frontiersin.org

Table 3. Socio-demographic and clinical correlates of Buss-Perry Aggression Questionnaire (BPAQ).

Symptom Severity (SCL-90-R) and Aggression (BPAQ)

Results of the multiple regression analyses examining the nine subscales of symptoms severity (i.e., SCL-90-R) and their association with aggression, after adjusting for other socio-demographic and clinical correlates are presented in Table 4. OC subscale of SCL-90-R was positively associated with the anger domain (β = 1.8; p = 0.003). Higher IS scores were associated with higher scores in the BPAQ domains of verbal aggression (β = 1.3; p = 0.01) and hostility (β = 2.7; p = 0.003). The HOS subscale was positively associated with the total (β = 10.7; p < 0.001), physical aggression (β = 4.8; p < 0.001), verbal aggression (β = 1.3; p = 0.002) and anger domains (β = 3.6; p < 0.0001) of the BPAQ. Higher PI subscale scores were associated with higher scores in the hostility (β = 0.5; p < 0.0001) domain and BPAQ total (β = 0.7; p = 0.049). In contrast, PHOANX was negatively associated with BPAQ total (β = −4.6; p = 0.03), anger (β = −1.2; p = 0.03) and hostility (β = −1.7; p < 0.02) domains.

TABLE 4
www.frontiersin.org

Table 4. Symptoms severity (SCL-90-R) and Buss-Perry Aggression Questionnaire (BPAQ).

Discussion

To our knowledge the current study is the first that has established the factor structure and correlates of BPAQ in a multi-ethnic Asian sample of patients with schizophrenia and related psychoses. Our findings indicate that the factor structure of the BPAQ scale in the overall sample was somewhat similar to that proposed by the developers (25), with some differences in the verbal aggression and anger subscales. This study also identified important socio-demographic and clinical correlates of the BPAQ scale among those with schizophrenia. These findings are discussed in further detail in the subsequent sections.

Factor Structure and Internal Consistency of the BPAQ

The results suggest that the total and subscale scores of BPAQ had an adequate reliability in terms of internal consistency, and provide a valid measurement of physical aggression, verbal aggression, anger and hostility in the sample. A number of researchers have investigated the reliability and validity of this instrument, and the findings generally point in the direction of good psychometric properties with the qualification that the elimination of a few items improves the instrument; Harris et al. (46) removed two items from the hostility subscale, Gerevich et al. (35) removed two reversed scored items, Zimonyi et al. (47) removed item 21 and item 27, while Nakano (48) removed three items. To develop a more appropriate measurement model, the present study identified a 27-item, four-factor measurement model with acceptable goodness-of-fit and high internal consistency, despite the removal of two items (item 9 from anger subscale and item 4 from the verbal aggression subscale). The current study findings further suggest the removal of these items for cross-cultural use, as the aforementioned studies have also suggested excluding items from the BPAQ.

Correlates of BPAQ Among Patients With Schizophrenia and Related Psychoses

Females were significantly associated with lower aggressive scores in physical and hostility subscales of BPAQ compared to male patients with schizophrenia and related psychoses. The findings were similar to various other research studies (25, 4951). A possible explanation could be the strong relation of testosterone with aggression (49). The literature reports more physical aggression in men than women in the general population (52, 53), as well as among patients with mental disorders (25, 54).

Research studies have shown that individuals with lower education show greater aggressive behavior among patients with severe mental disorders (26, 28, 55). Our findings were similar to other studies where those with primary education displayed more physical aggression (28, 55, 56). A possible explanation provided by Harris and Kelly (56) was that higher education might serve to reduce aggression, as it teaches individuals to consider alternative points of view, to inhibit immediate emotional responses in favor of thoughtful ones, and to plan for long-term goals. In addition, individuals who have lower aggression and are more willing to accept gratification may be more likely to seek higher education (56). It is also possible that lower education might represent an indirect proxy of worse cognitive functioning; cognitive impairment in turn has been reported to be associated with aggressive and violent behavior among patients with schizophrenia (57, 58). This raises an interesting possibility as cognitive impairment could benefit from cognitive remediation therapy (59). Cognitive training and social cognitive training have been shown to be effective in reducing violence in patients with schizophrenia, which is encouraging (60) although further research is needed.

The current study found that a later onset of illness (31 years and above) was significantly associated with higher BPAQ total scores, physical aggression and anger scores among patients with schizophrenia and related psychoses. To our knowledge, this study is among the first to report a positive association between the aggression scores and older age of onset of schizophrenia. A possible explanation could be the association of aggression with a variety of negative outcomes in older adults, including social isolation, unemployment, and low socioeconomic status (61, 62). Our current study collected data on age of onset based on the date of diagnosis of patients, however some patients may experience symptoms much before receiving the actual diagnosis and this may contribute to a longer duration of untreated illness. Hodgins et al. (63) suggested that substance misuse, increase in dopamine production that leads to stress dysregulation, and changes in brain structure as a result of the prolonged illness may increase the risk of physical aggression towards others during the course of illness. It is plausible that older patients in our study may have had a later onset of illness and the illness was associated with adverse outcomes that increased the risk of aggression in these patients. Future studies should include information on social support and functional outcomes to better understand the relationship between age of onset and aggressive behavior.

Various studies have suggested an association between alcohol, drug use and aggressive behavior among psychiatric and general population (64, 65). In contrast, substance use was not significantly associated with aggression in the current study. A possible explanation could be that the strict measures toward misuse of drugs in Singapore, with tough penalties and capital punishment associated with it, resulted in low substance use or under-reporting of substance use in the present study due to fear or social desirability bias; thus, resulting in a lack of significant association with aggression. A similar finding of low prevalence of substance use was also seen in prior studies conducted among clinical population (30, 31).

SCL-90-R Global Severity Index score was positively correlated with the total and all four subscales scores of BPAQ. Our results found self-reported symptoms severity, more specially, obsessive compulsive, hostility, and paranoid ideation symptom dimensions were significantly associated with higher aggression scores. This finding is consistent with many studies suggesting that positive symptoms of schizophrenia, more specifically paranoid ideations, and hostility are commonly the link between schizophrenia and aggressive acts (6669). The potential explanations for the association between paranoid ideation and aggression are well established whereby individuals with paranoid symptoms have an attentional bias for threat cues (70), a tendency to jump to conclusions (68) and attribute hostile intent to others' actions. Individual with paranoid symptoms may utilize aggression as a safety behavior in an effort to maintain their “safety” or prevent threats (67).

Limitations

Limitations of the current study include the recruitment of all patients from a single tertiary psychiatric hospital who may not be representative of patients with schizophrenia in general. Secondly, the participants in this study were recruited using a convenience sampling method and were restricted to only those who were self-referred or referred by treating clinicians or other health care professionals; hence, they might not be representative of all outpatients in the institution and that could impose a sampling bias. Thirdly, the cross-sectional design cannot demonstrate causal relations between variables. Fourth, the data about actual aggressive behaviors were not captured at all; future studies might want to look at hospital reports of actual violence. Lastly, as noted earlier, although item 16 was a negatively worded item, it loaded positively with the factor of physical aggression. It may be that the double negative within the question (i.e., no good reason) may have confused respondents and caused this positive factor loading. Future studies utilizing the BPAQ should aim to rework this question by removing the negatively worded phrasing, since the remaining 27 items in the final model put forth in the present study are all worded positively.

Conclusion

In conclusion, our research established the factor structure of the BPAQ in an Asian population among outpatients with schizophrenia and related psychoses seeking treatment at a tertiary hospital. The study findings demonstrate high internal consistency and a valid factor structure of BPAQ, making it appropriate for assessing aggression in this population. We identified socio-demographic and clinical factors that were associated with aggression in patients with schizophrenia and related psychoses. Early implementation of risk protocols as well as psycho-education in this vulnerable group may potentially reduce the risk of aggression in patients with psychosis. Our study results highlight the relevance of adapting BPAQ instrument in the hospital setting to enable implementation of targeted interventions and holistic programmes for patients. However, larger community based studies are needed to replicate our findings.

Data Availability Statement

Data may be available upon reasonable request and subjected to approval by the Institutional Review Board (IRB). This is a requirement mandated for this research study by our IRB and funders. Requests to access the dataset should be directed to the senior author, Mythily Subramaniam, mythily@imh.com.sg.

Ethics Statement

The studies involving human participants were reviewed and approved by National Healthcare Group Domain Specific Review Board. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

AJ wrote the manuscript, conceived the study, and wrote the protocol. JHL analyzed the data, assisted in the interpretation of the findings, and provided comments for the article. EA reviewed the analyses and provided comments for the article. SS, SC, ES, LC, K-CW, YMM, CT, and SV critically reviewed the article. SAC and MS reviewed the protocol and critically reviewed the article. All authors provided intellectual input and approved the final manuscript.

Funding

The study was funded through the Singapore Ministry of Health's National Medical Research Council under the Centre Grant Programme (Ref No.: NMRC/CG/M002/2017_IMH). The funding body had no role in the design of the study and data collection, analysis, and interpretation of data and in writing the manuscript.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2021.777388/full#supplementary-material

References

1. Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJ. Global Burden of Diseases and Risk Factors. Washington: The World Bank (2006).

Google Scholar

2. Sariaslan A, Arseneault L, Larsson H, Lichtenstein P, Fazel S. Risk of subjection to violence and perpetration of violence in persons with psychiatric disorders in Sweden. JAMA Psychiatry. (2020) 77:359–367. doi: 10.1001/jamapsychiatry.2019.4275

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Zhou JS, Zhong BL, Xiang YT, Chen Q, Cao XL, Correll CU. Prevalence of aggression in hospitalized patients with schizophrenia in China: a meta-analysis. Asia-Pac Psychiatry. (2016) 8:60–9. doi: 10.1111/appy.12209

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Douglas KS, Guy LS, Hart SD. Psychosis as a risk factors for violence to others: a meta-analysis. Pyschol Bull. (2009) 135:679–706. doi: 10.1037/a0016311

PubMed Abstract | CrossRef Full Text | Google Scholar

5. GBD 2017 Disease and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet. (2017) 392:1789–858. doi: 10.1016/S0140-6736(18)32279-7

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Subramaniam M, Abdin E, Vaingankar JA, Sambasivam R, Zhang YJ, Shafie S, et al. Lifetime prevalence and correlates of schizophrenia and other psychotic disorders in Singapore. Front Psychiatry. (2021) 12:650674. doi: 10.3389/fpsyt.2021.650674

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Subramaniam M, Abdin E, Picco L, Pang S, Shafie S, Vaingankar JA, et al. Stigma towards people with mental disorders and its components—a perspective from multi-ethnic Singapore. Epidemiol Psychiatr Sci. (2017) 26:371–82. doi: 10.1017/S2045796016000159

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Silver E, Brent T. Mental disorder and violence: an examination of stressful life events and impaired social support. Soc Probl. (2005) 52:62–78. doi: 10.1525/sp.2005.52.1.62

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Yanos PT, DeLuca JS, Roe D, Lysaker PH. The impact of illness identity on recovery from severe mental illness: a review of the evidence. Psychiatry Res. (2020) 288:112950. doi: 10.1016/j.psychres.2020.112950

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Barlati S, Morena D, Nibbio G, Cacciani P, Corsini P, Mosca A, et al. Internalized stigma among people with schizophrenia: relationship with socio-demographic, clinical and medication-related features. Schizophr Res. (2021). S0920-9964(21)00219-X. doi: 10.1016/j.schres.2021.06.007. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Devaramane V, Pai NB, Vellu SL. The effect of a brief family interventions on primary carer's functioning and their schizophrenic relatives' levels of psychopathology in India. Asian J Psychiatry. (2011) 4:183–7. doi: 10.1016/j.ajp.2011.06.004

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Citrome LL,. Aggression: Overview, Epidemiology, Assessment Differential Diagnosis. In: Bienenfeld D, editor. New York, NY: Medscape (2015). Retreived from: https://emedicine.medscape.com/article/288689-overview (accesesed June 9, 2017).

13. Swapna V, Lye Yin P, Mythily S, Siow-Ann C. Aggression in Asian patients with first-episode psychosis. Int J Soc Psychiatry. (2005) 51:365–71. doi: 10.1177/0020764005060852

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Appelbaum PS, Robbins PC, Monahan J. Violence and delusions: data from the MacArthur Violence Risk Assessment Study. Am J Psychiatry. (2000) 157:566–72. doi: 10.1176/appi.ajp.157.4.566

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Torrey EF. Stigma and violence: isn't it time to connect the dots? Schizophr Bull. (2011) 37:892–6. doi: 10.1093/schbul/sbr057

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Volavka J. Violence in schizophrenia and bipolar disorder. Psychiatr Danub. (2013) 25:24–33.

Google Scholar

17. Palijan TZ, Radeljak S, Kovac M, Kovacevic D. Relationship between comorbidity and violence risk assessment in forensic psychiatry- the implication of neuroimaging studies. Psychiatr Danub. (2010) 22:253–6.

PubMed Abstract | Google Scholar

18. Witt K, Van Dorn R, Fazel S. Risk factors for violent in psychosis: systematic review and meta-regression analysis of 110 studies. PLoS ONE. (2013) 8:e55942. doi: 10.1371/annotation/f4abfc20-5a38-4dec-aa46-7d28018bbe38

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Bo S, Abu-Akel A, Kongersleve M, Haahr UH, Simonsen E. Risk factors for violence among patients with schizophrenia. Clin Psycholo Rev. (2011) 31:711–26. doi: 10.1016/j.cpr.2011.03.002

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Lamsma J, Cahn W, Fazel S. Use of illicit substances and violent behaviour in psychotic disorders: two nationwide case-control studies and meta-analyses. Psychol Med. (2020) 50:2028–33. doi: 10.1017/S0033291719002125

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Fazel S, Sariaslan A. Victimization in people with severe mental health problems: the need to improve research quality, risk stratification and preventive measures. World Psychiatry. (2021) 20:437–8. doi: 10.1002/wps.20908

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Rossa-Roccor V, Schmid P, Steinert T. Victimization of people with severe mental illness outside and within the mental health care system: results on prevalence and risk factors from a multicenter study. Front Psychiatry. (2020) 11:563860. doi: 10.3389/fpsyt.2020.563860

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Latalova K, Kamaradova D, Prasko J. Violent victimization of adult patients with severe mental illness: a systematic review. Neuropsychiatr Dis Treat. (2014) 10:1925–39. doi: 10.2147/NDT.S68321

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Archer J. Sex differences in aggression in real-world settings: a meta-analytic review. Rev General Psychol. (2004) 8:291–322. doi: 10.1037/1089-2680.8.4.291

CrossRef Full Text | Google Scholar

25. Buss AH, Perry M. The aggression questionnaire. J Pers Soc Psychol. (1992) 63:452–9. doi: 10.1037/0022-3514.63.3.452

CrossRef Full Text | Google Scholar

26. Sher L, Rutter SB, New AS, Siever LJ, Hazlett EA. Gender differences and similarities in aggression, suicidal behaviour, and psychiatric comorbidity in borderline personality disorder. Acta Psychiatr Scand. (2019) 139:145–53. doi: 10.1111/acps.12981

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Bitter I, Basson BR, Dossenbacj MR. Antipsychotic treatment and sexual functioning in first-time neuroleptic-treated schizophrenia patients. Int Clin Psychopharamacol. (2005) 20:19–21. doi: 10.1097/00004850-200501000-00004

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Mehta RJ, Ritambhara Y, Mehta ND. A case control study of aggressive behaviour in stable patients with schizophrenia who have improved on treatment and in normal and its effect on quality of life at government medical college Surat. Int J Med Sci Clin Inven. (2016) 3:1565–74. doi: 10.18535/ijmsci/v3i2.08

CrossRef Full Text | Google Scholar

29. Department of Statistics Singapore. Population Trends 2020. (2020). Available online at: https://www.singstat.gov.sg/-/media/files/publications/population/population2020.pdf (accessed June 26, 2021).

30. Subramaniam M, Mahesh MV, Peh CX, Tan J, Fauziana R, Satghare P, et al. Hazardous alcohol use among patients with schizophrenia and depression. Alcohol. (2017) 65:63–9. doi: 10.1016/j.alcohol.2017.07.008

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Verma SK, Subramaniam M, Chong SA, Kua EH. Substance abuse in schizophrenia. A Singapore perspective. Soc Psychiatry Psychiatry Epidemiol. (2002) 37:326–8. doi: 10.1007/s00127-002-0553-8

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Subramaniam M, Abdin E, Vaingankar JA, Shafie S, Chua HC, Tan WM, et al. Minding the treatment gap: results of the Singapore Mental Health Study. Soc Psychiatry Psychiatr Epidemiol. (2020) 55:1415–24. doi: 10.1007/s00127-019-01748-0

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Tan C, Abdin E, Liang W, Poon LY, Poon NY, Verma S. Medication adherence in first-episode psychosis patients in Singapore. Early Interv Psychiatry. (2019) 13:780–8. doi: 10.1111/eip.12559

PubMed Abstract | CrossRef Full Text | Google Scholar

34. American Psychiatric Association. Diagnostic Statistical Manual of Mental Disorders: DSM-IV. Fourth edition. Washington, DC: American Psychiatric Association (1994). Available online at: https://search.library.wisc.edu/catalog/999733358502121 (accessed June 26, 2021).

Google Scholar

35. Gerevich J, Bacskai E, Czobor P. The generalizability of the Buss-Perry Aggression Questionnaire. Int J Methods Psychiatr Res. (2007) 16:124–136. doi: 10.1002/mpr.221

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Derogatis LR, Savitz KL. The SCL-90-R and the Brief Symptoms Inventory (BSI) in Primary Care. In: Maruish, Mark Edward Handjournal of psychological assessment in primary care settings. Mahwah NJ: Lawarence Eribaum Associates (2000), p. 297–334.

Google Scholar

37. Derogatis LR. SCL-90-R: Administration, scoring and procedures manual-II for the (revised) version and other instruments of the psychopathology rating scale series. Clin Psychom Res. (1992) 1992:1–16.

Google Scholar

38. Ewing JA. Detecting alcoholism. The CAGE questionnaire. J. Am. Med. Assoc. (1984) 252:1905–7. doi: 10.1001/jama.1984.03350140051025

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Dhalla S, Kopec JA. The CAGE questionnaire for alcohol misuse: A review of the reliability and validity studies. Clin. Investig. Med. (2007) 30:33–41. doi: 10.25011/cim.v30i1.447

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Abdin E, Sagayadevan V, Vaingankar JA, Picco L, Chong SA, Subramaniam M. A non-parametric item response theory evaluation of the CAGE instrument among older adults. Substance Use Misuse. (2018) 53:391–9. doi: 10.1080/10826084.2017.1332645

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Skinner HA. The drug abuse screening test. Addic Behav. (1982) 7:363–71. doi: 10.1016/0306-4603(82)90005-3

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Villalobos-Gallegos L, Pérez-López A, Mendoza-Hassey R, Graue-Moreno J, Marín-Navarrete R. Psychometric and diagnostic properties of the Drug Abuse Screening Test (DAST): Comparing the DAST-20 vs. the DAST-10. Salud Mental. (2015) 38:89–94. doi: 10.17711/SM.0185-3325.2015.012

CrossRef Full Text | Google Scholar

43. Kline R. (2010). Principles and Practice of Structural Equation Modelling. New York, NY: Guillford Press.

Google Scholar

44. Hu L, Bentler PM. Cut-off criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Modell. (1999) 6:1–55. doi: 10.1080/10705519909540118

CrossRef Full Text | Google Scholar

45. Stevens JP. Applied Multivariate Statistics for the Social Sciences. 2nd Edition. Hillsdale, NJ: Eribaum (1992).

Google Scholar

46. Harris JA. Confirmatory factor analysis of The Aggression Questionnaire. Behav Res Ther;. (1995) 33:991–3. doi: 10.1016/0005-7967(95)00038-Y

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Zimonyi S, Kasos K, Halmai Z, Csirmaz L, Stadler H, Rózsa S, et al. Hungarian validation of the buss–perry aggression questionnaire—is the short form more adequate? Brain Behav. (2021) 11:e02043. doi: 10.1002/brb3.2043

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Nakano K. Psychometric evaluation on the Japanese adaptation of the Aggression Questionnaire. Behav Res Ther. (2001) 39:853–8. doi: 10.1016/S0005-7967(00)00057-7

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Mehta PH, Beer J. Neural mechanisms of the testosterone-aggression relation the role of orbitofrontal cortes. J Cognneurosci. (2010) 22:2357–68. doi: 10.1162/jocn.2009.21389

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Anderson CA, Bushman BJ. Human aggression. AnnuRev Psychol. (2002) 53:27–51. doi: 10.1146/annurev.psych.53.100901.135231

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Vitoratou S, Ntzoufras I, Smyrnis N, Stefanis NC. Factorial composition of the Aggression Questionnaire: a multi-sample study in Greek adults. Psychiatry Res. (2009) 168:32–9. doi: 10.1016/j.psychres.2008.01.016

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Archer J. The nature of human aggression. Int J Law Psychiatry. (2009) 32:202–08. doi: 10.1016/j.ijlp.2009.04.001

PubMed Abstract | CrossRef Full Text | Google Scholar

53. World Health Organization. World Report on Violence and Health. (2002). Available online at: http://whqlibdoc.who.int/publications/2002/9241545615_eng (accessed July 3, 2021).

54. Araya T, Ebnemelek E, Getachew R. Prevalence and associated factors of aggressive behaviour among patients with schizophrenia at Ayder comprehensive specialized hospital, Ethiopia. BioMed Res. Int. (2020) 2020:7571939. doi: 10.1155/2020/7571939

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Fond G, Boyer L, Favez M, Brunel L, Aouizerate B, Berna F, et al. Medication and aggressiveness in real-world schizophrenia. Results from the FACE-SZ dataset. Psychopharmacology. (2016) 233:571–8. doi: 10.1007/s00213-015-4167-8

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Harris MB, Knight-Bohnhoff K. Gender and aggression II: personal aggressiveness. Sex Roles. (1996) 35:27–42. doi: 10.1007/BF01548173

CrossRef Full Text | Google Scholar

57. Whiting D, Lichtenstein P, Fazel S. Violence and mental disorders: a structured review of associations by individual diagnoses, risk factors, and risk assessment. Lancet Psychiatry. (2020) 8:150–61. doi: 10.1016/S2215-0366(20)30262-5

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Reinharth J, Reynolds G, Dill C, Serper M. Cognitive predictors of violence in schizophrenia: a meta-analytic review. Schizophr Res Cogn. (2014) 1:101–11. doi: 10.1016/j.scog.2014.06.001

CrossRef Full Text | Google Scholar

59. Vita A, Barlati S, Ceraso A, Nibbio G, Ariu C, Deste G, et al. Effectiveness, core elements, and moderators of response of cognitive remediation for schizophrenia: a systematic review and meta-analysis of randomized clinical trials. JAMA Psychiatry. (2021) 78:848–58. doi: 10.1001/jamapsychiatry.2021.0620

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Jones MT, Harvey PD. Neurocognition and social cognition training as treatments for violence and aggression in people with severe mental illness. CNS Spectr. (2020) 25:145–53. doi: 10.1017/S1092852919001214

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Chen L, Selvendra A, Stewart A, Castle D. Risk factors in early and late onset schizophrenia. Comprehen. Psychiatry. (2017). 80:155–162. doi: 10.1016/j.comppsych.2017.09.009

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Volavka J. Comorbid personality disorders and violent behavior in psychotic patients. Psychiatr Q. (2014) 85:65–78. doi: 10.1007/s11126-013-9273-3

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Hodgins S Magdalena J Piatosa and Boris S. Violence among people with schizophrenia: phenotypes and neurobiology. Curr Topic Behav Neurosci. (2014) 17:329–68. doi: 10.1007/7854_2013_259

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Bácskai E, Czobor P, Gerevich J. Gender differences in trait aggression in young adults with drug and alcohol dependence compared to the general population. Prog Neuro-Psychopharmacol Biol Psychiatry. (2011) 35:1333–40. doi: 10.1016/j.pnpbp.2011.04.005

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Pickard H, Fazel S. (2013). Substance abuse as a risk factor for violence in mental illness: some implications for forensic psychiatric practice and clinical ethics. Curr Opin Psychiatry. 26:349–354. doi: 10.1097/YCO.0b013e328361e798

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Nedrerlof AF, Muris P, Hovens JE. Threat/control-override symptoms and emotional reactions to 2014 positive symptoms as correlates of aggressive behaviour in psychotic patients. J Nervous Mental Dis. (2011) 199:342–7. doi: 10.1097/NMD.0b013e3182175167

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Freeman D. Suspicious minds: the psychology of persecutory delusions. Clin Psychol Rev 27. (2007) 425–57. doi: 10.1016/j.cpr.2006.10.004

PubMed Abstract | CrossRef Full Text | Google Scholar

68. So SH, Freeman D, Dunn G, Kapur S, Kuipers E, Bebbington P, et al. Jumping to conclusions, a lack of belief flexibility and delusional conviction in psychosis: a longitudinal investigation of the structure, frequency, and relatedness of reasoning biases. J Abnorm Psychol. (2012) 121:129. doi: 10.1037/a0025297

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Wu Y, Kang R, Yan Y, Gao K, Li Z, Jiang J, et al. Epidemiology of schizophrenia and risk factors of schizophrenia-associated aggression from 2011 to 2015. J Int Med Res. (2018) 46:4039–49. doi: 10.1177/0300060518786634

PubMed Abstract | CrossRef Full Text | Google Scholar

70. Bentall RP, Kaney S, Bowen-Jones K. Persecutory delusions and recall of threat related, depression-related, and neutral words. Cognit Ther Res. (1995) 19:445–57. doi: 10.1007/BF02230411

CrossRef Full Text | Google Scholar

Keywords: aggression, BPAQ, schizophrenia, factor structure, confirmatory factor analysis

Citation: Jeyagurunathan A, Lau JH, Abdin E, Shafie S, Chang S, Samari E, Cetty L, Wei K-C, Mok YM, Tang C, Verma S, Chong SA and Subramaniam M (2022) Aggression Amongst Outpatients With Schizophrenia and Related Psychoses in a Tertiary Mental Health Institution. Front. Psychiatry 12:777388. doi: 10.3389/fpsyt.2021.777388

Received: 30 September 2021; Accepted: 23 November 2021;
Published: 03 January 2022.

Edited by:

Morten Hesse, Aarhus University, Denmark

Reviewed by:

Gabriele Nibbio, University of Brescia, Italy
Bernhard Bogerts, Otto von Guericke University Magdeburg, Germany

Copyright © 2022 Jeyagurunathan, Lau, Abdin, Shafie, Chang, Samari, Cetty, Wei, Mok, Tang, Verma, Chong and Subramaniam. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Anitha Jeyagurunathan, anitha_jeyagurunathan@imh.com.sg

Download