ORIGINAL RESEARCH article
Sec. Psychology for Clinical Settings
Volume 7 - 2016 | https://doi.org/10.3389/fpsyg.2016.01809
Healthcare Needs, Experiences and Satisfaction after Terrorism: A Longitudinal Study of Survivors from the Utøya Attack
- 1Norwegian Centre for Violence and Traumatic Stress Studies, Oslo, Norway
- 2Centre for Child and Adolescent Mental Health, Eastern and Southern Norway, Oslo, Norway
- 3Faculty of Medicine, Institute of Clinical Medicine, University of Oslo, Oslo, Norway
Background: Public health outreach programs have been developed in order to ensure that needs are met after disasters. However, little is known about survivors' experiences with post-terror healthcare. In the present study, our objectives were to (1) describe survivors' experiences with post-terror healthcare, (2) identify factors associated with reports of unmet healthcare needs, and (3) examine the relationship between socio-demographic characteristics, healthcare experiences and satisfaction.
Methods: Our study comprised three waves of semi-structured interviews with 261/490 (53%) survivors of the Utøya mass shooting. We applied Pearson's chi-squared tests (categorical variables) and independent t-tests (continuous variables) to compare survivors by whether or not they reported higher perceived needs than received help for psychological reactions and physical health problems, respectively. Ordinal regression analyses were applied to examine whether socio-demographic characteristics and healthcare experiences were associated with dissatisfaction.
Results: Altogether 127 (49%) survivors reported very high/high help needs for psychological reactions, and 43 (17%) for attack-related physical health problems. Unmet healthcare needs were associated with higher levels of posttraumatic stress, psychological distress, somatic symptoms and less social support. Survivors with immigrant backgrounds and injured survivors who were not admitted to hospital reported unmet needs for physical health problems more often. After adjustments for socio-demographic characteristics, immigrant origin was associated with dissatisfaction with post-terror healthcare. After additionally adjusting for healthcare experiences, poor rating of the overall organization and accessibility of healthcare remained significantly associated with dissatisfaction.
Conclusions: Most survivors were satisfied with the post-terror healthcare they received, yet our findings indicate that increased attention to the physical health of non-hospitalized terrorism survivors is required. Furthermore, in future outreach, particular attention should be paid to the healthcare needs of survivors with immigrant background.
Experiencing a terrorist attack may have a severe effect on mental and physical health (North et al., 1999; Feng et al., 2006; Miguel-Tobal et al., 2006; Tucker et al., 2007; Whalley and Brewin, 2007; Neria et al., 2011; Dyb et al., 2014). Despite efforts to develop public health outreach programs to respond to survivors' healthcare requirements, (Felton, 2002; Brewin et al., 2010) unmet needs have been reported in the aftermath of terrorism (Pfefferbaum et al., 2003; Fairbrother et al., 2004). Although, evaluation of health services is necessary for their improvement, there has been little research on post-terror healthcare provision. Existing studies have primarily comprised cross-sectional assessments of posttraumatic stress reactions and use of counseling services. Health authorities increasingly recognize patients' perceived experiences and satisfaction as important aspects of healthcare quality (Donabedian, 1988). Satisfaction is a broad concept that may reflect multiple factors; including the quality of care and the patient's expectations and preferences (Bleich et al., 2009). It is therefore valuable to assess different types of experiences with the post-terror outreach that may be important from the survivors' perspective and may contribute to satisfaction with healthcare. A better understanding of survivors' experiences and satisfaction with post-terror outreach is essential for identifying the aspects of healthcare that may be important for meeting survivors' needs and strengthening public health preparedness for future attacks. This study investigates the healthcare needs, experiences and satisfaction of the Utøya attack survivors.
On July 22, 2011, a solitary right-wing terrorist perpetrated a shooting spree at the summer camp of a political youth organization on the Utøya islet. During the nearly 1.5 h long shooting, 69 were killed, many lost friends or family members and many were injured or risked drowning in attempts to swim to safety. The 495 survivors came from rural and urban municipalities throughout Norway. In order to anticipate the unmet needs observed after previous terrorist attacks, a primary care based proactive outreach program was created to identify survivors who would develop mental health problems and need specialized treatment. The Norwegian Directorate of Health recommended that municipal crisis teams contact all survivors directly after the attack, and that all survivors be appointed a municipal contact person. The contact person was to ensure continuity in the follow-up throughout the first year, and set up standardized screening assessments at 5–6 weeks, 3, and 12 months after the attack (Norwegian Directorate of Health, 2012). Prior research has shown that all survivors received some type of healthcare in the aftermath of the Utøya attack, though an important minority was not proactively followed-up as recommended (Dyb et al., 2011; Stene and Dyb, 2015). The survivors' perceived needs, experiences and satisfaction with post-terror healthcare provision have not yet been investigated. The aims of this study were to:
- Describe the survivors' perceived needs, experiences and satisfaction with post-terror healthcare.
- Identify factors associated with reporting unmet healthcare needs.
- Examine whether satisfaction with post-terror follow-up was related to socio-demographic factors and experiences with healthcare.
Materials and Methods
Participants and Procedures
Police records were used to identify 495 survivors who had been on the Utøya islet during the shooting. We excluded four survivors aged <13 years and one living abroad, hence study invitations were sent by mail to 490 survivors. Semi-structured face-to-face interviews were performed by trained clinicians at 4–5 months (wave 1), 14–15 months (wave 2), and 31–32 months (wave 3) after the attack. Questions about healthcare needs, experiences and satisfaction were included at wave 3. The study had an open cohort design in which all the eligible survivors (n = 490) were invited to participate at waves 1 and 2. At wave 3 invitations were sent to the 355 (72%) survivors who participated at wave 1 or 2. Altogether, 261 (53%) survivors participated at wave 3 and were included in this study. There were no significant differences between participating and non-participating survivors (n = 229) with respect to gender (52 vs. 57% male survivors, p = 0.258), age (mean 19.5 (SD 4.8) vs. 19.0 (3.9) years, p = 0.189), hospitalization after the attack (7 vs. 8%, p = 0.450) and peripheral residence (13 vs. 18%, p = 0.162). Survivors who were lost to follow-up after the first two study waves (n = 94) were significantly more likely to be of non-Norwegian origin than survivors in our sample (p = 0.002). However, they did not differ significantly in their levels of posttraumatic distress, anxiety/depression, somatic symptoms and social support (p ≥ 0.208). Participants aged ≥16 years provided written informed consent. Parental consent was required before survivors aged <16 years could participate in the study. The Regional Committees for Medical and Health Research Ethics South East and North in Norway approved the study. The study procedures have been described in detail in a previous study (Stene and Dyb, 2016).
Healthcare Needs, Experiences, and Satisfaction
There are no standardized methods for assessing healthcare experiences among survivors of mass-casualty incidents. Our questions on perceived experiences and satisfaction with follow-up were developed from questions included in national surveys of patient experiences in Norway designed by the Norwegian Knowledge Centre for the Health Services (Garratt et al., 2011). The wording of some questions was adjusted to fit the post-disaster setting. Questions on healthcare needs, experiences and satisfaction had a five-point response scale, ranging from “not at all” to “to a very large extent,” which has been shown to be satisfactory for assessing patient experiences (Garratt et al., 2011). The questions are given in Box 1. We did separate assessments for the perceived needs and receipt of help or treatment for attack-related psychological reactions and physical health problems. The survivors were first asked to rate the extent to which they had required help, and immediately afterwards they were asked to rate the extent to which they had received help. If the survivors' scores for required help were higher than the scores for help received, the response was categorized as unmet needs for psychological reactions and physical health problems.
Box 1. Questions on healthcare needs, experiences and satisfaction
I will now ask you some questions about your need for help. With respect to what you experienced at Utøya, have you…
- Felt that you needed help or treatment for psychological reactions/problems?
- Received help from healthcare practitioners for psychological reactions/problems?
- Felt that you needed help or treatment for bodily/physical health problems?
- Received help from healthcare practitioners for bodily/physical health problems?
- Do you currently feel that you need help or treatment for psychological reactions/problems?
- Do you currently feel that you need help or treatment for bodily/physical health problems?
Not at all/To a small extent/To some extent/To a large extent/To a very large extent
We would like to know about your overall experience with the public help services in relation to what you went through at Utøya.
- Did you find the help services to be well organized?
- Were you offered help without having to ask for it?
- How satisfied are you with the accessibility of the help services?
- Were you treated with care and consideration?
- Were you involved in decisions regarding your treatment/follow-up?
- Did you get enough time to talk and interact with healthcare practitioners?
- Did a single representative from the help services have the main responsibility for your follow-up?
Not at all/To a small extent/To some extent/To a large extent/To a very large extent
Overall, were the help and treatment you received after the terrorist attack satisfactory?
Not at all/To a small extent/To some extent/To a large extent/To a very large extent
Other questions regarding post-terror follow-up
Overall, what benefit have you had from the help you received from public services after the terrorist attack?
Response alternatives: No/Little/Some/Large/Very large benefit
Did you have to wait to be offered help from the public services after the terrorist attack?
Response alternatives: No/Yes, but not for long/Yes, quite long/Yes, far too long
Posttraumatic stress reactions in the past month were measured using the University of California at Los Angeles Post-traumatic Stress Disorder (PTSD) Reaction Index (UCLA PTSD-RI) (Steinberg et al., 2004). The total score covers 17 items that conform to the DSM–IV symptoms of PTSD rated on a five-point Likert scale ranging from 0 (never) to 4 (most of the time) (American Psychiatric Association, 2000). Three items have two alternative wordings that are assessed by the item with the highest score. It has been documented that a mean score of 38 or greater on the PTSD-RI has the greatest sensitivity and specificity for detecting PTSD (Steinberg et al., 2004). The mean score was used in the analyses (Cronbach's alphas: waves 1 and 2 = 0.89 and wave 3 = 0.91). Symptoms of anxiety and depression were assessed with the Hopkins Symptom Checklist-8 (SCL-8). This is a short version of the SCL-25 which measures symptoms of depression/anxiety in the past 2 weeks using eight items scored from 1 (not bothered) to 4 (very bothered) (Derogatis et al., 1974). The mean score of five of the Hopkins Symptom Checklist items can be dichotomized by a validated cut-off at >2.0 to serve as a measure of anxiety and depression (Tambs and Moum, 1993). We applied the mean score in the analyses (Cronbach's alphas: wave 1 = 0.85, wave 2 = 0.89 and wave 3 = 0.90). The short versions of the Hopkins Symptom Checklist have shown high psychometric qualities in population-based studies (Strand et al., 2003). Somatic symptoms in the past 2 weeks were measured using a short version of the Children's Somatic Symptoms Inventory (CSSI-8) (Walker et al., 2008). The eight items assessed pain in the stomach, head, lower back, and arms/legs; faintness/dizziness; rapid heartbeat; nausea/stomach problems; and weakness. The items were scored on a scale from 1 (not bothered) to 4 (very bothered). We used the mean score in the analyses (Cronbach's alphas: wave 1 = 0.77, wave 2 = 0.78 and wave 3 = 0.77). Social support was assessed using seven items from the Duke University of North Carolina Functional Social Support Questionnaire (FSSQ-7) scored from 1 (much less than I would like) to 5 (as much as I would like)(Broadhead et al., 1988) (Cronbach's alphas: wave 1 = 0.79, wave 2 = 0.77 and wave 3 = 0.80).
We obtained information on age, gender and place of residence from police records. The other data were collected during the first interview. Age was assessed at the time of the attack as a continuous variable with one decimal in the analyses. If the survivor's home municipality was located more than 45 min traveling time from a settlement with at least 15000 inhabitants, it was defined as peripheral residence according to Statistics Norway's classification of centrality (Statistics Norway Centrality, 2008). Survivors with both parents born abroad were classified as having non-Norwegian origin. Financial status was assessed by asking survivors how they perceived their own (survivors who did not live with parents) or their parents' (survivors who lived with parents) economic status compared to others. The five response categories were dichotomized into financially disadvantaged (much or somewhat poorer) or not (similar, somewhat better, and much better). Physical injury comprised three categories. Survivors who were hospitalized directly after the attack because of physical injuries were classified as hospitalized. Hospitalization was verified by hospital records. Survivors who were not hospitalized and answered yes to the question “Were you physically injured and required medical assistance?” were classified as injured but not hospitalized, and survivors who answered no were classified as not injured.
We did descriptive analyses of the survivors' perceived healthcare needs, experiences and satisfaction related to the post-disaster follow-up. Pearson's chi-squared tests (categorical variables) and independent t-tests (continuous variables) were used to compare survivors according to whether or not they reported higher perceived needs than received help for psychological reactions and physical health problems, respectively. Furthermore, we used unadjusted and adjusted ordinal regression analyses to examine whether socio-demographic factors and perceived experiences were related to levels of dissatisfaction. We applied two multivariable regression models. Model 1 adjusted for socio-demographic variables, including age, gender, origin, peripheral residence and self-perceived economic status. Model 2 adjusted for the survivors' healthcare experiences in addition to all variables in Model 1. Due to sample size constraints, questions on healthcare experiences were reduced from five to three categories, where “not at all” and “to a small extent” were combined as well as “to a large extent” and “to a very large extent.” A hierarchical cluster analysis using Spearman correlation of the questions on healthcare experiences identified a homogenous clustering for the questions about satisfaction with the accessibility of services and being given enough time to talk and interact with healthcare practitioners. Consequently, we applied the mean score of these items as a continuous variable in the analyses. The percentages and analyses were based on the total number of answers for each item. Due to non-participation, we lacked data on symptoms and social support for 20 (7.7%) survivors at wave 1 and 34 (13.0%) survivors at wave 2. There was little missing data among those who participated in waves 1 and 2, and no respondents had more than two items with missing data in any of the above-mentioned scales (PTSD-RI, SCL-8, CSSI-8 and FSSQ-7). If a respondent had missing data on one or two items, the mean scores of the answered items were used in the analyses. We presented the crude and adjusted odds ratios (OR) with 95% confidence intervals (CI). The analyses were performed with IBM SPSS version 22 and R version 3.3.3 (The R Foundation for Statistical Computing, Vienna, Austria).
Characteristics of our sample are presented in Table 1. Two and a half years after the attack, 125 (48.4%) survivors rated their health as excellent or very good. However, 98 (37.7%) survivors reported that their health had worsened after the attack. Furthermore, 43 (16.5%) survivors reported very high/high current help needs for psychological reactions, and, 24 (9.2%) reported very high/high current help needs for physical health problems. In all, 22 (8.6%) survivors reported that they had to wait too long or quite long before they were offered help. Altogether, 133 (51.6%) survivors reported very large/large benefit, whereas 45 (17.4%) reported little or no benefit from the overall help they had received after the attack. The number of survivors with symptoms above the clinical cut-off for PTSD at the respective survey waves were 53/241 (22.0%) at wave 1, 19/227 (8.4%) at wave 2, and 20/261 (7.7%) at wave 3. Furthermore, the number of survivors with clinical levels of anxiety and depression symptoms were 108/241 (44.8%) at wave 1, 66/227 (29.1%) at wave 2, and 64/261 (24.5%) at wave 3. Figure 1 presents the survivors' self-perceived overall attack-related needs and received help/treatment. With respect to psychological reactions, 53 (20.4%) survivors scored their healthcare needs as greater, and 90 (34.6%) as less, than the help they had received. As for attack-related physical health problems, 37 (14.3%) survivors rated their healthcare needs as greater, and 42 (16.2%) as less, than what they had received. Overall, 13 (5.0%) survivors scored their healthcare needs as greater than the help they had received for both psychological reactions and physical health problems. Altogether, 21 (48.8%) of the 43 survivors who reported very high/high help needs due to attack-related physical health problems had been physically injured during the attack.
Figure 1. The survivors' self-perceived overall needs, and received help/treatment, for psychological reactions (n = 260) and physical health problems (n = 259) related to the Utøya attack.
Table 2 displays characteristics of survivors who reported healthcare needs greater than the help they had received for attack-related psychological reactions and physical health problems. Survivors who reported unmet needs for psychological reactions were significantly more likely to report higher levels of posttraumatic stress and anxiety/depression both shortly after the attack and at wave 3, i.e., after approximately 2.5 years, than those who did not. They were also more likely to report higher levels of somatic symptoms, less social support and poorer general health at wave 3 than the other survivors. With respect to attack-related physical health problems, unmet needs were associated with higher levels of posttraumatic stress, anxiety/depression and somatic symptoms, and less social support at all survey waves. Unmet needs were also associated with non-Norwegian origin and poorer general health. Furthermore, there was a significant relationship between physical injuries and unmet needs. None of the survivors who were hospitalized due to injuries reported unmet needs for physical health problems, compared to 11 (36.7%) of those who were injured but not admitted to hospital and 26 (12.4%) of the survivors who were not injured.
Table 2. Survivor characteristics by self-perceived unmet healthcare needs for attack-related psychological and physical health problems.
Figure 2 displays the survivors' perceived experiences and overall satisfaction with the help services they received in relation to the Utøya attack. Overall, 78 (30.0%) survivors were satisfied to a very large extent, 97 (37.3%) to a large extent, 44 (16.9%) to some extent, 24 (9.2%) to a small extent and 17 (6.5 %) were not at all satisfied with the help services. No statistically significant relationship was found between satisfaction and self-perceived health or current health compared to before the attack (p = 0.267 and p = 0.444, respectively).
Figure 2. Survivors' experiences and satisfaction with help services after the Utøya attack reported 31–32 months after the attack.
In the unadjusted ordinal regression analyses, non-Norwegian origin and low scores on all perceived experiences with healthcare were associated with overall dissatisfaction with help received after the attack (Table 3). In the multivariable ordinal regression model adjusting for socio-demographic factors (Model 1), non-Norwegian origin remained significantly associated with dissatisfaction. After additionally adjusting for perceived healthcare experiences (Model 2), only low scores on the overall organization and accessibility of healthcare remained significantly associated with dissatisfaction.
Table 3. Multivariable ordinal regression models for dissatisfaction with help and treatment after the Utøya attack among 261 survivors.
This study provides new insight into the perceived healthcare needs, experiences and satisfaction among survivors of terrorism. Half of the survivors reported very high or high help needs for psychological reactions, and one in six reported very high or high help needs for attack-related physical health problems. The large proportion reporting high help needs suggests that a proactive outreach with screening assessments of all trauma survivors may be beneficial (Dyb et al., 2011). Participation in screening assessments might also have rendered the survivors more conscious about their help needs.
Most survivors scored the help they had received as equal to their needs. Yet one in five reported unmet needs for psychological reactions and one in seven for physical health problems. Unmet needs for psychological reactions were more common among survivors with more symptoms of posttraumatic stress and depression/anxiety both shortly and sometime after the attack. It seems plausible that there is a bidirectional relationship between increased symptom load and unmet needs; i.e., that higher morbidity increases the likelihood of unmet needs, and that insufficient treatment results in higher levels of symptoms. Unmet needs for psychological reactions were also associated with somatic symptoms and lower social support at wave 3, but not before. There is increasing awareness of the adverse physical health effects of chronic stress (Gupta, 2013). Furthermore, studies have shown that social support may reduce psychological stress, yet little is known about how persistent psychological stress may influence social relationships and support (Arnberg et al., 2012; Thoresen et al., 2014). Unfortunately, causal inferences cannot be drawn from the current analysis. The potential impact of untreated psychological stress on physical health and social relationships merits attention in future research.
With respect to physical health problems, unmet needs were associated with higher levels of posttraumatic stress, anxiety/depression and somatic symptoms, as well as lower social support at all survey waves. Interestingly, none of the injured survivors who were admitted to hospital after the attack reported unmet needs for physical health problems. It appears that the physical health of the severely injured was well cared for. In contrast, more than a third of the injured survivors who were not admitted to hospital and 12% of the survivors who were not injured reported unmet needs for attack-related physical health problems. In fact, the majority of survivors who reported very high/high help needs for attack-related physical health problems had not been physically injured. Our results underscore the importance of addressing the survivors' physical health in the aftermath of disasters, even in the absence of injuries. Previous studies have found somatic symptoms to be associated with higher levels of posttraumatic stress (Gupta, 2013) and the utilization of mental health services (Stene and Dyb, 2015) after disasters. Furthermore, somatic symptoms are associated with adverse psychosocial consequences and functional impairment (Campo et al., 1999).
Our findings suggest that the healthcare needs of survivors of immigrant origin require more attention. Compared to survivors of Norwegian origin, those with non-Norwegian origin were more likely to report unmet needs for attack-related physical health problems and to be less satisfied with the post-attack follow-up. It has been hypothesized that ethnic minorities tend to somatise distress but research results are inconsistent. Some studies have found no significant differences in somatization by ethnicity, (Bekker and Schepman, 2009) whereas others have indicated that somatization is either less (Bauer et al., 2012) or more (Aragona et al., 2005) common in ethnic minorities. Other possible explanations could be cultural or language-related barriers to satisfactory healthcare. The lower satisfaction with healthcare among immigrants agrees with findings from a Norwegian study in a non-disaster setting (Lien et al., 2008). Since participation rates generally tend to be lower among immigrants than non-immigrants, selection bias might occur. Indeed, in our study the loss to follow-up was greater among non-Norwegian survivors, and the results might not be representative for all non-Norwegian survivors. One should therefore be cautious when drawing conclusions concerning findings related to immigrant status.
This study applied univariable analyses to examine the relationship between survivor characteristics and perceived unmet healthcare needs. This information is valuable for identifying survivors at risk of having unmet help needs, improving the accessibility of healthcare and preventing unmet needs. Research in non-disaster settings indicates that perceived help needs are strongly associated with symptom severity (Mojtabai et al., 2002; Codony et al., 2009; Hargreaves et al., 2015). Identification of factors associated with unmet needs is therefore important in the planning of post-disaster outreach and the allocation of resources. Yet causal inferences cannot be drawn from the current analysis, and we cannot draw conclusions about why some survivors rated the help they had received as insufficient for their needs. The extent of self-perceived received help might reflect both quantity and quality of care. We lacked information about whether unmet needs were reported due to lack of healthcare or receipt of unsatisfactory healthcare. Furthermore, the amount of help offered to survivors with perceived unmet needs is unknown; it is possible that unidentified barriers prevented them from seeking or accepting care.
Although most survivors reported receiving help equal to their needs, a number of survivors reported their needs to be less than the help they received. This may be a natural consequence of the proactive outreach, as it comprised a screening assessment of all survivors irrespective of their symptom levels and functioning. Hence, survivors with no or few help needs may have received help that they believed to be unnecessary. This may represent a misallocation of resources, particularly for those who reported no or few needs but great or very great amounts of received help (Figure 1). On the other hand, studies in non-disaster settings have found that many individuals with mental disorders do not perceive their own need for help/treatment. It is possible that some of the survivors who reported receiving more help than they felt they needed might still have benefitted from it.
Most survivors reported both high satisfaction and benefit from the post-terror follow-up. Providing good healthcare experiences and satisfaction is increasingly becoming a priority for health authorities, and studies suggest that satisfaction is associated with better adherence to treatment. As previously mentioned, non-Norwegian survivors were less satisfied with the overall help they had received after the terrorist attack. The association remained significant after adjusting for other sociodemographic variables (Model 1, Table 3). A multivariable ordinal regression including perceived healthcare experiences indicated that the overall organization and accessibility of help services were particularly important quality measures in the aftermath of terrorism from the survivors' perspective (Model 2, Table 3).
Strengths and Limitations
This study included data from three waves of face-to-face interviews with young survivors of terrorism. One of the study strengths is the clear definition of the study population. The Utøya attack took place on a small island, where all survivors could be identified as having experienced a life-threatening event. In previous post-disaster studies the number and identity of directly affected survivors have often been unknown, and the respondents' trauma exposure may have diverged substantially. Furthermore, the first two waves of our study had an open cohort design, which allowed survivors to join the study at wave 2. This may have enhanced the response rate among survivors who were initially unable to participate due to poor health, thus providing a more representative sample than studies using closed cohorts (Stene and Dyb, 2016). All survivors were invited to participate, regardless of their receipt of healthcare services. Prior research on post-disaster health services has often included only recipients of specific services (Jackson et al., 2006). However, in the evaluation of outreach it is also important to assess those who did not receive care. Indeed, reaching out to everyone in need of follow-up is a considerable challenge after mass-casualty incidents.
A limitation of this study may be that we were unable to evaluate specific services individually. Respondents were asked to report their overall needs, received help and satisfaction with all the services they had received in relation to the terrorist attack over a period of more than 2.5 years. Therefore, we were unable to differentiate between their experiences with services in the early and the long-term phases after the attack. There may also have been recall bias due to the length of the period they were asked to evaluate. In this article, we assessed the survivors' subjective needs for, and receipt of, help and treatment. It is unknown to what extent appropriate, evidence-based care was provided to those in need. We also lacked information about the type of psychological reactions and physical health problems the survivors believed they needed help for. Moreover, there is no consensus on how unmet needs or satisfaction with healthcare should be measured. Satisfaction is a broad and subjective concept involving a variety of factors, including the survivors' expectations and preferences as well as the quality of the care they received (Bleich et al., 2009). We lacked information about the survivors' expectations and experiences with health services before the attack. Moreover, since few survivors rated low satisfaction with help services, we might have failed to identify predictors of low satisfaction (type 2 error). Furthermore, our results are based on responses from 52% of the survivors, and might not be representative of all survivors. There might be a particular risk of selection bias for results concerning immigrant status. A significantly higher number of survivors of non-Norwegian origin were lost to follow-up and were therefore not included in the current study. A Dutch study on survivors of a fireworks disaster found that health problems were associated with higher response among immigrant survivors; and with lower response among non-immigrants (Dijkema et al., 2005; Stene and Dyb, 2016).
External validity may be restricted by differences in the organization and financing of healthcare. This study was undertaken in a country with universal healthcare coverage, and participation in the proactive outreach program was free of charge. In countries with different organization of healthcare, access to health services may depend more on personal economy. Furthermore, our sample primarily comprised adolescents and young adults. The results are not necessarily representative of other age groups.
More research is needed to understand the needs and experiences of terrorism survivors and their satisfaction with provided healthcare. A combination of quantitative and qualitative data could provide better insight into the reasons for, and nature of, satisfaction with services provided after terrorist events. Furthermore, subjective reports of healthcare needs, experiences and satisfaction should be combined with objective, accurate measures of type and frequency of provided care. In the evaluation of outreach, it is important to consider both clinical- and patient-centered outcomes and effective use of resources.
LES contributed to the design, analyzed the data, and wrote the manuscript. TWL contributed to the statistical analyses and the drafting of the manuscript. GD was the study's project leader and contributed to drafting the manuscript.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
We sincerely thank all participants. Our study was funded by the Norwegian Directorate of Health and the Norwegian Research Council through the Research Programme on Health and Care Services.
American Psychiatric Association (2000). Diagnostic and Statistical Manual of Mental Disorders 4th Edn., Text Revision (DSM-IV-TR). Washington, DC: American Psychiatric Association.
Aragona, M., Tarsitani, L., Colosimo, F., Martinelli, B., Raad, H., Maisano, B., et al. (2005). Somatization in primary care: a comparative survey of immigrants from various ethnic groups in Rome, Italy. Int. J. Psychiatry Med. 35, 241–248. doi: 10.2190/2G8N-MNNE-PGGP-PJJQ
Arnberg, F. K., Hultman, C. M., Michel, P. O., and Lundin, T. (2012). Social support moderates posttraumatic stress and general distress after disaster. J. Trauma. Stress 25, 721–727. doi: 10.1002/jts.21758
Bauer, A. M., Chen, C. N., and Alegría, M. (2012). Prevalence of physical symptoms and their association with race/ethnicity and acculturation in the United States. Gen. Hosp. Psyhiatry 34, 323–331. doi: 10.1016/j.genhosppsych.2012.02.007
Bekker, M. H. J., and Schepman, R. (2009). Somatization and psychological awareness of ethnic minority clients in Western-European mental health care: a pilot study. Eur. J. Psychiatry 23, 135–139. doi: 10.4321/s0213-61632009000300001
Bleich, S. N., Ozaltin, E., and Murray, C. K. (2009). How does satisfaction with the health-care system relate to patient experience? Bull. World Health Organ. 87, 271–278. doi: 10.2471/BLT.07.050401
Brewin, C. R., Fuchkan, N., Huntley, Z., Robertson, M., Thompson, M., Scragg, P., et al. (2010). Outreach and screening following the 2005 London bombings: usage and outcomes. Psychol. Med. 40, 2049–2057. doi: 10.1017/S0033291710000206
Broadhead, W. E., Gehlbach, S. H., de Gruy, F. V., and Kaplan, B. H. (1988). The Duke-UNC functional social support questionnaire. measurement of social support in family medicine patients. Med. Care 26, 709–23. doi: 10.1097/00005650-198807000-00006
Campo, J. V., Jansen-McWilliams, L., Comer, D. M., and Kelleher, K. J. (1999). Somatization in pediatric primary care: association with psychopathology, functional impairment, and use of services. J. Am. Acad. Child Adolesc. Psychiatry 38, 1093–1101. doi: 10.1097/00004583-199909000-00012
Codony, M., Alonso, J., Almansa, J., Bernert, S., De Girolamo, G., De Graaf, R., et al. (2009). Perceived need for mental health care and service use among adults in Western Europe: results of the ESEMeD project. Psychiatric Serv. 60, 1051–1058. doi: 10.1176/ps.2009.60.8.1051
Derogatis, L. R., Lipman, R. S., Rickels, K., Uhlenhuth, E. H., and Covi, L. (1974). The Hopkins Symptom Checklist (HSCL): a self-report symptom inventory. Behav. Sci. 19, 1–15. doi: 10.1002/bs.3830190102
Dijkema, M. B., Grievink, L., Stellato, R. K., Roorda, J., and van der Velden, P. G. (2005). Determinants of response in a longitudinal health study following the firework-disaster in Enschede, The Netherlands. Eur. J. Epidemiol. 20, 839–847. doi: 10.1007/s10654-005-2149-6
Donabedian, A. (1988). The quality of care. How can it be assessed? JAMA 260, 1743–1748. doi: 10.1001/jama.1988.03410120089033
Dyb, G., Jensen, T., Glad, K. A., Nygaard, E., and Thoresen, S. (2011). Early outreach to survivors of the shootings in Norway on the 22nd of July. Eur. J. Psychotraumatol. 2014, 5. doi: 10.3402/ejpt.v5.23523
Dyb, G., Jensen, T. K., Nygaard, E., Ekeberg, Ø., Diseth, T. H., Wentzel-Larsen, T., et al. (2014). Post-traumatic stress reactions in survivors of the 2011 massacre on Utøya Island, Norway. Br. J. Psychiatry. 204, 361–367. doi: 10.1192/bjp.bp.113.133157
Fairbrother, G., Stuber, J., Galea, S., Pfefferbaum, B., and Fleischman, A. R. (2004). Unmet need for counseling services by children in New York City after the September 11th attacks on the World Trade Center: implications for pediatricians. Pediatrics 113, 1367–1374. doi: 10.1542/peds.113.5.1367
Felton, C. J. (2002). Project Liberty: a public health response to New Yorkers' mental health needs arising from the World Trade Center terrorist attacks. J. Urban Health 79, 429–433. doi: 10.1093/jurban/79.3.429
Feng, J., Lenihan, D. J., Johnson, M. M., Karri, V., and Reddy, C. V. (2006). Cardiac sequelae in Brooklyn after the September 11 terrorist attacks. Clin. Cardiol. 29, 13–17. doi: 10.1002/clc.4960290105
Garratt, A. M., Helgeland, J., and Gulbrandsen, P. (2011). Five-point scales outperform 10-point scales in a randomized comparison of item scaling for the patient experiences questionnaire. J. Clin. Epidemiol. 64, 200–207. doi: 10.1016/j.jclinepi.2010.02.016
Gupta, M. A. (2013). Review of somatic symptoms in post-traumatic stress disorder. Int. Rev. Psychiatry 25, 86–99. doi: 10.3109/09540261.2012.736367
Hargreaves, D. S., Elliott, M. N., Viner, R. M., Richmond, T. K., and Schuster, M. A. (2015). Unmet health care need in US adolescents and adult health outcomes. Pediatrics 136, 513–520. doi: 10.1542/peds.2015-0237
Jackson, C. T., Allen, G., Essock, S. M., Felton, C. J., and Donahue, S. A. (2006). Clients' satisfaction with Project Liberty counseling services. Psychiatr. Serv. 57, 1316–1319. doi: 10.1176/ps.2006.57.9.1316
Lien, E., Nafstad, P., and Rosvold, E. O. (2008). Non-western immigrants' satisfaction with the general practitioners' services in Oslo, Norway. Int. J. Equity Health 7:7. doi: 10.1186/1475-9276-7-7
Miguel-Tobal, J. J., Cano-Vindel, A., Gonzalez-Ordi, H., Iruarrizaga, I., Rudenstine, S., Vlahov, D., et al. (2006). PTSD and depression after the Madrid march 11 train bombings. J. Trauma. Stress 19, 69–80. doi: 10.1002/jts.20091
Mojtabai, R., Olfson, M., and Mechanic, D. (2002). Perceived need and help-seeking in adults with mood, anxiety, or substance use disorders. Arch. Gen. Psychiatry 59, 77–84. doi: 10.1001/archpsyc.59.1.77
Neria, Y., DiGrande, L., and Adams, B. (2011). Posttraumatic stress disorder following the September 11, 2001, terrorist attacks: a review of the literature among highly exposed populations. Am. Psychol. 66, 429–446. doi: 10.1037/a0024791
North, C. S., Nixon, S. J., Shariat, S., Mallonee, S., McMillen, J. C., Spitznagel, E. L., et al. (1999). Psychiatric disorders among survivors of the Oklahoma City Bombing. JAMA 282, 755–762. doi: 10.1001/jama.282.8.755
Norwegian Directorate of Health (2012). Learning for Better Emergency Preparedness. The Medical Response to the Terrorist Incidents of 22 July 2011. Oslo: Norwegian Directorate of Health.
Pfefferbaum, B., Sconzo, G. M., Flynn, B. W., Kearns, L. J., Doughty, D. E., Gurwitch, R. H., et al. (2003). Case finding and mental health services for children in the aftermath of the Oklahoma City bombing. J. Behav. Health Serv. Res. 30, 215–227. doi: 10.1007/BF02289809
Statistics Norway Centrality (2008). Statistics Norway Centrality Available online at: http://stabas.ssb.no/ItemsFrames.asp?ID=5285601&Language=en&VersionLevel=classversion&MenuChoice=Language
Steinberg, A. M., Brymer, M. J., Decker, K. B., and Pynoos, R. S. (2004). The University of California at Los Angeles post-traumatic stress disorder reaction index. Curr. Psychiatry Rep. 6, 96–100. doi: 10.1007/s11920-004-0048-2
Stene, L. E., and Dyb, G. (2015). Health service utilization after terrorism: a longitudinal study of survivors of the 2011 Utoya attack in Norway. BMC Health Serv. Res. 15:158. doi: 10.1186/s12913-015-0811-6
Stene, L. E., and Dyb, G. (2016). Research participation after terrorism: an open cohort study of survivors and parents after the 2011 Utoya attack in Norway. BMC Res. Notes 9:57. doi: 10.1186/s13104-016-1873-1
Strand, B. H., Dalgard, O. S., Tambs, K., and Rognerud, M. (2003). Measuring the mental health status of the Norwegian population: a comparison of the instruments SCL-25, SCL-10, SCL-5 and MHI-5 (SF-36). Nord. J. Psychiatr. 57, 113–118. doi: 10.1080/08039480310000932
Tambs, K., and Moum, T. (1993). How well can a few questionnaire items indicate anxiety and depression? Acta Psychiatr. Scand. 87, 364–367. doi: 10.1111/j.1600-0447.1993.tb03388.x
Thoresen, S., Jensen, T. K., Wentzel-Larsen, T., and Dyb, G. (2014). Social support barriers and mental health in terrorist attack survivors. J. Affect. Disord. 156, 187–193. doi: 10.1016/j.jad.2013.12.014
Tucker, P. M., Pfefferbaum, B., North, C. S., Kent, A., Burgin, C. E., Parker, D. E., et al. (2007). Physiologic reactivity despite emotional resilience several years after direct exposure to terrorism. Am. J. Psychiatry 164, 230–235. doi: 10.1176/ajp.2007.164.2.230
Walker, L. S., Beck, J. E., Garber, J., and Lambert, W. (2008). Children's somatization inventory: Psychometric properties of the revised form (CSI-24). J. Pediatr. Psychol. 34, 430–440. doi: 10.1093/jpepsy/jsn093
Whalley, M. G., and Brewin, C. R. (2007). Mental health following terrorist attacks. Br. J. Psychiatry 190, 94–96. doi: 10.1192/bjp.bp.106.026427
Keywords: health services research, healthcare quality, mass casualty incidents, disaster planning, PTSD, psychosomatic medicine
Citation: Stene LE, Wentzel-Larsen T and Dyb G (2016) Healthcare Needs, Experiences and Satisfaction after Terrorism: A Longitudinal Study of Survivors from the Utøya Attack. Front. Psychol. 7:1809. doi: 10.3389/fpsyg.2016.01809
Received: 07 August 2016; Accepted: 02 November 2016;
Published: 24 November 2016.
Edited by:Lorys Castelli, University of Turin, Italy
Reviewed by:Silvia Serino, Istituto Auxologico Italiano (IRCCS), Italy
Volker Max Perlitz, Simplana GmbH, Germany
Copyright © 2016 Stene, Wentzel-Larsen and Dyb. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Lise E. Stene, firstname.lastname@example.org