<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="review-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Comput. Sci.</journal-id>
<journal-title>Frontiers in Computer Science</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Comput. Sci.</abbrev-journal-title>
<issn pub-type="epub">2624-9898</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fcomp.2020.00027</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Computer Science</subject>
<subj-group>
<subject>Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Improving Hazard Map Comprehension for Protective Action Decision Making</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Lindell</surname> <given-names>Michael K.</given-names></name>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/820816/overview"/>
</contrib>
</contrib-group>
<aff><institution>Institute for Hazard Mitigation Planning and Research, University of Washington</institution>, <addr-line>Seattle, WA</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Roberto Ther&#x000F3;n, University of Salamanca, Spain</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Magdalena Mendez-Lopez, University of Zaragoza, Spain; Thomas John Cova, The University of Utah, United States</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Michael K. Lindell <email>mlindell&#x00040;uw.edu</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Human-Media Interaction, a section of the journal Frontiers in Computer Science</p></fn></author-notes>
<pub-date pub-type="epub">
<day>31</day>
<month>07</month>
<year>2020</year>
</pub-date>
<pub-date pub-type="collection">
<year>2020</year>
</pub-date>
<volume>2</volume>
<elocation-id>27</elocation-id>
<history>
<date date-type="received">
<day>02</day>
<month>06</month>
<year>2020</year>
</date>
<date date-type="accepted">
<day>23</day>
<month>06</month>
<year>2020</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2020 Lindell.</copyright-statement>
<copyright-year>2020</copyright-year>
<copyright-holder>Lindell</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract><p>A major challenge in the communication of spatial hazard information is the existence of substantial variation in people&#x00027;s ability to correctly infer the appropriate conclusions from hazard maps. Examination of the results from a variety of different types of hazard maps has identified patterns of erroneous as well as accurate processing of map information. In response, most hazard map studies have focused on the erroneous inferences and sought to develop displays that would cause hazard map viewers to make more accurate inferences about the hazard. This research has made some significant advances, but it has neglected the development and testing of spatial displays that can help people to make more timely and effective protective action decisions. This article concludes by summarizing the findings from hazard map research and recommending future research that will address these unresolved issues.</p></abstract>
<kwd-group>
<kwd>hazard map</kwd>
<kwd>map comprehension</kwd>
<kwd>display effects</kwd>
<kwd>proximity effect</kwd>
<kwd>protective action decision making</kwd>
<kwd>evacuation decision arc</kwd>
</kwd-group>
<counts>
<fig-count count="3"/>
<table-count count="0"/>
<equation-count count="1"/>
<ref-count count="105"/>
<page-count count="14"/>
<word-count count="12352"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>A hazard map is a common device for providing people with information about the environmental hazards to which they are exposed. Hazard maps differ in the temporal contexts that they address&#x02014;chronic hazards that will happen sometime in the future vs. acute hazards that are imminent threats. Maps of chronic hazards might be used by specialists such as land use planners, structural engineers, and emergency managers to identify geographic areas that can expect an event of a specified probability (e.g., the area inundated by a 100-year flood) or of a specific magnitude (e.g., the area expected to be affected by a Category 5 hurricane storm surge). They can use these maps to guide community hazard mitigation and emergency preparedness actions that are implemented long before an acute threat arises. In addition, authorities can use these maps to promote household emergency management actions.</p>
<p>Maps of acute hazards can be used by authorities to identify protective action recommendations (PARs) for the risk area population. That is, these maps can be used to guide decisions about who is at risk, what protective action the risk area population should take, and when they should implement those protective actions (Cova et al., <xref ref-type="bibr" rid="B20">2017</xref>). For example, coastal emergency managers use the hazard maps in HURREVAC to guide their decisions about PARs when their jurisdictions are threatened by approaching hurricanes. In turn, authorities can use acute hazard maps to communicate hazard warnings that promote appropriate household protective actions. The objective of these warnings is not only to increase compliance with PARs, but also to decrease shadow evacuation so those who are not at risk do not impede the evacuation of those who are at risk (Yin et al., <xref ref-type="bibr" rid="B103">2016</xref>; Lindell et al., <xref ref-type="bibr" rid="B54">2019a</xref>).</p>
<p>When constructing hazard maps, one might think that hazard analysts only need to draw lines in the right places on a base map and give those maps to risk area populations in order to increase their risk perceptions and, thus, their emergency preparedness for chronic threats and protective actions for acute threats. Unfortunately, that is not the case because studies dating back at least to Handmer (<xref ref-type="bibr" rid="B34">1980</xref>) have documented people&#x00027;s misunderstanding of hazard maps. Consequently, risk communicators ranging from warning meteorologists to local emergency managers need to understand the limits of people&#x00027;s comprehension of different types of hazard maps.</p>
<p>At the outset, it is important to understand that hazard maps are one of three means of communicating hazard information&#x02014;spatial, numeric, and textual. Moreover, the effects of this hazard information can be understood in terms of the Protective Action Decision Model (Lindell and Perry, <xref ref-type="bibr" rid="B56">2004</xref>, <xref ref-type="bibr" rid="B57">2012</xref>; Lindell, <xref ref-type="bibr" rid="B50">2018</xref>), which posits that a hazard map is a form of warning message that is primarily directed toward the warning receiver&#x00027;s perceptions of the threat. Once a hazard map elicits a high threat perception, the receiver is motivated to search for additional information (if the information source is not highly credible, the threat is ambiguous, or the logistics of response are uncertain) and to initiate protective action. Thus, map elements that promote these processes will be more effective in eliciting appropriate protective actions. The following sections will elaborate on these ideas by discussing indicators of map comprehension, cognitive processes in map comprehension, and cognitive abilities affecting map comprehension. The article will then review of research on people&#x00027;s comprehension of, and behavioral response to, different types of hazard maps, and conclude with a summary of research findings and recommendations for future research.</p>
</sec>
<sec id="s2">
<title>Psychological Processes in Map Utilization</title>
<sec>
<title>Indicators of Map Comprehension</title>
<p>Map comprehension can be defined as a map viewer&#x00027;s ability to draw the inferences that the map constructor intended. There are only a few studies of map comprehension that have examined the basic elements of map reading skills (Muir, <xref ref-type="bibr" rid="B75">1985</xref>; Milson and Alibrandi, <xref ref-type="bibr" rid="B70">2008</xref>; Aksoy, <xref ref-type="bibr" rid="B1">2013</xref>; Albert et al., <xref ref-type="bibr" rid="B2">2016</xref>). Specifically, (1) <italic>symbol recognition</italic> involves accurate interpretation of map symbols such as those located in the map legend, (2) <italic>direction finding</italic> is the determination of geographical directions among landmarks using a map compass, and (3) <italic>scale use</italic> involves determination of actual geographical distances among landmarks using a map scale. More sophisticated maps, such as topographical maps, require (4) <italic>contour interpretation</italic>, which is the determination of quantities such as land elevations from the location of points within contours. MacPherson-Krutsky et al. (<xref ref-type="bibr" rid="B65">2020</xref>) found differences between basic map skills (compass and scale utilization) and advanced map skills (contour interpretation) even though both require a degree of knowledge of mapping conventions and visuospatial skills. Specifically, these researchers found that experiment participants had significantly higher scores on basic map skills than on advanced map skills and the two scales had only a modest correlation (<italic>r</italic> = 0.23).</p>
</sec>
<sec>
<title>Cognitive Processes in Map Comprehension</title>
<p>Accurate interpretation of a spatial display requires viewers to see the display clearly, pay attention to relevant display features, develop &#x0201C;cognitive maps&#x0201D; (mental representations of the essential elements of a print or electronic map), and make inferences from their cognitive maps to produce judgments, make decisions, and choose actions (Hegarty, <xref ref-type="bibr" rid="B36">2011</xref>). The ability to see visual display elements clearly is affected by aspects of the map display such as the size of those elements and their number (i.e., the degree of display clutter). However, the ability to see visual display elements is also affected by personal factors such as the viewers&#x00027; visual acuity and color blindness.</p>
<p>Attention is influenced by &#x0201C;bottom-up&#x0201D; processes, in which visually salient features such as bright colors capture viewers&#x00027; attention. It is also influenced by &#x0201C;top-down&#x0201D; processes in which viewers&#x00027; expectations direct their attention to specific display elements. These expectations are determined by a viewer&#x00027;s goals, which can be externally imposed (e.g., an experimenter-assigned task to reproduce the map) or self-generated (e.g., viewers&#x00027; intentions of determining if their homes are in hazard zones). Viewers&#x00027; expectations about hazard maps are directed by schemas, also known as mental models, which are generic belief structures about entities, their attributes, and the interrelationships among those attributes (Endsley and Jones, <xref ref-type="bibr" rid="B28">2012</xref>). People can have schemas of varying comprehensiveness about maps in general and about the specific map content being displayed in particular. Accordingly, people can range in knowledge from novices (who have rudimentary schemas) to experts (who have comprehensive schemas) in each of these domains (Ooms et al., <xref ref-type="bibr" rid="B79">2014</xref>). Related to the concept of a schema is a heuristic, or simple rule, for processing situations (Tversky and Kahneman, <xref ref-type="bibr" rid="B94">1974</xref>). Although heuristics were originally conceived as suboptimal rules for decision making, subsequent research has found that they are often &#x0201C;fast and frugal&#x0201D; ways to make decisions (Gigerenzer and Goldstein, <xref ref-type="bibr" rid="B29">1996</xref>). Indeed, Keller et al. (<xref ref-type="bibr" rid="B45">2010</xref>) identified a number of heuristics that define rules for information search, information search termination, and decision making.</p>
<p>People&#x00027;s cognitive maps are affected by their training and experience (Eley, <xref ref-type="bibr" rid="B27">1993</xref>). However, there appears to be little research on the effects of these topics on map comprehension. Indeed, instruction in map interpretation is inconsistent, even in geography textbooks (Gillen et al., <xref ref-type="bibr" rid="B30">2010</xref>). A more thoroughly studied determinant of map comprehension is the viewer&#x00027;s spatial ability which, following Colom et al. (<xref ref-type="bibr" rid="B18">2002</xref>), can be defined as the ability to generate, retain, retrieve, and transform visual images. Unlike research on cognitive processes, which tends to focus on commonalities in the way that all viewers typically process map information, research on cognitive abilities tends to focus on individual differences among map viewers in the ways that they process information.</p>
<p>Multiple studies have found that individuals who have higher levels of spatial ability are better at interpreting and applying map information (Postigo and Pozo, <xref ref-type="bibr" rid="B84">2004</xref>; Hegarty et al., <xref ref-type="bibr" rid="B37">2010</xref>; Aksoy, <xref ref-type="bibr" rid="B1">2013</xref>; Ooms et al., <xref ref-type="bibr" rid="B80">2015</xref>; MacPherson-Krutsky et al., <xref ref-type="bibr" rid="B65">2020</xref>). Moreover, a number of studies report that gender influences map comprehension and spatial ability, but the evidence is mixed. For example, Lindell et al. (<xref ref-type="bibr" rid="B53">2016</xref>) and Jon et al. (<xref ref-type="bibr" rid="B43">2019</xref>), but not Jon et al. (<xref ref-type="bibr" rid="B42">2018</xref>), found that females judged tornado polygons as having significantly higher strike probabilities than males. More generally, many studies of cognitive abilities find significant gender differences, with females tending to have stronger verbal ability and males tending to have stronger spatial ability (Halpern, <xref ref-type="bibr" rid="B32">1986</xref>; Voyer et al., <xref ref-type="bibr" rid="B96">1995</xref>; Lawton and Morrin, <xref ref-type="bibr" rid="B49">1999</xref>; Montello et al., <xref ref-type="bibr" rid="B74">1999</xref>; Halpern and Collaer, <xref ref-type="bibr" rid="B33">2005</xref>). However, other reviews find weaker evidence for gender differences. Hyde and Linn (<xref ref-type="bibr" rid="B41">1988</xref>) conclude that gender differences in verbal ability are large on only a few measures; Coluccia and Louse (<xref ref-type="bibr" rid="B19">2004</xref>) conclude that gender differences are small in at least one aspect of spatial ability, spatial orientation, especially when using a map. Some recent studies attribute gender differences in spatial performance to corresponding differences in strategy use (Bosco et al., <xref ref-type="bibr" rid="B9">2004</xref>; Picucci et al., <xref ref-type="bibr" rid="B83">2011</xref>) and gender roles (Reilly et al., <xref ref-type="bibr" rid="B85">2016</xref>), both of which can be eliminated by training. Nonetheless, there is no evidence to date that gender differences in visuospatial abilities are decreasing (Halpern and Collaer, <xref ref-type="bibr" rid="B33">2005</xref>).</p>
<p>There is also consistent evidence that performance in a variety of scientific disciplines is correlated with object-scale spatial ability (Hegarty et al., <xref ref-type="bibr" rid="B37">2010</xref>; Hegarty, <xref ref-type="bibr" rid="B36">2011</xref>; Yoon and Mann, <xref ref-type="bibr" rid="B104">2017</xref>; Buckley et al., <xref ref-type="bibr" rid="B11">2018</xref>). In particular, Hegarty et al. (<xref ref-type="bibr" rid="B37">2010</xref>) reported significant differences among members of different professions in their self-reported spatial and verbal abilities using the Santa Barbara Sense of Direction Scale (SBSOD, a measure of environmental-scale spatial ability), the Philadelphia Spatial Ability Scale (PSA, a measure of object-scale spatial ability), and the Philadelphia Verbal Ability Scale (PVA, a measure of verbal ability). On the SBSOD, respondents from the physical sciences, biological sciences, geosciences, geography, and engineering scored above the mean; whereas psychology, social sciences, and humanities scored at or below the mean. On the PSA, the pattern was generally the same, although biological sciences scored below the mean. On the PVA, the pattern was the reverse of that for the SBSOD.</p>
</sec>
</sec>
<sec id="s3">
<title>Hazard maps</title>
<sec>
<title>Hazard Map Types</title>
<p>A map is an <italic>iconic</italic> spatial display, but spatial displays can also be classified relational or hybrid displays (Hegarty, <xref ref-type="bibr" rid="B36">2011</xref>). An iconic display represents spatial objects. A road map is an example of an iconic display that represents a network of roads and the locations of landmarks in a geographical area. A relational display represents non-spatial variables, such as a graph of a hurricane&#x00027;s Saffir-Simpson category plotted over time. A hybrid display combines an iconic display, such a base map, with a relational display to provide a spatial representation of non-spatial categories or quantities, as when 100 and 500-year flood zones are represented by map contours (Allen et al., <xref ref-type="bibr" rid="B3">2006</xref>).</p>
<p>In the literature on risk communication and hazard warnings, there is much more extensive research on verbal elements of warnings than on graphic displays or numeric information (Lindell, <xref ref-type="bibr" rid="B50">2018</xref>). Mileti and Sorensen (<xref ref-type="bibr" rid="B69">1990</xref>) summarized research on (primarily verbal) warnings as indicating that the most important message elements are the identity of the hazard, expected time and location of impact, protective action guidance, and identity of the warning source. Hazard maps inherently address the identity of the hazard and the location of impact, and often address the identity of the map source. However, they inherently provide an allocentric perspective of the environment, so viewers must infer their risk by being able to locate their positions on the map. By contrast, verbal warnings provide an allocentric perspective of the environment if broadcast messages only describe the risk area in terms of large-scale features (e.g., which counties are at risk of a tornado). However, they can provide an egocentric perspective of the environment if they personalize the risk (e.g., a public safety officer delivering a face-to-face warning). Unfortunately, face-to-face warnings have substantial resource requirements although more advanced technologies such as Reverse 911 can achieve personalization with lower labor demands (Lindell and Prater, <xref ref-type="bibr" rid="B59">2010</xref>; Lindell et al., <xref ref-type="bibr" rid="B54">2019a</xref>, Chapter 3).</p>
<p>In addition to the type of graphic information that makes a hazard map a hybrid display, hazard maps can contain supplementary information that is numeric (e.g., hurricane forward speed, size, and magnitude/intensity) or textual (e.g., National Hurricane Center&#x00027;s&#x02014;NHC&#x00027;s&#x02014;<italic>Hurricane Watch</italic> and <italic>Hurricane Warning</italic>). For example, information about tsunamis could include how they are generated, what are their environmental cues, how soon the first wave of a local tsunami could arrive after earthquake shaking stops, how long waves might continue to arrive, and how tsunami wave impact would affect different types of structures (Lindell et al., <xref ref-type="bibr" rid="B51">2019b</xref>). Additional information might include the types of warning sources and channels available in a given community, as well as the identity of sources of additional information and assistance.</p>
<p>One can generate a four-fold typology of hazard maps by drawing two distinctions&#x02014;whether they have non-interactive or interactive displays and whether they depict a static (chronic/potential) or dynamic (imminent/actual) hazard. Non-interactive maps, whether print or electronic, are defined by a base map and one or more predetermined features that are simultaneously overlaid onto it. By contrast, interactive maps allow the user to select which features are individually or simultaneously overlaid onto the base map. Interactive maps provide additional information while avoiding clutter that is likely to overload the viewer of a static map, although this raises the challenge of users knowing how to navigate the interactivity (Cao et al., <xref ref-type="bibr" rid="B13">2017</xref>; MacPherson-Krutsky et al., <xref ref-type="bibr" rid="B65">2020</xref>).</p>
<p>Static maps depict hazards that are, essentially, constant over time. That is, they provide information about chronic, or potential, hazards. One of the most common examples is a map of a 100-year flood plain, but maps of hurricane risk areas and tsunami evacuation zones are other examples. By contrast, dynamic hazard maps provide a base map but show how an event is changing over time (e.g., Sea Island Software <ext-link ext-link-type="uri" xlink:href="http://www.hurrevac.com/tutorials.htm">www.hurrevac.com/tutorials.htm</ext-link>; Wu et al., <xref ref-type="bibr" rid="B100">2015a</xref>). Dynamic maps, which are sometimes called animated maps (Cybulski, <xref ref-type="bibr" rid="B22">2016</xref>), can vary in the degree to which the time dimension is discrete (e.g., the 6 h intervals of National Hurricane Center Forecast Advisories) or continuous (e.g., the animation displayed in first-person shooter games).</p>
</sec>
<sec>
<title>Static/Non-interactive Maps</title>
<p>Research on static/non-interactive maps, one of the oldest areas of research on hazard maps, has found flood maps to be no more effective than a &#x0201C;100-year flood&#x0201D; label (Bell and Tobin, <xref ref-type="bibr" rid="B7">2007</xref>). This broad finding has been explored further using a variety of dependent variables such as viewer perceptions of risk, risk area accuracy, preferences for map features, misconceptions about visualizations, and effects of user characteristics on performance. One important conclusion is that people need to be able to orient themselves on the map, but studies have differed in their findings about the most effective base map for doing this. Some studies have reported user preference for aerial photographs and 3D maps with clearly labeled landmarks rather than conventional topographical contour maps (Haynes et al., <xref ref-type="bibr" rid="B35">2007</xref>; Dransch et al., <xref ref-type="bibr" rid="B23">2010</xref>; Nave et al., <xref ref-type="bibr" rid="B78">2010</xref>; Cao et al., <xref ref-type="bibr" rid="B12">2016</xref>). However, other studies have shown a preference for topographical contour maps and street maps (Van Kerkvoorde et al., <xref ref-type="bibr" rid="B95">2018</xref>). In addition, isarithmic maps produce the better understanding of uncertainty about hazard exposure than gradational shaded or binned maps (Thompson et al., <xref ref-type="bibr" rid="B93">2015</xref>; Mulder et al., <xref ref-type="bibr" rid="B76">2017</xref>). Moreover, consistent with the broader literature on map comprehension, color coding scheme and probability coding (numerical vs. verbal) also influence participants&#x00027; judgments (Thompson et al., <xref ref-type="bibr" rid="B93">2015</xref>; Van Kerkvoorde et al., <xref ref-type="bibr" rid="B95">2018</xref>). Furthermore, confusion can occur when aspects of the hazard map are poorly defined by having too many features or arbitrarily defined risk area borders (Zhang et al., <xref ref-type="bibr" rid="B105">2004</xref>; Arlikatti et al., <xref ref-type="bibr" rid="B4">2006</xref>). Hazard maps are easier to interpret if risk area borders are defined by well-recognized features such as rivers, roads, and jurisdictional boundaries than by topographical contours. However, some jurisdictions have defined their hurricane evacuation zones by postal codes because these are even easier to recognize (Wu et al., <xref ref-type="bibr" rid="B99">2020</xref>).</p>
</sec>
<sec>
<title>Static/Interactive Maps</title>
<p>In a recent study of a multi-hazard map, MacPherson-Krutsky et al. (<xref ref-type="bibr" rid="B65">2020</xref>) found that both basic and advanced map comprehension scores had significant positive correlations with scores on objective test of spatial ability, but not self-report measures. Moreover, self-reported spatial ability had statistically significant, but only moderately strong, correlations with objective spatial ability tests. Interestingly, participants&#x00027; self-assessments of their performance were significantly correlated with advanced map skill. That is, those who were better at this task were able to assess their performance and conclude that the task was easier. This metacognitive accuracy is the opposite of the Dunning-Kruger effect, in which less competent people are oblivious to their own ignorance (Dunning, <xref ref-type="bibr" rid="B26">2011</xref>). A likely explanation is that map utilization tasks provide the viewer with relatively unambiguous immediate feedback about performance.</p>
</sec>
<sec>
<title>Dynamic/Non-interactive Maps</title>
<p>Most of the studies in this category addressed a special case of dynamic maps, which is a single &#x0201C;snapshot&#x0201D; of a dynamic hazard. In addition to varying information (verbal, numeric, or spatial) about the hazard across conditions, most experiments asked participants to judge a snapshot of the hazard (e.g., strike probability) at different locations. Since successive snapshots were presented as independent observations at the same time, they are not dynamic displays in exactly the same sense as the evolution of an event over successive time periods. However, they are addressed here as a special case of dynamic maps because experimenters used these snapshots to map viewers&#x00027; perceptions of different aspects of a hazard&#x00027;s future behavior.</p>
<sec>
<title>Wildfire Maps</title>
<p>Cheong et al. (<xref ref-type="bibr" rid="B17">2016</xref>) found little difference in viewers&#x00027; performance among a simple line boundary, spectral color, color shading, black-and-white transparency, and pointillist texture representation when participants had 30 s to judge each wildfire probability map. However, under increasing time pressure, participants performed best when viewing a spectral color map and worst when viewing a text-based or simple line boundary map.</p>
<p>Cao et al. (<xref ref-type="bibr" rid="B12">2016</xref>) conducted an online survey of residents in wildfire-prone areas who viewed a hypothetical wildfire described either by text messages or maps, and then tested on their comprehension of the information, their risk perceptions, and their reactions to the mode of presentation. Additionally, the website recorded the time respondents took to interpret the information they viewed. The results showed that maps were more effective than text messages in improving comprehension, increasing risk perceptions, and producing more positive reactions.</p>
</sec>
<sec>
<title>Tornado Maps</title>
<p>There has been a significant amount of research on people&#x00027;s responses to tornado warning polygons since Lindell et al. (<xref ref-type="bibr" rid="B60">2013</xref>) reviewed the research on tornado warning response. This warning polygon research has yielded seven important findings (Nagele and Trainor, <xref ref-type="bibr" rid="B77">2012</xref>; Sherman-Morris and Brown, <xref ref-type="bibr" rid="B87">2012</xref>; Ash et al., <xref ref-type="bibr" rid="B5">2014</xref>; Mason and Senkbeil, <xref ref-type="bibr" rid="B67">2014</xref>; Casteel and Downing, <xref ref-type="bibr" rid="B16">2015</xref>; Lindell et al., <xref ref-type="bibr" rid="B53">2016</xref>; Jon et al., <xref ref-type="bibr" rid="B42">2018</xref>, <xref ref-type="bibr" rid="B43">2019</xref>). The first finding is the centroid effect&#x02014;people&#x00027;s tendency to judge the polygon centroid as the location of highest risk (Sherman-Morris and Brown, <xref ref-type="bibr" rid="B87">2012</xref>; Ash et al., <xref ref-type="bibr" rid="B5">2014</xref>; Lindell et al., <xref ref-type="bibr" rid="B53">2016</xref>; Jon et al., <xref ref-type="bibr" rid="B43">2019</xref>). This effect is particularly strong in deterministic polygon-only displays where no contextual information is given about the location of the tornadic storm cell that is the basis for issuing the warning polygon. The second finding is a proximity effect&#x02014;the degree to which <italic>p</italic><sub><italic>s</italic></sub> judgments decline with increasing distance from the tornadic storm cell rather than distance from the polygon centroid. Providing information about the location of a tornadic storm cell by displaying a radar image leads viewers recognize that there is a <italic>great</italic> threat at the near edge of the polygon (Jon et al., <xref ref-type="bibr" rid="B42">2018</xref>, <xref ref-type="bibr" rid="B43">2019</xref>). However, this proximity effect reduces, but does not eliminate the centroid effect. That is, viewers fail to recognize that there is a <italic>much greater</italic> threat at the polygon&#x00027;s near edge than at the centroid.</p>
<p>The third finding is the <italic>absence</italic> of an edge effect, the degree to which there is a threshold effect in the decrease of strike probability (<italic>p</italic><sub><italic>s</italic></sub>) judgments immediately outside the polygon&#x00027;s boundaries. Contrary to the NWS&#x00027;s intended threshold function, which is a <italic>strong</italic> edge effect, tornado polygon studies have found only a <italic>weak</italic> edge effect. That is, <italic>p</italic><sub><italic>s</italic></sub> judgments are indeed lower just outside than just inside the polygon (Ash et al., <xref ref-type="bibr" rid="B5">2014</xref>), but the decrease is only a slightly larger decrease than expected in an otherwise continuous function (Lindell et al., <xref ref-type="bibr" rid="B53">2016</xref>; Miran et al., <xref ref-type="bibr" rid="B73">2018</xref>; Jon et al., <xref ref-type="bibr" rid="B43">2019</xref>). However, it appears that the edge effect might be stronger in the storm cell&#x00027;s direction of travel, that is, along the warning polygon&#x00027;s longitudinal axis, and that lengthening the polygon changes viewers&#x00027; responses (Klockow-McClain et al., <xref ref-type="bibr" rid="B47">2020</xref>).</p>
<p>The fourth finding is a transect effect, the degree to which <italic>p</italic><sub><italic>s</italic></sub> judgments decline continuously with increasing distance from the polygon&#x00027;s longitudinal axis, even extending outside the warning polygon (Lindell et al., <xref ref-type="bibr" rid="B53">2016</xref>; Jon et al., <xref ref-type="bibr" rid="B42">2018</xref>, <xref ref-type="bibr" rid="B43">2019</xref>). Moreover, Jon et al. (<xref ref-type="bibr" rid="B42">2018</xref>) found that a deterministic polygon&#x0002B;radar display and two gradient displays (one with and the other without a radar display) exhibit a transect effect <italic>inside</italic> the polygon, in which <italic>p</italic><sub><italic>s</italic></sub> judgments decline with distance from the centerline along each transect). This internal transect effect was consistently supported on transect T2 (the transect through the centroid), consistently contradicted the hypothesis on T3 (the transect just inside the polygon&#x00027;s edge farthest from the storm cell), and was inconsistent on T1 (the transect just inside the polygon&#x00027;s edge nearest to the storm cell). Curiously, the results for the two deterministic polygon displays were identical to each other and the results for the two gradient polygon displays were also identical to each other. However, the results for the two types of displays were different from each other. The most likely explanation for this difference is that the lines in the gradient display accentuated the differences in risk between the grid cell on the centerline and the two cells adjacent to it but inside the polygon.</p>
<p>The fifth finding is there are mixed findings about a display effect&#x02014;whether there are differences among the displays and whether the displays that indicate the location of the tornadic storm cell are superior to the deterministic polygon-only display. Klockow&#x00027;s (<xref ref-type="bibr" rid="B46">2013</xref>) comparison of deterministic polygons with probabilistic polygons (which varied in their color schemes) found no significant differences among them. Similarly, Casteel and Downing&#x00027;s (<xref ref-type="bibr" rid="B16">2015</xref>) comparison of a text-only alert, text&#x0002B;NWS warning polygon, a text&#x0002B;radar image; and a text&#x0002B;warning polygon&#x0002B;radar image reported that the additional information did not produce statistically significant enhancement of the warning effectiveness. Ash et al. (<xref ref-type="bibr" rid="B5">2014</xref>) reported a significant difference between the <italic>p</italic><sub><italic>s</italic></sub> judgments of deterministic polygons and probabilistic polygons (gradient polygons using different colors or different shades of a single color) that produced weaker centroid and edge effects as compared to a deterministic polygon. Miran et al. (<xref ref-type="bibr" rid="B72">2016</xref>) reported better accuracy for displays that lacked radar images and that a four-color spectral display (red, orange, yellow, green), a four shade gray gradient display, and a four isopleth contour display were better than a four shade red gradient display&#x02014;possibly because the polygons were superimposed over the storm cell. Finally, Klockow-McClain et al. (<xref ref-type="bibr" rid="B47">2020</xref>) found that, compared to the deterministic polygon, sequential and divergent color displays had significantly lower protective action expectations at low probabilities. Overall, the results from different displays are inconsistent, suggesting display effects are either very small or very complex. If they are small, it would not make a difference what type of polygon the NWS displays in its tornado warnings. If they are very complex, further research will be needed to explain them.</p>
<p>The sixth finding concerns the degree to which <italic>p</italic><sub><italic>s</italic></sub> judgments and emotional reactions to tornado polygon displays are related to expected response actions. Indeed, <italic>p</italic><sub><italic>s</italic></sub> judgments are negatively correlated with expectations of resuming normal activities and positively correlated with expectations of information seeking, sheltering, and evacuating (Ash et al., <xref ref-type="bibr" rid="B5">2014</xref>; Lindell et al., <xref ref-type="bibr" rid="B53">2016</xref>; Jon et al., <xref ref-type="bibr" rid="B42">2018</xref>, <xref ref-type="bibr" rid="B43">2019</xref>). However, Jon et al. (<xref ref-type="bibr" rid="B43">2019</xref>) found that viewers had no general tendency to prefer one of the protective actions anywhere inside the polygon, regardless of the type of display they viewed. One possible explanation for this finding is that the participants in this study had generally low levels of experience with tornadoes, so they failed to realize the implication of their <italic>p</italic><sub><italic>s</italic></sub> judgments for the choice of protective action. Of course, behavioral expectations are not necessarily the same as actual behavior, but hurricane evacuation expectations have been found to be significantly correlated with people&#x00027;s actual evacuation behavior 2 years later (Kang et al., <xref ref-type="bibr" rid="B44">2007</xref>). Moreover, a recent statistical meta-analysis found that the results from studies of people&#x00027;s responses to hypothetical hurricane scenarios have been quite similar to those from studies of people&#x00027;s responses to actual hurricanes (Huang et al., <xref ref-type="bibr" rid="B39">2016</xref>). Thus, it is reasonable to continue experimental studies of viewers&#x00027; responses to hypothetical tornado scenarios.</p>
<p>The seventh finding concerns the degree to which <italic>p</italic><sub><italic>s</italic></sub> judgments and expected response actions are related to experiential and demographic variables. Tornado polygon studies conducted to date have reported that viewers with previous polygon experience are less likely to ignore warnings, as well as that females are less likely to ignore warnings and more likely to take protective actions. However, there is less compelling evidence regarding other experiential and demographic variables. Specifically, none of the correlations of experiential and demographic variables with <italic>p</italic><sub><italic>s</italic></sub> judgments and expected response actions Jon et al. (<xref ref-type="bibr" rid="B42">2018</xref>, <xref ref-type="bibr" rid="B43">2019</xref>) or Lindell et al. (<xref ref-type="bibr" rid="B53">2016</xref>) reported to be significant in one of these studies were also significant in either of the other two studies and none of the demographic variables were significant in Miran et al. (<xref ref-type="bibr" rid="B71">2020</xref>). These findings are consistent with studies concluding that demographic and experiential variables are inconsistent predictors of hurricane evacuation (Baker, <xref ref-type="bibr" rid="B6">1991</xref>; Huang et al., <xref ref-type="bibr" rid="B39">2016</xref>).</p>
<p>In summary, the findings from tornado polygon studies suggest that viewers use a <italic>proximity heuristic</italic> (Teigen, <xref ref-type="bibr" rid="B92">2005</xref>) that generates a perceived risk gradient in which perceived risk decreases with distance from the hazard source (Lindell and Earle, <xref ref-type="bibr" rid="B52">1983</xref>). When information about the location of a tornadic storm cell outside the polygon is unavailable, the polygon centroid is likely to be mistaken as the location of the hazard source. Thus, the warning polygon is interpreted as a single contour of constant <italic>p</italic><sub><italic>s</italic></sub>, with other contours paralleling the polygon edges&#x02014;much like a topographical contour that has the centroid as the location of maximum <italic>p</italic><sub><italic>s</italic></sub>. Conversely, information about a tornadic storm cell diminishes the centroid effect by redirecting viewers&#x00027; attention to the true hazard source at the hook echo in the storm cell. One important implication of these findings is that there is likely to be incomplete compliance with the NWS protective action recommendation (i.e., immediate shelter) in many parts of the tornado polygon. Also contrary to the NWS&#x00027;s recommendations, people are likely to take protective actions in areas beyond the tornado polygon edges. Thus, the findings from tornado polygon research are consistent with those from studies of other hazards that have revealed incomplete compliance and evacuation shadow (Lindell and Perry, <xref ref-type="bibr" rid="B56">2004</xref>, <xref ref-type="bibr" rid="B57">2012</xref>; Lindell, <xref ref-type="bibr" rid="B50">2018</xref>).</p>
</sec>
<sec>
<title>Hurricane Maps</title>
<p>Unlike tornado studies, hurricane hazard map studies have not examined a centroid effect. Although the tornado polygon and the hurricane uncertainty cone both show potential future locations of the relevant storm feature&#x02014;a tornadic hook echo or a hurricane center&#x02014;a tornado is an ephemeral feature that might not materialize from a hook echo and, thus, whose location on the tracking map is inherently uncertain. By contrast, a hurricane center is a persistent feature whose location on the tracking map is readily identifiable. However, hurricane studies have generally found evidence of a proximity effect. Specifically, reference points that are located closer to the hurricane center generally have higher ratings of likely damage than reference points that are more distant (Boone et al., <xref ref-type="bibr" rid="B8">2018</xref>; Liu L. et al., <xref ref-type="bibr" rid="B64">2019</xref>). Ruginski et al. (<xref ref-type="bibr" rid="B86">2016</xref>) also found this result, but only for the track only and ensemble displays.</p>
<p>Hurricane studies have searched for an edge effect since Broad et al. (<xref ref-type="bibr" rid="B10">2007</xref>) concluded that many people misinterpret the NHC&#x00027;s uncertainty cone associated with a hurricane&#x00027;s forecast track as indicating that there is zero probability of the track falling outside the uncertainty cone. In fact, the NHC intends the uncertainty cone to provide a 67% confidence interval around the forecast track. However, none of the hurricane studies found evidence of a strong edge effect (judgments of <italic>p</italic><sub><italic>s</italic></sub> = 0 or no damage outside the uncertainty cone) at the aggregate level. Ruginski et al. (<xref ref-type="bibr" rid="B86">2016</xref>) looked for evidence of edge effects at the individual level, but even those analyses found no evidence for a strong edge effect. Indeed, Boone et al. (<xref ref-type="bibr" rid="B8">2018</xref>) found that only 14% of their experiment participants displayed a strong edge effect outside the boundary but, even among these participants, this was accompanied by a very steep transect effect within the uncertainty cone. Another 12% of the participants displayed a weak edge effect and most of them exhibited a very steep transect effect within the uncertainty cone.</p>
<p>Like the tornado polygon studies, hurricane display studies have consistently found evidence of a transect effect. This effect is found whether the dependent variable is a judgment of <italic>p</italic><sub><italic>s</italic></sub> in eight 45 degree sectors of a 360 circle (Cox et al., <xref ref-type="bibr" rid="B21">2013</xref>; Wu et al., <xref ref-type="bibr" rid="B102">2014</xref>) or likely damage to reference points distributed along a roughly 650 km/400 mi line ahead of the current hurricane center (Ruginski et al., <xref ref-type="bibr" rid="B86">2016</xref>; Liu L. et al., <xref ref-type="bibr" rid="B63">2017</xref>; Boone et al., <xref ref-type="bibr" rid="B8">2018</xref>; Liu D. et al., <xref ref-type="bibr" rid="B62">2019</xref>). Individual level analysis in Boone et al. (<xref ref-type="bibr" rid="B8">2018</xref>) showed that 58% of their experiment participants exhibited a simple transect effect.</p>
<p>Also like the tornado studies, hurricane studies have found mixed evidence of display effects. With respect to edge and transect effects, Wu et al. (<xref ref-type="bibr" rid="B102">2014</xref>) found no differences among track only, uncertainty cone only, and track&#x0002B;cone displays, whereas Cox et al. (<xref ref-type="bibr" rid="B21">2013</xref>) found slight differences between an uncertainty cone only and an ensemble display. Ruginski et al. (<xref ref-type="bibr" rid="B86">2016</xref>) found that displays using an uncertainty cone led some viewers to conclude that the storm was intensifying, which was replicated in Padilla et al. (<xref ref-type="bibr" rid="B81">2017</xref>) Experiment 1. Padilla et al. (<xref ref-type="bibr" rid="B81">2017</xref>) Experiments 2 and 3 found that an ensemble display had the perverse effect of eliciting larger damage estimates for a reference location that was farther away from the hurricane center (i.e., a <italic>reverse</italic> proximity effect) if that location was on one of the ensemble tracks. Liu L. et al. (<xref ref-type="bibr" rid="B64">2019</xref>) studied four ensemble displays that varied in hurricane track density (7, 15, or 63 tracks), with track annotations indicating storm size and intensity either present for the 15 track display in one condition and absent from it in another condition. The 63 track display correctly produced a shallower slope for the 48 h transect than for the 24 h transect, whereas the 15 and 7 track displays incorrectly produced parallel slopes for the two transects. Moreover, the 15 track annotated display produced shallower slopes for the distance-damage relationship than the corresponding unannotated display. Compared to the unannotated display, the annotated display yielded damage judgments that were lower at the point nearest the track distribution centerline and higher at the point farthest from the centerline. In addition, damage judgments increased with annotations indicating increasing size and intensity.</p>
<p>Unlike the tornado studies, none of the hurricane studies have examined the degree to which <italic>p</italic><sub><italic>s</italic></sub> judgments or emotional reactions to hurricane displays are related to expected response actions or the degree to which <italic>p</italic><sub><italic>s</italic></sub> judgments and expected response actions are related to demographic and experiential variables.</p>
</sec>
</sec>
<sec>
<title>Dynamic/Interactive Maps</title>
<sec>
<title>Wildfire Maps</title>
<p>In research on wildfires, Drews et al. (<xref ref-type="bibr" rid="B25">2015</xref>) found that, although Incident Commanders with greater expertise searched for less information before selecting a PAR, this did not affect the quality of those decisions. In addition, participants selected less information in the second phase of the experiment, selected more dynamic information than static information in both phases of the experiment, and were more likely to recommend evacuation&#x02014;even in cases for which that was not the optimal PAR.</p>
<p>Cao et al. (<xref ref-type="bibr" rid="B13">2017</xref>) evaluated an interactive wildfire map comprising 23 elements that displayed information about current and forecast hazard conditions, fire containment status, personal location, and response guidance (PARs, closed roads, and evacuation shelters). Although participants&#x00027; ratings of different display elements as highly important (<italic>M</italic> &#x0003E; 4.5 on a 5 point scale) were necessarily associated with high levels of agreement, ratings of different display elements as less important (<italic>M</italic> &#x0003C; 4.5) were associated with extremely low levels of agreement that they were important (i.e., a uniform distribution of ratings) rather than agreement that they were unimportant.</p>
</sec>
<sec>
<title>Hurricane Maps</title>
<p>In research on hurricanes, Meyer et al. (<xref ref-type="bibr" rid="B68">2013</xref>) found that experiment participants who viewed a forecast track reported greater evacuation preparation than those who saw an uncertainty cone&#x02014;even among those located far from the predicted center path. Moreover, participants who had never experienced a hurricane were most likely to express worry about an approaching storm and fastest to undertake preparatory action.</p>
<p>Later, Wu et al. (<xref ref-type="bibr" rid="B100">2015a</xref>) conducted a process tracing analysis of participants&#x00027; dynamic decisions based on hurricane tracking maps. Participants assuming the role of a county emergency manager began by reading a training manual, the <italic>Local Official</italic>&#x00027;<italic>s Guide to Hurricane Evacuation Decision Making</italic>, which is an updated version of guidance produced by the Texas Division of Emergency Management. After reading and being tested on the Official&#x00027;s Guide, participants tracked four different hurricanes, each of which had six hurricane forecast advisories. The participants considered a variety of different sources of information&#x02014;textual, graphic, and numeric&#x02014;when tracking hurricanes. As revealed by click counts and click durations, participants&#x00027; information search strategies became more efficient over forecast advisories and with increased experience tracking the four hurricanes. These changes in the search patterns from the first to the fourth hurricane suggest that the presentation of abstract principles in the <italic>Official</italic>&#x00027;<italic>s Guide</italic> was not sufficient for them to learn how to track hurricanes efficiently but they were able to significantly improve their search efficiency with a modest amount (roughly an hour) of practice. Overall, these data indicate that information search patterns are complex and deserve greater attention in studies of dynamic decision tasks.</p>
<p>In the same experiment, Wu et al. (<xref ref-type="bibr" rid="B101">2015b</xref>) assessed participants&#x00027; <italic>p</italic><sub><italic>s</italic></sub> judgments and PARs during the four different hurricane scenarios. The results show that participants&#x00027; <italic>p</italic><sub><italic>s</italic></sub> judgments revealed significant changes in the transect effect over time. There was an increase in <italic>p</italic><sub><italic>s</italic></sub> judgments for target cities (projected landfall locations) and a decrease in <italic>p</italic><sub><italic>s</italic></sub> judgments for adjacent cities and remote cities as the hurricanes approached landfall. In addition, <italic>p</italic><sub><italic>s</italic></sub> judgments were significantly correlated with PARs. Participants also chose more PARs as hurricanes approached landfall, especially for the counties to which the participants were assigned as emergency managers. Nonetheless, they failed to choose as many PARS as appropriate, especially evacuating areas at risk of hurricane impacts. Overall, the results suggest that participants were able to utilize the available hurricane information to make reasonable <italic>p</italic><sub><italic>s</italic></sub> judgments but failed to make the appropriate inferences about the significance of those <italic>p</italic><sub><italic>s</italic></sub> judgments.</p>
<p>In response to the findings of Wu et al. (<xref ref-type="bibr" rid="B101">2015b</xref>) and Huang et al. (<xref ref-type="bibr" rid="B40">2017</xref>) examined the perceived attributes, behavioral expectations, and expected implementation timing of 11 organizational emergency response actions for a hypothetical Category 4 hurricane. The perceived attributes of the hurricane response actions were characterized by two hazard-related attributes (effectiveness for person protection and property protection) and five resource-related attributes (financial costs, required knowledge/skill, required equipment, required time/effort, and required cooperation). This study&#x00027;s data explain the findings of untimely protective action decision making in Wu et al. (<xref ref-type="bibr" rid="B101">2015b</xref>) by revealing distinctly different patterns for the expected implementation of preparatory actions and evacuation recommendations. Participants used the hazard-related and resource-related attributes to differentiate among the response actions and the expected timing of implementation. Moreover, participants&#x00027; behavioral expectations and expected implementation timing for the response actions were most strongly correlated with those actions&#x00027; effectiveness for person protection. Finally, participants reported evacuation implementation times that were consistent with a phased evacuation strategy in which risk areas are evacuated in order of their proximity to the coast. However, the late initiation of evacuation in risk areas closest to the coast would have led to very late evacuation of risk areas farther inland.</p>
<p>Sherman-Morris and Del Valle-Martinez (<xref ref-type="bibr" rid="B88">2017</xref>) addressed track uncertainty by presenting participants with track&#x0002B;uncertainty cone displays that either maintained a constant bearing or changed bearing in the second day of a 3 day scenario. This scenario addressed meteorologists&#x00027; concerns about a &#x0201C;windshield wiper&#x0201D; effect in which viewers over-react to a change in hurricane track with lower risk perceptions when the storm resumes its original bearing. Contrary to the hypothesized &#x0201C;windshield wiper&#x0201D; effect, experiment participants&#x00027; <italic>p</italic><sub><italic>s</italic></sub> judgments appeared to be based solely on the current day&#x00027;s information rather than being influenced by the fluctuations in the storm&#x00027;s heading.</p>
</sec>
</sec>
</sec>
<sec id="s4">
<title>Decision Aids For Dynamic/Interactive Maps</title>
<p>One obvious reason why the participants in the Wu et al. (<xref ref-type="bibr" rid="B101">2015b</xref>) study issued tardy PARs is that, even though the hurricane tracking displays provided information about <italic>where</italic> to initiate PARs, they lacked any graphical guides for deciding <italic>when</italic> to initiate them. As noted earlier, this issue was addressed by Cova et al. (<xref ref-type="bibr" rid="B20">2017</xref>), who suggested that emergency managers establish <italic>warning triggers</italic> to define the times that PARs should be initiated. Warning triggers address three primary questions: which locations or population segments are at risk, what is the best PAR for each location or population segment, and when should the PARs be initiated? The first question is fundamentally geographic and involves careful identification of population segments that are likely to be adversely affected (Sorensen et al., <xref ref-type="bibr" rid="B90">1992</xref>; Hsu and Peeta, <xref ref-type="bibr" rid="B38">2014</xref>). The second question involves selecting the best available PARs for different target groups (e.g., evacuate or shelter-in-place). The third question requires assessing the amount of time that target groups will need to complete their PARs before hazard impact (Sorensen, <xref ref-type="bibr" rid="B89">1991</xref>; Lindell and Prater, <xref ref-type="bibr" rid="B58">2007</xref>).</p>
<p>The first step, identification of locations at risk is illustrated in <xref ref-type="fig" rid="F1">Figure 1</xref>, which shows a hurricane approaching a coastal jurisdiction. The figure&#x00027;s right-hand side has a small circle depicting the hurricane eye, which is surrounded by a larger circle representing the radius of Tropical Storm force wind. The hurricane track is pointed toward a coastal <italic>Risk Area</italic>, which is defined by the hurricane center&#x00027;s forecast point of landfall, the distance to either side which is defined by the radius of hurricane force wind that will cause wind and surge damage, and the inland distance that there will be wind and surge damage, which is defined by hurricane intensity. There are <italic>Caution Areas</italic> adjacent to the <italic>Risk Area</italic> along the coast because of the uncertainty about the storm track and storm size, as well as inland from the <italic>Risk Area</italic> because of the uncertainty about the storm intensity.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Hurricane protective action zones [adapted from from Lindell et al. (<xref ref-type="bibr" rid="B54">2019a</xref>), with permission].</p></caption>
<graphic xlink:href="fcomp-02-00027-g0001.tif"/>
</fig>
<p>The second step, identifying the appropriate PAR for each location, involves choosing among evacuation, shelter in-place, and allowing people to continue normal activities. Evacuation is expensive and disruptive so it should be recommended only when other actions provide insufficient protection. In turn, the level of protection depends upon three fundamental criteria&#x02014;time, distance, and shielding. Evacuation addresses the first two criteria by reducing the amount of time that people are exposed to a hazard and it increases distance from the hazard source. By contrast, sheltering in-place provides shielding from a hazard by reducing the infiltration of hazardous materials into a structure (e.g., volcanic ash) or by resisting dangerous temperatures (e.g., wildfires) or pressures (e.g., tornadic wind). Evacuation is common for hurricanes striking the United States because this hazard provides sufficient forewarning to clear a risk area before hazard impact and few single family homes in coastal areas provide adequate protection from wind and surge. However, tornadoes provide insufficient time to evacuate safely, so authorities typically recommend shelter in-place (see Lindell et al., <xref ref-type="bibr" rid="B54">2019a</xref>, Chapter 3, for further discussion).</p>
<p>The third step, determination of when to issue PARs, is based on the principle that protective actions should be completed before the arrival of hazardous conditions. As <xref ref-type="fig" rid="F2">Figure 2</xref> indicates, hurricane tracking involves an initial detection stage, after which the storm continues to be monitored until it makes landfall. As the storm progresses, meteorologists make projections about landfall location, wind speed, storm surge, and rainfall that, in turn, serve as decision information for emergency managers. These emergency managers use the decision information about expected storm impacts to establish the warning triggers that address which locations or population segments are at risk, what is the best PAR for each location or population segment, and when the PARs should be initiated.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Chains of events for hurricane and community response [adapted from Lindell and Perry (<xref ref-type="bibr" rid="B55">1992</xref>), with permission].</p></caption>
<graphic xlink:href="fcomp-02-00027-g0002.tif"/>
</fig>
<p>A graphical guide for deciding when to initiate PARs can be constructed by recognizing that the time required for a resident or transient household to clear the risk area after incident initiation can be defined as a function of four Evacuation Time Estimate (ETE) components,</p>
<disp-formula id="E1"><label>(1)</label><mml:math id="M1"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mi>f</mml:mi><mml:mtext>&#x000A0;</mml:mtext><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:msub><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mi>w</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:msub><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mi>p</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mi>e</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <italic>t</italic><sub><italic>T</italic></sub> is a household&#x00027;s total clearance time, <italic>t</italic><sub><italic>d</italic></sub> is the authorities&#x00027; warning decision time, <italic>t</italic><sub><italic>w</italic></sub> is the household&#x00027;s warning receipt time, <italic>t</italic><sub><italic>p</italic></sub> is the household&#x00027;s evacuation preparation time, and <italic>t</italic><sub><italic>e</italic></sub> is the household&#x00027;s evacuation travel time (Lindell et al., <xref ref-type="bibr" rid="B54">2019a</xref>, section 3.2). As Cova et al. (<xref ref-type="bibr" rid="B20">2017</xref>) noted, authorities who have a predefined trigger for initiating an evacuation can eliminate <italic>t</italic><sub><italic>d</italic></sub>, leaving household warning receipt time, household evacuation preparation time, and household evacuation travel time. Warning receipt time and evacuation preparation time are unique values for each household but can be aggregated into distributions that show the percentage of households over time who have received a warning or completed evacuation preparations. In turn, the ETE can be converted to an <italic>evacuation decision arc</italic> by recognizing that the critical distance of the hazard from a reference point (e.g., the nearest location of the threatened population) equals rate (the forward speed of the hurricane) multiplied by time (the ETE). The left side of <xref ref-type="fig" rid="F3">Figure 3</xref> shows the hurricane Risk Area from <xref ref-type="fig" rid="F1">Figure 1</xref> with three arcs. A conventional evacuation decision arc is defined by the most likely values of the ETE for that Risk Area and the current value of the hurricane&#x00027;s forward speed (the speed at which the hurricane center is moving over the water). However, both the Risk Area&#x00027;s ETE and the hurricane&#x00027;s forward speed are quantities whose uncertainty can be represented by a <italic>minimum probable radius, most probable radius</italic>, and <italic>maximum probable radius</italic> for the evacuation decision arc. Using this display, authorities can trigger an evacuation once the hazard reaches the evacuation decision arc (Lindell et al., <xref ref-type="bibr" rid="B54">2019a</xref>, section 3.3.2). In the case of a hurricane, evacuation should begin when the radius of Tropical Storm force wind touches the evacuation decision arc that local authorities have selected. Tropical Storm force wind is a common evacuation trigger because this is the wind speed at which an evacuation could be stalled if high profile vehicles such as buses and recreational vehicles are overturned by high wind striking them from the side.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Evacuation decision arcs [reprinted from Lindell et al. (<xref ref-type="bibr" rid="B54">2019a</xref>), with permission].</p></caption>
<graphic xlink:href="fcomp-02-00027-g0003.tif"/>
</fig>
</sec>
<sec sec-type="discussion" id="s5">
<title>Discussion</title>
<p>There is strong empirical support for some conclusions about people&#x00027;s comprehension of hazard maps. First, people&#x00027;s risk judgments can be characterized by a proximity heuristic (Teigen, <xref ref-type="bibr" rid="B92">2005</xref>), which generates a perceived risk gradient that is a monotone decreasing function of distance from a hazard source (Lindell and Earle, <xref ref-type="bibr" rid="B52">1983</xref>). However, there are differences among hazards regarding the application of this heuristic because there are corresponding differences among hazards regarding the location of the hazard source with respect to contour lines drawn on a hazard map. For wildfires, the hazard source is at the fire perimeter and the principal risk area is downwind of the burn area. For hurricanes, the hazard source is within the radius of hurricane wind at the apex of the uncertainty cone and the principal risk area is along the forecast storm track. Finally, the hazard source for tornadoes is located inside the warning polygon that defines the risk area. Consequently, tornado polygons produce a centroid effect that is not found for wildfires or hurricanes. By contrast, responses to the latter two types of hazard displays exhibit a transect effect, which is a special case of the proximity effect. Instead of proximity to the current location of the hazard source, the transect effect is an outcome of proximity to the future location of the hazard source.</p>
<p>The transect effect found in laboratory experiments is consistent with the results of survey research showing that the rate of sheltering in-place in response to a tornado warning was more strongly correlated with proximity to the forecast track than being in the warning polygon (Nagele and Trainor, <xref ref-type="bibr" rid="B77">2012</xref>). Similarly, Miran et al. (<xref ref-type="bibr" rid="B73">2018</xref>) found an effect of proximity to the forecast track on protective action during the May 2013 Oklahoma City tornadoes. Finally, Krocak et al. (<xref ref-type="bibr" rid="B48">2020</xref>) found that the probability of a false-positive tornado warning perception as a function of distance from the nearest tornado warning followed an exponential decay function in which the probability declined from approximately <italic>p</italic> = 1.0 within the warning polygon to approximately <italic>p</italic> = 0.45 at 100 miles.</p>
<p>The transect effect is so strong that it substantially weakens the edge effect that the NWS intends for tornado polygons (which is different from the hurricane uncertainty cone that is only a 67% confidence interval). The weak edge effect found in tornado and hurricane display experiments is consistent with findings from the many field studies that have reported evacuation shadow&#x02014;people&#x00027;s evacuation from areas outside the evacuation zones that authorities have officially designated (see Lindell et al., <xref ref-type="bibr" rid="B54">2019a</xref>, Chapter 4). In the case of the tornado polygon, the conflict between the NWS&#x00027;s intended response (there is no need for protective action outside the polygon) and people&#x00027;s typical response is quite likely a result of cascading conservatism that arises from the absence of a clear verbal or numeric definition of the meteorologist&#x00027;s subjective probability of a tornado strike outside the polygon&#x00027;s edges (Sorensen and Mileti, <xref ref-type="bibr" rid="B91">1987</xref>). Since viewers do not know whether the tornado polygon represents a 50, 75, or 99.99% confidence interval, they are more likely to treat it as the former than the latter.</p>
<p>Display effects are difficult to summarize succinctly because different displays produce distinctive types of inferential errors. For example, it is now known that few people are susceptible to error of thinking that a hurricane cannot possibly track outside the uncertainty cone as Broad et al. (<xref ref-type="bibr" rid="B10">2007</xref>) warned. However, there does seem to be a significant proportion of viewers who mistake the uncertainty cone&#x00027;s increasing cross-section for an increase in hurricane size (Ruginski et al., <xref ref-type="bibr" rid="B86">2016</xref>; Padilla et al., <xref ref-type="bibr" rid="B81">2017</xref>). This is a potentially important finding, but it is unclear what implications, if any, this has for viewers&#x00027; protective action decision making. One possibility is that perception of an increasing hurricane size would increase spontaneous evacuation by viewers in areas on either side of a designated evacuation zone (e.g., the Caution Areas on either side of the Risk Area in <xref ref-type="fig" rid="F1">Figure 1</xref>. This possibility should be tested in future research that asks people to report their expected protective actions. Of course, there may be some discrepancies between people&#x00027;s expected protective actions and those that they take in an actual event because, as the PADM indicates, protective actions are not determined by risk perceptions alone; such actions are also affected by perceptions other stakeholders and of the alternative protective actions (Lindell and Perry, <xref ref-type="bibr" rid="B55">1992</xref>, <xref ref-type="bibr" rid="B56">2004</xref>, <xref ref-type="bibr" rid="B57">2012</xref>; Lindell, <xref ref-type="bibr" rid="B50">2018</xref>). Indeed, as Maidl and Buchecker (<xref ref-type="bibr" rid="B66">2015</xref>) found, simply distributing static/non-interactive hazard maps to a risk area population has only small impacts on hazard awareness, discussion with others, and expectations of preparedness&#x02014;let alone actual preparedness. This is undoubtedly a result of the many variables other than hazard map content that influence people&#x00027;s protective actions.</p>
<p>Another issue needing further research is the characterization of map comprehension components. MacPherson-Krutsky et al. (<xref ref-type="bibr" rid="B65">2020</xref>) characterized these as basic and advanced skills, but Cao et al. (<xref ref-type="bibr" rid="B12">2016</xref>) characterized map effectiveness dimensions as accuracy of understanding, risk perception, response time, and preference and ease of understanding. There is also a need for further research on interactive maps because an increasing number of features, such as the ability to display or suppress different data layers, increases the complexity of hazard map operation. Thus, research will be needed that can identify the most readily understandable procedures for conveying to novice users how to select and deselect different map features (Cao et al., <xref ref-type="bibr" rid="B13">2017</xref>; MacPherson-Krutsky et al., <xref ref-type="bibr" rid="B65">2020</xref>).</p>
<p>There is also a need to examine the degree to which the magnitude of transect effects in both tornado and hurricane studies are influenced by the range of points over which viewers are asked to judge hazard impacts affects the size of the transect effect. Specifically, Wu et al. (<xref ref-type="bibr" rid="B102">2014</xref>) obtained a much larger transect effect than Ruginski et al. (<xref ref-type="bibr" rid="B86">2016</xref>) almost certainly because Wu and his colleagues asked for <italic>p</italic><sub><italic>s</italic></sub> judgments in a 360 degree circle whereas Ruginski and his colleagues asked for expected damage judgments along a 650 km/400 mi line (see also Boone et al., <xref ref-type="bibr" rid="B8">2018</xref>; Liu L. et al., <xref ref-type="bibr" rid="B64">2019</xref>). This suggests that the range of response options offered to novice map viewers acts as a subtle cue to the range of hazard impacts. A related issue concerns the degree to which the findings from hazard map experiments generalize to risk area residents because most tornado and hurricane displays have obtained <italic>p</italic><sub><italic>s</italic></sub> and damage judgments at experimenter-selected locations on a map. However, many risk area residents cannot identify their locations on a map (Zhang et al., <xref ref-type="bibr" rid="B105">2004</xref>; Arlikatti et al., <xref ref-type="bibr" rid="B4">2006</xref>), so there is a need for hazard map displays to identify the location of the hazard and the viewer (Liu B. F. et al., <xref ref-type="bibr" rid="B61">2017</xref>).</p>
<p>Future research should also examine the possibility that training can correct misconceptions about hazard map displays by identifying commonly held erroneous beliefs and seeking to correct them (e.g., Whitney et al., <xref ref-type="bibr" rid="B98">2004</xref>). In particular, it is important to determine if training can suppress the centroid effect in <italic>p</italic><sub><italic>s</italic></sub> judgments about tornado polygons. For example, researchers might try to see if warning people about the centroid effect during simulated TV broadcasts of tornado polygons would accomplish this aim. However, such warnings might have limited effect because Boone et al. (<xref ref-type="bibr" rid="B8">2018</xref>) reported that training had limited success in correcting the misconception that the expanding uncertainty cone indicates increasing hurricane size. Research on hazard map training should also examine viewers&#x00027; metacognition because the accuracy of people&#x00027;s insight into their map comprehension skills is likely to affect their training motivation (Gully and Chen, <xref ref-type="bibr" rid="B31">2010</xref>).</p>
<p>Another direction of future research is to expand the types of displays that are studied. Hurricane display research conducted to date has emphasized alternatives or supplements to the forecast track, such as the uncertainty cone and the ensemble display. However, there has been no research on the forecast wind swath, which is defined by the locations that could be subjected to hurricane force wind rather the locations through which the hurricane center could pass (which is the definition of the uncertainty cone). Because the wind swath provides a better representation of the locations at risk, it is likely to elicit better compliance with evacuation PARs (Mileti and Sorensen, <xref ref-type="bibr" rid="B69">1990</xref>; Lindell, <xref ref-type="bibr" rid="B50">2018</xref>). Research on hurricane displays might also follow the lead of tornado polygon studies in examining the effect of presenting hurricane radar images, which provide graphic displays of storm size and intensity. This information could have the positive effect of increasing evacuation expectations in risk areas advised to evacuate, but might also have the negative effect of increasing shadow evacuation from inland areas that are not advised to evacuate.</p>
<p>Another suggestion derived from tornado polygon research would be to see if providing impact-based warnings to hurricane risk areas would increase compliance with evacuation PARs in the same way that these warnings increase shelter in-place for tornadoes (Casteel, <xref ref-type="bibr" rid="B14">2016</xref>, <xref ref-type="bibr" rid="B15">2018</xref>). Such studies will need to carefully examine different verbal, numeric, and visual ways of describing impacts because the wording of a Hurricane Ike warning predicting &#x0201C;certain death&#x0201D; for those who failed to evacuation seems to have had no effect on evacuation rates (Wei et al., <xref ref-type="bibr" rid="B97">2014</xref>).</p>
<p>The Cao et al. (<xref ref-type="bibr" rid="B13">2017</xref>) display of expected fire front arrival times suggests that displaying Tropical Storm force wind arrival times at different locations might also be useful. This information would be consistent with warning researchers&#x00027; recommendations to provide information about the expected time of impact so viewers know when to begin evacuation preparations (Mileti and Sorensen, <xref ref-type="bibr" rid="B69">1990</xref>; Lindell, <xref ref-type="bibr" rid="B50">2018</xref>). In addition, hurricane and wildfires displays could be improved by adding evacuation decision arcs that inform viewers when they should leave their homes to ensure that they reach safety before hazardous conditions arrive (Lindell and Prater, <xref ref-type="bibr" rid="B58">2007</xref>; Cova et al., <xref ref-type="bibr" rid="B20">2017</xref>). Such displays could overcome the deficiencies in PAR selection observed in Wu et al. (<xref ref-type="bibr" rid="B101">2015b</xref>).</p>
<p>Cao et al. (<xref ref-type="bibr" rid="B13">2017</xref>) advocated providing dynamic/interactive wildfire hazard maps viewers with interactive controls so viewers can select the elements that are most important to them. For example, they recommended additional spatial information (e.g., fire location, containment status, current and forecast wind conditions, and fire spread prediction) and textual information (e.g., well-known landmarks, names of jurisdiction subject to PARs, roads that have been closed, and names and addresses of community shelters). However, this calls attention to the need for research into intuitive interface design that relies on viewers&#x00027; immediate understanding of features such as locating their home on the map, manipulating map layers, accessing non-spatial information, and adjusting the map scale.</p>
<p>In addition, researchers should identify ways to assist risk area residents in focusing their attention on the display elements that the experts judge to be most important. For example, researchers might follow the example of Drews et al. (<xref ref-type="bibr" rid="B24">2014</xref>, <xref ref-type="bibr" rid="B25">2015</xref>) in asking expert Incident Commanders to identify the critical variables that should receive the most attention when selecting PARs. One possibility might be to design interfaces so the most important variables are default options. This would allow novice viewers to use the displays with minimal or no training, yet allow more advanced viewers to access additional information. In addition, novice decision makers could be provided with simplified instruction manuals and train on multiple scenarios until they reach proficiency. Unfortunately, this type of training is not feasible for risk area residents and even less feasible for tourists who are visiting the area for only a short duration. Instead, these population segments need well-designed static/non-interactive hazard maps, as well alternatives to maps such as prominent markers at hazard zone boundaries in the community.</p>
<p>Finally, future research on hazard maps should also examine the effects of hazard zone residence, map experience, cognitive variables such as spatial ability, and demographic variables. For example, these studies should examine the extent to which the findings from experiments using convenience samples generalize to risk area residents that have greater levels of hazard knowledge. In addition, researchers should examine people&#x00027;s responses to understudied hazards such as wildfires because most of the articles on wildfire visualization describes specific wildfire hazard maps (e.g., Liu D. et al., <xref ref-type="bibr" rid="B62">2019</xref>) or wildfire decision support systems (e.g., Pence and Zimmerman, <xref ref-type="bibr" rid="B82">2011</xref>). There is also a need to study floods and hazardous materials releases to see if they elicit responses that differ from those of the more extensively studied hazards reviewed here.</p>
</sec>
<sec id="s6">
<title>Author Contributions</title>
<p>ML reviewed the literature and prepared the manuscript.</p>
</sec>
<sec id="s7">
<title>Conflict of Interest</title>
<p>The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aksoy</surname> <given-names>B.</given-names></name></person-group> (<year>2013</year>). <article-title>Investigation of mapping skills of pre-service teachers as regards to various parameters</article-title>. <source>Educ. Res. Rev.</source> <volume>8</volume>, <fpage>134</fpage>&#x02013;<lpage>143</lpage>. <pub-id pub-id-type="doi">10.5897/ERR12.221</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Albert</surname> <given-names>G.</given-names></name> <name><surname>Ily&#x000E9;s</surname> <given-names>V.</given-names></name> <name><surname>Kis</surname> <given-names>D.</given-names></name> <name><surname>Szigeti</surname> <given-names>C.</given-names></name> <name><surname>V&#x000E1;rkonyi</surname> <given-names>D.</given-names></name></person-group> (<year>2016</year>). <article-title>Testing the map reading skills of university students</article-title>, in <source>6th International Conference on Cartography and GIS</source> (<publisher-loc>Albena</publisher-loc>), <fpage>188</fpage>&#x02013;<lpage>199</lpage>.</citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Allen</surname> <given-names>G. L.</given-names></name> <name><surname>Miller Cowan</surname> <given-names>C. R.</given-names></name> <name><surname>Power</surname> <given-names>H.</given-names></name></person-group> (<year>2006</year>). <article-title>Acquiring information from simple weather maps: influences of domain specific knowledge and general visual-spatial abilities</article-title>. <source>Learn. Individ. Differ</source>. <volume>16</volume>, <fpage>337</fpage>&#x02013;<lpage>349</lpage>. <pub-id pub-id-type="doi">10.1016/j.lindif.2007.01.003</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Arlikatti</surname> <given-names>S.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Prater</surname> <given-names>C. S.</given-names></name> <name><surname>Zhang</surname> <given-names>Y.</given-names></name></person-group> (<year>2006</year>). <article-title>Risk area accuracy and hurricane evacuation expectations of coastal residents</article-title>. <source>Environ. Behav.</source> <volume>38</volume>, <fpage>226</fpage>&#x02013;<lpage>247</lpage>. <pub-id pub-id-type="doi">10.1177/0013916505277603</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ash</surname> <given-names>K. D.</given-names></name> <name><surname>Schumann</surname> <given-names>I. I. I. R. L</given-names></name> <name><surname>Bowser</surname> <given-names>G. C.</given-names></name></person-group> (<year>2014</year>). <article-title>Tornado warning trade-offs: evaluating choices for visually communicating risk</article-title>. <source>Wea. Climate</source> Soc. <volume>6</volume>, <fpage>104</fpage>&#x02013;<lpage>118</lpage>. <pub-id pub-id-type="doi">10.1175/WCAS-D-13-00021.1</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baker</surname> <given-names>E. J.</given-names></name></person-group> (<year>1991</year>). <article-title>Hurricane evacuation behavior</article-title>. <source>Int. J. Mass Emerg. Disasters</source> <volume>9</volume>, <fpage>287</fpage>&#x02013;<lpage>310</lpage>.</citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bell</surname> <given-names>H. M.</given-names></name> <name><surname>Tobin</surname> <given-names>G. A.</given-names></name></person-group> (<year>2007</year>). <article-title>Efficient and effective? The 100-year flood in the communication and perception of flood risk</article-title>. <source>Environ. Hazards</source> <volume>7</volume>, <fpage>302</fpage>&#x02013;<lpage>311</lpage>, <pub-id pub-id-type="doi">10.1016/j.envhaz.2007.08.004</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Boone</surname> <given-names>A. P.</given-names></name> <name><surname>Gunalp</surname> <given-names>P.</given-names></name> <name><surname>Hegarty</surname> <given-names>M.</given-names></name></person-group> (<year>2018</year>). <article-title>Explicit versus actionable knowledge: the influence of explaining graphical conventions on interpretation of hurricane forecast visualizations</article-title>. <source>J. Exp. Psychol. Appl</source>. <volume>24</volume>, <fpage>275</fpage>&#x02013;<lpage>295</lpage>. <pub-id pub-id-type="doi">10.1037/xap0000166</pub-id><pub-id pub-id-type="pmid">29963882</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bosco</surname> <given-names>A.</given-names></name> <name><surname>Longoni</surname> <given-names>A. M.</given-names></name> <name><surname>Vecchi</surname> <given-names>T.</given-names></name></person-group> (<year>2004</year>). <article-title>Gender effects in spatial orientation: cognitive profiles and mental strategies</article-title>. <source>Appl. Cogn. Psychol</source>. <volume>18</volume>, <fpage>519</fpage>&#x02013;<lpage>532</lpage>. <pub-id pub-id-type="doi">10.1002/acp.1000</pub-id><pub-id pub-id-type="pmid">20676381</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Broad</surname> <given-names>K.</given-names></name> <name><surname>Leiserowitz</surname> <given-names>A.</given-names></name> <name><surname>Weinkle</surname> <given-names>J.</given-names></name> <name><surname>Steketee</surname> <given-names>M.</given-names></name></person-group> (<year>2007</year>). <article-title>Misinterpretations of the cone of uncertainty in Florida during the 2004 hurricane season</article-title>. <source>Bull. Am. Meteorol. Soc</source>. <volume>88</volume>, <fpage>651</fpage>&#x02013;<lpage>668</lpage>. <pub-id pub-id-type="doi">10.1175/BAMS-88-5-651</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buckley</surname> <given-names>J.</given-names></name> <name><surname>Seery</surname> <given-names>N.</given-names></name> <name><surname>Canty</surname> <given-names>D.</given-names></name></person-group> (<year>2018</year>). <article-title>A heuristic framework of spatial ability: a review and synthesis of spatial factor literature to support its translation into STEM education</article-title>. <source>Educ. Psychol. Rev</source>. <volume>30</volume>, <fpage>947</fpage>&#x02013;<lpage>972</lpage>. <pub-id pub-id-type="doi">10.1007/s10648-018-9432-z</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cao</surname> <given-names>Y.</given-names></name> <name><surname>Boruff</surname> <given-names>B. J.</given-names></name> <name><surname>Mcneill</surname> <given-names>I. M.</given-names></name></person-group> (<year>2016</year>). <article-title>Is a picture worth a thousand words? Evaluating the effectiveness of maps for delivering wild fire warning information</article-title>. <source>Int. J. Disaster Risk Reduct.</source> <volume>19</volume>, <fpage>179</fpage>&#x02013;<lpage>196</lpage>, <pub-id pub-id-type="doi">10.1016/j.ijdrr.2016.08.012</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cao</surname> <given-names>Y.</given-names></name> <name><surname>Boruff</surname> <given-names>B. J.</given-names></name> <name><surname>McNeill</surname> <given-names>I. M.</given-names></name></person-group> (<year>2017</year>). <article-title>The smoke is rising but where is the fire? Exploring effective online map design for wildfire warnings</article-title>. <source>Nat. Hazards</source> <volume>88</volume>, <fpage>1473</fpage>&#x02013;<lpage>1501</lpage>. <pub-id pub-id-type="doi">10.1007/s11069-017-2929-9</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Casteel</surname> <given-names>M. A.</given-names></name></person-group> (<year>2016</year>). <article-title>Communicating increased risk: an empirical investigation of the National Weather Service&#x00027;s impact-based warnings</article-title>. <source>Wea. Climate Soc</source>. <volume>8</volume>, <fpage>219</fpage>&#x02013;<lpage>232</lpage>. <pub-id pub-id-type="doi">10.1175/WCAS-D-15-0044.1</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Casteel</surname> <given-names>M. A.</given-names></name></person-group> (<year>2018</year>). <article-title>An empirical assessment of impact based tornado warnings on shelter in place decisions</article-title>. <source>Int. J. Disaster Risk Reduct.</source> <volume>30</volume>, <fpage>25</fpage>&#x02013;<lpage>33</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijdrr.2018.01.036</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Casteel</surname> <given-names>M. A.</given-names></name> <name><surname>Downing</surname> <given-names>J. R.</given-names></name></person-group> (<year>2015</year>). <article-title>Assessing risk following a wireless emergency alert: are 90 characters enough?</article-title> <source>J. Homeland Secur. Emerg. Manage</source>. <volume>13</volume>, <fpage>95</fpage>&#x02013;<lpage>112</lpage>. <pub-id pub-id-type="doi">10.1515/jhsem-2015-0024</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cheong</surname> <given-names>L.</given-names></name> <name><surname>Bleisch</surname> <given-names>S.</given-names></name> <name><surname>Kealy</surname> <given-names>A.</given-names></name> <name><surname>Tolhurst</surname> <given-names>K.</given-names></name> <name><surname>Wilkening</surname> <given-names>T.</given-names></name> <name><surname>Duckham</surname> <given-names>M.</given-names></name></person-group> (<year>2016</year>). <article-title>Evaluating the impact of visualization of wildfire hazard upon decision-making under uncertainty</article-title>. <source>Int. J. Geogr. Inf. Sci</source>. <volume>30</volume>, <fpage>1377</fpage>&#x02013;<lpage>1404</lpage>. <pub-id pub-id-type="doi">10.1080/13658816.2015.1131829</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Colom</surname> <given-names>R.</given-names></name> <name><surname>Contreras</surname> <given-names>M. J.</given-names></name> <name><surname>Botella</surname> <given-names>J.</given-names></name> <name><surname>Santacreu</surname> <given-names>J.</given-names></name></person-group> (<year>2002</year>). <article-title>Vehicles of spatial ability</article-title>. <source>Pers. Individ. Dif</source>. <volume>32</volume>, <fpage>903</fpage>&#x02013;<lpage>912</lpage>. <pub-id pub-id-type="doi">10.1016/S0191-8869(01)00095-2</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Coluccia</surname> <given-names>E.</given-names></name> <name><surname>Louse</surname> <given-names>G.</given-names></name></person-group> (<year>2004</year>). <article-title>Gender differences in spatial orientation: a review</article-title>. <source>J. Environ. Psychol</source>. <volume>24</volume>, <fpage>329</fpage>&#x02013;<lpage>340</lpage>. <pub-id pub-id-type="doi">10.1016/j.jenvp.2004.08.006</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cova</surname> <given-names>T. J.</given-names></name> <name><surname>Dennison</surname> <given-names>P. E.</given-names></name> <name><surname>Li</surname> <given-names>D.</given-names></name> <name><surname>Drews</surname> <given-names>F. A.</given-names></name> <name><surname>Siebeneck</surname> <given-names>L. K.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name></person-group> (<year>2017</year>). <article-title>Warning triggers in environmental hazards: who should be warned to do what and when?</article-title> <source>Risk Anal.</source> <volume>37</volume>, <fpage>601</fpage>&#x02013;<lpage>611</lpage>. <pub-id pub-id-type="doi">10.1111/risa.12651</pub-id><pub-id pub-id-type="pmid">27409767</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cox</surname> <given-names>J.</given-names></name> <name><surname>House</surname> <given-names>D.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name></person-group> (<year>2013</year>). <article-title>Visualizing uncertainty in predicted hurricane tracks</article-title>. <source>Int. J. Uncertain. Quantif.</source> <volume>3</volume>, <fpage>143</fpage>&#x02013;<lpage>156</lpage>. <pub-id pub-id-type="doi">10.1615/Int.J.UncertaintyQuantification.2012003966</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cybulski</surname> <given-names>P.</given-names></name></person-group> (<year>2016</year>). <article-title>Design rules and practices for animated maps online</article-title>. <source>J. Spat. Sci.</source> <volume>61</volume>, <fpage>461</fpage>&#x02013;<lpage>471</lpage>. <pub-id pub-id-type="doi">10.1080/14498596.2016.1147394</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dransch</surname> <given-names>D.</given-names></name> <name><surname>Rotzoll</surname> <given-names>H.</given-names></name> <name><surname>Poser</surname> <given-names>K.</given-names></name></person-group> (<year>2010</year>). <article-title>The contribution of maps to the challenges of risk communication to the public</article-title>. <source>Int. J. Digit. Earth</source> <volume>3</volume>, <fpage>292</fpage>&#x02013;<lpage>311</lpage>, <pub-id pub-id-type="doi">10.1080/17538941003774668</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Drews</surname> <given-names>F. A.</given-names></name> <name><surname>Musters</surname> <given-names>A.</given-names></name> <name><surname>Siebeneck</surname> <given-names>L. K.</given-names></name> <name><surname>Cova</surname> <given-names>T. J.</given-names></name></person-group> (<year>2014</year>). <article-title>Environmental factors that influence wildfire protective-action recommendations</article-title>. <source>Int. J. Emerg. Manage</source>. <volume>10</volume>, <fpage>153</fpage>&#x02013;<lpage>168</lpage>. <pub-id pub-id-type="doi">10.1504/IJEM.2014.066187</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Drews</surname> <given-names>F. A.</given-names></name> <name><surname>Siebeneck</surname> <given-names>L.</given-names></name> <name><surname>Cova</surname> <given-names>T.</given-names></name></person-group> (<year>2015</year>). <article-title>Information search and decision making in computer-based wildfire simulations</article-title>. <source>J. Cogn. Eng. Decis. Making</source> <volume>9</volume>, <fpage>229</fpage>&#x02013;<lpage>240</lpage>. <pub-id pub-id-type="doi">10.1177/1555343415586478</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Dunning</surname> <given-names>D.</given-names></name></person-group> (<year>2011</year>). <article-title>The Dunning&#x02013;Kruger effect: on being ignorant of one&#x00027;s own ignorance</article-title>, in <source>Advances in Experimental Social Psychology</source>, <volume>Vol. 44</volume>, eds J.M. Olson, and M.P. Zanna (<publisher-loc>San Diego, CA: Academic Press</publisher-loc>), <fpage>247</fpage>&#x02013;<lpage>296</lpage>. <pub-id pub-id-type="doi">10.1016/B978-0-12-385522-0.00005-6</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eley</surname> <given-names>M. G.</given-names></name></person-group> (<year>1993</year>). <article-title>The differential susceptibility of topographic map interpretation to influence from training</article-title>. <source>Appl. Cogn. Psychol</source>. <volume>7</volume>, <fpage>23</fpage>&#x02013;<lpage>42</lpage>. <pub-id pub-id-type="doi">10.1002/acp.2350070104</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Endsley</surname> <given-names>M. R.</given-names></name> <name><surname>Jones</surname> <given-names>D. G.</given-names></name></person-group> (<year>2012</year>). <source>Designing for Situation Awareness: An Approach to User-Centered Design, 2nd Edn</source>. <publisher-loc>Boca Raton, FL</publisher-loc>: <publisher-name>CRC Press</publisher-name>.</citation></ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gigerenzer</surname> <given-names>G.</given-names></name> <name><surname>Goldstein</surname> <given-names>D. G.</given-names></name></person-group> (<year>1996</year>). <article-title>Reasoning the fast and frugal way: models of bounded rationality</article-title>. <source>Psychol. Rev</source>. <volume>103</volume>, <fpage>650</fpage>&#x02013;<lpage>669</lpage>. <pub-id pub-id-type="doi">10.1037/0033-295X.103.4.650</pub-id><pub-id pub-id-type="pmid">8888650</pub-id></citation></ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gillen</surname> <given-names>J.</given-names></name> <name><surname>Skryzhevska</surname> <given-names>L.</given-names></name> <name><surname>Henry</surname> <given-names>M. C.</given-names></name> <name><surname>Green</surname> <given-names>J.</given-names></name></person-group> (<year>2010</year>). <article-title>Map interpretation instruction in introductory textbooks: a preliminary investigation</article-title>. <source>J. Geogr.</source> <volume>109</volume>, <fpage>181</fpage>&#x02013;<lpage>189</lpage>. <pub-id pub-id-type="doi">10.1080/00221341.2010.501381</pub-id></citation></ref>
<ref id="B31">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Gully</surname> <given-names>S.</given-names></name> <name><surname>Chen</surname> <given-names>G.</given-names></name></person-group> (<year>2010</year>). <article-title>Individual differences, attribute-treatment interactions, and training outcomes</article-title>, in <source>Learning, Training, And Development in Organizations</source>, eds S.W.J. Kozlowski, and E. Salas (<publisher-loc>New York, NY: Routledge</publisher-loc>), <fpage>3</fpage>&#x02013;<lpage>64</lpage>.<pub-id pub-id-type="pmid">11924540</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Halpern</surname> <given-names>D. F.</given-names></name></person-group> (<year>1986</year>). <source>Sex Differences in Cognitive Abilities</source>. <publisher-loc>Hillsdale NJ</publisher-loc>: <publisher-name>Erlbaum</publisher-name>.</citation></ref>
<ref id="B33">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Halpern</surname> <given-names>D. F.</given-names></name> <name><surname>Collaer</surname> <given-names>M. L.</given-names></name></person-group> (<year>2005</year>). <article-title>Sex differences in visuospatial abilities: more than meets the eye</article-title>, in <source>The Cambridge Handbook of Visuospatial Thinking</source>, eds P. Shah, and A. Miyake (<publisher-loc>New York, NY: Cambridge University Press</publisher-loc>), <fpage>170</fpage>&#x02013;<lpage>212</lpage>. <pub-id pub-id-type="doi">10.1017/CBO9780511610448.006</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Handmer</surname> <given-names>J. W.</given-names></name></person-group> (<year>1980</year>). <article-title>Flood hazard maps as public information: an assessment within the context of the Canadian flood damage reduction program</article-title>. <source>Can. Water Resour. J</source>. <volume>5</volume>, <fpage>82</fpage>&#x02013;<lpage>110</lpage>. <pub-id pub-id-type="doi">10.4296/cwrj0504082</pub-id></citation></ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Haynes</surname> <given-names>K.</given-names></name> <name><surname>Barclay</surname> <given-names>J.</given-names></name> <name><surname>Pidgeon</surname> <given-names>N.</given-names></name></person-group> (<year>2007</year>). <article-title>Volcanic hazard communication using maps: an evaluation of their effectiveness</article-title>. <source>Bull. Volcanol</source>. <volume>70</volume>, <fpage>123</fpage>&#x02013;<lpage>138</lpage>. <pub-id pub-id-type="doi">10.1007/s00445-007-0124-7</pub-id></citation></ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hegarty</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>The cognitive science of visual-spatial displays: implications for design</article-title>. <source>Top. Cogn. Sci</source>. <volume>3</volume>, <fpage>446</fpage>&#x02013;<lpage>474</lpage>. <pub-id pub-id-type="doi">10.1111/j.1756-8765.2011.01150.x</pub-id><pub-id pub-id-type="pmid">25164399</pub-id></citation></ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hegarty</surname> <given-names>M.</given-names></name> <name><surname>Crookes</surname> <given-names>R. D.</given-names></name> <name><surname>Dara-Abrams</surname> <given-names>D.</given-names></name> <name><surname>Shipley</surname> <given-names>T. F.</given-names></name></person-group> (<year>2010</year>). <article-title>Do all science disciplines rely on spatial abilities? Preliminary evidence from self-report questionnaires</article-title>. <source>Lect. Notes Comput. Sci.</source> <volume>6222</volume>, <fpage>85</fpage>&#x02013;<lpage>94</lpage>, <pub-id pub-id-type="doi">10.1007/978-3-642-14749-4_10</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hsu</surname> <given-names>Y.-T.</given-names></name> <name><surname>Peeta</surname> <given-names>S.</given-names></name></person-group> (<year>2014</year>). <article-title>Risk-based spatial zone determination problem for stage-based evacuation operations</article-title>. <source>Transp. Res. C Emerg. Technol.</source> <volume>41</volume>, <fpage>73</fpage>&#x02013;<lpage>89</lpage>. <pub-id pub-id-type="doi">10.1016/j.trc.2014.01.013</pub-id></citation></ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huang</surname> <given-names>S.-K.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Prater</surname> <given-names>C. S.</given-names></name></person-group> (<year>2016</year>). <article-title>Who leaves and who stays? A review and statistical meta-analysis of hurricane evacuation studies</article-title>. <source>Environ. Behav.</source> <volume>48</volume>, <fpage>991</fpage>&#x02013;<lpage>1029</lpage>. <pub-id pub-id-type="doi">10.1177/0013916515578485</pub-id></citation></ref>
<ref id="B40">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huang</surname> <given-names>S.-K.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Wei</surname> <given-names>H.-L.</given-names></name> <name><surname>Samuelson</surname> <given-names>C. D.</given-names></name></person-group> (<year>2017</year>). <article-title>Perceptions, behavioral expectations, and implementation timing for response actions in a hurricane emergency</article-title>. <source>Nat. Hazards</source> <volume>88</volume>, <fpage>533</fpage>&#x02013;<lpage>558</lpage>. <pub-id pub-id-type="doi">10.1007/s11069-017-2877-4</pub-id></citation></ref>
<ref id="B41">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hyde</surname> <given-names>J. S.</given-names></name> <name><surname>Linn</surname> <given-names>M. C.</given-names></name></person-group> (<year>1988</year>). <article-title>Gender differences in verbal ability: a meta-analysis</article-title>. <source>Psychol. Bull</source>. <volume>104</volume>:<fpage>53</fpage>. <pub-id pub-id-type="doi">10.1037/0033-2909.104.1.53</pub-id></citation></ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jon</surname> <given-names>I.</given-names></name> <name><surname>Huang</surname> <given-names>S.-K.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name></person-group> (<year>2018</year>). <article-title>Perceptions and reactions to tornado warning polygons: would a gradient polygon be useful?</article-title> <source>Int. J. Disaster Risk Reduct.</source> <volume>30</volume>, <fpage>132</fpage>&#x02013;<lpage>144</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijdrr.2018.01.035</pub-id></citation></ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jon</surname> <given-names>I.</given-names></name> <name><surname>Huang</surname> <given-names>S.-K.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name></person-group> (<year>2019</year>). <article-title>Perceptions and expected immediate reactions to severe storm displays</article-title>. <source>Risk Anal.</source> <volume>39</volume>, <fpage>274</fpage>&#x02013;<lpage>290</lpage>. <pub-id pub-id-type="doi">10.1111/risa.12896</pub-id><pub-id pub-id-type="pmid">29119587</pub-id></citation></ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kang</surname> <given-names>J. E.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Prater</surname> <given-names>C. S.</given-names></name></person-group> (<year>2007</year>). <article-title>Hurricane evacuation expectations and actual behavior in Hurricane Lili</article-title>. <source>J. Appl. Soc. Psychol.</source> <volume>37</volume>, <fpage>881</fpage>&#x02013;<lpage>897</lpage>. <pub-id pub-id-type="doi">10.1111/j.1559-1816.2007.00191.x</pub-id></citation></ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Keller</surname> <given-names>N.</given-names></name> <name><surname>Cokely</surname> <given-names>E. T.</given-names></name> <name><surname>Katsikopoulos</surname> <given-names>K. V.</given-names></name> <name><surname>Wegwarth</surname> <given-names>O.</given-names></name></person-group> (<year>2010</year>). <article-title>Naturalistic heuristics for decision making</article-title>. <source>J. Cogn. Eng. Decis. Mak.</source> <volume>4</volume>, <fpage>256</fpage>&#x02013;<lpage>274</lpage>. <pub-id pub-id-type="doi">10.1518/155534310X12844000801168</pub-id></citation></ref>
<ref id="B46">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Klockow</surname> <given-names>K. E.</given-names></name></person-group> (<year>2013</year>). <source>Spatializing Tornado Warning Lead-Time: Risk Perception and Response in a Spatio-Temporal Framework</source>. <publisher-loc>Norman OK</publisher-loc>: <publisher-name>The University of Oklahoma</publisher-name>.</citation></ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Klockow-McClain</surname> <given-names>K. E.</given-names></name> <name><surname>McPherson</surname> <given-names>R. A.</given-names></name> <name><surname>Thomas</surname> <given-names>R. P.</given-names></name></person-group> (<year>2020</year>). <article-title>Cartographic design for improved decision making: trade-offs in uncertainty visualization for tornado threats</article-title>. <source>Ann. Am. Assoc. Geogr.</source> <volume>110</volume>, <fpage>314</fpage>&#x02013;<lpage>333</lpage>. <pub-id pub-id-type="doi">10.1080/24694452.2019.1602467</pub-id></citation></ref>
<ref id="B48">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Krocak</surname> <given-names>M. J.</given-names></name> <name><surname>Ernst</surname> <given-names>S.</given-names></name> <name><surname>Allan</surname> <given-names>J. N.</given-names></name> <name><surname>Wehde</surname> <given-names>W.</given-names></name> <name><surname>Ripberger</surname> <given-names>J. T.</given-names></name> <name><surname>Silva</surname> <given-names>C. L.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Thinking outside the polygon: a study of tornado warning perception outside of warning polygon bounds</article-title>. <source>Nat. Hazards</source> <volume>102</volume>, <fpage>1351</fpage>&#x02013;<lpage>1368</lpage>. <pub-id pub-id-type="doi">10.1007/s11069-020-03970-5</pub-id></citation></ref>
<ref id="B49">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lawton</surname> <given-names>C. A.</given-names></name> <name><surname>Morrin</surname> <given-names>K. A.</given-names></name></person-group> (<year>1999</year>). <article-title>Gender differences in pointing accuracy in computer simulated 3D mazes</article-title>. <source>Sex Roles</source> <volume>40</volume>, <fpage>73</fpage>&#x02013;<lpage>92</lpage>. <pub-id pub-id-type="doi">10.1023/A:1018830401088</pub-id></citation></ref>
<ref id="B50">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lindell</surname> <given-names>M. K.</given-names></name></person-group> (<year>2018</year>). <article-title>Communicating imminent risk</article-title>, in <source>Handbook of Disaster Research</source>, eds H. Rodr&#x000ED;guez, J. Trainor, and W. Donner (<publisher-loc>New York, NY: Springer</publisher-loc>), <fpage>449</fpage>&#x02013;<lpage>477</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-319-63254-4_22</pub-id><pub-id pub-id-type="pmid">21689129</pub-id></citation></ref>
<ref id="B51">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Bostrom</surname> <given-names>A.</given-names></name> <name><surname>Goltz</surname> <given-names>J.</given-names></name> <name><surname>Prater</surname> <given-names>C. S.</given-names></name></person-group> (<year>2019b</year>). <source>Social Science Evaluation of Tsunami Evacuation Products, Part 1: Assessment of Textual, Graphical, and Numerical Features</source>. <publisher-loc>Seattle, WA</publisher-loc>: <publisher-name>Environmental Hazards Research Institute</publisher-name>.</citation></ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Earle</surname> <given-names>T. C.</given-names></name></person-group> (<year>1983</year>). <article-title>How close is close enough: public perceptions of the risks of industrial facilities</article-title>. <source>Risk Anal.</source> <volume>3</volume>, <fpage>245</fpage>&#x02013;<lpage>253</lpage>. <pub-id pub-id-type="doi">10.1111/j.1539-6924.1983.tb01393.x</pub-id></citation></ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Huang</surname> <given-names>S.</given-names></name> <name><surname>Wei</surname> <given-names>H.</given-names></name> <name><surname>Samuelson</surname> <given-names>C. D.</given-names></name></person-group> (<year>2016</year>). <article-title>Perceptions and expected immediate reactions to tornado warning polygons</article-title>. <source>Nat. Hazards</source> <volume>80</volume>, <fpage>683</fpage>&#x02013;<lpage>707</lpage>. <pub-id pub-id-type="doi">10.1007/s11069-015-1990-5</pub-id><pub-id pub-id-type="pmid">29119587</pub-id></citation></ref>
<ref id="B54">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Murray-Tuite</surname> <given-names>P.</given-names></name> <name><surname>Wolshon</surname> <given-names>B.</given-names></name> <name><surname>Baker</surname> <given-names>E. J.</given-names></name></person-group> (<year>2019a</year>). <source>Large-Scale Evacuation: The Analysis, Modeling, and Management of Emergency Relocation From Hazardous Areas</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Routledge</publisher-name>. <pub-id pub-id-type="doi">10.4324/9781315119045</pub-id></citation></ref>
<ref id="B55">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Perry</surname> <given-names>R. W.</given-names></name></person-group> (<year>1992</year>). <source>Behavioral Foundations of Community Emergency Planning</source>. <publisher-loc>Washington DC</publisher-loc>: <publisher-name>Hemisphere Press</publisher-name>.<pub-id pub-id-type="pmid">29119587</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Perry</surname> <given-names>R. W.</given-names></name></person-group> (<year>2004</year>). <source>Communicating Environmental Risk in Multiethnic Communities</source>. <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage Publications</publisher-name>.</citation></ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Perry</surname> <given-names>R. W.</given-names></name></person-group> (<year>2012</year>). <article-title>The protective action decision model: theoretical modifications and additional evidence</article-title>. <source>Risk Anal.</source> <volume>32</volume>, <fpage>616</fpage>&#x02013;<lpage>632</lpage>, <pub-id pub-id-type="doi">10.1111/j.1539-6924.2011.01647.x</pub-id><pub-id pub-id-type="pmid">21689129</pub-id></citation></ref>
<ref id="B58">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Prater</surname> <given-names>C.</given-names></name></person-group> (<year>2007</year>). <article-title>A hurricane evacuation management decision support system (EMDSS)</article-title>. <source>Nat. Hazards</source> <volume>40</volume>, <fpage>627</fpage>&#x02013;<lpage>334</lpage>. <pub-id pub-id-type="doi">10.1007/s11069-006-9013-1</pub-id></citation></ref>
<ref id="B59">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Prater</surname> <given-names>C. S.</given-names></name></person-group> (<year>2010</year>). <article-title>Tsunami preparedness on the Oregon and Washington coast: recommendations for research</article-title>. <source>Nat. Hazards Rev.</source> <volume>11</volume>, <fpage>69</fpage>&#x02013;<lpage>81</lpage>. <pub-id pub-id-type="doi">10.1061/(ASCE)1527-6988(2010)11:2(69)</pub-id></citation></ref>
<ref id="B60">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Sutter</surname> <given-names>D. S.</given-names></name> <name><surname>Trainor</surname> <given-names>J. E.</given-names></name></person-group> (<year>2013</year>). <article-title>Individual and household response to tornadoes</article-title>. <source>Int. J. Mass Emerg. Disasters</source> <volume>31</volume>, <fpage>373</fpage>&#x02013;<lpage>383</lpage>.</citation></ref>
<ref id="B61">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>B. F.</given-names></name> <name><surname>Wood</surname> <given-names>M. M.</given-names></name> <name><surname>Egnoto</surname> <given-names>M.</given-names></name> <name><surname>Bean</surname> <given-names>H.</given-names></name> <name><surname>Sutton</surname> <given-names>J.</given-names></name> <name><surname>Mileti</surname> <given-names>D.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>Is a picture worth a thousand words? The effects of maps and warning messages on how publics respond to disaster information</article-title>. <source>Public Relations Rev</source>. <volume>43</volume>, <fpage>493</fpage>&#x02013;<lpage>506</lpage>. <pub-id pub-id-type="doi">10.1016/j.pubrev.2017.04.004</pub-id></citation></ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>D.</given-names></name> <name><surname>Xu</surname> <given-names>Z.</given-names></name> <name><surname>Fan</surname> <given-names>C.</given-names></name></person-group> (<year>2019</year>). <article-title>Generalized analysis of regional fire risk using data visualization of incidents</article-title>. <source>Fire Mater.</source> <volume>43</volume>, <fpage>413</fpage>&#x02013;<lpage>421</lpage>. <pub-id pub-id-type="doi">10.1002/fam.2713</pub-id></citation></ref>
<ref id="B63">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>L.</given-names></name> <name><surname>Boone</surname> <given-names>A. P.</given-names></name> <name><surname>Ruginski</surname> <given-names>I. T.</given-names></name> <name><surname>Padilla</surname> <given-names>L.</given-names></name> <name><surname>Hegarty</surname> <given-names>M.</given-names></name> <name><surname>Creem-Regehr</surname> <given-names>S. H.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>Uncertainty visualization by representative sampling from prediction ensembles</article-title>. <source>IEEE Trans. Vis. Comput. Graph</source> <volume>23</volume>, <fpage>2165</fpage>&#x02013;<lpage>2178</lpage>. <pub-id pub-id-type="doi">10.1109/TVCG.2016.2607204</pub-id><pub-id pub-id-type="pmid">28113666</pub-id></citation></ref>
<ref id="B64">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>L.</given-names></name> <name><surname>Padilla</surname> <given-names>L.</given-names></name> <name><surname>Creem-Regehr</surname> <given-names>S. H.</given-names></name> <name><surname>House</surname> <given-names>D. H.</given-names></name></person-group> (<year>2019</year>). <article-title>Visualizing uncertain tropical cyclone predictions using representative samples from ensembles of forecast tracks</article-title>. <source>IEEE Trans. Vis. Comput. Graph</source> <volume>25</volume>, <fpage>882</fpage>&#x02013;<lpage>891</lpage>. <pub-id pub-id-type="doi">10.1109/TVCG.2018.2865193</pub-id></citation></ref>
<ref id="B65">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>MacPherson-Krutsky</surname> <given-names>C.</given-names></name> <name><surname>Brand</surname> <given-names>B. D.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name></person-group> (<year>2020</year>). <article-title>Does updating natural hazard maps to reflect best practices increase user comprehension of risk?</article-title> <source>Int. J. Disaster Risk Reduct.</source> <volume>46</volume>:<fpage>101487</fpage>. <pub-id pub-id-type="doi">10.1016/j.ijdrr.2020.101487</pub-id></citation></ref>
<ref id="B66">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maidl</surname> <given-names>E.</given-names></name> <name><surname>Buchecker</surname> <given-names>M.</given-names></name></person-group> (<year>2015</year>). <article-title>Raising risk preparedness by flood risk communication</article-title>. <source>Nat. Hazards Earth Syst. Sci</source>. <volume>15</volume>, <fpage>1577</fpage>&#x02013;<lpage>1595</lpage>. <pub-id pub-id-type="doi">10.5194/nhess-15-1577-2015</pub-id></citation></ref>
<ref id="B67">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mason</surname> <given-names>J. B.</given-names></name> <name><surname>Senkbeil</surname> <given-names>J. C.</given-names></name></person-group> (<year>2014</year>). <article-title>Implications of the 2011 Tuscaloosa EF4 tornado for shelter and refuge decisions</article-title>. <source>Nat. Hazards</source> <volume>74</volume>, <fpage>1021</fpage>&#x02013;<lpage>1041</lpage>. <pub-id pub-id-type="doi">10.1007/s11069-014-1230-4</pub-id></citation></ref>
<ref id="B68">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meyer</surname> <given-names>R.</given-names></name> <name><surname>Broad</surname> <given-names>K.</given-names></name> <name><surname>Orlove</surname> <given-names>B.</given-names></name> <name><surname>Petrovic</surname> <given-names>N.</given-names></name></person-group> (<year>2013</year>). <article-title>Dynamic simulation as an approach to understanding hurricane risk response: insights from the Stormview lab</article-title>. <source>Risk Anal</source>. <volume>33</volume>, <fpage>1532</fpage>&#x02013;<lpage>1552</lpage>. <pub-id pub-id-type="doi">10.1111/j.1539-6924.2012.01935.x</pub-id><pub-id pub-id-type="pmid">23231496</pub-id></citation></ref>
<ref id="B69">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Mileti</surname> <given-names>D. S.</given-names></name> <name><surname>Sorensen</surname> <given-names>J. H.</given-names></name></person-group> (<year>1990</year>). <source>Communication of Emergency Public Warnings: A Social Science Perspective and State-Of-The-Art Assessment (No. ORNL-6609)</source>. <publisher-loc>Oak Ridge, TN</publisher-loc>: <publisher-name>Oak Ridge National Laboratories</publisher-name>. <pub-id pub-id-type="doi">10.2172/6137387</pub-id></citation></ref>
<ref id="B70">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Milson</surname> <given-names>A. J.</given-names></name> <name><surname>Alibrandi</surname> <given-names>M.</given-names></name></person-group> (<year>2008</year>). <article-title>Critical map literacy and geographic information systems: the spatial dimension of civic decision making</article-title>, in <source>The Electronic Republic? The Impact of Technology on Education for Citizenship</source>, eds P. J. VanFossen, and M. J. Berson (<publisher-loc>West Lafayette, IN</publisher-loc>: <publisher-name>Purdue University Press</publisher-name>), <fpage>110</fpage>&#x02013;<lpage>128</lpage>.</citation></ref>
<ref id="B71">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Miran</surname> <given-names>S. M.</given-names></name> <name><surname>Ling</surname> <given-names>C.</given-names></name> <name><surname>James</surname> <given-names>J. J.</given-names></name></person-group> (<year>2020</year>). <article-title>People&#x00027;s thresholds of decision-making against a tornado threat using dynamic probabilistic hazard information</article-title>. <source>Int. J. Disaster Risk Reduct</source>. <volume>42</volume>:<fpage>101345</fpage>. <pub-id pub-id-type="doi">10.1016/j.ijdrr.2019.101345</pub-id></citation></ref>
<ref id="B72">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Miran</surname> <given-names>S. M.</given-names></name> <name><surname>Ling</surname> <given-names>C.</given-names></name> <name><surname>James</surname> <given-names>J. J.</given-names></name> <name><surname>Rothfusz</surname> <given-names>L.</given-names></name></person-group> (<year>2016</year>). <article-title>Comparing effectiveness of four graphical designs for probabilistic hazard information for tornado threat</article-title>, in <source>Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 60</source> (<publisher-loc>Los Angeles, CA</publisher-loc>: <publisher-name>SAGE Publications</publisher-name>), <fpage>2029</fpage>&#x02013;<lpage>2033</lpage>. <pub-id pub-id-type="doi">10.1177/1541931213601461</pub-id><pub-id pub-id-type="pmid">28802448</pub-id></citation></ref>
<ref id="B73">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Miran</surname> <given-names>S. M.</given-names></name> <name><surname>Ling</surname> <given-names>C.</given-names></name> <name><surname>Rothfusz</surname> <given-names>L.</given-names></name></person-group> (<year>2018</year>). <article-title>Factors influencing people&#x00027;s decision-making during three consecutive tornado events</article-title>. <source>Int. J. Disaster Risk Reduct</source>. <volume>28</volume>, <fpage>150</fpage>&#x02013;<lpage>157</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijdrr.2018.02.034</pub-id></citation></ref>
<ref id="B74">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Montello</surname> <given-names>D. R.</given-names></name> <name><surname>Lovelace</surname> <given-names>K. L.</given-names></name> <name><surname>Golledge</surname> <given-names>R. G.</given-names></name> <name><surname>Self</surname> <given-names>C. M.</given-names></name></person-group> (<year>1999</year>). <article-title>Sex-related differences and similarities in geographic and environmental spatial abilities</article-title>. <source>Ann. Assoc. Am. Geogr.</source> <volume>89</volume>, <fpage>515</fpage>&#x02013;<lpage>534</lpage>. <pub-id pub-id-type="doi">10.1111/0004-5608.00160</pub-id></citation></ref>
<ref id="B75">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Muir</surname> <given-names>S. P.</given-names></name></person-group> (<year>1985</year>). <article-title>Understanding and improving students&#x00027; map reading skills</article-title>. <source>Elementary School J</source>. <volume>86</volume>, <fpage>206</fpage>&#x02013;<lpage>216</lpage>. <pub-id pub-id-type="doi">10.1086/461444</pub-id></citation></ref>
<ref id="B76">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mulder</surname> <given-names>K. J.</given-names></name> <name><surname>Lickiss</surname> <given-names>M.</given-names></name> <name><surname>Harvey</surname> <given-names>N.</given-names></name> <name><surname>Black</surname> <given-names>A.</given-names></name> <name><surname>Charlton-Perez</surname> <given-names>A.</given-names></name> <name><surname>Dacre</surname> <given-names>H.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>Visualizing volcanic ash forecasts: scientist and stakeholder decisions using different graphical representations and conflicting forecasts</article-title>. <source>Wea. Climate Soc</source>. <volume>9</volume>, <fpage>333</fpage>&#x02013;<lpage>348</lpage>. <pub-id pub-id-type="doi">10.1175/WCAS-D-16-0062.1</pub-id></citation></ref>
<ref id="B77">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nagele</surname> <given-names>D. E.</given-names></name> <name><surname>Trainor</surname> <given-names>J. E.</given-names></name></person-group> (<year>2012</year>). <article-title>Geographic specificity, tornadoes, and protective action</article-title>. <source>Wea. Climate Soc</source>. <volume>4</volume>, <fpage>145</fpage>&#x02013;<lpage>155</lpage>. <pub-id pub-id-type="doi">10.1175/WCAS-D-11-00047.1</pub-id></citation></ref>
<ref id="B78">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nave</surname> <given-names>R.</given-names></name> <name><surname>Isaia</surname> <given-names>R.</given-names></name> <name><surname>Vilardo</surname> <given-names>G.</given-names></name> <name><surname>Barclay</surname> <given-names>J.</given-names></name></person-group> (<year>2010</year>). <article-title>Re-assessing volcanic hazard maps for improving volcanic risk communication: application to Stromboli Island, Italy</article-title>. <source>J. Maps</source> <volume>6</volume>, <fpage>260</fpage>&#x02013;<lpage>269</lpage>, <pub-id pub-id-type="doi">10.4113/jom.2010.1061</pub-id></citation></ref>
<ref id="B79">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ooms</surname> <given-names>K.</given-names></name> <name><surname>De Maeyer</surname> <given-names>P.</given-names></name> <name><surname>Fack</surname> <given-names>V.</given-names></name></person-group> (<year>2014</year>). <article-title>Study of the attentive behavior of novice and expert map users using eye tracking</article-title>. <source>Cartogr. Geogr. Inf. Sci</source>. <volume>41</volume>, <fpage>37</fpage>&#x02013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.1080/15230406.2013.860255</pub-id></citation></ref>
<ref id="B80">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ooms</surname> <given-names>K.</given-names></name> <name><surname>De Maeyer</surname> <given-names>P.</given-names></name> <name><surname>Fack</surname> <given-names>V.</given-names></name></person-group> (<year>2015</year>). <article-title>Listen to the map user: cognition, memory, and expertise</article-title>. <source>Cartogr. J.</source> <volume>52</volume>, <fpage>3</fpage>&#x02013;<lpage>19</lpage>, <pub-id pub-id-type="doi">10.1179/1743277413Y.0000000068</pub-id></citation></ref>
<ref id="B81">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Padilla</surname> <given-names>L. M.</given-names></name> <name><surname>Ruginski</surname> <given-names>I. T.</given-names></name> <name><surname>Creem-Regehr</surname> <given-names>S. H.</given-names></name></person-group> (<year>2017</year>). <article-title>Effects of ensemble and summary displays on interpretations of geospatial uncertainty data</article-title>. <source>Cogn. Res. Princ. Impl.</source> <volume>2</volume>:<fpage>40</fpage>. <pub-id pub-id-type="doi">10.1186/s41235-017-0076-1</pub-id><pub-id pub-id-type="pmid">29051918</pub-id></citation></ref>
<ref id="B82">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pence</surname> <given-names>M.</given-names></name> <name><surname>Zimmerman</surname> <given-names>T.</given-names></name></person-group> (<year>2011</year>). <article-title>The wildland fire decision support system: integrating science, technology, and fire management</article-title>. <source>Fire Manage. Today</source> <volume>71</volume>, <fpage>18</fpage>&#x02013;<lpage>22</lpage>.</citation></ref>
<ref id="B83">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Picucci</surname> <given-names>L.</given-names></name> <name><surname>Caff&#x000F2;</surname> <given-names>A. O.</given-names></name> <name><surname>Bosco</surname> <given-names>A.</given-names></name></person-group> (<year>2011</year>). <article-title>Besides navigation accuracy: gender differences in strategy selection and level of spatial confidence</article-title>. <source>J. Environ. Psychol</source>. <volume>31</volume>, <fpage>430</fpage>&#x02013;<lpage>438</lpage>. <pub-id pub-id-type="doi">10.1016/j.jenvp.2011.01.005</pub-id></citation></ref>
<ref id="B84">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Postigo</surname> <given-names>Y.</given-names></name> <name><surname>Pozo</surname> <given-names>J. I.</given-names></name></person-group> (<year>2004</year>). <article-title>On the road to graphicacy: the learning of graphical representation systems</article-title>. <source>Educ. Psychol.</source> <volume>24</volume>, <fpage>623</fpage>&#x02013;<lpage>644</lpage>, <pub-id pub-id-type="doi">10.1080/0144341042000262944</pub-id></citation></ref>
<ref id="B85">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Reilly</surname> <given-names>D.</given-names></name> <name><surname>Neumann</surname> <given-names>D. L.</given-names></name> <name><surname>Andrews</surname> <given-names>G.</given-names></name></person-group> (<year>2016</year>). <article-title>Sex and sex-role differences in specific cognitive abilities</article-title>. <source>Intelligence</source> <volume>54</volume>, <fpage>147</fpage>&#x02013;<lpage>158</lpage>. <pub-id pub-id-type="doi">10.1016/j.intell.2015.12.004</pub-id></citation></ref>
<ref id="B86">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ruginski</surname> <given-names>I. T.</given-names></name> <name><surname>Boone</surname> <given-names>A. P.</given-names></name> <name><surname>Padilla</surname> <given-names>L. M.</given-names></name> <name><surname>Liu</surname> <given-names>L.</given-names></name> <name><surname>Heydari</surname> <given-names>N.</given-names></name> <name><surname>Kramer</surname> <given-names>H. S.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>Non-expert interpretations of hurricane forecast uncertainty visualizations</article-title>. <source>Spat. Cogn. Comput</source>. <volume>16</volume>, <fpage>154</fpage>&#x02013;<lpage>172</lpage>. <pub-id pub-id-type="doi">10.1080/13875868.2015.1137577</pub-id></citation></ref>
<ref id="B87">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sherman-Morris</surname> <given-names>K.</given-names></name> <name><surname>Brown</surname> <given-names>M. E.</given-names></name></person-group> (<year>2012</year>). <article-title>Experiences of Smithville, Mississippi residents with the 27 April 2011 tornado</article-title>. <source>Natl. Wea. Digest</source> <volume>36</volume>, <fpage>93</fpage>&#x02013;<lpage>101</lpage>.</citation></ref>
<ref id="B88">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sherman-Morris</surname> <given-names>K.</given-names></name> <name><surname>Del Valle-Martinez</surname> <given-names>I.</given-names></name></person-group> (<year>2017</year>). <article-title>Optimistic bias and the consistency of hurricane track forecasts</article-title>. <source>Nat. Hazards</source> <volume>88</volume>, <fpage>1523</fpage>&#x02013;<lpage>1543</lpage>. <pub-id pub-id-type="doi">10.1007/s11069-017-2931-2</pub-id></citation></ref>
<ref id="B89">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sorensen</surname> <given-names>J. H.</given-names></name></person-group> (<year>1991</year>). <article-title>When shall we leave? Factors affecting the timing of evacuation departures</article-title>. <source>Int. J. Mass Emerg. Disasters</source> <volume>9</volume>, <fpage>153</fpage>&#x02013;<lpage>165</lpage>.</citation></ref>
<ref id="B90">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sorensen</surname> <given-names>J. H.</given-names></name> <name><surname>Carnes</surname> <given-names>S. A.</given-names></name> <name><surname>Rogers</surname> <given-names>G. O.</given-names></name></person-group> (<year>1992</year>). <article-title>An approach for deriving emergency planning zones for chemical munitions emergencies</article-title>. <source>J. Hazard. Mater.</source> <volume>30</volume>, <fpage>223</fpage>&#x02013;<lpage>242</lpage>. <pub-id pub-id-type="doi">10.1016/0304-3894(92)87001-V</pub-id></citation></ref>
<ref id="B91">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sorensen</surname> <given-names>J. H.</given-names></name> <name><surname>Mileti</surname> <given-names>D. S.</given-names></name></person-group> (<year>1987</year>). <article-title>Decision making uncertainties in emergency warning system organizations</article-title>. <source>Int. J. Mass Emerg. Disasters</source> <volume>5</volume>, <fpage>33</fpage>&#x02013;<lpage>61</lpage>.</citation>
</ref>
<ref id="B92">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Teigen</surname> <given-names>K. H.</given-names></name></person-group> (<year>2005</year>). <article-title>The proximity heuristic in judgments of accident probabilities</article-title>. <source>Br. J. Psychol</source>. <volume>96</volume>, <fpage>423</fpage>&#x02013;<lpage>440</lpage>. <pub-id pub-id-type="doi">10.1348/000712605X47431</pub-id><pub-id pub-id-type="pmid">16248934</pub-id></citation></ref>
<ref id="B93">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thompson</surname> <given-names>M. A.</given-names></name> <name><surname>Lindsay</surname> <given-names>J. M.</given-names></name> <name><surname>Gaillard</surname> <given-names>J. C.</given-names></name></person-group> (<year>2015</year>). <article-title>The influence of probabilistic volcanic hazard map properties on hazard communication</article-title>. <source>Appl. Volcanol.</source> <volume>4</volume>, <fpage>1</fpage>&#x02013;<lpage>24</lpage>, <pub-id pub-id-type="doi">10.1186/s13617-015-0023-0</pub-id></citation></ref>
<ref id="B94">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tversky</surname> <given-names>A.</given-names></name> <name><surname>Kahneman</surname> <given-names>D.</given-names></name></person-group> (<year>1974</year>). <article-title>Judgment under uncertainty: heuristics and biases</article-title>. <source>Science</source> <volume>185</volume>, <fpage>1124</fpage>&#x02013;<lpage>1131</lpage>. <pub-id pub-id-type="doi">10.1126/science.185.4157.1124</pub-id><pub-id pub-id-type="pmid">17835457</pub-id></citation></ref>
<ref id="B95">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Van Kerkvoorde</surname> <given-names>M.</given-names></name> <name><surname>Kellens</surname> <given-names>W.</given-names></name> <name><surname>Verfaillie</surname> <given-names>E.</given-names></name> <name><surname>Ooms</surname> <given-names>K.</given-names></name></person-group> (<year>2018</year>). <article-title>Evaluation of web maps for the communication of flood risks to the public in Europe</article-title>. <source>Int. J. Cartogr.</source> <volume>4</volume>, <fpage>49</fpage>&#x02013;<lpage>64</lpage>. <pub-id pub-id-type="doi">10.1080/23729333.2017.1371411</pub-id></citation></ref>
<ref id="B96">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Voyer</surname> <given-names>D.</given-names></name> <name><surname>Voyer</surname> <given-names>S.</given-names></name> <name><surname>Bryden</surname> <given-names>M. P.</given-names></name></person-group> (<year>1995</year>). <article-title>Magnitude of sex differences in spatial abilities: a meta-analysis and consideration of critical variables</article-title>. <source>Psychol. Bull.</source> <volume>117</volume>, <fpage>250</fpage>&#x02013;<lpage>270</lpage>. <pub-id pub-id-type="doi">10.1037/0033-2909.117.2.250</pub-id><pub-id pub-id-type="pmid">7724690</pub-id></citation></ref>
<ref id="B97">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wei</surname> <given-names>H. L.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Prater</surname> <given-names>C. S.</given-names></name></person-group> (<year>2014</year>). <article-title>Certain death from storm surge: a comparative study of household responses to warnings about Hurricanes Rita and Ike</article-title>. <source>Wea. Climate Soc</source>. <volume>6</volume>, <fpage>425</fpage>&#x02013;<lpage>433</lpage>. <pub-id pub-id-type="doi">10.1175/WCAS-D-13-00074.1</pub-id></citation></ref>
<ref id="B98">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Whitney</surname> <given-names>D. J.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Nguyen</surname> <given-names>D. H.</given-names></name></person-group> (<year>2004</year>). <article-title>Earthquake beliefs and adoption of seismic hazard adjustments</article-title>. <source>Risk Anal.</source> <volume>24</volume>, <fpage>87</fpage>&#x02013;<lpage>102</lpage>. <pub-id pub-id-type="doi">10.1111/j.0272-4332.2004.00414.x</pub-id><pub-id pub-id-type="pmid">15028003</pub-id></citation></ref>
<ref id="B99">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Wu</surname> <given-names>H.-C.</given-names></name> <name><surname>Huang</surname> <given-names>S. K.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name></person-group> (<year>2020</year>). <article-title>Chapter 12: Evacuation planning</article-title>, in <source>The Routledge Handbook of Urban Disaster Resilience: Integrating Mitigation, Preparedness, and Recovery Planning</source>, ed M.K. Lindell (<publisher-loc>New York, NY: Routledge</publisher-loc>), <fpage>206</fpage>&#x02013;<lpage>222</lpage>. <pub-id pub-id-type="doi">10.4324/9781315714462-12</pub-id></citation></ref>
<ref id="B100">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wu</surname> <given-names>H.-C.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Prater</surname> <given-names>C. S.</given-names></name></person-group> (<year>2015a</year>). <article-title>Process tracing analysis of hurricane information displays</article-title>. <source>Risk Anal.</source> <volume>35</volume>, <fpage>2202</fpage>&#x02013;<lpage>2220</lpage>. <pub-id pub-id-type="doi">10.1111/risa.12423</pub-id></citation></ref>
<ref id="B101">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wu</surname> <given-names>H.-C.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Prater</surname> <given-names>C. S.</given-names></name></person-group> (<year>2015b</year>). <article-title>Strike probability judgments and protective action recommendations in a dynamic hurricane tracking task</article-title>. <source>Nat. Hazards</source> <volume>79</volume>, <fpage>355</fpage>&#x02013;<lpage>380</lpage>. <pub-id pub-id-type="doi">10.1007/s11069-015-1846-z</pub-id></citation></ref>
<ref id="B102">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wu</surname> <given-names>H.-C.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name> <name><surname>Prater</surname> <given-names>C. S.</given-names></name> <name><surname>Samuelson</surname> <given-names>C. D.</given-names></name></person-group> (<year>2014</year>). <article-title>Effects of track and threat information on judgments of hurricane strike probability</article-title>. <source>Risk Anal.</source> <volume>34</volume>, <fpage>1025</fpage>&#x02013;<lpage>1039</lpage>. <pub-id pub-id-type="doi">10.1111/risa.12128</pub-id><pub-id pub-id-type="pmid">24147664</pub-id></citation></ref>
<ref id="B103">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yin</surname> <given-names>W.</given-names></name> <name><surname>Murray-Tuite</surname> <given-names>P.</given-names></name> <name><surname>Ukkusuri</surname> <given-names>S. V.</given-names></name> <name><surname>Gladwin</surname> <given-names>H.</given-names></name></person-group> (<year>2016</year>). <article-title>Modeling shadow evacuation for hurricanes with random-parameter logit model</article-title>. <source>Transp. Res. Rec.</source> <volume>2599</volume>, <fpage>43</fpage>&#x02013;<lpage>51</lpage>. <pub-id pub-id-type="doi">10.3141/2599-06</pub-id></citation></ref>
<ref id="B104">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yoon</surname> <given-names>S. Y.</given-names></name> <name><surname>Mann</surname> <given-names>E. L.</given-names></name></person-group> (<year>2017</year>). <article-title>Exploring the spatial ability of undergraduate students: association with gender, STEM majors, and gifted program membership</article-title>. <source>Gifted Child Q.</source> <volume>61</volume>, <fpage>313</fpage>&#x02013;<lpage>327</lpage>. <pub-id pub-id-type="doi">10.1177/0016986217722614</pub-id></citation></ref>
<ref id="B105">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>Y.</given-names></name> <name><surname>Prater</surname> <given-names>C. S.</given-names></name> <name><surname>Lindell</surname> <given-names>M. K.</given-names></name></person-group> (<year>2004</year>). <article-title>Risk area accuracy and evacuation from Hurricane Bret</article-title>. <source>Nat. Hazards Rev.</source> <volume>5</volume>, <fpage>115</fpage>&#x02013;<lpage>120</lpage>, <pub-id pub-id-type="doi">10.1061/(ASCE)1527-6988(2004)5:3(115)</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn fn-type="financial-disclosure"><p><bold>Funding.</bold> This article is based on work supported by the National Science Foundation under Grants IIS-1212790, IIS-1540469, and CMMI-1826455. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author and do not necessarily reflect the views of the National Science Foundation.</p>
</fn>
</fn-group>
</back>
</article> 