This article is a commentary on:
Commentary: Seeing the conflict: an attentional account of reasoning errors
André Mata
Mário B. FerreiraA response on
Commentary: Seeing the conflict: an attentional account of reasoning errors
by Frey, D., Bago, B., and De Neys, W. (2017a). Front. Psychol. 8:1284. doi: 10.3389/fpsyg.2017.01284
We welcome Frey et al.'s (2017a) thoughtful commentary to our work. In Mata et al. (2017), we used eye-tracking to measure the attention that problem-solvers pay to the premises of reasoning problems. Together with previous findings (Mata et al., 2014), that research suggests that rather than attributing reasoning errors solely to a failure to think properly about the problem, those errors might emerge earlier, from not paying sufficient attention to critical, conflict-relevant parts of the problem, thereby precluding its correct representation and comprehension (see also Evans, 1984, 1989, 1996). Indeed, correct responders were more likely than incorrect responders to pay attention to conflict-relevant premises, and they were better at discriminating between conflict and no-conflict problems.
The concern voiced by Frey et al. (2017a) is that a reading of our findings might suggest that incorrect responders are generally conflict-insensitive. That was not our point. Our research was not targeted at refuting (or even studying) implicit conflict detection (in our studies, the crucial comparisons include correct responses to conflict problems, which is not the case in conflict-detection studies). Our goal was to investigate the role of attention in reasoning. But of course, Frey et al. are correct in noting that our findings have implications for the question that is closest to their concern: whether incorrect reasoners are conflict-sensitive. In that regard, we will now revisit our research with an eye on this question.
At the mean/group level, even though there is a great deal of evidence pointing to conflict detection (e.g., De Neys et al., 2011; Stupple et al., 2013), we systematically fail to find evidence for incorrect responders' conflict sensitivity. This is the case using various measures, including attention [measured via eye-tracking, Mata et al., 2017, or change detection, Mata et al., 2014], performance ratings (Mata et al., 2013; Mata and Almeida, 2014, Study 3), and reaction time (Ferreira et al., 2016; for parallel findings from other labs, see Pennycook et al., 2012; Travers et al., 2016).
A more nuanced view is an individual-differences approach, whereby some, though not all, incorrect responders are conflict-sensitive (Pennycook et al., 2014, 2015; Mevel et al., 2015). But here too we find mixed results regarding whether most responders are conflict-sensitive or insensitive. Frey et al. (2017a) analyzed data from Study 2, where 51.9–55.6% of incorrect responders showed some degree of conflict sensitivity—far from a clear majority, but still a sizeable percentage. However, in Study 1, that percentage was lower: 33.3–44.4%1. In change-detection studies (Mata et al., 2014), where problem-solvers are asked whether they see any difference between the original conflict version of reasoning problems and slightly modified no-conflict versions of the same problems, conflict-sensitive incorrect responders are sometimes also the minority. And when care is taken to preclude detection of superficial changes (e.g., the conflict version is longer than the no-conflict version, which might enable change detection based on length and not content), that rate drops to 10.7%.
To be sure, we are not precluding the possibility of implicit conflict detection. It is an intriguing possibility, which parallels findings in other areas of cognition (e.g., Graf and Schacter, 1985), and is supported by an impressive amount of evidence. Moreover, we should note that considering only the percentage of conflict-sensitive incorrect responders provides a conservative measure, as correct responders are conflict-sensitive (Mata et al., 2014, 2017; Pennycook et al., 2015), and therefore the overall rate of conflict detection is higher than that described in studies focusing on error. What we are suggesting is that further work is needed to understand when/why incorrect responders show conflict sensitivity. We wish to offer two suggestions, concerning necessary preconditions for conflict detection.
First, one might explore the implications of our attentional account to conflict detection (we regard these approaches as complementary rather than competing): When reasoners do not pay attention to the conflict-relevant premises and therefore fail to understand the problem correctly, the reason why they err is not necessarily that they are unaware of logical principles, but rather because they cannot detect a conflict that has not been perceived/represented to begin with. Thus, logical intuitions cannot be triggered because they are not evoked by the problem as it is represented.
This might explain why, in conflict-detection studies, the confidence of incorrect responders is consistently high, sometimes as high as 85% or even 91.5% (where 100% means completely confident; De Neys et al., 2013; Johnson et al., 2016; see also Mata et al., 2013; Scherer et al., 2017). Responders who do not attend to, and therefore miscomprehend, the conflict-relevant premises answer conflict problems as if they contained no conflict. Future studies might integrate these two perspectives by studying the joint effect of attention/comprehension and conflict detection. We would not expect conflict detection for incorrect responders who miss the critical premises.
Second, rather than testing whether most responders are conflict-sensitive or insensitive, or testing the relative sensitivity/efficiency of conflict detection, one might impose strong tests on a conflict-detection model, and assume that conflict detection should only occur when conflicting thoughts are present. For instance, experts, who presumably do not share the same biased intuitions as laymen, should not show conflict detection (Svedholm-Häkkinen, 2015; Obersteiner et al., 2016). Conversely, young children, who have not yet accumulated the knowledge that underlies intuitive judgments should feel less conflicted (Jacobs and Potenza, 1991; Davidson, 1995; De Neys and Vanderputte, 2011).
In short, future research should test whether there is conflict detection only when the key ingredients are present: paying attention to the conflict-relevant premises, and having conflicting thoughts about the problem (e.g., for conjunction/base rate tasks, having knowledge of both the stereotype and the logical rule). As a noteworthy example, Frey et al. (2017b, Study 3) showed how differences in storage failure underlie conflict-sensitivity, and that only those incorrect responders who know the correct reasoning rules are conflict-sensitive. This is precisely the kind of approach that should bring valuable new insights to this debate.
Author Contributions
AM wrote the manuscript. MF provided comments.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Footnotes
1. ^Frey et al. argued that Study 1 had a potential confound, such that critical elements of the reasoning process (reviewing of premises) were neglected. This was not the case: The question was presented together with the premises, and eye-tracking was continuously recorded while participants took their time to think about the problem before they decided to type their response. They could therefore freely re-read the initial premises in light of the question, as all the information was on display.
References
Davidson, D. (1995). The representativeness heuristic and the conjunction fallacy effect in children's decision making. Merrill Palmer Q. 41, 328–346.
De Neys, W., Cromheeke, S., and Osman, M. (2011). Biased but in doubt: conflict and decision confidence. PLoS ONE 6:e15954. doi: 10.1371/journal.pone.0015954
De Neys, W., Rossi, S., and Houdé, O. (2013). Bats, balls, and substitution sensitivity: cognitive misers are no happy fools. Psychon. Bull. Rev. 20, 269–273. doi: 10.3758/s13423-013-0384-5
De Neys, W., and Vanderputte, K. (2011). When less is not always more: stereotype knowledge and reasoning development. Dev. Psychol. 47, 432–441. doi: 10.1037/a0021313
St Evans, J. B. T. (1984). Heuristic and analytic processes in reasoning. Br. J. Psychol. 75, 451–468.
St Evans, J. B. T. (1996). Deciding before you think: relevance and reasoning in the selection task. Br. J. Psychol. 87, 223–240.
Ferreira, M. B., Mata, A., Donkin, C., Sherman, S. J., and Ihmels, M. (2016). Analytic and heuristic processes in the detection and resolution of conflict. Mem. Cognit. 44, 1050–1063. doi: 10.3758/s13421-016-0618-7
Frey, D. P., Bago, B., and De Neys, W. (2017a). Commentary: seeing the conflict: an attentional account of reasoning errors. Front. Psychol. 8:1284. doi: 10.3389/fpsyg.2017.01284
Frey, D., Johnson, E. D., and De Neys, W. (2017b). Individual Differences in conflict detection during reasoning. Q. J. Exp. Psychol. 5, 1–52. doi: 10.1080/17470218.2017.1313283
Graf, P., and Schacter, D. L. (1985). Implicit and explicit memory for new associations in normal and amnesic subjects. J. Exp. Psychol. Learn. Mem. Cogn. 11, 501–518.
Jacobs, J. E., and Potenza, M. (1991). The use of judgement heuristics to make social and object decisions: a developmental perspective. Child Dev. 62, 166–178.
Johnson, E. D., Tubau, E., and De Neys, W. (2016). The doubting System 1: evidence for automatic substitution sensitivity. Acta Psychol. 164, 56–64. doi: 10.1016/j.actpsy.2015.12.008
Mata, A., and Almeida, T. (2014). Using metacognitive cues to infer others' thinking. Judgm. Decis. Mak. 9, 349–359. Available online at: http://psycnet.apa.org/record/2014-31817-005
Mata, A., Ferreira, M. B., and Sherman, S. J. (2013). The metacognitive advantage of deliberative thinkers: A dual-process perspective on overconfidence. J. Pers. Soc. Psychol. 105, 353–373. doi: 10.1037/a0033640
Mata, A., Ferreira, M. B., Voss, A., and Kollei, T. (2017). Seeing the conflict: an attentional account of reasoning errors. Psychon. Bull. Rev. 24, 1980–1986. doi: 10.3758/s13423-017-1234-7
Mata, A., Schubert, A., and Ferreira, M. B. (2014). The role of language comprehension in reasoning: how “good-enough” representations induce biases. Cognition 133, 457–463. doi: 10.1016/j.cognition.2014.07.011
Mevel, K., Poirel, N., Rossi, S., Cassotti, M., Simon, G., Houdé, O., et al. (2015). Bias detection: response confidence evidence for conflict sensitivity in the ratio bias task. J. Cogn. Psychol. 27, 227–237. doi: 10.1080/20445911.2014.986487
Obersteiner, A., Hoof, J. V., Verschaffel, L., and Dooren, W. V. (2016). Who can escape the natural number bias in rational number tasks? A study involving students and experts. Br. J. Psychol. 107, 537–555. doi: 10.1111/bjop.12161
Pennycook, G., Cheyne, J. A., Barr, N., Koehler, D. J., and Fugelsang, J. A. (2014). Cognitive style and religiosity: the role of conflict detection. Mem. Cognit. 42, 1–10. doi: 10.3758/s13421-013-0340-7
Pennycook, G., Fugelsang, J. A., and Koehler, D. J. (2012). Are we good at detecting conflict during reasoning? Cognition 124, 101–106. doi: 10.1016/j.cognition.2012.04.004
Pennycook, G., Fugelsang, J. A., and Koehler, D. J. (2015). What makes us think? A three-stage dual-process model of analytic engagement. Cogn. Psychol. 80, 34–72. doi: 10.1016/j.cogpsych.2015.05.001
Scherer, L. D., Yates, J. F., Baker, S. G., and Valentine, K. D. (2017). The influence of effortful thought and cognitive proficiencies on the conjunction fallacy: implications for dual-process theories of reasoning and judgment. Pers. Soc. Psychol. Bull. 43, 874–887. doi: 10.1177/0146167217700607
Stupple, E. J., Ball, L. J., and Ellis, D. (2013). Matching bias in syllogistic reasoning: evidence for a dual-process account from response times and confidence ratings. Think. Reason. 19, 54–77. doi: 10.1080/13546783.2012.735622
Svedholm-Häkkinen, A. M. (2015). Highly reflective reasoners show no signs of belief inhibition. Acta Psychol. 154, 69–76. doi: 10.1016/j.actpsy.2014.11.008
Keywords: intuition, reasoning, decision making, bias, conflict detection, attention
Citation: Mata A and Ferreira MB (2018) Response: Commentary: Seeing the conflict: an attentional account of reasoning errors. Front. Psychol. 9:24. doi: 10.3389/fpsyg.2018.00024
Received: 27 October 2017; Accepted: 09 January 2018;
Published: 26 January 2018.
Edited by:
Ulrich Hoffrage, University of Lausanne, SwitzerlandReviewed by:
Gordon Pennycook, Yale University, United StatesEdward J. N. Stupple, University of Derby, United Kingdom
Copyright © 2018 Mata and Ferreira. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: André Mata, andremata@psicologia.ulisboa.pt