Skip to main content

GENERAL COMMENTARY article

Front. Psychol., 26 January 2018
Sec. Cognition

Response: Commentary: Seeing the conflict: an attentional account of reasoning errors

  • Faculdade de Psicologia, CICPSI, Universidade de Lisboa, Lisbon, Portugal

A response on
Commentary: Seeing the conflict: an attentional account of reasoning errors

by Frey, D., Bago, B., and De Neys, W. (2017a). Front. Psychol. 8:1284. doi: 10.3389/fpsyg.2017.01284

We welcome Frey et al.'s (2017a) thoughtful commentary to our work. In Mata et al. (2017), we used eye-tracking to measure the attention that problem-solvers pay to the premises of reasoning problems. Together with previous findings (Mata et al., 2014), that research suggests that rather than attributing reasoning errors solely to a failure to think properly about the problem, those errors might emerge earlier, from not paying sufficient attention to critical, conflict-relevant parts of the problem, thereby precluding its correct representation and comprehension (see also Evans, 1984, 1989, 1996). Indeed, correct responders were more likely than incorrect responders to pay attention to conflict-relevant premises, and they were better at discriminating between conflict and no-conflict problems.

The concern voiced by Frey et al. (2017a) is that a reading of our findings might suggest that incorrect responders are generally conflict-insensitive. That was not our point. Our research was not targeted at refuting (or even studying) implicit conflict detection (in our studies, the crucial comparisons include correct responses to conflict problems, which is not the case in conflict-detection studies). Our goal was to investigate the role of attention in reasoning. But of course, Frey et al. are correct in noting that our findings have implications for the question that is closest to their concern: whether incorrect reasoners are conflict-sensitive. In that regard, we will now revisit our research with an eye on this question.

At the mean/group level, even though there is a great deal of evidence pointing to conflict detection (e.g., De Neys et al., 2011; Stupple et al., 2013), we systematically fail to find evidence for incorrect responders' conflict sensitivity. This is the case using various measures, including attention [measured via eye-tracking, Mata et al., 2017, or change detection, Mata et al., 2014], performance ratings (Mata et al., 2013; Mata and Almeida, 2014, Study 3), and reaction time (Ferreira et al., 2016; for parallel findings from other labs, see Pennycook et al., 2012; Travers et al., 2016).

A more nuanced view is an individual-differences approach, whereby some, though not all, incorrect responders are conflict-sensitive (Pennycook et al., 2014, 2015; Mevel et al., 2015). But here too we find mixed results regarding whether most responders are conflict-sensitive or insensitive. Frey et al. (2017a) analyzed data from Study 2, where 51.9–55.6% of incorrect responders showed some degree of conflict sensitivity—far from a clear majority, but still a sizeable percentage. However, in Study 1, that percentage was lower: 33.3–44.4%1. In change-detection studies (Mata et al., 2014), where problem-solvers are asked whether they see any difference between the original conflict version of reasoning problems and slightly modified no-conflict versions of the same problems, conflict-sensitive incorrect responders are sometimes also the minority. And when care is taken to preclude detection of superficial changes (e.g., the conflict version is longer than the no-conflict version, which might enable change detection based on length and not content), that rate drops to 10.7%.

To be sure, we are not precluding the possibility of implicit conflict detection. It is an intriguing possibility, which parallels findings in other areas of cognition (e.g., Graf and Schacter, 1985), and is supported by an impressive amount of evidence. Moreover, we should note that considering only the percentage of conflict-sensitive incorrect responders provides a conservative measure, as correct responders are conflict-sensitive (Mata et al., 2014, 2017; Pennycook et al., 2015), and therefore the overall rate of conflict detection is higher than that described in studies focusing on error. What we are suggesting is that further work is needed to understand when/why incorrect responders show conflict sensitivity. We wish to offer two suggestions, concerning necessary preconditions for conflict detection.

First, one might explore the implications of our attentional account to conflict detection (we regard these approaches as complementary rather than competing): When reasoners do not pay attention to the conflict-relevant premises and therefore fail to understand the problem correctly, the reason why they err is not necessarily that they are unaware of logical principles, but rather because they cannot detect a conflict that has not been perceived/represented to begin with. Thus, logical intuitions cannot be triggered because they are not evoked by the problem as it is represented.

This might explain why, in conflict-detection studies, the confidence of incorrect responders is consistently high, sometimes as high as 85% or even 91.5% (where 100% means completely confident; De Neys et al., 2013; Johnson et al., 2016; see also Mata et al., 2013; Scherer et al., 2017). Responders who do not attend to, and therefore miscomprehend, the conflict-relevant premises answer conflict problems as if they contained no conflict. Future studies might integrate these two perspectives by studying the joint effect of attention/comprehension and conflict detection. We would not expect conflict detection for incorrect responders who miss the critical premises.

Second, rather than testing whether most responders are conflict-sensitive or insensitive, or testing the relative sensitivity/efficiency of conflict detection, one might impose strong tests on a conflict-detection model, and assume that conflict detection should only occur when conflicting thoughts are present. For instance, experts, who presumably do not share the same biased intuitions as laymen, should not show conflict detection (Svedholm-Häkkinen, 2015; Obersteiner et al., 2016). Conversely, young children, who have not yet accumulated the knowledge that underlies intuitive judgments should feel less conflicted (Jacobs and Potenza, 1991; Davidson, 1995; De Neys and Vanderputte, 2011).

In short, future research should test whether there is conflict detection only when the key ingredients are present: paying attention to the conflict-relevant premises, and having conflicting thoughts about the problem (e.g., for conjunction/base rate tasks, having knowledge of both the stereotype and the logical rule). As a noteworthy example, Frey et al. (2017b, Study 3) showed how differences in storage failure underlie conflict-sensitivity, and that only those incorrect responders who know the correct reasoning rules are conflict-sensitive. This is precisely the kind of approach that should bring valuable new insights to this debate.

Author Contributions

AM wrote the manuscript. MF provided comments.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Footnotes

1. ^Frey et al. argued that Study 1 had a potential confound, such that critical elements of the reasoning process (reviewing of premises) were neglected. This was not the case: The question was presented together with the premises, and eye-tracking was continuously recorded while participants took their time to think about the problem before they decided to type their response. They could therefore freely re-read the initial premises in light of the question, as all the information was on display.

References

Davidson, D. (1995). The representativeness heuristic and the conjunction fallacy effect in children's decision making. Merrill Palmer Q. 41, 328–346.

Google Scholar

De Neys, W., Cromheeke, S., and Osman, M. (2011). Biased but in doubt: conflict and decision confidence. PLoS ONE 6:e15954. doi: 10.1371/journal.pone.0015954

PubMed Abstract | CrossRef Full Text | Google Scholar

De Neys, W., Rossi, S., and Houdé, O. (2013). Bats, balls, and substitution sensitivity: cognitive misers are no happy fools. Psychon. Bull. Rev. 20, 269–273. doi: 10.3758/s13423-013-0384-5

PubMed Abstract | CrossRef Full Text | Google Scholar

De Neys, W., and Vanderputte, K. (2011). When less is not always more: stereotype knowledge and reasoning development. Dev. Psychol. 47, 432–441. doi: 10.1037/a0021313

CrossRef Full Text | Google Scholar

St Evans, J. B. T. (1984). Heuristic and analytic processes in reasoning. Br. J. Psychol. 75, 451–468.

Google Scholar

St Evans, J. B. T. (1989). Bias in Human Reasoning: Causes and Consequences. Brighton: Erlbaum.

Google Scholar

St Evans, J. B. T. (1996). Deciding before you think: relevance and reasoning in the selection task. Br. J. Psychol. 87, 223–240.

Google Scholar

Ferreira, M. B., Mata, A., Donkin, C., Sherman, S. J., and Ihmels, M. (2016). Analytic and heuristic processes in the detection and resolution of conflict. Mem. Cognit. 44, 1050–1063. doi: 10.3758/s13421-016-0618-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Frey, D. P., Bago, B., and De Neys, W. (2017a). Commentary: seeing the conflict: an attentional account of reasoning errors. Front. Psychol. 8:1284. doi: 10.3389/fpsyg.2017.01284

PubMed Abstract | CrossRef Full Text | Google Scholar

Frey, D., Johnson, E. D., and De Neys, W. (2017b). Individual Differences in conflict detection during reasoning. Q. J. Exp. Psychol. 5, 1–52. doi: 10.1080/17470218.2017.1313283

CrossRef Full Text | Google Scholar

Graf, P., and Schacter, D. L. (1985). Implicit and explicit memory for new associations in normal and amnesic subjects. J. Exp. Psychol. Learn. Mem. Cogn. 11, 501–518.

PubMed Abstract | Google Scholar

Jacobs, J. E., and Potenza, M. (1991). The use of judgement heuristics to make social and object decisions: a developmental perspective. Child Dev. 62, 166–178.

Google Scholar

Johnson, E. D., Tubau, E., and De Neys, W. (2016). The doubting System 1: evidence for automatic substitution sensitivity. Acta Psychol. 164, 56–64. doi: 10.1016/j.actpsy.2015.12.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Mata, A., and Almeida, T. (2014). Using metacognitive cues to infer others' thinking. Judgm. Decis. Mak. 9, 349–359. Available online at: http://psycnet.apa.org/record/2014-31817-005

Google Scholar

Mata, A., Ferreira, M. B., and Sherman, S. J. (2013). The metacognitive advantage of deliberative thinkers: A dual-process perspective on overconfidence. J. Pers. Soc. Psychol. 105, 353–373. doi: 10.1037/a0033640

PubMed Abstract | CrossRef Full Text | Google Scholar

Mata, A., Ferreira, M. B., Voss, A., and Kollei, T. (2017). Seeing the conflict: an attentional account of reasoning errors. Psychon. Bull. Rev. 24, 1980–1986. doi: 10.3758/s13423-017-1234-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Mata, A., Schubert, A., and Ferreira, M. B. (2014). The role of language comprehension in reasoning: how “good-enough” representations induce biases. Cognition 133, 457–463. doi: 10.1016/j.cognition.2014.07.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Mevel, K., Poirel, N., Rossi, S., Cassotti, M., Simon, G., Houdé, O., et al. (2015). Bias detection: response confidence evidence for conflict sensitivity in the ratio bias task. J. Cogn. Psychol. 27, 227–237. doi: 10.1080/20445911.2014.986487

CrossRef Full Text | Google Scholar

Obersteiner, A., Hoof, J. V., Verschaffel, L., and Dooren, W. V. (2016). Who can escape the natural number bias in rational number tasks? A study involving students and experts. Br. J. Psychol. 107, 537–555. doi: 10.1111/bjop.12161

PubMed Abstract | CrossRef Full Text | Google Scholar

Pennycook, G., Cheyne, J. A., Barr, N., Koehler, D. J., and Fugelsang, J. A. (2014). Cognitive style and religiosity: the role of conflict detection. Mem. Cognit. 42, 1–10. doi: 10.3758/s13421-013-0340-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Pennycook, G., Fugelsang, J. A., and Koehler, D. J. (2012). Are we good at detecting conflict during reasoning? Cognition 124, 101–106. doi: 10.1016/j.cognition.2012.04.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Pennycook, G., Fugelsang, J. A., and Koehler, D. J. (2015). What makes us think? A three-stage dual-process model of analytic engagement. Cogn. Psychol. 80, 34–72. doi: 10.1016/j.cogpsych.2015.05.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Scherer, L. D., Yates, J. F., Baker, S. G., and Valentine, K. D. (2017). The influence of effortful thought and cognitive proficiencies on the conjunction fallacy: implications for dual-process theories of reasoning and judgment. Pers. Soc. Psychol. Bull. 43, 874–887. doi: 10.1177/0146167217700607

PubMed Abstract | CrossRef Full Text | Google Scholar

Stupple, E. J., Ball, L. J., and Ellis, D. (2013). Matching bias in syllogistic reasoning: evidence for a dual-process account from response times and confidence ratings. Think. Reason. 19, 54–77. doi: 10.1080/13546783.2012.735622

CrossRef Full Text | Google Scholar

Svedholm-Häkkinen, A. M. (2015). Highly reflective reasoners show no signs of belief inhibition. Acta Psychol. 154, 69–76. doi: 10.1016/j.actpsy.2014.11.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Travers, E., Rolison, J. J., and Feeney, A. (2016). The time course of conflict on the Cognitive Reflection Test. Cognition 150, 109–118. doi: 10.1016/j.cognition.2016.01.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: intuition, reasoning, decision making, bias, conflict detection, attention

Citation: Mata A and Ferreira MB (2018) Response: Commentary: Seeing the conflict: an attentional account of reasoning errors. Front. Psychol. 9:24. doi: 10.3389/fpsyg.2018.00024

Received: 27 October 2017; Accepted: 09 January 2018;
Published: 26 January 2018.

Edited by:

Ulrich Hoffrage, University of Lausanne, Switzerland

Reviewed by:

Gordon Pennycook, Yale University, United States
Edward J. N. Stupple, University of Derby, United Kingdom

Copyright © 2018 Mata and Ferreira. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: André Mata, andremata@psicologia.ulisboa.pt

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.