Abstract
This brief research report presents an experiment investigating how people interpret quantities displayed in pictorial charts. Pictorial charts are a popular form of data visualization in media. They represent different quantities with differently scaled pictures. In the present study, 63 university students answered a 12-item questionnaire containing three different pictorial charts. The study aimed to evaluate how individuals perceive the quantities in the pictorial charts intuitively. Therefore, the students’ answers were not rated as correct or incorrect. Instead, it was analyzed which functional relationship between scale factor and estimated quantity best described people’s interpretation of pictorial charts. The experiment showed that, on average, a model assuming a quadratic relationship fitted best. This result deviates from research that found an overgeneralization of linearity when students compare the areas of two mathematically similar shapes. It may be that the routines for the interpretation of pictures differ considerably depending on whether a person must calculate a quantity arithmetically or is prompted to estimate the quantity based on visual perception.
Introduction
Data and data analyses play an important role in decision making in modern society. Consequently, print media try to convey data of public relevance in graphically appealing and reader-friendly data visualizations. These graphics are becoming increasingly popular, graphically elaborate, and complex and are nowadays subsumed within the term information graphics or infographics (e.g., ).
A specific and popular form of an infographic is a pictorial chart (). It uses a picture related to the data to make the data presentation more aesthetically pleasing. Different quantities are displayed by scaling the picture up or down. Figure 1, which compares the nitrogen oxide emissions of different types of cars, provides an example of a pictorial chart. White clouds display the threshold values for nitrogen oxide emissions, and gray clouds represent the cars’ actual emission values. The “larger” the cloud, the greater the represented quantity of emissions.
FIGURE 1
An appealing graphical design for a chart can make data more accessible. However, graphical features can create a distorting visual impression and mislead the reader. Therefore, various countries’ curricula and standards in mathematics require students to have the ability to judge statistical data visualizations and to be able to identify misleading data displays (e.g.,
FIGURE 2

Stimulus for a standardized test item in a task: “The picture above is misleading. Explain why” (
First, this brief research report reflects from a theoretical perspective upon how people interpret pictorial charts and reviews empirical results from mathematics education and psychology that could substantiate different assumptions. Subsequently, the paper presents an empirical study investigating how students interpret pictorially displayed quantities in pictorial charts. Finally, in the “Discussion” section, the paper tries to explain the different research results by suggesting that whether people have to assess pictures analytically or perceptually might have a substantial effect. Furthermore, it is argued that given the increasing variety and importance of data visualization in public life, mathematics education should pay more attention to popular or novel forms of data visualizations.
Theoretical Background
A pictorial chart is based on a similarity transformation. A graphic designer uniformly scales a picture A by a factor to generate a mathematically similar picture B.
Therefore, one can try to generate assumptions about how people interpret pictorial charts by exemplarily analyzing an item (Figure 2) from a standardized test of the National Assessment of Educational Progress (NAEP). This item (
While the mathematics of volume is clear, this might not be the way people interpret the pictures of the garbage cans. If readers perceptually evaluate pictures based on the area covered by ink, the garbage can of 1980 extends over four times as much area as the garbage can of 1960. Generally speaking, the area of a shape quadruples if the shape’s length and width are doubled, due to a quadratic relationship between the scale factor and the area. There is also a third manner in which people could interpret the pictorial chart. In Figure 2, one could argue that the garbage cans are just replacing the bars of a bar chart to make the chart more appealing to the reader. Therefore, it might be possible that the reader, in the same way as when reading a bar chart, takes only the garbage cans’ height into account.
This ambiguity begs the question whether empirical research provides evidence of how readers evaluate pictorial charts. Empirical research that explicitly addressed readers’ interpretation of pictorial charts could not be found. However, research results from mathematics education and psychology may substantiate some theoretical assumptions outlined above.
Results From Related Empirical Research
Since most pictorial charts rely on displaying quantities via representations of two- or three-dimensional objects, the reader’s ability and strategies to deal with measures (length, area, and volume) might influence the interpretation of pictorial charts. However, the ability to calculate these measures exactly does not play a significant role when interpreting pictorial charts. Instead, the ability to estimate measures might be crucial.
One strategy for estimating measures is the reference point strategy (
A further research strand that relates to the interpretation of pictorial charts is research on problem-solving. In one experiment,
Present Study
In summary, the theoretical analyses and the empirical results in mathematics education and psychology show that it is still unclear how people interpret pictorial charts. That is, the question is the quantity Q2 that readers will assign to picture B when a picture A with a known quantity Q1 is uniformly scaled by a factor s and results in picture B. To evaluate whether a pictorial chart is misleading, one should know how people “read” a pictorial chart. Assuming that the processing of pictorial charts in media is based on intuitive heuristics that people quickly perform, the present study focuses on this System 1 (
Some assumptions could be derived from the presented theoretical background. If readers apply an approximately linear relationship (as discovered in research about the overgeneralization of linearity) between the scaling factor and the quantity Q2, it results in the rule Q2 ≈ s ⋅ Q1. If people base their judgment on the perceptual aspects of interpreting a picture as a two-dimensional object (cf. summarized research above about the perception of areas), an approximately quadratic relationship could be assumed, that is, Q2 ≈ s2 ⋅ Q1. If a pictorial chart consists of perspective pictures of three-dimensional objects (e.g., photographs or perspective drawings of garbage cans), a spatial interpretation based on an approximately cubic relationship is possible (Q2 ≈ s3 ⋅ Q1). The NAEP coding guide, for example, evaluates this approach as the only correct solution for interpreting three-dimensional pictures. Although these three options would provide a clear-cut theoretical explanation for their occurrence, different exponents (e.g., 1.6 or 2.4) in the power functions could not be ruled out. Therefore, it appears reasonable to replace the exponent with a variable b so that the rule results in the general equation Q2 = sb ⋅ Q1.
The research questions for this study were: (RQ1) When one views a pictorial chart in which a quantity Q2 is displayed via scaling a picture representing the known quantity Q1 with a scaling factor s, which value b in the power function Q2 = sb ⋅ Q1 best describes a person’s interpretation of a quantity Q2? (RQ2) Does the value b vary substantially between persons? (RQ3) Does the value b depend on the picture? (RQ4) Does the value b depend on whether the pictures were enlarged or reduced?
Materials and Methods
Participants
This study drew the participation of 63 mathematics teacher-education students from a German university (primary and secondary school education) with an average age of M = 21.5 (SD = 2.0). Since most of the students aspired to the primary school teaching profession, female students predominated in the sample (58 females, 5 males). The students had not received instruction on the study’s topic, nor was the topic explicitly taught in any course. The students were recruited during ordinary course time and did not receive a financial incentive. Ethics approval was obtained from the students.
Materials
The questionnaire consisted of 12 items (three testlets with four items each). A specific picture formed the basis of every testlet. The three pictures differed in their level of realism and the extent to which they can be interpreted two- or three-dimensionally. In the CO2 testlet, a line drawing of a cloud represented the amount of carbon dioxide emitted by a factory. This line drawing could be interpreted two-dimensionally as the cross-section of a cloud. A three-dimensional interpretation was also possible by taking into consideration the real-life nature of a cloud and the overlapping lines. However, how deep the cloud is perceived depends on the reader’s interpretation. In the Garbage testlet (Figure 3), a photograph of a garbage can depicted the amount of garbage produced by a household. The photograph was used to stimulate a three-dimensional interpretation. In the Sugar testlet, a perspective line drawing of a sugar lump in cavalier projection displayed the amount of sugar a person consumes. Like the Garbage testlet, the Sugar testlet should stimulate a three-dimensional interpretation. A picture of a cloud, a garbage can, or a sugar lump on the left-hand side displayed a base quantity of 100 units in each testlet. On the right-hand side, the same picture was uniformly scaled by a specific factor (e.g., 0.7 or 1.6, with the complete item booklet provided in Supplementary Material, File 2, Chapter A). Different scale factors were used to derive general rules from the data about the relationship between scale factors and perceived quantities. The pictorial charts did not contain an ordinate, and the pictures were not placed on a horizontal baseline. The participants had to intuitively estimate the quantity represented by the picture on the right because the aim of the experiment was to determine the readers’ innate interpretation of the pictorial chart. Each testlet comprised four comparisons. The 12 items were presented in a fixed order (CO2, Garbage, Sugar). The scale factor s in the experiment ranged from 0.3 to 1.9.
FIGURE 3

Item of the Garbage test translated into English: The garbage can on the left is scaled by the factor 0.7.
Administration
The students answered the questionnaire with paper and pencil. They were told that the questions dealt with intuitive estimation. Hence, the students were asked to refrain from using a calculator or a ruler and from performing calculations manually. It took the students between 5 and 10 min to complete the questionnaire.
Data Analysis
Each of the three testlets contained four items, resulting in 12 items per person. The data analysis aimed to determine the functional relationship between scale factor and a person’s estimate. It was assumed that the estimation follows a power function Q2 = sb ⋅ Q1 (cf., section “Theoretical Background”). In the experiment, Q1 always equaled 100, so the equation becomes Q2 = 100 sb. Taking logarithms of the equation, we get: = b ⋅ log (s). Therefore, to determine the exponent b, we apply a linear regression y = bx + e with the logarithm of the scale factor, log(s), as the independent variable x and the logarithm of Q2 divided by 100, , as the dependent variable y, and e as the residual. In the equation y = bx + e, the value of the regression slope b equals the exponent b in the power function. The regression intercept is zero.
The data had a multilevel structure because the responses were nested within testlets and persons. Classical regression analysis cannot account for the dependence on the responses within persons. Therefore, multilevel models (cf.
First, a two-level-approach (responses nested within persons) was applied. To answer the first research question, an average value for the exponent b for all participants across all items was estimated (Model 1: fixed slope). To evaluate whether the exponent b varies among individuals (research question 2), a value for the exponent b for every participant across all 12 items was determined (Model 2: random slope). In Model 3, the testlet structure was taken into account (answers nested within testlets and individuals). That is, this model estimated whether the testlet (CO2, Garbage, and Sugar) had an effect on the exponent b (research question 3). In Model 4, a further fixed effect (enlargement or reduction) was added to Model 3 to evaluate RQ4. A detailed description of the multilevel analyses can be found in Supplementary Material, File 2, Chapter B.
Outliers were replaced with missing values before conducting the multilevel analyses. A value was defined as an outlier if picture B was scaled down, but a student estimated a value bigger than 100 and vice versa.
Results
Every participant answered all 12 items, resulting in 756 item responses (cf. descriptive statistics in Table 1). Six item responses were identified as outliers and replaced with missing values.
TABLE 1
| Estimated quantity for Q2 | ||||||||||
| Item No. | Test | Task | Scaling factor | If b = 1 (linear) | If b = 2 (quadratic) | If b = 3 (cubic) | N | M | SD | 95% CI |
| 1 | CO2 | a | 0.9 | 90 | 81 | 73 | 63 | 80.9 | 7.4 | (79.0, 82.7) |
| 2 | b | 1.3 | 130 | 169 | 220 | 62 | 177.5 | 59.6 | (162.4, 192.7) | |
| 3 | c | 0.3 | 30 | 9 | 3 | 60 | 10.9 | 4.1 | (9.8, 11.9) | |
| 4 | d | 1.6 | 160 | 256 | 410 | 63 | 290.2 | 98.3 | (265.4, 314.9) | |
| 5 | Garbage | a | 0.7 | 70 | 49 | 34 | 63 | 54.5 | 16.1 | (50.4, 58.6) |
| 6 | b | 1.5 | 150 | 225 | 338 | 62 | 189.3 | 47.0 | (177.3, 201.2) | |
| 7 | c | 1.9 | 190 | 361 | 686 | 63 | 344.4 | 147.4 | (307.2, 381.5) | |
| 8 | d | 0.5 | 50 | 25 | 13 | 62 | 28.4 | 12.0 | (25.3, 31.4) | |
| 9 | Sugar | a | 1.4 | 140 | 196 | 274 | 63 | 195.0 | 52.1 | (181.9, 208.1) |
| 10 | b | 0.8 | 80 | 64 | 51 | 63 | 67.9 | 13.2 | (64.6, 71.2) | |
| 11 | c | 0.4 | 40 | 16 | 6 | 63 | 19.2 | 9.0 | (16.9, 21.5) | |
| 12 | d | 1.8 | 180 | 324 | 583 | 63 | 365.6 | 180.9 | (320.1, 411.2) | |
Descriptive information concerning the items.
The six outliers were eliminated before calculating the descriptive statistics.
Regarding the first research question, the aim was to identify in the power function Q2 = 100sb the exponent b that best described the participants’ perception of the quantities in the pictorial charts. Using logarithms of the estimation values and the scale factors caused the slopes in the multilevel analyses to equal the searched value b (cf. “Materials and Methods” section). The first multilevel model (Model 1) with fixed slopes (i.e., assuming that the value b did not vary among participants) resulted in a value 1.92 for the exponent b, 95% CI (1.87, 1.96). The explained variance in this model was 91% (Pseudo-R2). That is, on average, the interpretation of the displayed quantities in a pictorial chart followed approximately a quadratic relationship.
The second research question dealt with the question whether the value b varied among participants. The second multilevel model (Model 2) with random slopes showed that the exponent b varied significantly among the participants, as a model comparison between the first and second model showed. The values ranged from the lowest value 1.4 to the highest value 2.7. Thirty-two of the participants (i.e., 51%) had an exponent between 1.75 and 2.25, that is, an approximately quadratic relationship. Several participants showed values in between two whole numbers for the exponent b. Twenty-three participants (37%) had an exponent between 1.25 and 1.75, and 8 participants (13%) had exponents between 2.25 and 2.75.
RQ3 addressed the issue of whether the estimation process depended on the picture in a pictorial chart. Therefore, in a three-level model (Model 3), a testlet effect was estimated by assuming a fixed effect of the testlet. This model fitted significantly better than Model 2, χ2(1) = 100.1, p < 0.001, and the explained variance was enhanced from 93.5 to 95.6%. Although the testlet effect was significant, its size was rather small. This model’s average value for the exponent b also was 1.92, 95% CI (1.83, 2.01). For the CO2 testlet, the value 0.04, 95% CI (0.01, 0.07) has to be added to this exponent; for the Garbage testlet, the value 0.06, 95% CI (–0.10, –0.03), has to be subtracted, and for the Sugar testlet, the value 0.02, 95% CI (–0.01, 0.05), has to be added.
Finally, the question was whether the estimation process was influenced by whether the pictures were enlarged or reduced (RQ 4). Model 4 did not improve the model fit in comparison with Model 3, χ2(1) = 0.13, p = 0.72, and the fixed effect (enlargement or reduction) did not significantly differ from zero, 95% CI (–0.09, 0.06). Detailed information about the results of the multilevel analyses can be found in Supplementary Material, File 2, Chapter B.
Discussion
The study showed that the participants applied, on average, an approximately quadratic relationship (b = 1.92) between the scale factor and the estimated quantity. That is, generally, the participants estimated the quantity in a pictorial graph based on the area of the picture. The b-values, however, differed among participants. None of the 63 participants could be identified to operate with a linear relationship or a cubic relationship when dealing with pictorial charts. The majority based their judgment on an approximately quadratic relationship (51%). A considerable proportion of the students (37%) had an estimation process in between a linear and a quadratic relationship. These students might have intended to estimate the area but did it in a biased manner because research has shown many people underestimate areas (e.g.,
Within the context of the theoretical considerations presented and prior empirical results from mathematics education and psychology, the experiment revealed some surprising results. First, the assumption that, in general, participants apply spatial considerations to a two-dimensional picture of a three-dimensional object cannot be corroborated. Second, the present study’s results seem to deviate from the results of several experiments that found a robust overgeneralization of linear models when pictures were provided in problem-solving tasks. However, the study’s empirical results align most closely with the findings regarding the perception and estimation of areas.
These results raise the question whether the different results from the research on the illusion of linearity and the present experiment can be reconciled. In research concerning the overgeneralization of linear models, the students were asked to calculate the area or an indirect measure of the area (e.g., the time to fertilize a piece of land). The students had to use arithmetic operations (e.g., addition and multiplication) to solve the problem. Research has shown that students looked for analogies when asked to solve a new problem (
The assumption that it matters whether students have to estimate the quantity represented based on visual perception or to calculate the quantities using arithmetic operations can be supported by theories concerning information processing of texts and pictures (e.g.,
With respect to the learning and teaching of mathematics, the experiment showed that tasks such as those in Figure 2 are problematic when the aspect of “misleading” is only judged theoretically as the NAEP coding guide does. The present experiment showed that even mathematically inclined persons did not base their quantity interpretations on real-world volume. Therefore, students must be sensitized to this issue on a more sophisticated level. However, further research in this field is necessary to infer more specific knowledge that can be taught in school about the interpretation of novel forms of data visualizations.
However, some limitations should be mentioned. First, the sample with mathematics teacher education students is selective. The question is whether the findings are generalizable to different samples (e.g., younger students or less mathematically educated individuals). It could be possible that mathematically inclined individuals interpret pictorial charts differently from people without a mathematics background. Furthermore, there could have been a priming effect, as the clouds were always presented first and could have prompted an estimate based on areas. Moreover, in future experiments, the picture’s effects in pictorial charts should be investigated further by using diverse types of pictures and varying them systematically. In a subsequent study, the presented results should be replicated using a more diverse sample and different pictures. A possible sequencing effect should be controlled for by permuting the testlets. Furthermore, it would be interesting to investigate whether providing a legend in a pictorial chart would affect the reader’s interpretation.
Conclusion
Some conclusions can be drawn from the present study in terms of the design of pictorial charts. Readers do not seem to interpret two-dimensional pictures of three-dimensional objects spatially. Therefore, chart designers probably should refrain from using pictures of three-dimensional objects to display quantities. With regard to the growing popularity of infographics (e.g.,
Statements
Data availability statement
The present study’s original data are included in the Supplementary Material, File 1, further inquiries can be directed to the author.
Ethics statement
Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
The author confirms being the sole contributor of this work and has approved it for publication.
Acknowledgments
I would like to thank the editor and the reviewers for helpful feedback which improved the manuscript substantially and Alexander Robitzsch for statistical support.
Conflict of interest
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.609027/full#supplementary-material
References
1
Allgemeiner Deutscher Automobil-Club (2017). Der erste Schritt [The first step].ADAC-Motorwelt6910–16.
2
CairoA. (2013). The Functional Art: An Introduction to Information Graphics and Visualization.Berkeley, CA: New Riders.
3
De BockD.VerschaffelL.JanssensD. (1998). The predominance of the linear model in secondary school students’ solutions of word problems involving length and area of similar plane figures.Educ. Stud. Math.3565–83.
4
De BockD.VerschaffelL.JanssensD. (2002). The effects of different problem presentations and formulations on the illusion of linearity in secondary school students.Math. Think. Learn.465–89. 10.1207/s15327833mtl0401_3
5
EsteleyC. B.VillarrealM. E.AlagiaH. R. (2010). The overgeneralization of linear models among university students’ mathematical productions: a long-term study.Math. Think. Learn.1286–108. 10.1080/10986060903465988
6
GelmanA.HillJ. (2006). Data Analysis Using Regression and Multilevel/Hierarchical Models.Cambridge: Cambridge University Press.
7
GentnerD.HolyoakK. J.KokinovB. N. (eds) (2001). The Analogical Mind: Perspectives from Cognitive Science.Cambridge, MA: MIT Press.
8
HartleyA. A. (1981). Mental measurement of line length: the role of the standard.J. Exp. Psychol. Hum. Percept. Perform.7309–317. 10.1037/0096-1523.7.2.309
9
HuffD. (1954). How to Lie With Statistics.New York, NY: Norton.
10
JoramE.GabrieleA. J.BertheauM.GelmanR.SubrahmanyamK. (2005). Children’s use of the reference point strategy for measurement estimation.J. Res. Math. Educ.364–23.
11
JoramE.SubrahmanyamK.GelmanR. (1998). Measurement estimation. Learning to map the route from number to quantity and back.Rev. Educ. Res.68413–449. 10.3102/00346543068004413
12
KahnemanD. (2011). Thinking, Fast and Slow.New York, NY: Farrar, Straus and Giroux.
13
MayerR. E. (2014). “Cognitive theory of multimedia learning,” in The Cambridge Handbook of Multimedia Learning, 2nd Edn, ed.MayerR. E. (Cambridge: Cambridge University Press), 43–71. 10.1017/cbo9781139547369.005
14
MorganM. J. (2005). The visual computation of 2-D area by human observers.Vis. Res.452564–2570. 10.1016/j.visres.2005.04.004
15
National Assessment of Educational Progress NAEP (1992). Explain Why Graph is Misleading: Question ID 1992-8M15. Available online at: https://nces.ed.gov/NationsReportCard/nqt/Search(accessed January 6, 2021).
16
National Council of Teachers of Mathematics (2000). Principles and Standards for School Mathematics.Reston, VA: National Council of Teachers of Mathematics.
17
RaidveeA.ToomM.AverinK.AllikJ. (2020). Perception of means, sums, and areas.Attent. Percept. Psychophys.82865–876. 10.3758/s13414-019-01938-7
18
SchneiderB.BissettR. (1988). “Ratio” and “difference” judgments for length, area, and volume: are there two classes of sensory continua?J. Exp. Psychol. Hum. Percept. Perform.14503–512. 10.1037/0096-1523.14.3.503
19
StevensS. S. (1975). Psychophysics: Introduction to its Perceptual, Neural, and Social Prospects.New York, NY: Wiley.
20
StevensS. S.GuiraoM. (1963). Subjective scaling of length and area and the matching of length to loudness and brightness.J. Exp. Psychol.66177–186. 10.1037/h0044984
21
TufteE. R. (2001). The Visual Display of Quantitative Information, 2nd Edn. Cheshire, CT: Graphics.
22
Vlahović-ŠtetićV.Pavlin-BernardićN.RajterM. (2010). Illusion of linearity in geometry: effect in multiple-choice problems.Math. Think. Learn.1254–67. 10.1080/10986060903465871
23
YauN. (2011). Visualize This: The FlowingData Guide to Design, Visualization, and Statistics.Indianapolis, IN: Wiley.
Summary
Keywords
pictorial charts, illusion of linearity, problem-solving, cognitive processing, statistical literacy, data visualization
Citation
Rolfes T (2021) Interpretation of Quantities Displayed in Pictorial Charts. Front. Psychol. 12:609027. doi: 10.3389/fpsyg.2021.609027
Received
22 September 2020
Accepted
14 January 2021
Published
25 February 2021
Volume
12 - 2021
Edited by
Karin Binder, University of Regensburg, Germany
Reviewed by
Iddo Gal, University of Haifa, Israel; Daniel Frischemeier, University of Paderborn, Germany; Stephanie Budgett, The University of Auckland, New Zealand
Updates

Check for updates
Copyright
© 2021 Rolfes.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Tobias Rolfes, rolfes@leibniz-ipn.de
This article was submitted to Cognition, a section of the journal Frontiers in Psychology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.