Abstract
Actions that are chosen have properties that distinguish them from actions that are not. Of the nearly infinite possible actions that can achieve any given task, many of the unchosen actions are irrelevant, incorrect, or inappropriate. Others are relevant, correct, or appropriate but are disfavored for other reasons. Our research focuses on the question of what distinguishes actions that are chosen from actions that are possible but are not. We review studies that use simple preference methods to identify factors that contribute to action choices, especially for object-manipulation tasks. We can determine which factors are especially important through simple behavioral experiments.
Introduction
Actions make psychological activity tangible, for it is through actions that decisions are expressed. To be on the frontier of psychology, therefore, it is desirable not just to know what actions are chosen but also how they are. The actions of interest can be large-scale, as in deciding whether to stay in school or drop out; or they can be small-scale, as in raising one’s eyebrow or nodding in a way that conveys less than full agreement. The actions need not be communicative, however. They can be purely functional, as in reaching for a cup of coffee when one is alone. Such functional actions can also be carried out in different ways, quickly and assuredly, for example, or slowly and hesitantly.
Psychologists have paid little attention to the way actions are physically expressed. Instead, they have typically focused on the instrumental outcomes of behavior, the most famous example being B. F. Skinner’s research, in which rats pressed on levers or pigeons pecked on keys to get rewards or avoid punishments (e.g., Skinner, ). How the rats pressed the levers or how the pigeons pecked the keys were of less interest than which devices were activated when.
The restriction of focus to switch closures, whether achieved with limbs or beaks, is understandable when one’s methods of recording behavior are primitive. It is much easier to record which electrical switch is closed in a Skinner box than to quantify the detailed properties of movement trajectories. Still, the manner in which movements are made may be relevant not just for conveying subtleties of communication or for determining whether a task is performed confidently. How movements are made may also be relevant for shedding light on motor control itself.
Consider the simple act of pressing an elevator button. An elevator summoned by a button press is indifferent to the movements made to press the button. Still, the movements made to press the button are a concern for the person pressing the button. This is obvious for someone with a movement disability, but even for neurologically typical individuals, there is a non-trivial problem to be solved in pressing an elevator button. The number of possible joint configurations that let the finger press the button is limitless. In addition, for any given joint configuration achieved at the time of the press, the number of paths leading to that joint configuration is limitless as well. Finally, for every one of those paths to the final configuration, the timing possibilities are boundless, too. So even for a task as trivial as pressing an elevator button, the number of possible actions is infinite. A core question in motor control is how, for situations like this, particular actions are chosen.
Approaches to Action Selection
The problem of choosing actions in the sense just discussed was first recognized by Bernstein (), who referred to the matter as the degrees-of-freedom problem. As Bernstein appreciated, the degrees of freedom of the body exceed the degrees of freedom associated with the ostensive description of most tasks to be achieved. An elevator button, for example, has six (positional) degrees of freedom – the three spatial coordinates of its center, and the three orientation coordinates of its plane (pitch, roll, and yaw). The width of the button (governing its tolerance for aiming errors) is relevant as well, as is the force needed to complete the press. Summing up these degrees of freedom, there are eight of them.
The degrees of freedom of the body of a typical person intent on pressing a button are vastly greater. Considering only the skeleton, a person’s upper arm has three degrees of freedom (rotation about the x, y, and z axes), the forearm has two degrees of freedom (flexion/extension and twisting), and each finger joint adds its own degrees of freedom. Adding the joints of the spine, hip, knee, and ankle, still more degrees of freedom come along. How the head is oriented enters as well, how the eyes are oriented factors in, and so on. Quickly, the bodily degrees of freedom exceed the eight associated with the button, and this ignores the vicissitudes of the muscles affecting the joints and the nerves driving the muscles, which create an even greater explosion of possibilities.
Coupling
How can one make progress on the challenge of choosing particular actions when infinitely many achieve a task? In the literature on this topic three approaches have been taken. Two were pursued by Bernstein (). A third emerged after him.
One approach that Bernstein () pursued was to identify functional dependencies between effectors. Bernstein’s idea was that linkages between effectors could limit the degrees of freedom to be controlled.
At an abstract level, this approach can be appreciated by considering Figure 1, which shows, in one case, two independent points in a plane and, in the other, two points joined by a line of fixed length. In the first case, there are four degrees of freedom: the x and y values of point A, and the x and y values of point B. In the second case, there are three degrees of freedom: the x and y of one point and the angle of the line, whose length is fixed, from A to B. This simple example, adapted from Saltzman (), shows how coupling can reduce the degrees of freedom to be managed.
Figure 1
Does coupling exist in actual motor performance? The answer, resoundingly, is Yes. As noticed by von Holst (), when fish oscillate their dorsal fins and then start to oscillate their pectoral fins, the dorsal fin oscillations change. When von Holst asked human subjects to do something similar, raise and lower one outstretched arm at a fixed frequency and then at other frequencies, the oscillations of the control arm changed. Such limb interactions occur reliably and have been studied in detail (e.g., Swinnen et al., ).
What do these results imply about the degrees-of-freedom problem? They might be taken to suggest that dependencies between effectors obviate the problem, but there is a difficulty with this suggestion. Linkages are not fixed but rather come and go depending on what needs to be achieved. During speech, for example, the upper lip moves down toward the lower lip more quickly than usual if the lower lip rises more slowly than usual (and vice versa), but this is only true when the sound to be produced requires bilabial closure, as in “p” or “b.” It is not the case when the sound to be produced is a fricative, as in “f” or “v” (Abbs, ).
The manifestation of coupling also depends on how the task is presented. When the perceptual representation of the task is simplified, actions that are otherwise difficult to perform can be easy (Mechsner et al., ). Similarly, if the hands haptically track moving objects, staying in light touch with the objects while the objects move, two circularly moving objects turning at different frequencies can be haptically tracked essentially perfectly no matter what the frequency relation between them. By contrast, generating two circles with those same frequencies is nearly impossible if the circles are drawn through more conventional means, such as drawing them on a blackboard (Rosenbaum et al., ).
Mechanics
The second track that Bernstein () pursued to address the degrees-of-freedom problem was to appeal to exploitation of mechanics. His idea was that action control can be simplified by exploiting mechanical interactions between the body and outer world.
Examples of motor performance that reflect exploitation of mechanics abound. A delightful example concerns babies in Jolly Jumpers. Suspended in their little seats, dangling via elastic chords from firm hooks above, babies learn to push on the floor at just the right pace and force to get the most “bang for the buck” (Goldfield et al., ).
Once babies and toddlers learn to walk, they continue to exploit mechanics. During mature walking there is a stance phase and a swing phase for each foot. During the stance phase the foot is on the ground, whereas during the swing phase the foot is off the ground. During the swing phase there is remarkably little muscle activity once the swing is initiated. The swing is completed, however, because the leg is swung forward and then pulled down via gravity. It turns out that people switch from walking to running as locomotion speed increases at just the speed where leg lowering would occur more quickly than is achievable by letting gravity pulling the leg down. At this critical speed, the transition is made from walking (a series of controlled falls), to running (a series of controlled leaps) (Alexander, ).
Does exploitation of mechanics solve the degrees-of-freedom problem? Perhaps to some extent in some circumstances. For example, exploitation of mechanics has been shown to be a useful way to avoid copious computation for robot trajectories (Collins et al., ). Still, it is unclear how far one can go with this approach, for it fails to explain the richness and diversity of voluntarily shaped performance.
Constraints
If neither the coupling approach to the degrees-of-freedom problem nor the mechanics approach to the degrees-of-freedom problem fully solves the problem, what approach can do so? Toward answering this question, it is useful to return to the way we introduced the degrees-of-freedom problem earlier in this article. We noted that Bernstein () couched the problem in terms of the degrees of freedom of the body relative to the degrees of freedom associated with the ostensive description of the task to be achieved. The key phrase for us as psychologists is “ostensive description.” What we mean is that while a task description has some properties, the individual approaching the task adds more properties to the description – enough of them, in fact, to fully describe the problem and thereby, in effect, solve it. For example, if the task is “to press the elevator button,” the person about to perform this task might add more constraints, such as “… with an effector that can easily be brought to the button.” The effector might be the right index finger, but if the individual were holding a squirming baby, some other effector might be used instead.
Saying that constraints limit action choices raises the question of how scientists can identify those constraints. To begin with, note that if constraints limit the range of possible actions, the constraints that do so correspond to the features of actions that are performed. Similarly, actions that could achieve the task but are not performed lack those features. Not all constraints are equally important, however. If an elevator button must be pushed, it is probably more important to press the button with a finger than to carry one’s finger to the button with some desired average speed.
Given this pair of points – that constraints are mirrored in the features of selected actions and that some constraints are more important than others – the challenge for psychologists interested in action selection is to discover which constraints are more important than which others. Determining the ranking or weighting of constraints achieves two things. First, it obviates the need to say which constraints are relevant and which are not. That is, instead of adopting such a binary classification, all possible constraints can be, and indeed must be, included. What distinguishes the constraints, then, is their weights. Some constraints have large weights. Others have small weights, including weights that are vanishingly small (i.e., nearly zero or zero itself).
Second, the weights of the constraints define the task as represented by the actor. This point is of inestimable importance for psychology because so much of psychological research is about performance of one task or another – the Stroop task, the Flanker task, and so on. What a task is – how it is represented by someone performing it – is rarely considered, but the issue is core to understanding action selection and psychology more broadly. If a bus driver sees his task as setting people straight about how to enter his bus, then the way his passengers feel about him will be very different than if he sees his task as greeting his passengers as warmly as he can.
A mathematical formalism can help pave the way for where we will go with this. The formalism lets us depict tasks in an abstract “task space” (Figure 2) and lets us introduce a hypothesis about minimization of transitions within this space.
Figure 2
An elementary task, T, performed at time 1 can be defined as a vector of constraint weights, w1,1 for constraint 1, w2,1 for constraint 2, and so on, all the way up to constraint n at time 1.
The weights can be visualized as a point in task space, as seen in Figure 2. The axes of the space correspond to the weights (between 0 and 1) for the possible constraints. Figure 2 shows just two constraint weights, for graphical convenience. In this illustration, ellipses contain the possible weights for achieving a given elementary task. A single point within the ellipse is highlighted to show which weight combination is chosen.
It is also possible to consider series of elementary task solutions, as shown in the next equation, where we extend the first equation to one in which all the weights take on values for a range of times from time 1 up to time t:
Two task series are shown in Figure 2. In the case on the left, the first elementary task solution takes into account which point will be chosen for the second elementary task. In the right panel, though the set of possible solutions for the first elementary task is the same as in the left panel, the weighting pair chosen within it is different. The reason is that a different task is required next.
What we are saying is that actions may be selected in a way that minimizes transitions through task space. This idea has been appreciated before (e.g., Jordan and Rosenbaum, ) and is particularly well known in connection with speech co-articulation, where the way a sound is produced depends on what sounds will follow (Fowler, ).
Object Manipulation
In our laboratories at Penn State and Utah State, we have been concerned with manual control rather than speech control. Our particular interest within the domain of manual control has been object manipulation. Object manipulation is particularly interesting to us because we take a cognitive approach to action selection. In studies of object manipulation the same object can be used for different purposes. A pen can be used for writing or for poking, a knife can be used for slicing or for jabbing, and so on (Klatzky and Lederman, ). This feature of object manipulation makes the associated tasks attractive to us given our cognitive bent. The same participant can be exposed to the same object in the same position and can be instructed or otherwise induced to use the object with different goals. Differences in the way participants grasp or handle the object depending on the future task demands can be ascribed to differences in the participants’ mental states.
Order of planning
Yet another attraction of object manipulation is that one can study planning effects of different orders. One can look for first-order planning effects, reflecting the influence of the object being reached for in its present state; or one can look for second-order planning effects, reflecting the influences of what is to be done next with the object; or one can look for third-order planning effects, reflecting the influences of what is to be done after that; and so on (Rosenbaum et al., ). The highest-order planning effect that can be observed can be taken to reflect the planning span. For discussions of planning spans for speaking and typewriting, see Sternberg et al. () and Logan ().
As long as there are second- or higher-order planning effects in object manipulation, those effects can be viewed as manual analogs of speech co-articulation. We can, in fact, coin a phrase to highlight this association. Just as there are co-articulation effects for speech, we can say there might be “co-manipulation” effects for manual control.
One would expect co-manipulation effects if the cognitive substrates of co-articulation extended to manual behavior. Saying this another way, to the extent that manual control is present in many animals whose evolutionary past does not yet equip them with the capacity for speech, the capacity for co-manipulation may set the stage for co-articulation.
Naturalistic observation
Granted that co-manipulation would be interesting to discover, how could one look for it? A first thought is to observe the microscopic features of manual behavior in the laboratory, taking advantage of technical systems for recording and quantifying properties of limb movements (e.g., Cai and Aggarwal, ). We have used such systems in our research (e.g., Studenka et al., ). However, the method we have generally favored has been simpler. We have preferred to observe behavior in situations where there are two easily observed ways of grasping any given object, especially when one of those ways can be plausibly linked to what will be done with the object. We like this approach because it can be pursued in the everyday environment, permitting or, better yet, encouraging, naturalistic observation.
It was, in fact, a naturalistic observation that paved the way for most of the research to be described in this article. While the first author was eating at a restaurant, he observed a waiter filling glasses with water. Each glass was inverted and the waiter had to turn each glass over to pour water into it. The waiter grasped each glass with his thumb down, whereupon he turned the glass over and poured water into the glass, holding the glass with his thumb up. Finally, he set the filled glass down, keeping his thumb up, and then proceeded to the next glass, turning his hand to the thumb-down position as he prepared for the next episode of glass filling.
The usual way of reaching for a glass is, of course, to take hold of it with a thumb-up posture. Why, then, did the waiter grasp the glass with his thumb down? Grasping an inverted glass with a thumb-down posture afforded a thumb-up hold when the waiter poured water into the glass and then set it down on the table. If the glass had been picked up with the thumb up, the resulting thumb-down posture would have made the subsequent pouring and placement awkward. At extreme forearm rotation angles (e.g., thumb-down angles) as compared to less extreme forearm rotation angles (e.g., thumb-up angles), rated comfort is lower (Rosenbaum et al., , , ), muscular power is lower (Winters and Kleweno, ), joint configuration variance is higher (Solnik et al., ), and maximum oscillation rates, which are critical for quick error correction, are lower as well (Rosenbaum et al., ). For any of these reasons, it made sense for the waiter to grasp each inverted glass as he did.
Two-alternative forced choice procedure
The waiter’s adoption of a thumb-down posture was consistent with the model shown in Figure 2. The waiter’s decision to grasp the glass thumb-down shows that he was aware of (or had learned) what he would do next with the glass, so his action selection reflected second-order (or possibly higher-order) planning.
The waiter’s maneuver was detected in a single naturalistic observation, so it was important to replicate the result in the laboratory. The laboratory method that was used relied on the two-alternative forced choice procedure. The two alternatives per trial were readily categorized actions, either of which was possible for the task at hand but only one of which was typically preferred (or expected to be preferred) over the other.
The logic of the approach was to find out how often one alternative was favored over the other depending on the nature of the choice difference. The approach proved useful, as indicated in the raft of studies that have used it (Rosenbaum et al., ). In the present article, we cover some of the major results of this work, including several findings that emerged after preparation of the review article just cited. Specifically, we review (1) findings that have been obtained about choice of grasp orientation, both in neurologically typical and neurologically atypical adults and children and in non-human primates; (2) findings concerning grasp locations along objects to be moved; and (3) findings concerning selection of actions that involve walking as well as reaching.
Grasp orientation in healthy young adults
The first laboratory test of the tendency to select initially distinct grasp orientations in the service of later grasp orientations (Rosenbaum et al., ), involved presenting university students with a horizontally oriented wooden dowel resting on stands beneath the dowel’s ends (Figure 3). One end of the dowel was white; the other end was black. A circular disk target was placed on either side of the stand, closer to where the participant stood, and the participant was asked to reach out with the right hand to grasp the dowel and place either the black end or white end into a specified target. The task used a two-alternative forced choice method, though the two alternatives were not explicitly named for the participants. They could either grasp the dowel with an overhand (palm down) grasp, or they could grasp the dowel with an underhand (palm up) grasp. The dowel placement could likewise end in either of two ways: with a thumb-up posture or with a thumb-down posture. Ratings from the participants indicated that they found the thumb-down posture uncomfortable. In addition, they found the underhand (palm-up posture) less uncomfortable, and they found the overhand (palm-down posture) and thumb-up posture least uncomfortable (most comfortable).
Figure 3
For the action rather than the rating task, the main result was that participants consistently chose an initial grasp orientation that facilitated a thumb-up posture when the dowel was placed onto the target. When the participants were asked to place the black (left) end of dowel in the target, they picked up the dowel with an overhand grasp, which allowed them to end in a thumb-up orientation. By contrast, when participants were asked to place the white (right) end of the dowel in the target, they picked up the dowel using an underhand grasp, which also allowed them to end in the same thumb-up orientation. Regardless of the end that needed to be placed on the target, therefore, participants altered their initial grasps in a way that ensured a comfortable final grasp orientation. Rosenbaum et al. (
After this first laboratory demonstration of the end-state comfort effect, many studies confirmed that the tendency to prioritize the grasp orientation at the end of a movement emerges in a wide variety of tasks. It was found that participants showed a preference for end-state comfort when the dowel task was reversed, so a vertical dowel was brought to a horizontal resting position; the final posture was a comfortable palm-down posture (Rosenbaum et al.,
Figure 4

Rotation task studied by Rosenbaum et al. (
The end-state comfort effect emerged not only in single-hand tasks, as just described, but also in bimanual tasks. In a bimanual version of the dowel transport task, participants grasped two horizontal dowels, one with each hand, and moved them to two vertical positions (Weigelt et al.,
Subsequent studies showed that precision rather than end-state comfort per se may be the decisive factor in second-order grasp planning. Short and Cauraugh (
All the results summarized in the last paragraph indicate that the term “end-state comfort” may be a misnomer. Ending in a comfortable state may be less important than occupying postures affording the most control. For further evidence, see Künzell et al. (
Grasp planning in non-human animals
The evidence just reviewed suggests that consideration of grasp orientation is an important constraint guiding action selection in object manipulation, at least in neuro-typical college students. Is this factor also important in other populations?
Consider first performance by non-human primates. Studies of object manipulation in non-human primates have shed light on the evolutionary history of the cognitive capacities underlying manual action selection. Weiss et al. (
Figure 5

A cotton-top tamarin performing the cub extraction task of Weiss et al. (
When the cup was upright, the tamarins grasped the stem with a typical thumb-up orientation. More interestingly, when the cup was inverted, the tamarins grasped the stem with an atypical thumb-down orientation. In the latter case (as in the former) the monkeys ended with the glass held thumb-up (see Figure 5). Thus, the tamarins, like college students and waiters, prioritized comfort (or presumed comfort) of final grasp orientations over prioritized comfort (or presumed comfort) of initial grasp orientations. This outcome suggests that the cognitive substrates for second-order grasp planning may have been in place as long as 45 million years ago, when the evolutionary line leading to tamarins diverged from the evolutionary line leading to humans (Figure 6).
Figure 6

Evolutionary tree stemming for a common primate ancestor to prosimians (e.g., the ring-tailed lemur shown here), which departed from the anthropoid line approximately 65 million years ago; to New World monkeys (e.g., the cotton-top tamarin shown here), which departed from the anthropoid line approximately 45 million years ago; to Old World monkeys (e.g., the macaque shown here), which departed from the anthropoid line approximately 30 million years ago; and to Homo sapiens (e.g., Charles Darwin shown here).
Can the lineage for such planning be placed even farther back in time? Chapman et al. (
Figure 7

A ring-tailed lemur grasping an inverted cup’s stem using a thumb-down posture. The lemur then inverted the cup to remove a raisin from it. (Image fromChapman et al.,
A final remark about evolution is that one would expect the planning ability indexed by grasp planning also to exist for old world monkeys and apes; otherwise, there would be a disconcerting “hole” in the picture. Rhesus monkeys (Nelson et al.,
Grasp planning in babies, toddlers, and children
What about ontogenetic rather than phylogenetic development? In humans, the species whose ontogenetic development is of most interest to us, first-order grasp planning takes hold within the first year of life. Babies modify their grasps according to the properties of objects they reach for. The relevant literature is briefly reviewed in a textbook about motor control written mainly for psychologists (Rosenbaum,
In terms of the development of second-order grasp planning, such planning appears in some toddlers at around 18 months of age (Thibaut and Toussaint,
Several studies have also investigated child clinical populations. Autistic children and mildly learning-disabled children show less sensitivity to final grasp orientation than do age-matched controls (Hughes,
Grasp planning in adult clinical populations
Studies of adult clinical populations have also revealed grasp-planning deficits. In a task requiring participants to grasp a dowel and rotate it to different positions, individuals with visual agnosia did not consistently choose initial grasps that facilitated comfortable grasp orientations at the ends of the rotations (Dijkerman et al.,
Grasp height
Constraints that come into play in planning for object manipulation are not only revealed by grasp orientations; they are also revealed by grasp locations. For example, when grasping a glass to place it on a high shelf, a person might grasp the glass low, near the base, to avoid an extreme stretch during the placement. Similarly, when grasping a glass to place it on a low shelf, the same person might grasp the same glass higher to avoid an extreme downward stretch.
These expectation were borne out in a naturalistic observation made by the first author at his home in the midst of returning a toilet plunger to its normal position on the floor. The details of the incident are unimportant. We will spare you! Suffice it to say that the type of manipulandum for which the phenomenon first appeared proved useful in laboratory experiments, where a fresh plunger was used.
Participants were asked to place the plunger onto shelves of different heights (Cohen and Rosenbaum,
Figure 8

Two of the conditions studied by Cohen and Rosenbaum (
Figure 9

The grasp height effect. FromCohen and Rosenbaum (
This observed relation, which Cohen and Rosenbaum (
Another finding from the study of Cohen and Rosenbaum (
A subsequent study showed that it was the location on the plunger shift rather than the posture that participants recalled for the return moves. Weigelt et al. (
Reaching and Walking
The studies reviewed above concerned choices of grasps for forthcoming object manipulations. The studies provided evidence for second-order planning at least. The studies showed that grasps are not just adjusted according to the immediate demands of taking hold of an object based on its currently perceived properties (first-order planning), but instead also depend on what will be done with the object afterward. For evidence that grasp planning can go beyond the second-order, see Haggard (
Grasp features are not the only aspects of behavior that provide evidence for higher-order object-manipulation planning. Consider a study by Studenka et al. (
Standing for object manipulation
Whereas Studenka et al. (
Little research has been done on whole-body planning of object manipulation, but some work has been done on it in our lab at Penn State. van der Wel and Rosenbaum (
The main result was that participants preferred to stand on the foot opposite the direction of forthcoming object displacement if the displacement was large. If the displacement was small, participants displayed no foot preference at the time of manual displacement.
Why did participants stand on the opposite foot for large displacements? Doing so made it possible for participants to rock in the direction of the upcoming manual displacement, landing on the foot ipsilateral to the placement. No such rocking was observed when the manual displacements were small.
What was the effect of the participants’ initial distance from the table? To the surprise of van der Wel and Rosenbaum (
Figure 10

Mean observed proportion of trials in which participants stood on the right foot when they grasped a plunger to move it far to the left, near to the left, near to the right, or far from the right, plotted as a function of the distance from the table at the start of each trial. Fromvan der Wel and Rosenbaum (
The latter hypothesis was confirmed through an analysis of changes in step lengths as a function of starting distance from the table. van der Wel and Rosenbaum (
These results, along with the others summarized in this section, suggest that participants could project themselves into the positions they would need (or want) to adopt for the manual transfers they would perform.
Walking for object manipulation
If people can mentally project themselves to future body positions, might they also be able to project themselves moving through those positions? Might they, in other words, be able to imagine themselves carrying out object manipulations while moving through the environment – for example, while grabbing items from a supermarket shelf during a trip down the aisle?
That people can coordinate their reaching and walking in cognitively impressive ways was shown by Marteniuk and Bertram (
Figure 11

Vertical displacement of a hand-held cup as a function of horizontal displacement of the same cup when standing (left column) or walking (right column) and when the data are plotted in extrinsic spatial coordinates (top row) or intrinsic joint coordinates (bottom row). Adapted fromMarteniuk and Bertram (
This finding is reminiscent of a classic result reported 20 years earlier. In that study, Morasso (
In the walk-and-reach study of Marteniuk and Bertram (
In one of our experiments (Rosenbaum et al.,
Figure 12

Three arrangements used by Rosenbaum et al. (
Given these possible arrangements, it was possible to study the costs of walking versus reaching. In some conditions, participants had no conflict between these two costs. For example, participants had no conflict if the bucket was near the left edge of the table, the left target was close, and the right target was far away (top panel of Figure 12). However, if the bucket was near the right edge of the table, the left target was nearby, and the right target was far away (middle panel of Figure 12), participants had a conflict. In that case, participants could either walk along the right side of the table, reaching less but walking more, or they could walk along the left side of the table, reaching more but walking less. Finally, in terms of the examples reviewed here (just some of the conditions tested), if the bucket was in the middle of the table and the left target was farther away than the right (bottom panel of Figure 12), participants could walk less by walking along the right side of the table, or they could walk more, walking along the left side of the table, reaching just as far in both cases. If they walked more, they would have to use the less favored hand (the left hand for the participants in this study).
So what was more important, walking less or reaching with the hand that was preferred? With the tasks used, which go beyond those reviewed above, Rosenbaum et al. (
Figure 13

Probability, p(L), of choosing to walk along the left side of the table (Rosenbaum,
Two further remarks are worth making about the study just reviewed. First, the study was aimed at showing how different kinds of costs are considered together. A priori, it is not obvious how walking costs and reaching costs are co-evaluated in the planning of walking and reaching. The study just summarized shows that it is possible to find a common currency for evaluation of the two kinds of costs. That common currency is (or is analogous to) “functional distance,” defined as the weighted combination of walking distance and reaching distance. Presumably, the weights would change if walking were challenged more (e.g., by adding leg loads) or if reaching were challenged more (e.g., by adding wrist loads). Being able to estimate mathematical weights such as these is central to the general approach outlined here because, as stated in the introduction of this paper, we believe that tasks can be represented as vectors of weights for dimensions on which tasks vary (see Figure 2).
The second remark is that the study just reviewed was done by having participants actually walk and reach in the environment depicted in Figure 12. The study was later repeated by showing a new group of participants (another group of Penn State undergraduates) pictures of the environment in which the real task had been done, photographed from the perspective of someone standing where participants stood at the start of each real-action trial (Rosenbaum,
The result of the virtual-action study was that the choices participants made when they indicated how they would do the task were almost identical to the choices made by participants who actually did the task. The result lent credence to the impression that Rosenbaum et al. (
It also happened that in the virtual-action study of Rosenbaum (
Did it make sense that participants did not rely on serial simulations to choose their actions in this reach-and-walk task? Rosenbaum (
Conclusion
The research summarized in this article has been concerned with choosing between actions expressed at the relatively low level of carrying out movements, especially with the hands and legs in the context of object manipulation. As noted in the introduction, there has been relatively little attention paid to the motor system in psychology, which is odd considering that psychology is the science of mental life and behavior, whereas motor control is the science of how one gets from mental life to behavior.
The latter definition might not be the one that most motor-control researchers spontaneously provide when asked to define their field, for most motor-control researchers typically come from engineering or neuroscience. That issue aside, it is not always clear that to understand motor control, one must invoke mental states. Some aspects of motor control are explicitly removed from mental states in that they rely on mechanical properties of the neuro-muscular and skeletal system, sometimes obviating the need for planning or control, as discussed in Section “Mechanics.” Similarly, reflexive (highly automatic) responses might not require extensive mental involvement. Even in the case of simple tasks where reflexes seem sufficient, mental states turn out to have a tuning function, as reviewed in Section “Coupling.” Thus, mental states are essential for motor control, just as motor control is essential for the expression of mental states.
Why motor control has received short shrift in psychology is an interesting topic that, among other things, tells psychologists about their values (Rosenbaum,
Even with such primitive materials, however, we have arrived at some useful conclusions. The first of these is that different tasks can be represented in terms of the weights assigned to different performance variables. No matter how obvious this point is, it actually diverges from a prevailing view in engineering-inspired motor-control research – namely, that there is some single optimization variable that governs motor control. Various candidates for this single optimization variable have been suggested over the years, including minimization of mean squared jerk (Hogan,
Our second conclusion is that identifying the priorities of constraints for a task need not be viewed as an elusive goal. Instead, it is a reachable goal if one is willing simply to try to find out which means of achieving a task are preferred over others. All the presently reviewed experiments (from our lab) had this goal. What was common to all the experiments was the aim of determining which performance variables participants cared about more than others. To answer this question, we relied on ratings, measures of performance quality, and, especially, two-alternative forced choice preferences.
Our third and final conclusion concerns embodied cognition. This has become a very popular topic lately. The embodiment perspective is one that we find congenial given our interest in motor control, but the discussion of embodiment has glossed over the details of motor performance. Saying that perception implicitly calls up a response is fine as far as it goes, but a “response” is actually an equivalence class of possible movement solutions, as detailed here. Therefore, turning to a familiar example from the embodied-cognition literature (Glenberg and Kaschak,
Statements
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AbbsJ. H. (1986). “Invariance and variability in speech production: a distinction between linguistic intent and its neuromotor implementation,” in Invariance and Variability in Speech Processes, eds PerkellJ. S.KlattD. H. (Hillsdale, NJ: Erlbaum), 202–219.
2
AlexanderR. M. (1984). Walking and running. Am. Sci.72, 348–354.
3
BernsteinN. (1967). The Coordination and Regulation of Movements. London: Pergamon.
4
CaiQ.AggarwalJ. K. (1999). Tracking human motion in structured environments using a distributed-camera system. IEEE Trans. Pattern Anal. Mach. Intell.21, 1241–1247.10.1109/34.809119
5
ChapmanK. M.WeissD. J.RosenbaumD. A. (2010). The evolutionary roots of motor planning: the end-state comfort effect in lemurs. J. Comp. Psychol.124, 229–232.10.1037/a0018025
6
CisekP. (2012). Making decisions through a distributed consensus. Curr. Opin. Neurobiol.22, 927–936.10.1016/j.conb.2012.05.007
7
CoelhoC. J.NusbaumH. C.RosenbaumD. A.FennK. M. (2012). Imagined actions aren’t just weak actions: task variability promotes skill learning in physical practice but not in mental practice. J. Exp. Psychol. Learn. Mem. Cogn.38, 1759–1764.10.1037/a0028065
8
CohenR. G.RosenbaumD. A. (2004). Where objects are grasped reveals how grasps are planned: generation and recall of motor plans. Exp. Brain Res.157, 486–495.10.1007/s00221-004-1862-9
9
CollinsS.RuinaA.TedrakeR.WisseM. (2005). Efficient bipedal robots based on passive-dynamic walkers. Science307, 1082–1085.10.1126/science.1107799
10
CrajéC.AartsP.Nijhuis-van der SandenM.SteenbergenB. (2010). Action planning in typical and atypical developing children. Res. Dev. Disabil.31, 1039–1046.10.1016/j.ridd.2010.07.010
11
CrajéC.van der KampJ.SteenbergenB. (2009). Visual information for action planning in left and right congenital hemiparesis. Brain Res.1261, 54–64.10.1016/j.brainres.2008.12.074
12
DijkermanH. C.McIntoshR. D.SchindlerI.NijboerT. C. W.MilnerA. D. (2009). Choosing between alternative wrist postures: action planning needs perception. Neuropsychologia47, 1476–1482.10.1016/j.neuropsychologia.2008.12.002
13
FischmanM. G. (1997). End-state comfort in object manipulation. Res. Q. Exerc. Sport, 68(Suppl.), A60. [Abstract].
14
FowlerC. A. (2007). “Speech production,” in The Oxford Handbook of Psycholinguistics, ed. GaskellM. G. (New York: Oxford University Press), 489–502.
15
FreyS. H.PovinelliD. J. (2012). Comparative investigations of manual action representations: evidence that chimpanzees represent the costs of potential future actions involving tools. Philos. Trans. R. Soc. Lond. B Biol. Sci.367, 48–58.10.1098/rstb.2011.0189
16
GlenbergA. M.KaschakM. P. (2002). Grounding language in action. Psychon. Bull. Rev.9, 558–565.10.3758/BF03196313
17
GoldfieldE. C.KayB. A.WarrenW. H. (1993). Infant bouncing: the assembly and tuning of action systems. Child Dev.64, 1128–1142.10.2307/1131330
18
GonzalezD. A.GlazebrookC. M.StudenkaB. E.LyonsJ. (2013). Motor interactions with another person: do individuals with autism spectrum disorder plan ahead?Front. Integr. Neurosci.7:23.10.3389/fnint.2013.00023
19
HaggardP. (1998). Planning of action sequences. Acta Psychol. (Amst.)99, 201–215.10.1016/S0001-6918(98)00011-0
20
HarrisC. M.WolpertD. M. (1998). Signal-dependent noise determines motor planning. Nature394, 780–784.10.1038/29528
21
HermsdörferJ.LaimgruberK.KerkhoffG.MaiN.GoldenbergG. (1999). Effects of unilateral brain damage on grip selection, coordination, and kinematics of ipsilesional prehension. Exp. Brain Res.128, 41–51.10.1007/s002210050815
22
HoganN. (1984). An organizing principle for a class of voluntary movements. J. Neurosci.4, 2745–2754.
23
HughesC. (1996). Planning problems in autism at the level of motor control. J. Autism Dev. Disord.26, 99–107.10.1007/BF02276237
24
JanssenL.BeutingM.MeulenbroekR.SteenbergenB. (2009). Combined effects of planning and execution constraints on bimanual task performance. Exp. Brain Res.192, 61–73.10.1007/s00221-008-1554-y
25
JanssenL.CrajéC.WeigeltM.SteenbergenB. (2010). Motor planning in bimanual object manipulation: two plans for two hands?Motor. Control.14, 240–254.
26
JohnsonD. M. (1939). Confidence and speed in the two-category judgment. Arch. Psychol.241, 1–52.
27
JordanM. I.RosenbaumD. A. (1989). “Action,” in Foundations of Cognitive Science, ed. PosnerM. I. (Cambridge, MA: MIT Press), 727–767.
28
JovanovicB.SchwarzerG. (2011). Learning to grasp efficiently: the development of motor planning and the role of observational learning. Vision Res.51, 945–954.10.1016/j.visres.2010.12.003
29
KlatzkyR. L.LedermanS. J. (1987). “The intelligent hand,” in Psychology of Learning and Motivation, Vol. 21, ed. BowerG. H. (San Deigo, CA: Academic Press), 121–151.
30
KünzellS.AugsteC.HeringM.MaierS.MeinzingerA.-M.SiessmeirD. (in press). Optimal control in the critical part of the movement: a functional approach to motor planning processes. Acta Psychol. (Amst.)
31
LoganG. D. (1983). “Time, information, and the various spans in typewriting,” in Cognitive Aspects of Skilled Typewriting, ed. CooperW. E. (New York: Springer-Verlag), 197–224.
32
ManoelE. J.MoreiraC. R. P. (2005). Planning manipulative hand movements: do young children show the end-state comfort effect?J. Hum. Mov. Stud.49, 93–114.
33
MarteniukR. G.BertramC. P. (2001). Contributions of gait and trunk movement to prehension: perspectives from world and body-centered coordinates. Motor Control5, 151–164.
34
MechsnerF.KerzelD.KnoblichG.PrinzW. (2001). Perceptual basis of bimanual coordination. Nature414, 69–73.10.1038/35102060
35
MorassoP. (1981). Spatial control of arm movements. Exp. Brain Res.42, 223–227.10.1007/BF00236911
36
NelsonE. L.BerthierN. E.MetevierC. M.NovakM. A. (2011). Evidence for motor planning in monkeys: rhesus macaques select efficient grips when transporting spoons. Dev. Sci.14, 822–831.10.1111/j.1467-7687.2010.01030.x
37
NewmanC. (2001). The Planning and Control of Action in Normal Infants and Children with Williams Syndrome. London: University College London. [unpublished doctoral dissertation].
38
RosenbaumD. A. (2005). The Cinderella of psychology: the neglect of motor control in the science of mental life and behavior. Am. Psychol.60, 308–317.10.1037/0003-066X.60.4.308
39
RosenbaumD. A. (2010). Human Motor Control, 2nd Edn.San Diego, CA: Academic Press/Elsevier.
40
RosenbaumD. A. (2012). The tiger on your tail: choosing between temporally extended behaviors. Psychol. Sci.23, 855–860.10.1177/0956797612440459
41
RosenbaumD. A.BrachM.SemenovA. (2011). Behavioral ecology meets motor behavior: choosing between walking and reaching paths. J. Mot. Behav.43, 131–136.10.1080/00222895.2010.548423
42
RosenbaumD. A.ChapmanK. M.WeigeltM.WeissD. J.van der WelR. (2012). Cognition, action, and object manipulation. Psychol. Bull.138, 924–946.10.1037/a0027839
43
RosenbaumD. A.CohenR. G.MeulenbroekR. G.VaughanJ. (2006a). “Plans for grasping objects,” in Motor Control and Learning over the Lifespan, eds LatashM.LestienneF. (New York: Springer), 9–25.
44
RosenbaumD. A.DawsonA. M.ChallisJ. H. (2006b). Haptic tracking permits bimanual independence. J. Exp. Psychol. Hum. Percept. Perform.32, 1266–1275.10.1037/0096-1523.32.5.1266
45
RosenbaumD. A.DawsonA. M. (2004). The motor system computes well but remembers poorly. J. Mot. Behav.36, 390–392.
46
RosenbaumD. A.HeugtenC.CaldwellG. C. (1996). From cognition to biomechanics and back: the end-state comfort effect and the middle-is-faster effect. Acta Psychol. (Amst.)94, 59–85.10.1016/0001-6918(95)00062-3
47
RosenbaumD. A.MarchakF.BarnesH. J.VaughanJ.SlottaJ.JorgensenM. (1990). “Constraints for action selection: overhand versus underhand grips,” in Attention and Performance XIII: Motor Representation and Control, ed. JeannerodM. (Hillsdale, NJ: Lawrence Erlbaum Associates), 321–342.
48
RosenbaumD. A.VaughanJ.BarnesH. J.JorgensenM. J. (1992). Time course of movement planning: selection of hand grips for object manipulation. J. Exp. Psychol. Learn. Mem. Cogn.18, 1058–1073.10.1037/0278-7393.18.5.1058
49
RosenbaumD. A.VaughanJ.JorgensenM. J.BarnesH. J.StewartE. (1993). “Plans for object manipulation,” in Attention and Performance XIV – A Silver Jubilee: Synergies in Experimental Psychology, Artificial Intelligence and Cognitive Neuroscience, eds MeyerD. E.KornblumS. (Cambridge: Bradford Books), 803–820.
50
SaltzmanE. (1979). Levels of sensorimotor representation. J. Math. Psychol.20, 91–163.10.1016/0022-2496(79)90020-8
51
SavelsberghG.van der KampJ.van WersmerskerkenM. (2013). “The development of reaching actions,” in The Oxford Handbook of Developmental Psychology, Vol. 1: Body and Mind, ed. ZelazoP. D. (New York: Oxford University Press), 380–402.
52
ShortM. W.CauraughJ. H. (1999). Precision hypothesis and the end-state comfort effect. Acta Psychol. (Amst.)100, 243–252.10.1016/S0001-6918(98)00020-1
53
SkinnerB. F. (1969). Contingencies of Reinforcement: A Theoretical Analysis. New York: Appleton-Century-Crofts.
54
SmythM. M.MasonU. C. (1997). Planning and execution of action in children with or without developmental coordination disorder. J. Child Psychol. Psychiatry38, 1023–1037.10.1111/j.1469-7610.1997.tb01619.x
55
SolnikS.PazinN.CoelhoC. J.RosenbaumD. A.ScholzJ. P.ZatsiorksyV. M.et al (2013). End-state comfort and joint configuration variance during reaching. Exp. Brain Res.225, 431–442.10.1007/s00221-012-3383-2
56
SternbergS.MonsellS.KnollR. L.WrightC. E. (1978). “The latency and duration of speech and typewriting,” in Information Processing in Motor Control and Learning, ed. StelmachG. E. (New York: Academic Press), 117–152.
57
StudenkaB. E.SeegelkeC.SchützC.SchackT. (2012). Posture based motor planning in a sequential grasping task. J. Appl. Res. Mem. Cogn.1, 89–95.10.1016/j.jarmac.2012.02.003
58
SwinnenS. P.HeuerH.CasaerP. (1994). Interlimb Coordination: Neural, Dynamical, and Cognitive Constraints. San Diego: Academic Press.
59
ThibautJ.-P.ToussaintL. (2010). Developing motor planning over ages. J. Exp. Child. Psychol.105, 116–129.10.1016/j.jecp.2009.10.003
60
UnoY.KawatoM.SuzukiR. (1989). Formation and control of optimal trajectory in human multijoint arm movement. Minimum torque-change model. Biol. Cybern.61, 89–101.10.1007/BF00204593
61
van der WelR. P.RosenbaumD. A. (2007). Coordination of locomotion and prehension. Exp. Brain Res.176, 281–287.10.1007/s00221-006-0618-0
62
von HolstE. (1939). Die relative Koordination als Phänomenon und als Methode zentral-nervöse Funktionsanalyze. Ergeb. Physiol.42, 228–306. [English translation in von HolstE. (1973). “Relative coordination as a phenomenon and as a method of analysis of central nervous functions,” in The Behavioural Physiology of Animal and Man: The Collected Papers of Erich von Holst, Vol. 1, Trans. MartinR.London: Methuen].10.1007/BF02322567
63
WalshM. M.RosenbaumD. A. (2009). Deciding how to act is not achieved by watching mental movies. J. Exp. Psychol. Hum. Percept. Perform.35, 1481–1489.10.1037/a0015799
64
WeigeltM.CohenR. G.RosenbaumD. A. (2007). Returning home: locations rather than movements are recalled in human object manipulation. Exp. Brain Res.149, 191–198.10.1007/s00221-006-0780-4
65
WeigeltM.KundeW.PrinzW. (2006). End-state comfort in bimanual object manipulation. Exp. Psychol.53, 143–148.10.1027/1618-3169.53.2.143
66
WeigeltM.SchackT. (2010). The development of end-state comfort planning in preschool children. Exp. Psychol.57, 476–482.10.1027/1618-3169/a000059
67
WeissD. J.WarkJ. D.RosenbaumD. A. (2007). Monkey see, monkey plan, monkey do: the end-state comfort effect in cotton-top tamarins (Saguinus oedipus). Psychol. Sci.18, 1063–1068.10.1111/j.1467-9280.2007.02026.x
68
WintersJ. M.KlewenoD. G. (1993). Effect of initial upper-limb alignment on muscle contributions to isometric strength curves. J. Biomech.26, 143–153.10.1016/0021-9290(93)90045-G
Summary
Keywords
action selection, degrees-of-freedom problem, motor control, behavioral psychology, choosing actions
Citation
Rosenbaum DA, Chapman KM, Coelho CJ, Gong L and Studenka BE (2013) Choosing Actions. Front. Psychol. 4:273. doi: 10.3389/fpsyg.2013.00273
Received
22 April 2013
Accepted
27 April 2013
Published
03 June 2013
Volume
4 - 2013
Edited by
Ezequiel Morsella, San Francisco State University and University of California, San Francisco, USA
Reviewed by
Ezequiel Morsella, San Francisco State University and University of California, San Francisco, USA; T. Andrew Poehlman, Southern Methodist University, USA
Copyright
© 2013 Rosenbaum, Chapman, Coelho, Gong and Studenka.
This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc.
*Correspondence: David A. Rosenbaum, Department of Psychology, 448 Moore Building, Pennsylvania State University, University Park, PA 16802, USA e-mail: dar12@psu.edu
This article was submitted to Frontiers in Cognition, a specialty of Frontiers in Psychology.
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.