Abstract
Humans can operate a variety of modern tools, which are often associated with different visuomotor transformations. Studies investigating this ability have shown that separate motor memories can be acquired implicitly when different sensorimotor transformations are associated with distinct (intended) postures or explicitly when abstract contextual cues are leveraged by aiming strategies. It still remains unclear how different transformations are remembered implicitly when postures are similar. We investigated whether features of planning to manipulate a visual tool, such as its visual identity or the environmental effect intended by its use (i.e. action effect) would enable implicit learning of opposing visuomotor rotations. Results show that neither contextual cue led to distinct implicit motor memories, but that cues only affected implicit adaptation indirectly through generalization around explicit strategies. In contrast, a control experiment where participants practiced opposing transformations with different hands did result in contextualized aftereffects differing between hands across generalization targets. It appears that different (intended) body states are necessary for separate aftereffects to emerge, suggesting that the role of sensory prediction error-based adaptation may be limited to the recalibration of a body model, whereas establishing separate tool models may proceed along a different route.
Similar content being viewed by others
Introduction
A hallmark of human motor skill is that we can manipulate a variety of different objects and tools. The apparent ease with which we switch between skilled manipulation of different tools requires that our motor system maintains representations of different sensorimotor transformations associated with them and retrieves these based on context1,2. For this to work, the brain is assumed to rely on contextual cues, i.e. sensations that allow the identification of the current context in a predictive manner (though see Lonini and colleagues3). This capacity has been investigated in dual adaptation experiments, where different cues are linked with different – often conflicting - sensorimotor transformations to determine the extent with which the cues enable the formation of separate visuomotor memories4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21. Whereas earlier studies have predominantly found that the posture or initial state of the body act as sufficient cues11,14,19,22, a number of more recent studies observed that distinct movement plans effectively separate memories for sensorimotor transformations16,18,23,24,25,26, even when these plans are not ultimately executed16.
As suggested by Sheahan and colleagues16, these findings can be unified under a dynamical systems perspective of neural activity27. Under this framework, neural states during movement execution are largely determined by a preparatory state prior to movement onset. Assuming that distinct states of the body as well as intended movements set distinct preparatory states, errors experienced during execution could therefore be associated with distinct neural states, thus establishing separate memories for novel transformations. While this idea is supported by recent findings showing that artificially induced neural states can serve as effective cues for the separation of newly formed sensorimotor memories28, these cues still pertain to intended states of the body such as visually observable movement outcomes or final postures.
In contrast, findings regarding more abstract context cues that are not directly related to the state of the body have been less consistent. For example, some studies have found color cues to enable dual adaptation7, while others have not14,22. Such inconsistent findings could be reconciled by the notion that motor memory can be subdivided into explicit and implicit types. These types are associated with different properties29,30,31,32,33 as well as neural processes34,35 and it is conceivable that they are also sensitive to different sets of context cues9,26. Thus, the effectiveness of color and other more abstract cues may be limited to cases in which participants become aware of the cues’ predictive power and develop distinct explicit action plans in response to them8,9,26.
In the use of modern electronic tools such as video game controllers or remotely controlled vehicles, however, there are many instances where similar postures or bodily states in general are associated with different sensorimotor transformations, yet skilled performers operate such tools effortlessly, suggesting that they have separate implicit memories of the respective transformations. Two features extrinsic to the body state that typically distinguish between different tools are (a) the visual representation of the effector that is controlled (as in the case of operating a drone or steering a virtual car by the same remote control) and (b) the action effect that can be produced by using the tool and thus that one strives to achieve. Thus, distinct preparatory states most likely incorporate features beyond bodily states, such as the identity of the tool which is operated and/or the nature of the intended action effect, suggesting that these may serve as cues to separate implicit memories.
Here, we considered the identity of the tool being controlled and the intended action effect as parts of a movement’s plan (i.e. its preparatory activity) and tested by which processes, implicit and/or explicit learning, these cues would allow for the development of separate motor memories. Based on a previous study by Howard and colleagues14, which showed that the visual orientation of a controlled object was modestly successful, we expected the visually perceived identity of a tool to constitute a relevant contextual cue in establishing separate implicit motor memories. To test this, participants practiced two opposing cursor rotations associated with different cursor icons or “tools”.
Our second approach was inspired by ideomotor theory, according to which actions are represented by their perceivable effects (see Stock and Stock36 for a review of its history). More specifically, it was based on a strong version of ideomotor theory claiming that effect anticipations directly trigger actions37. According to the theory of event coding38, effect anticipations are not limited to spatial properties, but can refer to any remote or distal sensory consequences anticipated in response to an action. The direct-activation hypothesis has received empirical support from neurophysiological studies showing that the mere perception of stimuli that had been established as action effects during a preceding practice phase were able to elicit neural activity in motor areas39,40,41. If we allow effect anticipations to be part of a neural preparatory state under the above view, this suggests that distinct action effects that a learner intends to achieve should allow distinct sensorimotor transformations to be associated with them. If confirmed, this would extend the state space relevant for the separation of implicit motor memory from physical to psychological dimensions42,43 and thereby potentially explain separation of this memory for movements with similar body states. To test this, we investigated how participants adapted to two opposing visuomotor cursor rotations when these were associated with different action effects.
Finally, we conducted a control experiment where we tested if the use of separate hands and thus clearly distinguishable bodily states would cue distinct implicit motor memories of the opposing visuomotor transformations. Given that different effectors can be considered different states of the body and that intermanual transfer of adaptation is limited30,44,45, we hypothesized that this would lead to clearly separate implicit memories for the two transformations.
Results
Experiment 1: Visual tools
The goal of experiment 1 was to determine if different visual tools could afford dual adaptation to conflicting sensorimotor transformations. In alternating blocks, participants practiced overcoming two opposing 45° visuomotor rotations by controlling two different visual tools, either a cartoon of a hand or an arrow cursor. (We note that these cues were also associated with separate regions of the visual workspace, i.e. left and right half of the screen in experiment 1 and 2 (Figs. 1A, 2A), but replication without this feature in experiment 4 suggests that it did not substantially affect results, which we therefore discuss as pertaining to the visual tool cue). The clockwise and counterclockwise perturbations were uniquely associated with either the hand or arrow cursor, counterbalanced across participants. To distinguish whether the context cue enabled separate memories to be formed and retrieved implicitly or through separate explicit motor plans26, we tested spatial generalization of learning under each cue differentially and dissociated total learning into explicit plans and implicit adaptation by a series of posttests46.
Within a few blocks of practice, all participants were able to compensate for the opposing rotations (Fig. 2B). Total learning, which is believed to comprise both explicit and implicit contributions, generalized broadly across directions in a pattern that is suggestive of dual adaptation (Fig. 2C). Much of the dual adaptation could be attributed to different explicit judgments (Fig. 2D) for each tool, while aftereffects appeared to contribute very little to the total learning (Fig. 2E). Note that, by “aftereffects”, we refer to changes in pointing performance in trials in which participants had been instructed that the rotations were absent.
What’s more, the pattern of generalization of the aftereffects appeared to be similar for each tool and exhibited a bimodal shape (Fig. 2E). We have previously shown that this bimodal aftereffect pattern can be explained by plan-based generalization24,25,26. Under this explanation, implicit adaptation accumulates locally, yielding Gaussian-like generalization peaks that center on the movement plan24,25. Dual adaptation paradigms produce opposing peaks that cancel out when the movement plans determining their centers overlap, but may persist locally when these generalization centers are separated by plans pointing in different directions26. The bimodal patterns in our present data therefore suggest that the cues did enable implicit dual adaptation indirectly by cuing separate explicit movement plans, similar to what we have already shown for the visual workspaces cue alone26,47. However, it appears there was no direct effect of the cues on implicit learning, since aftereffects across target directions were not contextualized, i.e. did not differ between the two cue levels.
As our primary goal was to determine if distinct tools could serve as cues to separate implicit visuomotor memories, we sought to further characterize the pattern of interference (or generalization) of the aftereffects. Here, we found that the mean aftereffects across generalization targets were fit better by the sum of two Gaussians (“bimodal” Gaussian) than a single Gaussian (ΔBIC: 16.1 for cued CW rotation, 17.0 for cued CCW rotation), which is consistent with our previous findings26. The gain parameters had opposite signs and their respective bootstrapped confidence intervals did not include zero (Table 1), suggesting that adaptive changes in response to both rotations were represented in each generalization function. The locations and signs of the peaks comply with what we previously explained by implicit adaptation for each of the two practiced rotations generalizing narrowly around the cue-dependent explicit movement plans26. Here, the bimodal curve can be thought of as the sum of these independent generalization functions, where the two modes reflect the two opposite peaks of the individual functions and interference is maximal at the practiced target. Importantly, confidence intervals of differences between bootstrapped parameters for the two curves included zero (Table 1), indicating that adaptation retrieved under the two context cue levels did not differ significantly. In summary, we take these results to show that visual tools did not cue separate implicit visuomotor memories, except indirectly, mediated by plan-based generalization around separate explicit movement plans.
Experiment 2: Action effects
Motivated by ideomotor theory37, experiment 2 tested whether implicit memories of opposing transformations could be acquired and retrieved separately when they were associated with different intended effects of the motor action. For this purpose, participants were instructed that they should either “paint” or “explode” the target. The current effect was announced by an on-screen message at the beginning of each block and participants saw an animation of a brushstroke (paint-cue) or an explosion (explode-cue) where their cursor crossed the specified target amplitude and heard respective sounds. Again, we retained separate visual workspaces as in our previous experiments, but experiment 4 indicates that this additional cue of workspace separation did not substantially affect the observed results.
The results show no relevant qualitative differences compared to the visual tool cue used in experiment 1. Participants quickly compensated for both rotations during practice (Fig. 3B). Total learning and explicit judgments compensated for the rotations in a cue-dependent fashion and generalized broadly (Fig. 3C,D). Aftereffects (Fig. 3E) displayed a bimodal pattern (ΔBIC CW: 19.7, CCW: 18.8) that is visually similar to that of experiment 1. The oppositely signed peaks again complied with plan-based generalization and bootstrapped parameters indicated no difference between the curves for the different cue levels (Table 1). It therefore appears that separate action effects were ineffective in cuing separate implicit memories for the opposing transformations, except as mediated by spatially separate explicit movement plans.
Experiment 3: Separate hands
As the first two context cues we tested were effective only via separate explicit strategies, we wanted to test a cue that would allow separate implicit memories to be created with relative certainty. Based on the findings that distinct body states cue separate implicit memories and that transfer of learning between hands is incomplete30,44,48, we reasoned that using different hands to practice the two rotations would be a promising approach. In experiment 3, a clockwise cursor rotation was therefore associated with left hand movements and visual display in the left half of the screen (left visual workspace), whereas a counterclockwise rotation was cued by right hand movements and right visual workspace display.
Similar to experiment 1 and 2, total learning and explicit judgments indicated that participants learned to compensate each rotation in a cue-specific fashion. Total learning at the practiced target almost completely compensated the rotation associated with each cue and relatively broad generalization to other targets occurred (Fig. 4C). Explicit judgments at the practiced target compensated about half of the cued rotation and also displayed a flat generalization pattern (Fig. 4D). Different than in the first two experiments, implicit aftereffects also showed a clear, cue dependent separation, with a single-peaked generalization pattern (Fig. 4E). This was supported by BIC being similar between single and bimodal Gaussian (ΔBIC CW: 1.9, CCW: 0.4, each in favor of the single Gaussian). The direction of the single Gaussians’ peaks depended on the hand cue, in line with each reflecting adaptation to the respective rotation practiced with that hand. Further, their locations were shifted off the practiced target in the direction consistent with plan-based generalization (Table 1). Interestingly, generalization appeared to be considerably wider than the peaks in the first two experiments and in previous studies25,49. Furthermore, we note that, despite separate implicit memories being established, implicit learning seemed incapable of accounting for the full cursor rotation, as it was supplemented by explicit strategies, in line with recent findings that the extent of implicit adaptation is limited50.
In summary, these results indicate that the cue combination of using separate hands in addition to the separate visual workspaces successfully cued separate visuomotor memories for both implicit adaptation and explicit strategies. As contextual separation of memories can be considered the inverse of transfer/interference between contexts, this is in line with findings suggesting that intermanual transfer of sensorimotor adaptation relies largely on strategies being flexibly applied across hand-context30,44 and that implicit learning transfers incompletely to the other hand30,45,48 (but see Kumar and colleagues51).
Experiment 4
In experiments 1 to 3, we retained the visual workspace cue from our previous experiments9,26 in addition to the novel cue in focus. Furthermore, the cues were already present during baseline, where they did not have any predictive value. Drawing parallels to classical conditioning, one might suspect that the association of new implicit memories with the contextual cues in experiment 1 and 2 was prevented by either of two mechanisms: first, the presence of the visual workspace cue could have led the brain to ignore the predictive value of additional cues, similar to blocking52, or compound conditioning53. In this case one of our added cues could have actually enabled implicit dual adaptation, but be blocked by the visual workspace cue taking responsibility for the difference in context and directing adaptive changes towards the explicit route26,47. Second, similar to latent inhibition54, the lack of a predictive cue value during baseline could have prevented the implicit learning system from considering them even after their predictive value had been established. In Experiment 4, we control for those two possibilities by testing dual adaptation with only the visual tool or the action effects cue, presented exclusively during rotation practice and posttests. Because experiment 3 already found separate hands to effectively cue separate implicit memories, we did not include separate hands in this experiment.
Whereas, it appeared initially that there were indeed cue-dependent aftereffects in addition to the bimodal pattern, inspecting individual data revealed that the separation was driven by only a few participants (Supplementary figure S1). We think that the most likely explanation for this is that the respective participants ignored the instruction to abandon strategies in our aftereffects posttest due to misunderstanding and therefore excluded these participants for our main analyses (two out of 22 participants from the “tool” group and four out of 26 participants from the “effect” group, see methods). We discuss potential alternative interpretations in the Supplementary Text.
Without the participants thus labeled outliers, total learning in both cue conditions came close to full, cue-specific compensation of the rotations and generalized broadly across targets (Fig. 5C,H), while explicit judgments compensated about half of the rotations in a cue-specific fashion and also generalized broadly (Fig. 5D,I). Aftereffects again displayed opposing peaks on either side of the practiced target (Fig. 5E,J), although the fits under the action effect cue were a little more unstable and the confidence interval on the gain parameter for the negative peak now included zero (Table 1). Importantly, the fits still did not differ between the cue levels (Table 1).
In summary, experiment 4 did not provide convincing evidence that the tool and effect cue enabled separate implicit memories to be formed by the implicit adaptation mechanism that typically underlies cursor rotation aftereffects. If the modifications made in this experiment indeed induced separate implicit memories in a few participants, this was likely by a different mechanism (see Supplementary Text), which may be interesting to investigate in future experiments.
Discussion
Based on the assumption that distinct preparatory states most likely incorporate features beyond bodily states, we considered the identity of a tool being controlled and the intended action effect as being part of a movement’s plan (i.e. its preparatory activity) and tested whether these cues would allow for the development of separate motor memories. We also distinguished between explicit and implicit forms of motor memories. Contrary to our expectation, neither distinct tools nor action effects appeared to produce separate implicit memories. Instead, the opposing transformations were represented in implicit memory only indirectly via local spatial generalization around explicit movement plans16,23,24,25,26. Consistent with previous findings10,13, it appears that separate implicit memories are inextricably linked to states of the movement or the body. Indeed, in a control experiment (experiment 3), we found that distinct aftereffects, an indicator for the development of separate implicit motor memories, formed when participants practiced the opposing visuomotor rotations with separate hands, which represent a strong cue within a bodily state space. Under the dynamical systems perspective invoked in the introduction16,27, these results would indicate that only past, current and future states of the body determine the preparatory state in areas relevant to implicit adaptation, while more abstract contextual cues that relate to the action but not to parts of the body, are processed differently.
Despite our findings, we know that people can manipulate a variety of complex tools with little cognitive effort, even if they share similar movement characteristics and workspaces. Thus, we would expect that humans are capable of separating and storing separate implicit memories based on cues that do not require distinct states of the body. This raises the question as to why studies have consistently failed to find contextual cues that do not depend on movement-related states6,20,22. One possibility lies in the way in which context was implemented during practice and testing: it is well possible that experimental parameters like the duration of practice, the frequency and schedule of change between transformation-cue-combinations7,55, or the way cues are presented in tests without visual feedback are responsible for the absence of implicit dual adaptation and it is a limitation of our study that we did not test different conditions. However, recent findings have shown that implicit adaptation in cursor rotation experiments approaches a fixed asymptote50, which suggests that even longer practice would not enable this implicit adaptation process to account for large-scale change in visuomotor relations. These findings thus align with ours in suggesting that learning transformations associated with tools and contexts may come about via mechanisms distinct from this canonical implicit adaptation.
What could be the nature of these mechanisms? Morehead and colleagues56 suggested that explicit movement plans are part of an action selection mechanism that can also operate implicitly, whereas implicit adaptation typically observed in cursor rotation experiments reflects a calibration mechanism for motor execution on a lower level. We speculate that the action selection level is where context-dependent learning of tool transformations occurs. Under this view, implicit, context-dependent learning could, for example, be achieved by proceduralization of strategies at the action selection level, in line with canonical views of skill learning35,57. Recent findings have shown that that new policies can be learned by exploration and reinforcement58,59, and that this is closely tied to explicit strategies60,61. A possibility is that explicit action selection tendencies may become proceduralized by associative learning. Consistent with this idea, recent findings indicate that stimulus-response associations in cursor rotation62,63,64 and visuomotor association paradigms65 can become “cached”, so that they are expressed by default in situations where cognitive processing resources are limited.
These roles we assign to action selection and execution are reminiscent of another canonical distinction in the motor learning literature, between the learning of body versus tool transformations66,67,68,69 giving rise to modifications of an internal representation of the body (body schema)70,71 and internal representations of tools, respectively72,73. Here, our results would suggest that aftereffects in standard cursor rotation experiments reflect a dedicated mechanism that keeps the system calibrated to minor changes in the transformations of the body, and is therefore sensitive to context regarding the state of the body, but not other aspects of the motor environment. Notably, limiting standard implicit adaptation to a body model does not necessarily contradict the idea that internal models and the cerebellum underlie tool transformations1,12,74. Recent neuroimaging and patient studies indicate that cerebellum-based internal models support not only the implicit75, but also the explicit component of visuomotor adaptation76,77. A possibility is that internal models support the selection of suitable actions by simulating their hypothetical outcomes78.
Within the theory of event coding (TEC)38 mentioned in the introduction, our findings can be explained along a similar route: TEC acknowledges that neural signatures underlying perception and action need to be distinct at the far ends of this continuum and common coding and effect-based representation of actions can therefore only occur on an intermediate level38. As such, our results would place implicit adaptation to cursor rotations towards the action side of processing, thus explaining why separate action effects did not enable separate learning in our study, but the use of separate effectors did.
Throughout this work, we chose to call visual tools, action effects and the limb used for execution a “contextual cue”, whereas we did not consider the different targets contextual cues that we utilized to test generalization. A more holistic view would be that the brain represents a multidimensional state space composed of psychological and physical dimensions and contextual separation is achieved by separation in any of these dimensions. Our choice to define a visuomotor memory as representing the physical space of the experiment is therefore an arbitrary one. Eventually, the question of how to define “contextual cue” therefore becomes the same as which contextual cues enable the formation of separate memories in which ways. In this sense, our findings mean that adaptation of the implicit body model reflected in aftereffects only responds to contextual cues that are directly related to the state of the body, whereas a supposed action selection component can in principle account for any contextual cue provided that the cue is either subject to overt attention or supported by a previously reinforced association. This may be taken to suggest that separate neural correlates of these learning processes represent our percept of the world and body in state spaces of different dimensionality.
One may suspect that our findings depend critically on the size of the visuomotor rotation investigated and that reducing the size of the rotation would have reduced explicit learning through error awareness, thereby boosting implicit learning. Whereas rotation size does modulate explicit learning79, it is currently unclear if explicit strategies modulate implicit learning, with some findings suggesting an influence80, whereas others suggest implicit learning to be relatively robust against strategy and rotation magnitude79,81. Nevertheless, it remains a possibility that smaller rotations could reveal context effects on implicit learning – an avenue for future research.
In conclusion, our results show that neither the visual identity of two digital tools nor the effect intended by their use did allow the formation of separate implicit motor memories under the conditions studied. While extended practice under different conditions may lead to more implicit learning, we take our results to suggests that this may not come about by one implicit internal model becoming differentiated into two, but rather by learners acquiring new action selection tendencies. These tendencies may be explicit, initially, and become habituated with practice62,63,64,65, or they could be acquired incidentally depending on practice conditions82, explaining how we handle those tools with little cognitive effort.
Methods
A total of one-hundred human volunteers participated in the study. All participants provided written, informed consent as approved by the local ethics committee of the Department of Psychology and Sport Science of Justus-Liebig-Universität Giessen and experiments were conducted in accordance with the relevant guidelines and regulations. To be included in analysis, participants had to be between 18 and 30 years old, right handed, have normal or corrected to normal visual acuity and were not supposed to have participated in a similar experiment, before. We therefore excluded 8 participants (5 for not being clearly right-handed according to the lateral preference inventory83, 2 for failing to follow instructions according to post-experimental standardized questioning, one for exceeding our age limit), giving us a total of 18 analyzed participants in experiment 1, 17 in experiment 2, and 20 in experiment 3.
Apparatus
The general task and protocol were similar to those described in our previous study26. Participants sat at a desk, facing a screen running at 120 Hz (Samsung 2233RZ), mounted at head height, 1 m in front of them (Fig. 1A). They moved a plastic sled (50 × 30 mm base, 6 mm height) strapped to the index finger of their right hand (and left hand, respectively, in experiment 3), sliding over a glass surface on the table, with low friction. A second tabletop occluded vision of their hands. Sled position was tracked with a trakSTAR sensor (Model M800, Ascension technology, Burlington, VT, USA) mounted vertically above the fingertip, and visualized by a custom Matlab (2011, RRID:SCR_001622) script using the Psychophysics toolbox (RRID:SCR_002881)84, so that participants controlled a cursor (cyan filled circle, 5.6 mm diameter or specific cursors in experiment 1).
Trial types
Trials began with arrows on the outline of the screen guiding participants to a starting position (red/green circle, 8 mm diameter) centrally on their midline, about 40 cm in front of their chest. Here, the cursor was only visible when participants were within 3 mm of the start location. After participants held the cursor in this location for 500 ms, a visual target (white, filled circle, 4.8 mm diameter) appeared at 80 mm distance and participants had to “shoot” the cursor through the target, without making deliberate online corrections. If movement time from start to target exceeded 300 ms, the trial was aborted with an error message.
Participants experienced 3 types of trials. On movement practice trials, they saw the cursor moving concurrently with their hand. Here, cursor feedback froze for 500 ms, as soon as target amplitude was reached. On movement test trials, we tested behavior without visual feedback meaning that the cursor disappeared on leaving the start circle. On explicit judgment trials46, we asked participants to judge the direction of hand movement required for the cursor to hit the target, without performing a movement. For this purpose, participants verbally instructed the experimenter to rotate a ray that originated in the start location to point in the direction of their judgment. During judgments, they were asked to keep their hand supinated on their thigh in order to discourage them from motor imagery. Accordingly, moving towards the start position was not required.
General task protocol
The experiment consisted of four phases: familiarization, pretests, rotation practice and posttests (Fig. 1B). Familiarization consisted of 48 movement practice trials to a target at 90° with veridical cursor feedback, thus requiring a movement “straight ahead”. The cue condition (see Specific experiments) alternated every 4 trials, with condition order counterbalanced across participants. Pretests contained movement practice tests and explicit judgment tests to establish a baseline for subsequent analysis. We tested generalization to 9 target directions from 0° to 180° at the amplitude of the practice target. We obtained one set per cue level, which in turn consisted of 3 blocks of randomly permuted trials to each of the 9 target directions for movement tests and one such block for explicit judgment tests. The sets were interspersed by blocks of 8 practice movements (4 per cue level) to the 90° target, to refresh participants’ memory (Fig. 1B). There were thus 104 trials in the pretests: 2 × 27 movement tests, 2 × 9 explicit tests, 4 × 8 movement practice trials.
In the subsequent rotation practice phase, participants performed 144 trials toward the practice direction with cursor movement being rotated relative to hand movement by 45°. The sign of the rotation switched between clockwise (CW) and counterclockwise (CCW) depending on the context condition, which here alternated every 8 trials. Before we first introduced the cursor rotation, we instructed participants that they would still control the cursor, but that the relation between the direction of hand and cursor movement would be changed and that this changed relation would be signaled by a red, instead of the already experienced green start circle.
Rotation practice was followed by a series of posttests to dissociate implicit, total and explicit learning. The posttests were structured like the pretests, except that the movement tests were repeated twice: the first repetition tested for implicit aftereffects by instructing participants to assume the rotation was switched off, reasoning that this would induce them to abandon potential aiming strategies and aim directly at the target. The second repetition tested for total learning by instructing them that the rotation was switched on. For the explicit judgment tests, the rotation was instructed as switched on to test for explicit knowledge about the cursor rotation. Throughout the experiment, the presence or absence of the rotation was additionally cued by the color of the starting position (green = switched off, red = switched on), which participants were repeatedly reminded of.
Specific experiments
The experiments differed in the type of contextual cue associated with the opposing cursor rotations. In all experiments, the rotation sign was associated with a visual workspace cue, meaning that start, cursor and target locations were presented with a constant y-axis shift of ¼ screen width (Fig. 1A). CW cursor rotation was always associated with display in the left half of the screen while CCW rotation was displayed in the right half. Hand movements were performed in a joint central workspace. We retained this for consistency with our previous experiments, where we found that it did not cue separate implicit memories and instead produced a pattern consistent with plan-based generalization9,26. Our main interest was thus on whether the added cues would enable separate implicit memories to be formed.
In experiment 1, the added cue was the visual identity of the cursor: participants either saw a hand icon or an arrow cursor. These cursor types were associated with the existing combination of visual workspace and cursor rotation in a way that was constant within, but counterbalanced across participants. As the cursor was visible once participants were in the vicinity of the start location, they could anticipate the upcoming rotation based on the cue in all movement trials. On explicit posttests, the cursor cue was attached to the far end of the ray that signaled participants response.
The added contextual cues for experiment 2 were two different action effects: Participants were instructed that they would have to either “explode” the target or “paint” it. The effect that participants should intend was prompted by a screen message at the beginning of each block (German: “Zerstören!” or “Anmalen!”). Accordingly, an animated explosion or brushstroke appeared at the location where the cursor crossed target amplitude, accompanied by respective sounds. As in experiment 1, action effects were fixed to visual workspaces and rotation direction within, but counterbalanced across participants. During movement tests without feedback, participants received the onscreen message before each block and the audio was played to remind them of the intended action effects.
In experiment 3, the additional cue was the hand used to conduct the movement, where we always associated the left hand with the left visual workspace and the right hand with the right visual workspace. At the beginning of each block, participants were prompted about which hand to use by an onscreen message and we asked them to rest the idle hand in their lap.
In experiment 4, participants were randomly assigned to two groups that received the “tool” or the “action effect” cue, respectively. Participants now saw all movements in a common visual workspace. Furthermore, context cues were not given during baseline and pretests and were only introduced together with the rotation. Matching of rotation sign to cue was counterbalanced across participants, as was the order of rotations presented to them. On aftereffect posttest, some participants displayed behavior that appeared to differ categorically from the majority of the group. We therefore labeled those participants whose mean aftereffects across all targets under either of the cues was outside two standard deviations of the group mean as outliers and excluded them from the main analyses. We show these participants’ performance and discuss alternative treatments in the Supplementary Material.
Data analysis
We performed data analysis and visualization in Matlab (RRID:SCR_001622) and R (RRID:SCR_001905). X- and y-coordinates of the fingertip were tracked at 100 Hz and low-pass filtered using MATLAB’s “filtfilt” command (4-th order Butterworth, 10 Hz cutoff frequency). We then calculated the movement-terminal hand direction as the angular deviation of the vector between start and hand location at target amplitude and the vector between start and target. We excluded the following percentages of trials for producing no discernible movement endpoints (usually because the trial was aborted): experiment 1: 5.3%, experiment 2: 4.4%, experiment 3: 3.6%, and an additional total of 24 trials for producing hand angles more than 120° from the ideal hand direction on a given trial. Explicit direction judgments were calculated as the deviation between the vector connecting the start position with the target and the participants’ verbally instructed direction judgement. To obtain our measures of aftereffects, total learning, and explicit judgments, we calculated the median of the three repetitions per target in each pre- and posttest, under each cue level, for each participant, and subtracted the individual median of pretests from their respective posttests to account for any biases85. As main outcome measure, we therefore report direction changes from pretest to the different posttests types, depending on test target direction and context cues.
Statistical analysis
As we were interested in whether or not the contextual cues enabled separate implicit memories, we focused on aftereffects and only report explicit judgments and total learning descriptively, for completeness. Furthermore, as generalization of explicit judgments appears to strongly depend on methodological details26,49, we would not claim universal validity of our findings in this respect. In our main analysis, we aimed to infer whether implicit aftereffects assessed under each cue reflected only the cued transformation, or both, and if aftereffects differed depending on the cue level. We therefore fit two candidate functions to the group mean aftereffect data obtained under each cue, respectively. In line with our previous reasoning26, we chose a single-peaked Gaussian to represent the hypothesis that aftereffects reflected only one learned transformation:
Here, y is the aftereffect at test direction x. Out of the free parameters, a is the gain, b the mean and c the standard deviation.
The hypothesis that aftereffects reflected two transformations was represented by the sum of two Gaussians:
For this, we assumed separate gains a1; a2 and means b1; b2 but a joint standard deviation c. For fitting, we used Matlab’s “fmincon” to maximize the joint likelihood assuming independent Gaussian likelihood functions for the residuals. We restarted the fit 100 times from different values selected uniformly from the following constraints: −180° to 180° on a, 0° to 180° on b-parameters, 0° to 180° on c, and subsequently compared the fits with the highest likelihood for each model by Bayesian information criterion (BIC), calculated as:
with n being the number of data points, k number of free parameters and lik the joint likelihood of the data under the best fit parameters.
In order to test if the generalization functions thus obtained differed significantly between the two context cues used in each experiment, respectively, we created 10000 bootstrap samples by selecting participants randomly, with replacement, and fitting on the across subject mean, starting from the best fit parameters of the original sample. For each sample, we calculated the difference between parameters obtained for each cue level. We considered parameters to differ significantly if the two-sided 95% confidence interval of these differences, calculated as the 2.5th to 97.5th percentile, did not include zero.
Data availability
The datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.
References
Higuchi, S., Imamizu, H. & Kawato, M. Cerebellar activity evoked by common tool-use execution and imagery tasks: An fMRI study. Cortex 43, 350–358 (2007).
Wolpert, D. M. & Kawato, M. Multiple paired forward and inverse models for motor control. Neural Networks 11, 1317–1329 (1998).
Lonini, L., Dipietro, L., Zollo, L., Guglielmelli, E. & Krebs, H. I. An internal model for acquisition and retention of motor learning during arm reaching. Neural Comput. 21, 2009–27 (2009).
Ayala, M. N., ‘t Hart, B. M., Henriques, D. Y. P. & ’t Hart, B. M. Concurrent adaptation to opposing visuomotor rotations by varying hand and body postures. Exp. Brain Res. 233, 3433–3445 (2015).
Heald, J. B., Ingram, J. N., Flanagan, J. R. & Wolpert, D. M. Multiple motor memories are learned to control different points on a tool. Nat. Hum. Behav. 2, 300–311 (2018).
Hinder, M. R., Woolley, D. G., Tresilian, J. R., Riek, S. & Carson, R. G. The efficacy of colour cues in facilitating adaptation to opposing visuomotor rotations. Exp. Brain Res. 191, 143–55 (2008).
Osu, R., Hirai, S., Yoshioka, T. & Kawato, M. Random presentation enables subjects to adapt to two opposing forces on the hand. Nat. Neurosci. 7, 111–112 (2004).
van Dam, L. C. J. & Ernst, M. O. Mapping Shape to Visuomotor Mapping: Learning and Generalisation of Sensorimotor Behaviour Based on Contextual Information. PLoS Comput. Biol. 11, 1–23 (2015).
Hegele, M. & Heuer, H. Implicit and explicit components of dual adaptation to visuomotor rotations. Conscious. Cogn. 19, 906–917 (2010).
Bock, O., Worringham, C. & Thomas, M. Concurrent adaptations of left and right arms to opposite visual distortions. Exp. Brain Res. 162, 513–519 (2005).
Ghahramani, Z. & Wolpert, D. M. Modular decomposition in visuomotor learning. Nature 386, 392–4 (1997).
Imamizu, H., Kuroda, T., Miyauchi, S., Yoshioka, T. & Kawato, M. Modular organization of internal models of tools in the human cerebellum. Proc. Natl. Acad. Sci. 100, 5461–6 (2003).
Galea, J. M. & Miall, R. C. Concurrent adaptation to opposing visual displacements during an alternating movement. Exp. Brain Res. 175, 676–688 (2006).
Howard, I. S., Wolpert, D. M. & Franklin, D. W. The effect of contextual cues on the encoding of motor memories. J. Neurophysiol. 109, 2632–44 (2013).
Howard, I. S., Ingram, J. N., Franklin, D. W. & Wolpert, D. M. Gone in 0.6 seconds: the encoding of motor memories depends on recent sensorimotor States. J. Neurosci. 32, 12756–68 (2012).
Sheahan, H. R., Franklin, D. W. & Wolpert, D. M. Motor planning, not execution, separates motor memories. Neuron 92, 773–779 (2016).
Sheahan, H. R., Ingram, J. N., Žalalyte, G. M. & Wolpert, D. M. Imagery of movements immediately following performance allows learning of motor skills that interfere. Sci. Rep. 8, 14330 (2018).
Howard, I. S., Wolpert, D. M. & Franklin, D. W. The value of the follow-through derives from motor learning depending on future actions. Curr. Biol. 25, 397–401 (2015).
Seidler, R. D., Bloomberg, J. J. & Stelmach, G. E. Context-dependent arm pointing adaptation. Behav. Brain Res. 119, 155–166 (2001).
Woolley, D. G., Tresilian, J. R., Carson, R. G. & Riek, S. Dual adaptation to two opposing visuomotor rotations when each is associated with different regions of workspace. Exp. Brain Res. 179, 155–165 (2007).
Woolley, D. G., De Rugy, A., Carson, R. G. & Riek, S. Visual target separation determines the extent of generalisation between opposing visuomotor rotations. Exp. Brain Res. 212, 213–224 (2011).
Gandolfo, F., Mussa-Ivaldi, F. A. & Bizzi, E. Motor learning by field approximation. Proc. Natl. Acad. Sci. 93, 3843–3846 (1996).
Hirashima, M. & Nozaki, D. Distinct motor plans form and retrieve distinct motor memories for physically identical movements. Curr. Biol. 22, 432–436 (2012).
Day, K. A., Roemmich, R. T., Taylor, J. A. & Bastian, A. J. Visuomotor learning generalizes around the intended movement. eNeuro 3, e0005–16 (2016).
McDougle, S. D., Bond, K. M. & Taylor, J. A. Implications of plan-based generalization in sensorimotor adaptation. J. Neurophysiol. 118, 383–393 (2017).
Schween, R., Taylor, J. A. & Hegele, M. Plan-based generalization shapes local implicit adaptation to opposing visuomotor transformations. J. Neurophysiol. 120, 2775–87 (2018).
Churchland, M. M. et al. Neural Population Dynamics During Reaching. Nature 487, 1–20 (2012).
Nozaki, D., Yokoi, A., Kimura, T., Hirashima, M. & de Xivry, J. J. O. Tagging motor memories with transcranial direct current stimulation allows later artificially-controlled retrieval. Elife 5, e15378 (2016).
Schween, R. & Hegele, M. Feedback delay attenuates implicit but facilitates explicit adjustments to a visuomotor rotation. Neurobiol. Learn. Mem. 140, 124–133 (2017).
Poh, E., Carroll, T. J. & Taylor, J. A. Effect of coordinate frame compatibility on the transfer of implicit and explicit learning across limbs. J. Neurophysiol. 116, 1239–1249 (2016).
Masters, R. S. W. Knowledge, knerves and know-how: The role of explicit versus implicit knowledge in the breakdown of a complex motor skill under pressure. Br. J. Psychol. 83, 343–358 (1992).
Masters, R. S. W., Poolton, J. M., Maxwell, J. P. & Raab, M. Implicit motor learning and complex decision making in time-constrained environments. J. Mot. Behav. 40, 71–79 (2008).
Haith, A. M., Huberdeau, D. M. & Krakauer, J. W. The influence of movement preparation time on the expression of visuomotor learning and savings. J. Neurosci. 35, 5109–5117 (2015).
Taylor, J. A. & Ivry, R. B. Cerebellar and prefrontal cortex contributions to adaptation, strategies, and reinforcement learning. Prog. Brain Res. 210, 217–53 (2014).
Willingham, D. B. A neuropsychological theory of motor skill learning. Psychol. Rev. 105, 558–584 (1998).
Stock, A. & Stock, C. A short history of ideo-motor action. Psychol. Res. 68, 176–188 (2004).
Shin, Y. K., Proctor, R. W. & Capaldi, E. J. A Review of Contemporary Ideomotor Theory. Psychol. Bull. 136, 943–974 (2010).
Hommel, B., Müsseler, J., Aschersleben, G. & Prinz, W. The Theory of Event Coding (TEC): A framework for perception and action planning. Behav. Brain Sci. 24, 849–878 (2001).
Elsner, B. et al. Linking actions and their perceivable consequences in the human brain. Neuroimage 17, 364–372 (2002).
Melcher, T., Weidema, M., Eenshuistra, R. M., Hommel, B. & Gruber, O. The neural substrate of the ideomotor principle: An event-related fMRI analysis. Neuroimage 39, 1274–1288 (2008).
Paulus, M., Hunnius, S., Van Elk, M. & Bekkering, H. How learning to shake a rattle affects 8-month-old infants’ perception of the rattle’s sound: Electrophysiological evidence for action-effect binding in infancy. Dev. Cogn. Neurosci. 2, 90–96 (2012).
Tenenbaum, J. B. & Griffiths, T. L. Generalization, similarity, and Bayesian inference. Behav. Brain Sci. 24, 629–640 (2001).
Shepard, R. N. Toward a universal law of generalization for psychological science. Science (80-). 237, 1317–23 (1987).
Malfait, N. & Ostry, D. J. Is interlimb transfer of force-field adaptation a cognitive response to the sudden introduction of load? J. Neurosci. 24, 8084–9 (2004).
Sarwary, A. M. E., Stegeman, D. F., Selen, L. P. J. & Medendorp, W. P. Generalization and transfer of contextual cues in motor learning. J. Neurophysiol. 114, 1565–76 (2015).
Heuer, H. & Hegele, M. Adaptation to visuomotor rotations in younger and older adults. Psychol. Aging 23, 190–202 (2008).
Heuer, H. & Hegele, M. Generalization of implicit and explicit adjustments to visuomotor rotations across the workspace in younger and older adults. J. Neurophysiol. 106, 2078–85 (2011).
Wang, J. & Sainburg, R. L. Mechanisms underlying interlimb transfer of visuomotor rotations. J. Exp. Psychol. 520–526 https://doi.org/10.1007/s00221-003-1392-x (2003).
Poh, E. & Taylor, J. A. Generalization via superposition: Combined effects of mixed reference frame representations for explicit and implicit learning in a visuomotor adaptation task. J. Neurophysiol. 1953–1966 https://doi.org/10.1152/jn.00624.2018 (2019).
Kim, H. E., Morehead, J. R., Parvin, D. E., Moazzezi, R. & Ivry, R. B. Invariant errors reveal limitations in motor correction rather than constraints on error sensitivity. Commun. Biol. 1, 19 (2018).
Kumar, N., Kumar, A., Sonane, B. & Mutha, P. K. Interference between competing motor memories developed through learning with different limbs. J. Neurophysiol. 120, 1061–1073 (2018).
Kamin, L. J. Predictability, surprise, attention and conditioning. In Punishment and aversive behavior (eds Campbell, B. A. & Church, R. M.) 279–296 (Appleton-Century-Crofts, 1969).
Rescorla, R. A. & Wagner, A. R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In Classical Conditioning II: Current Research and Theory (eds Black, A. H. & Prkasy, W. F.) 64–99 (Appleton-Century-Crofts, https://doi.org/10.1101/gr.110528.110 1972).
Lubow, R. E. & Moore, A. U. Latent inhibition: The effect of nonreinforced pre-exposure to the conditional stimulus. J. Comp. Physiol. Psychol. 52, 415–419 (1959).
Braun, D. A., Aertsen, A., Wolpert, D. M. & Mehring, C. Motor Task Variation Induces Structural Learning. Curr. Biol. 19, 352–357 (2009).
Morehead, J. R. et al. Savings upon Re-Aiming in Visuomotor Adaptation. J. Neurosci. 35, 14386–14396 (2015).
Fitts, P. M. & Posner, M. I. Human Performance. (Brooks/Cole, 1967).
Shmuelof, L. et al. Overcoming motor ‘forgetting’ through reinforcement of learned actions. J. Neurosci. 32, 14617–21 (2012).
Vaswani, P. A. et al. Persistent residual errors in motor adaptation tasks: reversion to baseline and exploratory escape. J. Neurosci. 35, 6969–6977 (2015).
Codol, O., Holland, P. J. & Galea, J. M. The relationship between reinforcement and explicit strategies during visuomotor adaptation. Sci. Rep. 8, 9121 (2018).
Holland, P. J., Codol, O. & Galea, J. M. Contribution of explicit processes to reinforcement-based motor learning. J. Neurophysiol. 119, 2241–2255 (2018).
McDougle, S. D. & Taylor, J. A. Dissociable cognitive strategies for sensorimotor learning. Nat. Commun. 10, (2019).
Leow, L.-A., Marinovic, W., Rugy, A. D. & Carroll, T. J. Task errors drive memories that improve sensorimotor adaptation. bioRxiv 1–29 (2019).
Huberdeau, D. M., Krakauer, J. W. & Haith, A. M. Practice induces a qualitative change in the memory representation for visuomotor learning. bioRxiv. https://doi.org/10.1101/226415 (2017).
Hardwick, R. M., Forrence, A. D., Krakauer, J. W. & Haith, A. M. Time-dependent competition between habitual and goal-directed response preparation. bioRxiv 201095 https://doi.org/10.1101/201095 (2018).
Heuer, H. Bewegungslernen. (Kohlhammer, 1983).
Kong, G., Zhou, Z., Wang, Q., Kording, K. P. & Wei, K. Credit assignment between body and object probed by an object transportation task. Sci. Rep. 7, 1–10 (2017).
Berniker, M. & Körding, K. P. Estimating the sources of motor errors for adaptation and generalization. Nat. Neurosci. 11, 1454–61 (2008).
Berniker, M. & Körding, K. P. Estimating the relevance of world disturbances to explain savings, interference and long-term motor adaptation effects. PLoS Comput. Biol. 7, (2011).
Cardinali, L. et al. Tool-use induces morphological updating of the body schema. Curr. Biol. 19, 478–479 (2009).
Kluzik, J., Diedrichsen, J., Shadmehr, R. & Bastian, A. J. Reach Adaptation: What Determines Whether We Learn an Internal Model of the Tool or Adapt the Model of Our Arm? J. Neurophysiol. 100, 1455–1464 (2008).
Massen, C. Cognitive representations of tool-use interactions. New Ideas Psychol. 31, 239–246 (2013).
Heuer, H. & Hegele, M. Explicit and implicit components of visuo-motor adaptation: An analysis of individual differences. Conscious. Cogn. 33, 156–169 (2015).
Imamizu, H. & Kawato, M. Brain mechanisms for predictive control by switching internal models: Implications for higher-order cognitive functions. Psychol. Res. 73, 527–544 (2009).
Leow, L.-A., Marinovic, W., Riek, S. & Carroll, T. J. Cerebellar anodal tDCS increases implicit learning when strategic re-aiming is suppressed in sensorimotor adaptation. PLoS One 12, e0179977 (2017).
Butcher, P. A. et al. The cerebellum does more than sensory-prediction-error-based learning in sensorimotor adaptation tasks. J. Neurophysiol. 118, 1622–36 (2017).
Werner, S., Schorn, C. F., Bock, O., Theysohn, N. & Timmann, D. Neural correlates of adaptation to gradual and to sudden visuomotor distortions in humans. Exp. Brain Res. 232, 1145–56 (2014).
Barsalou, L. W. Perceptual Symbol Systems. Behav. Brain Sci. 22, 577–660 (1999).
Bond, K. M. & Taylor, J. A. Flexible explicit but rigid implicit learning in a visuomotor adaptation task. J. Neurophysiol. 113, 3836–3849 (2015).
Benson, B. L., Anguera, J. A. & Seidler, R. D. A spatial explicit strategy reduces error but interferes with sensorimotor adaptation. J. Neurophysiol. 105, 2843–2851 (2011).
Mazzoni, P. & Krakauer, J. W. An implicit plan overrides an explicit strategy during visuomotor adaptation. J. Neurosci. 26, 3642–3645 (2006).
Lee, T. G., Acuña, D. E., Kording, K. P. & Grafton, S. T. Limiting motor skill knowledge via incidental training protects against choking under pressure. Psychon. Bull. Rev. 1–12 https://doi.org/10.3758/s13423-018-1486-x (2018).
Büsch, D., Hagemann, N. & Bender, N. Das Lateral Preference Inventory: Itemhomogenität der deutschen Version. Zeitschrift für Sport. 16, 17–28 (2009).
Brainard, D. H. The Psychophysics Toolbox. Spat. Vis. 10, 433–436 (1997).
Ghilardi, M. F., Gordon, J. & Ghez, C. Learning a visuomotor transformation in a local area of work space produces directional biases in other areas. J. Neurophysiol. 73, 2535–2539 (1995).
Acknowledgements
We thank Manuela Henß, Simon Koch, Rebekka Rein, Simon Rosental, Kevin Roß and Vanessa Walter for supporting data collection. This research was supported by a grant within the Priority Program, SPP 1772 from the German Research Foundation (Deutsche Forschungsgemeinschaft, DFG), grant no [He7105/1.1]. JAT was supported by the National Institute of Neurological Disorders and Stroke (Grant R01 NS-084948) and National Science Foundation (Grant 1838462).
Author information
Authors and Affiliations
Contributions
R.S. and M.H. designed experiments. L.L. conducted experiments. R.S. analyzed data and created figures. R.S., L.L., J.A.T. and M.H. interpreted data. R.S. and L.L. wrote manuscript draft. R.S., L.L., J.A.T. and M.H. revised manuscript and approved publication.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Schween, R., Langsdorf, L., Taylor, J.A. et al. How different effectors and action effects modulate the formation of separate motor memories. Sci Rep 9, 17040 (2019). https://doi.org/10.1038/s41598-019-53543-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-019-53543-1
This article is cited by
-
The complex interplay between perception, cognition, and action: a commentary on Bach et al. 2022
Psychological Research (2024)
-
Cortical preparatory activity indexes learned motor memories
Nature (2022)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.