ABSTRACT
Animal locomotion is the result of complex and multi-layered interactions between the nervous system, the musculo-skeletal system and the environment. Decoding the underlying mechanisms requires an integrative approach. Comparative experimental biology has allowed researchers to study the underlying components and some of their interactions across diverse animals. These studies have shown that locomotor neural circuits are distributed in the spinal cord, the midbrain and higher brain regions in vertebrates. The spinal cord plays a key role in locomotor control because it contains central pattern generators (CPGs) – systems of coupled neuronal oscillators that provide coordinated rhythmic control of muscle activation that can be viewed as feedforward controllers – and multiple reflex loops that provide feedback mechanisms. These circuits are activated and modulated by descending pathways from the brain. The relative contributions of CPGs, feedback loops and descending modulation, and how these vary between species and locomotor conditions, remain poorly understood. Robots and neuromechanical simulations can complement experimental approaches by testing specific hypotheses and performing what-if scenarios. This Review will give an overview of key knowledge gained from comparative vertebrate experiments, and insights obtained from neuromechanical simulations and robotic approaches. We suggest that the roles of CPGs, feedback loops and descending modulation vary among animals depending on body size, intrinsic mechanical stability, time required to reach locomotor maturity and speed effects. We also hypothesize that distal joints rely more on feedback control compared with proximal joints. Finally, we highlight important opportunities to address fundamental biological questions through continued collaboration between experimentalists and engineers.
Introduction
Animal locomotion arises from complex and rich interactions between the nervous system, the musculoskeletal system and the environment (Dickinson et al., 2000; Nishikawa et al., 2007). Animal sensorimotor control involves multi-layered and distributed systems, with central networks, reflexes and mechanics all contributing to sensorimotor responses on varied time scales (Büschges, 2005; Buschmann et al., 2015; Bidaye et al., 2018; Grillner, 1985; Grillner and El Manira, 2019; Loeb et al., 1999; Nirody, 2023,;Pearson, 1995; Pearson and Gramlich, 2010; Rossignol et al., 2006). Because of this inherent complexity, it has been a longstanding challenge in biology to rigorously understand the structure, function and integration of animal sensorimotor systems. Integrative approaches are needed to address this challenge. Exchange between biology, physics and engineering disciplines can be particularly useful for generating and rigorously testing hypotheses about how mechanics and control interact to produce agile locomotion. In this Review, we discuss how the exchange between comparative experimental biology, physics and engineering can provide fundamental insights into the neuromechanics (see Glossary) of vertebrate locomotion.
Historically, comparative approaches have been essential for providing mechanistic understanding of the control of movement, and Journal of Experimental Biology (JEB) has been an important venue for comparative studies across diverse taxa. In the 1930s–1940s, Gray and co-authors published numerous papers on animal movement in JEB, characterizing the locomotor movements, reflex responses and locomotor pattern generation in the eel, dogfish, toad, leech and earthworm (Gray, 1933; 1936; Gray et al., 1938; Gray and Lissmann, 1938; 1940; Gray and Sand, 1936). Subsequent studies continued to expand on this diversity and contribute to mechanistic understanding of sensorimotor control (e.g. Hughes, 1952, 1957,;Wilson, 1965, 1967). Many of the early studies were foundational for understanding both the basic biomechanics and neural control circuitry for movement. At that time, it was often necessary to study movement mechanics and neural control together, because so little was known about both.
In recent decades, the fields of comparative biomechanics and sensorimotor physiology have been relatively isolated, as each field focused on more detailed mechanistic understanding of specific subsystems. Simultaneously, studies of sensorimotor control have increasingly focused on a few genetic animal models, such as the mouse, zebrafish, fruit fly and Caenorhabditis elegans, which enable the use of the most richly developed genetic and molecular tools (Bidaye et al., 2018; Fetcho and McLean, 2010; Fouad et al., 2018; Kiehn, 2011; Lewis and Eisen, 2003; Zhong et al., 2012; Mantziaris et al., 2020). Nonetheless, this narrow focus has its drawbacks, and important questions remain about the diversity and specialization of sensorimotor control across species. We suggest that it is important to continue to expand studies beyond the classic genetic animal models, because comparative approaches provide opportunities to address fundamental questions about the evolution and diversity of neuromechanical integration. Critical gaps in understanding remain in how the different elements of the sensorimotor system are integrated with each other, and how this integration varies with body size and among animals adapted for different locomotor environments.
The interdisciplinary field of comparative neuromechanics has emerged over the last 15 years or so (Nishikawa et al., 2007; Ting and McKay, 2007), focusing on the study of mechanics and control of movement in a comparative framework. In this Review, we highlight principles and hypotheses that have emerged from this field, with a specific focus on sensorimotor and neuromechanical integration in vertebrates. We discuss current conceptualization of the role of central pattern generators (CPGs; see Glossary) and their integration with reflexes and limb mechanics, and the interactions between feedforward and feedback control mechanisms (see Glossary). In the sections below, we first summarize current understanding in biology based on both historical and recent experimental evidence, then discuss contributions from bio-inspired robotics and simulations, and highlight current open questions and future directions that are enabled through direct integration of engineering and experimental biology. Our Review focuses mainly on vertebrate locomotion; however, we note that many principles of locomotor control have parallels between vertebrates and invertebrates, and readers are directed to recent reviews of invertebrate systems (Nirody, 2023; Mantziaris et al., 2020; Bidaye et al., 2018).
Altricial
Animals that take extended time after birth to reach locomotor maturity.
Central pattern generator (CPG)
Neural circuits that can generate the basic rhythmic motor patterns for movement and breathing without any sensory inputs. These circuits produce periodic signals that are often mathematically modeled as oscillators (see below). A defining feature of a CPG is that it can generate a periodic motor output without a periodic input.
Compliance
Elastic deformation of a mechanical system. Compliance can be viewed as the opposite of stiffness.
Control theory
Field of applied mathematics that deals with the control of dynamical and engineered systems.
Decerebrate preparation
An experimental manipulation in which cerebral brain function is eliminated by transection or removal of the cerebrum. The extent to which longer-latency feedback pathways remain intact or eliminated depends on the specific location of the transection.
Dynamic stability
Stability of a gait that requires movement to prevent falling (as opposed to static stability, see below). Typically, a dynamically stable gait exhibits convergence to a limit cycle behavior, namely periodic behavior that is robust against (small) perturbations.
Efferent copy
A copy of the motor signals that are used as inputs to internal models to predict dynamics and sensory feedback.
Entrainment
Synchronization of oscillatory dynamical systems such that they converge to the same frequency and therefore to constant phase differences. Two dynamical systems can mutually entrain each other (and converge to a frequency that is typically an average of their intrinsic frequencies), or one dynamical system can entrain another (and impose its intrinsic frequency on the other).
Feedback control
A control pathway in which sensory signals are returned back to generate an error signal that regulates the input commands towards desired output dynamics.
Feedforward control
A control pathway that generates a predefined command signal based on the anticipated load and dynamics of the system. In this Review, we discuss two types of feedforward control mechanisms: spinal CPGs and supraspinal internal models.
Fictive locomotion
The generation of the basic rhythmic muscle activation patterns required for locomotion in isolated spinal cords, such as the alternating activation of flexors and extensors in the leg of walking animals or the transmission of an undulatory wave down the body in swimming animals.
Internal models
Internal neural representations that can predict the interactions between the nervous system, the musculoskeletal system and the environment. Forward internal models can predict causal relationships between actions and their consequences. Inverse internal models can predict which actions are needed to reach particular consequences.
Model-based control
Control architecture that uses internal models for performing anticipatory (as opposed to reactive) movements. An example of model-based control in robotics is model-predictive control, which uses a model of the robot and an optimization criterion to define motor commands over a finite-time horizon.
Neuromechanics
The scientific field focused on the interactions between biomechanics of the musculoskeletal system and sensorimotor control and their integration for robust and agile movement.
Oscillators
Dynamical systems or neural networks that exhibit stable limit cycle behavior, i.e. that produce stable periodic signals.
Precocial
Animals that locomote effectively shortly after birth.
Preflexes
The intrinsic dynamic properties of the musculoskeletal system in its activated state that automatically stabilize movements through visco-elastic properties. These form a kind of zero-delay feedback stabilizing movement.
Sensorimotor delay
The time lag between the onset of a mechanical perturbation and its reception by a sensory organ to the development of peak muscle force in response to the perturbation. It includes sensing delay, nerve conduction delay, synaptic delay, neuromuscular junction delay, electromechanical delay and muscle force development delay.
Spinal preparation
An experimental manipulation in which the brain and brainstem function are completely removed by transection of the spinal cord, typically in the thoracic region.
Static stability
Stability of a posture or a gait in which the center of mass is always maintained above the (possibly time-varying) support polygons formed by the contacts between the limbs (or any body parts) and the ground. An animal that is statically stable will not fall when it freezes its posture.
Biology: historical experimental evidence, current understanding and new hypotheses
Integration of CPGs and sensory feedback in the spinal cord
The spinal cord plays a key role in integrating predictive and reactive elements of vertebrate locomotor control (Grillner and El Manira, 2019; Rossignol et al., 2006). Animal control involves inherently long sensorimotor delays (see Glossary; More et al., 2010; More and Donelan, 2018). Because of these delays, animals cannot rely entirely on reactive, feedback-driven control, but must instead use a combination of predictive and reactive control mechanisms for stable movement (Fig. 1). The spinal cord contains neural circuits involved in integrating CPGs (see Box 1), reflex responses, and descending and ascending pathways to the brain (Grillner and El Manira, 2019; Pearson, 1995; Rossignol et al., 2006). CPGs in the spinal cord provide a type of predictive, feedforward controller for locomotion that helps to overcome delays. CPGs are activated by a descending ‘drive’ signal and produce predetermined motor outputs for locomotion. These outputs provide complex muscle activation for the anticipated mechanical demands, resulting in, for instance, traveling waves for undulatory locomotion and alternation of stance and swing phases for legged locomotion. Therefore, CPGs resemble feedforward controllers in control theory (see Glossary), because they produce complex and detailed motor commands given a simpler high-level descending signal for the desired behavior, such as movement at a specific speed. However, CPGs do not act in isolation. The CPG receives continuous modulation through descending drive commands and reflex feedback (Grillner et al., 2008; Rossignol et al., 2006). Consequently, the CPG can be thought of as a type of feedforward controller nested within a feedback control system (Holmes et al., 2006).
CPGs play important roles in the generation of coordinated motor patterns for both vertebrate and invertebrate locomotion. CPGs are neural circuits that can generate the basic rhythmic motor patterns for movement and breathing without any sensory inputs. Locomotor CPG circuits are located in the spinal cord of vertebrates (Grillner and El Manira, 2019), and in the ventral nerve cord of invertebrates (Mantziaris et al., 2020). The existence of CPGs has been demonstrated across diverse vertebrate species through the observation of fictive locomotion in spinal preparations, with all inputs from the brain and periphery transected (Gray, 1936; Gray and Lissmann, 1940; Grillner and Wallén, 1982; Ho and O'Donovan, 1993; Sholomenko et al., 1991; Sholomenko and Steeves, 1987; Ten Cate, 1964, 1965). The CPG circuits in the isolated spinal cord generate fictive swimming in aquatic species (e.g. lamprey, zebrafish), fictive walking in terrestrial species (birds, mammals), and both fictive swimming and fictive walking in amphibious species (e.g. salamanders) (Chevallier et al., 2008; Fetcho and McLean, 2010; Grillner and El Manira, 2019; Grillner and Wallen, 1985; Ryczko et al., 2010; Whelan, 1996). Genetic studies have identified specific subpopulations of interneurons involved in rhythm generation that are conserved across vertebrates (Grillner and El Manira, 2019; Kiehn, 2016; Rybak et al., 2015). Locomotor CPGs are distributed segmentally along the spinal cord as interconnected rhythmic units (Grillner et al., 1995; Kiehn, 2016; McLean and Dougherty, 2015; Rybak et al., 2015), typically one per pair of antagonist muscles or even one per muscle (Cheng et al., 1998). Specific ventrolateral regions of the spinal cord generate flexor/extensor alternation, and specific ventromedial interneurons generate left/right coordination (Kiehn, 2016; McLean and Dougherty, 2015). Note that although there is no direct evidence of CPG circuits in humans, there is ample indirect evidence that humans possess CPG circuits similar to those of other vertebrate species (Minassian et al., 2017).
Current evidence suggests that animal locomotion makes use of a nested, multi-layered control architecture that organizes sensing and action (Grillner and El Manira, 2019; McLean and Dougherty, 2015; Pearson, 1995; Rossignol et al., 2006). A nested architecture enables separation of task selection (starting, stopping, gait and speed), task coordination (e.g. generation of coordinated rhythmic leg movements) and stabilization in response to disturbances. As a first approximation of the hierarchical organization, CPGs generate rhythmic commands that act as feedforward signals for task coordination, whereas descending commands activate and modulate CPGs for task selection, and reflexes provide stabilizing responses to perturbations (Fig. 1). We will later see that neuromechanical models suggest more complexity, with sensory feedback also contributing to task coordination (Owaki et al., 2013; Thandiackal et al., 2021). Sensorimotor delays give rise to temporal scaling of control responses based on the spatial distribution of system elements (Fig. 1). Inner loops deal locally with perturbations, relying on fast peripheral mechanisms, including intrinsic mechanics (Brown and Loeb, 2000; Daley et al., 2007; Dickinson et al., 2000; Full and Koditschek, 1999; Jindrich and Full, 2002) and short-latency reflexes (Af Klint et al., 2010; Daley et al., 2009; Hiebert and Pearson, 1999; Moritz and Farley, 2004). Intermediate loops modify task-level variables, such as joint and leg stiffness, and outer loops integrate sensorimotor information in the brain to select and switch among different tasks and update internal models (see Glossary; Pearson and Gramlich, 2010). However, many uncertainties remain in how different control layers are integrated and modulated based on experience, learning and different locomotor contexts.
There was a longstanding historical debate about the relative importance of feedforward and feedback in control of animal locomotion. Sherrington's work on reduced animal preparations revealed that reflex actions could generate the component motions necessary for rhythmic walking (Sherrington, 1910). Thus, Sherrington argued that locomotion could be viewed as the result of a chain of reflexes (Sherrington, 1900, 1906, 1910). Subsequent work by Graham Brown demonstrated that motor patterns for locomotion could be generated in deafferented preparations and did not require sensory input. Graham Brown (1911, 1914) argued that ‘spinal centers’ (later named CPGs) acted as the primary unit of motor activity, not the reflex. He suggested that the reflexes regulate rather than generate motor activity (Graham Brown, 1911). To this day, the relative roles of central and reflex-generated contributions to locomotion remain somewhat controversial; however, it has become clear that both mechanisms co-exist and provide redundancy and flexibility in the system.
Subsequent work has confirmed the existence and shared features of spinal CPGs across vertebrates (see Box 1). Vertebrates also share a common mechanism for descending drive to CPGs to control gait speed and initiation. Stimulation of the mesencephalic locomotor region invokes gait initiation and gait transitions across species, inducing swimming in fish and walking in terrestrial animals (Cabelguen et al., 2003; Grillner and Wallen, 1985; Shik et al., 1966; Steeves et al., 1987). As the strength of the stimulation increases, swimming speed increases in the fish, and a quadruped increases speed and transitions between gaits from a walk to trot to gallop (Shik et al., 1966; Wallén, 1982).
In vertebrates, sensory feedback plays an essential role in entraining CPG rhythms to the mechanics of the body and the interaction with the environment. In the lamprey, periodic bending of the spinal cord results in entrainment (see Glossary) of the patterns of fictive locomotion (see Glossary), through sensory feedback from mechanosensitive edge cells in the spinal cord (Grillner et al., 1981; Grillner and Wallén, 1984). Similarly, proprioceptive feedback entrains gait rhythm and the timing of stance–swing transitions in quadrupedal gait (Pearson, 2008; Whelan, 1996). In decerebrate and spinal preparations (see Glossary), increasing belt speed leads to gait transitions from walk to trot and gallop, suggesting a role for sensory feedback entrainment in gait transitions (Barbeau and Rossignol, 1987; Forssberg et al., 1980; Kriellaars et al., 1994; Pearson, 2008; Whelan, 1996; Yanagihara et al., 1993). With increasing knowledge of the interneuronal networks and cellular mechanisms underlying sensorimotor control, it has become clear that sensory feedback is integrated at multiple levels: as distinct reflexes, as modulators of central pattern generation, and integrating with longer-latency feedback loops to regulate navigation and task selection (Grillner and El Manira, 2019; Rossignol et al., 2006) (Fig. 1).
Diversity in the integration of feedforward, feedback and model-based neural control
Recent evidence and modeling studies (see below) suggest that the relative contributions of feedforward and feedback control can vary depending on size of the animal, speed, terrain and risks of falling. Below, we discuss emerging hypotheses about specialization and diversification of control components among vertebrates. Loosely speaking, we suggest two types of feedforward control, one in the spinal cord, based on CPGs, and one in higher brain centers, based on internal models, which we will here call (cephalized) model-based neural control (see Glossary). We call them both feedforward because they represent an anticipatory component as opposed to the reactive nature of feedback.
Body size and scaling of neuromechanical delays
Body size is one important source of diversity in control mechanisms for locomotion (Fig. 2, Table 1). Sensorimotor loop delay increases with body size (M), in proportion to M0.21 (More et al., 2010, 2013; More and Donelan, 2018). Large animals experience longer sensorimotor delays relative to movement durations compared with the same ratio in small animals. For example, at speeds near the trot–gallop transition, a shrew has a total delay of 10 ms, 25% of its stance duration, but an elephant has a total delay of approximately 180 ms, 60% of its stance duration (More and Donelan, 2018). Delay relative to stance duration is important because this determines the time available to apply force for a corrective response to a disturbance. If an animal cannot respond to a disturbance within the stance phase, the response requires coordination of multi-step and multi-legged strategies, which involve longer-latency feedback loops. Delays therefore challenge the ability of large animals to respond effectively to perturbations, even though they have slower dynamics and step cycles compared with smaller animals (Mohamed Thangal and Donelan, 2020; More and Donelan, 2018).
To compensate for the relatively longer delays, it is expected that larger animals rely more on model-based control, using sensory feedback and internal models in the brain to generate state estimates for stable movement. Internal models can allow animals to compensate for delayed and noisy sensory feedback to predict future states, enabling generation of appropriate motor outputs for stable movement (Todorov, 2004; Todorov and Jordan, 2002; Wolpert and Ghahramani, 2000). The synaptic delays associated with internal model computations are a higher fraction of the total sensorimotor delay in very small animals (Mohamed Thangal and Donelan, 2020; More and Donelan, 2018). Consequently, the benefits of model-based control may not outweigh the costs of increased computation times in small animals (Thangal and Donelan, 2020; More and Donelan, 2018). Thus, overall, it is expected that larger animals are likely to have more cephalized model-based control, with higher brain involvement compared with small animals (Fig. 2, Table 1), whereas small animals can achieve agile and robustly stable movement through more spinalized control mechanisms coupled to intrinsic mechanical preflexes (see Glossary).
Spinalization versus cephalization of feedforward control may relate to mechanical stability and the time to locomotor maturity
Although all vertebrates share similar component systems for locomotor control, a source of diversity among vertebrates is the degree of involvement of the brain and the complexity of descending drive modulation (Fig. 3). This distinction may be related to different developmental demands between precocial and altricial species (see Glossary). Precocial species tend to have relatively small brains as adults, whereas altricial species tend to have larger adult brain size (Bennett and Harvey, 1985; Garwicz et al., 2009). We hypothesize that these developmental differences may also be related to the relative degree of ‘spinalization’ versus ‘cephalization’ of locomotor control. That is, precocial species have more spinalized locomotor control, relying mainly on spinal CPG networks as a feedforward controller, coupled to intrinsic mechanics of the body, with short-latency reflexes. In contrast, altricial species have more cephalized control, relying more on model-based control in the brain, with longer-latency reflexes updating internal models. Through experience and optimization, animals can optimize the use of efference copy (see Glossary) and sensory feedback to estimate current states and predict future states to determine desired motor outputs (Todorov, 2004; Todorov and Jordan, 2002; Wolpert and Ghahramani, 2000). Multiple brain regions may be involved in the generation, maintenance and updating of internal models, including the cerebellum and the posterior parietal cortex (Ito, 2008; McVea et al., 2009; Pearson and Gramlich, 2010). Multi-layered model-based control can overcome delays by predicting mechanical conditions over a wide range of contexts and adjusting feedforward commands through descending pathways (Nakahira et al., 2021).
The contrast between precocial and altricial species can be appreciated when comparing large ground birds (such as ostriches and rheas) with humans. Although birds and humans have independently evolved bipedalism, they have converged upon walking and running gaits with similar mechanical and energetic demands (Gatesy and Biewener, 1991; Roberts et al., 1998; Rubenson et al., 2004; Watson et al., 2011). Yet, they exhibit important differences in development and sensorimotor control features. Ground birds are precocial, able to walk and run very shortly after hatching (Muir et al., 1996; Muir and Chu, 2002; Ryu and Bradley, 2009; Smith et al., 2010), whereas humans are exceptionally altricial, requiring many months of practice to walk without falling. We suggest that these developmental differences also reflect differences in spinalization versus cephalization of locomotor control. Birds have relatively more spinalized locomotor control compared with more cephalized control in mammals, including humans. Neurophysiological studies have demonstrated that spinal circuits are sufficient to generate complete locomotor patterns for self-supported walking in birds (Ho and O'Donovan, 1993; Sholomenko et al., 1991; Sholomenko and Steeves, 1987; Ten Cate, 1960). Birds do possess a common descending pathway with other vertebrates, from the mesencephalic locomotor region to the spinal CPGs, but lack a direct telencephalic–spinal projection analogous to the mammalian corticospinal tract (Sholomenko and O'Donovan, 1995; Sholomenko and Steeves, 1987; Steeves et al., 1987; Webster and Steeves, 1988). A recent study genetically silenced interneurons in the dorsal spinal tract in chicks, which increased kinematic variability in walking (Haimson et al., 2021), suggesting that sensory feedback and descending modulation contribute to stability of walking in birds. Nonetheless, locomotor control appears to be relatively more spinalized in birds compared with the more cephalized sensorimotor control observed in mammals.
The relatively spinalized versus cephalized locomotor control in ground birds versus mammals, respectively, might represent different solutions to the problem of neural delays. Cephalization allows more sophisticated internal models and model-based control; this allows delays to be overcome by predicting mechanical conditions over a wide range of learned contexts and adjusting descending commands accordingly. In contrast, spinalization relies on simpler CPG-based feedforward control, with the feedback-entrained rhythm providing estimates of current state and generation of motor output. We hypothesize that animals with more spinalized control also tend to have more intrinsically stable biomechanics (Fig. 3). Among bipeds, birds have a relatively flexed limb posture compared with humans, a forward horizontal position of the body and high elasticity in the distal leg muscles, features that increase mechanical stability (Badri-Spröwitz et al., 2022; Daley, 2018; Daley et al., 2009; Daley and Biewener, 2011; Daley and Birn-Jeffery, 2018). Humans, in contrast, have a straight leg posture with the body vertically balanced over the hips, which is highly unstable without active control.
Among quadrupeds, there is also diversity in intrinsic mechanical stability that may relate to degree of cephalization versus spinalization of control. Large ungulates have parasagittal limb posture with relatively straight legs, a high body center of mass and a relatively narrow base of support. These features benefit locomotor economy by minimizing the active muscle force required to support body weight against gravity (Biewener, 1989). However, upright postures are relatively unstable compared with the sprawled posture and wide base of support typical of many amphibians and lizards (Alexander, 2002; Ijspeert, 2020). Note that here we mainly refer to static stability (see Glossary) rather than dynamic stability. At least at slow speeds, static stability in quadrupeds is proportional to the size of the support polygon, and inversely proportional to the ratio of body height to stance width (Alexander, 2002). We hypothesize that there is a control gradient in which mechanical stability enables spine-localized feedforward control, whereas mechanical instability is associated with brain-dominated feedforward control (Fig. 2). We also hypothesize that unstable animals require better proprioception for monitoring their posture and loads on limbs, and hence have a larger role for spinal sensing than mechanically stable animals. A similar hypothesis has been proposed in Ryczko et al. (2020) .
Proximo-distal differentiation in control
Across diverse tetrapod animals, limbs have a proximo-distal distribution in muscle–tendon morphology, which may also result in differentiation in control mechanisms (Daley et al., 2007). The largest, most powerful muscles are proximal, concentrating mass near the body. Distal muscles have lower mass and high mass-specific force owing to their short, pennate muscle fiber arrangement and high in-series compliance (see Glossary). The pennate architecture of distal muscles leads to a load-sensitive architectural gear ratio (Azizi et al., 2008; Eng et al., 2018; Roberts et al., 2019), which is likely to make them sensitive to external perturbations. In contrast, the high inertia and lower compliance of the proximal muscles is likely to make them less sensitive to external perturbations. Based on these mechanical differences between proximal and distal muscles, we hypothesize that proximal muscles use higher-gain feedforward control, with length and position feedback entraining CPG rhythm, whereas distal muscles rely more on intrinsic mechanics (i.e. preflexes) and short-latency load and stretch reflexes (Fig. 4). Indeed, evidence from cats suggests that proximal muscles at the hip contribute to regulation of stance–swing transitions, whereas the distal ankle extensors use force feedback to regulate stance load bearing (Donelan and Pearson, 2004; Gorassini et al., 1994; Hiebert et al., 1994; Pearson et al., 1998). Modeling studies also support this hypothesis (Dzeladini et al., 2014; see below).
Using neuromechanical simulations and biorobots to investigate animal motor control
One theme that has emerged from neuromechanical studies is the importance of effective tuning of control to the biomechanical properties of the system and to physical interactions with the environment. However, the multi-layered, distributed and redundant nature of animal sensorimotor systems makes it challenging to rigorously understand the relationships and connections among the component systems through experiments alone. Neuromechanical simulations (i.e. numerical simulations of both neural circuits and bodies interacting with a virtual environment) can be useful tools to tackle these challenges and test hypotheses about animal motor control. Additionally, simulated neural circuits can also be tested in the real world with biomimetic robots used as physical models of animal bodies.
Because the modeler is in control of all components, models are ideally suited to study motor control in animals with an integrative perspective, following Richard Feynman's famous quote: ‘What I cannot create, I do not understand’. Neuromechanical simulations and biorobots present multiple interesting properties: (i) they allow the modeler to explicitly determine, implement and modify different components (e.g. feedback loops, CPGs, muscle models); (ii) they provide access to many internal states, including quantities which are impossible to measure in moving animals; (iii) they offer the option to systematically change some properties (e.g. sizes and masses); (iv) they allow for repeatable experiments; (v) they allow ‘what-if’ scenarios and testing of motor behaviors not observed in nature; and (vi) they allow for multiple types of perturbations and lesion studies. Modeling experiments benefit from an iterative approach, with iterations between animal studies, hypothesis design, model design, (numerical) experiments and predictions (Webb, 2001). They are particularly useful for experiments that cannot be performed on real animals for practical, financial and/or ethical reasons.
The use of neuromechanical simulations and robots to investigate animal behavior has a fairly long history and finds its roots in early work in cybernetics (Ashby, 1957; Wiener, 2019) and in robotics, for instance, with Grey Walter's tortoise robots (Walter, 1950, 1951). Other reviews have addressed the use of simulations and robots to investigate animal behavior (Dickinson et al., 2000; Floreano et al., 2014; Holmes et al., 2006; Ijspeert, 2014; Pearson et al., 2006; Webb, 2001; 2020; Ramdya and Ijspeert, 2023). Here, we focus in particular on locomotion and on how simulations and robots can help in the investigation of the interactions between CPGs, sensory feedback loops and descending modulation, and more specifically on interactions between feedforward and feedback control.
Models of lamprey swimming highlight the importance of the CPG in mechanically stable locomotion
The lamprey represents a good example of how numerical modeling has contributed to decoding how neural circuits interact with the body to generate swimming. A first contribution of numerical modeling has been to decipher the neuronal and network properties of rhythm generation in the local segmental circuits. The lamprey spinal cord is composed of approximately 100 segments and each segment contains neural oscillators (see Glossary) that are part of the locomotor CPG. Biophysical models of these segmental circuits have shown that several mechanisms play a role in rhythm generation, including contralateral inhibition, frequency adaptation and stretch-sensitive cells (Ekeberg et al., 1991; Hellgren et al., 1992; Traven et al., 1993; Wallén et al., 1992). The relative importance of these mechanisms likely depends on the cycle frequency, which varies extensively in the lamprey (Traven et al., 1993; Wallén et al., 1992).
Numerical and mathematical models have also investigated the complete CPG circuits, and how traveling waves of neural activity are generated along the 100 segments of the spinal cord to produce forward swimming (Buchanan, 1992; Ekeberg, 1993; Ekeberg et al., 1995; Ijspeert, 1996; Williams, 1992a,b; Cohen et al., 1982; Kopell et al., 1991; Kopell and Ermentrout, 1988; Williams et al., 1990). It is known that neurons in the local segmental oscillators project up and down the spinal cord, thus creating couplings between oscillators. The models have shown that the most likely mechanisms to explain the phase lags between oscillators are asymmetries of inter-oscillator couplings, and that other potential explanations such as gradients of intrinsic frequencies and conduction delays are less likely.
Finally, models of the lamprey spinal cord have also been connected to simulated bodies in the water, i.e. to form complete neuromechanical simulations (Fig. 5A) and relate CPG activity to actual swimming behavior (Ekeberg, 1993; Ekeberg et al., 1995; Ekeberg and Grillner, 1999; Ijspeert, 1996; Thandiackal et al., 2021; Williams and McMillen, 2015). These neuromechanical simulations have demonstrated that the traveling waves of neural activity indeed generate forward swimming, and that modulating the descending drive signals applied to the CPG models can change the speed of swimming as well as induce turning, when symmetric and asymmetric left−right descending pathways are activated (Ekeberg, 1993). These simulations and robotic experiments (Ijspeert and Crespi, 2007) have shown that lamprey-like swimming can be obtained using CPG models without sensory feedback, supporting our hypothesis that CPGs play an important role in mechanically stable locomotion (Fig. 3). In this case, the surrounding water provides a kind of mechanical stability (i.e. by preventing large accelerations).
Note that sensory feedback still plays a useful role in lamprey swimming. Sensory feedback is necessary for handling perturbations in the water, and neuromechanical simulations have shown the role of stretch receptors (that provide feedback about curvature to the CPG) in coping with changes of flow velocity in the water (Ekeberg et al., 1995; Ijspeert et al., 1999). Thus, there are specific environments that can only be crossed when sensory feedback is included, and cannot be crossed with the CPG in open-loop.
Remarkably, a lamprey-like robot (Fig. 5B) (Thandiackal et al., 2021) has furthermore shown that local sensory feedback alone (in this case from pressure-sensitive cells in the lamprey skin) could synchronize the oscillators that comprise the CPG when direct coupling is removed. See Hamlet et al. (2023) for a similar finding in a neuromechanical simulation with stretch feedback. In other words, sensory feedback presents an alternative and redundant mechanism for traveling wave generation, separate from direct CPG coupling. This offers a high robustness against lesions, similar to that seen in eels, which can continue swimming despite full transection of the spinal cord (Wallén, 1982). It also suggests that inter-oscillator couplings might be less strong than previously thought (see discussion below).
Models show that CPGs can induce transitions between swimming and walking in amphibians
The transition between swimming and walking has been studied in the salamander using neuromechanical simulations and robots (Fig. 5C) (Bicanski et al., 2013; Ijspeert, 2001; Ijspeert et al., 2007; Karakasiliotis et al., 2013, 2016; Knüsel et al., 2020). Because of its amphibious locomotion, the salamander represents an interesting animal to study the transition from water to ground locomotion and to create a bridge between aquatic and terrestrial vertebrate studies (Ryczko et al., 2020).
Modeling studies in salamanders have demonstrated that the transition from swimming to ground locomotion can, in principle, be obtained by extending an undulatory swimming circuit with neural oscillators for the limbs, rather than by creating a completely new locomotor circuit for ground locomotion (Ijspeert, 2001; Ijspeert et al., 2007). Modeling reveals that the modulation of two descending drives applied to the left and right sides of the simulated circuits can vary speed, heading and even the type of gait in the simulated and robotic bodies. Thus, the patterns generated by CPGs are not rigidly fixed but can be modulated extensively for adaptive locomotion. Modeling also shows that for simple environments, locomotion can be generated purely in open-loop, i.e. using CPG models without sensory feedback (Ijspeert et al., 2007). This is due to the high mechanical stability of the sprawling posture of salamanders, with a large support polygon and a low center of mass. This therefore supports our hypothesis that mechanically stable locomotion can largely be CPG-driven (Fig. 3). But sensory feedback loops also play an important role. Local proprioceptive (stretch) feedback can reduce the variability of intersegmental phase lags toward values appropriate for locomotion and can simplify the generation of different motor behaviors (Knüsel et al., 2020). Furthermore, sensory feedback could, in principle, also replace direct coupling of CPG oscillators (Suzuki et al., 2021), similarly to what has been found for lamprey-like swimming (Thandiackal et al., 2021).
Models of mammalian legged locomotion inform our understanding of sensory feedback and task coordination
The importance of sensory feedback in mammalian legged locomotion has been investigated by Ekeberg and Pearson (2005), who developed a neuromechanical simulation of the cat (Fig. 5E) with a focus on hindlimbs. They studied two types of feedback involved in determining the duration of the stance in a leg: one proportional to limb loading and the other proportional to hip extension. Their model did not include a CPG. The study showed that these two types of sensory feedback can generate interlimb coordination corresponding to an alternating gait and can handle irregular terrain. The findings also suggested that limb loading is more important than hip extension in providing sensory feedback. A related study investigated the role of hip extension feedback and CPGs in rat locomotor adaptation to split-belt conditions, in which the right and left legs are on belts with different speeds (Fujiki et al., 2018). Under these conditions, hip extension could be used as a phase-resetting signal to keep the CPG entrained with the mechanical movements of the legs, such as to adapt to the split-belt conditions. These findings are consistent with the hypothesized proximo-distal differentiation in control mechanisms summarized in Fig. 4.
Controllers inspired by animal CPGs and reflex loops have become popular for the control of legged robots and have also provided new scientific insights (Aoi et al., 2017; Bellegarda and Ijspeert, 2022; Fukuoka et al., 2003; Manoonpong et al., 2007). For instance, load feedback similar to that of Ekeberg and Pearson was used to generate different gaits on a quadruped robot (Fig. 5D) (Owaki et al., 2013; Owaki and Ishiguro, 2017). Each limb was driven by a local oscillator without direct coupling to other oscillators, representing CPGs without direct couplings. Local loading feedback was sufficient to generate stable gaits, showing the importance of the body and physical interactions as mechanisms for synchronizing CPGs. Interestingly, transitions between walking, trotting and galloping gaits could be produced by simply increasing the frequency of the oscillators, as previously shown in decerebrated cats (Shik et al., 1966). This shows the potential role of sensory feedback as a task coordination mechanism (in addition to a role in perturbation responses). Similar principles have been shown in insect models, for instance, for the stick insect (Cruse, 1990; Cruse et al., 1995; Daun-Gruhn, 2011; Schilling et al., 2013).
More detailed models of mammalian CPGs have been developed by Rybak and colleagues (Danner et al., 2016, 2017; Markin et al., 2016; Rybak et al., 2015). These models reveal how CPG circuits with two layers, one for rhythm generation and the other for pattern formation, can produce several features of quadruped locomotion in open loop (without a body); even gait transitions can be produced by the activation of specific descending pathways (Danner et al., 2017). Thus, it appears that multiple mechanisms could explain gait transition (consistent with our view that animal neuromechanical systems show high redundancy); some transitions are mainly induced through descending modulation, whereas others are mainly driven by sensory feedback. The development of new full-body models of mammalian musculoskeletal systems (e.g. see Tata Ramalingasetty et al., 2021) will allow the community to investigate gait generation and modulation in more detail. Overall, evidence suggests that CPGs and sensory feedback are equally important in gait generation in quadruped mammals. It is likely that gaits in complex environments require more complex modulation of descending pathways than in simple environments, and therefore involve more cephalized, rather than spinalized, control. Similarly, slow gaits might require more descending modulation than fast gaits, to allow the animal to maintain posture and balance (Fig. 3).
Numerical models suggest that biped locomotion relies more on sensory feedback than on CPGs
Some of the first neuromechanical simulations of biped locomotion were developed by Taga and colleagues (Taga, 1995, 1998; Taga et al., 1991). These simulations of human walking demonstrated how robust locomotion could emerge from the interaction of CPGs and reflexes. Multiple studies have since explored the interplay of CPGs and reflexes in biped locomotion with simulations and robots (Aoi et al., 2019; Fujiki et al., 2015; Geyer and Herr, 2010; Ryu and Kuo, 2021; Van der Noot et al., 2018, 2019). A particularly influential neuromechanical model developed by Geyer and Herr (2010) demonstrated that a limited number of reflexes can generate stable locomotion without the need for CPG circuits (Fig. 5G). The simulated gaits closely match human gait recordings in terms of joint kinematics, ground reaction forces and muscle activities. Although the model did not include a CPG, it did depend on a finite-state machine that selectively activates and deactivates reflexes, so that they are only active at particular phases of the locomotor cycle. One could argue such a gating mechanism represents a similar function as a CPG and could in fact be implemented in a CPG circuit.
The Geyer and Herr model has inspired several follow-up models to investigate gait modulation (Dzeladini et al., 2014; Ramadan et al., 2022; Russo et al., 2021; Song and Geyer, 2015), 3D walking and running (Wang et al., 2012), and locomotor pathologies (Bruel et al., 2022; Ong et al., 2019; Song and Geyer, 2018). Control of speed is difficult to achieve with a purely sensory-driven circuit, as it requires the modulation of multiple reflex gains with non-linear functions. Dzeladini et al. (2014) demonstrated that adding CPG circuits to the sensory-driven model of Geyer and Herr (2010) could simplify the control of speed (Fig. 5H). They achieved speed regulation over a large range using simple drive signals that modulated the frequencies and amplitudes of the CPG oscillations. Interestingly, they obtained the best speed control by adding oscillators only to the muscles controlling the hip joints. These simulations support the hypothesis proposed by Daley et al. (2007) – based on perturbations to running gaits of birds – that proximal joints are controlled with higher-gain feedforward (CPG) signals and distal joints are controlled by higher-gain feedback signals (Fig. 4).
Overall, it is clear from these simulation studies that sensory-feedback loops are essential for human locomotion, supporting our hypothesis that mechanically unstable locomotion is more sensory driven than CPG driven (Fig. 3). CPGs are likely to contribute mainly to speed and gait modulation. Interestingly, the simulations of Geyer and Herr (2010) and most follow-up simulations are not capable of producing slow and very slow walking, because the simulated models simply fall. This suggests more sophisticated balance control mechanisms are missing in the models, and hence these models do not yet properly implement the more important role of descending modulation that we hypothesize for unstable locomotion (Fig. 3).
The neuromechanics of bipedal locomotion of birds has been less commonly modeled than human locomotion. One neuromechanical simulation study demonstrated that the sensory-driven control architectures of Geyer and Herr (2010) and Wang et al. (2012) could be adapted to control an ostrich-like body (Geijtenbeek et al., 2013). A number of bird-like robots have also been developed (Apgar et al., 2018; Badri-Spröwitz et al., 2022; Pratt et al., 2001). Among these, BirdBot is particularly interesting, because it implements a bird-inspired tendon system that uses mechanical coupling to control leg stiffness in the stance and swing phases (Fig. 5F). The mechanically coupled design provides self-stable and energy-efficient walking and running with simple CPG-based control and no sensory feedback, highlighting intrinsically stable features of the avian distal limb. Therefore, this represents another source of redundancy, in which the intrinsic musculoskeletal mechanics contributes to intralimb coordination and balance, aspects that are often considered to be pure control problems.
Open questions
Here, we have reviewed historical and current perspectives on the organization of locomotor circuits based on experimental and modeling evidence. Although there are shared features of the component elements across vertebrates, there is also diversity in the relative contributions of these components. We have proposed several hypotheses about how the respective roles of CPGs, reflexes and descending modulation vary across vertebrates: depending on body size, the mechanical instability of gaits, the speed of locomotion and the developmental time to locomotor maturity. We have also hypothesized that these roles can vary within the body, between proximal to distal joints, and depending on the speed and gait. However, to rigorously confirm or reject these hypotheses, we need further integration of animal experiments and neuromechanical simulations.
Numerical models can be particularly useful to test some of these hypotheses. For instance, neuromechanical simulations of a pendulum (which can be viewed as a very simple model of a leg) have shown that periodic behaviors can be obtained by either purely feedback or purely feedforward (CPG-based) mechanisms; however, circuits that combine both feedback and feedforward contributions are more robust against unexpected disturbances and sensorimotor noise (Kuo, 2002). Similar results are obtained with a simulation of biped locomotion (Ryu and Kuo, 2021). An interesting proposition from Kuo and colleagues is that CPGs can be viewed as ‘state estimators’ that predict the state of limbs (and therefore sensory signals). Based on this, a CPG could be viewed as a ‘filter for processing sensory information rather than as a generator of commands’ (Kuo, 2002). In our view, this perspective underestimates the role of CPGs in coordinating and modulating locomotion (e.g. for regulating speed, gait and heading), but it has the merit of analyzing the trade-off between feedforward and feedback control using rigorous optimal estimation principles. Importantly, the potential roles of the CPG as a pattern generator and a state estimator are not necessarily mutually exclusive – CPGs may act as a type of internal model that filters sensory inputs, estimates current state and generates rhythmic outputs based on current state estimates.
Another important open question is related to the degree of centralization of locomotion control and the strength of inter-oscillator couplings within and across animals (Aoi et al., 2017; Holmes et al., 2006; Neveln et al., 2019; Revzen et al., 2009). Historically, fictive locomotion experiments gave the impression that locomotor patterns were mainly generated by CPGs, and that inter-oscillator couplings serve as the mechanism for inter-joint coordination. However, as presented above, modeling has shown that sensory feedback is another mechanism for synchronization that can replace inter-oscillator couplings (Cruse et al., 1995; Owaki et al., 2013; Thandiackal et al., 2021; Suzuki et al., 2021). Biological evidence also shows that local sensory feedback is directly integrated into segmentally distributed CPGs (Grillner et al., 1981; Grillner and Wallén, 1984; Pearson, 2008; Rossignol et al., 2006; Whelan, 1996). Inter-oscillator couplings might therefore be weaker than previously thought. This relatively decentralized control organization would allow for flexible motor patterns to be adapted to environmental constraints, through sensing and modulation of descending pathways.
Neveln et al. (2019) have proposed an interesting framework based on mutual information to quantify centralization in animal locomotion, which could help systematically investigate the degree of centralization across species and conditions. They suggest that locomotor coordination ‘could either be achieved through strong, global coupling with dense connections between components’, representing high centralization, or ‘through weak, local coupling with sparse connections’, representing low centralization. Furthermore, centralization can also be affected by the strength of mechanical coupling and the organization of sensory feedback, regardless of whether it is processed centrally or locally (Holmes et al., 2006). Neveln and colleagues (2019) tested their approach in simulation, with robots, and in cockroach experiments. This model-free, empirical method of quantifying centralization will be useful for analyzing future neuromechanical models and animal experiments. It is likely that the level of centralization depends on the morphology and stability of locomotion, as well as on environmental conditions (speed of locomotion and complexity of the environment). Consistent with this, the strength of coupling between legs appears to be speed-dependent in invertebrates (Drosophila), with no coupling at low speeds of walking and high coupling at high speeds (Berendes et al., 2016). Further research is needed to clarify the mechanisms that enable variation in coupling strength with speed, and to understand the diversity of oscillator coupling strengths across species with varying locomotor demands.
Concerning descending modulation, we do not yet know exactly how many independent descending pathways exist, how many local spinal locomotor circuits they project to (global versus local joint-specific projections), and their effect (activating oscillators, changing a joint offset or modulating reflexes, for instance). From several studies (Arber and Costa, 2022; Ferreira-Pinto et al., 2018; Rossignol et al., 2006), we know that descending projections present a mix of these properties. Modeling studies have started exploring how different aspects of legged locomotion (e.g. frequency, step size, ground clearance and others) can be modulated by descending pathways (Song and Geyer, 2015; Bellegarda and Ijspeert, 2022; Ramadan et al., 2022). But more studies are needed to investigate the diversity of descending pathways across species and how they relate to motor behaviors and mechanical features of the body. Decoding descending pathways will be particularly important in allowing us to understand what types of voluntary movements an animal can perform (for instance, for gait transitions and for limb placement in visually guided locomotion). Animals can smoothly switch between steady-state locomotion and highly modulated locomotion as needed when crossing a complex terrain. It is likely that this is done by switching from activating a small number of descending pathways to more complex time-varying activations of multiple descending pathways. This is related to the concept of relatively spinalized versus cephalized control, discussed above. Also, some animals appear to be better than others at performing fine-tuned movements, and this may reflect a higher number of descending pathways and a larger role of descending modulation in mammals than in amphibians, for example (Fig. 3). Integration of experimental and modeling work is needed to test these ideas.
Conclusions and outlook
We envision a bright future for the next 100 years of research in this area, with exciting opportunities to integrate experiments and modeling to address open questions about the neuromechanical control of locomotion. Thanks to new imaging techniques and genetic identification methods, future full atlases and connectomes of spinal circuits and descending and ascending pathways will be tremendously useful to improve our understanding of the underlying circuits involved in vertebrate locomotion. For instance, by quantifying the proportion of sensory neurons within the spinal cord and the number of independent descending pathways (Arber and Costa, 2022; Ferreira-Pinto et al., 2018), it will be possible to more quantitatively estimate the respective roles of sensory feedback, CPGs and descending modulation across different vertebrate animals. We hope that these techniques will not be limited to classic genetic model animals (e.g. zebrafish and mice), but also used extensively across diverse species to allow comparison between different morphologies and locomotor modes. In particular, compared with the rich literature on terrestrial locomotion, there has been relatively little research on the diversity of sensorimotor control mechanisms among flying vertebrates, which is an important area for further study.
Additionally, advances in optogenetic and chemogenetic techniques represent a tremendous opportunity to selectively activate or deactivate specific cell types, performing experiments that were previously possible only in simulation. There are exciting opportunities for new ‘virtual twin’ experiments that combine experimental technologies and computing power for simulations; for example, by creating neuromechanical simulations that replicate animal behavior in real-time, it could become feasible to conduct state-dependent animal experiments, in which a perturbation is applied when a modeled internal state from the simulation (e.g. tension in a tendon or phase of an oscillator) reaches a specific threshold (see Ramdya and Ijspeert 2023 for additional ideas). It might also become possible to create hybrid experiments in which a spinal cord preparation is connected in closed loop with a musculoskeletal simulation moving in a virtual physics-based environment. In such an experiment, recorded activity from ventral roots would be used to activate simulated muscles, and virtual sensory signals from the simulated moving body would be used to stimulate sensory neurons. Such preparations would allow one to record and investigate spinal cord circuits with all the technologies available for controlled bench experiments while still approximating in vivo conditions of unconstrained locomotion. These kinds of integrative studies will be essential for testing hypotheses about of the fundamental principles of locomotion in vertebrates, understanding how control varies among species, and for guiding functional restoration and therapeutic approaches such as electric epidural stimulation (van den Brand et al., 2012; Wagner et al., 2018).
Acknowledgements
We thank Ansgar Büschges, Pavan Ramdya and two anonymous reviewers for useful comments on a previous version of the manuscript. Thanks to Brooke Christensen for contributing animal illustrations for the figures.
Footnotes
Funding
A.J.I. is financially supported by the École Polytechnique Fédérale de Lausanne and by the European Research Council Synergy grant Salamandra (951477). M.A.D. is supported by University of California, Irvine, and the National Science Foundation (2016049, 2021832). Some ideas represented in this Review arose in the workshop on Integrative Organismal Modeling of Movement supported by the National Science Foundation (2040544 to M.A.D.).
References
Competing interests
The authors declare no competing or financial interests.