Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Application of machine learning to the identification of joint degrees of freedom involved in abnormal movement during upper limb prosthesis use

  • Sophie L. Wang,

    Roles Data curation, Formal analysis, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Division of Biomedical Physics, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, Food and Drug Administration, Silver Spring, Maryland, United States of America, Department of Bioengineering, University of Maryland, College Park, Maryland, United States of America

  • Conor Bloomer,

    Roles Data curation, Methodology, Writing – review & editing

    Affiliation Division of Biomedical Physics, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, Food and Drug Administration, Silver Spring, Maryland, United States of America

  • Gene Civillico,

    Roles Visualization, Writing – review & editing

    Affiliation Office of the National Institutes of Health Director, National Institutes of Health, Bethesda, Maryland, United States of America

  • Kimberly Kontson

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Project administration, Resources, Supervision, Visualization, Writing – review & editing

    Kimberly.Kontson@fda.hhs.gov

    Affiliation Division of Biomedical Physics, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, Food and Drug Administration, Silver Spring, Maryland, United States of America

Abstract

To evaluate movement quality of upper limb (UL) prosthesis users, performance-based outcome measures have been developed that examine the normalcy of movement as compared to a person with a sound, intact hand. However, the broad definition of “normal movement” and the subjective nature of scoring can make it difficult to know which areas of the body to evaluate, and the expected magnitude of deviation from normative movement. To provide a more robust approach to characterizing movement differences, the goals of this work are to identify degrees of freedom (DOFs) that will inform abnormal movement for several tasks using unsupervised machine learning (clustering methods) and elucidate the variations in movement approach across two upper-limb prosthesis devices with varying DOFs as compared to healthy controls. 24 participants with no UL disability or impairment were recruited for this study and trained on the use of a body-powered bypass (n = 6) or the DEKA limb bypass (n = 6) prosthetic devices or included as normative controls. 3D motion capture data were collected from all participants as they performed the Jebsen-Taylor Hand Function Test (JHFT) and targeted Box and Blocks Test (tBBT). Range of Motion, peak angle, angular path length, mean angle, peak angular velocity, and number of zero crossings were calculated from joint angle data for the right/left elbows, right/left shoulders, torso, and neck and fed into a K-means clustering algorithm. Results show right shoulder and torso DOFs to be most informative in distinguishing between bypass user and norm group movement. The JHFT page turning task and the seated tBBT elicit movements from bypass users that are most distinctive from the norm group. Results can be used to inform the development of movement quality scoring methodology for UL performance-based outcome measures. Identifying tasks across two different devices with known variations in movement can inform the best tasks to perform in a rehabilitation setting that challenge the prosthesis user’s ability to achieve normative movement.

Introduction

The loss of distal degrees of freedom (DOFs) in the arms and hands disrupts the performance of most activities of daily living [1]. Between the increased workload of the remaining limb and the altered joint kinematics that result from compensating for the loss of DOFs [24], individuals with upper limb loss are at greater risk for musculoskeletal pain and overuse injuries [1,57]. Understanding this risk, researchers and clinical groups are developing new performance-based outcome measures that incorporate subjective evaluation of how a task is being completed by asking the administrator to compare the movements of the prosthesis user to those of a person with a sound, intact upper limb [8,9].

Although these scoring approaches provide more insight into the functional abilities of individuals using upper limb prosthesis technology, the broad definition of “normal movement” and the subjective nature of the scoring can make it difficult to know which areas of the body to focus on evaluating, and the magnitude of the deviation from the normative movement ranges. There have been several studies utilizing quantitative motion capture to examine movement quality for the upper limb prosthesis user population [24,1013], but these studies tend to isolate single features of motion and make narrowly-defined comparisons to non-disabled individuals. Additionally, these studies vary greatly in the kinematic parameters analyzed–from joint angles and range of motion [24,1214] to velocity changes [11,15], rendering trend interpretations and cross study conclusions challenging.

Furthermore, these evaluations of movement are typically completed for a single terminal device at a time, making the effects of varying prosthetic technologies unclear. Consider two available technologies for this clinical population: the voluntary open body-powered hook controlled through body movements and the DEKA arm controlled with inertial measurement units attached to the feet [1619]. With different prosthetic components and technology that provide different DOFs of control, one might anticipate kinematic differences in response to the available DOFs and control mechanism [20]. However, it is not yet clear where in the body and during what types of tasks these kinematic differences occur relative to normal movement and whether administrators should focus on certain areas of the body based on the type of prosthetic technology being used.

The identification of upper body movements as normal or not normal can easily be characterized as a binary classification problem. If upper body movement can be quantified into discrete features that describe the kinematic trajectories for a given DOF, clustering analysis can be used to systematically determine differences between two groups. Cluster analysis allows for the application of a global measure of separation (e.g. Euclidian distance) over an entire set of characteristics that describe movement instead of performing several individual comparisons for a single discrete movement characteristic (e.g. range of motion) that may be over- or underestimating differences between two groups, and require additional interpretation and subjective weighting on importance, especially with larger numbers of characteristics (or features) to be compared between groups. Individual comparisons (e.g. t-tests, ANOVAs, etc.) have their place in the identification of movements as normal or abnormal, but unsupervised clustering approaches provide an additional level of robustness by analyzing data without a priori knowledge of group characteristics [21]. The application of clustering analysis to identify movement differences between groups is not novel. Some studies have used input from inertial measurement units and accelerometers to classify different upper limb movements [22,23] or different gait patterns [24]. Other studies have applied clustering analysis and other machine learning techniques to motion capture data to classify different full body actions in healthy individuals [25] or severity of crouch gait in children with cerebral palsy [26]. Electromyography data of the abdominal and erector spinae muscles has also been used as input to clustering algorithms to classify patterns of muscle activity during gait in healthy controls [27]. While a couple of clustering studies have focused on the upper limb prosthesis user population, the application of clustering analysis to compare movement of individuals using multiple prosthetic devices to the movements of non-disabled individuals has not been done.

Based on the gaps described above, the goals of this work are to 1) identify DOFs that will inform abnormal movement for several tasks using unsupervised machine learning (clustering methods) and 2) elucidate the variations in movement approach across two upper-limb prosthesis devices with varying DOFs as compared to non-disabled controls. Motion capture data from non-disabled controls and individuals using two upper limb bypass prosthesis devices (body-powered hook and DEKA arm) will be used as input into a K-means clustering algorithm. The body-powered hook was chosen as a commonly used upper limb prosthesis terminal device [2833], and the DEKA arm was chosen as a state-of-the-art terminal device with novel control mechanisms and powered DOFs [16,17,20,34]. By identifying DOFs involved in abnormal motion elicited through prosthesis device use, more targeted instructions in the performance-based outcome measures seeking to evaluate movement quality can be provided. Additionally, the results of the work can provide cross-device guidance for the evaluation of joints and movements typically involved in abnormal motion and insight into the differences in movement elicited by two different types of upper limb prosthesis devices. Lastly, identifying tasks with known variations in movement for specific device types can help inform the best tasks to perform in a rehabilitation setting that challenge the prosthesis user’s ability to achieve normative movement.

Methods

Participants

A total of 24 non-disabled participants with no upper limb disability or impairment and no prior prosthesis experience were included in this study. The study was approved by the FDA IRB (Protocol 16–071). All participants provided written informed consent prior to participating in the study. Each participant performed a set of standardized tasks under one of several conditions: Normative (Norm), Body Powered Bypass (BP Bypass), or DEKA Bypass (DK Bypass). To avoid confounding effects of the same individual being trained on two different prosthetic devices and to be mindful of participants’ time commitment to the study, each participant only participated in one condition.

In the bypass conditions, adaptive bypass devices allowed trained non-disabled participants to use upper limb prosthesis terminal devices (Fig 1A and 1B). Bypass devices are a well-accepted approach to assess skill acquisition, training efficacy, and device use performance [29,30,3537]. The use of bypass devices was chosen in this study to isolate the influence of the upper limb terminal device on motion [38,39], as prosthesis users vary in terms of favored terminal devices, device training, and usage experience. Recruitment of individuals using the DEKA arm is also difficult since very few individuals throughout the country are trained on and using this device. In accordance with the protocol of Bloomer et al. [38], participants were trained for 20 hours on each bypass prosthetic device. Recommendations on training length for actual upper limb prosthesis users vary from 5 hours to several months [40,41], thus 20 hours of training is a reasonable approximation to training that would be received in a clinic. Further details on the participants and the devices within each of these condition groups are provided below.

thumbnail
Fig 1. Upper limb prosthesis bypass devices.

A) Body Powered Bypass device, right side configuration with body-powered voluntary open Hosmer 5x split hook terminal device. B) DEKA Bypass device, right-hand radial configuration with powered wrist.

https://doi.org/10.1371/journal.pone.0246795.g001

Normative (Norm) condition.

No devices were used in the Norm condition, and no training was provided. A convenience sample of 12 participants performed each task under the Norm condition (four females, eight males; mean age 26.91 ± 9.84 years). 11 of the 12 participants self-reported right-hand dominance, and all participants performed the standard tasks with the right hand. It was determined through examination of data distributions that left-hand and right-hand dominant individuals did not consistently differ in joint movement during tasks. Therefore, in order to maintain a higher sample size, left-handed individuals were included in the analysis.

The 12 participants were randomly assigned to two separate groups of six to serve as controls for the 6 BP Bypass and the 6 DK Bypass participants. The randomization was performed ten times to examine the effects of the variance in the normative condition. Further details of the randomization will be provided in the K-means clustering section below. None of the participants included in the Norm condition participated in any of the bypass conditions.

Body-Powered (BP) Bypass condition.

In the BP Bypass condition (Fig 1A), a forearm brace adaptor with a perpendicular handlebar allowed the use of a body-powered voluntary open Hosmer 5x split hook terminal device, with manual locking wrist rotation, set in-line with the length of the forearm. On average, the length of the bypass prosthesis was 9.25 ± 0.64 cm longer than the intact limb. The body-powered bypass device was provided by Arm Dynamics (Dallas, TX). The in-line terminal device configuration was chosen due to the mechanical and kinematic requirements of the cable actuation with the figure eight harness.

A convenience sample of 6 participants (3 females, 3 males; mean age 28.16 ± 2.67 years) were trained with the BP Bypass device. All participants self-reported right-hand dominance. During standard task performance, the BP Bypass was set to a right-side configuration for all participants.

DEKA (DK) Bypass condition.

For the DK Bypass condition (Fig 1B), a forearm brace adaptor provided by Next Step Bionics (Manchester, NH) with a perpendicular handlebar allowed the use the right-hand radial configuration motorized DEKA device with powered wrist. Just as the device is controlled by individuals with upper limb loss, non-disabled participants used inertial measurement units attached to the dorsum of the foot to control grip changes, opening and closing of the device, and wrist rotation. This terminal device was mounted to the forearm adaptor with a medial offset of 10° from the participant’s forearm.

A convenience sample of 6 participants (2 females, 4 males; mean age 27.67 ± 7.13 years) were trained with the DK Bypass device. 5 participants self-reported right-hand dominance, 1 participant self-reported left-hand dominance. All participants performed standard tasks with the right-hand radial configuration DK Bypass. It was determined through examination of data distributions that left-hand and right-hand dominant individuals did not consistently differ in joint movement during tasks. Therefore, in order to maintain a higher sample size, left-handed individuals were included in the analysis.

Functional tasks

Participants performed two outcome measures: the Jebsen-Taylor Hand Function test (JHFT) and the targeted Box and Blocks Test (tBBT) [42,43]. These tasks were chosen as ones that would elicit a wide range of movements representative of those performed during activities of daily living. The JHFT consists of seven activities of daily living (ADL) tasks performed in a seated position: 1) Writing, 2) Page Turning, 3) Picking Up Small Objects, 4) Simulated Feeding, 5) Stacking Checkers, 6) Moving Large Light Objects and 7) Moving Large Heavy Objects [42]. A standard template was used to place each object for a given task in the same location for each participant. The tBBT involves the controlled transport of 16 blocks arranged in a 4 by 4 array from one side of a divided box to the other side [43]. This task was performed in both a standing position and a seated position [43]. Participants performed two trials of each task.

Motion analysis

An eight-camera passive marker ViconTM motion analysis system was used to acquire and pre-process motion data (VICON, Oxford, UK). The Bonita B10 motion capture cameras were set to a sampling rate of 100Hz. Prior to each data collection session, the motion analysis system was calibrated according to manufacturer guidelines. Twenty-seven retro-reflective markers were placed on the upper body of each participant at the bony anatomical landmarks of the upper body in accordance with the Vicon Upper-Body Plug-In-Gait body model documentation (“Upper body modeling with Plug-in Gait,” 2019). Briefly, head markers were placed on the right/left temple and right/left back of the head; torso markers were placed on the spinous process of C7 and T10 vertebrae, right scapula, xiphoid process, and sternal notch; arm markers were placed on the acromio-clavicular joint, lateral surface of upper arm, lateral epicondyle of the elbow joint, lateral surface of lower arm, medial and lateral sides of the wrist joint, and on the third metacarpal; hip markers were placed on the right/left anterior superior iliac torso and right/left posterior superior iliac torso. The Plug-In-Gait upper body model was then calibrated to the dimensions of the participant to create the wrist, forearm, upper arm, head, neck, torso, and pelvic model segments.

Data analysis

Joint angles were calculated from the Vicon upper body model using YXZ Euler angles derived from relative orientation comparisons of two segments (VICON Plug-In-Gait, Oxford, UK). Details on the calculation of kinematic parameters and model validation can be found in [4446] The DOFs analyzed in this study include right and left elbow flexion/extension; right and left shoulder flexion/extension, abduction/adduction, and internal/external rotation; torso flexion, lateral flexion, and rotation; and neck flexion, lateral flexion, and rotation. Although the tasks performed were not bi-manual, we included DOFs at the left shoulder given the high incidence of musculoskeletal pain and injury occurring at the shoulder and on the contralateral limb for this clinical population [1]. The left elbow DOF was included to provide a complete understanding of the upper body/arm movement differences.

The angle data were then filtered using a 4th order, zero lag, low pass Butterworth filter at 6 Hz. Data from each trial were further segmented into segments, with the number of segments depending on the number of objects manipulated in a given task. For example, the JHFT Task 2 -Page turning required the participant to turn over five notecards, which resulted in five segments. For all tasks, segment start was defined as approximately 10 frames before a participant contacted an object. Segment end was defined as approximately 10 frames after a participant let go of an object. A standard template was used to place each object for a given task in the same location for each participant, but the objects themselves may be distributed across the front of the participant or to the side of the participant depending on the task. To adequately compare kinematic trajectories across participants within a given condition, the analysis was limited to the last segment (i.e. object manipulated) within each trial.

K-means clustering

K-means clustering was selected as the unsupervised machined learning method for this study due to the binary nature of the classification problem (i.e. Norm vs a Bypass), and the simplicity of the algorithm’s decision-making approach. Specific parameters, or features, of the joint angle trajectories were calculated to characterize the movement and serve as input into the K-means clustering algorithm. Given the current lack of consensus on the definition of movement quality as it pertains to evaluation of upper limb prosthesis users [47], several features describing different aspects of movement were selected for this analysis: peak angle, range of motion (RoM), joint trajectory path distance (PDist), mean joint angle, peak angle velocity, and number of zero crossings. The peak angle was calculated as the maximum measured joint angle value. The RoM was calculated as the difference between the maximum angle and the minimum angle value. The PDist was calculated according to Eq 1, wherein the absolute difference between each joint angle component sample point was calculated and summed across all samples taken (1 to n points) for a given DOF. For this metric, all trajectories were interpolated to be the same array length n, so no additional normalization to PDist was done.

(1)

Mean angle was calculated as the average of the joint angle over the task segment. The maximum value of the derivative of each joint angle served as the peak angle velocity. Smoothness was measured from zero crossing, where zero crossing is defined as the number of times angle velocity crossed zero [48,49]. The peak angle and RoM were selected as clinically accepted, accessible, and interpretable features of movement [4,11,42,43,5055] and represent the movement envelope within which an individual performs a given task. PDist was selected as an additional summary metric to characterize movements as it has been previously used in the literature to examine compensatory motions in individuals with upper limb loss [11], and has been used as a method to examine motion efficiency [56,57]. Max normalization was applied for each feature.

Understanding one of the limitations of k-means clustering to be the dependence of the output on cluster center initialization, cluster center initialization used the K-means++ algorithm (Statistics and Machine Learning Toolbox, MATLAB) with the squared Euclidean as the distance metric. To further improve consistency in results by avoiding local minima, the clustering algorithm was implemented with five replicates.

K-means clustering analyses were performed between the normative condition data and each bypass condition data (i.e. Norm vs. BP Bypass and Norm vs. DK Bypass), for each task and DOF, resulting in a total of 126 K-means analyses for one bypass condition (9 tasks x 14 DOFs per condition). For each analysis, ten iterations were performed, with randomized Norm controls assigned for each iteration. That is, each k-means iteration for a given task and DOF had the twelve normative participants randomly assigned into either the BP Bypass control group or the DK Bypass control group. This approach was implemented to account for variation in normal movement patterns, and to provide an estimate of the classification accuracy range. A flowchart of the data collection, processing, and analysis is shown in in Fig 2. In total, 2,520 K-means were performed (9 tasks x 14 DOFs x 10 iterations x 2 conditions).

thumbnail
Fig 2. Flowchart of data collection and processing and the calculation of deviation from chance (DfC) metric.

https://doi.org/10.1371/journal.pone.0246795.g002

Evaluation of algorithm performance–Deviation from Chance (DfC) metric.

Although the true category of each data point was known (i.e. Norm or Bypass), the unsupervised approach employed in this study assigns an arbitrary category to every “cluster” that is formed. Thus, when determining accuracy of the classification, a new accuracy metric was used that provides the accuracy of clustering regardless of the actual labeling of any cluster, if the data points of any given cluster are maintained as a single cluster. The new metric utilized in this paper measured the absolute difference of the accuracy from random chance, which is 50% for a binary classification. We refer to this metric as the deviation from chance or DfC (Eq 2). The DfC ranges from 0 to 50, with a result of 0 indicating that a particular DOF was not informative in distinguishing the Norm and Bypass conditions (i.e. classification accuracy matches that of random chance) and a result of 50 indicating a particular DOF was highly informative in distinguishing the Norm and Bypass conditions. A threshold for this DfC metric was selected to be 25, half of the maximum possible value, as an initial value. More or less strict requirements can be placed on the identification of DOFs that distinguish the Norm and Bypass conditions by increasing or decreasing this DfC threshold, respectively.

(2)

Statistical analysis.

To determine the DfC values for a given DOF/task that are significantly higher than the DfC threshold of 25, a one-sided Wilcoxon ranksum test was performed between the DfC values resulting from the 10 iterations for a given task/DOF and the threshold (α = 0.05). Since the goal of this work is to identify the individual DOFs and tasks that elicit significantly different movement from normative movement during use of a bypass prosthesis, an adjustment for multiple comparisons was not done. However, a table of p-values for this analysis is included in supplementary material (S1 Table).

The distributions of all features used in the k-means analyses are also plotted for each DOF and task (S1S14 Figs). For informational purposes, a Wilcoxon ranksum test between each bypass condition and the norm condition was done with a significance level set at α = 0.05. While a comparison of clustering approaches to conventional statistical approaches is beyond the scope of this paper, these data are provided for transparency purposes.

Results

This work successfully created kinematic datasets with representative activities of daily living motions in multiple populations of simulated device users. Between the neck, torso, right and left elbows, and right and left shoulders, there were 14 DOFs analyzed for each of the 9 tasks performed. The average DfC metric from the K-means analyses are plotted for each individual joint and task, with error bars on the bar plots indicating the standard deviation of the 10 k-means iterations (Fig 3). Asterisks in the bar plots indicate that a given DOF/task for a condition resulted in a significantly higher DfC values than the threshold. This figure allows for identification of tasks that separate normative movement from bypass device movement as a function of each analyzed DOF. The threshold for DfC was denoted through the red dotted line at 25 (Fig 3). In general, the tasks that exceeded the threshold varied across the bypass conditions and the DOFs within each joint. The results were consistent with previous studies in showing that tasks and joint DOF involved in abnormal movement are device-specific. However, certain patterns did emerge and will be discussed in the Discussion section.

thumbnail
Fig 3.

Average and standard deviation from chance (DfC) for all tasks, DOFs, and bypass condition comparisons: A-F) Body Powered Bypass v. Norm Joint results, G-L) DK Bypass v. Norm Joint Results. Tasks: JHFT1—Writing, JHFT2—Page Turning, JHFT3—Picking Up Small Objects, JHFT4—Simulated Feeding, JHFT5—Stacking Checkers, JHFT6—Moving Large Light Objects and JHFT7—Moving Large Heavy Objects. Distributions significantly greater than the threshold at DfC = 25 (red dotted line) denoted by a * (p < 0.05).

https://doi.org/10.1371/journal.pone.0246795.g003

To get a better sense of which tasks and DOFs were associated with the greatest distinguishability between normative movement and bypass condition movement, the K-means results that were significantly greater than the DfC threshold were summarized for each bypass condition. Out of the 126 k-means analyses for the BP bypass condition (9 tasks x 14 DOFs) performed, 62 were significantly higher than the threshold (p < 0.05). For those 62 analyses, the frequency of appearance of a particular task (Table 1A) or DOF (Table 1B) was determined and presented as a percentage. The same summary was done for the DK bypass condition, with 64 out of 126 analyses significantly exceeding the threshold, and the frequency of a particular task (Table 1A) or DOF (Table 1B) was determined.

thumbnail
Table 1.

Percentage of times a (A) task and (B) DOF were associated with deviations from chance distributions significantly greater than the threshold.

https://doi.org/10.1371/journal.pone.0246795.t001

One of the most frequent tasks with high DfC values for both the BP bypass and DK bypass conditions was JHFT2 –Page Turning, occurring in 14.5% and 17.2% of the significant results, respectively (Table 1A). Some tasks were found to elicit more significant DfC values for one bypass condition, but not the other. For example, 16.1% of the significant results were elicited by tBBT in the BP bypass condition compared to only 3.1% for this same task in the DK bypass condition.

When all DOFs are combined, the right shoulder and torso appear more often in the significant results across both bypass conditions, indicating these joints are most informative for distinguishing movement between the Norm and Bypass conditions (Table 1B). Interestingly, left shoulder abduction/adduction appears often in the significant results for both the BP (9.7%) and DK (12.5%) bypass conditions. While each DOF tends to be equally represented in the significant results across bypass conditions, there is a large discrepancy in the neck DOFs, with these DOFs appearing more often when distinguishing movement between the Norm condition and DK bypass condition.

Discussion and conclusion

The goals of this work were to utilize unsupervised machine learning to identify parameters that will inform abnormal movement for several tasks and elucidate the variations in movement approach across two different upper-limb prosthesis devices with varying DOFs as compared to non-disabled controls. To achieve those goals, specific features of movement derived from motion capture data from individuals with no upper limb impairment or disability under normative conditions and individuals using two upper limb bypass prosthesis devices (body-powered hook and DEKA arm) were used as input into a K-means clustering algorithm. While a few studies have focused on the application of clustering algorithms to the upper limb prosthesis user population, the use of these clustering methods to compare movement of individuals using these two prosthetic devices to the movements of non-disabled individuals has not been done.

Although patterns emerged, there was no single DOF that was universally distinctive across tasks and Bypass conditions (Fig 3) and no single task that consistently elicited distinctive movements between the Norm and Bypass conditions (Fig 3). This result is not unexpected, however, based on previous studies that have indicated compensation patterns for this clinical population are both task and device dependent [2,20]. The BP Bypass results, with highly distinct torso and shoulder angles, were consistent with the results from Metzger et al. 2012 which had 7 of the 10 participants using a body powered device [11]. Additionally, the compensatory motions of the head and torso found by Hussaini et al. 2017 in prosthesis users equipped with single DOF electric hand terminal devices [3] also corresponded well with the distinct joint angles identified in the BP Bypass condition. With a more robust approach to characterizing movement that simultaneously incorporates multiple features of movement into advanced clustering algorithms to identify differences, the results presented here still build on existing knowledge and can be used to inform the development of scoring methodology for upper limb performance-based outcome measures. A discussion of the clinical implications of the results as well as limitations and future work follows.

According to Table 1B, the right shoulder and torso are more frequently associated with high DfC values, meaning differences in normative and bypass prosthesis user movement are greater for these body regions. Fig 3B and 3H indicate that tasks requiring a lot of wrist motion, such as JHFT2—page turning and JHFT6 –moving large, light objects, will challenge shoulder abduction and internal rotation for both BP and DK Bypass prosthesis users, but not so much shoulder flexion. This information could be used to devise more targeted approaches for the assessment of normal movement for tasks typically requiring wrist manipulation. Instead of simply asking an observer to make a subjective assessment of the normalcy of movement, instructions could be provided to closely observe how far the upper arm goes out to the side or how much rotation is required of the upper arm to complete a task. Similarly, instructions could be provided to focus more on torso rotation as opposed to torso forward flexion or lateral flexion for tasks that require small object manipulation. Fig 3C and 3I indicate for tasks such as JHFT3 –small objects and JHFT5—stacking checkers, torso rotation is the DOF that differs most consistently between non-disabled controls and bypass prosthesis users. Results also show that left shoulder abduction/adduction is frequently different between non-disabled controls and bypass prosthesis users, as this DOF appears in 9.7% and 12.5% of results significantly higher than the threshold for the BP and DK bypass conditions, respectively (Table 1B). This is not an unexpected result for the BP bypass prosthesis since this prosthetic device type is controlled by movement of the contralateral arm. That the DK bypass condition also shows high use of this DOF may indicate the weight of the DK device causes extra counter-movements in the opposite arm. Although the experimental protocol included a weight balancer and arm brace to reduce the impact of the DK bypass weight on movement, we cannot discount the fact that this may be an artifact of the experimental design. Repeating the experiment in actual DK prosthesis users would illuminate the tendency of this user group to move the contralateral limb during unilateral tasks.

As mentioned previously, the type of device being used may also be an important factor to consider when assessing normalcy of movement and the impact of the device on compensatory movement. Fig 3B, for example, shows that right shoulder flexion/extension during JHFT4 –simulated feeding is significantly different between non-disabled control movement and BP Bypass prosthesis user movement. However, Fig 3H shows that right shoulder abduction/adduction and rotation are the DOFs that distinguish non-disabled control movement from DK Bypass prosthesis user movement for this same task. Another interesting observation showing the potential impact of device on movement can be seen in the neck DOFs in Table 1B and DfC plots in Fig 3D and 3J. Of all the DOFs that appeared in the results significantly higher than the DfC threshold of 25 for the BP bypass condition, only 8.1% included neck DOFs. Conversely, 20.3% of the significant results for the DK bypass included neck DOFs. This implies neck movements of individuals using the DK bypass prosthesis are more often different from the non-disabled control group. The result can be explained by considering the visibility of objects being manipulated by the terminal device of these two prosthetic systems, with body-powered hooks more typically known for good visibility of objects [58]. Understanding how the device impacts the movement of the user is important to assessing the normalcy of the observed movement, and the results presented here serve as a preliminary source for elucidating such an impact for two types of upper limb prosthetic devices.

Due to the binary nature of the classification problem (i.e. Norm vs a Bypass), and the simplicity of the algorithm’s decision-making approach, K-means clustering was selected for this study. K-means clustering is a partitioning algorithm that divides data into groups of at least one value with each data value assigned to exactly one group, by minimizing the mean distance of the data value from an assigned cluster center value in repeated rounds of reassignment as necessary [59]. Alternate partitioning algorithms, model-based algorithms, or density-based clustering algorithms may provide greater separation between conditions. The features selected (peak angle, range of motion, path distance, mean angle, peak angle velocity, and zero crossings) were selected for their ease in translation to actual motion and understandability. This study aimed to use an easily understandable machine learning approach to examine motion data for useful differences, so no dimensionality reduction approaches were applied. The identification of features most informative to the difference between normative and bypass prosthesis user movement was out of scope for this paper, but such an analysis may help contribute to consensus on the definition of movement quality.

One output of this work is the creation of kinematic datasets with representative ADL motions in multiple populations of simulated device users. Even with only six features characterizing movement, the K-means clustering approach was able to identify distinctive joint DOFs for several ADL tasks over two methods of simulated upper limb prosthesis use. With the development of more compact, easily implementable motion analysis systems such as 3D optical marker-based motion capture, inertial measurements units, or markerless motion capture that can be used in the home or clinic, the widespread collection of quantitative movement data is becoming more of a reality. Although limited in generalizability to actual prosthesis users, this dataset can be used to inform the development of larger, more applicable datasets to be incorporated into a supervised machine learning algorithm for the real-time identification of abnormal or compensatory movement based on movement data input.

Key limitations of this study include the limited sample size due to the high training requirements for skillful bypass device use, the use of non-disabled participants, the unilateral nature of the tasks selected, as well as the limited interaction zones required for task performance. While the use of uniformly trained non-disabled participants limits the sources of kinematic variation to those of the device and potentially allows for a larger participant pool, the generalizability of these results to individuals with upper limb loss remains to be seen. Furthermore, the unilateral nature of the tasks selected allowed the examination of device induced changes in kinematics but may not be fully representative of device use patterns outside of the lab environment. Lastly, all tasks were performed in a frontal central interaction zone, which reflects the task space of performance-based outcome measure tasks in common use [47]. However, device induced kinematic changes outside of this interaction zone were not captured.

Future avenues of investigation include increasing the number of trained participants, comparing the results from this study with the actual upper limb prosthesis user motion capture data, investigating additional features for machine learning, investigating additional clustering approaches, and performing further experiments with additional tasks that require device use in spaces other than directly in front of the participant.

Supporting information

S1 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for right elbow flexion/extension.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s001

(PDF)

S2 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for right shoulder flexion/extension.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s002

(PDF)

S3 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for right shoulder abduction/adduction.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s003

(PDF)

S4 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for right shoulder rotation.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s004

(PDF)

S5 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for torso flexion.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s005

(PDF)

S6 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for torso lateral flexion.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s006

(PDF)

S7 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for torso rotation.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s007

(PDF)

S8 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for neck flexion.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s008

(PDF)

S9 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for neck lateral flexion.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s009

(PDF)

S10 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for neck rotation.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s010

(PDF)

S11 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for left shoulder flexion/extension.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s011

(PDF)

S12 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for left shoulder abduction/adduction.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding,JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s012

(PDF)

S13 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for left shoulder rotation.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s013

(PDF)

S14 Fig. Distributions of features for DEKA Bypass (blue), BP Bypass (red), and Norm (black) conditions for left elbow flexion/extension.

Tasks JHFT1 -Writing, JHFT2 -Page Turning, JHFT3 -Picking Up Small Objects, JHFT4 -Simulated Feeding, JHFT5 -Stacking Checkers, JHFT6 -Moving Large Light Objects and JHFT7 -Moving Large Heavy. Stars denote statistical significance of Wilcoxon ranksumtest between each bypass condition data and the Norm condition data. *p< 0.05, **p<0.01, ***p<0.001.

https://doi.org/10.1371/journal.pone.0246795.s014

(PDF)

S1 Table. P-values for the statistical test comparing the Deviation from Chance (DfC) distributions for a given task/DOF to the threshold value (DfC = 25).

https://doi.org/10.1371/journal.pone.0246795.s015

(DOCX)

Acknowledgments

The authors thank David Nahmias (Food and Drug Administration) for his assistance with data architecture. The authors also thank Arm Dynamics (Dallas, TX) and Next Step Bionics (Manchester, NH) for designing and fabricating the bypass prostheses, and DEKA for providing the radial configuration DEKA arm.

Disclaimer: The mention of commercial products, their sources, or their use in connection with material reported herein is not to be construed as either an actual or implied endorsement of such products by the Department of Health and Human Services.

References

  1. 1. Ostlie K, Franklin RJ, Skjeldal OH, Skrondal A, Magnus P. Musculoskeletal pain and overuse syndromes in adult acquired major upper-limb amputees. Archives of physical medicine and rehabilitation. 2011;92(12):1967–73 e1. pmid:22133243
  2. 2. Carey SL, Jason Highsmith M, Maitland ME, Dubey RV. Compensatory movements of transradial prosthesis users during common tasks. Clin Biomech (Bristol, Avon). 2008;23(9):1128–35. pmid:18675497
  3. 3. Hussaini A, Zinck A, Kyberd P. Categorization of compensatory motions in transradial myoelectric prosthesis users. Prosthet Orthot Int. 2017;41(3):286–93. pmid:27473642
  4. 4. Major MJ, Stine RL, Heckathorne CW, Fatone S, Gard SA. Comparison of range-of-motion and variability in upper body movements between transradial prosthesis users and able-bodied controls when executing goal-oriented tasks. J Neuroeng Rehabil. 2014;11:132. pmid:25192744
  5. 5. Bouma SE, Postema SG, Bongers RM, Dijkstra PU, van der Sluis CK. Musculoskeletal complaints in individuals with finger or partial hand amputations in the Netherlands: a cross-sectional study. Disabil Rehabil. 2018;40(10):1146–53. pmid:28637147
  6. 6. Marshall M, Helmes E, Deathe AB. A comparison of psychosocial functioning and personality in amputee and chronic pain populations. Clin J Pain. 1992;8(4):351–7. pmid:1493346
  7. 7. Postema SG, Bongers RM, Brouwers MA, Burger H, Norling-Hermansson LM, Reneman MF, et al. Musculoskeletal Complaints in Transverse Upper Limb Reduction Deficiency and Amputation in The Netherlands: Prevalence, Predictors, and Effect on Health. Archives of physical medicine and rehabilitation. 2016;97(7):1137–45. pmid:26906238
  8. 8. Kearns NT, Peterson JK, Smurr Walters L, Jackson WT, Miguelez JM, Ryan T. Development and Psychometric Validation of Capacity Assessment of Prosthetic Performance for the Upper Limb (CAPPFUL). Archives of physical medicine and rehabilitation. 2018;99(9):1789–97. pmid:29777713
  9. 9. Resnik L, Adams L, Borgia M, Delikat J, Disla R, Ebner C, et al. Development and evaluation of the activities measure for upper limb amputees. Archives of physical medicine and rehabilitation. 2013;94(3):488–94 e4. pmid:23085376
  10. 10. Hebert JS, Boser QA, Valevicius AM, Tanikawa H, Lavoie EB, Vette AH, et al. Quantitative Eye Gaze and Movement Differences in Visuomotor Adaptations to Varying Task Demands Among Upper-Extremity Prosthesis Users. JAMA Netw Open. 2019;2(9):e1911197. pmid:31517965
  11. 11. Metzger AJ, Dromerick AW, Holley RJ, Lum PS. Characterization of compensatory trunk movements during prosthetic upper limb reaching tasks. Archives of physical medicine and rehabilitation. 2012;93(11):2029–34. pmid:22449551
  12. 12. Carey SL, Dubey RV, Bauer GS, Highsmith MJ. Kinematic comparison of myoelectric and body powered prostheses while performing common activities. Prosthet Orthot Int. 2009;33(2):179–86. pmid:19367522
  13. 13. Valevicius AM, Boser QA, Chapman CS, Pilarski PM, Vette AH, Hebert JS. Compensatory strategies of body-powered prosthesis users reveal primary reliance on trunk motion and relation to skill level. Clinical Biomechanics. 2020;72:122–9. pmid:31862606
  14. 14. Abd Razak NA, Abu Osman NA, Wan Abas WA. Kinematic comparison of the wrist movements that are possible with a biomechatronics wrist prosthesis and a body-powered prosthesis: a preliminary study. Disabil Rehabil Assist Technol. 2013;8(3):255–60. pmid:22830946
  15. 15. de los Reyes-Guzman A, Dimbwadyo-Terrer I, Trincado-Alonso F, Monasterio-Huelin F, Torricelli D, Gil-Agudo A. Quantitative assessment based on kinematic measures of functional impairments during upper extremity movements: A review. Clin Biomech (Bristol, Avon). 2014;29(7):719–27. pmid:25017296
  16. 16. Resnik L, Klinger SL, Etter K. The DEKA Arm: its features, functionality, and evolution during the Veterans Affairs Study to optimize the DEKA Arm. Prosthet Orthot Int. 2014;38(6):492–504. pmid:24150930
  17. 17. Resnik L, Klinger SL, Etter K, Fantini C. Controlling a multi-degree of freedom upper limb prosthesis using foot controls: user experience. Disabil Rehabil Assist Technol. 2014;9(4):318–29. pmid:23902465
  18. 18. Resnik L, Latlief G, Klinger SL, Sasson N, Walters LS. Do users want to receive a DEKA Arm and why? Overall findings from the Veterans Affairs Study to optimize the DEKA Arm. Prosthet Orthot Int. 2014;38(6):456–66. pmid:24286806
  19. 19. Resnik LJ, Acluche F, Lieberman Klinger S. User experience of controlling the DEKA Arm with EMG pattern recognition. PLoS One. 2018;13(9):e0203987. pmid:30240420
  20. 20. Bloomer C, Kontson KL. Comparison of DEKA Arm and body-powered upper limb prosthesis joint kinematics. Archives of Rehabilitation Research and Clinical Translation. 2020.
  21. 21. Rovini E, Fiorini L, Esposito D, Maremmani C, Cavallo F. Fine Motor Assessment With Unsupervised Learning For Personalized Rehabilitation in Parkinson Disease. IEEE Int Conf Rehabil Robot. 2019;2019:1167–72. pmid:31374787
  22. 22. Biswas D, Cranny A, Gupta N, Maharatna K, Achner J, Klemke J, et al. Recognizing upper limb movements with wrist worn inertial sensors using k-means clustering classification. Hum Mov Sci. 2015;40:59–76. pmid:25528632
  23. 23. McLeod A, Bochniewicz EM, Lum PS, Holley RJ, Emmer G, Dromerick AW. Using Wearable Sensors and Machine Learning Models to Separate Functional Upper Extremity Use From Walking-Associated Arm Movements. Archives of physical medicine and rehabilitation. 2016;97(2):224–31. pmid:26435302
  24. 24. Pendharkar G, Naik GR, Nguyen HT. Using Blind Source Separation on accelerometry data to analyze and distinguish the toe walking gait from normal gait in ITW children. Biomedical Signal Processing and Control. 2014;13:41–9.
  25. 25. Kapsouras I, Nikolaidis N. Action recognition on motion capture data using a dynemes and forward differences representation. Journal of Visual Communication and Image Representation. 2014;25(6):1432–45.
  26. 26. Rozumalski A, Schwartz MH. Crouch gait patterns defined using k-means cluster analysis are related to underlying clinical pathology. Gait Posture. 2009;30(2):155–60. pmid:19535249
  27. 27. White SG, McNair PJ. Abdominal and erector spinae muscle activity during gait: the use of cluster analysis to identify patterns of activity. Clin Biomech (Bristol, Avon). 2002;17(3):177–84. pmid:11937255
  28. 28. Belter JT, Reynolds BC, Dollar AM. Grasp and force based taxonomy of split-hook prosthetic terminal devices. Conf Proc IEEE Eng Med Biol Soc. 2014;2014:6613–8. pmid:25571512
  29. 29. Haverkate L, Smit G, Plettenburg DH. Assessment of body-powered upper limb prostheses by able-bodied subjects, using the Box and Blocks Test and the Nine-Hole Peg Test. Prosthet Orthot Int. 2016;40(1):109–16. pmid:25336050
  30. 30. Huinink LH, Bouwsema H, Plettenburg DH, van der Sluis CK, Bongers RM. Learning to use a body-powered prosthesis: changes in functionality and kinematics. J Neuroeng Rehabil. 2016;13(1):90. pmid:27716254
  31. 31. Kruger LM, Fishman S. Myoelectric and body-powered prostheses. J Pediatr Orthop. 1993;13(1):68–75. pmid:8416358
  32. 32. Millstein SG, Heger H, Hunter GA. Prosthetic use in adult upper limb amputees: a comparison of the body powered and electrically powered prostheses. Prosthet Orthot Int. 1986;10(1):27–34. pmid:3725563
  33. 33. Sensinger JW, Lipsey J, Thomas A, Turner K. Design and evaluation of voluntary opening and voluntary closing prosthetic terminal device. J Rehabil Res Dev. 2015;52(1):63–75. pmid:26186081
  34. 34. Cowley J, Resnik L, Wilken J, Smurr Walters L, Gates D. Movement quality of conventional prostheses and the DEKA Arm during everyday tasks. Prosthet Orthot Int. 2017;41(1):33–40. pmid:26932980
  35. 35. Bouwsema H, van der Sluis CK, Bongers RM. Changes in performance over time while learning to use a myoelectric prosthesis. J Neuroeng Rehabil. 2014;11:16. pmid:24568148
  36. 36. Berning K, Cohick S, Johnson R, Miller LA, Sensinger JW. Comparison of body-powered voluntary opening and voluntary closing prehensor for activities of daily life. J Rehabil Res Dev. 2014;51(2):253–61. pmid:24933723
  37. 37. Weeks DL, Wallace SA, Anderson DI. Training with an upper-limb prosthetic simulator to enhance transfer of skill across limbs. Archives of physical medicine and rehabilitation. 2003;84(3):437–43. pmid:12638114
  38. 38. Bloomer C, Wang S, Kontson K. Creating a standardized, quantitative training protocol for upper limb bypass prostheses. Phys Med Rehabil Res. 2018;3(6):1–8. pmid:31172033
  39. 39. Bloomer C, Wang S, Kontson K. Kinematic analysis of motor learning in upper limb body-powered bypass prosthesis training. PLoS One. 2020;15(1):e0226563. pmid:31978051
  40. 40. Atkins D. Adult Upper Limb Prosthetic Training. Atlas of Limb Prosthetics: Surgical, Prosthetic, and Rehabilitation Principles. 2 ed. Rosemont, IL: American Academy of Orthopedic Surgeons; 1992.
  41. 41. Dakpa R, Heger H. Prosthetic management and training of adult upper limb amputees. Current Orthopaedics. 1997;11(3):193–202.
  42. 42. Kontson KL, Wang S, Barovsky S, Bloomer C, Wozniczka L, Civillico EF. Assessing kinematic variability during performance of Jebsen-Taylor Hand Function Test. J Hand Ther. 2019. pmid:30857890
  43. 43. Kontson K, Marcus I, Myklebust B, Civillico E. Targeted box and blocks test: Normative data and comparison to standard tests. PLoS One. 2017;12(5):e0177965. pmid:28542374
  44. 44. Cutti AG, Paolini G, Troncossi M, Cappello A, Davalli A. Soft tissue artefact assessment in humeral axial rotation. Gait & Posture. 2005;21(3):341–9. pmid:15760751
  45. 45. Muray IA. Determining Upper Limb Kinematics and Dynamics During Everyday Tasks: University of Newcastle; 1999.
  46. 46. Stagni R. FS, Cappello A., Ussia L., Leardini A. Third Siamoc Congress: Propagation of skin motion artefacts to knee joint kinematics. Gait & Posture. 2002;16:211–2.
  47. 47. Wang S, Hsu CJ, Trent L, Ryan T, Kearns NT, Civillico EF, et al. Evaluation of Performance-Based Outcome Measures for the Upper Limb: A Systematic Review. PM & R: the journal of injury, function, and rehabilitation. 2018.
  48. 48. Choi A, Joo SB, Oh E, Mun JH. Kinematic evaluation of movement smoothness in golf: relationship between the normalized jerk cost of body joints and the clubhead. Biomedical engineering online. 2014;13(1):20. pmid:24571569
  49. 49. Murphy MAH, C.K. Kinematic analysis of the upper extremity after stroke—how far have we reached and what have we grasped? Physical Therapy Reviews. 2015;20(3).
  50. 50. Galna B, Barry G, Jackson D, Mhiripiri D, Olivier P, Rochester L. Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson’s disease. Gait Posture. 2014;39(4):1062–8. pmid:24560691
  51. 51. Cuesta-Vargas AI, Roldan-Jimenez C. Validity and reliability of arm abduction angle measured on smartphone: a cross-sectional study. BMC Musculoskelet Disord. 2016;17:93. pmid:26897035
  52. 52. Fitoussi F, Maurel N, Diop A, Laassel EM, Ilharreborde B, Presedo A, et al. Upper extremity kinematics analysis in obstetrical brachial plexus palsy. Orthop Traumatol Surg Res. 2009;95(5):336–42. pmid:19559664
  53. 53. Valevicius AM, Boser QA, Lavoie EB, Chapman CS, Pilarski PM, Hebert JS, et al. Characterization of normative angular joint kinematics during two functional upper limb tasks. Gait Posture. 2019;69:176–86. pmid:30769260
  54. 54. van Andel CJ, Wolterbeek N, Doorenbosch CA, Veeger DH, Harlaar J. Complete 3D kinematics of upper extremity functional tasks. Gait Posture. 2008;27(1):120–7. pmid:17459709
  55. 55. Kontson KL, Marcus IP, Myklebust BM, Civillico EF. An Integrated Movement Analysis Framework to Study Upper Limb Function: A Pilot Study. IEEE Trans Neural Syst Rehabil Eng. 2017;25(10):1874–83. pmid:28422686
  56. 56. Sanchez-Margallo JA, Sanchez-Margallo FM, Oropesa I, Enciso S, Gomez EJ. Objective assessment based on motion-related metrics and technical performance in laparoscopic suturing. Int J Comput Assist Radiol Surg. 2017;12(2):307–14. pmid:27423649
  57. 57. Xiao X, Hu HJ, Li LF, Li L. Comparison of dominant hand to non-dominant hand in conduction of reaching task from 3D kinematic data: Trade-off between successful rate and movement efficiency. Math Biosci Eng. 2019;16(3):1611–24. pmid:30947435
  58. 58. Biddiss EA, Chau TT. Upper limb prosthesis use and abandonment: a survey of the last 25 years. Prosthet Orthot Int. 2007;31(3):236–57. pmid:17979010
  59. 59. Anand N, Vikram P. Comprehensive Analysis & Performance Comparison of Clustering Algorithms for Big Data. Review of Computer Engineering Research. 2017;4(2):54–80.