National Aeronautics and Space Administration
Lyndon B. Johnson Space Center

CONTRACT: NAS 9-1891 5
PROGRAM: SBIR PHASE II STUDY
PROJECT: NONSTANDARD FUNCTIONAL LIMB TRAJECTORIES

Contractor
MOCO, INC.

Principal Investigator
RUTH A. MAULUCCI, Ph.D.

(Ariel Dynamics Inc. Note: The following are excerpts from the full report.
These portions related to the comparison between the technologies.)

1. WORK ACCOMPLISHED DURING THIS REPORTING PERIOD

A. Literature Search

A fairly extensive literature search was done on recent progress in areas related to the theoretical components of this project. The search was done manually at the libraries of the Massachusetts Institute of Technology over a period of several days, and identified dozens of articles for immediate use. Current work on limb motor control was compiled, to assist in adapting the existing standard limb biomechanical model to handle the nonstandard conditions. Various newly reported analysis methods for dealing with the experimental data were reviewed, as a start in developing the descriptive model based on the empirical results from the nonstandard conditions. A comparison study of recent publications of global optimization techniques was made, in order to find a better algorithm for the highly nonlinear problem of limb movement with many local minima.

C. Ascension Flock Of Birds

The four-receiver Flock of Birds system, manufactured by Ascension Technology, is used in this project for kinematic data acquisition, and represents one of the major pieces of instrumentation in the study. The Flock of Birds was returned to the manufacturer for updating. The circuit boards were upgraded with the latest engineering changes. The read only memories (ROM) were upgraded to reduce the amount of noise in the signals and improve the sustained data gathering rate. As a courtesy, Ascension also evaluated MOCO's customized control and acquisition software to determine if it was exceeding any of the data collection rates.

After receiving the updated Bird system, MOCO revised the experiment software to adapt to the new communication instructions, and integrated the suggested software changes. A subject from MOCO personnel was instrumented and tested under the new modifications. System performance was improved and was more reliable. The noise was reduced and the sustained gathering rate was maintained at 100 Hz per receiver. Ascension had suggested inserting a delay at the start of the data gathering period, but this became unnecessary, and since it would affect the reaction time calculations, the suggested change was not implemented. A research meeting was held in Phoenix, AZ, August 9-11. The purpose of this meeting was to convene MOCO personnel and consultants involved in this project to discuss the various components. Attendees were Drs. Maulucci and Eckhouse from MOCO; Drs. Penny and Ariel from Computerized Biomechanical Analysis (CBA), consultants to this project; and Dr. Seif-Naraghi from Good Samaritan Medical Center, also a consultant to this project. Also in attendance was Dr. Richard M. Herman from Good Samaritan Medical Center, a physiatrist and senior researcher in the motor system, who has worked with MOCO on numerous previous human performance projects. The experimental studies for the five nonstandard conditions of limb movement were discussed at length. The major points were as follows. Consideration was given to whether the size of the subject should influence the weight of the load in the limb loading condition; no consensus was reached but the trend was toward using the same weight for all subjects. CBA presented a demonstration on a notebook computer of the Ariel Performance Analysis System (APAS) software that will be used in the muscle fatigue study, showing its operational capabilities on true biomechanical and electromyogram (EMG) data. For this condition, it was also decided that the subject's arm will have to be supported in, anticipation of the reach and a switch used to determine the initiation time, because the degrees of muscle fatigue expected will make it difficult for the subject to hold the arm in the air and impossible for the subject to hold the arm steady enough to obtain initiation time through software. Extensive discussion ensued pertaining to the justification of the muscle fatigue paradigm; clarification of potential problem areas was made by CBA. With regard to the perturbation condition, it was decided that the type of perturbation proposed was appropriate. One force and one time of application should be selected as the perturbation of interest and which must meet the design specifications. Perturbations with different forces and at different times will be interspersed as well as some highly unusual disturbance such as a loud noise and normal trials of standard reaching; these will serve only as random distracters and will not be analyzed as perturbations. It was observed that the subject may become habituated to the anticipation of a perturbation after a very short period of time, and that a degradation of the response may occur. This was deemed appropriate since in many functional activities, persons are in situations in which perturbations are occurring over a long period of time and the learned response is precisely what is of interest; caution was advised in the analysis of the results since there is an expected difference between the trials at the beginning and end of the session. It was further suggested that attention be paid to the interspersed normal trials since these may be quite different from those obtained in the baseline sessions and may contain significant information. No recommendations were made for the path obstacle condition. Comments similar to those made for limb perturbations were applied to the final condition of environment alterations. The target of interest will be the center target, with the alterations taking place to the right and the left; it may be possible to include a second target of interest, also with alterations taking place to the right and left, or to the right and then further to the right.

A large portion of the meeting was devoted to devising methods for establishing and confirming compatibility between the APAS and the Ascension Flock of Birds (FOB) for acquiring the kinematic data. The first issue was which points to digitize with the APAS in order to obtain data analogous to that obtained with the FOB. The second issue concerned the twist angles which traditionally are difficult to perturbation and the passive line tension have been measured. The goal is to minimize the passive force required to keep the line taut. Second, different motor alternatives for producing the perturbation have been considered. These are a stepper and a torque motor, with the goal of controlling the required tug without affecting the FOB magnetic tracking devices. Third, consideration has been given to where the disrupter will be located and how to route the line between the arm segment and the disrupter in a way that minimizes interference with the motor and the various wooden parts of the test station.

Since it is desired to apply the perturbation at a specific percent of the movement time, it is necessary to detect the initiation of movement in real time. Currently, the initiation of motion is calculated after the reach by analyzing the FOB data off-line. The limitation in processing of the FOB data in real time implies that a new means of determining the initiation of movement may be necessary. A number of different switches have been considered.

The APAS is the kinematic recorder that will be used for the nonstandard condition of muscle fatigue, as discussed on P. C4, B. Objective 2, 1. Test Station. Although the APAS has been used in numerous other biomechanical studies, methods are being developed to improve the visual markers for the system to accommodate the special demands of this study. These markers must have the properties that: (1) they can be detected by an automatic computerized digitizing system and will reduce the amount of human interactive involvement with the process; (2) they will not interfere with the normal reaching task or with the performance of the intervening fatigue tasks; and (3) they will not move or be damaged due to the exercise or the perspiration generated. Some of the possibilities under consideration for markers on the hand, knuckle, and finger tip include the following. A latex, single finger surgical covering may be used to which either 3-M specialized reflective tape, some other reflective material, or reflective paint can be applied. Application of temporary or "press-on" nails to the finger nail in conjunction with different types and sizes of reflective balls are being considered. These options may be less effective because of the anticipated difficulty in executing normal movement during the reaching task and in holding the exercise bar during the fatiguing task. Efforts to modify a latex surgical glove and a bike glove were unsatisfactory and were rejected. Use of reflective paint or theatrical make-up applied directly to the skin are possible options. Preliminary use of a Dr. Scholl's Corn protector cushion on the knuckle is encouraging since the pad is flexible, and therefore easily conforms to skin and joint changes associated with flexion and extension of the hand during the reaching task and when gripping the exercise bar. A significant observation was that the corn pad did not move or slip when exposed to moisture, e.g., water; the next test will be exposure to exercise and the perspiration generated from that effort.

A study design has been devised, as proposed on p. C6, C. Objective 3, c., d, for the comparison study of the trajectories obtained with the FOB and the APAS. The measurement errors or differences for the two systems could be caused by system set-up, resolution, and sensors and markers moving on skin. To isolate the possible different causes, a three-level testing and comparison method was designed.

The first level is a static comparison. Sensors and markers will be placed on rigid sticks fixed in space. The two systems will collect data simultaneously for several seconds, and the results will be compared.

(2) What kind of regression process should be used for fitting the function to the normalized paths? (Most likely, a weighted regression method based on the scatter area size will be developed.)

(3) Can a good fit to the experimental data be obtained for all targets using a function model with target position as parameters? (If so, the likelihood of predicting a path or path zone for an unknown target is high.)

(4) Why are the path scatter areas different for the different targets? (The optimization model may ultimately provide explanations.)

Three activities were conducted. These will be referenced to the Contract, Section C Statement of Work on pp. C2-C8, where relevant. These pages are also contained in the Contract Proposal.

A change in vendor has been made for construction of the empirical testing apparatus for the nonstandard conditions, as described on p. C3, A. Objective 1, 3. Path Obstacles and 4. Environmental Alterations; and of the target apparatus for the front panel of the leg workspace and for the muscular fatigue condition, as explained on p. C5, B. Objective 2,1. Work by Mr. Hal Layland, the vendor originally proposed, was not satisfactory. This aspect of the project has now been assumed by group that has had considerable experience in building original test items. All specifications and engineering diagrams have been forwarded to the current company. No additional expense will be incurred because of this change, and no delays are anticipated.

Work on the comparison study of the trajectories obtained with the Ascension Flock of Birds (FOB) and the Ariel Performance Analysis System (APAS), as proposed on p. C6, C. Objective 3, focused on two tasks. A portable calibration device for the APAS system was built which can easily and inexpensively be-shipped between MOCO and Computerized Biomechanical Analysis (CBA), the consulting organization for this study. This device is used by the APAS to calibrate the three-dimensional area of interest, in this case, the immediate surroundings of the subject performing the reaching task. The device was required to be accurate and transportable. The use of PVC tubing, tennis balls and golf "wifffle" balls were shown to fit these necessary conditions. Metal and wooden structures were considered and rejected. In conjunction with the development of the calibration device, camera placements, lighting, and reflective markers were arranged for the test procedures. All filming specifications which could be considered and resolved in the CBA laboratory were evaluated in an effort to facilitate the experimental work which will be performed at MOCO for the actual study. The comparison study of the FOB and the APAS is now finalized. The comparison study of the trajectories obtained with the Ascension Flock of Birds (FOB) and the Ariel Performance Analysis System (APAS), as proposed on p. C6, C. Objective 3, is underway. The APAS equipment was delivered to MOCO, Inc.; this consisted of two cameras, the calibration cube and the various reflective markers. Communications with personnel from Computerized Biomechanical Analysis (CBA), the consulting organization for this study, determined the appropriate setup of the equipment in terms of the placement of the cameras, the use of lights, and the best camera settings. The equipment setup was further illustrated in a videotape prepared by CBA for MOCO which showed the same test session, including the calibration, subject-worn reflective markers, and subject reaches, through the eyes of each camera. Minor modifications were made to the MOCO FOB software, so that the FOB and APAS could be synchronized and used concurrently. Each trial proceeds as follows. The large light emitting diode (LED) display that is typically used to inform the subject of the number of the target to be touched for the impending trial is placed in the viewing field of both APAS cameras. The two cameras are started. The trial number is presented to the cameras by placing a clipboard containing the written number in front of the cameras for a few seconds. By means of a keystroke, three events occur simultaneously, namely, a tone is emitted, the LED display changes, and FOB data collection is initiated. The data are collected for six seconds. At this instance, the LED display changes again and the FOB stops automatically. The cameras are turned off manually. Thus, the two APAS frames in which the LED changes correspond to the initial and final data points of the FOB. This allows the signal points of one system to be matched in time with the signal points of the other system, and in addition synchronizes the two APAS cameras. A comprehensive three-day testing session was then conducted in which the FOB and the APAS recorded the same instance of each trial. A formal protocol was developed to permit comparison of the two systems. System performance was examined at four levels, each increasing the difficulty of obtaining system compatibility. The first level, termed static inanimate, was to determine the translational distances between two fixed points, fixed flexion angles formed by a goniometer, and fixed twist angle displacements made by a goniometer. In the second level, dynamic inanimate, trajectories were obtained for the three translation signals of randomly moving points, randomly changing flexion angles formed by two rods, and randomly changing twist angles produced by a rod. For the third level, static animate, a human subject held his arm in various fixed positions intermediate to a functional reach; the translational distances between selected body landmarks, joint flexion angles, and angles formed by body segments and the coordinate axes were obtained. At the fourth level, dynamic animate, the human subject made standard functional reaches; translation trajectories of selected body landmarks, joint flexion and twist angle trajectories, and trajectories of angles formed by body segments and the coordinate axes were acquired. Additional trials tested different variable shutter settings for the cameras. The protocol is given in detail in Appendix A.

Initial results of the comparison study of the trajectories obtained with the Ascension Flock of Birds (FOB) and the Ariel Performance Analysis System (APAS), as proposed on p. C6, C. Objective 3, were analyzed. In particular, selected trials from the formal testing session to examine static and dynamic inanimate and animate conditions were examined.

The first trial, from the static inanimate group, was to calculate the x, y, and z translational distances between two fixed points, with the distances pre-measured by a steel measuring tape. The following results (cm) were obtained.

The second trial, also from the static inanimate group, was to calculate the fixed flexion angle formed by a goniometer. The following results (deg) were obtained.

The third trial, again from the static inanimate group, was to calculate the fixed twist angle displacement made by a goniometer. The following results (deg) were obtained.

This result is particularly encouraging, since video motion analysis systems typically do not handle twist angles at all. The twist angle is obtained here through techniques specially developed for this application.

The fourth trial, from the dynamic inanimate group, was to obtain the trajectories for the x, y, and z translation signals of a randomly moving point. The results (cm) for the FOB and the APAS, respectively, are given in Figure la,b.

The fifth trial, again from the dynamic inanimate group, was to obtain the trajectories of a randomly changing flexion angle formed by two rods. The results (deg) for the FOB and the APAS, respectively, are given in Figure 2a,b.

A sixth trial, from the dynamic animate group, was to determine the complete kinematics of the arm during a standard functional reach made by a human subject. As a result of examining the trial, a method for processing this level was established. The FOB software developed by MOCO and the APAS software both perform a complete set of calculations

on the arm, consisting of translation trajectories of body landmarks, joint angle trajectories, and body segment angle trajectories. Although the two sets contain equivalent information, the trajectories in the two sets are different. Rather than rewriting the analysis software for either system, which would have been a major undertaking since both software systems are fairly complex, the following solution was adopted. The APAS data will be presented to MOCO as the x, y, and z translation trajectories of the end effector, wrist, elbow, shoulder, and sternoclavicular joint, and the two reflective markers on the forearm and the upper arm crosspieces, with no angle processing. MOCO will then use these to derive the trajectories that correspond to those used with the FOB system. In general, the preliminary view of the comparison data looks promising.

Subject in Experimental Condition    

A complete set of initial results of the comparison study of the trajectories obtained with the A Ascension Flock of Birds (FOB? and the Ariel Performance Analysis System (APAS), as proposed on p. C6, C. Objective 3, was analyzed with the APAS by Computerized Biomechanical Analysis (CBA), the consulting organization for this study. and was delivered to MOCO. In particular, examples from each level and sub-level of the formal testing session to examine static and dynamic inanimate and animate conditions was analyzed with the APAS. In all cases, the new method for processing was used. As described presented to MOCO as the x, y, and z translation trajectories of the reflective markers, end effector. or joints, whichever are appropriate.

Displacement of body's joints

The comparison study was then conducted at MOCO with six human subject in fulfillment of p. C6, C. Objective 3, b. and c. No attempt was made to control for age, gender, handedness, stature, or weight since the Objective was simply compare data simultaneously acquired by the FOB and the APAS. A session consisted of trials from Level III -- Static Animate and Level IV -- Dynamic Animate defined previously in Monthly Progress Report -- 8, using the software and task descriptions given in the text and the Preparation and Acquisition given in Appendix A of that report. Descriptions remain as given for Protocol R in the OWD Phase II Final Report for target panels; targets; positioning chair; system integration; placement of receivers and transmitter; procedures for anthropometric and environmental measurements; target definitions (all trials were performed in the arm workspace, on the front panel, with a normal speed, at the prescribed distance, using the right arm); basic task (except that for the Static Animate trials the limb was held fixed in an interior reach figuration); subject fixed point; subject positioning; typical trial (except that the subject was verbally informed of the target number, and for the Static Animate trials the limb was placed in an interior reach configuration prior to the computer tone and did not move); harness; body segment posture (except that for he Dynamic Animate trials, the subject was instructed to maintain the final configuration of the arm until the trial terminated, i.e., 6 seconds passed); and control, acquisition, and monitoring software (with the exceptions noted in Monthly Progress Report -- 8). Figures 3, 4, and 5, respectively, show the placement of the receivers and markers, the subject measurement sheet, and the protocol worksheet.

The testing required two laboratory technicians. The monitor prepared the subject and took the measurements, explained the test to the subject, announced the target number and type and the Level to the subject, presented the trial number to the APAS cameras, assured that the subject was performing as instructed according to all of the details of the protocol, and attended to the general comfort and safety of the subject. The instrumentation operator was responsible for calibrating the APAS, focusing the APAS cameras, running the FOB control program, starting the APAS cameras, starting the FOB data collection, verifying the incoming APAS video data on two television screens to which the cameras were connected, stopping the APAS cameras, verifying proper acquisition of the FOB results with the OWD analytical information and animation software, and manually recording trial repetitions and anomalies. Both technicians made whatever adjustments were necessary, prior to each trial, to assure that the FOB transmitter was located so that it could handle the four receivers throughout the motion, and that all the reflective markers could be seen by both APAS cameras throughout the motion. Each session took approximately 2 hours.

Analysis of the initial results of the comparison study of the data obtained with the Ascension Flock of Birds (FOB) and the Ariel Performance Analysis System (APAS), as proposed on p. C6, C. Objective, was completed. The formal protocol for the initial study is contained in Appendix A of Monthly Progress Report -- 8, and explained in that report. As reported, the levels and sublevels of the protocol are as follows.

One example from each level or sublevel of the protocol was analyzed, for a total of eight examples.

In all cases, a new method for processing, justified in Monthly Progress Report -- 9, was used. This consists of the APAS data presented to MOCO as the x, y, and z translation values or trajectories of the reflective markers, end effector, or joints, whichever are appropriate, and MOCO using these to derive the values or trajectories that correspond to those used with the FOB system. The results will be presented next for the eight examples. Some of these were included in Monthly Progress Report -- 9, but will be repeated here using the new processing method.

The first example, from Level I.A., was to calculate the x, y, and z translational distances between two fixed points, with the distances pre-measured by a steel measuring tape. The following results (cm) were obtained.

                    x          y         z
        Tape       37.4       55.9      20.0
        FOB        37.7       56.1      21.0
        APAS       37.5       55.6      20.2

The second example, from Level I.B., was to calculate the fixed flexion angle formed by a goniometer. To introduce more of a challenge, the goniometer was perpendicular to the ground, but at a 4-5 degree angle outward with respect to the APAS cameras. The following results (deg) were obtained.

The third example, from Level I.C., was to calculate the fixed twist angle displacement made by a goniometer. Again, to challenge the systems, the goniometer was skewed with respect to the APAS cameras. The following results (deg) were obtained.

                         angle
          Goniometer      46
          FOB             47
          APAS            46

The fourth example, from Level II.A., was to obtain the trajectories for the x, y, and z translation signals of a randomly moving point. The results (cm) for the FOB and the APAS, respectively, are given in Figure 4a,b.

The fifth example, from Level II.B., was to obtain the trajectory of a randomly changing flexion angle formed by two rods. The results (deg) for the FOB and the APAS, respectively, are given in Figure Sa,b.

The sixth example, from Level II.C., was to obtain the trajectory of a randomly changing twist angle of a rod. The results (deg) for the FOB and the APAS, respectively, are given in Figure 6a,b. The seventh example, from Level III, consisted of a human subject holding his arm at the initial, interior, and final positions of a functional reach. The x, y, and z translational distances between each adjacent pair of FOB receivers was calculated. Wrist flexion/extension, wrist radial/ulnar deviation, and elbow flexion/extension angles were also calculated. Finally, the upper arm X-axis angle, upper arm Y-axis angle, and upper arm Z-axis angle were calculated, these being defined relative to an inertial moving coordinate system, with origin that is attached to and moves with the shoulder at the acromion and axes that remain directed as and parallel to those of the FOB transmitter. The following results (cm for translations and deg for angles) were obtained.