One Small Step for a Man: Estimation of Gender, Age and Height from Recordings of One Step by a Single Inertial Sensor

Transcription

1 Article One Small Step for a an: Estimation of Gender, Age and Height from Recordings of One Step by a Single Inertial Sensor Qaiser Riaz, *, Anna Vögele, Björn Krüger and Andreas Weber Received: October ; Accepted: December ; Published: 9 December Academic Editor: Panicos Kyriacou Department of Computer Science II, Universität Bonn, Bonn, Germany; voegele@cs.uni-bonn.de (A.V.); weber@cs.uni-bonn.de (A.W.) Gokhale ethod Institute, Stanford, CA 9, USA; kruegerb@cs.uni-bonn.de * Correspondence: qaiser.riaz@uni-bonn.de; Tel.: Abstract: A number of previous works have shown that information about a subject is encoded in sparse kinematic information, such as the one revealed by so-called point light walkers. With the work at hand, we extend these results to classifications of soft biometrics from inertial sensor recordings at a single body location from a single step. We recorded accelerations and angular velocities of 6 subjects using integrated measurement units (IUs) attached at four locations (chest, lower back, right wrist and left ankle) when performing standardized gait tasks. The collected data were segmented into individual walking steps. We trained random forest classifiers in order to estimate soft biometrics (gender, age and height). We applied two different validation methods to the process, -fold cross-validation and subject-wise cross-validation. or all three classification tasks, we achieve high accuracy values for all four sensor locations. rom these results, we can conclude that the data of a single walking step (6D: accelerations and angular velocities) allow for a robust estimation of the gender, height and age of a person. Keywords: estimation of soft biometrics; gender, age and height estimation from inertial data; gait analysis; inertial sensors to estimate gender, age and height; accelerometers. Introduction Sparse representation of human motions has been investigated for some decades now. It is well-known that representation of human motion by point light displays and similar concepts (e.g., point light walker [,]) contains detailed information on several aspects of motions and their initiators. Over the years, the possibilities to identify certain parameters characterizing given motions have been explored. On the one hand, it is possible to discover information about the displayed motions as such. In the field of action recognition, it has been shown that estimation of poses and skeletons from video and motion capture data allows for recognition and analysis of human movement (Lv et al. [], Junejo et al. [], Barnachon et al. [], Oshin et al. [6]). The survey of vision-based human motion capture by oeslund et al. [7] discusses the advances and application of motion-capture-related techniques for tracking, pose estimation and recognition of movement. Recognition of motion patterns from video data can be achieved by machine learning approaches exploiting local space-time features (e.g., for SV-based methods, Schüldt et al. [8]). On the other hand, information on the kinematic properties of living beings or animated objects can be detected by analyzing representations of motions. This can be done using motion capture data from passive or active devices, as well as contact forces measurements (Venture et al. [9], Kirk et al. []). Sensors,, 999 9; doi:.9/s997

2 Sensors,, ore recently, the market for wearable devices has virtually exploded (Liew et al. [], Son et al. []). The sheer number of devices [] reflects that there are numerous methods to capture and analyze human motion in a relatively new field of application associated with ubiquitous computing. Even though information acquired by such devices may be less accurate than information acquired by modern motion capture systems (Le asurier et al. [], oster et al. []), it has been shown that reconstruction of motion from extremely sparse sensor setups is possible in practice (Tautges et al. [6], Riaz et al. [7]). This indicates that data collected using tri-axial accelerometers are suitable for classification tasks, e.g., associated with social actions (Hung et al. [8]), general everyday activities (Parkka et al. [9], Jean-Baptiste et al. [], Dijkstra et al. []) or repetitive physical exercises (orris et al. []). We investigated if data from a single wearable sensor can reveal similar information about the moving subject as motion capture data in the sense of the above-quoted [,]. We focus on classification of gender, age and height defining exemplary inertial properties of moving subjects. Our experiments show that it is indeed possible to classify and thereby estimate such properties. Our method is able to process representations of single steps recorded by one accelerometer (as opposed to longer data sequences; Neugebauer et al. []). In sum, our method is able to recover soft biometric information with high accuracy consistently over various sensor positions. Since the classification task depends on the chosen feature sets, we further investigated this by evaluating the role of different possible feature sets in the classification. odern machine learning techniques like decision trees can target pattern recognition and prediction tasks based on many different representations of motion (Brand et al. [], Bao et al. [], Kwapisz et al. [6]). We used random forests, a learning method based on the construction of multiple decision trees, which can be used for classification, as well as regression tasks. While learning predictive models by using decision trees on their own may result in over-fitting to a training set (Phan et al. [7]), random forests are less prone to this problem. or an overview of random forests, refer to the works of Breimann [8] or Liaw and Wiener [9].. aterials and ethods.. Participants Consent All participants were informed in detail about the purpose of the study, the nature of the experiments, the types of data to be recorded and the data privacy policy. The subjects were aware that they were taking part in experiments where a number of biometric and kinematic properties were monitored. The main focus of the study was communicated to the subjects during their progress over the course of the training by the specialists of Gokhale ethod Institute [] (Stanford, CA, United States). Each willing participant was asked to fill in the data collection form with personal details, including full name, sex, age and height... Population Characteristics and Sampling The participants were selected during a gait and posture training program conducted in July of by the specialists of Gokhale ethod Institute. They use special gait and posture training methods to help regain the structural integrity of the body. The training program consisted of six 9-minute training sessions. The study population consisted of a total of 6 adults with a male to female ratio of : and an average age of 8. years (σ = ±.7). The average height of the participants was recorded at 7 cm (σ = ±.). The characteristics of the study population are shown in Table.

3 Sensors,, Table. Characteristics of the study population, including age, sex and height. or validation, two types of models were used: k-fold cross-validation and subject-wise cross-validation. Variable Characteristics Total Population 6 Age (y, mean, ± SD) 8. ±.7 emale Participants ale Participants Height (cm, ± SD) 7 ±. A k-fold cross-validation model (chosen value of k = ) was used to compute the classification accuracy of the classifier. In k-fold cross-validation, original sample data are randomly partitioned into k equally-sized sub-samples or folds. Out of the k folds, k-folds are used for training, and the left-out fold is used for validation. The cross-validation process is repeated k times, and each of the k folds is used exactly once for validation. or sampling, the stratified sampling method [] is used to divide the population into training and test datasets. A subject-wise cross-validation model was also employed to compute the classification accuracy of each participant against others. Subject-wise cross-validation is a special variant of leave-one-out cross-validation in which instead of leaving one sample out for validation, all samples of one participant are left out for validation. or n participants (n = 6, in our case), all samples of n participants are used for training, and all samples of the left-out participant are used for testing. The cross-validation process is repeated n times in order to validate each participant exactly once against the rest. Unlike -fold cross-validation, the number of samples in each fold is not equal in subject-wise cross-validation. This is due to the difference in the step length of each subject. Subjects with shorter step lengths have more steps than the others... Standardized Gait Tasks The gait task consisted of a -meter straight walk from a starting point, turning around and walking back to the starting point. Participants were asked to walk in their natural manner and to repeat the gait task two times, resulting in a -meter walk. Three different types of experiments were performed: () walking on a hard surface (concrete floor) with shoes on; () walking on a hard surface (concrete floor) with bare feet; and () walking on a soft surface (exercise mattress) with bare feet. Data were recorded during three different stages of the training course: () at the start of the training (before the st session); () in the middle of the training (after the rd session); and () at the end of the training (after the 6th session). Hence, for each participant, 9 different recording sessions were carried out in total (see Table ). Table. Standardized gait tasks. Experiments were performed on different surfaces with and without shoes, as shown here. or each participant, 9 different recording sessions were carried out in total. -eter Straight Walk Hard Surface Hard Surface Soft Surface Shoes On Barefoot Barefoot Recordings Before st Session After rd Session After 6th Session

4 z x y Sensors,, Sensor Placement and Data Collection A set of four APD Opal wireless inertial measurement units [] was used to record accelerations and angular velocities. An APD Opal IU consists of a triad of three accelerometers and three gyroscopes. The technical specifications of the sensor are given in Table. The sensors were tightly attached to different body parts using adjustable elastic straps. We were particularly interested in the inertial measurements of four different body parts: () chest; () lower back; () right wrist; and () left ankle. The sensor placement at each body part is shown in igure. Table. Technical specifications of the APD Opal IU. Accelerometer Gyroscope agnetometer Axes axes axes axes Range ± g or ±6 g ± deg/s ±6 Gauss Noise. m/s / Hz. deg/s/ Hz. mgauss/ Hz Sample Rate 8 Hz 8 Hz 8 Hz Output Rate to 8 Hz to 8 Hz to 8 Hz Bandwidth Hz Hz Hz Resolution bits bits bits z x y z y z y x x igure. Placement of four APD Opal IUs on different body parts. The sensors were placed on four different locations: left ankle, right wrist, lower back and chest... Pre-Processing The output sampling rate of an APD Opal IU sensor is adjustable between and 8 Hz. In our experiments, an output sampling rate of 8 Hz was chosen. Due to the noisy nature of the acceleration measurements, raw data were pre-processed to suppress noise. To this end, we used the moving average method with a window size of 9 frames to smooth the raw signal and suppress noise..6. Signal Decomposition The input signal consists of a long sequence of steps, which is segmented into single steps in order to extract features. A simple approach to decompose a long sequence of steps into single steps is by means of peak and valley detection [ ]. In this approach, peaks are detected by finding local maxima, whereas valleys are detected by finding local minima. The detection of false peaks is minimized by using two thresholds: d and h d is used to define the minimum distance between two peaks, and h is used to define the minimum height of the peak. We have used the same approach to detect peaks and valleys from the input signal. The values of the two thresholds are chosen by experimentation. The valleys are then used to cut the input signal into individual steps. Peaks and valleys are only detected in the x-axis of the acceleration signal and are used to decompose the y- and z-axes of acceleration and all axes of the gyroscope. This approach makes sure that the length of the individual step is consistent in all axes of the acceleration and gyroscope. In igure, the left side

5 Sensors,, image presents the pre-processed input signal from the x-axis of the IU s accelerometer attached to the lower back. The detected valleys, highlighted with circles ( ), are also shown. 6 6 Acceleration (m/s ) rames Acceleration (m/s ) rames igure. The pre-processed input signal from the x-axis of the IU s accelerometer attached to the lower back and an extracted single step are shown. In the left image, detected valleys are highlighted with. In the right image, a decomposed signal depicting a single step is shown between the vertical dash-dot lines (- ). Some of the extracted features from the single step are: () square ( ): global minimum; () diamond ( ): global maximum; () solid line ( ): mean; () horizontal dash-dot line (- ): standard deviation; () dashed line (- -): root mean square; (6) between vertical dash-dot lines (- ): length and duration..7. Extraction of eatures All single steps detected from the signal decomposition are further processed to extract different features from the time and frequency domains. Table presents a complete list of features extracted from different components of accelerations and angular velocities. or each single step, the feature set consists of features in total. Statistical features include: step length, step duration, average, standard deviation, global minimum, global maximum, root mean square and entropy. Energy features include the energy of the step. The maximum amplitude of the frequency spectrum of the signal is calculated using fast ourier transform (T). The step length and the step duration are only computed for the x-axis of the accelerations, as they remain the same in all other axes. All of the remaining features are computed for all D accelerations and D angular velocities. In igure, the right-hand image presents a decomposed signal depicting a single step between the vertical dash-dot lines (- ). Some of the extracted features are also shown, including: () square ( ): global minimum; () diamond ( ): global maximum; () solid line ( ): mean; () horizontal dash-dot line (- ): standard deviation; () dashed line (- -): root mean square; (6) between vertical dash-dot lines (- ): length and duration of the step. Table. Description of the extracted features for each step from the accelerometer (A) and/or the gyroscope (G). or each step, features from the time and frequency domains are computed. eature Name Sensor Axis Total Description Step Length A x Total number of frames Step Duration (s) A x Step duration in seconds Average A, G x, y, z 6 ean value of the step Standard Deviation A, G x, y, z 6 σ of the step inimum A, G x, y, z 6 Global minimum of the step aximum A, G x, y, z 6 Global maximum of the step Root ean Square A, G x, y, z 6 RS value of the step s i Entropy A, G x, y, z 6 Uncertainty measure of the step, s i.: i= n max(s (p i )log (p i ) where p i = i ) i= n s i max(s i ) Signal Energy A, G x, y, z 6 Energy of the step: n= N x[n] Amplitude A, G x, y, z 6 aximum amplitude of the frequency spectrum of the signal of the step

6 Sensors,, Classification of eatures Training and validation data were prepared for each sensor using the features extracted in the previous step. Three types of group classification tasks were performed: () gender classification; () height classification; and () age classification. urthermore, training and validation data were also prepared for classification within participant subgroups for height and age classification. In Table, the characteristics of the population within different classification tasks are presented. or age and height classification, we choose classes based on the available data. Here, we have tried to define meaningful thresholds for classes while keeping balanced populations for all classes. Table. Characteristics of the population within different group and subgroup classification tasks. Task Classes N Age (ean ± SD) Group Classification Tasks Gender Classification Age Classification Height Classification Subgroup Classification Tasks Age Classification ale Group emale Group Height Classification ale Group emale Group ale.7 ±. emale.79 ±. Age < 9. ±.6 < Age < ±.8 Age 6.67 ± 7.8 Height 7 cm 8.6 ±.9 7 cm < Height < 8 cm.7 ±. Height 8 cm 8.7 ±.8 Age 6.67 ±.9 Age > 6.8 ± 9.87 Age 6.8 ± 6.8 Age > 8 9. ± 7.8 Height 8 cm 7 8. ±.7 Height >8 cm. ±.8 Height 7 cm 8.6 ±.9 Height >7 cm ± 9.8 As the classifier, random forest [9] was chosen and trained on the training dataset with the following values of parameters: number of trees = ; maximum number of features for best split = 7. Two types of validation strategies were employed: stratified -fold cross-validation and subject-wise cross-validation. The -fold cross-validation was employed for all group and subgroup classification tasks, whereas the subject-wise cross-validation was employed to group classification tasks only. or each sensor in a classification task, the classifier was trained and validated for three different sets of features: () D accelerations (6 features); () D angular velocities (6 features); and () 6D accelerations and angular velocities ( features). The -fold cross-validation was employed for all three sets of features, whereas the subject-wise cross-validation was employed for the third set of features ( features) only. inally, the classification rate, specificity, sensitivity and the positive predictive value (PPV) for each set of features were calculated as explained in [6]. The same approach

7 Sensors,, was used for all group and subgroup classification tasks. The classification rate c or classification accuracy is given by the formula in Equation (): c = (TP + TN) (TP + TN + P + N) () where TP, TN are the numbers of true positives and true negatives, respectively, and P, N are the numbers of false positives and false negatives, respectively.. Results In the following sections, we present the results of our investigations of the recorded gait data. Our classification results prove a number of hypotheses regarding biometric and biographic characteristics of the human subjects. Specifically, the gender, the body height and the age of participants could be classified well. Each of classification tasks was solved by training random forest classifiers, as introduced in the previous section... Gender Classification Our goal was to show that classification tasks regarding the gender of the trial subject can be performed sufficiently well by using the proposed sensors attached to each of the given locations. H : The gender can be identified by motion recordings of any of the employed sensors The results presented in igure show that the statement holds true for each of the four sensors individually. or each sensor, there are three different images visualizing the results of the binary classification, namely for the investigation of accelerations, of angular velocities, as well as of both combined. The confusion matrices encode the following information: each column represents the instances in one of the predicted classes, while each row represents the instances in the actual class (female/male). Left Ankle Avg. Classif. Rate: 86.% Lower Back Avg. Classif. Rate: 87.98% Chest Avg. Classif. Rate: 89.6% Right Wrist Avg. Classif. Rate: 8.769% Acc xyz 9% % 7% Avg. Classif. Rate: 8.88% Avg. Classif. Rate: 8.7% Avg. Classif. Rate: 8.677% Avg. Classif. Rate: 79.% 6% ω xyz % % Avg. Classif. Rate: 89.96% Avg. Classif. Rate: 9.% Avg. Classif. Rate: 9.7% Avg. Classif. Rate: 87.6% % Acc xyz + ω xyz % % igure. Confusion matrices of gender classification computed with -fold cross-validation. Each column presents sensor position (left to right): left ankle, lower back, chest and right wrist. Each row presents feature sets used for classification (top to bottom): D accelerations (6 features), D angular velocities (6 features) and 6D accelerations and angular velocities ( features). Classes: CG = gender female; C G = gender male. or the application of acceleration only, the classification rates are higher than 8.8% for each of the sensors. Classification results based on angular velocities show a lower classification rate, but

8 Sensors,, still above 79.%. The classification based on the combined features performs better than each of the individual feature sets, namely above 87%. ore precisely, the results for the combined features are (listed by sensor in descending order of rates): chest (9.7%), lower back (9.%), left ankle (89.96%), right wrist (87.6%). Table 6 presents -fold cross-validation results of gender classification, including correct classification accuracy, sensitivity, specificity, the positive predictive value (PPV) of each class and the average PPV of all classes. PPV C represents the PPV of the class C G, and PPV C represents the PPV of the class C G. Table 6. Classification results obtained by using -fold cross-validation for different classification categories: gender, height and age. The results show balanced correct classification rates, sensitivity, specificity, the positive predictive value (PPV) of each class and the average PPV of all classes. Classification Task Body Part Sensor Class.Rate Sens. Spec. PPV C PPV C PPV vg.ppv Gender Classification Body Height Classification Age Classification Chest A xyz, G xyz Lower Back A xyz, G xyz Right Wrist A xyz, G xyz Left Ankle A xyz, G xyz Chest A xyz, G xyz Lower Back A xyz, G xyz Right Wrist A xyz, G xyz Left Ankle A xyz, G xyz Chest A xyz, G xyz Lower Back A xyz, G xyz Right Wrist A xyz, G xyz Left Ankle A xyz, G xyz Body Height Classification Another goal was body height classification from only accelerations, angular velocities and a combination of both. H : The body height can be identified by motion recordings of any of the employed sensors The results of the ternary classification for each individual sensor are given in igure. Here, the classification estimated the assignment to three classes (C H : height 7 cm, : 7 cm < height < 8 cm, C H : height 8 cm). A behavior similar to the gender classification was observed where the classification based on the combined features of accelerations and angular velocities performs better than the individual ones. ore precisely, the results for the combined features are (listed by sensor in descending order of rates): chest (89.%), lower back (88.%), left ankle (87.7%), right wrist (8.78%). Table 6 presents -fold cross-validation results of body height classification, including correct classification accuracy, sensitivity, specificity, the positive predictive value (PPV) of each class and the average PPV of all classes. PPV C shows the PPV of the class C H ; PPV C shows the PPV of the class C H ; and PPV C shows the PPV of the class C H. Left Ankle Avg. Classif. Rate: 87.76% Lower Back Avg. Classif. Rate: 88.% Chest Avg. Classif. Rate: 89.8% Right Wrist Avg. Classif. Rate: 8.78% % 8% Acc xyz + ω xyz % 6% % % % % % igure. Confusion matrices of body height classification computed with -fold cross-validation. Each column presents the sensor position (left to right): left ankle, lower back, chest and right wrist. 6D accelerations and angular velocities ( features) were used for classification. C H : height 7 cm, C H : 7 cm < height < 8 cm, : height 8 cm. 6

9 Sensors,, Age Classification Another goal was age group classification from only accelerations, angular velocities and their combination. H : The age group of individuals can be identified by motion recordings of any of the employed sensors. The results of the ternary classification for each individual sensor are given in igure. Here, the classification estimated the assignment to three classes according to three age groups (C A : age <; C A : age < ; : age ) of participants. Similar to the previous classification tasks, the classification based on the combined features of accelerations and angular velocities performs better than the individual ones. ore precisely, age classification results for the combined features are (listed by sensor in descending order of rates): lower back (88.8%), chest (88.88%), left ankle (8.7%), right wrist (8.%). Table 6 presents -fold cross-validation results of age classification, including correct classification accuracy, sensitivity, specificity, the positive predictive value (PPV) of each class and the average PPV of all classes. PPV C represents the PPV of the class C A ; PPV C represents the PPV of the class C A ; and PPV C represents the PPV of the class C A. Left Ankle Avg. Classif. Rate: 8.7% Lower Back Avg. Classif. Rate: 88.8% Chest Avg. Classif. Rate: 88.88% Right Wrist Avg. Classif. Rate: 8.% % 8% Acc xyz + ω xyz % 6% % % % % % igure. Confusion matrices of age classification computed with -fold cross-validation. Each column presents the sensor position (left to right): left ankle, lower back, chest and right wrist. 6D accelerations and angular velocities ( features) were used for classification. C A : age <; C A : age < ; : age... Contribution of Individual eatures to Classification Results The contribution of each of the employed features in all three classification tasks was homogenous in the sense that there is not one outstanding feature with a major contribution to the classification results. In all experiments, we made the following observation: in sum, accelerations contributed more to the overall results than angular velocities. However, the combination of the two feature types did better than accelerations or angular velocities individually. Random forest s permutation-based variable importance measures have been used to evaluate the contribution of individual features in the overall classification results. or further details, refer to the works of Breimann [9] and Louppe et al. [7]. In detail, the classification results related to sensors at different locations can depend on quite different feature sets. In the following, we will give an overview of the most important contributors for each of the locations.... Gender Classification or the location at the chest, angular velocities (around the y-axis, i.e., transverse axis) contributed most, especially the standard deviation, max, energy, and RS. These are related to the rotation of the upper body around a horizontal axis over the course of the motion. Note that this is not a contradiction to our other claims. urthermore, the amplitude of the accelerations along the x-axis, i.e., the cranio-caudal axis, is of high importance. or the lower back, the most important features are associated with acceleration of the z-axis. This corresponds to changes in the velocity of the hip movement within the sagittal plane, i.e., front to back. In addition, angular velocities associated with 7

10 Sensors,, the z-axis, i.e., rotation around the anteroposterior axis (swinging of hips), contribute significantly to the results. urthermore, the amplitude of the accelerations along the x-axis, i.e., the cranio-caudal axis, is also of high importance. or the right wrist, features associated with acceleration along the y- and z-axes are top contributors. Particularly, minimum, maximum and entropy acceleration values associated with dorso-ventral, as well as lateral movement of the hand play a more important part in the classification. urthermore, the RS and energy of angular velocities associated with the z-axis are important. This is also linked to the swinging of the hand in the lateral direction. or the ankles, the contribution of accelerations along each axis is generally higher compared to the contribution of other single features. igure 6 shows bar graphs of the features importance computed during gender classification. The graphs present a comparison of the importance of each feature (as percentage) with respect to different sensor positions. In general, all features are significantly contributing in the classification task. An overview of contribution percentages where the most important features are highlighted is given in Table 7. Table 7. eatures importance computed during gender classification using -fold cross-validation strategy. The top contributing features are highlighted with bold text. All values are the percentage. Len Dur ean SD in ax RS Ent E Amp Chest Lower Back Right Wrist Left Ankle A x A y A z G x G y G z A x A y A z G x G y G z A x A y A z G x G y G z A x A y A z G x G y G z

11 Sensors,, Chest Lower Back Right Wrist Left Ankle len dur Acc x Acc y Acc z ω x ω y ω z igure 6. Bar graphs of the features importance computed during gender classification using the -fold cross-validation strategy. The graphs present a comparison of the importance of each feature (in %) with respect to different sensor positions. In general, all features are significantly contributing in the classification task.... Body Height Classification or the location at the chest, accelerations along the z-axis contributed most, especially the mean, minimum, maximum and energy. These are associated with the motion of the upper body in the dorso-ventral direction. urthermore, the minimum accelerations along the x-axis, i.e., the cranio-caudal axis, are of importance. or the lower back, the most important features are associated with acceleration of the z-axis, especially the mean, maximum, RS and energy. This corresponds to changes in the velocity of the movement of the hips within the sagittal plane, i.e., front to back. In addition, the minimum of the accelerations in the x-axis contributes significantly to the results. These are linked to the movement of the hips along the cranio-caudal axis (up and down). or the right wrist, features associated with acceleration along each of the three axes contribute significantly. Particularly, maximum, RS and energy values associated with dorso-ventral movement of the hand play a more important part. or the ankles, also the contribution of accelerations along each axis is generally high. Additionally, angular velocities associated with the rotation of the feet from side to side (around the z-axis) are significant contributors. igure 7 shows bar graphs of the feature contribution computed during body height classification. The graphs present a comparison of the importance of each feature (as percentage) with respect to different sensor positions. In general, all features are significantly contributing in the classification task. An overview of the contribution percentages where the most important features are highlighted is given in Table 8. 9

12 Sensors,, Table 8. eatures importance computed during body height classification using the -fold cross-validation strategy. The top contributing features are highlighted with bold text. All values are the percentage. Len Dur ean SD in ax RS Ent E Amp Chest Lower Back Right Wrist Left Ankle A x A y A z G x G y G z A x A y A z G x G y G z A x A y A z G x G y G z A x A y A z G x G y G z Chest Lower Back Right Wrist Left Ankle len dur Acc x Acc y Acc z ω x ω y ω z igure 7. Bar graphs of the features importance computed during body height classification using the -fold cross-validation strategy. The graphs present a comparison of the importance of each feature (in %) with respect to different sensor positions. In general, all features are significantly contributing in the classification task.

13 Sensors,, Age Classification or the location at the chest, the importance of the features is similarly distributed as in the height classification results: accelerations along the z-axis contributed most, especially the mean, maximum, RS and energy. These are associated with the motion of the upper body in the dorso-ventral direction. urthermore, the minimum acceleration along the x-axis, i.e., the cranio-caudal axis, is important. or the lower back, the most important features are associated especially with acceleration of the z-axis. This is similar to the results found in the height classification scenario and corresponds to changes in the velocity of the movement of the hips within the sagittal plane, i.e., front to back. or the right wrist, features associated with acceleration along each of the three axes contribute significantly. Additionally, the minimum angular velocity associated with rotation around the z-axis, i.e., swinging laterally, is important. or the ankles, the contribution of features associated with lateral acceleration is high. Additionally, angular velocities associated with swinging of the feet from side to side (around the z-axis), as well as rolling over from heel to toes (rotation around the y-axis) are significant contributors. igure 8 shows bar graphs of the features importance computed during age classification. The graphs present a comparison of the importance of each feature (as percentage) with respect to different sensor positions. In general, all features are significantly contributing in the classification task. An overview of contribution percentages where the most important features are highlighted is given in Table 9. Chest Lower Back Right Wrist Left Ankle len dur Acc x Acc y Acc z ω x ω y ω z igure 8. Bar graphs of the features importance computed during age classification using the -fold cross-validation strategy. The graphs present a comparison of the importance of each feature (in %) with respect to different sensor positions. In general, all features are significantly contributing in the classification task.

14 Sensors,, Table 9. eatures importance computed during age classification using the -fold cross-validation strategy. The top contributing features are highlighted with bold text. All values are the percentage. Len Dur ean SD in ax RS Ent E Amp Chest Lower Back Right Wrist Left Ankle A x A y A z G x G y G z A x A y A z G x G y G z A x A y A z G x G y G z A x A y A z G x G y G z Classification Results Based on Restriction to Subgroups Since the correlation between body height and gender is very high (on average, men are taller than women), we performed a gait-based classification task on each of the groups of female and male participants in order to present height classification results that are independent of this particular phenomenon. oreover, we also performed age classification on the data of each subgroup (female vs. male) separately. The number of subjects present in the study did not allow for ternary classification of subgroups (see Table for the population characteristics). Therefore, there were two different classes in the height-related experiment: C H = the body height of the subject is less than or equal to t h cm; C H = the body height of the subject is greater than t h cm (t h = 8 for male, t h = 7 for female subjects). In the age-related experiment, assigned classes were: C A = the subject is less than or equal to t a years old; C A = the subject is greater than t a years old (t a = for male, t a = for female subjects). Table shows an overview of the results. It is quite clear that the results are very good in all cases with the classification rate higher than 9% in all but two cases (89.% and 87.97% for the right wrist sensor in both female groups). The results also present balanced sensitivity, specificity, the positive predictive value (PPV) of each class and the average PPV of all classes. or body height classification, PPV C represents the PPV of the class C H, and PPV C represents the PPV of the class C H. or age classification, PPV C shows the PPV of the class C A, and PPV C shows the PPV of the class C A.

15 Sensors,, Table. Results of body height and age classifications within participant subgroups using -fold cross-validation. The results show balanced correct classification rates, sensitivity, specificity, the positive predictive value (PPV) of each class and the average PPV of all classes. Classification Task Body Part Sensor Class. Rate Sens. Spec. PPV C PPV vg. PPV Body Height Classification ale Group emale Group Age Classification ale Group emale Group Chest A xyz, G xyz Lower Back A xyz, G xyz Right Wrist A xyz, G xyz Left Ankle A xyz, G xyz Chest A xyz, G xyz Lower Back A xyz, G xyz Right Wrist A xyz, G xyz Left Ankle A xyz, G xyz Chest A xyz, G xyz Lower Back A xyz, G xyz Right Wrist A xyz, G xyz Left Ankle A xyz, G xyz Chest A xyz, G xyz Lower Back A xyz, G xyz Right Wrist A xyz, G xyz Left Ankle A xyz, G xyz Subject-Wise Cross-Validation In order to show that our results are not caused by over-fitting the classification to specific subjects rather than learning the properties, we are looking for (gender, height, age), a subject-wise cross-validation model was also employed (as explained in Section.8). Table presents the classification results of subject-wise cross-validation for all three group classification tasks: gender, height and age. The feature set contained all features of 6D accelerations and angular velocities ( in total). or each sensor position, sensitivity, specificity, the PPV of each class and the average PPV of all classes were also computed. A comparison of the classification results of group classification tasks using -fold cross-validation and subject-wise cross-validation for chest (CH), lower back (LB), right wrist (RW) and left ankle (LA) is presented in igure 9. It is clearly observable that -fold cross-validation outperforms subject-wise cross-validation in all cases. old CV Subject wise CV Accuracy CH LB RW LA Gender Accuracy CH LB RW LA Height Accuracy CH LB RW LA Age igure 9. A comparison of correct classification accuracy of group classification tasks (gender, height and age) using -fold cross-validation and subject-wise cross-validation. Sensor positions include: chest (CH), lower back (LB), right wrist (RW) and left ankle (LA). The -fold cross-validation model outperforms the subject-wise cross-validation model in all cases.

16 Sensors,, Table. Subject-wise classification results of different classification categories: gender, height and age. The results show balanced correct classification rates, sensitivity, specificity, the positive predictive value (PPV) of each class and the average PPV of all classes. Classification Task Body Part Sensor Class. Rate Sens. Spec. PPV C PPV C PPV vg. PPV Chest A xyz, G xyz Gender Classification Lower Back A xyz, G xyz Right Wrist A xyz, G xyz Left Ankle A xyz, G xyz Chest A xyz, G xyz Body Height Classification Lower Back A xyz, G xyz Right Wrist A xyz, G xyz Left Ankle A xyz, G xyz Chest A xyz, G xyz Age Classification Lower Back A xyz, G xyz Right Wrist A xyz, G xyz Left Ankle A xyz, G xyz In the case of gender classification using chest and lower back sensors, the classification rates are 7.8% and 6.7% lower than -fold cross-validation. or right wrist and left ankle sensors, the classification rates are 8.6% and.8% lower than -fold cross-validation. In the case of height classification using chest and lower back sensors, the classification rates are 6.8% and 6.7% lower than -fold cross-validation. or right wrist and left ankle sensors, the classification rates are.8% and 9.% lower than -fold cross-validation. or the age classification task, a sharp decline in the classification rates is observable in subject-wise cross-validation. or chest and lower back sensors, the classification rates are.8% and 6.8% lower than -fold cross-validation. or right wrist and left ankle, the classification rates are.% and.79% lower than -fold cross-validation. The main reason for such a sharp decline is because of the unbalanced population in classes C A, and with a subject ratio of 9:6:. On the level of subject-wise cross-validation, it is also possible to address the questions of the invariance of the features within the different steps of a walking sequence or to come up with random forest regressions for age and height. Not surprisingly, almost all steps of one walking sequence were classified identically; 99.% for gender classification, 98.7% for height classification and 98.% for age classification. When performing a random forest regression instead of a classification, we obtained age classifications with an average RS error of about. years and height classification with an average RS error of about 9. cm.. Discussion.. Summary of indings The general problem we tackled is the estimation of soft biometric information from one single step recorded by one inertial sensor. We did so by solving different classification tasks based on the motion data of human walking steps represented by accelerations and angular velocities. Data were recorded by one sensor placed at various locations on the human body, namely the chest, the lower back, the wrist and the ankle. The results show that these classification tasks can be solved well by using accelerometers and/or gyroscopes at any of the given locations. The classification rates were highest for sensors located at the lower back and chest in each of the experiments, but still convincingly high when the sensor is attached to the wrist or ankle. Our analysis of the feature sets used in each of the experiments has made clear that there is not one feature mainly responsible for any of the distinctions necessary for a classification. However, the feature importance in each of the classifications gave pointers as to what combination of features produces the best results. The most important findings were that angular velocities did not perform better than accelerations.

17 Sensors,, Comparison with Existing Research It is not surprising that information about the gender can be recovered by analysis of chest or lower back movement. The effects of marker placement and viewpoint selection for recording locomotion are discussed extensively in the works of Troje [], as was the high relevance of hip movement for gender classification by human observers. However, we have presented new findings, namely that accelerations associated with wrist and ankle movement alone allow for classification of gender, as well. To our knowledge, we are also the first to show that classification of height and age groups is possible from non-visual features. This is as yet done by solely relying on image- or video-based features. akihara et al. [8] introduce a paper on gait-based age estimation by Gaussian process regression on silhouette-based features of bodies (contrary to face-based age estimation, as presented by Stewart et al. [9]). Their investigation was based on standard resolution video data. They have constructed a whole-generation database of over individuals, their age ranging from two to 9. Our initial situation is clearly different from this in terms of sensor modalities. The use of commercial smart phones and wearables is an attractive chance to monitor biometric properties nowadays. obile phones and smart devices are a convenient platform for recording information in an every-day setup. Our experiments have shown that information recorded by a single sensor, such as a smart device, suffices for the estimation of basic soft biometric properties. Particularly, the wrist was an important subject for tests, because smart devices are commonly worn at that location. Estimating biometric properties based on motion data makes sense in a number of different scenarios. In some of them, the focus may be on hard biometric properties in order to facilitate online identity checks and close security gaps. A number of previous works have shown that identification and authentication problems can be solved by classification of motion data acquired by mobile devices. Derawi and Bours [] show that recognition of specific users can be done in real-time based on data collected by mobile phones. Their method can correctly identify enrolled users based on learning templates of different walking trials. On the other hand, attention may be directed to soft biometric properties. onitoring health or preventing and curing injury are use cases that represent this idea. Previous works have shown that accelerometers are well suited for detection and recognition of events and activity. In their paper on sensory motor performance, Albert et al. [] discuss a new method to classify different types of falls in order to rapidly assess the cause and necessary emergency response. They present very good results classifying accelerometer data acquired by commercial mobile phones, which were attached to the lower backs of test subjects. In their comparative evaluation of five machine learning classifiers, support vector machines performed best, achieving accuracy values near 98%. Classification by decision trees only performed second best in their experiments at 9% to 98% accuracy for fall detection and at 98% to 99% accuracy for fall type classification. In their paper on gait pattern classification, Von Tscharner et al. [] even conclude that a combination of PCA, SV and ICA is most reliable dealing with high intra- and inter-subject variability. However, in their survey on mobile gait classification, Schneider et al. [] make an attempt to settle the disagreement about suitable classification algorithms. In their study, they conclude that random forest is best suited for the classification of gait-related properties. In our setup, we decided to use random forest in order to produce comparable results. One additional benefit of this choice is that there is a low number of parameters that have to be chosen. urthermore, the random forest method enables computing the significance and importance of each feature in overall classification. This helped us to investigate and perform a comparative study of the features importance for each sensor position in different classification tasks.

18 Sensors,, Limitations Since our database is much smaller than the one introduced by akihara et al. [8] and the variety of biometric features was also smaller (e.g., age covered only three decades), our experiments can only serve as proof of concept for now. Testing classifiers of non-image-based features on a larger database comprising wider ranges of biometric properties is a direction for future work. Another limitation of our database is that it only consists of data belonging to patients with complaints of back pain. It will be worthy to perform further experiments to record data of participants without back pain (control group). Classification tasks can then be performed for the patient group, the control group and a combination of both. One noteworthy limitation we had to face in our experiments is a possible uncertainty of sensor placement. Irrespective of how carefully each involved sensor is placed, the accuracy of placement depends on physical characteristics of test subjects, which may vary between individuals to some extent.. Conclusions and uture Work We have classified biometric information based on the data of a single inertial-measurement unit collected on a single step. As a novel empirical finding, we have shown that single steps of normal walking already reveal biometric information about gender, height and age quite well, not only for measurements of lower back movements or chest movements, but also for wrist movements or ankle movements. Using standard -fold cross-validation, the classification rates have been for gender classification: 87.6% (right wrist sensor) to 9.7% (chest sensor); height classification: 8.78% (right wrist sensor) to 89.% (chest sensor); age classification: 8.% (right wrist sensor) to 88.8% (chest, lower back sensor). When using the rather strict subject-wise evaluations, the classification rates are somewhat lower for gender by 6.7% (lower back sensor) to.8% (left ankle) compared to the results of -fold cross-validation. or height classification, the classification rates using subject-wise evaluation are 6.7% (lower back sensor) to 9.% (left ankle sensor) lower, and for age classification, 6.8% (lower back sensor) to.79% (left ankle sensor). These values can be seen as lower bounds on the possible classification rates on the biological variations, since also our feature selection, as well as our used machine learning techniques might not be optimal. Especially, a good estimate of the direction of gravity should improve the results; at sensors position with less change in orientation (chest, lower back), the classification rates had been better than at the ones with higher change (wrist, ankle). In future work, we will try to adopt a model-based estimate of body-part orientation using techniques similar to the ones used in [7] to come up with such estimates. On the side of the basic science questions about human movement control, we want to address questions about to which degree the movement patterns can be spoofed by trained and untrained persons in future work. We will perform tests asking probands to try to walk like the other gender, to pretend to have another age or to have another height, etc. On the technological side, our work should help to gain information on the user by smartwatches, smartphones or smart shoes, given the fact that many sensor systems for consumer electronics are limited: long time recordings can be done in low frame rates only or high speed measurements can be done for a limited amount of time, to save battery life time. Thus, it is more and more important to get information out of sparse sensor readings. Our work presents a technique where biometric parameters can be estimated from single steps. These biometric parameters can be used for further analysis of motions that are recorded with lower frame rates. Compared to previous work, where full sequences are considered for classification, we see this as a strong improvement. However, our work also demonstrates the sensitivity of sensor data of such devices with respect to privacy concerns: already, the information on a single step recorded from a smartphone or smartwatch reveals personal information on gender, height and age. 6

19 Sensors,, Acknowledgments: We thank Guanhong Tao for his support and help in performing the experiments. We also thank all participants for taking part in the experiments. This work was partially supported by Deutsche orschungsgemeinschaft (DG) under research grants KR 9/-. Author Contributions: Conceived of and designed the experiments: BK, QR, AW. Performed the experiments: QR, BK. Analyzed the data: QR, BK, AV. Contributed reagents/materials/analysis tools: QR, BK, AV. Wrote the paper: AV, QR, BK, AW. Conflicts of Interest: The authors declare no conflict of interest. References. Johansson, G. Visual perception of biological motion and a model for its analysis. Percep. Psychophys. 97,,.. Troje, N.. Decomposing biological motion: A framework for analysis and synthesis of human gait patterns. J. Vis.,,.. Lv,.; Nevatia, R. Single View Human Action Recognition using Key Pose atching and Viterbi Path Searching. In Proceedings of the 7 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 7), inneapolis, N, USA, 8 June 7.. Junejo, I.N.; Dexter, E.; Laptev, I.; Perez, P. View-Independent Action Recognition from Temporal Self-Similarities. IEEE Trans. Pattern Anal. ach. Intell.,, Barnachon,.; Bouakaz, S.; Boufama, B.; Guillou, E. Ongoing human action recognition with motion capture. Pattern Recognit., 7, Oshin, O.; Gilbert, A.; Bowden, R. Capturing relative motion and finding modes for action recognition in the wild. Comput. Vis. Image Underst.,, oeslund, T.B.; Hilton, A.; Krüger, V. A survey of advances in vision-based human motion capture and analysis. Comput. Vis. Image Underst. 6,, Schuldt, C.; Laptev, I.; Caputo, B. Recognizing Human Actions: A Local SV Approach. In Proceedings of the7th International Conference on Pattern Recognition (ICPR ), Washington, DC, USA, 6 August ; pp Venture, G.; Ayusawa, K.; Nakamura, Y. otion capture based identification of the human body inertial parameters. In Proceedings of the th Annual International Conference of the IEEE Engineering in edicine and Biology Society, (EBS), Vancouver, BC, Canada, August 8; pp Kirk, A.G.; O Brien, J..; orsyth, D.A. Skeletal Parameter Estimation from Optical otion Capture Data. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), June ; pp Liew, C.S.; Wah, T.Y.; Shuja, J.; Daghighi, B. ining Personal Data Using Smartphones and Wearable Devices: A Survey. Sensors,, 69.. Son, D.; Lee, J.; Qiao, S.; Ghaffari, R.; Kim, J.; Lee, J.E.; Song, C.; Kim, S.J.; Lee, D.J.; Jun, S.W.; et al. ultifunctional wearable devices for diagnosis and therapy of movement disorders. Nat. Nanotechnol., 9, 97.. Tao, W.; Liu, T.; Zheng, R.; eng, H. Gait Analysis Using Wearable Sensors. Sensors,, 8.. Le asurier, G.C.; Tudor-Locke, C. Comparison of pedometer and accelerometer accuracy under controlled conditions. ed. Sci. Sports Exerc.,, oster, R.C.; Lanningham-oster, L..; anohar, C.; ccrady, S.K.; Nysse, L.J.; Kaufman, K.R.; Padgett, D.J.; Levine, J.A. Precision and accuracy of an ankle-worn accelerometer-based pedometer in step counting and energy expenditure. Prev. ed.,, Tautges, J.; Zinke, A.; Krüger, B.; Baumann, J.; Weber, A.; Helten, T.; üller,.; Seidel, H.P.; Eberhardt, B. otion Reconstruction Using Sparse Accelerometer Data. AC Trans. Graph.,, 8: 8:. 7. Riaz, Q.; Tao, G.; Krüger, B.; Weber, A. otion reconstruction using very few accelerometers and ground contacts. Graph. odel., 79, Hung, H.; Englebienne, G.; Kools, J. Classifying Social Actions with a Single Accelerometer. In Proceedings of the AC International Joint Conference on Pervasive and Ubiquitous Computing, Zurich, Switzerland, 8 September ; pp. 7. 7

20 Sensors,, Parkka, J.; Ermes,.; Korpipaa, P.; antyjarvi, J.; Peltola, J.; Korhonen, I. Activity classification using realistic data from wearable sensors. IEEE Trans. Inf. Technol. Biomed. 6,, Jean-Baptiste, E..D.; Nabiei, R.; Parekh,.; ringi, E.; Drozdowska, B.; Baber, C.; Jancovic, P.; Rotshein, P.; Russell,.J. Intelligent Assistive System Using Real-Time Action Recognition for Stroke Survivors. In Proceedings of the IEEE International Conference on Healthcare Informatic (ICHI), Verona, Italy, 7 September ; pp. 9.. Dijkstra, B.; Kamsma, Y.; Zijlstra, W. Detection of gait and postures using a miniaturised triaxial accelerometer-based system: Accuracy in community-dwelling older adults. Age Ageing, 9, orris, D.; Saponas, T.S.; Guillory, A.; Kelner, I. Recoit: Using a Wearable Sensor to ind, Recognize, and Count Repetitive Exercises. In Proceedings of the SIGCHI Conference on Human actors in Computing Systems, Toronto, ON, Canada, 6 April ay ; pp... Neugebauer, J..; Hawkins, D.A.; Beckett, L. Estimating youth locomotion ground reaction forces using an accelerometer-based activity monitor. PLoS ONE, 7, e88.. Brand,.; Oliver, N.; Pentland, A. Coupled Hidden arkov odels for Complex Action Recognition. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 97), San Juan, Puerto Rico, 7 9 June 997; pp Bao, L.; Intille, S. Activity Recognition from User-Annotated Acceleration Data. In Pervasive Computing; erscha, A., attern,., Eds.; Springer Berlin Heidelberg: Berlin, Germany, ; Volume, pp Kwapisz, J.R.; Weiss, G..; oore, S.A. Activity Recognition Using Cell Phone Accelerometers. SIGKDD Explor. Newsl.,, Phan, T. Improving Activity Recognition via Automatic Decision Tree Pruning. In Proceedings of the AC International Joint Conference on Pervasive and Ubiquitous Computing, Seattle, WA, USA, 7 September ; pp Breiman, L. Random orests. ach. Learn.,,. 9. Liaw, A.; Wiener,. Classification and Regression by randomorest. R News,, 8.. Gokhale, E. Gokhale ethod Gokhale ethod Institute. Available online: com/ (accessed on October ).. Särndal, C.; Swensson, B. odel Assisted Survey Sampling; Springer: New York, NY, USA, ; pp... Opal, A. Wireless, Wearable, Synchronized Inertial easurement Units (IUs) APD, Inc. Available online: (accessed on October ).. Li,.; Zhao, C.; Ding, G.; Gong, J.; Liu, C.; Zhao,. A reliable and accurate indoor localization method using phone inertial sensors. In Proceedings of the AC Conference on Ubiquitous Computing, Pittsburgh, PA, USA, 8 September ; pp... Derawi,.; Nickel, C.; Bours, P.; Busch, C. Unobtrusive User-Authentication on obile Phones Using Biometric Gait Recognition. In Proceedings of the Sixth International Conference on Intelligent Information Hiding and ultimedia Signal Processing (IIH-SP), Darmstadt, Germany, 7 October ; pp. 6.. Zijlstra, W. Assessment of spatio-temporal parameters during unconstrained walking. Eur. J. Appl. Physiol., 9, Umbaugh, S.E. Digital Image Processing and Analysis: Human and Computer Vision Applications with CVIPtools; CRC Press: Boca Raton, L, USA, ; pp Louppe, G.; Wehenkel, L.; Sutera, A.; Geurts, P. Understanding variable importances in forests of randomized trees. In Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA, December ; pp akihara, Y.; Okumura,.; Iwama, H.; Yagi, Y. Gait-based Age Estimation using a Whole-generation Gait Database. In Proceedings of the International Joint Conference on Biometrics (IJCB), Washington, DC, USA, October ; pp Stewart, D.; Pass, A.; Zhang, J. Gender classification via lips: static and dynamic features. IET Biom.,, 8.. Derawi,.; Bours, P. Gait and activity recognition using commercial phones. Comput. Secur., 9, 7.. Albert,.V.; Kording, K.; Herrmann,.; Jayaraman, A. all Classification by achine Learning Using obile Phones. PLoS ONE, 7, e66. 8

21 Sensors,, Von Tscharner, V.; Enders, H.; aurer, C. Subspace Identification and Classification of Healthy Human Gait. PLoS ONE, 8, e66.. Schneider, O.S.; aclean, K.E.; Altun, K.; Karuei, I.; Wu,.. Real-time Gait Classification for Persuasive Smartphone Apps: Structuring the Literature and Pushing the Limits. In Proceedings of the International Conference on Intelligent User Interfaces, Los Angeles, CA, USA, 9 arch ; pp c by the authors; licensee DPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons by Attribution (CC-BY) license ( 9