Convergent Validity of a Piezoelectric Pedometer and an Omnidirectional Accelerometer for Measuring Children s Physical Activity

Similar documents
Effects of Age and Body Mass Index on Accuracy of Simple Moderate Vigorous Physical Activity Monitor Under Controlled Condition

Validation of PiezoRx Pedometer Derived Sedentary Time

Validation of Omron Pedometers Using MTI Accelerometers for Use with Children

Presence and duration of reactivity to pedometers in adults

In Australia, survey instruments for the

Evaluation of a commercially available

Pedometer-Determined Physical Activity Levels of Youth

Comparison of pedometer and accelerometer measures of physical activity during preschool time on 3- to 5-year-old children

Saunders et al. BMC Public Health 2014, 14:519

Convergent Validity of 3 Low Cost Motion Sensors With the ActiGraph Accelerometer

Title: Agreement between pedometer and accelerometer in measuring physical activity in overweight and obese pregnant women

MIL-STD-883G METHOD

Accurate assessment of physical activity (PA) in a

Validity of the Actical Accelerometer Step-Count Function in Children

Competitive Performance of Elite Olympic-Distance Triathletes: Reliability and Smallest Worthwhile Enhancement

Steps/day translation of the moderate-to-vigorous physical activity guideline for children and adolescents

This study investigated the amount of physical activity that occurred during

Validation of Measurements from a ZephIR Lidar

Using Accelerometry: Methods Employed in NHANES

Comparisons of Accelerometer and Pedometer Determined Steps in Free Living Samples

Pedometers: Answers to FAQs from Teachers

CHILDREN S PEDOMETER-DETERMINED PHYSICAL ACTIVITY DURING SCHOOL-TIME AND LEISURE-TIME

Investigating the Validity of the MVPA Feature on the New Lifestyles 1000 Pedometer in Children with Visual Impairments. Killeen Pritchard.

Effects of Placement, Attachment, and Weight Classification on Pedometer Accuracy

Sandra Nutter, MPH James Sallis, PhD Gregory J Norman, PhD Sherry Ryan, PhD Kevin Patrick, MD, MS

INFLUENCE OF PEDOMETER TILT ANGLE ON STEP COUNTING VALIDITY DURING CONTROLLED TREADMILL WALKING TRIALS. Melissa Dock

Validity of Four Activity Monitors during Controlled and Free-Living Conditions

Validation of an Electronic Pedometer for Measurement of Physical Activity in Children

Using Hexoskin Wearable Technology to Obtain Body Metrics During Trail Hiking

Safety Assessment of Installing Traffic Signals at High-Speed Expressway Intersections

Wildlife Ad Awareness & Attitudes Survey 2015

Convergent Validity of Pedometer and Accelerometer Estimates of Moderate-to-Vigorous Physical Activity of Youth

measures Second generation accelerometers

An Examination of the Effects of a Curriculum Based Pedometer Program in Two Age Groups: Adults and Pre-Adolescent Children

Evaluating the Influence of R3 Treatments on Fishing License Sales in Pennsylvania

Promoting Health in Low-Wealth Communities: Physical Activity

Femke De Meester 1*, Delfien Van Dyck 1,2, Ilse De Bourdeaudhuij 1 and Greet Cardon 1

Childrenʹs Step Counts on Weekend, Physical Education, and Non Physical Education Days

Physical activity during recess outdoors and indoors among urban public school students, St. Louis, Missouri,

THE VAILDITY OF PROXY REPORT ON KINERGARTEN CHILDREN S PHYSICAL ACTIVITY IN HONG KONG AU YUNG CHING

Engineering Note. Algorithms. Overview. Detailed Algorithm Description. NeoFox Calibration and Measurement. Products Affected: NeoFox

WHAT CAN WE LEARN FROM COMPETITION ANALYSIS AT THE 1999 PAN PACIFIC SWIMMING CHAMPIONSHIPS?

Measuring physical activity in youth settings: Considerations for instrument selection

In the spring of 2006, national newspaper headlines screamed

HHS Public Access Author manuscript Int J Cardiol. Author manuscript; available in PMC 2016 April 15.

Review Article Review of Prediction Models to Estimate Activity-Related Energy Expenditure in Children and Adolescents

Walkable Communities and Adolescent Weight

Physical Activity monitors: Limitations to measure physical activity in the free-living environment

Objective Physical Activity Monitoring for Health-Related Research: A Discussion of Methods, Deployments, and Data Presentations

Procedia - Social and Behavioral Sciences 46 ( 2012 ) WCES 2012

Treadmill and daily life

Exploring the relationship between Heart Rate (HR) and Ventilation Rate (R) in humans.

Surf Survey Summary Report

USING WIRELESS PEDOMETERS TO MEASURE CHILDREN S PHYSICAL ACTIVITY: HOW RELIABLE IS THE FITBIT ZIP TM?

JEPonline Journal of Exercise Physiologyonline

Drilling Efficiency Utilizing Coriolis Flow Technology

Medicine. Cadence Feedback With ECE PEDO to Monitor Physical Activity Intensity. A Pilot Study. Fusun Ardic, MD and Esra Göcer, MD

TRENDS IN PARTICIPATION RATES FOR WILDLIFE-ASSOCIATED RECREATION BY RACE/ETHNICITY AND GENDER:

Accuracy of a Pedometer and an Accelerometer in Women with Obesity

Influence of Angular Velocity of Pedaling on the Accuracy of the Measurement of Cyclist Power

Activity profiles in adolescent netball: A combination of global positioning system technology and time-motion analysis

Paper 2.2. Operation of Ultrasonic Flow Meters at Conditions Different Than Their Calibration

March Madness Basketball Tournament

Clutch Hitters Revisited Pete Palmer and Dick Cramer National SABR Convention June 30, 2008

Application Block Library Fan Control Optimization

EvaluationoftheAARPRed HatSocietyStep&Stride WithRuby:AYear-Long WalkingProgram. ExecutiveSummary

Triaxial Accelerometry for Assessment of Physical Activity in Young Children

Ambulatory monitoring of gait quality with wearable inertial sensors

Chapter 5: Methods and Philosophy of Statistical Process Control

APPROACH RUN VELOCITIES OF FEMALE POLE VAULTERS

Bhagwant N. Persaud* Richard A. Retting Craig Lyon* Anne T. McCartt. May *Consultant to the Insurance Institute for Highway Safety

Fail Operational Controls for an Independent Metering Valve

Convergent Validity of the Arab Teens Lifestyle Study (ATLS) Physical Activity Questionnaire

Legendre et al Appendices and Supplements, p. 1

The Impact of Policy and Environmental Outcomes on Youth Physical Activity

PEDOMETER HANDBOOK MAKING EVERY STEP COUNT!

Methods. Mark A. Tully and Margaret E. Cupples. Study Design

The Effects of Game Size on the Physical Activity Levels and Ball Touches of Elementary School Children in Physical Education

SUPPLEMENTARY INFORMATION

Sontek RiverSurveyor Test Plan Prepared by David S. Mueller, OSW February 20, 2004

Traffic Parameter Methods for Surrogate Safety Comparative Study of Three Non-Intrusive Sensor Technologies

Investigating the effects of interchanging components used to perform ripple assessments on calibrated vector network analysers

POWER Quantifying Correction Curve Uncertainty Through Empirical Methods

MICROPHONE WIND SPEED LIMITS DURING WIND FARM NOISE MEASUREMENTS

Wade Reynolds 1 Frank Young 1,2 Peter Gibbings 1,2. University of Southern Queensland Toowoomba 4350 AUSTRALIA

NBA TEAM SYNERGY RESEARCH REPORT 1

Effects of directionality on wind load and response predictions

An Application of Signal Detection Theory for Understanding Driver Behavior at Highway-Rail Grade Crossings

A SURVEY OF 1997 COLORADO ANGLERS AND THEIR WILLINGNESS TO PAY INCREASED LICENSE FEES

Gerald D. Anderson. Education Technical Specialist

Is lung capacity affected by smoking, sport, height or gender. Table of contents

Coaching Applications. Maturational Timing and Swim Performance in Collegiate Female Swimmers

Impact of Pedometer Use and Self-Regulation Strategies on Junior High School Physical Education Students' Daily Step Counts

Hardware Triaxial and Consolidation Testing Systems Pressure Measurement and Control

Bicycle Helmet Use Among Winnipeg Cyclists January 2012

Accuracy and Precision of High-Speed Field Measurements of Pavement Surface Rutting and Cracking

2009 New Brunswick Gambling Prevalence Study

Calculation of Trail Usage from Counter Data

Analysis of Variance. Copyright 2014 Pearson Education, Inc.

Title: Modeling Crossing Behavior of Drivers and Pedestrians at Uncontrolled Intersections and Mid-block Crossings

Transcription:

Pediatric Exercise Science, 2011, 23, 399-410 2011 Human Kinetics, Inc. Convergent Validity of a Piezoelectric Pedometer and an Omnidirectional Accelerometer for Measuring Children s Physical Activity Scott Duncan, Kate White, Losi Sa ulilo, and Grant Schofield Auckland University of Technology The aim of this study was to assess the convergent validity of a new piezoelectric pedometer and an omnidirectional accelerometer for assessing children s time spent in moderate to vigorous physical activity (MVPA). A total of 114 children (51 boys, 63 girls) aged 5 11 years wore a sealed NL-1000 piezoelectric pedometer (New Lifestyles Inc, Lee s Summit, MO) and an Actical accelerometer (Mini Mitter, Bend, OR) over one school day. The NL-1000 pedometers were randomized to one of two manual intensity thresholds used to define MVPA (1): Level 3 = 2.9 metabolic equivalent test (MET) and (2) Level 4 = 3.6 MET. Compared with the Actical, the NL-1000 underestimated the time spent in MVPA by 37% and 45% at intensity levels 3 and 4, respectively. In addition, the 95% limits of agreement were wide at both intensity levels (level 3 = -144%, 70%; level 4 = -135%, 45%), indicating a low level of precision. Physical activity during childhood offers numerous health advantages, including improvements to blood lipid profile, bone health and self-efficacy, and a reduction in the risk of developing cardiovascular disease, type 2 diabetes and obesity (3,18). As such, the promotion of physical activity in children is a key public health priority in many countries. National physical activity guidelines are typically expressed in units of time; the most common recommendation is that children accumulate at least 60 min of moderate to vigorous physical activity (MVPA) each day (10). Thus, the accurate measurement of time spent in MVPA is essential so that population trends and interventions can be monitored using a unit that has direct relevance to public health policy. Accelerometers are advanced motion sensing devices that are generally considered to be the most effective way of estimating MVPA in large samples (16). They are particularly useful in pediatric populations, where they provide an objective and unobtrusive assessment of physical activity frequency, duration, and intensity that does not rely on subjective recall of behavior. Several studies have Duncan, White, Sa ulilo, and Schofield are with the Centre for Physical Activity and Nutrition, Auckland University of Technology, Auckland, New Zealand. 399

400 Duncan et al. established the validity and reliability of a variety of accelerometer models for measuring MVPA in children, including uniaxial (vertical plane of motion only), triaxial (three planes of motion), and omnidirectional (multiple planes of motion) variations (9). However, accelerometers are expensive instruments (USD300 600) that require expertise to configure and operate. They are therefore less useful for health practitioners undertaking large population studies. In addition, the requirement for data to be downloaded onto a computer before access means that they cannot be used to provide immediate feedback to the individual being monitored. Pedometers, on the other hand, are inexpensive and technically uncomplicated devices that can provide ongoing feedback to study participants (data can be accessed directly from the digital display). Pedometers are principally designed to measure the number of steps taken each day. Most pedometers perform this function using a spring-mounted horizontal lever arm that detects vertical forces at the waist level greater than approximately 0.35 g. Expressing physical activity in terms of steps per day has several advantages: steps are an easy unit to understand for the general public, daily step counts include all physical activity (not just moderate to vigorous), and increasing steps is sustainable approach for those who are less able to participate in more vigorous physical activities. Step-based guidelines have been developed for children based on a reduction in risk of negative health outcomes (5,19). However, given that ownership of a pedometer is required before an individual can self-monitor adherence to step-based guidelines, increasing minutes spent in MVPA remains the preferred message for most public health agencies. The recently released NL-1000 pedometer (New Lifestyles Inc, Lee s Summit, MO) bridges, at least in part, the gap between accelerometers and pedometers by including an ability to detect and record daily minutes of MVPA in addition to daily step counts. This feature is possible through the use of a piezoelectric strain gauge sensor that permits a graded response to vertical movement rather than the all-or-nothing response of spring-levered pedometers. It also features an internal memory that automatically stores daily step counts and minutes of MVPA for up to seven days, removing the need for researchers or participants to manually record each day s data. The capability of the relatively inexpensive NL-1000 (USD50) to objectively measure minutes of MVPA has significantly reduced the financial outlay required to obtain MVPA estimates in large samples. In addition, all NL-1000 data (including minutes of MVPA) can be easily accessed straight from the digital display. Despite the potential of the NL-1000 pedometer for physical activity research, it is critical that the MVPA estimates recorded by the NL-1000 are comparable to accelerometer-based estimates. To our knowledge, only one study has investigated the performance of the NL-1000 for assessing MVPA in children. McMinn et al. (12) compared time spent in MVPA between the NL-1000 and a uniaxial accelerometer (Actigraph GT1M, Actigraph LLC, Pensacola, FL). Children aged 10 13 years wore the equipment under three different conditions (1): a cross-country run (N = 12) (2), physical education (N = 18), and (3) classroom activity breaks (N = 42). The authors concluded that the NL-1000 performed well when compared with the accelerometer-determined minutes of MVPA. An important caveat of this conclusion is that the NL-1000 only performed adequately when the threshold used to define MVPA in the criterion measure was higher than the commonly accepted thresholds of three metabolic equivalent of task (MET) levels or a physical activity

Convergent Validity in Measuring Children s Physical Activity 401 ratio (PAR) of three. In addition, the sample size and age range were limited, and the testing conditions were not free-living but discrete high activity periods. Thus, the purpose of the current study was to assess the accuracy and precision of the NL-1000 pedometer for detecting MVPA in free-living children when compared with an omnidirectional accelerometer set to record activities greater than PAR 3. Participants Methods A total of 126 children from Years 1 6 at a local primary school were recruited to participate in the study. Of this initial sample, 12 were excluded from analysis procedures due to incomplete data, resulting in a final sample size of 114 (51 boys, 63 girls). Written informed assent and consent were obtained from children and parents, respectively. The age and sex of participants were collected from the current school roll. Ethical approval to conduct the study was granted by the institutional ethics committee. Instruments Physical activity was recorded using two portable motion sensing devices (1): Actical accelerometers (Mini Mitter, Bend, OR) and (2) NL-1000 pedometers. The Actical is an omnidirectional accelerometer that has been established as one of the better and most widely used instruments for assessing physical activity duration in children with excellent validity and reliability (9,14). They are also able to detect steps with an acceptable level of accuracy (7). The shortest possible epoch time of 15 s was selected to minimize the MVPA misclassification that is possible at longer epochs (11). MVPA was calculated from Actical activity counts using a previously validated and commonly used prediction equation developed specifically for children (15). The NL-1000 is a piezoelectric pedometer that has the capability of logging minutes of MVPA in four-second epochs. The NL-1000 has nine intensity levels that correspond to various estimated MET levels. These levels can be adjusted to record the time spent at different intensities. The manufacturers recommend setting the activity level at 4 equivalent to a threshold of 3.6 MET to measure MVPA. However, MVPA is usually defined as intensity at or above 3 MET (1). Therefore, setting the NL-1000 at activity level 3 (> 2.9 MET) may provide a more appropriate estimation of time spent in MVPA. The intensity level used for each participant was randomized between levels 3 and 4, such that 58 children were tested at level 3 and 56 at level 4. Procedures Participants were concurrently fitted with a sealed pedometer and accelerometer at the beginning of the school day (9.30am). One device was fitted above the iliac crest of the left hip with the other fitted on the right hip using an elasticized waistband with an adjustable belt. The order the devices were placed on the left or right hip was randomized. Pedometers were reset and sealed immediately before fitting them to each child. Researchers removed the equipment at the end of the school

402 Duncan et al. day (2.30pm) and NL-1000 step counts and MVPA were recorded immediately from the digital display. To ensure accuracy, time of the day was recorded as soon as the equipment was placed on and removed from each child. In addition, children were asked if they had removed the pedometer or accelerometer during the day; those that had were excluded from data analysis (N = 12). Data collection took place daily over a 4-week period (approximately 6 7 children per day) using 10 NL-1000 pedometers and 10 Actical accelerometers. Statistical Analysis Descriptive statistics were generated for age and monitoring time in addition to the MVPA and step count data recorded by the Actical accelerometers. Sex differences were examined using independent-samples t tests. While accelerometers do not provide a gold standard estimate of MVPA, for the purposes of our analyses they were treated as the criterion measure. Bias (NL-1000 MVPA Actical MVPA) was converted to a percentage of Actical MVPA to assess the relative under- or overestimation of the NL-1000. A negative value indicates underestimation whereas a positive value indicates overestimation. The 95% limits of agreement and loss of precision statistics were also calculated to provide an indication of reliability. The loss of precision, or the variance of prediction error divided by the variance of the criterion value, measures the theoretical increase in sample size required to offset the prediction error. The consistency of percent bias at the extremes of the observed MVPA distribution was clarified using correlation analysis. Bland-Altman plots were generated to demonstrate the effects of different NL-1000 intensity levels on mean percent bias and 95% limits of agreement. All data were analyzed using PASW Statistics 18.0 (SPSS Inc, Chicago, IL) and a P value of less than 0.05 to indicate statistical significance. Results Table 1 shows the descriptive statistics for the study sample. Based on data from the Actical accelerometers, participants accumulated approximately 30 min of MVPA and 6,000 steps over the duration of the monitoring period. MVPA was significantly lower for the NL-1000 when compared with the Actical estimates for all subgroups and intensity levels (p <.001 for all). There were no significant step count differences between devices for either girls or boys or across the whole sample. There were also no significant differences in age, total monitoring time, MVPA, or step count between boys and girls. The utility of the NL-1000 pedometer for measuring minutes of MVPA was assessed using multiple indices related to accuracy and precision (Table 2). For all subgroups, the NL-1000 significantly underestimated MVPA when compared with the Actical accelerometer. The poor level of agreement was also reflected in the lack of association between the two measures. Underestimation was only slightly lower (approximately 2 min or 8%) when the NL-1000 was set to level 3 when compared with level 4. The negative bias was 24.6% greater in boys than in girls at level 3, but 5.2% lower at level 4. The negative association between MVPA (Actical) and percent bias shows that the underestimation was greatest for participants who accumulated the most amount of MVPA during the measurement

Convergent Validity in Measuring Children s Physical Activity 403 Table 1 Descriptive Statistics for the Study Sample Boys (N = 51) Girls (N = 63) All (N = 114) Age (years) 8.4 ± 1.9 8.4 ± 1.8 8.4 ± 1.8 Total monitoring time (min) 310.5 ± 10.5 311.0 ± 11.0 310.7 ± 10.7 Actical MVPA (min) 31.8 ± 15.9 28.9 ± 13.7 30.2 ± 14.7 NL-1000 MVPA L3 13.0 ± 10.6 13.5 ± 6.7 13.3 ± 8.6 (min) 1 NL-1000 MVPA L4 13.3 ± 8.3 12.1 ± 8.0 12.6 ± 8.1 (min) 2 Actical step count 6,312 ± 2,779 5,885 ± 2,457 6,076 ± 2,603 NL-1000 step count 6,367 ± 2,346 5,951 ± 1,997 6,150 ± 2,162 Mean ± SD; MVPA, moderate to vigorous physical activity. 1 L3 = Intensity level 3 (Boys, N = 26; Girls, N = 32) 2 L4 = Intensity level 4 (Boys, N = 25; Girls, N = 31) period. The 95% limits of agreement were wide for all subgroups, indicating that the low accuracy of the NL-1000 units for measuring MVPA is compounded by low precision. Indeed, the loss of precision ranged from 127% in boys (level 4) to as high as 163% in girls (level 4). Figures 1 and 2 illustrate the percent bias and 95% limits of agreement associated with measuring MVPA with the NL-1000 pedometer at levels 3 and 4. The decreased accuracy when using level 4 rather than level 3 was accompanied by an increase in precision. Nonetheless, the overall performance at both levels was poor. The tendency for underestimation to increase with the total minutes of MVPA can also be clearly observed. For both intensity levels, percent bias decreased in a relatively linear fashion between approximately five and 30 min before stabilizing at MVPA levels greater than 30 min. Discussion The release of the NL-1000 pedometer has provided researchers and health practitioners with a practical and affordable means to obtain estimates of MVPA duration in large samples; however, the accuracy and precision of the estimates must be established before they can be confidently used in the field. Our results show that, on average, the NL-1000 underestimates MVPA by 37 45% in children aged 5 11 years when compared with Actical accelerometers. Given that the latter device provides accurate and reliable estimates of MVPA (9,14), these findings suggest that the NL-1000 misses a substantial proportion of children s MVPA. Furthermore, the associations between percent bias and MVPA suggest that the underestimation increases with the total amount of MVPA. Curiously, however, this negative trend was apparent in children who accumulated between five and 30 min of MVPA but not in their more active counterparts. It is possible that there

Table 2 Utility of NL-1000 Pedometers for Measuring Minutes of Moderate to Vigorous Physical Activity (MVPA) in Children Aged 5 11 Years Difference in ry,y b Mean MVPA (min) a percent bias (%) c Mean SD p d Proportion of under- and overestimation (%) ry, %bias e 95% limits of agreement (%) f Loss of precision (%) g Male Level 3-19.3 18.1 0.093-50.6 0.000 84.6/15.4-0.512 (p =.008) Level 4-18.0 18.6-0.021-42.0 0.000 80.0/20.0-0.722 (p <.001) Female -125.7, 24.5 134.6-125.5, 40.9 127.1 Level 3-14.1 16.8-0.175-26.0 0.000 75.0/25.0-0.788 (p <.001) Level 4-18.3 16.7-0.206-47.2 0.000 93.5/6.5-0.634 (p <.001) All -149.9, 97.9 138.0-143.6, 49.2 162.5 Level 3-16.4 17.4-0.022-37.0 0.000 79.3/20.7-0.676 (p <.001) Level 4-18.2 17.4-0.108-44.9 0.000 87.5/12.5-0.660 (p <.001) -143.8, 69.8 134.6-135.1, 45.3 142.0 a Difference in MVPA = NL-1000 MVPA Actical MVPA. b Correlation coefficient between Actical MVPA and NL-1000 MVPA. c Percent bias = ([NL1000 MVPA Actical MVPA]/Actical MVPA) x 100. d Probability that mean percent bias = 0. e Correlation coefficient between Actical MVPA and the percent bias. f 95% limits of agreement = mean percent bias ± 1.96 x percent bias SD. g Loss of precision = ([variance of NL-1000 MVPA Actical MVPA]/variance of Actical MVPA) x 100. h Underestimation/overestimation. 404

Convergent Validity in Measuring Children s Physical Activity 405 Figure 1 Bland-Altman plot showing percent bias of the NL-1000 pedometer (Level 3) for measuring minutes of moderate to vigorous physical activity (MVPA) in children aged 5 11 years. The solid line is the mean percent bias and the dashed lines are the 95% limits of agreement. are particular types of activities performed by more active children and not by less active children, and that these activities are somehow less likely to be detected by the NL-1000. The biphasic trend observed in our data could be explained if the prevalence of these hypothetical activities gradually increased from a minimum in inactive children to a maximum in children who were at least moderately active ( 30 min MVPA during the school day). In fact, it could be that the ability of the NL-1000 to detect activity reaches a maximum point beyond which any additional vigorous activity is not recorded. If more active children accumulate more vigorous activity, then it is likely the NL-1000 will perform better in inactive children. A recent study investigating the accuracy of step counts in a pedometer that uses the same internal mechanism as the NL-1000 (NL-800) supported the notion that

406 Duncan et al. Figure 2 Bland-Altman plot showing percent bias of the NL-1000 pedometer (Level 4) for measuring minutes of moderate to vigorous physical activity (MVPA) in children aged 5 11 years. The solid line is the mean percent bias and the dashed lines are the 95% limits of agreement. the mode of activity is an important determinant of pedometer accuracy (17). The latter authors observed significant underestimation of step counts (compared with a hand counter) when children were skipping, galloping, and sliding, with acceptable performance during walking and hopping. Such findings highlight the variable nature of the NL-1000 motion sensor. When compared with the Actical, the NL-1000 also showed a low level of precision when measuring MVPA in our sample. The wide 95% limits of agreement at intensity level 3 imply that the accelerometer-determined value of MVPA could be as much as 107% higher or lower than that recorded by a NL-1000 pedometer. For a child averaging 60 min of MVPA each day, the limits of agreement correspond to a potential error of ± 64 min. While these limits narrow slightly to ± 54 min when

Convergent Validity in Measuring Children s Physical Activity 407 intensity level 4 is used, both levels remain well beyond what would normally be considered a worthwhile detectable difference. It should be noted, however, that a larger sample would likely have resulted in narrower limits of agreement. It could be argued that the loss of precision statistic holds more relevance for population research, given that it defines the theoretical increase in sample size that would be required to offset the random error associated with the NL-1000 pedometer. Our data suggest that the sample size must be increased by 135% and 142% at levels 3 and 4 (respectively) to compensate for the use of NL-1000 pedometers instead of Actical accelerometers. Naturally, this estimate relates to precision only and does not offset the underestimation of MVPA by the NL-1000. If we assume that the Actical accelerometer provides an accurate estimate of MVPA, our results suggest that the NL-1000 is an unsuitable measure of MVPA in children when using intensity levels 3 or 4. It is likely, however, that lowering the threshold used to define MVPA in the NL-1000 would reduce the degree of underestimation. The manufacturer states that the intensity levels of 1 and 2 correspond to MET values of 1.8 and 2.3, respectively, placing them below the most commonly used definition of MVPA ( 3 MET). Our data suggest that, in reality, levels 1 and 2 may be nearer to 3 MET than levels 3 and 4 (estimated as 2.9 and 3.6 MET, respectively). Nonetheless, the relatively minor improvement in percent bias we observed when comparing level 4 with level 3 (1.8%) suggests that even level 1 would continue to underestimate MVPA by a substantial margin (approximately 13.6% assuming a linear relationship exists between estimated MET and percent bias). We also observed distinct sex differences in the relationship between intensity level and percent bias, such that level 3 performed better than level 4 in girls and vice versa in boys. This provides further support for the hypothesis that specific (in this case sex-related) activities are detected differently between the two devices, and raises the possibility that a threshold reduction in boys may not be worthwhile. Regardless, lowering the intensity threshold would not improve the low precision or negate the difference in percent bias at opposite ends of the MVPA distribution. We found it interesting that the NL-1000 pedometer was much better at detecting step counts than minutes of MVPA. Supplementary analysis (not shown) revealed that the number of steps collected by the NL-1000 was positively correlated with both step count and minutes of MVPA recorded by the Actical. Counting steps is clearly the primary purpose of the NL-1000, and we have previously established the accuracy of this function in children using a New Lifestyles pedometer with the same internal mechanism (6). The positive correlation between NL-1000 and Actical step counts and indeed between NL-1000 step counts and Actical MVPA rules out the possibility that variation in wear time or researcher error contributed to the differences in MVPA between devices. It appears that the piezoelectric strain gauge and/or proprietary algorithm used to detect and define movement in the NL-1000 pedometer is effective at classifying steps but not minutes of MVPA. It is possible this may be resolved by updates to the hardware or firmware of the NL-1000. This study represents the second investigation of the accuracy of the NL-1000 pedometer for measuring minutes of MVPA in children. The first such study compared the performance of the NL-1000 with a uniaxial accelerometer (Actigraph GT1M) for detecting older children s MVPA during a cross-country run, physical education, and classroom-based physical activities (12). The authors concluded that the MVPA data recorded by the NL-1000 at intensity level 3 ( 2.6 MET)

408 Duncan et al. were not meaningfully different from Actigraph estimates when using a 4 MET threshold (1,769 2,393 counts/minute, depending on age). These findings are clearly contrary to the results of the current study, which found the NL-1000 consistently underestimated MVPA when compared with Actical estimates. It is important to note, however, that McMinn et al. (12) reported significant underestimation when the NL-1000 was compared with the Actigraph at a 3 MET threshold (906 1,399 counts/min), the level generally used to define MVPA in children and adults. Thus, it is probable that differences in the thresholds used to define MVPA in the Actigraph and Actical accelerometers contributed to the substantial variation between studies. The equation used to define MVPA in our study was not based on a particular MET threshold but on a physical activity ratio (PAR) of three or greater, which corresponds to 1,500 counts per minute (15). The PAR index calculated as energy expenditure divided by basal metabolic rate is preferable to MET values in children given that the latter do not account for children s age-related decline in resting metabolic rate. A PAR of three is generally considered to represent the boundary between light and moderate physical activity in children (15). In any case, it is likely that our Actical threshold of PAR 3 corresponds to the MET 3 threshold used by McMinn et al. (12), both of which resulted in significant NL-1000 underestimation. Clearly, any judgment of the utility of the NL-1000 for detecting MVPA duration in children depends heavily on the threshold used to define MVPA in the comparison measure. We contend that a PAR 3 currently represents the most appropriate definition of MVPA in children. Disparity between the aforementioned studies may also have arisen from differences in the technical specifications of Actical and Actigraph accelerometers. The Actical has an omnidirectional sensor that can detect movement in multiple planes, whereas the Actigraph has a uniaxial sensor that measures movement in the vertical plane only. Furthermore, the Actical is sensitive to movements in the 0.5 3.0 Hz frequency range, while the Actigraph is sensitive to movements in the 0.25 2.5 Hz range. Previous studies have concluded that the physical activity data recorded by the two devices are not comparable (8,13). In fact, there is evidence that Actigraph counts attenuate at high intensity activities whereas Actical counts continue to increase (4,8). This observation is the another likely explanation of the differences between McMinn et al. (12) and the current study, which demonstrated a higher level of NL-1000 underestimation in the most active children. Put another way, if both the Actigraph and the NL-1000 underestimate MVPA at high intensities, then they will appear to be congruent and the NL-1000 underestimation may be missed. This is especially relevant given that McMinn et al. (12) tested children under high intensity conditions such as cross-country running and physical education. Comparing MVPA data collected from all three units (NL-1000, Actical, Actigraph) simultaneously may be the only way to test this hypothesis. The final notable source of difference between the current study and that described in McMinn et al. (12) are the epoch times selected for the Actical and Actigraph, respectively. The epoch refers to the duration of time over which the activity counts detected by the accelerometer are summed. This summed value is then entered into an equation to estimate the average physical activity intensity for the given epoch. In general, it is recommended to use as short an epoch as possible to reduce misclassification of intensity levels. This is particularly applicable to children, whose movement patterns are characterized by short, intermittent bursts

Convergent Validity in Measuring Children s Physical Activity 409 of activity (2). We chose the shortest possible Actical epoch of 15 s; McMinn et al. (12) were able to select one-second epochs for the Actigraph accelerometer. While the latter epoch is clearly preferable, it would not necessarily lead to the substantial differences in results observed between studies. As longer epochs tend to produce lower estimates of MVPA when compared with shorter epochs (11), it follows that the NL-1000 underestimation observed in our results would have been even greater had we been able to select one-second epochs for the Actical accelerometers. Similarly, it is probable that the four-second epoch featured in the NL-1000 pedometer at least partially counteracted the underestimation of MVPA when compared with Actical estimates based on a 15-s epoch. For these reasons it is unlikely that inconsistent epoch times are an important contributor to the observed differences between studies. In summary, the development of the NL-1000 pedometer has provided researchers and health practitioners with an inexpensive means to measure physical activity in a unit that aligns with current time-based physical activity recommendations. Compared with a validated omnidirectional accelerometer, however, the NL-1000 significantly underestimates the total minutes of MVPA accumulated by 5 11-yearold children during a normal school day. In addition, the NL-1000 displayed a low level of precision overall and a nonlinear association between percent bias and MVPA. We therefore conclude that the NL-1000 pedometer does not provide a satisfactory estimate of MVPA duration in children. References 1. Ainsworth, B.E., W.L. Haskell, M.C. Whitt, et al. Compendium of physical activities: an update of activity codes and MET intensities. Med. Sci. Sports Exerc. 32:S498 S504, 2000. 2. Bailey, R.C., J. Olson, S.L. Pepper, J. Porszasz, T.J. Barstow, and D.M. Cooper. The level and tempo of children s physical activities: an observational study. Med. Sci. Sports Exerc. 27:1033 1041, 1995. 3. Biddle, S.J., T. Gorely, and D.J. Stensel. Health-enhancing physical activity and sedentary behaviour in children and adolescents. J Sports Sci. 22:679 701, 2004. 4. Crouter, S.E., and D.R. Bassett. Comparison of accelerometer counts between the ActiGraph and Actical during structured field activities [abstract]. Med. Sci. Sports Exerc. 39:179, 2007. 5. Duncan, J.S., G. Schofield, and E.K. Duncan. Step count recommendations for children based on body fat. Prev. Med. 44:42 44, 2007. 6. Duncan, J.S., G. Schofield, E.K. Duncan, and E.A. Hinckson. Effects of age, walking speed, and body composition on pedometer accuracy in children. Res. Q. Exerc. Sport. 78:420 428, 2007. 7. Esliger, D.W., A. Probert, S.C. Gorber, S. Bryan, M. Laviolette, and M.S. Tremblay. Validity of the Actical accelerometer step-count function. Med. Sci. Sports Exerc. 39:1200 1204, 2007. 8. Esliger, D.W., and M.S. Tremblay. Technical reliability assessment of three accelerometer models in a mechanical setup. Med. Sci. Sports Exerc. 38:2173 2181, 2006. 9. Freedson, P., D. Pober, and K.F. Janz. Calibration of accelerometer output for children. Med. Sci. Sports Exerc. 37:S523 S530, 2005. 10. Janssen, I., and A.G. Leblanc. Systematic review of the health benefits of physical activity and fitness in school-aged children and youth. Int. J. Behav. Nutr. Phys. Act. 7:40, 2010.

410 Duncan et al. 11. McClain, J.J., T.L. Abraham, T.A. Brusseau, Jr., and C. Tudor-Locke. Epoch length and accelerometer outputs in children: comparison to direct observation. Med. Sci. Sports Exerc. 40:2080 2087, 2008. 12. McMinn, D., D.A. Rowe, M. Stark, and L. Nicol. Validity of the New Lifestyles NL-1000 accelerometer for measuring time spent in moderate-to-vigorous physical activity in school settings. Meas. Phys. Educ. Exerc. Sci. 14:67 78, 2010. 13. Paul, D.R., M. Kramer, A.J. Moshfegh, D.J. Baer, and W.V. Rumpler. Comparison of two different physical activity monitors. BMC Med. Res. Methodol. 7:26, 2007. 14. Pfeiffer, K.A., K.L. McIver, M. Dowda, M.J. Almeida, and R.R. Pate. Validation and calibration of the Actical accelerometer in preschool children. Med. Sci. Sports Exerc. 38:152 157, 2006. 15. Puyau, M.R., A.L. Adolph, F.A. Vohra, I. Zakeri, and N.F. Butte. Prediction of activity energy expenditure using accelerometers in children. Med. Sci. Sports Exerc. 36:1625 1631, 2004. 16. Reilly, J.J., V. Penpraze, J. Hislop, G. Davies, S. Grant, and J.Y. Paton. Objective measurement of physical activity and sedentary behaviour: review with new data. Arch. Dis. Child. 93:614 619, 2008. 17. Smith, J.D., and C.A. Schroeder. Pedometer accuracy in elementary school children while walking, skipping, galloping, and sliding. Meas. Phys. Educ. Exerc. Sci. 14:92 103, 2010. 18. Sothern, M.S., M. Loftin, R.M. Suskind, J.N. Udall, and U. Blecker. The health benefits of physical activity in children and adolescents: implications for chronic disease prevention. Eur. J. Pediatr. 158:271 274, 1999. 19. Tudor-Locke, C., R.P. Pangrazi, C.B. Corbin, et al. BMI-referenced standards for recommended pedometer-determined steps/day in children. Prev. Med. 38:857 864, 2004.