BioMed Research International

Volume 2014 (2014), Article ID 348659, 11 pages

http://dx.doi.org/10.1155/2014/348659

Research Article

Accuracy and Repeatability of the Gait Analysis by the WalkinSense System

Marcelo P. de Castro,1,2,3 Marco Meucci,⁴ Denise P. Soares,1,3 Pedro Fonseca,³ Márcio Borgonovo-Santos,1,3 Filipa Sousa,1,3 Leandro Machado,1,3 and João Paulo Vilas-Boas1,3

¹Centre of Research, Education, Innovation and Intervention in Sport, Faculty of Sports, University of Porto, Rua Dr. Plácido Costa 91, 4200 450 Porto, Portugal

²Department of Physiotherapy, Activity and Human Movement Study Centre, School of Allied Health Science, Polytechnic Institute of Porto, Rua Valente Perfeito 322, 4400-330 Vila Nova de Gaia, Portugal

³Porto Biomechanics Laboratory, University of Porto, Rua Dr. Plácido Costa 91, 4200 450 Porto, Portugal

⁴University of Rome “Foro Italico,” Piazza Lauro de Bosis 6, 00135 Roma, Italy

Received 25 October 2013; Revised 12 January 2014; Accepted 13 January 2014; Published 20 February 2014

Academic Editor: P. J. Oefner

Copyright © 2014 Marcelo P. de Castro et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

WalkinSense is a new device designed to monitor walking. The aim of this study was to measure the accuracy and repeatability of the gait analysis performed by the WalkinSense system. Descriptions of values recorded by WalkinSense depicting typical gait in adults are also presented. A bench experiment using the Trublu calibration device was conducted to statically test the WalkinSense. Following this, a dynamic test was carried out overlapping the WalkinSense and the Pedar insoles in 40 healthy participants during walking. Pressure peak, pressure peak time, pressure-time integral, and mean pressure at eight-foot regions were calculated. In the bench experiments, the repeatability (i) among the WalkinSense sensors (within), (ii) between two WalkinSense devices, and (iii) between the WalkinSense and the Trublu devices was excellent. In the dynamic tests, the repeatability of the WalkinSense (i) between stances in the same trial (within-trial) and (ii) between trials was also excellent (ICC > 0.90). When the eight-foot regions were analyzed separately, the within-trial and between-trials repeatability was good-to-excellent in 88% (ICC > 0.80) of the data and fair in 11%. In short, the data suggest that the WalkinSense has good-to-excellent levels of accuracy and repeatability for plantar pressure variables.

1. Introduction

During human locomotion the foot acts passively, cushioning the impact forces, and actively, transferring the forces generated by the muscles to propel the body [1]. Thus, it is important to know the magnitude and behavior of ground reaction forces to prevent and treat injuries as well as to enhance human performance in sport. Biomechanical gait analysis is commonly performed by force plates that use three-dimensional force transducers to measure the three components (medial-lateral, anterior-posterior, and vertical) of ground reaction forces and torques [1]. For this reason, force plates are of enormous value for assessing human activity, such as walking, running, or jumping. However, this instrument does not directly provide any information about where these forces are being applied along the plantar surface of the foot. For this reason, new plantar pressure systems for quantitative gait force analysis have become increasingly popular.

The first documented described plantar pressure system, which was based on an air-filled chamber, was developed in the 19th century [2]. This method of measurement evolved to deformable materials that provided an ink impression or used optical methods for recording data [1]. At present, a wide range of systems that use electromechanical sensors allow for a more reliable plantar pressure evaluation. Among these, the capacitive, resistive, and piezoresistive sensors are the most frequently used for foot plantar pressure analysis. When compressed, they calculate the variations of the applied load, measuring the proportional change in voltage, conductance, or resistance, respectively [3–5]. These sensors can be used as either matrix measurements or discrete measurements [5]. Matrix measurements are made by arrays of sensors in the configuration of pressure plates for barefoot or in-shoe analyses that record the plantar pressure along the entire foot. Discrete measurements are performed using individual sensors (commonly up to eight sensors) placed at specific locations on the plantar foot surface (usually in-shoe). Compared to matrix measurements, discrete measurements are less complex but require an a priori decision about the regions of interest [5].

In-shoe plantar pressure systems (used to perform either discrete or matrix measurements) have been widely used by researchers and clinicians in the fields of clinical rehabilitation [6–8], ergonomics [9–11], and sport activities [12, 13]. Such systems allow monitoring of pressure in the interface between the plantar surface of the foot and the insole of a shoe during either static or dynamic activities, allowing measurements in real conditions without the limits of laboratorial setup [14, 15]. The operating principle behind each in-shoe system is generally the same: these systems use different sensors/insoles to collect and send pressure values to a hub, usually attached to the lateral malleolus or pelvic girdle, which records data in a memory card or transfers them in real-time to a computer by cable, Bluetooth, or other wireless means.

Before using a new device, validation studies against gold-standard instruments are conducted to determine the accuracy and repeatability of the system [14]. Accuracy is defined as the difference between the value of a known quantity and the value measured by the tested device [9, 16]. This device attribute is also referred to in the literature as “validity” [17, 18]. In the gait analysis field, calibration benches or systems considered to be gold standards are used to determine how accurate or valid the tested devices are. Another very important device feature is its repeatability, which is defined as the difference between two or more measurements performed by the same instrument under identical testing conditions [16, 19–21]. In gait studies of measurement error, many authors have also used the term “reliability” to refer to this feature [18, 20, 22–26]. In some studies the terms “repeatability” and “reliability” have been used indiscriminately [20, 21, 25]. In a repeatability study, variability in measurements made on the same subject can be ascribed only to errors in the measurement process itself. When gait analysis devices are assessed, the repeatability between stance phases (within-trial repeatability), between trials (between-trial repeatability), and between days (between-day repeatability) is commonly analyzed. One of the in-shoe plantar pressure devices most frequently used by clinicians and researchers is the Pedar in-shoe system (Novel GmbH, Munich, Germany). This system has been demonstrated to be accurate [9] and has shown excellent between-trial [15] and between-day [20, 26] repeatability. The knowledge of such device attributes (accuracy and repeatability) is of utmost importance before using it in clinical contexts.

WalkinSense (Kinematix SA, formerly Tomorrow Options, Sheffield, UK) is a user-friendly device designed for in-shoe monitoring and long-term storage of plantar pressure and spatial-temporal parameters during locomotion, such as gait speed, distance traveled, and stride length and frequency, without the need for a standardized calibration and the constraints of a laboratorial setup. One preliminary study [27] has already explored the repeatability of the plantar pressures recorded by the WalkinSense. The system was found to be as repeatable as other plantar pressure measurement systems (i.e., F-scan and Pedar). However, the authors assessed only three subjects and no statistical procedure was performed. The authors [27] highlighted the need for further investigations to truly understand how accurate and repeatable the plantar pressures measured by WalkinSense are. Another preliminary study assessed the spatial-temporal parameters of the WalkinSense [28] in a small sample of 15 participants and found good accuracy and repeatability for these parameters.

In short, there is very little information about how accurate the plantar pressures acquired by WalkinSense are, and it is not clear how repeatable the acquisition of these parameters is. This lack of information becomes a barrier for using the device in research and clinical contexts. Thus, the aim of this study was to measure the accuracy and repeatability of the gait analysis performed by the WalkinSense system. Values recorded by WalkinSense measuring typical gait in an adult population are also presented. We hypothesized that the plantar pressure parameters recorded by WalkinSense would be accurate and repeatable.

2. Methods

2.1. Participants

Forty volunteering university students (20 males and 20 females, with mean age of 21.6 ± 3.4, weight 67.2 ± 11.6 kg, and height 170.6 ± 0.9 cm) were recruited. All subjects were healthy and capable of ambulating independently. The exclusion criteria were any pain or difficulty with independent gait, disabilities that could affect natural gait (musculoskeletal, visual, or hearing impairments), and necessity of walking aids. This study was approved by the local ethical committee, and all participants freely gave their written consent to participate after being informed about the study procedures.

2.2. Equipment and Data Collection

The WalkinSense (weight: 68 g, length: 78 mm, width: 48 mm, and thickness: 18 mm) is a CE mark Class I electronic medical device designed to dynamically monitor human lower limb activity (Figure 1(a)). The device contains a micro-electromechanical system (MEMS) triaxial accelerometer and one gyroscope and is connected to a net of eight force-sensing piezoresistors (weight: 5 g, size: 1.8 cm²) used for foot pressure measurements, which can be freely positioned under or over any insole. This device operates at a sampling frequency of 100 Hz in two modes: offline mode, where data are stored to an SD memory card, and real-time mode, where data are communicated to a PC through Bluetooth technology.

(a)

(b)

Figure 1: (a) WalkinSense and Pedar attached on one of the participants during data collection. (b) Experimental setup of the bench experiment: (&) position of the eight WalkinSense sensors on (*) the Pedar insoles prior to insertion in (#) the Trublu calibration device.

Data collection was carried out into two phases: first, a gold-standard bench-testing comparison was conducted with the WalkinSense and the Trublu calibration device; second, a dynamic experimental test compared the WalkinSense with the Pedar during gait.

2.2.1. Bench Experiment (Trublu)

During the bench testing two WalkinSense devices were assessed. Each one of the eight sensors of the WalkinSense nets were randomly positioned under an insole with 2 mm of thickness (provided by the manufacturer) and attached by adhesive Velcro straps. Next, the insoles were positioned into the Trublu, in which ten levels of pressure were sequentially applied during 10 seconds on each one: 0.00, 23.54, 49.03, 73.55, 99.05, 146.12, 199.07, 294.20, 391.29, and 492.29 kPa. Following this, the WalkinSense and the Pedar were assessed together (the WalkinSense nets were positioned under the Pedar insoles, Figure 1(b)), only to determine whether the two systems would work well jointly.

2.2.2. Dynamic Experiment

For the dynamic experiment, the Pedar system (weight: 400 g, length: 150 mm, width: 100 mm, and thickness: 40 mm) was used. The Pedar records in-shoe plantar pressures through 99 capacitive pressure-sensitive sensors with an area of ≅1.5 cm² (depending on the size of the insole) and a sampling frequency of 100 Hz.

The dynamic experimental protocol consisted of recording the plantar pressure during gait simultaneously, with the WalkinSense and the Pedar overlapped. Thus, we warranted that both systems were measuring exactly the same event. The bench tests suggested that there is no interference between the systems and they work well jointly. Before data collection, the Pedar insoles were checked by the Trublu calibration device in order to verify the performance of all sensors. The eight sensors of the WalkinSense were positioned under the Pedar insole (Figure 2) in correspondence with the main-reference foot areas, as proposed by and adapted from other studies [7, 10].

Figure 2: Position of the WalkinSense sensors at the Pedar insole.

The centroid for positioning each of the WalkinSense sensors on the Pedar insole was manually identified by pressing a stick with the same area of the sensor on the insole corresponding to the selected regions. The activity of the Pedar sensors was controlled on a computer screen, and when only the aimed sensor was active, the region was marked. Following this, the WalkinSense sensors were attached to the insole using adhesive Velcro straps. This procedure was repeated for all pairs of Pedar insoles. The insoles were put into a neutral pair of shoes (ballet sneakers). Then, the participants stood in an upright position and their weight and height were recorded by a force plate (Bertec Corporation, Columbus, OH, USA) and a stadiometer (Seca, Birmingham, United Kingdom). The participants familiarized themselves with the experimental setup by walking freely over a 12-meter walkway at a pace of 100 steps per minute marked by electronic metronome software (Metronome Beat, Andy Stone). Following the familiarization, participants performed a variable number of trials, and three valid ones were used for further analysis. In each trial, about 12 steps were recorded and only the central four stance phases (two with each foot) were used in the statistical analysis. This procedure was adopted to avoid the effects of acceleration in the movement.

2.3. Data Analysis

Data from the Pedar were recorded by the Pedar-X software (Novel GmbH, Munich, Germany) and data from the WalkinSense using the WalkinSense software (Kinematix SA, Sheffield, UK). The sensor pressure values from both systems were exported and then analyzed by MATLAB 7.0 software (MathWorks, Massachusetts, USA) through an appropriate program for data processing and variable calculation. Each step of all trials was considered as one sample during the statistical analysis to avoid hiding differences between the instruments and within or between trials that could be caused by averaged values.

2.3.1. Bench Experiment

At each of the ten load levels applied by the Trublu, we analyzed the 100 central frames (from 1000 recorded frames—10 seconds of data recording) taken from the two WalkinSense systems. The loads applied by the Trublu were also recorded for later use as reference values to calculate the accuracy of the WalkinSense systems.

2.3.2. Dynamic Experiment

The following anatomical regions were studied: great toe (GToe); medial, central, and lateral forefoot (, , and , resp.); medial and lateral midfoot ( and , resp.); and medial and lateral rearfoot ( and , resp.). For each WalkinSense sensor and the respective Pedar sensor, four dependent variables were calculated: peak pressure (, in kPa), defined as the highest value displayed by the sensor along the stance phase; peak pressure time (, in % of the stance phase), defined as the instant correspondent to the ; mean pressure (, in kPa), defined as the mean pressure during the stance phase; and the pressure-time integral (, in kPa s), defined as the integral along the stance phase.

The gait analysis conducted used the mid-gait method, as this method aptly represents a normal walk [29], and three trials were performed in order to provide a consistent mean [30]. Subjects wore standardized shoes and adopted a controlled gait cadence, since footwear and walking speed have been shown to influence plantar pressures during gait [31]. Gender differences were not considered, as a previous article reported no gender influence on and parameters [32].

2.4. Statistical Analysis

Statistical analysis was performed using SPSS statistics v.20 software (IBM SPSS, Chicago, USA) and Statistica v.8 software (Statsoft, Tulsa, USA). We considered the Two-Way Mixed Model (Type: consistency) intraclass correlation coefficient (ICC) ≤0.69 as poor, 0.70–0.79 as fair, 0.80–0.89 as good, and ≥0.90 as excellent [33]. All ICCs were calculated intraexaminers. The 95% confidence intervals (CI95%) were calculated with the ICC and the absolute and percentage differences to verify the uncertainty of these differences [34].

2.4.1. Bench Experiment

(1) Repeatability. The within-WalkinSense (sensor versus sensor from the same WalkinSense net) and between-WalkinSense (8 sensors versus 8 sensors from two WalkinSense systems) repeatability was verified by the ICC.

(2) Accuracy. The relation (accuracy) between the applied load (Trublu) and WalkinSense was verified by the (i) ICC, (ii) Pearson correlation coefficient, and (iii) absolute (Trublu − WalkinSense) and percentage [(Trublu − WalkinSense) × 100/Trublu] difference analyses. Negative values indicate that the WalkinSense showed values higher than the Trublu, while positive values indicate that the WalkinSense showed values lower than the Trublu.

2.4.2. Dynamic Experiments

(1) Repeatability. The overall (considering all regions together) and regional within-trial (first right step versus second right step and first left step versus second left step) and between-trial (four steps from the first trial versus second trial versus third trial) repeatability of the WalkinSense was verified by the ICC.

(2) Accuracy. The relation (accuracy) between the WalkinSense and the Pedar records was verified by (i) the ICC (overall and regional), (ii) the overall Person correlation coefficient, and (iii) the overall and regional absolute (Pedar − WalkinSense) and percentage [(Pedar − WalkinSense) × 100/Pedar] difference analyses. Negative values indicate that the WalkinSense showed values higher than the Pedar, while positive values indicate that the WalkinSense showed values lower than the Pedar.

(3) Description of Values. The descriptive statistics include mean and standard deviation for each parameter of the WalkinSense and the Pedar for each foot region.

3. Results

3.1. Bench Experiment

3.1.1. Repeatability

The within-WalkinSense ICC was 0.999 (CI95% 0.998 to 0.999) (Figure 3) and the between-WalkinSense ICC was 0.993 (CI95% 0.990 to 0.995).

Figure 3: Bench experiment: relation between the applied loads and WalkinSense records at the 10 levels of load. ICC: intraclass correlation coefficient. At the second and third column of the table, positive values indicate greater values in the WalkinSense system and negative values indicate lower values in the WalkinSense.

3.1.2. Accuracy

An excellent ICC and high and statistically significant () level of correlation between the applied loads (Trublu) and WalkinSense records were observed (Figure 3). The absolute differences ranged from −7.88 to 12.81 kPa along the different applied loads. The percentage differences were lower than 9% for nine out of the ten loads applied. At the first load applied (25.54 kPa), the WalkinSense showed pressure values 33.48% lower than the bench. The heaviest applied loads (>294 kPa) showed the smallest differences (<2%).

3.2. Dynamic Experiments

3.2.1. Repeatability

Excellent overall within-trial and between-trial repeatability was found in the four dependent variables, and all of the ICC CIs95% were smaller than 0.02 (Table 1).

Table 1: WalkinSense overall (all regions together) within- and between-trials intraclass correlation coefficients (ICC) for all measurements during gait.

Variables
Within-trial
Between-trial

ICC
CI95%
ICC
CI95%

0.972
0.969
0.975
0.979
0.977
0.981

0.987
0.986
0.988
0.915
0.904
0.925

0.940
0.933
0.946
0.993
0.992
0.994

0.938
0.931
0.944
0.965
0.960
0.969

: peak pressure; : pressure time; : mean pressure; : pressure-time integral.

The regional within-trial and between-trial ICCs for the were excellent in four (, , FFCt, and GToe), good in two (FFLat and FFMed), and fair in one (MFLat) out of the seven analyzed regions (Table 2). For the , the regional within-trial ICCs were excellent (GToe), good (FFLat), and poor (MFLat) in one region each and fair in four regions; and the between-trial ICCs were good in five regions and excellent (GToe) and fair (MFLat) in one region each. All within-trial and between-trial ICCs for and were good or excellent (Table 2).

Table 2: WalkinSense regional within- and between-trial intraclass correlation coefficients (ICC) during gait.

Variable
Region
Within-trial
Between-trial

ICC
CI95%
ICC
CI95%

Peak pressure
RFLat
0.978
0.971
0.983
0.971
0.961
0.979

RFMed
0.964
0.953
0.973
0.961
0.948
0.972

MFLat
0.763
0.688
0.821
0.794
0.713
0.855

MFMed
&
&
&
&
&
&

FFLat
0.868
0.826
0.900
0.896
0.858
0.926

FFCt
0.949
0.932
0.961
0.956
0.940
0.968

FFMed
0.834
0.779
0.875
0.858
0.802
0.900

GToe
0.928
0.905
0.946
0.966
0.954
0.976

Peak pressure time
RFLat
0.718
0.630
0.785
0.859
0.808
0.897

RFMed
0.763
0.684
0.823
0.826
0.758
0.877

MFLat
0.665
0.554
0.749
0.763
0.669
0.834

MFMed
&
&
&
&
&
&

FFLat
0.873
0.831
0.904
0.857
0.801
0.900

FFCt
0.786
0.717
0.838
0.808
0.736
0.863

FFMed
0.748
0.664
0.811
0.843
0.780
0.891

GToe
0.900
0.867
0.924
0.946
0.926
0.962

Pressure-time integral
RFLat
0.959
0.946
0.969
0.960
0.946
0.971

RFMed
0.908
0.879
0.930
0.928
0.901
0.948

MFLat
0.848
0.798
0.885
0.873
0.825
0.910

MFMed
&
&
&
&
&
&

FFLat
0.890
0.855
0.917
0.912
0.879
0.937

FFCt
0.960
0.948
0.970
0.965
0.953
0.975

FFMed
0.810
0.746
0.857
0.835
0.769
0.885

GToe
0.882
0.843
0.911
0.915
0.882
0.939

Mean pressure
RFLat
0.965
0.955
0.974
0.961
0.947
0.972

RFMed
0.903
0.871
0.926
0.928
0.902
0.949

MFLat
0.817
0.758
0.862
0.867
0.814
0.906

MFMed
&
&
&
&
&
&

FFLat
0.884
0.847
0.912
0.915
0.883
0.939

FFCt
0.959
0.947
0.969
0.962
0.948
0.973

FFMed
0.816
0.755
0.862
0.840
0.774
0.889

GToe
0.890
0.853
0.917
0.916
0.885
0.941

RFLat: lateral rearfoot; RFMed: medial rearfoot; MFLat: lateral midfoot; MFMed: medial midfoot; FFLat: lateral forefoot; FFCt: central forefoot; MFMed: medial forefoot; GToe: great toe; CI95%: 95% confidence interval. &: as the midfoot region was loaded only in ≅5% of the trials, the percentage difference and ICC were not calculated for this region.

3.2.2. Accuracy

Analyzing all regions together (overall), the WalkinSense showed lower values for (6.2%), (14.1%), and (13.2%) compared to the Pedar. The occurred slightly later (3.3%) in the WalkinSense compared to the Pedar (Table 3). The overall ICCs (WalkinSense versus Pedar) were higher than 0.95 for all variables (Table 3). The Pearson coefficient indicated correlations statistically significant for all variables (Table 3).

Table 3: Percentage difference, intraclass correlation coefficient (ICC), and Pearson correlation coefficient (CC) between Pedar and WalkinSense during gait.

Percentage differences (%)
ICC
Pearson CC

Average difference
CI95%
ICC
CI95%

−6.2
−6.8
−5.6
0.973
0.971
0.975
0.869
<0.001

3.4
3.1
3.6
0.997
0.997
0.997
0.973
<0.001

−14.1
−14.9
−13.2
0.955
0.952
0.958
0.872
<0.001

−13.2
−14.1
−12.4
0.956
0.953
0.959
0.872
<0.001

: peak pressure; : pressure time; : mean pressure; : pressure-time integral.

The regional percentage differences between the systems for ranged from 3.6% at the RFMed to 16.4% at the MFLat. The percentage differences for the were similar among the regions, ranging from 2.3% to 4.3%. In the and , the highest differences were observed at the MFLat (≅30% for both and ) and the lowest differences in the RFMed (7.7% for and 6.3% for ) (Table 4).

Table 4: Percentage differences and intraclass correlation coefficient (ICC) between Pedar and WalkinSense for each foot region during gait.

Variable
Region
Percentage differences (%)
ICC
CI95%

Average difference
CI95%

Peak pressure
RFLat
−10.8
−12.4
−9.1
0.859
0.827
0.885

RFMed
−3.6
−5.0
−2.2
0.958
0.949
0.965

MFLat
−16.4
−18.1
−14.6
0.963
0.954
0.971

MFMed
&
&
&
&
&
&

FFLat
−15.2
−16.7
−13.7
0.936
0.922
0.947

FFCt
−5.4
−6.9
−3.9
0.953
0.942
0.961

FFMed
10.4
8.5
12.4
0.945
0.932
0.956

GToe
−7.9
−9.8
−6.1
0.953
0.942
0.961

Peak pressure time
RFLat
4.3
3.1
5.5
0.974
0.967
0.980

RFMed
3.4
2.2
4.5
0.982
0.977
0.985

MFLat
3.6
2.9
4.3
0.983
0.980
0.986

MFMed
&
&
&
&
&
&

FFLat
3.7
3.3
4.1
0.964
0.956
0.971

FFCt
2.3
1.9
2.7
0.839
0.803
0.868

FFMed
3.0
2.6
3.5
0.944
0.931
0.954

GToe
3.5
3.1
3.8
0.938
0.923
0.949

Pressure-time integral
RFLat
−18.4
−20.7
−16.2
0.907
0.888
0.923

RFMed
−7.7
−9.6
−5.8
0.949
0.937
0.958

MFLat
−31.2
−33.7
−28.8
0.937
0.923
0.948

MFMed
&
&
&
&
&
&

FFLat
−24.7
−26.6
−22.8
0.915
0.897
0.929

FFCt
8.4
6.4
10.4
0.923
0.907
0.937

FFMed
−12.2
−13.8
−10.6
0.961
0.952
0.968

GToe
−14.0
−15.8
−12.2
0.959
0.950
0.966

Mean pressure
RFLat
−17.5
−19.8
−15.2
0.915
0.897
0.930

RFMed
−6.3
−8.1
−4.4
0.947
0.936
0.957

MFLat
−30.1
−32.6
−27.7
0.942
0.927
0.953

MFMed
&
&
&
&
&
&

FFLat
−23.7
−25.6
−21.8
0.913
0.895
0.929

FFCt
9.8
7.8
11.8
0.949
0.937
0.959

FFMed
−11.0
−12.6
−9.4
0.959
0.950
0.967

GToe
−13.3
−15.1
−11.4
0.970
0.963
0.975

RFLat: lateral rearfoot; RFMed: medial rearfoot; MFLat: lateral midfoot; MFMed: medial midfoot; FFLat: lateral forefoot; FFCt: central forefoot; MFMed: medial forefoot; GToe: great toe; CI95%: 95% confidence interval. &: as the midfoot region was loaded only in ≅5% of the trials, the percentage difference and ICC were not calculated for this region.

In seven out of the eight regions, lower values were observed in the WalkinSense (negative percentage differences) for the , , and variables. Only at the FFCt did the WalkinSense show higher values than the Pedar. The range of the CIs95% of the percentage differences for the was ≅3.5%; for the , it was ≅1.5%; and for the and , it was ≅4.5% (Table 4).

Twenty-six out of the 28 regional ICCs (Pedar and WalkinSense) were greater than 0.9, and their 95% confidence interval ranged between 0.2 and 0.35. The remaining two ICCs (out of the 28) were 0.86 for the at the RFLat and 0.84 for the at the FFCt.

3.2.3. Description of Values

Both systems showed the highest and lowest , , and values at the FFCt and MFMed, respectively. Also, the earliest and latest occurred at the same regions in both systems (RFLat and GToe, resp.) (Table 5).

Table 5: Description of values for the WalkinSense and Pedar during gait.

Variable
Region
Pedar
WalkinSense

Mean
SD
Mean
SD

Peak pressure (kPa)
RFLat
291.0
73.0
257.2
71.6

RFMed
285.3
95.8
274.7
96.3

MFLat
80.8
35.0
67.8
34.2

MFMed
0.8
6.4
0.3
2.7

FFLat
250.0
86.7
211.9
80.8

FFCt
302.9
104.1
330.7
110.8

FFMed
257.0
88.8
242.4
86.9

GToe
247.0
121.7
224.2
111.9

Peak pressure time (%Stance)
RFLat
16.2
5.1
16.9
5.4

RFMed
17.8
6.5
18.4
6.8

MFLat
48.2
11.5
49.6
11.3

MFMed
26.7
8.7
33.5
13.3

FFLat
71.0
7.4
73.6
7.4

FFCt
76.9
4.1
78.6
3.6

FFMed
72.3
6.7
74.3
6.4

GToe
80.6
6.0
83.3
5.6

Pressure-time integral (kPa·s)
RFLat
70.5
26.6
58.1
27.8

RFMed
70.7
27.0
65.6
28.9

MFLat
25.8
10.6
18.3
11.0

MFMed
0.4
1.6
0.0
0.4

FFLat
82.5
26.0
63.5
27.9

FFCt
84.1
30.7
90.7
35.2

FFMed
78.4
28.3
69.9
30.3

GToe
57.7
32.9
50.4
32.0

Mean pressure (kPa)
RFLat
94.5
33.0
79.1
36.3

RFMed
96.2
37.1
90.4
39.5

MFLat
34.5
14.4
24.7
14.3

MFMed
0.5
2.3
0.1
0.7

FFLat
111.5
33.2
86.5
36.1

FFCt
112.9
39.4
123.2
44.9

FFMed
106.1
37.4
95.7
40.4

GToe
78.3
43.5
69.0
42.8

RFLat: lateral rearfoot; RFMed: medial rearfoot; MFLat: lateral midfoot; MFMed: medial midfoot; FFLat: lateral forefoot; FFCt: central forefoot; MFMed: medial forefoot; GToe: great toe; CI95%: 95% confidence interval; SD: standard deviation.

In most trials of both systems, there was no pressure at the MFMed. In 472 out of 480 of the WalkinSense stance phases analyzed (four stance phases × three trails × 40 participants) and 436 out of 480 of the Pedar stance phases, the MFMed was not loaded. The four highest values for (WalkinSense: 42.2, 32.4, 16.7, and 12.7 kPa; Pedar: 77.5, 62.5, 57.5, and 52.2 kPa), (WalkinSense: 6.2, 4.8, 2.5, and 0.8 kPa s; Pedar: 15.6, 13.0, 12.7, and 9.1 kPa s), and (WalkinSense: 10.9, 9.7, 4.3, and 1.4 kPa; Pedar: 21.7, 19.1, 18.1, and 13.2 kPa) occurred at the same trials in both systems.

4. Discussion

The present study aimed to measure the accuracy, repeatability, and description of values of the plantar pressure parameters of the WalkinSense system. For this purpose, two experiments were carried out: a bench experiment, in which the WalkinSense records were compared to a gold-standard bench test (Trublu), and a dynamic experiment, in which the WalkinSense was compared to one of the most commonly used in-shoe plantar pressure systems (Pedar) in gait analyses. While the majority of the measurement error studies only assess the repeatability or accuracy of the devices using static-bench [9, 17, 35] or dynamic [19–26, 36] experiments separately, the present study focused on a wider approach for statically and dynamically assessing the accuracy and repeatability of a device.

4.1. Bench Experiment

Our first aim was to assess repeatability of the eight WalkinSense sensors from a single net as well as the repeatability of a couple of nets. Secondly, we wanted to verify the accuracy of the measurements when compared to a gold-standard device. Results show an excellent repeatability (ICC > 0.999) of the measurements for both the single net and pair of nets, together with an excellent overall repeatability and a high Pearson correlation coefficient between the WalkinSense and Trublu systems. However, further analysis reported that the absolute and the percentage differences varied with the applied loads. In fact, the highest percentage differences, −33% and −7%, were observed at the lowest pressures, 24 and 49 kPa, applied. Hsiao et al. [9] reported similar results in a previous study where the accuracy of the Pedar and F-scan (Tekscan, South Boston, USA) systems were analyzed by bench tests. They found a low accuracy at the lowest pressures in both systems and a gradual reduction of the percentage difference at the higher loads. The Pedar showed percentage differences between −57.2% and 1.3% when pressures between 12 and 59 kPa were applied; the F-scan reported a similar trend with percentage differences between 19.4% and 27.9% for loads between 5 and 41 kPa [9]. In our study, on the other hand, we observed the lowest percentage differences, equal to 0.4% and 0.2%, at the highest load magnitudes (≅300 and 500 kPa). In the same way, when the Pedar and F-scan systems were loaded with 300 and 500 kPa by Hsiao et al. [9], low differences, equal to 5.2% and 3.6% and 1.2% and −11%, respectively, were observed. As the thickness of the contact surface in which the sensors are placed decreases their sensitivity at low-pressure ranges (from 10 to 80 kPa) [37], the insole in which the WalkinSense sensors were placed, with its 2 mm thickness, may play an important role in explaining these higher percentage differences found at the lowest applied pressures.

4.2. Dynamic Experiment

Excellent overall within- and between-trial repeatability was found for all dependent variables (, , , and ) in this study. However, the ICCs varied among regions. For both and , six out of the seven regions (disregarding the MFMed, which was not analyzed) reported a good-to-excellent repeatability, while only one, the MFLat, reported fair values. Similarly, in a study by Kernozec et al. [20], where the repeatability of the Pedar system was assessed by the coefficient of variation, different results were obtained among the regions. As in our study, the authors [20] also found the midfoot (which was considered as a unique region) to be one of the least repeatable regions. In another study in which the between-day repeatability of a pressure plate (EMED) was assessed in ten-foot regions, Gurney et al. [24] reported that the repeatability was poor-to-fair in four regions and good-to-excellent in six, while the repeatability was poor-to-fair in three regions and good-to-excellent in the remaining seven [24].

In our study, overall high degrees of agreement (ICCs > 0.95) were found comparing gait parameters of the WalkinSense and the Pedar. The overall percentage differences indicate that the WalkinSense showed lower (≅6%), (≅14%), and (≅13%) and the slightly later (≅3%) compared to the Pedar. The regional ICCs between the systems were excellent for almost all regions. When considering the regional percentage differences, and reported the highest differences: ≅30% in the MFLat and ≅24% in the FFLat. Considering the differences between the systems (kind of sensor, sensor area, and layout), we may consider these differences as acceptable.

In a preliminary study, Healy et al. [27] assessed three subjects’ walking using the WalkinSense and the F-scan (Tekscan Inc., Boston, USA) systems in two different days. The WalkinSense showed a similar level of repeatability when compared to other plantar pressure measurement systems. However, the conclusions were mostly based on subjective analyses; the authors did not provide any measure of variance of the values nor did they perform any statistical procedure. Therefore, it is difficult to compare their results [27] with those found in the present study. Nevertheless, our findings seem to be in agreement with those reported by Healy and colleagues in their preliminary study [27].

In short, in the dynamic experiment (gait analysis) from the present study, the overall within-trial and between-trial repeatability were excellent and the regional within-trial and between-trial repeatability were mostly good-to-excellent (only in one region was repeatability fair). The overall accuracy (ICCs: WalkinSense versus Pedar) showed ICCs higher than 0.95 and Pearson coefficient with correlations statistically significant for all variables and for the regional accuracy ICCs higher than 0.84 were observed for all variables.

4.3. Description of Values

All the values found in the present study fell in the reference range previously proposed for healthy subjects [19]. The magnitudes and the sequence of the along the regions were similar to those presented by Putti et al. [19].

In the present study, the highest was in the FFCt (331 kPa), followed by the RFMed (275 kPa) and the RFLat (257 kPa), while in the aforementioned study [19] the highest occurred in the GToe (280 kPa), followed by the rearfoot (which was considered as one region, 264 kPa) and forefoot (metatarsal heads I and II, ≅247 kPa). In another study assessing a healthy population [36], the highest was found in the forefoot (metatarsal heads II—361 kPa and III—330 kPa), followed by the GToe (321 kPa) and the rearfoot (313 kPa), using a pressure plate. The differences among these studies could be attributed to external variables such as the use of different shoes (neutral shoes versus running shoes) or different reference systems (in-shoe pressure system versus pressure plate). In the present study, we opted to use an in-shoe pressure system inside of neutral shoes in order to record gait values during a condition as similar as possible to those found in daily life.

4.4. Limitations

This study presents some limitations, such as (i) the standardized position of the WalkinSense sensors for the four pairs of Pedar insoles that did not necessarily correspond to the point of maximal pressure for all subjects; (ii) the differences between the WalkinSense and the Pedar (i.e., layout, sensor area, and kind); and (iii) the description of values provided in this study that can only be considered for the proposed arrangement of the sensors.

5. Conclusion

The WalkinSense showed good-to-excellent levels of accuracy and repeatability for plantar pressure variables during static-bench and dynamic gait analysis. Four plantar pressure parameters in healthy adults were presented and can be used as standard values while using this device. Further investigation of gait analysis and of the long-term accuracy and repeatability, the between-day and interexaminer repeatability, and the accuracy and repeatability of the spatial-temporal parameters of the WalkinSense are needed.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

References

D. Rosenbaum and H. P. Becker, “Plantar pressure distribution measurements. Technical background and clinical applications,” Foot and Ankle Surgery, vol. 3, no. 1, pp. 1–14, 1997.

M. Marey, “De la locomotion terrestre chez les Bipedes et les Quadrupedes,” Journal de l'Anatomie et de la Physiologie, vol. 9, pp. 42–80, 1873.

A. H. Abdul Razak, A. Zayegh, R. K. Begg, and Y. Wahab, “Foot plantar pressure measurement system: a review,” Sensors, vol. 12, no. 7, pp. 9884–9912, 2012.

M. Messina, J. Njuguna, V. Dariol, C. Pace, and G. Angeletti, “Design and simulation of a novel biomechanic piezoresistive sensor with silicon nanowires,” IEEE/ASME Transactions on Mechatronics, vol. 18, no. 3, pp. 1201–1210, 2013.

M. N. Orlin and T. G. McPoil, “Plantar pressure assessment,” Physical Therapy, vol. 80, no. 4, pp. 399–409, 2000.

P. R. Cavanagh and J. S. Ulbrecht, “Clinical plantar pressure measurement in diabetes: rationale and methodology,” Foot, vol. 4, no. 3, pp. 123–135, 1994.

S. A. Bus, R. Haspels, and T. E. Busch-Westbroek, “Evaluation and optimization of therapeutic footwear for neuropathic diabetic foot patients using in-shoe plantar pressure analysis,” Diabetes Care, vol. 34, no. 7, pp. 1595–1600, 2011.

M. P. Castro, S. A. Abreu, H. Sousa, L. Machado, R. Santos, and J. P. Vilas-Boas, “In-shoe plantar pressures and ground reaction forces during overweight adults' overground walking,” Research Quarterly for Exercise and Sport, forthcoming

H. Hsiao, J. Guan, and M. Weatherly, “Accuracy and precision of two in-shoe pressure measurement systems,” Ergonomics, vol. 45, no. 8, pp. 537–555, 2002.

M. P. Castro, S. Abreu, H. Sousa, L. Machado, R. Santos, and J. P. Vilas-Boas, “Ground reaction forces and plantar pressure distribution during occasional loaded gait,” Applied Ergonomics, vol. 44, no. 3, pp. 503–509, 2013.

M. P. Castro, S. Abreu, V. Pinto, et al., “Influence of pressure relief insoles developed for loaded gait (backpackers and obese people) on plantar pressure distribution and ground reaction forces,” Applied Ergonomics, 2014.

F. Fourchet, L. Kelly, C. Horobeanu, H. Loepelt, R. Taiar, and G. P. Millet, “Comparison of plantar pressure distribution in adolescent runners at low versus high running velocity,” Gait and Posture, vol. 35, no. 4, pp. 685–687, 2012.

V. Tessutti, F. Trombini-Souza, A. P. Ribeiro, A. L. Nunes, and I. D. C. N. Sacco, “In-shoe plantar pressure distribution during running on natural grass and asphalt in recreational runners,” Journal of Science and Medicine in Sport, vol. 13, no. 1, pp. 151–155, 2010.

J. M. Bland and D. G. Altman, “Statistical methods for assessing agreement between two methods of clinical measurement,” The Lancet, vol. 1, no. 8476, pp. 307–310, 1986.

A. K. Ramanathan, P. Kiran, G. P. Arnold, W. Wang, and R. J. Abboud, “Repeatability of the Pedar-X in-shoe pressure measuring system,” Foot and Ankle Surgery, vol. 16, no. 2, pp. 70–73, 2010.

H. L. P. Hurkmans, J. B. J. Bussmann, E. Benda, J. A. N. Verhaar, and H. J. Stam, “Accuracy and repeatability of the Pedar Mobile system in long-term vertical force measurements,” Gait and Posture, vol. 23, no. 1, pp. 118–125, 2006.

J. Woodburn and P. S. Helliwell, “Observations on the F-Scan in-shoe pressure measuring system,” Clinical Biomechanics, vol. 11, no. 5, pp. 301–304, 1996.

J. Firth, D. Turner, W. Smith, J. Woodburn, and P. Helliwell, “The validity and reliability of PressureStat for measuring plantar foot pressures in patients with rheumatoid arthritis,” Clinical Biomechanics, vol. 22, no. 5, pp. 603–606, 2007.

A. B. Putti, G. P. Arnold, L. Cochrane, and R. J. Abboud, “The Pedar in-shoe system: repeatability and normal pressure values,” Gait and Posture, vol. 25, no. 3, pp. 401–405, 2007.

T. W. Kernozek, E. E. Lamott, and M. J. Dancisak, “Reliability of an in-shoe pressure measurement system during treadmill walking,” Foot and Ankle International, vol. 17, no. 4, pp. 204–209, 1996.

G. Vidmar and P. Novak, “Reliability of in-shoe plantar pressure measurements in rheumatoid arthritis patients,” International Journal of Rehabilitation Research, vol. 32, no. 1, pp. 36–40, 2009.

D. C. Low and S. J. Dixon, “Footscan pressure insoles: accuracy and reliability of force and pressure measurements in running,” Gait and Posture, vol. 32, no. 4, pp. 664–666, 2010.

J. Hughes, L. Pratt, K. Linge, P. Clark, and L. Klenerman, “Reliability of pressure measurements: the EMED F system,” Clinical Biomechanics, vol. 6, no. 1, pp. 14–18, 1991.

J. K. Gurney, U. G. Kersting, and D. Rosenbaum, “Between-day reliability of repeated plantar pressure distribution measurements in a normal population,” Gait and Posture, vol. 27, no. 4, pp. 706–709, 2008.

A. Martínez-Nova, J. C. Cuevas-García, J. Pascual-Huerta, and R. Sánchez-Rodríguez, “BioFoot in-shoe system: normal values and assessment of the reliability and repeatability,” Foot, vol. 17, no. 4, pp. 190–196, 2007.

D. F. Murphy, B. D. Beynnon, J. D. Michelson, and P. M. Vacek, “Efficacy of plantar loading parameters during gait in terms of reliability, variability, effect of gender and relationship between contact area and plantar pressure,” Foot and Ankle International, vol. 26, no. 2, pp. 171–179, 2005.

A. Healy, P. Burgess-Walker, R. Naemi, and N. Chockalingam, “Repeatability of WalkinSense in shoe pressure measurement system: a preliminary study,” Foot, vol. 22, no. 1, pp. 35–39, 2012.

M. P. Castro, S. A. Abreu, I. Fonseca, J. Neiva, M. Correa, and J. P. Vilas-Boas, “Walkinsense validation: preliminary tests of mobility parameters,” Revista Portuguesa de Ciências do Desporto, vol. 11, pp. 845–848, 2011.

T. G. McPoil, M. W. Cornwall, L. Dupuis, and M. Cornwell, “Variability of plantar pressure data: a comparison of the two-step and midgait methods,” Journal of the American Podiatric Medical Association, vol. 89, no. 10, pp. 495–501, 1999.

M. van der Leeden, J. H. M. Dekker, P. C. Siemonsma, S. S. Lek-Westerhof, and M. P. M. Steultjens, “Reproducibility of plantar pressure measurements in patients with chronic arthritis: a comparison of one-step, two-step, and three-step protocols and an estimate of the number of measurements required,” Foot and Ankle International, vol. 25, no. 10, pp. 739–744, 2004.

J. M. Burnfield, C. D. Few, O. S. Mohamed, and J. Perry, “The influence of walking speed and footwear on plantar pressures in older adults,” Clinical Biomechanics, vol. 19, no. 1, pp. 78–84, 2004.

A. B. Putti, G. P. Arnold, and R. J. Abboud, “Foot pressure differences in men and women,” Foot and Ankle Surgery, vol. 16, no. 1, pp. 21–24, 2010.

J. W. Youdas, J. R. Carey, and T. R. Garrett, “Reliability of measurements of cervical spine range of motion—comparison of three methods,” Physical Therapy, vol. 71, no. 2, pp. 98–104, 1991.

K. Deschamps, I. Birch, J. Mc Innes, K. Desloovere, and G. A. Matricali, “Inter- and intra-observer reliability of masking in plantar pressure measurement analysis,” Gait and Posture, vol. 30, no. 3, pp. 379–382, 2009.

H. L. P. Hurkmans, J. B. J. Bussmann, R. W. Selles et al., “Validity of the Pedar Mobile system for vertical force measurement during a seven-hour period,” Journal of Biomechanics, vol. 39, no. 1, pp. 110–118, 2006.

A. B. Putti, G. P. Arnold, L. A. Cochrane, and R. J. Abboud, “Normal pressure values and repeatability of the Emed ST4 system,” Gait and Posture, vol. 27, no. 3, pp. 501–505, 2008.

T. Sumiya, Y. Suzuki, T. Kasahara, and H. Ogata, “Sensing stability and dynamic response of the F-Scan in-shoe sensing system: a technical note,” Journal of Rehabilitation Research and Development, vol. 35, no. 2, pp. 192–200, 1998.