Recent technical development focused on real-time heart rate monitoring instead of postexercise evaluation of recorded data. There are several systems on the market that allow direct and real-time monitoring of several individuals at the same time. The present study compared the systems of Polar, Acentas, Activio, and Suunto in a field test with twelve subjects regarding failure quota, operating distance, and ECG validity. Moreover, the installation and use of software and hardware were evaluated with a quality rating system. Chest belts were evaluated with a questionnaire, too. Overall the system of Acentas reached the best mark of all systems, but detailed results showed that every system has its advantages and disadvantages depending on using purpose, location, and weather. So this evaluation cannot recommend a single system but rather shows strength and weakness of all systems and additionally can be used for further system improvements.
Over the last 25 years, heart rate monitors have been widely used in sports and sports science. Since the development of handy heart rate monitors (HRMs) with the size of a watch and appropriate flexible chest belts with electrodes to transmit signals wirelessly to the watch, measurement of heart rate (HR) has become an easily accessible and valuable tool for training and coaching purposes and conducting laboratory or field studies [
A total of 12 active people (11 men and 1 woman; age:
The following four commercially available systems were used for all tests: POLAR Team2 Pro (Polar Electro Oy, Kempele, Finland), Acentas team monitoring system (Acentas GmbH, Hörgertshausen, Germany), Suunto Pro Team Pack (Suunto Oy, Vantaa, Finland), and Activio Sport System (Activio AB, Stockholm, Sweden).
A quality rating system similar to rating systems used in trade journals was used to test electronic equipment and software. A valuable design was found in the journal “Connect” (
500-score quality rating system, overall rating system divided in three main categories: hardware, software, and measurements.
Main category | Subcategory | Item | Scores |
---|---|---|---|
Hardware | Instruction manual | understandability | 10 |
Packing | Quality | 10 | |
Handling | 15 | ||
Chest belt | Storage | 10 | |
Battery | 10 | ||
Quality | 20 | ||
Wearing comfort | 25 | ||
Receiver | Power consumption | 5 | |
Quality | 25 | ||
Handling | 15 | ||
Connectivity | 5 | ||
Subtotal | |||
Installation | 10 | ||
Software | Menue navigation | 40 | |
Features | 100 | ||
Subtotal | |||
ECG deviation | 30 | ||
Measurements | Distance | 70 | |
Failure quota in field test | 100 | ||
Subtotal | |||
Maximum overall score |
Notes on hardware comparison.
System | Acentas | Activio | Polar | Suunto |
---|---|---|---|---|
(i) Short and compact but sufficient (+) | (i) Very detailed IM in English (+) | (i) Short instruction in six languages (+) | (i) No instruction manual (−) | |
(i) Compact backpack (<1 kg) (+) | (i) Good arrangement of hardware (+) | (i) Carrying case (+) | (i) Carrying case (+) | |
(i) Simple snap closing (+) | (i) Simple snap closing (+) | (i) Bluetooth USB stick for storage unit (+) | (i) USB reader for storage unit (+) | |
(i) Lightweight (~150 g) (+) | (i) Similar to Acentas system (±) | (i) Best quality (+) | (i) Lightweight (+) |
Wearing comfort of the chest belts was evaluated via a short anonymous questionnaire which all 12 participants (see Section
Score from the chest-belt questionnaire. (0 = “totally agree”; 5 = “absolutely disagree”).
Statement | Acentas | Activio | Polar | Suunto |
---|---|---|---|---|
“The belt is easily fixed and locked” | 3.8 | 3.4 | 2.8 | 2.9 |
“The belt is precisely and simply adapted to my chest girth” | 3.1 | 3.2 | 3.2 | 2.6 |
“I consider the belt disturbing right after attaching it to the body” | 0.9 | 1.0 | 0.9 | 1.1 |
“The belt hindered me during match play” | 2.6 | 2.7 | 1.6 | 2.9 |
“The belt caused pain” | 3.5 | 3.5 | 2.0 | 3.6 |
Notes on software comparison.
System | Acentas | Activio | Polar | Suunto |
---|---|---|---|---|
(i) On USB stick (+) | (i) Easy installation (+) | (i) Installation by Polar personnel (+) | (i) No software included, download only on homepage (−) | |
(i) Automatic recognition of chest belts (+) | (i) Very good arrangement of functions & team function (+) | (i) Long-loading software (−) | (i) Well-arranged & simple screen (+) | |
(i) Simple personalisation of a subject (+) | (i) Simple and fast recognition of active chest belts (+) | (i) Multifaced and user-friendly data creation (+) | (i) Unlabelled belts, boxes (−) |
The main field test was measurement of failure ratio during the half time of a real soccer match. All players apart from goal keeper were equipped with chest belts of the relevant system and measured during first half (= 45 min) of a league soccer game during four home matches in summer 2009. Temperature range was within 9°C, and weather conditions were similar (no precipitation) for all measurements. The receiver of the relevant system was always positioned three meters in projection of midline of the soccer ground. In order to improve transmission distance, receiver was positioned one meter above ground level. As data loss due to injury could not be excluded a priori, a mean failure ratio was determined only with transmitters sending valid data. Each deviation/loss of one percent of whole duration measurement of 45 min (= 2700 s) was subtracted with 10 scores, and a maximal score of 100 could be obtained. If, for example, a total loss time of all ten transmitters of a system was 270 s, a total score of 90 would be credited to this system. A failure ratio of 10 percent of whole duration measurement would be credited with a zero score.
Distance measurement was conducted on a uphill street with a constant slope and in far distance to high-voltage line or radio tower to reduce possible interference. Receiver antenna was placed on highest elevation of the hill one meter above ground, and unit was connected to a laptop (Toshiba Satellite Series; Toshiba Inc, NY, USA). The participants wearing the chest belts were equipped with a GPS device (Nokia N79, Nokia Group, Espoo, Finland) to measure distance. By moving backwards it was guaranteed that the chest belt transmitters were permanently faced to the receiver. Measurements were terminated when transmission signal was lost. Additionally, the participants were instructed to move arms to keep HR variable with time. Attempts were only started when both valid signals of GPS and HR were available and stopped when HR signal was lost. Tests were conducted twice, and mean value of both attempts was calculated and taken as maximal range. Maximal range distance was credited with 70 scores whereas the system with the absolute maximal covered range was taken as reference system and credited maximum score. Percentage deviation of distance of other systems was analogously deducted as percentage of scores. If, for example, reference system had 100 m range, it was credited 70 scores. If a second system had only 50 m range, it would be credited 50% of maximum score, hence 35.
Comparison against ECG was conducted in a laboratory by using ECG tool Vicardio ECP-6 standard (Energy-Lab Technologies, Hamburg, Germany). Measurement was conducted two minutes at rest with single-polar extremity drains. Mean HRs of both ECG and relevant system were compared. A maximum score of 30 could be obtained at this test. A deviation of 1 beat per minute (bpm) was deducted with two scores. Only complete accordance of both values was credited with maximum score.
Results for hardware are summarized in Table
Results of software evaluation are summarized in Table
As data of ECG comparison were only obtained with a single subject, they have to be regarded with caution. Further evaluation would be necessary to confirm or reject results. Data are represented against reference system. Acentas had 86 bpm average HR versus 88 of reference system. Suunto’s deviation was 80 to 85 bpm, Activio’s deviation was 81 to 85 bpm, and Polar’s deviation was 82 to 85 bpm, respectively. Score distribution is depicted in Table
Summary of all scores.
Category | Maximum attainable score | Acentas | Activio | Polar | Suunto |
---|---|---|---|---|---|
Hardware | |||||
9 | 10 | 5 | 0 | ||
Quality | 10 | 7 | 5 | 10 | 7 |
Handling | 15 | 14 | 5 | 5 | 6 |
Storage | 10 | 0 | 0 | 10 | 8 |
Battery | 10 | 9 | 9 | 6 | 8 |
Quality | 20 | 17 | 17 | 18 | 15 |
Wearing comfort | 25 | 14 | 14 | 11 | 13 |
Power consumption | 5 | 5 | 5 | 3 | 5 |
Quality | 25 | 19 | 19 | 23 | 17 |
Handling | 15 | 13 | 8 | 10 | 13 |
Connectivity | 5 | 3 | 3 | 5 | 3 |
Software | |||||
Installation | 10 | 10 | 5 | 4 | 4 |
Menu navigation | 40 | 35 | 38 | 30 | 35 |
Features | 100 | 75 | 85 | 90 | 50 |
Measurements | |||||
ECG-deviation | 30 | 26 | 22 | 24 | 20 |
Distance | 70 | 70 | 28 | 20 | 21 |
Failure quota | 100 | 94 | 80 | 90 | 0 |
Overall score | 500 | 420 | 353 | 364 | 225 |
Relative score (in %) | 84 | 70 | 73 | 45 | |
Price (in EUR) | ca. 3.500 | ca. 6.000 | ca. 3.500 | ca. 3.000 |
Regarding failure quota, average downtime was 148 s (0,6%) for Acentas, 286 s (1,0%) for Polar, and 552 s (2,0%) for Activio. The Suunto system stood out negatively, as a complete data loss was seen. Single belts were recognised from time to time, but no consistent data acquisition could be accomplished. A receiver problem might have caused this failure. Therefore, Suunto was not scored at all in this test. Similarly, five out of ten Polar chest belts had signal loss and could not be reactivated whereas Activio managed 10 out of 10 signals, and for the Acentas system 9 out of 10 were used for data evaluation as one person was injured during match play. The summarized scores and overall results are represented in Table
The purpose of the present study was to compare four commercially available online heart rate monitoring systems and especially their use in everyday situation in team sports. The system of Polar could score especially with a clear design, useable features of the software, and a convincing product quality. Only Polar uses WLAN for data transmission and also adds a mobile terminal in pocket format which can easily be used outdoor and with bad weather conditions. But the high energy consumption of WLAN transmission would terminate the battery capacities and additionally the duration of measurement. The system of Activio has a functional and useful software and the instruction manual was very detailed and easily comprehensible. The price, however, was very high compared with the other systems. Acentas could score with a huge operating distance, a valid heart rate signal compared with ECG, a low failure quota, and an easy handling. In contrast, the system of Suunto had a total breakdown during competition measurements and could not be reactivated. So this system was evaluated as the worst. The evaluation of the several chest belts revealed no important advantage of one manufacturer. Only the chest belt of Polar showed weaknesses regarding wearing comfort. Altogether, all systems cannot be used for online heart rate monitoring. Prospectively, it would be a great challenge to realise online monitoring for swimmers, possibly leading to new opportunities for the training regime. In this context the system of Polar and Suunto had the advantage that data are also recorded on the chest belt memory during water immersion and could be evaluated after exercise.
Meanwhile, some of the tested heart rate monitoring systems are updated and upgraded with new functions, respectively. For example, Acentas included an offline memory in the chest belts and added a wrist monitor for direct heart rate analysis from up to twenty athletes by the coach.
In summary, Acentas system reached the best mark of all systems, but every system has its advantages and disadvantages depending on the using purpose, location, and weather. So this present comparative study cannot recommend a single system but rather shows strength and weakness of all systems and additionally can be used for further system improvements.
The investigators were responsible for the study design, data collection, data analysis, data interpretation, and submission of the paper for publication, independently of all funding sources. The authors declare that they have no financial conflict of interests to disclose with any of the companies named in this paper. There is no preferential order of companies in the paper.
The authors thank all manufactures for the delivery of evaluation systems with no charge.