http://www.diva-portal.org This is the published version of a paper published in PLoS ONE. Citation for the original published paper (version of record): Golubic, R., May, A., Borch, K., Overvad, K., Charles, M. et al. (2014) Validity of Electronically Administered Recent Physical Activity Questionnaire (RPAQ) in Ten European Countries. PLoS ONE, 9(3): e92829 http://dx.doi.org/10.1371/journal.pone.0092829 Access to the published version may require subscription. N.B. When citing this work, cite the original published paper. Permanent link to this version: http://urn.kb.se/resolve?urn=urn:nbn:se:umu:diva-88401
15
Embed
European Countries. PLoS ONE, 9(3): e92829 Golubic, R ...717468/FULLTEXT01.pdfGermany, 13Department of Clinical Sciences, Genetic & Molecular Epidemiology Unit, Ska˚ne University
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
http://www.diva-portal.org
This is the published version of a paper published in PLoS ONE.
Citation for the original published paper (version of record):
Golubic, R., May, A., Borch, K., Overvad, K., Charles, M. et al. (2014)
Validity of Electronically Administered Recent Physical Activity Questionnaire (RPAQ) in Ten
European Countries.
PLoS ONE, 9(3): e92829
http://dx.doi.org/10.1371/journal.pone.0092829
Access to the published version may require subscription.
N.B. When citing this work, cite the original published paper.
Permanent link to this version:http://urn.kb.se/resolve?urn=urn:nbn:se:umu:diva-88401
Validity of Electronically Administered Recent PhysicalActivity Questionnaire (RPAQ) in Ten European CountriesRajna Golubic1, Anne M. May2, Kristin Benjaminsen Borch3, Kim Overvad4, Marie-Aline Charles5, Maria
Paul W. Franks13,14, Nicholas Wareham1, Ulf Ekelund1, Soren Brage1*
1 MRC Epidemiology Unit, University of Cambridge, Cambridge, United Kingdom, 2 Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht,
Utrecht, The Netherlands, 3 Department of Community Medicine, Faculty of Health Sciences, University of Tromsø, The Arctic University of Norway, Tromsø, Norway,
4 Section for Epidemiology, Department of Public Health, Aarhus University, Aarhus, Denmark and Department of Cardiology, Aalborg University Hospital, Aalborg,
Denmark, 5 Inserm, Centre for research in Epidemiology and Population Health, U1018, Lifelong epidemiology of obesity, diabetes and chronic renal disease Team, F-
94807, Villejuif, France; Univ Paris-Sud, UMRS 1018, F-94807, Villejuif, France, 6 Department of Epidemiology, Murcia Regional Health Authority, Murcia, Spain, 7 CIBER
Epidemiologıa y Salud Publica (CIBERESP), Spain, 8 Department Sociosanitary Sciences, Murcia School of Medicine, Murcia, Spain, 9 Subdireccion de Salud Publica de
Gipuzkoa, Gobierno Vasco, San Sebastian, Spain, 10 Molecular and Nutritional Epidemiology Unit, ISPO, Cancer Prevention and Research Institute, Florence, Italy,
11 Hellenic Health Foundation (HHF), Athens, Greece, 12 Department of Epidemiology, Deutsches Institut fur Ernahrungsforschung Potsdam-Rehbrucke, Nuthetal,
Germany, 13 Department of Clinical Sciences, Genetic & Molecular Epidemiology Unit, Skane University Hospital, Lund University, Malmo, Sweden, 14 Genetic
Epidemiology & Clinical Research Group, Department of Public Health & Clinical Medicine, Section for Medicine, Umea University, Umea, Sweden
Abstract
Objective: To examine the validity of the Recent Physical Activity Questionnaire (RPAQ) which assesses physical activity (PA)in 4 domains (leisure, work, commuting, home) during past month.
Methods: 580 men and 1343 women from 10 European countries attended 2 visits at which PA energy expenditure (PAEE),time at moderate-to-vigorous PA (MVPA) and sedentary time were measured using individually-calibrated combined heart-rate and movement sensing. At the second visit, RPAQ was administered electronically. Validity was assessed usingagreement analysis.
Results: RPAQ significantly underestimated PAEE in women [median(IQR) 34.1 (22.1, 52.2) vs. 40.6 (32.4, 50.9) kJ/kg/day,95%LoA: 244.4, 63.4 kJ/kg/day) and in men (43.7 (29.0, 69.0) vs. 45.5 (34.1, 57.6) kJ/kg/day, 95%LoA: 247.2, 101.3 kJ/kg/day]. Using individualised definition of 1MET, RPAQ significantly underestimated MVPA in women [median(IQR): 62.1 (29.4,124.3) vs. 73.6 (47.8, 107.2) min/day, 95%LoA: 2130.5, 305.3 min/day] and men [82.7 (38.8, 185.6) vs. 83.3 (55.1, 125.0) min/day, 95%LoA: 2136.4, 400.1 min/day]. Correlations (95%CI) between subjective and objective estimates were statisticallysignificant [PAEE: women, rho = 0.20 (0.15–0.26); men, rho = 0.37 (0.30–0.44); MVPA: women, rho = 0.18 (0.13–0.23); men,rho = 0.31 (0.24–0.39)]. When using non-individualised definition of 1MET (3.5 mlO2/kg/min), MVPA was substantiallyoverestimated (,30 min/day). Revisiting occupational intensity assumptions in questionnaire estimation algorithms withoccupational group-level empirical distributions reduced median PAEE-bias in manual (25.1 kJ/kg/day vs. 29.0 kJ/kg/day,p,0.001) and heavy manual workers (64.1 vs. 24.6 kJ/kg/day, p,0.001) in an independent hold-out sample.
Conclusion: Relative validity of RPAQ-derived PAEE and MVPA is comparable to previous studies but underestimation ofPAEE is smaller. Electronic RPAQ may be used in large-scale epidemiological studies including surveys, providinginformation on all domains of PA.
Citation: Golubic R, May AM, Benjaminsen Borch K, Overvad K, Charles M-A, et al. (2014) Validity of Electronically Administered Recent Physical ActivityQuestionnaire (RPAQ) in Ten European Countries. PLoS ONE 9(3): e92829. doi:10.1371/journal.pone.0092829
Editor: Hamid Reza Baradaran, Iran University of Medical Sciences, Iran (Republic of Islamic)
Received December 11, 2013; Accepted February 25, 2014; Published March 25, 2014
Copyright: � 2014 Golubic et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permitsunrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was supported by funding from the European Union (Integrated Project LSHM-CT-2006-037197 in the Framework Programme 6 of theEuropean Community) and the Medical Research Council, UK (grant code MC_UU_12015/3). RG is financially supported by a scholarship from the GatesCambridge, Benefactors’ Scholarship from St. John’s College Cambridge and Raymond and Beverly Sackler Studentship from the School of Clinical Medicine,University of Cambridge. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing Interests: The authors have declared that no competing interests exist.
derived with criterion-measured PAEE, MVPA and SED-time
by country and sex.
Validity of Electronically Administered RPAQ
PLOS ONE | www.plosone.org 3 March 2014 | Volume 9 | Issue 3 | e92829
Ta
ble
1.
Par
tici
pan
tch
arac
teri
stic
sat
bas
elin
e,
the
RP
AQ
valid
atio
nst
ud
yco
ho
rt(N
=1
92
3).
Co
un
try
Se
xN
Ag
e(y
ea
rs)
We
igh
t(k
g)
He
igh
t(m
)B
MI
(kg
/m2
)W
HR
Em
plo
ye
d
De
nm
ark
Wo
me
n1
13
57
.6(4
.2)
69
.8(1
2.9
)1
.64
(0.0
5)
25
.7(4
.5)
0.8
2(0
.07
)8
6(7
6.1
)
Me
n6
75
8.4
(3.6
)8
7.2
(10
.6)
1.7
8(0
.06
)2
7.7
(3.3
)0
.98
(0.1
8)
53
(79
.1)
Fran
ceW
om
en
17
45
4.7
(7.5
)6
1.3
(9.4
)1
.62
(0.0
6)
23
.2(3
.3)
0.7
7(0
.06
)1
43
(82
.2)
Ge
rman
yW
om
en
12
55
5.4
(4.5
)6
9.1
(11
.1)
1.6
4(0
.06
)2
5.6
(4.1
)0
.82
(0.0
6)
10
0(8
0.0
)
Me
n8
35
8.0
(3.1
)8
6.2
(12
.5)
1.7
7(0
.05
)2
7.6
(3.5
)0
.96
(0.0
6)
66
(79
.5)
Gre
ece
Wo
me
n1
21
51
.7(1
6.0
)6
9.2
(13
.1)
1.6
1(0
.06
)2
7.0
(5.4
)0
.84
(0.0
7)
64
(52
.9)
Me
n6
75
0.5
(18
.8)
84
.8(1
2.5
)1
.75
(0.0
8)
27
.8(3
.7)
0.9
5(0
.07
)4
4(6
5.6
)
Ital
yW
om
en
14
25
2.9
(6.5
)6
3.4
(10
.4)
1.6
0(0
.06
)2
4.9
(3.8
)0
.78
(0.0
7)
11
1(7
8.2
)
Me
n5
35
3.3
(6.6
)7
8.9
(13
.6)
1.7
3(0
.06
)2
6.9
(4.0
)0
.91
(0.0
7)
42
(79
.3)
Ne
the
rlan
ds
Wo
me
n1
79
58
.9(1
0.4
)6
2.7
(7.9
)1
.67
(0.0
7)
22
.6(2
.4)
0.8
3(0
.06
)1
11
(62
.0)
Me
n3
05
0.5
(11
.2)
77
.9(9
.9)
1.8
2(0
.06
)2
3.5
(2.2
)0
.87
(0.0
5)
24
(80
.0)
No
rway
Wo
me
n1
77
48
.2(6
.7)
70
.8(1
0.7
)1
.65
(0.0
6)
26
.0(3
.5)
0.8
4(0
.06
)1
54
(87
.0)
Spai
nW
om
en
11
34
9.1
(8.4
)6
5.1
(9.9
)1
.60
(0.0
6)
25
.5(3
.7)
0.8
1(0
.07
)8
2(7
1.9
)
Me
n9
25
1.5
(7.2
)8
0.4
(11
.0)
1.7
2(0
.07
)2
7.1
(3.4
)0
.94
(0.0
6)
80
(87
.0)
Swe
de
nW
om
en
95
52
.4(8
.5)
72
.1(1
2.8
)1
.65
(0.0
6)
26
.6(4
.9)
0.8
7(0
.06
)8
1(8
7.1
)
Me
n9
25
2.4
(7.9
)8
4.9
(13
.3)
1.7
9(0
.07
)2
6.5
(3.6
)0
.96
(0.0
7)
82
(90
.1)
UK
Wo
me
n1
04
59
.8(7
.6)
70
.0(1
1.4
)1
.62
(0.0
6)
26
.7(4
.1)
0.8
6(0
.06
)6
0(5
7.7
)
Me
n9
66
1.4
(7.9
)8
5.6
(12
.9)
1.7
6(0
.06
)2
7.7
(3.4
)0
.96
(0.0
7)
59
(61
.5)
To
tal
Wo
me
n1
34
35
4.0
(9.3
)6
6.9
(11
.5)
1.6
3(0
.07
)2
5.2
(4.2
)0
.82
(0.0
7)
99
2(7
4.0
)
Me
n5
80
55
.0(9
.9)
83
.9(1
2.4
)1
.76
(0.0
7)
27
.0(3
.6)
0.9
5(0
.09
)4
50
(77
.7)
Val
ue
sar
em
ean
(SD
),e
xce
pt
em
plo
yme
nt
stat
us
wh
ich
isn
(%).
Ab
bre
viat
ion
s:B
MI-
bo
dy
mas
sin
de
x;W
HR
-w
aist
-hip
rati
o;
p,
0.0
01
for
dif
fere
nce
inal
lva
riab
les
acro
ssth
eco
un
trie
s(K
rusk
al-W
allis
test
).d
oi:1
0.1
37
1/j
ou
rnal
.po
ne
.00
92
82
9.t
00
1
Validity of Electronically Administered RPAQ
PLOS ONE | www.plosone.org 4 March 2014 | Volume 9 | Issue 3 | e92829
Physical Activity Energy ExpenditureAbsolute validity. The RPAQ underestimated PAEE in
women, with a significant median bias (LoA) of 26.5 (244.4, 63.4)
kJ/kg/day, corresponding to 216% of median PAEE (Table 2). In
men, median bias (LoA) was positive at 1.1 (247.2, 101.3) kJ/kg/
day (about 2% of objective median), despite median self-reported
PAEE being slightly lower than objective median PAEE. Median
bias (LoA) for all participants was 24.6 (246.0, 78.7) kJ/kg/day
(211.0%), which was not significantly different from 0. Notably
higher RPAQ-derived PAEE in the Netherlands compared with
other countries is a result of higher leisure-time-PA due to greater
proportion of participants reporting high, though theoretically
possible, frequencies and durations of certain activities (e.g. 9 h of
do-it-yourself every day or 4 h of competitive cycling 5 times per
week).
Furthermore, we examined the variation of bias by BMI-
category and employment status. We found a significant difference
in bias across BMI-categories (p,0.001), with an underestimation
of PAEE in normal weight and overweight individuals and
overestimation in the obese (data not shown). There was a
substantially greater underestimation of PAEE and SED-time in
the unemployed compared with the employed participants (p,
0.001).
Bland-Altman plots suggest appreciable individual differences in
the assessment of PAEE (Supplementary figures 1 and 2).
Additionally, magnitude of error increased with increasing inter-
method mean PAEE (Spearman’s correlation coefficients
rho = 0.41, and rho = 0.42 in women and men, respectively, both
p,0.001). However, an opposite direction of this association was
noted when difference was plotted against the criterion (not
shown).
Relative validity. A significant but weak inter-method
correlation was observed for PAEE (Figure 1) in women, with a
pooled estimate rho = 0.20 (95% CI: 0.15 to 0.26), and significant
heterogeneity (I2 = 61.0%, p = 0.006). The pooled estimate in men
was greater than that in women (p = 0.003), rho = 0.37 (95% CI:
0.30 to 0.44) with borderline significant heterogeneity by country
(I2 = 47.9%, p = 0.062).
Time in Moderate-to-vigorous Physical ActivityAbsolute validity. When using individualised RMR to define
objective MVPA, the RPAQ significantly underestimated MVPA
(Table 3) in women with median bias (LoA) 28.5 (2130.5, 305.3)
min/day (211.5%), and significantly overestimated in men, with
median bias (LoA) 5.5 (2136.4, 400.1) min/day (6.6%). There was
a material underestimation in both sexes combined, with median
bias (LoA) 24.7 (2137.8, 348.8) min/day (26.2%). The observed
overestimation of MVPA in men despite lower median MVPA
from RPAQ than from combined sensing is a consequence of a
positively skewed distribution. However, the direction of bias in
MVPA varied by country in both sexes (Table 3).
Bias for MVPA did not vary by BMI-category for individualised
MET estimates but when standard definition of 1MET was used in
the derivation of objective intensity variables, the inter-method
difference in MVPA substantially increased with BMI (p = 0.008),
with the greatest overestimation among the obese. No difference in
bias in MVPA was found between employed and unemployed
individuals.
There were substantial individual differences in the assessment
of MVPA as displayed in Bland-Altman plots (Supplementary
figures 1 and 2), with an indication of proportional error
(Spearman’s correlation coefficients between the difference and
the average were rho = 0.36 and rho = 0.51 in women and men,
respectively, and both p,0.001). Nevertheless, individuals with
lower objectively measured MVPA tended to over-report MVPA
to a greater extent than their more active counterparts (not
shown). We found an overestimation of MVPA by RPAQ in
women and men (Supplementary table 1) when standard
definition of 1MET was applied.
Figure 1. Spearman’s correlation coefficients for the associations of PAEE, MVPA and sedentary time assessed by the RPAQ withobjectively measured corresponding variables by country and sex in 1343 women and 540 men.doi:10.1371/journal.pone.0092829.g001
Validity of Electronically Administered RPAQ
PLOS ONE | www.plosone.org 5 March 2014 | Volume 9 | Issue 3 | e92829
Ta
ble
2.
Ph
ysic
alac
tivi
tye
ne
rgy
exp
en
dit
ure
(kJ/
kg/d
ay)
asas
sess
ed
by
the
Re
cen
tP
hys
ical
Act
ivit
yQ
ue
stio
nn
aire
and
com
bin
ed
mo
vem
en
tse
nso
ran
dh
ear
tra
tem
on
ito
r,N
=1
92
3.
RP
AQ
Acc
+HR
Inte
r-m
eth
od
dif
fere
nce
Me
an
SD
Me
dia
nIQ
RM
ea
nS
DM
ed
ian
IQR
Me
an
bia
sM
ed
ian
bia
sL
oA
Wo
me
n,
N=
13
43
De
nm
ark
53
.83
5.6
47
.42
7.0
68
.43
9.0
11
.83
8.0
30
.24
7.2
14
.86
.0**
*2
28
.91
04
.1
Fran
ce3
4.2
20
.92
9.7
19
.64
3.8
38
.21
1.9
37
.53
0.8
45
.42
4.0
28
.9*
23
3.8
50
.8
Ge
rman
y4
6.2
35
.23
6.7
24
.55
4.8
40
.71
4.3
38
.73
0.0
49
.75
.52
1.0
23
0.0
64
.0
Gre
ece
28
.62
1.6
21
.91
3.6
39
.23
8.8
14
.13
8.2
29
.74
8.1
21
0.2
21
4.0
***
24
3.0
36
.5
Ital
y3
1.5
18
.82
5.7
18
.83
9.2
46
.31
3.6
44
.33
6.8
55
.52
14
.82
16
.62
50
.62
3.4
Ne
the
rlan
ds
57
.22
6.1
51
.54
0.4
72
.44
6.5
17
.64
3.6
35
.45
4.9
10
.78
.6**
*2
44
.98
1.2
No
rway
40
.82
5.2
35
.12
3.1
53
.04
5.1
14
.54
2.7
35
.15
3.7
24
.32
7.4
*2
48
.75
8.7
Spai
n3
2.9
17
.32
9.6
21
.14
2.6
47
.91
3.5
46
.03
8.6
57
.12
15
.02
15
.3**
*2
51
.03
0.9
Swe
de
n4
0.8
30
.63
3.7
21
.94
9.6
42
.91
4.6
41
.03
2.1
51
.72
2.1
27
.52
36
.07
9.0
Un
ite
dK
ing
do
m3
6.3
22
.32
9.2
19
.14
9.9
35
.31
1.6
33
.52
6.4
44
.11
.02
3.3
23
6.8
54
.6
To
tal,
wo
me
n4
0.6
27
.33
4.1
22
.15
2.2
42
.41
4.5
40
.63
2.4
50
.92
1.7
26
.5*
24
4.4
63
.4
Me
n,
N=
58
0
De
nm
ark
71
.26
1.0
52
.83
8.8
80
.64
3.1
17
.44
1.5
32
.45
1.8
28
.11
3.1
***
22
6.5
23
2.9
Ge
rman
y6
2.3
39
.45
1.0
35
.87
8.1
41
.61
3.9
41
.03
1.3
49
.42
0.7
14
.0**
*2
27
.99
4.6
Gre
ece
40
.53
0.0
30
.62
2.4
45
.74
4.2
19
.34
3.8
29
.45
4.7
24
.72
7.3
24
5.7
63
.9
Ital
y4
4.5
25
.94
2.0
28
.25
4.4
51
.21
5.8
48
.74
1.5
60
.12
6.7
21
2.1
*2
37
.44
4.7
Ne
the
rlan
ds
56
.82
4.4
54
.23
8.5
66
.35
5.2
15
.15
4.0
44
.66
3.7
1.6
0.7
26
3.7
74
.3
Spai
n5
0.2
34
.84
4.7
28
.55
9.4
51
.11
9.5
48
.63
8.2
62
.52
0.5
25
.12
47
.85
5.1
Swe
de
n5
2.1
34
.54
3.3
27
.76
8.9
55
.31
8.8
52
.44
1.3
67
.02
2.9
28
.62
64
.21
01
.3
Un
ite
dK
ing
do
m6
1.0
72
.74
7.5
25
.97
4.3
40
.01
6.2
36
.62
9.3
48
.92
1.0
7.9
*2
39
.41
05
.5
To
tal,
me
n5
5.2
46
.54
3.7
29
.06
9.0
47
.11
8.2
45
.53
4.1
57
.68
.11
.1**
*2
47
.21
01
.3
To
tal,
bo
thse
xes
34
.85
5.2
37
.72
3.6
45
.04
3.6
15
.84
6.5
32
.75
3.3
1.2
24
.62
46
.07
8.7
IQR
-in
terq
uar
tile
ran
ge
;SD
-st
and
ard
de
viat
ion
;Lo
A-
95
%lim
its
of
agre
em
en
t;ra
ng
eo
fb
ias
incl
ud
es
the
valu
es
be
twe
en
2.5
than
d9
7.5
thp
erc
en
tile
;A
cc+H
R-
com
bin
ed
acce
lero
me
ter
and
he
art
rate
mo
nit
or.
*p,
0.0
5,
**p
,0
.01
,**
*p,
0.0
01
for
bia
s.d
oi:1
0.1
37
1/j
ou
rnal
.po
ne
.00
92
82
9.t
00
2
Validity of Electronically Administered RPAQ
PLOS ONE | www.plosone.org 6 March 2014 | Volume 9 | Issue 3 | e92829
Relative validity. Inter-method correlation for MVPA
(Figure 1) was slightly weaker than that observed for total PAEE
and greater for men than women, p = 0.003 (rho = 0.18, 95% CI:
0.13 to 0.23; I2 = 64.0%, p = 0.003 for women and rho = 0.31,
95% CI: 0.24 to 0.39; I2 = 71.2%, p = 0.001 for men). Compar-
ative pooled correlation coefficients using the standard definition
of 1MET were rho = 0.16, 95% CI: 0.11 to 0.21; I2 = 74.3%, p,
0.001 in women, and rho = 0.27, 95% CI: 0.19 to 0.34;
I2 = 74.1%, p,0.001 in men (Supplementary figure 3); p = 0.007
for the difference in rho between the sexes.
Sedentary TimeAbsolute validity. The RPAQ significantly underestimated
SED-time, with median bias (LoA) 23.3 (29.0, 4.1) h/day among
women (220.8%), and 22.3 (28.3, 5.5) h/day (214.8%) among
men (Table 4).
Bias for SED-time did not differ across BMI-categories and
employment status, but when standard definition of 1MET was
used, underestimation of SED-time increased with BMI-category
(p = 0.018), and was the greatest in the obese (226%).
Assessment of SED-time varied considerably between partici-
pants (Supplementary figures 1 and 2). Magnitude of error tended
to increase with greater SED-time (Spearman’s correlation
coefficients rho = 0.21 and rho = 0.18 in women and men,
respectively, both p,0.001). However, the tendency to under-
report was associated with greater objectively measured SED-time
(not shown). Bias for SED-time remained similar after using
standard definition of 1MET (Supplementary table 2).
Relative validity. The correlation between self-reported and
objectively measured SED-time (Figure 2) was comparable to that
of PAEE and MVPA without substantial heterogeneity in women
(rho = 0.20 (95% CI: 0.14 to 0.25), I2 = 29.5%, p = 0.173). The
corresponding pooled estimate in men was a rho = 0.25 (95% CI:
0.19 to 0.31), and there was no evidence of heterogeneity between
the countries, I2 = 0%, p = 0.962. When using the standard
definition of 1MET, pooled estimate was rho = 0.19 (95% CI:
0.14 to 0.24), I2 = 42.8%, p = 0.072 in women and rho = 0.22
(95% CI: 0.13 to 0.30), I2 = 0%, p = 0.949 in men.
Domain-specific PAEE from the RPAQ and TotalObjectively Assessed PAEE
Domain-specific PAEE from the RPAQ (Table 5) materially
differed by country in all 4 domains in both sexes. The highest
PAEE was reported in the occupational domain, with median
(IQR) 14.7 (10.2, 15.1) kJ/kg/day in women, and 18.3 (12.3, 36.5)
kJ/kg/day in men. Partial correlations between domain-specific
PAEE from the RPAQ and total objectively measured PAEE are
shown in Table 5. After adjustment for all other domains,
correlation coefficients varied by country, and overall there was a
weak positive correlation for the occupational domain (women:
r = 0.16; men: r = 0.30), leisure-time-PA (women: r = 0.13; men:
r = 0.19) and commuting PA (women: r = 0.11; men: r = 0.10) but
a weak negative correlation for PAEE in the home domain
(women; r = 20.13; men: r = 20.11). However, none of these
partial correlations was statistically significant, although there was
evidence of significance in some countries in every PA-domain.
Comparison with Cambridge IndexSpearman’s correlation coefficients between objectively assessed
PAEE, MVPA and the Cambridge Index were of similar
magnitudes to those for the Short EPIC-PA-questionnaire [30],
with pooled estimates of rho = 0.23 (95% CI: 0.18–0.27) and
rho = 0.23 (95% CI: 0.19–0.28) for PAEE and time at MVPA,
respectively (Supplementary figure 4a), with considerable hetero-
geneity across countries. The results remained unchanged after
using the standard definition of 1MET (Supplementary figure 4b).
In addition, we observed a statistically significant trend in
objectively measured PAEE and MVPA across the categories of
the Cambridge Index (data not shown), which implies that this
index ranks participants according to the level of PA.
Revisiting Occupational Intensity DistributionEmployed participants spent the greatest proportion of time at
low intensity levels (Supplementary figures 5 and 6). Intensity
distribution during working hours differed substantially by
occupational group (p,0.001, multivariate test for means), with
more time at higher intensity categories in physically demanding
jobs. Similarly, proportion of daily time spent sedentary at work
(#1.5MET) was lower in participants with greater physical
demands at work, and ranged from median (IQR) 26% (14%–
40%) in heavy manual occupations to 55% (42%–67%) in
sedentary occupations. The pattern in unemployed participants
resembled that of sedentary workers. Heavy manual workers spent
more time in light-intensity PA (1.5–3MET) compared with other
occupations.
When applying these intensity distributions from the ‘‘training
sample’’ (N = 1282) to the ‘‘holdout sample’’ (N = 641), occupa-
tional and total PAEE displayed an increasing trend across
occupational groups (Figure 2), with the highest values in heavy
manual workers (p,0.001). After applying the empirically-derived
intensity distribution to each group, occupational and total PAEE
substantially dropped in all occupations (all p,0.001), with the
greatest reduction in heavy manual workers. In all employed
Figure 2. Total PAEE and PAEE at work derived from the RPAQ, and bias for total PAEE before and after applying intensitydistribution assumption. Results are based on the‘‘holdout sample’’, with the following number of participants in each category: sedentaryN = 264, standing N = 147, manual N = 58, heavy manual N = 12, representing 1/3 of participants in each group of the employed participants. Data aremedian (IQR), and median with 95% limits of agreement for bias.doi:10.1371/journal.pone.0092829.g002
Validity of Electronically Administered RPAQ
PLOS ONE | www.plosone.org 7 March 2014 | Volume 9 | Issue 3 | e92829
Ta
ble
3.
Tim
esp
en
tin
mo
de
rate
and
vig
oro
us
ph
ysic
alac
tivi
ty(m
in/d
ay)
asas
sess
ed
by
the
Re
cen
tP
hys
ical
Act
ivit
yQ
ue
stio
nn
aire
and
com
bin
ed
mo
vem
en
tse
nso
ran
dh
ear
tra
tem
on
ito
r,N
=1
92
3.
RP
AQ
Acc
+HR
Inte
r-m
eth
od
dif
fere
nce
Me
an
SD
Me
dia
nIQ
RM
ea
nS
DM
ed
ian
IQR
Me
an
bia
sM
ed
ian
bia
sL
oA
Wo
me
n,
N=
13
43
De
nm
ark
10
7.4
10
0.0
71
.84
6.1
12
0.0
72
.53
7.4
63
.54
5.2
95
.53
4.8
3.1
***
29
0.3
32
2.0
Fran
ce7
1.9
84
.14
8.6
23
.48
6.8
71
.63
7.6
65
.44
6.3
88
.80
.32
17
.12
12
2.0
26
2.9
Ge
rman
y1
06
.59
7.4
74
.04
1.9
13
3.9
80
.14
6.1
73
.04
6.1
10
0.3
26
.57
.1**
21
17
.02
94
.2
Gre
ece
69
.29
2.5
41
.41
9.8
72
.67
0.5
40
.66
8.1
42
.99
2.3
21
.42
15
.12
10
2.0
27
5.0
Ital
y7
8.2
91
.54
1.9
18
.51
03
.98
0.4
52
.37
2.5
46
.01
01
.02
2.2
22
1.5
21
37
.92
64
.4
Ne
the
rlan
ds
16
9.1
10
5.1
14
6.3
99
.12
05
.79
7.6
57
.89
0.0
57
.31
24
.07
1.5
61
.2**
*2
10
1.2
36
8.2
No
rway
10
0.8
11
8.3
53
.62
4.4
11
4.8
91
.05
3.8
79
.25
4.8
11
9.2
9.8
22
2.5
21
30
.53
48
.8
Spai
n7
0.4
59
.35
6.4
26
.29
9.9
96
.44
9.5
89
.25
8.4
12
5.6
22
6.0
23
0.4
**2
14
3.3
16
3.3
Swe
de
n7
3.0
97
.73
8.6
22
.96
8.2
91
.24
4.9
85
.15
5.1
12
0.8
21
8.2
23
9.7
21
63
.83
05
.3
Un
ite
dK
ing
do
m8
6.8
88
.05
8.0
35
.21
01
.76
0.5
40
.15
0.9
29
.28
4.1
26
.35
.5**
21
10
.32
71
.7
To
tal,
wo
me
n9
6.4
10
0.6
62
.12
9.4
12
4.3
81
.94
8.6
73
.64
7.8
10
7.2
14
.42
8.5
***
13
0.5
30
5.3
Me
n,
N=
58
0
De
nm
ark
15
5.8
14
4.5
10
0.7
45
.02
10
.18
2.3
53
.37
5.0
42
.31
12
.47
3.5
26
.9**
*2
10
8.7
39
9.9
Ge
rman
y1
75
.51
66
.81
12
.54
9.8
25
7.6
83
.84
3.1
77
.55
0.5
10
9.8
91
.74
1.1
***
29
8.1
42
7.3
Gre
ece
84
.41
21
.03
9.7
10
.79
8.0
96
.48
9.1
82
.53
8.3
13
7.2
21
2.0
22
6.5
21
32
.12
85
.4
Ital
y1
01
.31
13
.35
3.4
38
.01
20
.38
6.1
42
.28
1.0
56
.41
13
.51
5.1
21
3.6
21
24
.13
85
.7
Ne
the
rlan
ds
11
6.1
88
.29
5.9
52
.21
48
.11
10
.24
7.3
10
1.8
80
.91
38
.55
.92
4.6
21
95
.32
83
.3
Spai
n1
20
.11
52
.47
4.3
35
.61
40
.01
01
.35
9.6
92
.76
2.8
13
9.0
18
.82
8.0
21
46
.13
34
.3
Swe
de
n1
53
.21
58
.96
8.8
36
.12
92
.81
28
.27
0.2
11
1.6
73
.71
66
.32
4.9
22
4.8
22
24
.94
29
.7
Un
ite
dK
ing
do
m1
84
.51
68
.11
22
.24
9.8
29
3.2
79
.46
2.2
64
.14
1.5
11
5.3
10
5.1
51
.7**
*2
83
.55
34
.5
To
tal,
me
n1
42
.01
51
.58
2.7
38
.81
85
.69
5.9
63
.48
3.3
55
.11
25
.04
6.1
5.5
21
36
.44
00
.1
To
tal,
bo
thse
xes
10
3.3
11
9.5
60
.72
6.2
13
0.4
85
.45
3.4
75
.74
8.2
11
.41
8.4
24
.7**
*2
13
7.8
34
8.8
IQR
-in
terq
uar
tile
ran
ge
;SD
-st
and
ard
de
viat
ion
;Lo
A-
95
%lim
its
of
agre
em
en
t;ra
ng
eo
fb
ias
incl
ud
es
the
valu
es
be
twe
en
2.5
than
d9
7.5
thp
erc
en
tile
;A
cc+H
R-
com
bin
ed
acce
lero
me
ter
and
he
art
rate
mo
nit
or.
*p,
0.0
5,
**p
,0
.01
,**
*p,
0.0
01
for
bia
s.d
oi:1
0.1
37
1/j
ou
rnal
.po
ne
.00
92
82
9.t
00
3
Validity of Electronically Administered RPAQ
PLOS ONE | www.plosone.org 8 March 2014 | Volume 9 | Issue 3 | e92829
Ta
ble
4.
Tim
esp
en
tse
de
nta
ry(h
/day
)as
asse
sse
db
yth
eR
ece
nt
Ph
ysic
alA
ctiv
ity
Qu
est
ion
nai
rean
dco
mb
ine
dm
ove
me
nt
sen
sor
and
he
art
rate
mo
nit
or,
N=
19
23
.
RP
AQ
Acc
+HR
Inte
r-m
eth
od
dif
fere
nce
Me
an
SD
Me
dia
nIQ
RM
ea
nS
DM
ed
ian
IQR
Me
an
bia
sM
ed
ian
bia
sL
oA
Wo
me
n,
N=
13
43
De
nm
ark
12
.82
.71
2.1
10
.51
4.6
16
.32
.01
5.7
14
.51
7.4
23
.52
3.5
***
29
.73
.4
Fran
ce1
3.5
2.9
13
.31
1.0
15
.41
6.9
1.9
16
.81
5.6
18
.32
3.5
23
.7**
*2
8.7
5.9
Ge
rman
y1
3.6
2.8
13
.21
1.1
15
.91
6.2
2.3
16
.91
5.0
18
.22
2.6
23
.0**
*2
9.0
3.6
Gre
ece
12
.83
.41
1.9
10
.51
4.3
16
.12
.51
6.5
14
.61
8.3
23
.32
4.4
***
21
0.3
5.4
Ital
y1
2.7
2.6
12
.91
0.3
14
.91
4.8
2.2
14
.81
3.3
16
.42
2.1
22
.3**
*2
8.6
3.9
Ne
the
rlan
ds
12
.22
.21
1.8
10
.61
3.6
15
.82
.01
5.7
14
.31
7.0
23
.62
3.6
***
28
.63
.0
No
rway
13
.12
.61
2.5
10
.91
5.2
15
.62
.01
5.8
14
.31
7.2
22
.62
2.8
***
28
.63
.3
Spai
n1
2.9
2.8
12
.61
0.5
15
.01
4.8
2.0
15
.31
2.8
16
.32
1.9
22
.2**
*2
9.0
6.1
Swe
de
n1
2.4
2.8
11
.51
0.4
14
.01
5.8
2.1
15
.51
4.1
17
.32
3.4
23
.2**
*2
9.4
3.6
Un
ite
dK
ing
do
m1
2.9
2.4
12
.61
1.0
14
.01
6.5
2.0
16
.61
5.1
17
.92
3.7
24
.1**
*2
9.0
2.5
To
tal,
wo
me
n1
2.9
2.7
12
.41
0.7
14
.81
5.9
2.2
15
.91
4.3
17
.52
3.0
23
.3**
*2
9.0
4.1
Me
n,
N=
58
0
De
nm
ark
13
.22
.91
2.1
10
.81
5.7
16
.22
.41
6.1
14
.21
7.4
23
.02
3.0
***
28
.84
.9
Ge
rman
y1
3.9
3.0
12
.91
1.7
16
.21
6.4
2.2
15
.91
4.8
17
.42
2.5
22
.6**
*2
8.1
6.0
Gre
ece
14
.13
.91
3.0
11
.01
7.5
16
.12
.81
5.7
14
.21
7.8
22
.02
2.2
**2
9.5
7.5
Ital
y1
3.2
2.9
13
.21
0.7
15
.11
4.7
2.3
15
.01
3.6
16
.12
1.6
21
.9**
*2
7.4
4.5
Ne
the
rlan
ds
14
.52
.91
3.5
12
.11
7.3
15
.72
.01
5.4
14
.61
7.2
21
.32
1.2
*2
7.6
3.3
Spai
n1
3.6
2.8
13
.91
1.3
16
.01
5.2
2.6
15
.21
3.8
16
.72
1.6
21
.4**
*2
7.9
4.7
Swe
de
n1
2.5
3.0
11
.61
0.1
14
.51
4.5
2.5
14
.71
3.2
16
.22
1.9
22
.3**
*2
7.8
5.8
Un
ite
dK
ing
do
m1
3.2
2.8
12
.41
1.2
14
.41
6.4
2.4
16
.21
4.7
18
.32
3.2
22
.9**
*2
9.1
5.9
To
tal,
me
n1
3.4
3.1
12
.81
1.0
15
.91
5.6
2.6
15
.51
4.1
17
.22
2.2
22
.3**
*2
8.3
5.5
To
tal,
bo
thse
xes
12
.73
.01
2.2
10
.51
4.8
15
.82
.31
5.8
14
.31
7.4
23
.12
3.3
***
29
.64
.9
IQR
-in
terq
uar
tile
ran
ge
;SD
-st
and
ard
de
viat
ion
;Lo
A-
95
%lim
its
of
agre
em
en
t;ra
ng
eo
fb
ias
incl
ud
es
the
valu
es
be
twe
en
2.5
than
d9
7.5
thp
erc
en
tile
;A
cc+H
R-
com
bin
ed
acce
lero
me
ter
and
he
art
rate
mo
nit
or.
*p,
0.0
5,
**p
,0
.01
,**
*p,
0.0
01
for
bia
s.d
oi:1
0.1
37
1/j
ou
rnal
.po
ne
.00
92
82
9.t
00
4
Validity of Electronically Administered RPAQ
PLOS ONE | www.plosone.org 9 March 2014 | Volume 9 | Issue 3 | e92829
Ta
ble
5.
Do
mai
n-s
pe
cifi
ce
ne
rgy
exp
en
dit
ure
fro
mth
eR
PA
Qan
dp
arti
alco
rre
lati
on
wit
ho
bje
ctiv
ely
asse
sse
dp
hys
ical
acti
vity
en
erg
ye
xpe
nd
itu
read
just
ed
for
allo
the
rd
om
ain
s(5
80
me
nan
d1
34
3w
om
en
).
PA
EE
for
leis
ure
(kJ/
kg
/da
y)
PA
EE
at
wo
rk(k
J/k
g/d
ay
)P
AE
Efo
rco
mm
uti
ng
(kJ/
kg
/da
y)
PA
EE
at
ho
me
(kJ/
kg
/da
y)
Me
dia
nIQ
Rr
p-v
alu
efo
rr
Me
dia
nIQ
Rr
p-v
alu
efo
rr
Me
dia
nIQ
Rr
p-v
alu
efo
rr
Me
dia
nIQ
Rr
p-v
alu
efo
rr
Wo
me
n,
N=
13
43
De
nm
ark
15
.31
0.8
24
.50
.12
0.0
10
15
.91
2.5
32
.00
.06
,0
.00
10
.90
2.8
0.1
20
.37
54
.12
.55
.82
0.2
50
.00
5
Fran
ce9
.35
.41
8.3
0.1
10
.13
81
3.9
9.2
20
.40
.21
0.0
06
0.4
01
.30
.10
0.1
75
3.5
2.1
5.7
20
.24
0.0
02
Ge
rman
y1
4.8
8.2
29
.40
.22
0.0
04
16
.31
1.5
23
.20
.19
0.0
02
0.6
0.1
1.7
0.1
10
.00
83
.21
.95
.02
0.2
30
.08
5
Gre
ece
8.5
3.6
14
.60
.18
,0
.00
11
5.0
10
.12
9.2
0.3
1,
0.0
01
0.0
00
.40
.01
0.2
10
3.0
1.7
4.7
20
.13
0.5
08
Ital
y7
.93
.51
9.0
0.2
3,
0.0
01
13
.71
0.9
20
.70
.31
,0
.00
10
.40
1.7
20
.01
0.9
60
2.0
1.2
3.6
0.2
80
.04
3
Ne
the
rlan
ds
37
.92
6.4
58
.12
0.0
30
.54
98
.23
.61
4.6
0.0
80
.25
40
.50
4.3
0.1
30
.03
13
.82
.45
.72
0.1
70
.04
3
No
rway
9.6
4.4
16
.80
.30
,0
.00
11
5.9
11
.63
3.6
0.1
20
.12
30
.60
.22
.20
.19
0.0
14
3.6
2.7
5.8
20
.05
0.5
13
Spai
n1
3.0
4.9
21
.90
.27
,0
.00
11
4.1
11
.01
7.1
20
.13
0.0
13
0.3
0.0
1.6
0.0
80
.06
62
.31
.33
.42
0.0
40
.28
1
Swe
de
n7
.54
.41
1.1
20
.06
0.9
77
17
.41
2.2
30
.50
.19
0.1
53
2.1
0.9
6.7
0.2
80
.02
13
.82
.65
.52
0.3
40
.00
0
Un
ite
dK
ing
do
m1
3.5
7.7
23
.32
0.0
90
.47
91
6.2
8.8
27
.90
.30
,0
.00
10
.20
1.1
0.1
20
.12
94
.83
.16
.82
0.1
60
.03
1
To
tal,
wo
me
n1
2.6
6.0
25
.10
.13
0.1
99
14
.71
0.2
25
.10
.16
0.0
63
0.4
01
.90
.11
0.1
98
3.4
2.0
5.4
20
.13
0.1
58
p2
valu
e,
0.0
01
,0
.00
1,
0.0
01
,0
.00
1
Me
n,
N=
58
0
De
nm
ark
21
.11
0.3
32
.10
.28
0.0
31
31
.31
5.1
44
.20
.45
,0
.00
10
.50
1.9
20
.04
0.7
50
4.5
3.1
6.3
20
.14
0.2
93
Ge
rman
y2
0.9
10
.03
9.9
0.1
80
.11
01
9.6
10
.64
2.5
0.3
10
.00
50
.40
3.0
0.3
10
.00
54
.93
.08
.10
.05
0.6
60
Gre
ece
9.7
2.5
19
.30
.38
0.0
02
17
.71
3.3
26
.20
.34
0.0
06
0.1
00
.40
.13
0.2
93
3.7
1.8
7.0
0.0
40
.74
4
Ital
y1
4.0
7.6
33
.40
.47
0.0
01
16
.01
1.2
34
.00
.33
0.0
20
0.6
0.2
1.4
0.0
20
.86
92
.31
.43
.62
0.2
10
.13
7
Ne
the
rlan
ds
29
.61
6.2
46
.20
.06
0.7
59
14
.19
.71
6.2
20
.06
0.7
62
1.8
05
.30
.16
0.4
28
4.9
2.1
7.4
20
.12
0.5
38
Spai
n1
7.0
8.7
35
.50
.20
0.0
65
14
.71
1.4
27
.60
.35
0.0
01
0.3
0.1
1.6
0.2
50
.01
82
.91
.44
.12
0.1
20
.27
6
Swe
de
n1
1.1
7.0
17
.02
0.0
60
.61
52
0.4
12
.74
9.9
0.0
00
.99
51
.10
.43
.90
.16
0.1
62
3.2
2.1
4.9
20
.21
0.0
63
Un
ite
dK
ing
do
m2
1.7
11
.43
6.9
0.1
30
.23
12
1.9
9.6
50
.50
.48
,0
.00
10
.20
0.9
20
.18
0.0
82
4.6
3.4
7.2
20
.16
0.1
21
To
tal,
me
n1
6.0
8.1
30
.90
.19
0.2
07
18
.31
2.3
36
.50
.30
0.2
04
0.4
02
.00
.10
0.2
64
3.7
2.3
6.2
20
.11
0.3
28
p-v
alu
e,
0.0
01
,0
.00
1,
0.0
01
,0
.00
1
Ab
bre
viat
ion
s:P
AEE
-p
hys
ical
acti
vity
en
erg
ye
xpe
nd
itu
re;
MV
PA
-m
od
era
teto
vig
oro
us
ph
ysic
alac
tivi
ty;
IQR
-in
terq
uar
tile
ran
ge
;r-
par
tial
corr
ela
tio
nco
eff
icie
nts
(r)
be
twe
en
do
mai
n-s
pe
cifi
cP
Aas
sess
ed
by
the
RP
AQ
and
ob
ject
ive
lym
eas
ure
dto
tal
PA
adju
ste
dfo
ral
lo
the
rd
om
ain
s;P
AEE
for
wo
rkw
asca
lcu
late
do
nly
for
par
tici
pan
tsw
ho
rep
ort
ed
be
ing
em
plo
yed
;p
-val
ue
for
the
dif
fere
nce
acro
ssco
un
trie
s(K
rusk
al-W
allis
test
).d
oi:1
0.1
37
1/j
ou
rnal
.po
ne
.00
92
82
9.t
00
5
Validity of Electronically Administered RPAQ
PLOS ONE | www.plosone.org 10 March 2014 | Volume 9 | Issue 3 | e92829
participants, the revisited median (IQR) for occupational and total
RPAQ-derived PAEE were 8.4 (5.6, 13.1) kJ/kg/day (30% lower
than in original derivation) and 28.3 (18.8, 43.4) kJ/kg/day (23%
lower than in original derivation), respectively. Similarly, median
bias (LoA) became materially smaller in manual and heavy manual
workers but increased somewhat in sedentary and standing
workers (p,0.001 in all groups). The revisited median bias
(LoA) for all occupations was 213.4 (226.0, 0.6) kJ/kg/day,
corresponding to 28.8% of median PAEE.
Discussion
The results of this study suggest that the RPAQ is a valid
instrument for the assessment of PAEE, MVPA and SED-time in
the adult European population. Although relative validity of
questionnaire-derived PAEE and MVPA against objectively
measured variables is comparable with previously validated
questionnaires, the magnitude of underestimation of PAEE with
the RPAQ appears lower compared to other questionnaires.
The observed inter-method correlations for PAEE and MVPA
are consistent with the findings based on the Cambridge Index
from the Short EPIC-PA-questionnaire [30]. Fair to moderate
correlations between questionnaire-derived and objectively assess-
ed PAEE in this study are comparable with previous results using
objective criterion methods (accelerometer, HR monitor or
combined HR and movement sensor) with correlations around
0.3 [43–47]. Prince et al. [48] reviewed 173 validation studies and
found that the mean (SD) of correlation coefficients between PA-
questionnaires and an objective criterion method was 0.37 (0.25),
ranging from 20.71 to 0.96. Van Poppel et al. [49] systematically
reviewed 85 PA-questionnaires for adults and concluded that the
methodological quality of studies assessing measurement proper-
ties of PA-questionnaires was suboptimal (mainly due to small
sample size, inadequate analysis of construct validity or compar-
ison of measures that do not assess the same construct) and that no
questionnaire or type of questionnaire is superior to the others.
Helmerhorst et al. [9] conducted a systematic review of 96 existing
and 34 newly developed PA-questionnaires and concluded that
majority of the PA-questionnaires had acceptable reliability, but
their validity was moderate. Newly developed PA-questionnaires
did not appear to perform better than the existing PA-question-
naires with regard to reliability and validity [9]. In addition, the
majority of studies reported only correlation coefficients between
the questionnaire and the criterion method which precludes
comparing absolute validity between studies. Nevertheless, these
reviews pointed to the heterogeneity in the differences between
self-reported and objectively measured PAEE, with both overes-
timation and underestimation being probable[48–50].
In terms of the comparison with the criterion validity of
commonly used surveillance instruments (GPAQ and IPAQ),
Spearman’s correlation coefficients between total PA-time from
the GPAQ with pedometer- and accelerometer-assessed counts/
day in 9 countries [51] were 0.31 and 0.24, respectively, suggesting
a similar degree of relative validity as observed for the RPAQ in
our study. The corresponding correlation coefficient for sedentary
time from GPAQ and accelerometry was 0.40 [51]. For IPAQ
(short form), Spearman’s rho varied from 20.12 to 0.57 for total
PA, and from 0.07 to 0.61 for sedentary time when compared with
corresponding accelerometer-assessed variables [45]. Despite the
marked differences between these questionnaires (i.e. questions
about time spent in broad intensity levels as opposed to specific
activities), validity of estimates appears to be similar. However,
unlike IPAQ and GPAQ information, RPAQ information may be
summarised in other ways than caloric derivatives evaluated in this
article which might be important for specific health outcomes, e.g.
activities with an element of weight-bearing may have a beneficial
effect on bone density [52], or activities performed in groups
present greater opportunity for social interaction [53].
As systematic differences between instruments do not affect the
correlation coefficients but may substantially affect agreement,
both relative and absolute validity were investigated. The
underestimation of PAEE by the RPAQ is consistent with the
findings of our previous validation study using doubly labelled
water as the criterion [16], but the size of bias in the current larger
study is smaller (median(LoA)) for all participants: 24.6 (246.0,
78.7) kJ/kg/day (211%), which is equivalent to 277 (2768, 1314)
kcal/day for a person with a body weight of the sample mean.
Underestimation of PAEE in our study is also in accordance with
several other studies that used objective criterion for the validation
of PA-questionnaire, but the size of bias of the RPAQ appears to
be smaller. For example, the 7-d Physical Activity Recall by
Leenders et al. [54] had a mean bias(LoA) of 2156 (21095, 1306)
kcal/day (220%), the Minnesota Leisure Time Questionnaire
[55] a mean bias(LoA) of 2313 (21188, 562) kcal/day (239%),
and the College Alumnus Physical Activity Questionnaire [55] a
mean bias of 2240 (21076, 596) kcal/day (230%).
A consistent finding of positive association of bias with inter-
method average in Bland-Altman plots, but inverse association
with objectively measured PAEE, MVPA and SED-time suggests
that the average was predominantly driven by self-reported
parameters that have a different error structure than those
obtained by the combined sensor. Therefore, the direction of
proportional error should be interpreted with caution.
The observation that SED-time was underestimated by the
RPAQ is in line with previous reports [43,46,48,56]. However, the
reasons for sex differences in absolute validity of the RPAQ to
ascertain MVPA are unclear, but there was evidence of substantial
overestimation when the standard definition of 1MET was used to
derive objective variables, the definition used in most other studies.
The limits of agreement are comparable to the findings of studies
which sought to assess absolute validity of PA-questionnaires
against an objective method [50].
Furthermore, modest partial correlations were observed be-
tween domain-specific PAEE from the RPAQ and objectively
measured total PAEE, although the partial correlation for
domestic PA was negative. This finding is consistent with previous
reports [7,43]. However, domestic PA assessed by the RPAQ was
comprised of mainly sedentary pursuits (TV-viewing at 1MET and
computer use at 1.5 MET) and stair climbing (which is generally
very short in duration) but did not include household chores,
which suggests that PA in this particular domain might have been
underestimated or that the assigned energy cost is inaccurate.
Given the inability of the criterion method to discriminate the
domains of PA, the validity of domain-specific PAEE could not be
assessed.
A major strength of this study is its large sample of adult men
and women from 10 European countries (representative of the
EPIC-cohort with respect to age and sex), which allows
examination of country-specific validity. Moreover, HR was
individually calibrated, the sensor was worn at two independent
time-points for at least 4 consecutive days, and procedures were
standardized across the centres, all of which are design features
that help improve the precision of the criterion measure. In
addition, the objective criterion measure has a different error
structure compared to the RPAQ, thus eliminating the possibility
of correlated errors which could have occurred had the RPAQ
been validated against a PA-log or diary [57]. The RPAQ was
administered electronically (except in Sweden), which reduced the
Validity of Electronically Administered RPAQ
PLOS ONE | www.plosone.org 11 March 2014 | Volume 9 | Issue 3 | e92829
time required to distribute the questionnaires and receive answers
and eliminated the need for the research teams to enter hand-
written responses manually into computer, thus decreasing the
possibility of transcription error and significantly reducing
research cost. Lastly, combined HR and movement sensing as a
criterion measure of PA overcomes some of the weaknesses of HR
and accelerometry when used separately; this includes the limited
validity of HR monitoring for sedentary behaviour (due to HR
being influenced by factors other than PA and therefore being less
valid for the assessment of light PA and sedentary behaviour) and
inability of accelerometry to capture PAEE during cycling,
swimming or upper-body activity [37,39].
Several limitations need to be considered when interpreting the
results of this study. Energy costs estimated from tabulated values
[36] do not allow for between-individual variations in PAEE for a
given activity [7,58]. Therefore, a single estimate of energy cost
applied to all individuals pursuing a particular activity does not
capture different intensities and heterogeneity in mechanical and
metabolic efficiency. Prior to calculating RPAQ-derived PAEE, no
assumption about within-individual variation in activity intensity
was made, i.e. a particular activity is assigned the same intensity
for the entire reported duration, yet in reality, it is likely that both
within- and between-individual variation in intensity of most
activities exist over time. This is especially emphasised in the
occupational domain where the hypothesised intensity is used to
calculate PAEE for the whole reported work duration (typically .
7 hrs/day) notwithstanding its variability during that period.
Indeed, when we revisited the intensity distribution assumption
during working hours, it led to a considerable decrease in RPAQ-
derived PAEE in all occupational categories, and an appreciable
reduction in bias in those with the greatest bias (manual and heavy
manual workers). Nevertheless, this approach seems to slightly
increase the bias in sedentary occupations, which were the most
prevalent in this sample, thus leading to a worsening of the sample
bias. The analysis is limited by a low number of participants with
physically demanding occupations, and therefore the utility of the
empirically-derived intensity distribution should be tested in a
larger sample to gain a better insight into its impact on
questionnaire-derived PAEE and bias. Future research should
also investigate the effect of this approach on the associations
between occupational PA and health outcomes.
An intrinsic limitation of objective PA-monitoring is that it
typically provides only a snap-shot of an individual’s habitual PA
(4–5 days), whereas the reference period of the RPAQ was past 4
weeks. Despite measuring PA objectively at two visits and
capturing a range of PA-patterns, differences in PA between
weekend days and weekdays might have been ascertained in a
more detail over one entire week of monitor wear. Similarly,
seasonal variation in PA might not have been reliably captured by
only two assessments, a phenomenon which applies to a single
administration of the RPAQ as well [59].
In conclusion, the relative and absolute validities of the RPAQ
in estimating PAEE and MVPA are consistent with the results of
previous validation studies and the limitations (e.g. bias and weak
correlations) need to be considered when interpreting RPAQ-data.
For example, population estimates of PAEE would be valid,
whereas using the tool to address aetiological questions would
result in an attenuation of risk estimates between activity and
disease. Nevertheless, the electronic RPAQ is a convenient tool
and can be used with reasonable confidence in large-scale
epidemiological studies in European countries to compare
population estimates of total and domain-specific PA as well as
other summary measures of PA, and to examine associations
between PA and health outcomes.
Supporting Information
Figure S1 Bland-Altman plots of physical activity ener-gy expentiture (kJ/kg/day), time in moderate-to-vigor-ous physical activity (min/day) and sedentary time (h/day) from RPAQ and combined sensing stratified by sexusing individualised definition of 1MET; solid linerepresents median bias, and dashed lines denote limitsof agreement.
(TIFF)
Figure S2 Bland-Altman plots of time in moderate-to-vigorous physical activity (min/day) and sedentary time(h/day) from RPAQ and combined sensing stratified bysex using standard definition of 1MET = 3.5 ml O2/kg/min (1343 women and 540 men); solid line representsmedian bias, and dashed lines denote limits of agree-ment.
(TIFF)
Figure S3 Spearman’s correlation coefficients for theassociations of MVPA and sedentary time assessed bythe RPAQ with objectively measured correspondingvariables by country and sex using standard definitionof 1MET = 3.5 ml O2/kg/min (1343 women and 540men).
(TIFF)
Figure S4 Spearman’s correlation coefficients for theassociations of objectively assessed PAEE and time atMVPA with the Cambridge Index in the RPAQ validationstudy cohort (N = 1923, 1343 women and 540 men).
(TIFF)
Figure S5 Intensity distribution during working hoursfrom Monday to Friday by occupational group Index inthe RPAQ validation study cohort (N = 1923, 1343 womenand 540 men) using individualised definition of 1 MET.Inserts of each graph show zoomed view of intensity distribution in
the MVPA (.3 METs) zone. All values have been normalised to
bin size 0.25 METs. Data are median (IQR).
(TIFF)
Figure S6 Intensity distribution during working hoursfrom Monday to Friday by occupational group Index inthe RPAQ validation study cohort (N = 1923, 1343 womenand 540 men) using standard definition of1MET = 3.5 ml O2/kg/min. Inserts of each graph show
zoomed view of intensity distribution in the MVPA (.3 METs)
zone. All values have been normalised to bin size 0.25 METs.
Data are median (IQR).
(TIFF)
Table S1 Time spent in moderate to vigorous physicalactivity (min/day) as assessed by the Recent PhysicalActivity Questionnaire and combined movement sensorand heart rate monitor, N = 1923. Abbreviations: IQR-
interquartile range; LOA- limits of agreement; range of bias
includes the values between 2.5th and 97.5th percentile; Acc+HR-
combined accelerometer and heart rate monitor; Monitor data in
this analysis was processed using standard definition of 1 MET
(3.5 ml O2/kg/min). *p,0.05, **p,0.01, ***p,0.001 for bias.
(DOC)
Table S2 Time spent sedentary (h/day) as assessed bythe Recent Physical Activity Questionnaire and com-bined movement sensor and heart rate monitor,N = 1923. Abbreviations: IQR- interquartile range; LOA- limits
Validity of Electronically Administered RPAQ
PLOS ONE | www.plosone.org 12 March 2014 | Volume 9 | Issue 3 | e92829
of agreement; range of bias includes the values between 2.5th and
97.5th percentile; Acc+HR- combined accelerometer and heart
rate monitor; Monitor data in this analysis was processed using
standard definition of 1 MET (3.5 ml O2/kg/min). *p,0.05,
**p,0.01, ***p,0.001 for bias.
(DOC)
Acknowledgments
We are grateful to all study participants and all persons who contributed to
the data collection across the study sites. We would also like to thank the
MRC Epidemiology Unit physical activity technical team and data
management team, in particular Mark Betts, Laura Lamming, Stefanie
Mayle, Kate Westgate and Nicola Kerrison who assisted with data
reduction, cleaning and processing.
Author Contributions
Conceived and designed the experiments: SB UE NW PWF MV EV DP
PA MJTD MAC KO KBB AMM. Performed the experiments: SB PWF
MV EV DP PA MJTD MAC KO KBB AMM. Analyzed the data: RG.
Wrote the paper: RG SB UE.
References
1. Haskell WL, Lee IM, Pate RR, Powell KE, Blair SN, et al. (2007) Physical
activity and public health: updated recommendation for adults from the
American College of Sports Medicine and the American Heart Association. Med
Sci Sports Exerc 39: 1423–1434.
2. Miles L (2007) Physical activity and health. British Nutrition Foundation
Nutrition Bulletin: 314–343.
3. Lee IM, Shiroma EJ, Lobelo F, Puska P, Blair SN, et al. (2012) Effect of physical
inactivity on major non-communicable diseases worldwide: an analysis of
burden of disease and life expectancy. Lancet 380: 219–229.
4. Hallal PC, Andersen LB, Bull FC, Guthold R, Haskell W, et al. (2012) Global
physical activity levels: surveillance progress, pitfalls, and prospects. Lancet 380:
Impact of personalised feedback about physical activity on change in objectively
measured physical activity (the FAB study): a randomised controlled trial. PLoS
One 8: e75398.
22. Parkinson KN, Pearce MS, Dale A, Reilly JJ, Drewett RF, et al. (2011) Cohort
profile: the Gateshead Millennium Study. Int J Epidemiol 40: 308–317.
23. Bell R, Tennant PW, McParlin C, Pearce MS, Adamson AJ, et al. (2013)
Measuring physical activity in pregnancy: a comparison of accelerometry andself-completion questionnaires in overweight and obese women. Eur J Obstet
Gynecol Reprod Biol 170: 90–95.
24. Mediano MF, Neves FA, Cunha AC, de Souza EP, Moura AS, et al. (2013)
Changes in body weight, C-reactive protein, and total adiponectin in non-obese
women after 12 months of a small-volume, home-based exercise program.Clinics (Sao Paulo) 68: 1121–1127.
25. Nanchahal K, Power T, Holdsworth E, Hession M, Sorhaindo A, et al. (2012) Apragmatic randomised controlled trial in primary care of the Camden Weight
Loss (CAMWEL) programme. BMJ Open 2.
26. Smith NR, Clark C, Fahy AE, Tharmaratnam V, Lewis DJ, et al. (2012) The
Olympic Regeneration in East London (ORiEL) study: protocol for aprospective controlled quasi-experiment to evaluate the impact of urban
regeneration on young people and their families. BMJ Open 2.
27. Barker M, Baird J, Lawrence W, Jarman M, Black C, et al. (2011) TheSouthampton Initiative for Health: a complex intervention to improve the diets
and increase the physical activity levels of women from disadvantagedcommunities. J Health Psychol 16: 178–191.
28. Cave Hill Campus Barbados, Annual Report to Council 2010/2011.
29. Brage S, Brage N, Franks PW, Ekelund U, Wareham NJ (2005) Reliability and
validity of the combined heart rate and movement sensor Actiheart. Eur J Clin
Nutr 59: 561–570.
30. InterAct C (2012) Validity of a short questionnaire to assess physical activity in
10 European countries. Eur J Epidemiol 27: 15–25.
31. Riboli E, Hunt KJ, Slimani N, Ferrari P, Norat T, et al. (2002) European
Prospective Investigation into Cancer and Nutrition (EPIC): study populationsand data collection. Public Health Nutr 5: 1113–1124.
32. Ainsworth BE, Jacobs DR, Jr., Leon AS, Richardson MT, Montoye HJ (1993)Assessment of the accuracy of physical activity questionnaire occupational data.
J Occup Med 35: 1017–1027.
33. Richardson MT, Leon AS, Jacobs DR, Jr., Ainsworth BE, Serfass R (1994)Comprehensive evaluation of the Minnesota Leisure Time Physical Activity
Questionnaire. J Clin Epidemiol 47: 271–281.
34. The Sports Council and Health Education Authority (1992) Allied Dunbar
National Fitness Survey. London, United Kingdom: Health EducationAuthority.
35. MRC Epidemiology Unit, 2013 http://www.mrc-epid.cam.ac.uk/research/
36. Ainsworth BE, Haskell WL, Whitt MC, Irwin ML, Swartz AM, et al. (2000)
Compendium of physical activities: an update of activity codes and METintensities. Med Sci Sports Exerc 32: S498–504.
37. Brage S, Ekelund U, Brage N, Hennings MA, Froberg K, et al. (2007) Hierarchyof individual calibration levels for heart rate and accelerometry to measure
physical activity. J Appl Physiol 103: 682–692.
38. Stegle O, Fallert SV, MacKay DJ, Brage S (2008) Gaussian process robust
regression for noisy heart rate data. IEEE Trans Biomed Eng 55: 2143–2151.
39. Brage S, Brage N, Franks PW, Ekelund U, Wong MY, et al. (2004) Branchedequation modeling of simultaneous accelerometry and heart rate monitoring
improves estimate of directly measured physical activity energy expenditure.J Appl Physiol 96: 343–351.
40. Tremblay MS, Colley RC, Saunders TJ, Healy GN, Owen N Physiological andhealth implications of a sedentary lifestyle. Appl Physiol Nutr Metab 35: 725–
740.
41. Henry CJ (2005) Basal metabolic rate studies in humans: measurement anddevelopment of new equations. Public Health Nutr 8: 1133–1152.
42. Bland JM, Altman DG (1986) Statistical methods for assessing agreementbetween two methods of clinical measurement. Lancet 1: 307–310.
43. Peters TM, Moore SC, Xiang YB, Yang G, Shu XO, et al. Accelerometer-measured physical activity in Chinese adults. Am J Prev Med 38: 583–591.
44. Cust AE, Smith BJ, Chau J, van der Ploeg HP, Friedenreich CM, et al. (2008)Validity and repeatability of the EPIC physical activity questionnaire: a
validation study using accelerometers as an objective measure. Int J Behav Nutr
Phys Act 5: 33.
45. Craig CL, Marshall AL, Sjostrom M, Bauman AE, Booth ML, et al. (2003)
International physical activity questionnaire: 12-country reliability and validity.Med Sci Sports Exerc 35: 1381–1395.
Validity of Electronically Administered RPAQ
PLOS ONE | www.plosone.org 13 March 2014 | Volume 9 | Issue 3 | e92829