Top Banner
Measuring listening-related fatigue Behavioural and physiological markers Ronan McGarrigle 1 , Piers Dawes 1 , Andrew Stewart 1 , Stefanie Kuchinsky 3,4 , & Kevin Munro 1,2 1 School of Psychological Sciences, University of Manchester, UK. 2 Central Manchester University Hospitals NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK. 3 Center for Advanced Study of Language, University of Maryland, USA. 4 Maryland Neuroimaging Center, University of Maryland, USA. Background Individuals with hearing loss commonly report fatigue due to the need for sustained effortful listening in everyday situations (Bess & Hornsby, 2014) Decreasing pupil size over time reflects a reduction in levels of autonomic arousal and has been found to relate to increased levels of reported fatigue (Hopstaken et al., 2014) Changes in pupil size covary with BOLD changes in locus coeruleus activity, which governs our attention-arousal system (Aston-Jones & Cohen, 2005; Murphy et al., 2014) Increasing behavioural response times over the course of an experiment may represent a behavioural marker of mental fatigue (Hornsby, 2013) It is not clear whether or not these objective measures are sensitive to differences in fatigue during more naturalistic listening (i.e., conditions that require sustained processing) Research Question Are behavioural and physiological markers of mental fatigue sensitive to differences in signal-to- noise ratio (SNR) during a narrative speech processing task? Method Conclusions Speech-picture verification task Growth curve analysis revealed a significantly steeper linear decrease (i.e., slope) in pupil size over time in the hard versus the easy listening condition, which was more pronounced in the 2 nd versus the 1 st half of each trial block. This supports the hypothesised increase in mental fatigue over time in the more challenging (hard) listening condition Behavioural (response time) measures of fatigue did not reveal any difference in the rate of change over time between listening conditions. This suggests that either: Response times are not as sensitive as pupillometric measures at detecting listening-related fatigue, or Pupil size is indexing a separate phenomenon Pupil size changes over time may represent a sensitive physiological measure of the mental fatigue associated with sustained effortful listening Pupillometry Behavioural Results References Aston-Jones, G., & Cohen, J.D. (2005). An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annu. Rev. Neurosci., 28, 403-450. Bess, F.H., & Hornsby, B.W. (2014). Commentary: Listening can be exhausting—Fatigue in children and adults with hearing loss. Ear and Hearing, 35, 592-599. Hopstaken, J.F., Linden, D., Bakker, A.B., & Kompier, M.A. (2014). A multifaceted investigation of the link between mental fatigue and task disengagement. Psychophysiology, 52, 305-315. Hornsby, B.W. (2013). The effects of hearing aid use on listening effort and mental fatigue associated with sustained speech processing demands. Ear and Hearing, 34, 523-534. Murphy, P.R., O'Connell, R.G., O'Sullivan, M., Robertson, I.H., & Balsters, J.H. (2014). Pupil diameter covaries with BOLD activity in human locus coeruleus. Human brain mapping, 35, 4140-4154. “Bob lives near a beautiful park and loves going for long walks there during Spring. This time he decided to bring binoculars to see if he could spot any pigeons in the trees. Fortunately, he managed to catch a glimpse of one perching in its nest.” NO YES Listening conditions Easy: + 15 dB SNR Hard: - 8 dB SNR Background noise Multi-talker babble Experiment duration Trial duration 50 minutes 13-18 secs Participants 24 normal-hearing young adults Analysis Correct responses only were analysed for both pupillometry and behavioural data 1 second of noise pre speech-onset used as a baseline to measure relative change in pupil size in each trial Growth Curve Analysis used to capture potential curvilinear change in the pupil response Response times were log-transformed to approximate a normal distribution [email protected] The pupil response plotted as a function of time in the 1 st (left) versus the 2 nd (right) half of each listening condition block (circles = raw data, lines = cubic model fit) Significant condition X block ‘half’ interaction on the linear term (χ² = 3.98, p = 0.05). In other words, participants showed a steeper sloping pupil response for ‘hard’ versus ‘easy’ in the 2 nd versus the 1 st half of the block logRTs as a function of trial number across each listening condition block Significant difference in overall mean logRT between conditions (χ² = 10.29, p = 0.001). However, no difference in their rate of change (linear term), χ² = 0.12, p = 0.73, or in terms of the shape of the primary (U- shaped) inflection curve (quadratic term), χ² = 1.63, p = 0.20 Experimental Design Blocks of Easy and Hard trials, with order counterbalanced across p’s Acknowledgements: Thank you to Castang Foundation for providing funding for this PhD work
1

Measuring listening-related fatigue - Vanderbilt University · Measuring listening-related fatigue Behavioural and physiological markers Ronan McGarrigle1, Piers Dawes1, Andrew Stewart1,

Mar 29, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Measuring listening-related fatigue - Vanderbilt University · Measuring listening-related fatigue Behavioural and physiological markers Ronan McGarrigle1, Piers Dawes1, Andrew Stewart1,

Measuring listening-related fatigue

Behavioural and physiological markers

Ronan McGarrigle1, Piers Dawes1, Andrew Stewart1, Stefanie Kuchinsky3,4, & Kevin Munro1,2

1School of Psychological Sciences, University of Manchester, UK. 2Central Manchester University Hospitals NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK.

3Center for Advanced Study of Language, University of Maryland, USA. 4Maryland Neuroimaging Center, University of Maryland, USA.

Background Individuals with hearing loss commonly report fatigue due to the need for sustained effortful listening in everyday situations (Bess & Hornsby, 2014) Decreasing pupil size over time reflects a reduction in levels of autonomic arousal and has been found to relate to increased levels of reported fatigue (Hopstaken et al., 2014) • Changes in pupil size covary with BOLD changes in locus coeruleus activity, which governs our

attention-arousal system (Aston-Jones & Cohen, 2005; Murphy et al., 2014)

Increasing behavioural response times over the course of an experiment may represent a behavioural marker of mental fatigue (Hornsby, 2013) It is not clear whether or not these objective measures are sensitive to differences in fatigue during more naturalistic listening (i.e., conditions that require sustained processing) Research Question Are behavioural and physiological markers of mental fatigue sensitive to differences in signal-to-noise ratio (SNR) during a narrative speech processing task?

Method

Conclusions

Speech-picture verification task

• Growth curve analysis revealed a significantly steeper linear decrease (i.e., slope) in pupil size over time in the hard versus the easy listening condition, which was more pronounced in the 2nd versus the 1st half of each trial block. This supports the hypothesised increase in mental fatigue over time in the more challenging (hard) listening condition

• Behavioural (response time) measures of fatigue did not reveal any difference in the rate of change over time between listening conditions. This suggests that either:

Response times are not as sensitive as pupillometric measures at detecting listening-related fatigue, or Pupil size is indexing a separate phenomenon

• Pupil size changes over time may represent a sensitive physiological measure of the mental fatigue associated with

sustained effortful listening

Pupillometry

Behavioural

Results

References Aston-Jones, G., & Cohen, J.D. (2005). An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annu. Rev. Neurosci., 28, 403-450. Bess, F.H., & Hornsby, B.W. (2014). Commentary: Listening can be exhausting—Fatigue in children and adults with hearing loss. Ear and Hearing, 35, 592-599. Hopstaken, J.F., Linden, D., Bakker, A.B., & Kompier, M.A. (2014). A multifaceted investigation of the link between mental fatigue and task disengagement. Psychophysiology, 52, 305-315. Hornsby, B.W. (2013). The effects of hearing aid use on listening effort and mental fatigue associated with sustained speech processing demands. Ear and Hearing, 34, 523-534. Murphy, P.R., O'Connell, R.G., O'Sullivan, M., Robertson, I.H., & Balsters, J.H. (2014). Pupil diameter covaries with BOLD activity in human locus coeruleus. Human brain mapping, 35, 4140-4154.

“Bob lives near a beautiful park and loves going for long walks there during Spring. This time he decided to bring binoculars to see if he could spot any pigeons in the trees. Fortunately, he

managed to catch a glimpse of one perching in its nest.”

NO YES

Listening conditions Easy: + 15 dB SNR Hard: - 8 dB SNR

Background noise

Multi-talker babble

Experiment duration Trial duration 50 minutes 13-18 secs

Participants 24 normal-hearing young adults

Analysis

• Correct responses only were analysed for both pupillometry and behavioural data

• 1 second of noise pre speech-onset used as a baseline to measure relative change in pupil size in each trial

• Growth Curve Analysis used to capture potential curvilinear change in the pupil response • Response times were log-transformed to approximate a normal distribution

[email protected]

• The pupil response plotted as a function of time in the 1st (left) versus the 2nd (right) half of each listening condition block (circles = raw data, lines = cubic model fit)

• Significant condition X block ‘half’ interaction on the linear term (χ² = 3.98, p = 0.05). In other words, participants showed a steeper sloping pupil response for ‘hard’ versus ‘easy’ in the 2nd versus the 1st half of the block

• logRTs as a function of trial number across each listening condition block

• Significant difference in

overall mean logRT between conditions (χ² = 10.29, p = 0.001). However, no difference in their rate of change (linear term), χ² = 0.12, p = 0.73, or in terms of the shape of the primary (U-shaped) inflection curve (quadratic term), χ² = 1.63, p = 0.20

Experimental Design Blocks of Easy and Hard trials, with order counterbalanced across p’s

Acknowledgements: Thank you to Castang Foundation for providing funding for this PhD work