Laughter Perception with Haptic Stimulation Jianchuan Qi Project report submitted in part fulfilment of the requirements for the degree of Master of Science (Human-Computer Interaction with Ergonomics) in the Faculty of Brain Sciences, University College London, 2012. NOTE BY THE UNIVERSITY This project report is submitted as an examination paper. No responsibility can be held by London University for the accuracy or completeness of the material therein.
102
Embed
Laughter Perception with Haptic Stimulation · 2019-11-15 · Laughter Perception with Haptic Stimulation Jianchuan Qi Project report submitted in part fulfilment of the requirements
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Laughter Perception with Haptic Stimulation
Jianchuan Qi
Project report submitted in part fulfilment of the requirements for the
degree of Master of Science (Human-Computer Interaction with Ergonomics)
in the Faculty of Brain Sciences, University College London, 2012.
NOTE BY THE UNIVERSITY
This project report is submitted as an examination paper. No responsibility
can be held by London University for the accuracy or completeness of the
material therein.
- 2 -
ACKNOWLEDGMENTS
I am very much thankful to my supervisor, Dr. Harry Griffin, whose help,
support, guidance and encouragement throughout the entire process of this project
teach me the way to conduct scientific research and develop a deep understanding in
HCI. I would also like to thank Dr. Nadia Berthouze for her valuable suggestions
and support to the project.
Thanks to all participants who attended in the experiment. Thanks to all my
friends and classmates with all the help, especially Ciaran Mcloughlin with whom I
cooperate. Thanks to my family for all they have done for me.
- 3 -
ABSTRACT
Laughter is an important expression in human-human interaction, which serves
to deliver emotional information. With the increasing emergence of technology that
facilitates distance communication, there is a need to facilitate the conveyance of
such non-verbal expressions and also to increase the sense of presence. Haptic
feedback has been previously investigated as a way to convey touch in distance
communication. However, up to now, there are not any studies that investigate the
use of haptic feedback to enhance laughter perception. This project focused on
investigation of whether tactile stimulation is capable of enhancing laughter
perception as a physical medium of laughter. A perceptual experiment was
conducted by measuring people’s perception of laughter in video clips on screen,
while they were provided with vibration stimulations. The results showed that there
was no significant effect of the types of vibrations on ratings of perception of the
laughter from the video, but there was a significant interaction effect between the
type of vibration and the gender of the participants. Based on emotion traits and
states of the participants measured with questionnaire of State-Trait-Cheerfulness-
Inventory, there was no significant interaction effect between the type of vibration
and emotion trait or state.
- 4 -
CONTENTS
List of Images ....................................................................................................... 8
List of Tables ...................................................................................................... 10
.087. The post hoc adjusted with Bonferroni correction confirmed the difference of
arousal perception between respiration pattern vibration and no vibration was
significant for people in a less cheerful emotion trait, with t-test 𝑝 =. 034. Figure 22
shows that people in less cheerful emotion traits perceived more arousal from
laughter with square pattern vibration than with no vibration. Given that the
univariate test only approached significance, it would be appropriate to gather
further data to confirm these findings.
- 64 -
Figure 22 Effect of Cheerful Emotion Trait in Arousal Perceptions with Haptic Stimulation (Error Bar as
SD)
Contrasts also revealed that ratings of dominance with square pattern vibration
were significantly higher than with no vibration (𝐹 1,12 = 3.48,𝑝 =. 044 for 1-
tail test). The post hoc adjusted with Bonferroni correction confirmed the difference
of dominance perception between square pattern vibration and no vibration was
significant for people in less cheerful emotion traits, with t-test 𝑝 =. 010. As Figure
23 shows, square pattern vibration may increase perception of dominance of people
in less cheerful emotion traits. Given that the univariate test did not detect any
significant difference, it would be appropriate to gather further data to confirm these
findings.
1 1.1 1.2 1.3 1.4 1.5 1.6 1.7
Respiration Square None
Arousal
Less Cheerful
More Cheerful
- 65 -
Figure 23 Effect of Cheerful Emotion Trait in Dominance Perceptions with Haptic Stimulation (Error
Bar as SD)
Trait Seriousness
Subjects were median-split to form the two groups with scores of trait
seriousness, which were more serious trait and less serious trait. Among the 18
subjects with nine male and nine female, there were five male regarded as more
serious and four as less cheerful, and four female were identified as more serious
and five as less serious. A Repeated-Measures ANOVA was conducted to
investigate the difference between groups, with emotion trait of seriousness as the
between-subject variable.
The results of multivariate tests show that there was no significant interaction
effect between the type of vibration and emotion trait seriousness, 𝐹 6, 9 =
. 380,𝑝 >. 05. This indicated that emotion trait seriousness had no different effects
on people’s ratings on different types of vibrations. This was confirmed by the
univariate tests and contrasts tests.
-‐0.6
-‐0.4
-‐0.2
0
0.2
Square None
Ratings
Dominance
Less Cheerful
More Cheerful
- 66 -
Trait Bad Mood
After the median-split, data of two subjects whose scores were equal to the
medians were excluded to avoid confounding. A Repeated-Measures ANOVA was
conducted to investigate the difference between groups, with emotion trait of bad
mood as the between-subject variable.
The results of multivariate tests show that there was no significant interaction
effect between the type of vibration and emotion trait bad mood, 𝐹 6, 5 =
. 615,𝑝 >. 05. This indicated that emotion trait bad mood had no different effects on
people’s ratings on different types of vibrations. This was confirmed by the
univariate tests and contrasts tests.
Effect of Emotion State
The emotion traits of subjects were measured by STCI-S. Their scorings at states
of cheerfulness, seriousness and bad mood were calculated. For each measure, the
subjects were median-split into two groups based on their scores.
State Cheerfulness
After the median-split, data of four subjects whose scores were equal to the
medians were excluded to avoid confounding. A Repeated-Measures ANOVA was
conducted to investigate the difference between groups, with emotion state of
cheerfulness as the between-subject variable.
- 67 -
The results of multivariate tests show that there was no significant interaction
effect between the type of vibration and emotion state cheerfulness, 𝐹 6, 5 =
1.07,𝑝 >. 05. This indicated that emotion state cheerfulness had no different effects
on people’s ratings on different types of vibrations. However, the univariate tests
show that there was a significant interaction effect between the type of vibration and
emotion state cheerfulness for laughter pleasure valence perception, 𝐹 2, 20 =
3. 93,𝑝 = .036. Contrasts revealed that ratings of pleasure valence perception with
respiration pattern vibration were significantly different with that with no vibration
(𝐹 1, 10 = 5.21,𝑝 =. 023 for 1-tail test). Contrasts also revealed that ratings of
pleasure valence perception with square pattern vibration were significantly
different with that with no vibration (𝐹 1, 10 = 4.54,𝑝 =. 030 for 1-tail test). As
Figure 24 shows, people in a more cheerful emotion state perceived less pleasure
with vibrotactile stimulation, while people in less cheerful emotion state perceived
more.
- 68 -
Figure 24 Effects of Emotion States of Cheerfulness and Pleasure Perception with Haptic Stimulation
(Error Bar as SD)
The univariate tests also show that there was a significant interaction effect
between the type of vibration and emotion state cheerfulness for laughter arousal
perception, 𝐹 2, 20 = 3. 99,𝑝 = .035. Contrasts revealed that ratings of arousal
perception with respiration pattern vibration were significantly different with that
with no vibration (𝐹 1, 10 = 5.84,𝑝 =. 018 for 1-tail test). Contrasts also revealed
that ratings of arousal perception with square pattern vibration were significantly
different with that with no vibration (𝐹 1, 10 = 6.05,𝑝 =. 015 for 1-tail test). The
post hoc adjusted with Bonferroni correction confirmed the difference of arousal
perception between respiration pattern vibration and no vibration was significant for
people in a less cheerful emotion trait, with t-test 𝑝 =. 014. It also confirmed the
difference of arousal perception between square pattern vibration and no vibration
was significant for people in a less cheerful emotion trait, with t-test 𝑝 =. 032. As
Figure 25 shows, people in a more cheerful emotion state perceived less arousal
1
1.5
2
2.5
Respiration Square None
Ratings
Pleasure-‐Emotion States
Less Cheerful
More Cheerful
- 69 -
with vibrotactile stimulation, while people in less cheerful emotion state perceived
more.
Figure 25 Effects of Emotion States of Cheerfulness and Arousal Perception with Haptic Stimulation
The univariate tests show that there was no significant interaction effect between
the type of vibration and emotion state cheerfulness for laughter dominance
perception, 𝐹 2, 20 = 1.14,𝑝 > .05. This was confirmed by the univariate tests
and contrasts tests.
State Seriousness
After the median-split, data of four subjects whose scores were equal to the
medians were excluded to avoid confounding. A Repeated-Measures ANOVA was
conducted to investigate the difference between groups, with emotion state of
seriousness as the between-subject variable.
The results of multivariate tests show that there was no significant interaction
effect between the type of vibration and emotion state seriousness, 𝐹 6, 5 =
1
1.2
1.4
1.6
1.8
2
Respiration Square None
Ratings
Arousal
Less Cheerful
More Cheerful
- 70 -
. 255,𝑝 >. 05. This indicated that emotion state seriousness had no different effects
on people’s ratings on different types of vibrations. This was confirmed by the
univariate tests and contrasts tests.
State Bad Mood
Subjects were median-split to form the two groups with scores of trait
seriousness, which were more serious trait and less serious trait. A Repeated-
Measures ANOVA was conducted to investigate the difference between groups,
with emotion state bad mood as the between-subject variable.
The results of multivariate tests show that there was no significant interaction
effect between the type of vibration and emotion state bad mood, 𝐹 6, 9 =
. 990,𝑝 >. 05. This indicated that emotion state bad mood had no different effects
on people’s ratings on different types of vibrations. This was confirmed by the
univariate tests and contrasts tests.
- 71 -
CHAPTER 7. GENERAL DISCUSSION
In this chapter, the process and findings of the critical phases of this study are
discussed, with limitations identified. Directions of further research are suggested.
7.1. Device Design
A respiration sensor and a vibration generator were designed and built in this
study, in order to demonstrate the possibility of building an inexpensive and user-
programmable system. In order to build the respiration sensor, the materials and
components selected and used were simple and inexpensive, compared to
commercially available systems. The sensor was not very stable because of the
inexpensive components used therefore algorithms to correct and smooth the data
were created, in order to minimize the noise caused by the instability of the sensor.
In this study, it was found that the resistance of the conductive fabric was not
linearly correlated with its extension, and it tended to overshoot when rapidly
stretched, which would cause noise when the sensor was capturing data.
Consequently, the Arduino code had to make up for instability. A correction
function was developed to make the resistance linearly correlated with its extension
in the Arduino code. An array of 5 was also used in the code to store data collected
from the sensor, and the final output to the computer was the average of the array to
smooth the data. After correction, the data captured were linear correlated with the
extension of the sensor.
- 72 -
To guarantee that the device was able to capture valid data, the homemade
sensor was evaluated with a commercial sensor. This was crucial because even
though the working principle of the homemade respiration sensor was the same as
the commercial sensors, inexpensive materials and components, together with
possibly inaccuracy in construction, may cause noise. In this study, the result of the
evaluation showed that the data captured by homemade sensor after correction was
not as smooth as the commercial sensor, but the direct comparison proved that data
captured by the homemade sensor was not substantially different from those
captured by the commercial sensor, and the homemade sensor was able to capture
the respiration pattern of laughter. The evaluation justified that the homemade
sensor was usable, in other words, was able to capture valid data.
Correction and evaluation were very important in designing and building of the
respiration sensor. What could be improved was that, the work of building the
sensor could be done better, which included better sewing and soldering, since
workmanship might also cause noise. In addition, the algorithms in the Arduino
code to smooth the data could be further optimised in future.
7.2. Laughter Collection
In the laughter capture experiment, laughs and related respiration data of the
subjects were recorded as stimulation of the following studies. The laughs were
evoked by a game and several amusing videos. The game played was a cooperative
game, which could evoke some hilarious laughter and some social laughter. The
videos evoked simply hilarious laughter. Two ways to evoke laughter were used
- 73 -
because participants might be bored if they were only shown videos for the entire
duration of the session. Both ways were successful in evoking laughter, as there
were more than 41 laughs evoked in average in each 15-minute session. Participants
also reported that they had a good time in the experiment. It could be concluded that
the two ways succeeded in evoking enough laughter. However, in this study which
focused on hilarious laughter, social laughter and hilarious laughter were not
separated, which might cause a slightly difference as people might perceive social
laughter in a different way as hilarious laughter, according to the study of social
laughter by Fuller (1974), which suggested that social laughter were often facilitated
by the sound of other people’s laughter. Thus, in this study, the perception of social
laughter might be affected more by auditory stream, which might reduce the effect
of haptic stimulation. Many previous studies controlled this factor by using single
source to evoke laughter, such as the humorous video clips (Chapman, 1983;
Devereux & Ginsburg, 2001). Consequently, in further study focusing on hilarious
laughter, the material used should avoid evoking other sorts of laughter.
7.3. Vibration Pattern Testing
The goal of the vibration pattern experiment was to create an algorithm to
translate respiration patterns in haptic feedback, to measure people’s reactions to
various sorts of vibration patterns and, on the basis of these results, to select two
stimuli for the perceptual experiment. In the vibration pattern experiment, data were
analysed from perspectives of intensity, pleasantness and association with laughter.
It was deduced from results that, for patterns with stronger stimulation, people might
- 74 -
feel the vibrations as intense and unpleasant, while for patterns with weaker
stimulation, people might feel less intense but more pleasant.
The strength of vibration discussed above represented the peak value of the
vibrations. However, it was found that the perceived intensity and pleasantness of
the stimulus also depended on the vibration pattern, not just the peak value of the
vibrations. Different vibration patterns provided different feelings of intensity and
pleasantness even if their peak values were the same. This was because that different
vibration patterns transmitted different amount of energy to human body. The
vibration energy of each vibration pattern was represented by the area under the
vibration output curve. It was discovered that the vibration patterns with large
energy obtained lower ratings of the pleasantness perceived from the vibration.
Average rating of perceived pleasantness was around 0 when the value of energy
transmitted was around 90-100, while vibration patterns with energy around 90-100
were rated as having medium intensity. Consequently, in this study, it was found
that appropriate vibration patterns were with energy value around 90-100.
As there were no previous studies focusing on perception with different
vibration patterns, the vibration pattern testing provided further studies about haptic
stimulation with a thought of exploring differences caused by vibration patterns. It
was proved in this study that intensity of the stimulation and pleasantness caused by
the vibrotactile stimulation could be used as measures to investigate the feelings of
the people to the stimulation. Comparing energy of different vibration patterns
- 75 -
transmitted to the human body could also provide insights of the stimulation
perceived by people.
The limitation of the vibration pattern experiment was that there were only 6
subjects participated in this study, which was limited by time and resource.
Consequently, gender of participants was not considered as a between-subject
variable. However, previous studies showed that perception thresholds of vibration
were not the same among people: Frenette et al. (1990) claimed that vibrotactile
perception threshold was significantly different with genders. Neely and Burstrum
(2006) reported no gender differences, but they found many phenomena between
both genders. Therefore, by simply collecting ratings of all the subjective was not
fully reliable. If there were a larger sample of subjects, the testing of perceptions to
various vibration patterns might consider gender as a between-subject variable,
which may provide with a more accurate result.
7.4. Perceptual Study Findings
Since little research on vibrotactile stimulation about laughter has been
conducted, there are few similar studies based on which the results of this study
could be discussed. In this section, the results are summarized and discussed with
related previous studies, possible reasons of the results are deduced.
First, it was found in this study that no significant main effect of the types of
vibrations on ratings of perception of the laughter from the video was identified.
This result was supported by Fukushima (2010), who used vibrating dolls whose
- 76 -
vibration was synchronized with laugh tracks of comedy, as no significant
differences were observed. However, in present study it was discovered that ratings
of arousal with square pattern vibration were almost significantly higher than the
ratings obtained without vibration, and that ratings of dominance with square pattern
vibration were significantly higher than the ratings obtained without vibration. This
may be because that vibrotactile stimulation provided people with energy, which
made people feel that the laughter was stronger and more meaningful to people after
perceiving the additional energy. The theory of additional energy may also be
explaining that tactile modality was effective in expressing the urgency of incoming
messages and notifications, as Heikkinen claimed (2011). However, respiration
pattern vibration did not significantly enhance the perception of arousal and
dominance, which may be because it was more associated to the laughter than the
square pattern. The feeling that the vibration pattern was associated with the
laughter might reduce the perception of the vibration stimulation. In this study, the
respiration pattern was more associated with the laughter may have made it less
noticeable than the square wave.In other words, people might feel that the energy
perceived from the square pattern vibration was more than that perceived from the
respiration patter vibration, even though they transmitted the same amount of
energy.
Second, there was a significant interaction effect between the type of vibration
and the sex of the participants. However, since the univariate did not identify any
differences, no difference in perception of pleasure, arousal or dominance between
genders was found. This finding was not consistent with many previous studies
- 77 -
about the effect of vibrotactile stimulation, which claimed that there was no
significant effect of genders on vibration perception (Haans, et al., 2007; Jonghyun,
et al., 2010; Kang, et al., 2012). However, this finding of the present study was
similar with that concluded by Karuei et al. (2011), which was that gender did have
some impact, but the difference is not consistent or large. The reason may be that,
since laughter was emotional, which was not like the tasks of the previous studies,
the perceptions of laughter between genders were different. As Provine (1993)
discovered that the numbers of laughs were different between genders in speech
context. Results also showed that ratings of male on dominance with square
vibration were higher than that with no vibration, but ratings of female with two
vibrations were close. Consequently, it suggested that vibration stimulation in
square pattern might lead males to judge laughter in the screen as more meaningful
than simply hilarious.
Third, there was no significant interaction effect between the type of vibration
and emotion trait cheerfulness, seriousness or bad mood. However, there was an
almost significant interaction effect between the type of vibration and emotion trait
cheerfulness for laughter arousal perception, in which ratings with respiration
pattern vibration was significantly higher than with no vibration. This was different
from the first finding, as the respiration pattern vibration enhanced the perception of
arousal. It was possible that, for people with more cheerful emotion traits, the
respiration pattern vibration, which was more synchronized and associated with the
laughter, was able to cooperate with other media of laughter transfer by providing
more perceptual cues of the intensity of laughter. It may be deduced that people with
- 78 -
more cheerful emotion traits are able integrated perceptions from various streams to
perceive positive emotions.
Finally, no significant interaction effect was discovered between the type of
vibration and emotion state cheerfulness, seriousness or bad mood. However, the
univariate tests show significant effects between the type of vibration and emotion
state cheerfulness for laughter pleasure valence perception and arousal perception
were discovered. According to the data, vibration stimulation was able to enhance
laughter perception of people in less cheerful emotion state. It could be explained
that for people who were in the happy emotion state, vibration stimulation might be
a comparatively negative impact, because that might distract the perception of
laughter to that of the vibration stimulation. Conversely, for people in the less
cheerful emotion state, one reasonable explanation was that the energy transmitted
to people from the vibration stimulation might increase the sense of presence of
laughter, which was a positive feeling for laughter perception. As previous studies
suggested, haptic stimulation provided a strong interpersonal link between people,
and raised levels of presence (Brave & Dahley, 1997; Fogg, et al., 1998; Lok, 2002).
It was also found that for people in less cheerful emotion states, their ratings of
perceived arousal with respiration pattern vibration was higher than those with
square pattern vibration. This was consistent with Bennett and Stevens (2006), who
suggested that the sense of presence was significantly higher when correct haptic
feedback for material properties was provided, because the respiration pattern
vibration was more associated than the square pattern vibration.
- 79 -
In summary, vibration stimulation was able to enhance pleasure perception for
people in less cheerful emotion states. From the arousal perception perspective,
generally square pattern vibration enhanced perception, but respiration pattern
vibration worked better for people in less cheerful emotion traits. Vibration
stimulation also increased arousal perception for people in less cheerful emotion
states. Perception of dominance for male was enhanced by square pattern vibration.
The limitation of this experiment was the small sample of subjects. 18
participants were recruited. When dividing the subjects into groups, there were less
than 10 subjects in each group, which might not provide enough support to statistics.
If a larger sample of subjects could be tested, the results could be more significant.
7.5. Applications
These findings suggested that laughter perception of people might be positively
enhanced with a haptic device providing square pattern vibration, especially for
those in less happy emotion states. Considering the haptic devices that were built in
previous studies, such as the rotating fingertip stimulator of Salminen (2008), the
one-degree freedom haptic knob of Smith and MacLean (2007), and vibration
device of Heikkinen (2011) connected with mobile, a potential application is that
some vibrators and a respiration sensor could be fixed into some clothes, such as T-
shirts, at the position of chest. The respiration sensor would collect the respiration
data and send them to the vibrators on others’ clothes as stimulation. The vibrators
would provide vibrotactile stimulation as soon as the respiration pattern of laughter
is detected. Arduino could be used to connect the sensor and vibrator together, and
- 80 -
the experience of interaction would be significantly improved if wireless signal
receiver and transmitter were installed. This sort of device would be inexpensive but
still robust, as the materials and components used are not complex.
This design could be applied to various scenarios. In virtual non-colocated
environment, including online chatting between two people and group video talk
among groups of participants, the haptic device may help optimize the interaction by
enhancing perception of laughter. For interaction with Virtual Environment, the
haptic device may help increase the quality of interaction with the avatar, such as
the conversational agents described by Traum and Rickel (2002).
7.6. Suggestions for Further Study
Four suggestions are described for further study on this topic. Firstly, gender of
people in the video should be considered as a variable, with same-sex versus mixed-
sex dyads as a condition to control. In the experiment, although without special
consideration, there were 27 videos of male and 27 of female in the 54 videos.
However, the sequence of video and the vibration were all randomized without
considering the gender of people in the video. In addition, the durations of laughter
were controlled but the number of laughs from one person was not. Consequently it
was not fitted for controlling sex dyads. It may cause difference since male and
female may react differently towards laughter of the same or opposite sex.
Secondly, whether subjects know the people in the video laughing should be
considered as a variable. It is not hard to imagine that people may feel more intimate
- 81 -
when they know or are even friends with the people in the video, which may
influence their perception.
Thirdly, in this experiment, the unassociated haptic stimulation was tested.
Moreover, unsynchronized vibration, which is vibration with time delay or advance,
could also be considered because that may affect the sense of association with
laughter. Chang (2008) suggested that multimodal stimulation in interaction design
had been considered as a way to enhance experience, in which synchronization was
regarded as one of the most critical principles. Bresciani (2005) proved that the
modulation was connected with time interval of stimulation, by discovering that the
auditory modulation of tactile perception turned weaker when the auditory stimuli
were presented before the onset or after the end of the tactile sequences. Altinsoy
(2003) tested the time interval to judge synchronization, and the result showed was
from approximately –25 to 50 ms.
Finally, it is possible and reasonable to do a real interaction instead of a
perceptual study. Two non-co-located people look at the video together on a social
media space. In one condition, they receive vibration each time the other laugh. In
the other condition they do not receive any vibration. The aim would be to see if
they laugh more when they receive the vibration feedback, and if they rate the
movie funnier than when they don’t receive vibration. This could be a more
informative study than this perceptual study because subjective ratings are not fully
reliable. The PAD measures used in this study were an explicit measure, so that
- 82 -
participants had to make calculated judgements about their perception. In a natural
interaction, people would respond more instinctively.
- 83 -
CHAPTER 8. CONCLUSION
Theories were concluded from the data gathered in the experiment. First, no
significant main effect of the types of vibrations on ratings of perception of the
laughter from the video was identified. But ratings of arousal and dominance with
square pattern vibration were almost significantly higher than the ratings obtained
without vibration. Second, there was a significant interaction effect between the type
of vibration and the sex of the participants. Third, there was no significant
interaction effect between the type of vibration and emotion trait cheerfulness,
seriousness and bad mood. However, there was an almost significant interaction
effect between the type of vibration and emotion trait cheerfulness for laughter
arousal perception, in which ratings with respiration pattern vibration is significantly
higher than with no vibration. Fourth, no significant interaction effect is discovered
between the type of vibration and emotion state cheerfulness, seriousness and bad
mood. But there was a significant interaction effect between the type of vibration
and emotion state cheerfulness for laughter pleasure valence and arousal perception.
If more data could be obtained, the effects which were almost significant may be
more significant. Consequently, it is possible that a haptic device might positively
enhance laughter perception of people by providing square pattern vibration,
especially for those in less happy emotion states.
- 84 -
The limitations of this study approach included that social laughter were not
separated from hilarious laughter, which may cause difference to perception of
laughter. Both the samples of subjects for the vibration pattern experiment and
perceptual experiment were small. The number of participants cannot provide
sufficient support to statistics. Four suggestions for study direction are given. First,
gender dyads between participants and people in the videos should be considered.
Second, whether subjects and people in the videos know each other should be
concerned. Third, other forms of unsynchronized or non-associated stimulation
should be taken into account in future studies, such as time delay or advance.
Finally, a real interaction with instant vibration stimulation about laughter could
provide interesting results.
- 85 -
REFERENCES
Altinsoy, M. E. (2003). Perceptual aspects of auditory-tactile asynchrony. Paper presented at the Proceedings of the Tenth International Congress on Sound and Vibration, Stockholm, Sweden.
Bailenson, J. N. (2007). Virtual interpersonal touch: Expressing and recognizing emotions through haptic devices. Human-computer interaction, 22(3), 325.
Barnett, K. (1972). A theoretical construct of the concepts of touch as they relate to nursing. Nursing research, 21(2), 102.
Bennett, E., & Stevens, B. (2006). The Effect that the Visual and Haptic Problems Associated with Touching a Projection Augmented Model Have on Object-Presence. Presence: Teleoperators and Virtual Environments, 15(4), 419-437. doi: 10.1162/pres.15.4.419
Berkley, K. J. (1995). Are there separate central nervous system pathways for touch and pain? Nature medicine, 1(8), 766.
Bloch, S., Lemeignan, M., & Aguilera-T, N. (1991). Specific respiratory patterns distinguish among human basic emotions. International Journal of Psychophysiology, 11(2), 141-154. doi: 10.1016/0167-8760(91)90006-j
Boiten, F. A. (1998). The effects of emotional behaviour on components of the respiratory cycle. Biological Psychology, 49(1–2), 29-51. doi: 10.1016/s0301-0511(98)00025-8
Brave, S., & Dahley, A. (1997). inTouch: a medium for haptic interpersonal communication.
Bresciani, J. P. (2005). Feeling what you hear: auditory signals can modulate tactile tap perception. Experimental brain research, 162(2), 172.
Brown, L. M., & Willianmson, J. (2007). Shake-to-talk: Multimodal Messaging for Interpersonal Communication. Paper presented at the Proc. HAID 2007.
Chang, A. (2002). ComTouch: design of a vibrotactile communication device Proceedings of the conference on Designing interactive systems processes, practices, methods, and techniques - DIS '02.
Chang, A. (2008). An Audio-Haptic Aesthetic Framework Influenced by Visual Theory. Haptic and Audio Interaction Design (Vol. 5270).
Chapman, A. J. (1983). Humor and laughter in social interaction and some implications for humor research. Handbook of humor research, 1, 135-157.
- 86 -
Cohen, H. D., Goodenough, D. R., Witkin, H. A., Oltman, P., Gould, H., & Shulman, E. (1975). The effects of stress on components of the respiration cycle. Psychophysiology, 12(4), 377-380.
Craig, A. D. (2000). Thermosensory activation of insular cortex. Nature neuroscience, 3, 184.
Craig, A. D. (2002). How do you feel? Interoception: the sense of the physiological condition of the body. Nature reviews. Neuroscience, 3(8), 655.
Devereux, P. G., & Ginsburg, G. P. (2001). Sociality effects on the production of laughter. The Journal of general psychology, 128(2), 227.
Feleky, A. (1916). The influence of the emotions on respiration. Journal of experimental psychology, 1(3), 218.
Field, A. P. (2009). Discovering statistics using SPSS: SAGE publications Ltd.
Field, T. (2001). Touch. Cambridge, MA: MIT Press.
Filippelli, M. (2001). Respiratory dynamics during laughter. Journal of applied physiology, 90(4), 1441.
Fogg, B., Cutler, L. D., Arnold, P., & Eisbach, C. (1998). HandJive: a device for interpersonal haptic entertainment.
Frenette, B., Mergler, D., & Ferraris, J. (1990). Measurement precision of a portable instrument to assess vibrotactile perception threshold. European journal of applied physiology and occupational physiology, 61(5), 386-391.
Fukushima, S. (2010). Laugh enhancer using laugh track synchronized with the user's laugh motion
Proceedings of the 28th of the international conference extended abstracts on Human factors in computing systems - CHI EA '10.
Fuller, R. G. C., & Sheehy-Skeffington, A. (1974). Effects of group laughter on responses to humourous material, a replication and extension. Psychological Reports, 35(1), 531-534.
Gallace, A. (2010). The science of interpersonal touch: An overview. Neuroscience & biobehavioral reviews, 34(2), 246.
Goodenough, F. L. (1932). Expression of the emotions in a blind-deaf child. The Journal of abnormal and social psychology, 27(3), 328.
Grunwald, M. (2008). Human haptic perception: basics and applications: Birkhauser.
- 87 -
Haans, A., Nood, C. d., & IJsselsteijn, W. A. (2007). Investigating response similarities between real and mediated social touch: a first test. Paper presented at the CHI '07 extended abstracts on Human factors in computing systems, San Jose, CA, USA.
Heikkinen, J. (2011). Exploring the effects of cumulative contextual cues on interpreting vibrotactile messages
Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services - MobileHCI '11.
Iggo, A. (1977). Cutaneous and subcutaneous sense organs. British Medical Bulletin, 33(2), 97.
Jeon, B.-H., Ajovalasit, M., & Giacomin, J. (2009). Effects of gender differences on the subjective perceived intensity of steering wheel rotational vibration based on a multivariate regression model. International Journal of Industrial Ergonomics, 39(5), 736-743. doi: 10.1016/j.ergon.2009.02.010
Jonghyun, R., Jaemin, C., Gunhyuk, P., Seungmoon, C., & Han, S. H. (2010). Vibrotactile Feedback for Information Delivery in the Vehicle. Haptics, IEEE Transactions on, 3(2), 138-149. doi: 10.1109/toh.2010.1
Jordan, T. R., & Abedipour, L. (2010). The importance of laughing in your face:ˇInfluences of visual laughter on auditory laughter perception. Perception, 39(9), 1283-1285.
Kang, J., Kook, J., Cho, K., Wang, S., & Ryu, J. (2012). Effects of amplitude modulation on vibrotactile flow displays on piezo-actuated thin touch screen. International Journal of Control, Automation and Systems, 10(3), 582-588.
Karuei, I., MacLean, K. E., Foley-Fisher, Z., MacKenzie, R., Koch, S., & El-Zohairy, M. (2011). Detecting vibrations across the body in mobile contexts. Paper presented at the Proceedings of the 2011 annual conference on Human factors in computing systems, Vancouver, BC, Canada.
Kurt, T. E. (2007). Introduction to Microcontrollers with Arduino.
Lee, S., & Kim, G. J. (2008). Effects of haptic feedback, stereoscopy, and image resolution on performance and presence in remote navigation. International Journal of Human-Computer Studies, 66(10), 701-717. doi: 10.1016/j.ijhcs.2008.05.001
Lok, B. C. L. (2002). Interacting with dynamic real objects in virtual environments. University of North Carolina.
- 88 -
Meehan, M., Insko, B., Whitton, M., & Frederick P. Brooks, J. (2002). Physiological measures of presence in stressful virtual environments. ACM Trans. Graph., 21(3), 645-652. doi: 10.1145/566654.566630
Montoya, P. (2006). Affective modulation of somatosensory-evoked potentials elicited by tactile stimulation. Brain research, 1068(1), 205.
Nagai, M. (2007). Insular cortex and neuropsychiatric disorders: a review of recent literature. European psychiatry, 22(6), 387.
Neely, G., & Burstrum, L. (2006). Gender differences in subjective responses to hand–arm vibration. International Journal of Industrial Ergonomics, 36(2), 135-140. doi: 10.1016/j.ergon.2005.09.003
Nwokah, E. E. (1993). Vocal affect in three‐year‐olds: A quantitative acoustic analysis of child laughter. The Journal of the Acoustical Society of America, 94(6), 3076.
Oakley, I., Brewster, S., & Gray, P. (2001). Can you feel the force? An investigation of haptic collaboration in shared editors.
Provine, R. R. (1993). Laughter punctuates speech: Linguistic, social and gender contexts of laughter. Ethology, 95(4), 291-298.
Provine, R. R. (1997). Yawns, laughs, smiles, tickles, and talking: Naturalistic and laboratory studies of facial action and social communication. The psychology of facial expression, 158.
Ruch, W., & Ekman, P. (2001). The expressive pattern of laughter. In A. W. Kaszniak (Ed.), Emotion, qualia, and consciousness (pp. 426-443). Tokyo: Word Scientific.
Ruch, W., & Kohler, G. (1999). The measurement of state and trait cheerfulness. Personality psychology in Europe: Theoretical and empirical developments, 7, 67-83.
Ruch, W., Kohler, G., & van Thriel, C. (1996). Assessing the" humorous temperament": Construction of the facet and standard trait forms of the State-Trait-Cherrfulness-Inventory–STCI. Humor, 9(3-4), 303.
Sallnas, E.-L., Rassmus-Grohn, K., & Sjostrom, C. (2000). Supporting presence in collaborative environments by haptic force feedback. ACM Trans. Comput.-Hum. Interact., 7(4), 461-476. doi: 10.1145/365058.365086
Salminen, K. (2008). Emotional and behavioral responses to haptic stimulation
Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08.
- 89 -
Smith, J. (2007). Communicating emotion through a haptic link: Design space and methodology. International journal of human-computer studies, 65(4), 376.
Svebak, S. (1975). Respiratory patterns as predictors of laughter. Psychophysiology, 12(1), 62.
Szameitat, D. P., Alter, K., Szameitat, A. J., Darwin, C. J., Wildgruber, D., Dietrich, S., & Sterr, A. (2009). Differentiation of emotions in laughter at the behavioral level. Emotion, 9(3), 397.
Traum, D., & Rickel, J. (2002). Embodied agents for multi-party dialogue in immersive virtual worlds. Paper presented at the Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 2, Bologna, Italy.
Valentini, M. (2008). Residual haptic sensation following stroke using ipsilateral stimulation. Journal of neurology, neurosurgery and psychiatry, 79(3), 266.
Weiskrantz, L. (1987). Residual tactile sensitivity with self-directed stimulation in hemianaesthesia. Journal of neurology, neurosurgery and psychiatry, 50(5), 632.
- 90 -
APPENDIX A. ARDUINO CODE FOR LAUGHTER CAPTURE
EXPERIMENT
int sensorValue = 0; float EWin= 0; float EWOut = 0; int x = 0; float Sdata[5]; int rangeAdjuster = 100; void setup() { Serial.begin(1200); pinMode(9, OUTPUT); } void loop() { int sensorValue = analogRead(A0); for (x=0;x<5;x++) { Sdata[x] = pow(sensorValue,2); if(x=4){ EWin = (Sdata[0]+Sdata[1]+Sdata[2]+Sdata[3]+Sdata[4])/10; EWOut = 18*pow(2.71828,((EWin-45)/80)); Serial.write(EWOut); } } }
- 91 -
APPENDIX B. ARDUINO CODE FOR VIBRATION OUTPUT
int incomingByte = 0; int ledPin3 = 3; int ledPin5 = 5; int ledPin6 = 6; int ledPin9 = 9; int ledPin10 = 10; int storeByte = 0; void setup() { Serial.begin(9600); } void loop() {
54 I am a rather sad person. ................................................................... (1) (2) (3) (4)
55 I prefer people who communicate with deliberation and objectivity. (1) (2) (3) (4)
- 98 -
56 I often feel so weary that I cannot rouse myself to do anything. .......(1) (2) (3) (4)
57 I like to kid around with others. ........................................................ (1) (2) (3) (4)
58 When I communicate with other people, I always try to have an objective and
sober exchange of ideas. ........................................................................ (1) (2) (3) (4)
59 It is easy for me to spread good cheer. ...............................................(1) (2) (3) (4)
60 One of my principles is: "first work, then play.” .............................. (1) (2) (3) (4)
Please check to see that you have answered every statement.
- 99 -
APPENDIX E. STATE-TRAIT-CHEERFULNESS-INVENTORY-
STATE (STCI-S)(WILLIBALD RUCH, ET AL., 1996)
Name (Code): __________________ Age: |__|__|
Gender: male O female O
Instructions :
The following statements refer to your current mood and mental state. Please try as
much as possible to describe your
current feelings and state of mind by marking an X through one of the four
alternatives. Please use the following scale:
(1) strongly disagree (2) moderately disagree
(3) moderately agree (4) strongly agree
For example:
I have an even temper. ........................................................................... (1) (2) (3) (4)
If you strongly agree with this statement, that is, if you have an even temper at this
moment , mark an X through (4). If you strongly disagree, that is, if you at present
do not have an even temper at all , mark an X through (1).
If you have difficulty answering a question, pick the solution that most applies.
Please answer every question, do not omit any.
- 100 -
1. I am in a bad mood. ........................................................................... (1) (2) (3) (4)
2. I am set for serious things. ................................................................. (1) (2) (3) (4)
3. I feel chipper. ..................................................................................... (1) (2) (3) (4)
4. I am sad. ............................................................................................. (1) (2) (3) (4)
5. I have important things on my mind. ................................................. (1) (2) (3) (4)
6. I am cheerful. ..................................................................................... (1) (2) (3) (4)
7. I am in a thoughtful mood. ................................................................ (1) (2) (3) (4)
8. I could laugh at the drop of a hat. ...................................................... (1) (2) (3) (4)
9. I feel grouchy. .................................................................................... (1) (2) (3) (4)
10. I have a serious mental attitude. ...................................................... (1) (2) (3) (4)
11. I feel merry. ..................................................................................... (1) (2) (3) (4)
12. I feel downhearted. .......................................................................... (1) (2) (3) (4)
13. I am in a pensive frame of mind. ..................................................... (1) (2) (3) (4)
14. I am ill-humored. ............................................................................. (1) (2) (3) (4)
15. My thoughts are profound. .............................................................. (1) (2) (3) (4)
16. I feel great. ....................................................................................... (1) (2) (3) (4)
- 101 -
17. My mood is spoiled. ........................................................................ (1) (2) (3) (4)
18. I am in a serious frame of mind. ..................................................... (1) (2) (3) (4)
19. I am amused. ................................................................................... (1) (2) (3) (4)
20. I am peeved. .................................................................................... (1) (2) (3) (4)
21. I see the funny side of things. ......................................................... (1) (2) (3) (4)
22. I regard my situation objectively and soberly. ............................... (1) (2) (3) (4)
23. I'm walking on air. .......................................................................... (1) (2) (3) (4)
24. I feel gloomy. ................................................................................. (1) (2) (3) (4)
25. I am in a crabby mood. .................................................................. (1) (2) (3) (4)
26. I am delighted. ............................................................................... (1) (2) (3) (4)
27. I feel dejected. ............................................................................... (1) (2) (3) (4)
28. I'm prepared to do a task in earnest. .............................................. (1) (2) (3) (4)
29. I am ready to have some fun. ......................................................... (1) (2) (3) (4)
30. I am in a sober frame of mind. ....................................................... (1) (2) (3) (4)
- 102 -
APPENDIX F. PERCEPTION EXPERIMENT QUESTIONNAIRE
The first page of the questionnaire is shown. Pages following are in the same
structure.
The Pleasure-Displeasure Scale measures how pleasant an emotion may be. For instance both anger and fear are unpleasant emotions, and score high on the displeasure scale. However joy is a pleasant emotion.
The Arousal-Nonarousal Scale measures the intensity of the emotion. For instance while both anger and rage are unpleasant emotions, rage has a higher intensity or a higher arousal state. However boredom, which is also an unpleasant state, has a low arousal value.
The Dominance-Submissiveness Scale represents the controlling and dominant nature of the emotion. For instance while both fear and anger are unpleasant emotions, anger is a dominant emotion, while fear is a submissive emotion.