INFLUENCE OF TEXTUAL HEDGING AND FRAMING VARIATIONS ON DECISION MAKING CHOICES PERTAINING TO THE CLIMATE CHANGE ISSUE DISSERTATION Presented in Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the Graduate Dissertation Committee: School of The Ohio State University By Jeffrey R. Corney, M.A., M.S. ***** The Ohio State University 2001 Approved by Dr. Rosanne W. Fortner, Adviser Dr. Gary W. Mullins Adviser Dr. Tomas M. Koontz School ofNatural Resources
175
Embed
INFLUENCE OF TEXTUAL HEDGING AND FRAMING VARIATIONS … · INFLUENCE OF TEXTUAL HEDGING AND FRAMING VARIATIONS ON DECISION MAKING CHOICES PERTAINING TO THE CLIMATE CHANGE ISSUE DISSERTATION
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
INFLUENCE OF TEXTUAL HEDGING AND FRAMING VARIATIONS ON DECISION MAKING CHOICES PERTAINING TO THE CLIMATE CHANGE ISSUE
DISSERTATION
Presented in Partial Fulfillment of the Requirements for
the Degree Doctor of Philosophy in the Graduate
Dissertation Committee:
School of The Ohio State University
By
Jeffrey R. Corney, M.A., M.S.
*****
The Ohio State University 2001
Approved by Dr. Rosanne W. Fortner, Adviser
Dr. Gary W. Mullins ~w.~ Adviser
Dr. Tomas M. Koontz School ofNatural Resources
cruickshank.3
Typewritten Text
Ohio Sea Grant project E/E-001 OHSU-TD-1505
cruickshank.3
Typewritten Text
cruickshank.3
Typewritten Text
cruickshank.3
Typewritten Text
cruickshank.3
Typewritten Text
cruickshank.3
Typewritten Text
cruickshank.3
Typewritten Text
ABSTRACT
Better methods of communication that enhance, not hinder, the efficient and
equitable transfer of information from expert sources to decision makers and the general
citizenry are being sought by those who must make decisions regarding complex
environmental issues such as climate change.
The effects of variations in two textual components, hedging and framing, on
subjects' choices during an environmental decision making situation were investigated.
Subjects were provided with information in a text passage that conveyed both the benefits
and detriments associated with a decision to either support or not support large-scale
climate change reductions in the U.S. Measures of subjects' attitudes, beliefs and
decision intentions were derived from the Theory of Reasoned Action. Other measures,
' derived from risk communication studies, included trust in the credibility of information,
clarity of information, and prioritization of information use during decision making.
Subjects who participated were undergraduate students enrolled at The Ohio State
University. The 160 participants were randomly assigned one of either 16 treatments or a
control. Subjects received the same factual information regarding the climate change
issue. However, each experimental treatment represented a different combination of
11
textual manipulations, with information either hedged or not hedged and presented in
either a positive or negative frame.
Variations of hedging did not result in any significant findings, though a key trend
was observed. This trend suggests that a subject's trust in the credibility of information
presented may decrease when the benefits of not supporting climate change reductions
are not hedged. Variations in how climate change information was framed, however,
yielded some highly significant differences (p :5 0.001). The results suggest that negative
framing of either side of an issue, when the other is framed positively, influences the
priority a subject places on the importance of information, favoring the negatively framed
component.
This evidence suggests that if the goal of communicating information during an
environmental decision making situation, such as climate change, is to balance the
presentation of information and optimize cognitive and affective processing, then
hedging all statements and using negative framing for both sides of an issue is prudent.
iii
ACKNOWLEDGMENTS
I would like to express my sincere gratitude and thanks to my adviser, Dr.
Rosanne W. Fortner, for her care and support throughout my studies here at Ohio State.
Dr. Fortner always took good care of me with both material and emotional support.
I extend the same gratitude and thanks to Dr. Gary W. Mullins for supporting and
advocating both my academic and professional endeavors. Dr. Mullins always kept one
eye out for my future interests and put his trust in me to start building the foundation for
success while here at Ohio State.
I would like to thank Dr. Tomas M. Koontz for serving on my doctoral
dissertation committee and providing excellent advice for starting my career in academe.
I would also like to thank Dr. Robert J. Gates for his assistance as adviser for my M.S.
degree and for serving on my doctoral candidacy committee. Dr. Gates sharpened my
understanding and interest in the ways that human dimensions and natural science can be
interwoven to better understand ecological systems and their management. I would like
to thank Dr. Emmalou Norland for serving on my doctoral candidacy committee and for
providing research methods courses that pointed me in the right direction for developing
my own research.
IV
I would like to thank my family for their ever-present love and support. I would
like to thank my good friends and colleagues, Brad Welch and Sunita Hilton, for taking
this journey together with me. Their companionship, advice and willingness to laugh and
play when the day was done have been invaluable. Finally, I would like to thank my best
friend and fellow adventurer, Sarah Buchmann, for her love, support and unyielding faith
in my ability to do my best.
v
! i • "
VITA
October 5, 1965 Born - Dearborn, Michigan U.S.A.
1987 B.S. Biology, Hope College
1995 M.A. English, Colorado State University
2001 M.S. Natural Resources, The Ohio State University
PUBLICATIONS
Corney, J.R. (2001). Risk communication and wildland fire. In G.W. Mullins (Ed.) Communicator's Guide to Wild/and Fire (pp. 95-98). Columbus, OH: The Ohio State University, School ofNatural Resources.
Fortner, R.W., J.R. Corney, J.-Y. Lee & S. Romanello (2000). Developing a measure of public understanding of climate change and willingness to act when science is uncertain. In D. Scott et al. (Eds.) Climate ·change Communication: Proceedings of an International Conference (pp.E321-27). Waterloo, ON: University of Waterloo. Hull, PQ: Environment Canada.
Fortner, R.W., J.-Y. Lee, J.R. Corney, S. Romanello, J. Bonnell, B. Luthy, C. Figuerido & N. Ntsiko (2000). Public understanding of climate change: Certainty and willingness to act. Environmental Education Research 6(2): 127-141.
FIELDS OF STUDY
Major Field: Natural Resources
Environmental Communication, Education and Interpretation; Ecosystem Management and Environmental Decision Making
VI
TABLE OF CONTENTS
Abstract. ....................................................................................................................... ii
Acknowledgments ....................................................................................................... iv
Vita ........................................................................................................................ vi
List of Tables .............................................................................................................. ix
Climate Change Issue ....................................................................................... 1 Need for the Study ............................... -............................................................. 6 Problem Statement and Goal.. ........................................................................... 8 Definition of Terms ........................................................................................ 10 Research Questions ......................................................................................... 12 General Hypotheses ........................................................................................ 18 Limitations and Assumptions .......................................................................... 20
2. Literature Review .................................................................................................. 22
Environmental Decision Making ..................................................................... 22 Discourse and Linguistic Analysis .................................................................. 24 Risk Communication ...................................................................................... 33 Theory of Reasoned Action ............................................................................ 40
Correlations Among Variables ........................................................................ 79 Correlations With Covariate ........................................................................... 82 Analysis of Main Effects: Univariate ............................................................. 85
Comparison of Direct Responses ............................................................ 87 Comparison of Differential Responses ................................................. 104
Analysis of Main Effects: Multivariate ........................................................ 109 Analysis of Interactions ................................................................................ 112
Interpretation of Hypotheses Tests ................................................................ 114 Summary and Implications ........................................................................... 124 Recommendations for Future Study .............................................................. 126
3.3 Top five most common responses to each of the salient,belief and salient referent questions pertaining to the climate change issue ....................... 53
3.4 Combination of various experimental treatment levels for each of the two main variables ..................................................................................... 61
3 .5 Number of words for each experimental text passage ....................................... 61
3.6 Unrotated component loadings on the first factor for expert panel responses ......................................................................................................... 66
3.7 Rotated component loadings on the first factor for expert panel responses ......................................................................................................... 67
3.8 Item analysis of Detriment statements, based on an internal consistency method using Item-total correlations and Cronbach's Alpha, for expert panel responses .................................................................... 69
3. 9 Item analysis of Benefit statements, based on an internal consistency method using Item-total correlations and Cronbach's Alpha, for expert panel responses .................................................................... 70
3 .10 Reliability of instrument, based on an internal consistency method using Cronbach's Alpha, for both the pilot and control groups ......................... 72
4.1 Correlations of related dependent variables with each other, for multivariate analysis of variance ...................................................................... 81
ix
4.2 Correlations of each of the dependent variables with potential covariate, Prior Background ............................................................................. 84
4.3 Main effects and interactions for Clarity oflnformation ................................... 92
4.4 Main effects and interactions for Trust in the Credibility of Information ...................................................................................................... 93
4.5 Main effects and interactions for Decision Intention ........................................ 94
4.6 Main effects and interactions for Overall Attitude ............................................ 95
4.7 Main effects and interactions for Subjective Norm ........................................... 96
4.8 Main effects and interactions for Belief in Climate Change .............................. 97
4.9 Main effects and interactions for Belief in Outcome (Detriments) .................... 98
4.10 Main effects and interactions for Belief in Outcome (Benefits) ........................ 99
4.11 Main effects and interactions for Outcome Evaluation (Detriments) ............... 100
4.12 Main effects and interactions for Outcome Evaluation (Benefits) ................... 101
4.13 Main effects and interactions for Prioritization of Information Use (Detriments) .................................................................................................. 102
4.14 Main effects and interactions for Prioritization of Information Use (Benefits) ....................................................................................................... 103
4.15 Main•.effects and interactions for difference between responses to Detriments versus Benefits for Belief in Outcome .......................................... 106
4.16 Main effects and interactions for difference between responses to Detriments versus Benefits for Outcome Evaluation ...................................... 107
4.17 Main effects and interactions for difference between responses to Benefits versus Detriments for Prioritization of Information Use ................... 108
4.18 Main effect of hedging on each set of correlated variables, using multivariate analysis of variance technique .................................................... 110
4.19 Main effect of framing on each set of correlated variables, using multivariate analysis of variance technique .................................................... 111
x
l
CHAPTER 1
INTRODUCTION
"Most of what we learn about the world is filtered through communication. Even when we learn things directly, we perceive and interpret that experience through attitudes influenced by the words of others."
- C. Bazerman, The Informed Writer
Climate Change Issue
Global climate change research has become an international priority as evidence
mounts that increases in atmospheric carbon dioxide are caused in large part by
anthropogenic emissions. Nevertheless, the actual effects of increased C02, particularly
in terms of climatic changes, are still heavily debated. As evident in the Second
Assessment Reports of the Intergovernmental Panel on Climate Change (IPCC)
(Kirschbaum & Fischlin, 1996; Melillo et al., 1996) and the synthesis report for the U.S.
Global Change Research Program (NAST, 2000), changes in our ecological and
sociological systems are inevitable.
1
At a conference held in 1997, in Kyoto, Japan, the Parties to the United Nations
Framework Convention on Climate Change (UNFCCC) agreed to an international treaty
to reduce greenhouse gas emissions, known as the "Kyoto Protocol" (UNFCCC, 1997).
Its aim is to stabilize greenhouse gas concentrations by reducing emissions to or below
1990 levels. Currently, 84 nations are signatories of the Protocol, including all developed
nations (UNFCCC, 2001). In order to come into effect 55 countries need to ratify the
treaty, and of those nations at least 55% of them need to be developed nations. To date,
33 countries have ratified (UNFCCC, 2001). In 1998 the United States signed the treaty.
However, in order for the treaty to become binding in the U.S., it must be ratified by the
Senate, which is pending in the United States as of the time of this study (U.S. State
Department, 2001).
The Kyoto Protocol calls for developed nations to collectively reduce their
present emissions of six key greenhouse gases, including C02, by 5% by the year 2012
(UNFCCC, 1997). The U.S. contribution is a reduction of current emissions levels by
7%. Industrial nations must reduce emissions before lesser developed countries such as
China and India. This condition of the treaty has raised some issues regarding effects on
industry competitiveness in the global economy (U.S. State Department, 2001). Others
believe this is not that large a concern, as on average energy constitutes 2.2% of total
costs to U.S. industry, energy prices already vary significantly across countries, and
roughly two-thirds of all emissions affected are not in manufacturing sectors (U.S. State
Department, 2001 ).
2
Follow-up sessions of the Conference of the Parties have occurred since Kyoto
and subsequent proposals have been added to the Protocol to help refine the treaty
(UNFCCC, 2001; U.S. State Department, 2001). Emissions targets are now to be reached
over a five-year budget period, namely 2008-2012. Activities that absorb carbon (i.e.
carbon sinks), such as planting trees and restoring degraded soils, can be used toward
obtaining emission targets. Emissions trading is included, allowing countries to purchase
emissions permits from countries that have already met their targets and have surplus
permits. Developed countries will also be able to gain emissions reduction credit through
emission-reducing project activities in developing countries (UNFCCC, 2001; U.S. State
Department, 2001).
The most difficult and disputed aspects of climate change projections involve
effects on specific regions of the world. Most climatic models are not yet sophisticated
enough to allow for both high temporal and spatial resolution. General global climate
' change models are becoming more and more accepted, but individual country and
i
j regional ecosystems are harder to model (Kirschbaum & Fischlin, 1996; Melillo et al,
1996).
Individual country and regional systems, however, are usually the most relevant
to policymakers and the public. National economies are highly dependent on regional
ecosystems. Water resources are an obvious example, affecting agriculture and urban
development. National economies also rely on continued availability of both renewable
and non-renewable natural resources for energy, construction products, ecosystem
diversity, recreation and aesthetics.
3
Several computer simulation models, collectively called General Circulation
Models (GCMs), have been designed and refined over the past few years to help
scientists better assimilate data and predict possible outcomes of increased atmospheric
carbon dioxide. Basically, these models run computer simulations of atmospheric
conditions that attempt to synthesize complex physical processes linking the atmosphere
with global circulation and hydrological cycles. The standard comparison that these
models run is between an atmosphere with 1 x C02, representing current conditions, and
a doubling of carbon dioxide (2 x C02), representing projections of anthropogenically
produced carbon dioxide buildup over the course of the next 50 to 100 years. Two
commonly used steady-state models that have been used include the Goddard Institute for
Space Studies (GISS) and the Geophysical Fluid Dynamics Lab (GFDL) models
(Kirschbaum & Fischlin, 1996; Melillo et al., 1996).
Two new models that incorporate more dynamic or transient atmospheric and
oceanic elements such as cloud formation, ocean currents, and aerosol effects, have been
applied to global and regional climate change projections (NAST, 2000 a & b ). These
models allow for a more realistic, gradual buildup of C02 gas in the simulated
atmosphere versus the steady-state models' use of instant C02 doubling. These two
models, called the Canadian Model (CGCMl) and the Hadley Model (HadCM2) have
been used recently by the National Assessment Synthesis Team (2000) to predict
potential climate futures for the entire United States under elevated C02.
The National Assessment Synthesis Team has just published the results of these
simulations as applied to the United States (NAST, 2000 a & b ). This project has been an
ongoing national-level assessment of climate change impacts conducted as part of a
federal mandate assigned to the U.S. Global Change Research Program by request of the
President's Science Advisor. This project has been an enormous collaboration of
scientists, industry representatives, government agencies, and universities working on
collecting, interpreting and synthesizing the most current, accurate and relevant data
available on climate change impacts in the United States. The result is the recently
published 150-page Overview and 800-page Foundation report, Climate Change Impacts
on the United States: The Potential Consequences of Climate Variability and Change
(NAST, 2000). Climate change projections described in these documents were used as
the factual foundation for the experimental text material created for this study.
The United States, along with all other nations, is facing a critical environmental
decision making situation with regard to the climate change issue. The technical
knowledge acquired toward understanding the potential effects of climate change on
ecological and sociological systems is growing but currently remains incomplete and
wrought with unknowns and uncertainty (NAST, 2000 a & b ). A decision to either
support or not support reductions in human-induced climate change mechanisms, such as
greenhouse gas emissions and deforestation, will require large-scale involvement and
commitment on the part of the policy makers and citizenry of each country despite these
uncertainties (NAST, 2000 a & b). Because of its global scale, long-term effects and
uncertain scientific projections, the climate change issue is perhaps the most challenging
environmental decision making situation that we face at this time.
5
Need for the Study
Effective management of environmental issues such as climate change requires
efficient decision making on the part of scientists, elected officials, resource managers,
and citizens in general (Francis, 1993; Slocombe, 1993; Grumbine, 1994 & 1997;
Christensen et al., 1996; Lackey, 1998; Yaffee, 1999). Most, if not all, environmental
issues involve some degree of consideration and eventual trade-offs between potential
benefits and detriments that may result from a particular decision. Ideally, these factors
are equitably considered and effectively synthesized toward prudent decision making that
balances benefits and detriments in a sustainable manner (Francis, 1993; Slocombe,
' Levin et al., 1998), providing methods and precedent for accurately identifying and
manipulating each as a variable. To some extent, each of these components also has been
studied in terms of psychological effects on readers. Such studies have examined
subjects' comprehension of material, in cases ofhedging (e.g. Vande Kopple &
Crismore, 1990) and decision choices, in the case of framing (e.g. Ajzen & Fishbein,
1980; Tversky & Kahneman, 1981; Levin et al., 1998).
Cognitive and affective dependent variables used in this study were derived from
well-established psychological models that pertain to information processing and
decision making strategies. Though a variety of such models exist (e.g. Fischhof~ 1991;
Shafir & Tversky, 1993; Payne et al., 1993; Epstein, 1994), the Theory of Reasoned
Action (TRA) developed by Fishbein and Ajzen (Fishbein, 1967; Fishbein & Ajzen,
1975; Ajzen & Fishbein, 1980) was used as the primary theory from which psychometric
measures of the affective domain were derived for this study.
13
The Theory of Reasoned Action (TRA) model was defined by Fishbein (1967)
and later developed into a descriptive and predictive model for analyzing human behavior
(Fishbein & Ajzen, 1975; Ajzen & Fishbein, 1980). Five separate measures from the
original model were adopted, with only minor definitional modifications, to be used as
measures of the affective domain in this study. These variables included: Behavioral
Intention (redefined here as Decision Intention), Overall Attitude, Subjective Norm,
Behavioral Belief (redefmed here as Belief in Outcome), and Outcome Evaluation.
Two other affective variables were used: Perceived Trust in the Credibility of
Information and Belief in Climate Change as an actual event. Perceived Trust was
derived from risk communication literature, stressing that credibility in the information
has a profound effect on how it is used in decision making (Kasperson et al., 1988; Chess
et al., 1992; Sandman et al., 1993).
Belief in Climate Change was used to examine if the baseline beliefs about
climate change were affected by the treatments. Prior Background, specifically a
measure of how much a subject reports knowing about the issue and how much media
and classroom exposure to the climate change issue, was also assessed as a potential
qualifier. This variable was also considered for use as a potential covariate to reduce
error variance among treatment groups if necessary to enhance power.
The cognitive domain was assessed with just two variables: Perceived Clarity of
Information and Prioritization of Information Use. Clarity of Information was a simple
look at how easy or difficult a subject perceived the readability of the text and how easy
or difficult it was to understand. Again, risk communication literature points out that
14
clarity ofreadability plays a critical role during decision making (Kasperson et al., 1988;
Chess et al., 1992; Sandman et al., 1993).
Finally, Prioritization of Information Use was used to measure how subjects
differentially rank the importance of various information components, for both detriment
and benefit sides of the issue, when considering the information while deciding which
side of the issue to chose. This is a common measure of decision making practices used
to understand how subjects process information (Payne et al., 1993).
The two message components were experimentally manipulated in a structured
text passage designed to convey information pertaining to human-induced climate
change. Subjects were asked to read an experimental text passage, conveying
information regarding the climate change issue, and answer a series of questions designed
to measure the cognitive and affective variables that are relevant to the overall decision
making process.
In total, nine different dependent variables were assessed, with sub-sets - one for
Detriments and one for Benefits - used for Belief in Outcome, Outcome Evaluation, and
Prioritization of Information Use variables.
Following are the specific research questions examined ill this study:
1) Do variations in the use of hedging within the text passage differentially affect a
subject's direct responses to the following variables (a - i)?
(a) Perceived clarity of the information presented (b) Perceived trust in the credibility of the infonnation presented (c) Belief in human-induced climate change as an actual phenomenon ( d) Decision intention regarding supporting climate change reductions
15
I I 'I
( e) Overall attitude toward the outcomes of supporting climate change reductions (f) Subjective norm regarding influential referents approving of a decision to support
climate change reductions (g) Belief in the likelihood of outcomes occurring, regarding either detriments and/or
benefits associated with either supporting or not supporting climate change reductions
(h) Evaluation of outcomes, regarding either detriments and/or benefits associated with either supporting or not supporting climate change reductions
(i) Prioritization of information use during the decision making process, regarding either detriments and/ or benefits associated with the climate change issue
2) Do variations in the use of framing within the text passage differentially affect a
subject's direct responses to the following variables (a- i)?
(a) Perceived clarity of the information presented (b) Perceived trust in the credibility of the information presented (c) Belief in human-induced climate change as an actual phenomenon ( d) Decision intention regarding supporting climate change reductions ( e) Overall attitude toward the outcomes of supporting climate change reductions (f) Subjective norm regarding influential referents approving of a decision to support
climate change reductions (g) Belief in the likelihood of outcomes occurring, regarding either detriments and/or
benefits associated with either supporting or not supporting climate change reductions
(h) Evaluation of outcomes, regarding either detriments and/or benefits associated with either supporting or not supporting climate change reductions
(i) Prioritization of information use during the decision making process, regarding either detriments and/or benefits associated with the climate change issue
3) Do variations in the use of hedging within the text passage differentially affect the
difference between how subjects respond to information regarding detriments versus
benefits when responding to the following variables (a- c)?
(a) Belief in the likelihood of outcomes occurring, regarding both detriments and benefits associated with either supporting or not supporting climate change reductions
(b) Evaluation of outcomes, regarding both detriments and benefits associated with either supporting or not supporting climate change reductions
16
I '
( c) Prioritization of information use during the decision making process, regarding both detriments and benefits associated with the climate change issue
4) Do variations in the use of.framing within the text passage differentially affect the
difference between how subjects respond to information regarding detriments versus
benefits when responding to the following variables (a - c )?
(a) Belief in the likelihood of outcomes occurring, regarding both detriments and benefits associated with either supporting or not supporting climate change reductions
(b) Evaluation of outcomes, regarding both detriments and benefits associated with either supporting or not supporting climate change reductions
( c) Prioritization of information use during the decision making process, regarding both detriments and benefits associated with the climate change issue
5) Do variations in the use of hedging within the text passage differentially affect a
subject's responses to the following multivariate combinations of variables (a- d)?
(a) A combination of: Decision intention regarding supporting climate change reductions; Overall attitude toward the outcomes of supporting climate change reductions; and Subjective norm regarding influential referents approving of a decision to support climate change reductions
(b) Belief in the likelihood of outcomes occurring, regarding a combination of both detriments and benefits associated with either supporting or not supporting climate change reductions
( c) Evaluation of outcomes, regarding a combination of both detriments and benefits associated with either supporting or not supporting climate change reductions
( d) Prioritization of information use during the decision making process, regarding a combination of both detriments and benefits associated with the climate change issue
6) Do variations in the use of.framing within the text passage differentially affect a
subject's responses to the following multivariate combinations of variables (a-d)?
(a) A combination of: Decision intention regarding supporting climate change reductions; Overall attitude toward the outcomes of supporting climate change
17
I: I: I
1,
' I
reductions; and Subjective norm regarding influential referents approving of a decision to support climate change reductions
(b) Belief in the likelihood of outcomes occurring, regarding a combination of both detriments and benefits associated with either supporting or not supporting climate change reductions
( c) Evaluation of outcomes, regarding a combination of both detriments and benefits associated with either supporting or not supporting climate change reductions
( d) Prioritization of information use during the decision making process, regarding a combination of both detriments and benefits associated with the climate change issue
7) Are there interactions between or among variations in the use of hedging and framing
that contribute to effects on a subject's responses to any of the aforementioned
variables? What is/are the effect(s) of any interactions?
General Hypotheses
Hl. Hedging of both or either information component (detriments v. benefits) will result
in differential direct responses, with the hedged component(s) eliciting a response
ofrelatively greater magnitude than the not hedged component(s). When
components are differentially hedged, the direction of the response will be toward
supporting the hedged component.
H2. Framing of both or either information component (detriments v. benefits) will result
in differential direct responses, with the component(s) framed in a negative manner
eliciting a response of relatively greater magnitude than the component( s) framed in
a positive manner. When components are differentially framed, the direction of the
response will be toward supporting the negatively framed component.
18
! I
11
I I
I I
I
I
i1
H3. Differential hedging of one information component (detriments v. benefits) while
the other is not hedged will result in greater differences between responses to the i I
two components than when both components are either hedged or not hedged.
H4. Differential framing of one information component versus the other (detriments v. I
benefits), with one framed in a negative manner and the other positive, will result in ,,
I
greater differences between responses to the two components than when both are
framed either as negative or positive.
HS. Regarding multivariate combinations of variables, hedging of both or either
information component (detriments v. benefits) will result in differential direct
responses, with the hedged component( s) eliciting a response of relatively greater
magnitude than the not hedged component(s). When components are differentially
hedged, the direction of the response will be toward supporting the hedged
component.
H6. Regarding multivariate combinations of variables, framing of both or either
information component (detriments v. benefits) will result in differential direct
responses, with the component(s) framed in a negative manner eliciting a response
ofrelatively greater magnitude than the component(s) framed in a positive manner.
19
When components are differentially framed, the direction of the response will be
toward supporting the negatively framed component.
H7. Interactions between hedging and framing will occur, with the combination of
hedging and negative framing enhancing the magnitude of the response.
Limitations and Assumptions
This study was conducted against a backdrop of several potential confounding
variables inherent with most studies involving measures of human subjects' responses.
' Examples include differences in cognitive ability, prior education, age, and gender.
Efforts were made to account for these differences statistically by incorporating a
blocking technique (Gender) and covariate analysis (Prior Background) to mitigate or
measure potential influences of confounding variables.
Validity of each measure was accounted for, as best as possible, by using well
established measurement techniques and corroborating the specific questions with both
expert panel advice and pilot test item response analysis results. A key assumption was
that subjects would respond to questions based primarily on their cognitive and affective
processing of only the material presented to them during the experiment.
Sparsity of prior experimental studies of this nature rendered a priori estimates of
effect size difficult to attain. In order to optimize detection of effects a relatively
homogenous population -undergraduates enrolled in the School ofNatural Resources at
The Ohio State University- was selected for this study to minimize measurement error,
20
confounding noise and Type II error; consequently, inferential conclusions have been
compromised to some extent. Once tested and validated, this instrument can be used in
subsequent studies to examine more diverse populations.
21
CHAPTER2
LITERATURE REVIEW
Environmental Decision Making
Environmental decision making is an integrated approach to managing ecological
and human-developed sociological systems that talces into account the best known and
accepted natural and social science data and theories, as well as cultural values and
desires, and synthesizes these factors toward prudent decision making that balances
ecological, social and economic benefits in a sustainable manner (Francis, 1993;
an object is comprised of the sum of all beliefs about the object. Belief is further defined
as a combination of both strength of belief that the object being considered is associated
(likely or unlikely) with another object or concept (e.g. Long-tenn ecosystem stability is
40
dependent on preserving biodiversity), and the subject's evaluation (good or bad) of the
objects that comprise the association (e.g. Ecosystem stability should be a key land
management priority). In order to assess Attitude both strength and evaluation of belief
toward a specific concept should be measured.
The Subjective Norm component is defined as the product of a subject's
Normative Belief and the Motivation to act on that belief (Fishbein & Ajzen, 1975; Ajzen
& Fishbein, 1980). The Normative Belief is the subject's perception that people deemed
important or influential believe that a particular behavior is appropriate. Motivation is
the subject's desire to comply with the normative belief, often a measure of the strength
of influence between the subject and the referent(s) who are associated with the belief.
As with the Attitude component, two types of questions are typically required to
complete the Subjective Norm measure. First, subjects are prompted to think of various
individuals or groups who might influence their choices, acting as referents for the
subjective normative questions. Questions geared toward normative responses will ask
subjects to rate the strength and directionality of what they perceive their referent(s)
believe is appropriate in a particular situation (e.g. According to [referent] ecosystem
stability should be a key land management priority). Motivation to Comply with this
belief will be measured by associated questions that ask subjects to rate the strength of
their referents' influence on the subject's response to each normative question.
Behavioral Intention can be a single measure in accordance with the TRA model
(Ajzen & Fishbein, 1980). The proportional influence of Attitude versus Subjective
Norm on Behavioral Intention can be estimated, as well as reflected as weights. These
41
weights can be derived by handling the TRA model as a regression equation, whereby
Attitude and Subjective Nonn are predictors and Behavioral Intention the criterion.
Standardized regression coefficients for the two predictors then serve as estimates of
empirical weights. These weights can then be incorporated into the TRA model as
multiplicative factors for the respective components (Attitude and Subjective Norm)
before finally adding the two to derive a Behavioral Intention measure.
42
CHAPTER3
INSTRUMENTATION & METHODOLOGY
Design
A two-factor (4 x 4) randomized complete block (RCB), post-test only
experimental design (Keppel, 1991; Kirk, 1995; Hair et al., 1998) was used to measure
the effects and interactions of hedging (hedging, not hedging) and framing (positive,
negative) message components on each of nine dependent variables. Gender was used as
the blocking criterion in this study. Differential concern for environmental issues
between men and women has appeared as a trend in national surveys, with women
tending to be ~ore pro-environmental in their decision making trends than men
(NEETF/Roper, 1998). Framing has also been shown to affect men and women
differently, with women generally responding to negative frames with greater magnitude
than men (Fagley & Miller, 1990).
Nine specific dependent variables were assessed, drawn from both the cognitive
and affective psychological domains, focusing primarily on variables that constitute the
Theory of Reasoned Action (TRA) (Fishbein, 1967; Fishbein & Ajzen, 1975; Ajzen &
43
Fishbein, 1980). Three of these variables were further sub-divided into two measures
each, one for Detriments and one for Benefits associated with the climate change issue.
Subject responses for questions pertaining to each variable were measured on a seven
point semantic differential scale. Each measure was an average of constituent item
scores, consisting ofresponses to at least two questions per variable, and several with ten
questions per variable. Data derived from these scales were considered interval data in
accordance with relevant arguments that the advantages of robust statistical analyses
available for interval-level data outweigh the potential and rather minimal distortion of
data that may result in psychometric studies (Bohrnstedt & Borgatta, 1981 ).
For this experimental design an a priori estimated sample size of 160 (80 males
and 80 females) was calculated as necessary to attain a statistical power level of
approximately 0.80 with a= 0.05 to detect an estimated medium effect size fl' = 0.25
(Cohen, 1988; Kirk, 1995). Subjects were randomly assigned within each block to one of
16 experimental treatment combinations or the control, with a total of four subjects per
treatment combination within each block. Therefore, each level of the individual main
treatments (hedging and framing) and the control was comprised of sixteen subjects for
each block, or 32 subjects total for each main treatment group and the control.
Subject Selection
The target population was undergraduate students currently attending The Ohio
State University (OSU) who are U.S. citizens and had declared a major area of study in
the School of Natural Resources. According to Spring, 2001 enrollment data 234
44
students total were registered as Natural Resources majors, comprised of 115 female and
119 male students. This population was selected because it represents a cohort of
students ofrelatively homogenous age and educational background, who are presumably
interested in becoming natural resources decision makers. Students registered for courses
during the study period were accessible via the OSU Registrar Office web-based records
for student information and course rosters, providing the sample frame. Selection and
frame errors were adequately reduced by using the OSU Registrar information available
to the participating professors, assuming that records were accurate.
The study was conducted within the context of three courses in the School of
Natural Resources at The Ohio State University that are required of most Natural
Resource undergraduates: one large freshman/sophomore level course ( 192 enrolled) and
two smaller junior/senior level courses (25 and 32 enrolled respectively). Though
conducted in classroom settings, participation in this study was completely voluntary. A
monetary gift of $5 was given as an incentive for participation. Prospective subjects
were informed that there was no obligation to participate, and that participation or
abstention would not affect their grade in the course in any way. In all three classrooms
the professor vacated the room following the announcement and remained absent
throughout the questionnaire session. Subjects were also informed that results of this
study would be reported in terms of group responses. Individuals would not be identified
or associated with the responses in any way. The record of participation was kept strictly
confidential between myself and the University's administrative assistant in charge of
processing reimbursements associated with grant funding for this project.
45
A total of 168 students participated in the study. Eight cases were omitted from
the final analysis: two because of incomplete questionnaires, one because the respondent
was not a U.S. citizen, and five because they were demographic outliers, as their reported
age was considerably older (2:: 3 SD) than the average age of the rest of the sample. The
remaining 160 cases, representing 80 female and 80 male responses, were used for the
final analysis. This sample size represented 68% of all students registered as Natural
Resource majors during the time of this study.
Five specific questions targeted basic personal information such as ethnicity, age,
class rank, grade performance (G.P.A.), and country/State of residence. Comparisons
among treatment groups and the control were conducted [see Table 3 .l]. Results
revealed no significant difference among treatment groups or control along any of the
five demographic measures for either male or female respondents. This implies that the
desired homogenous sample was acquired.
FEMALES MALES
Age 21 22 Ethnicity White/Caucasian White/Caucasian Class Rank Senior Senior Grade-point Average 3.00-4.00 2.00-2.99 State of Residence Ohio Ohio
Females: N = 80; Males: N = 80. Categories indicate modal response.
Table 3.1: Demographic profile of subjects expressed as modal response.
46
I I
I I I
I
Prior to reading the experimental passage, subjects were asked a series of three
questions addressing their prior knowledge and exposure to the climate change issue from
both media sources and college courses. These questions were later averaged into a
single scale to assess a subject's Prior Background regarding the climate change issue.
Comparisons were made among treatment groups to confirm homogeneity of
Prior Background among the subjects [see Table 3.2]. No significant differences were
found among the treatment groups for Prior Background. Nevertheless, this variable was
later used as a covariate during construction of the factorial models during final analysis.
Prior Background
FEMALES
(2) "Knowledgeable & Informed"
MALES
(2) "Knowledgeable & Informed"
Females: N = 80; Males: N = 80. Categories indicate modal response. Modes based on 5-point scale: 0 =Not at all knowledgeable or informed, 1 = Slightly knowledgeable & informed, 2 = Knowledgeable & informed, 3 = Very knowledgeable & informed, 4 = Extremely knowledgeable & informed.
Table 3.2: Subjects' prior background measures.
47
Procedure
The study was conducted in mid-May, 2001, approximately two-thirds into the I: '
Spring Quarter session for OSU students. Two of the three intact classroom sessions I
were conducted on the same day; the third took place three days later. Experimental
sessions were conducted in a classroom monitored by myself.
Questionnaires for females and males were differentiated by different colored
covers and were placed in two separate stacks, with each treatment and the control I'
sequentially placed in each stack. Female and male participants were assigned a
questionnaire from the top of their respective stack as they came forward to collect a
' questionnaire. This procedure effectively randomized assignment of treatment levels and
the control within each block.
Subjects were instructed to read the instructions provided, read the text passage
carefully and respond to the subsequent questions as honestly as possible. Instructions
included two examples of what a question/statement might look like and how to mark a
response on the scale that best represents their response. It was also expressed that "this
is not a test of your knowledge or comprehension of the issue; there are no 'correct'
answers." Subjects were informed that they may refer to the text passage as needed;
however, to reduce question and order effects, they were also asked not to change
responses once marked on the questionnaire. No time limit was set; though it took
approximately 30 minutes on average for a participant to complete a questionnaire.
The questionnaire totaled sixteen 8.5 in. x 11 in. pages double-sided [see
Appendix A]. Times New Roman typeface in 12-point font was used for the
48
I I
I I
I I
I
I
I I
I I
experimental text passage and the questions. One page of the questionnaire was devoted
to "General Instructions," and two pages for the experimental text passage, which had 16
variations [see Appendix BJ. The remaining pages contained 63 questions pertaining to
the dependent variables of interest. Another six questions targeted basic personal
information such as gender (in case ofa mix up with handling of the color-coded
questionnaire), ethnicity, age, class rank, grade performance (G.P.A.), and country/State
of residence.
Salient Beliefs
Ajzen and Fishbein (1980) recommend that researchers begin the process of
building a questionnaire designed to measure variables in the Theory of Reasoned Action
by first establishing a baseline of the study population's salient beliefs on the topic of
interest. The target population for this portion of the instrument development was all
undergraduate students at The Ohio State University, Columbus campus, who are U.S.
citizens and registered for school-year 2000/2001 in either the College of Arts and
Sciences (ASC) or the College of Food, Agricultural, and Environmental Sciences
(FAES), which includes the School of Natural Resources. This represented a total target
population of approximately 10, 700 students.
Though the experiment would be conducted on a narrower subset of this
population - School of Natural Resources students only- soliciting responses from this
broader population of similar students increased the range and diversity of salient beliefs
reported. This also provided a more generalizeable set of responses to build upon, and
49
helped insure that a more robust range of possible beliefs was represented. Both
considerations are important when calibrating the instrument to capture topics of salient
interest to all of the subjects in the final experiment.
A stratified random sample frame of 150 students (75 female and 75 male) was
selected from the University's current 200012001 Student Directory using a random
number generation technique to first select a starting page, followed by a number to
determine how many pages to turn between each selection. Once a page was selected the
first selection criterion was with which of the two target Colleges the student was
affiliated. Once a viable candidate was found the name and email address were recorded
and the search moved to the next randomly selected page. Equal numbers of female and
male candidates were selected by alternating which sex was selected during each page
search. Selecting equal numbers of each sex was conducted to reflect the nearly 50150
distribution of males and females enrolled at Ohio State. Secondly, it was prudent to
solicit salient responses equally from both sexes, in keeping with the same reasoning
behind using gender as a blocking criterion. In order to more accurately reflect the 10:1
distribution of students enrolled in the College of Arts and Sciences (ASC) and the
College of Food, Agriculture, and Environmental Sciences (FAES) respectively, ten
candidates in ASC were selected for every one FAES candidate.
Following Dillman's (2000) procedures for internet surveys, candidates
comprising the sample frame of 150 students were sent a participation notification via
email one week prior to having the questionnaire actually sent. The questionnaire was
sent as part of an email message with instructions to answer within the context of the
50
email message and send back via "reply." Candidates were given one week to reply.
Two subsequent email solicitations were sent to non-respondents within two days after
each reply deadline lapsed. The final number of viable responses was 55, representing
37% of the sample frame. A comparison of early (first solicitation) versus late (third
solicitation) responses did not reveal any obvious qualitative or quantitative differences.
This sample inferentially represents the target population within an approximate ±12%
sample error at the 95% confidence level (Salant & Dillman, 1994).
Students participating in the salient belief questionnaire were asked:
1) What do you believe are the advantages of supporting an overall, nationwide decision that would favor reducing industrial and automobile greenhouse gas emissions within this country?
2) What do you believe are the disadvantages of supporting an overall, nationwide decision that would favor reducing industrial and automobile greenhouse gas emissions within this country?
3) Are there any organizations or individual people who would approve of you supporting an overall, nationwide decision that would favor reducing industrial and automobile greenhouse gas emissions within this country?
4) Are there any organizations or individual people who would disapprove of you supporting an overall, nationwide decision that would favor reducing industrial and automobile greenhouse gas emissions within this country?
Responses were compiled into a single transcript for each question. Each of the
four transcripts was analyzed by myself, starting with a qualitative content analysis to
ascertain recurrent themes. Next, a more careful reading of each response was conducted
by myself to judge which theme each statement most closely reflected. This required a
somewhat subjective judgment in that a common theme was often represented with
51
slightly different wording or phrasing by different respondents, but meant essentially the
same thing. Finally, each occurrence of a particular theme was counted for a final tally of
how frequently each theme was represented within the sample.
The most commonly stated themes for each of the four questions were recorded
[see Table 3.3]. These were considered representative of the main salient beliefs,
regarding outcomes of a decision to support large-scale human-induced climate change I
reduction and referents important to the respondents who would approve or disapprove of
such a decision.
These salient beliefs were used to help refine the search for specific information
regarding climate change that would be used to construct the experimental text passage
and subsequent questions. Where possible, topics chosen for inclusion in the instrument
were related to one of the five key salient outcomes.
There appear to be no substantial findings or hypotheses indicating that subjective
norm would be affected by variations in the textual components used as factors in this
study. Consequently, the salient referents were not as critical during the search for
relevant information in the climate change literature. However, one could consider that
these salient referents are most likely those who subjects were referring to when
responding to questions in the final instrument pertaining to the subjective norm variable.
52 I
'I
Salient Outcomes -Advantages 1) Decrease air pollution (23) 2) Decrease land and water pollution (15) 3) Protect the environment (14) 4) Protect human health (13) 5) Promote sustainable energy sources ( 10)
Salient Outcomes - Disadvantages 1) Higher costs for goods and services (16) 2) Economic slowdown (9) 3) Increased cost for energy and transportation (6) 4) Personal lifestyle inconvenience (5) 5) Loss of some jobs (4)
Salient Referents -Approve 1) Environmental groups (19) 2) Environmentally concerned citizens (13) 3) Scientists (8) 4) Government agencies (7) 5) Alternative energy industries ( 4)
Salient Referents - Disapprove 1) Industry in general (22) 2) Automobile manufacturers (20) 3) Coal, oil and gas companies (13) 4) Economically concerned citizens (8) 5) Conservative politicians (7)
N = 55. Numbers in parentheses represent frequency ofresponse.
Table 3.3: Top five most common responses to each of the salient belief and salient referent questions pertaining to the climate change issue.
53
I
I
I I
I
I I
I
I I
I
Text Material
The climate change issue was chosen for this study because it represents a current
and relevant natural resources problem that will require a considerable amount of
decision making to occur on the part of scientists, legislators, land managers, interest
groups and the public in general. It is also a large-scale issue in the United States and
abroad that impacts every human being to some extent, yet remains geographically
diffuse in that it cannot be pinpointed as a problem only for the West or the Great Lakes
or any particular city. Selecting an issue such as this was meant to reduce the potential
psychological effects of geographic proximity to the issue and personal investment
biases.
Climate change impacts are also wrought with scientific uncertainty and
imprecision of both measurement and predictions, which makes it a relatively contentious
issue. There are strong viewpoints regarding the detriments and benefits of either
supporting or not supporting climate change reductions.
The primary source of information for the experimental text and questions was the
technical report: Climate Change Impacts on the United States: The Potential
Consequences of Climate Variability and Change published in December, 2000, for the
U.S. Congress by the National Assessment Synthesis Team of the U.S. Global Change
Research Program (NAST, 2000 a & b ).
The experimental text passage was constructed from this source in order to
convey current and relevant information regarding climate change in a manner typical of
technical reports that natural resource decision makers may encounter. The experimental
54
passage started with a brief, 183-word introduction to the climate change issue designed
to orient the participating subjects to the topic and provide background information. This
text was adapted directly from the Climate Change Impacts on the United States report
(NAST, 2000), which is considered public domain material not subject to copyright law
infringement. This section related "factual" information about the accumulation of
greenhouse gases in the atmosphere and the latest projections for the physical aspects of
climate impacts, namely temperature, precipitation and sea level projections. All
treatment levels and the control group were given this portion of introductory text to read.
Fallowing is the introductory text as stated in the questionnaire:
Humans are affecting some of the key factors that govern climate by changing the composition of the atmosphere and by modifying the land surface. Rising atmospheric concentrations of carbon dioxide (C02) and other greenhouse gases are increasing Earth's natural greenhouse warming effect. This increase has resulted from the burning of coal, oil, and natural gas, and the clearing and burning of forests around the world. If the current rate of human-produced emissions is maintained, atmospheric C02 concentration will continue to rise, reaching between two and three times its pre-industrial level by the year 2100.
Long-term observations confirm that our climate is now changing at a rapid rate. With continued growth in atmospheric greenhouse gas concentrations, average temperature in the U.S. will rise in the next 100 years. There will also be more precipitation overall, with more of it coming in heavy downpours. In spite of this, some areas will get drier as increased evaporation due to higher temperatures outpaces increased precipitation. The warming is causing permafrost to thaw, and is melting sea ice, snow cover, and mountain glaciers, and sea level is rising.
Information for the manipulated part of the passage was carefully selected from
the report by first identifying topics that reflected the salient beliefs of the target
population. Secondly, topics were chosen that clearly portrayed a detriment to either
55
ecological or sociological systems if rapid, human-induced climate change is not
mitigated, as well as portraying the converse as a benefit to either system if the rate of
climate change is allowed to continue.
Equivalent-weighted propositional statements regarding both detriments and
benefits of climate change impacts constituted the experimental text. Ten statements
referred to detriments and ten to benefits, with five topics referring to ecological and five
to sociological impacts for each of the two viewpoints. Care was taken to match
statements regarding a particular detriment with one regarding a benefit that referred to
the same general topic. For example, one statement of a detriment: "Demands for air
conditioning might increase, possibly increasing the cost of energy during the summer,"
was matched by a statement regarding a benefit of allowing climate change to continue:
"Winter heating needs might decrease, possibly reducing the seasonal cost of energy."
Following is a list of the twenty topics used in the final instrument. Same
numbered items between detriments and benefits indicate a "matched" set of similar
topics that serve as the converse of each other:
Detriments Ecological:
1) Shoreline erosion and coastal wetland losses. 2) The rate ofloss of biodiversity, and plant and animal species'
adaptability to rapid changes. 3) Sustainability of delicate and isolated ecosystems such as alpine
meadows, mangroves, and tropical mountain forests. 4) Forest susceptibility to pests and fire, and damage to forest
ecosystem productivity. 5) Fish habitat disturbance and survival of cold-water fish species.
56
I
I I I I I I
Sociological: 6) Demands for air conditioning and the cost of energy during the
summer. 7) Water availability for irrigation, and irrigation management
complications. 8) Water- and animal-borne related diseases, and incidents of human
illness and death. 9) The risk of flash floods and soil erosion, and agricultural
productivity. 10) Economic impacts on the U.S. gross domestic product (GDP).
Benefits Ecological:
1) The number of inland, non-tidal wetlands, and the area where floodplain wetlands can form.
2) Migrating birds extent of flying south, timing of seasonal nesting, and the odds of young birds surviving winters.
3) Tree growth and forest expansion, and the coverage and range of forest ecosystems.
4) Plant productivity throughout various ecosystems. 5) Over-winter mortality of many species of wildlife, cold stress, and
seasonal availability of food for wildlife.
Sociological: 6) Winter heating needs and the cost of energy. 7) Crops developing at faster rates and agricultural use of irrigation
water. 8) Incidents of cold-related human illnesses and deaths. 9) The food supply from agricultural productivity and prices for food
products. 10) Economic impacts on the U.S. gross domestic product (GDP).
Statements were extracted from the Climate Change Impacts on the United States
(NAST, 2000 a & b) source documents as close to verbatim as possible, again this
material is considered public domain not subject to copyright law infringement. Minor
alterations in word choice and order were necessary to standardize sentence length and
57
I I
I I
I I
allow for the textual manipulations to be added or omitted and still retain coherent,
parallel meaning.
A readability index, based on a system developed by Edward Fry that compares
number of syllables to number of sentences within a passage of text, was used to assess
the reading complexity throughout the text (Hopkins, 1998). The text consistently
registered at a college readability level. Sentence structure, length, language register,
voice, tone, person, and modifiers that were not part of the treatment manipulations were
kept as constant as possible throughout the text.
Subjects were informed in the instructions section that "all information presented
in the passage is based on a consensus of rigorously studied, well accepted sources."
However, sources of the content of the text were not revealed to the subjects, so that trust
in the origin of the information would not be a potential influence on responses.
The text was adapted for the experimental conditions by simultaneously
manipulating two message components [see Appendix BJ:
Hedging was altered by 1) adding terms to modify the modal and epistemic
quality of statements (e.g. Water availability for irrigation might decrease, potentially
complicating irrigation management.), or 2) not hedging was produced by using the
definitive modal will, and omitting any adverbial hedges (e.g. Water availability for
irrigation will decrease, complicating irrigation management).
Matched sets of detriments and benefits were structured with the same hedging
terms. Each statement, when hedged, contained two hedging terms. One term was a
modal verb such as might, may or could and the other was an adverb such as possibly,
58
I I
I
I I
I I I
I
I
I
I
probably or potentially, or an adverbial "rounder" such as about or roughly. The
introduction to each set of ten statements was also hedged for those treatment levels, also
using two hedging terms. In this case, one term was the lexical verb suggest and the
other the adverb likely.
Each set of ten statements, with the corresponding introduction, contained
approximately 235 words [see Table 3.5]. Twenty-two hedging terms were used per 235
word passage, representing a hedging frequency of about one out of ten words. This
corresponds closely to descriptive studies of scientific texts, reporting average hedging
frequencies for the Discussion sections of typical biomedical case reports and research
papers at 10% to 13% (Salager-Meyer, 1994).
Framing was altered by 1) describing the outcome of each propositional statement
in a positive valence relative to each of the two decision alternatives (support vs. not
support climate change reductions) (e.g. Disturbance of fish habitat will be avoided,
preventing threats to the survival of some cold-water fish species), or 2) describing the
outcome of each propositional statement in a negative valence relative to each of the two
decision alternatives (e.g. Disturbance of fish habitat will occur, threatening the survival
of some cold-water fish species).
Using the typology of goal framing described in detail by Levin, Schneider and
Gaeth (1998), positive and negative valences were each represented by two different
manners of framing. One manner is considered a "strong" frame, using obtain gain and
suffer loss formats to represent positive and negative valences respectively. The other
59
manner is considered a "weak" frame relative to the first, using avoid loss and forgo gain
formats to represent positive and negative valences respectively.
The following two Tables [3.4 & 3.5] outline what constitutes each treatment
level in relation to how the two sides of the issue (detriments and benefits) are presented,
and the number of words contained in the experimental text passages for each treatment
level.
60
DETRIMENTS BENEFITS
Hedging: 1) Both Hedged Hedged Hedged 2) Both Not Hedged Not Hedged Not Hedged 3) Mix(A) Hedged Not Hedged 4) Mix(B) Not Hedged Hedged 5) Control n/a n/a
Framing: 1) Strong Mix Suffer Loss Obtain Gain 2) Weak.Mix Avoid Loss Forgo Gain 3) Both Positive Avoid Loss Obtain Gain 4) Both Negative Suffer Loss Forgo Gain 5) Control n/a n/a
Table 3.4: Combination of various experimental treatment levels for each of the two main variables.
Hedged Not Hedged
Detriments: Suffer Loss 227 218 Avoid Loss 243 234
Benefits: Obtain Gain 226 217 Forgo Gain 258 249
Table 3.5: Number of words for each experimental text passage.
61
~
Expert Panel
Twelve faculty members from the School of Natural Resources at The Ohio State
University were selected to serve as a panel of experts to help validate the specific
climate change topics selected for the instrument. This panel consisted of six professors
whose research focuses on the social science component of natural resource issues, and
six who focus on the natural science component. Three of the twelve panelists were
female. Most panelists are full professors who have been working in their respective
fields for a decade or more. Three panelists were relatively new faculty members, having
started their academic careers within two years prior to the study.
Each expert panelist received a questionnaire containing each of the twenty
climate change topics, specifically the ten detriment and ten benefit statements drawn
directly from the Climate Change Impacts on the United States report (NAST, 2000 a &
b ). Each topic was presented as a pair of two versions of the same statement. One
version was negatively framed and the other positively framed. This format was used to
help mitigate potential bias in response caused by differential framing. All versions were
hedged to hold that variable constant for this portion of the study.
Panelists were asked to read each topic pair and rate how important they judge the
topic represented in the statements to be when deciding whether to support or not support
a reduction in the rate of human-induced climate change. Panelists were informed that
"this is not meant to be a measure of your personal preference or attitude toward one side
of the issue or the other; rather, it is an objective (as possible) measure of how important
62
each proposition is to the overall issue." Panelists were also asked to "rate each
statement pair on its own merits, not relative to other pairs."
Responses were along a five-point, Likert-type scale: Not at all important,
Slightly important, Important, Very important, Extremely important. Panelists were also
asked to make qualitative comments regarding the accuracy and clarity of the content
presented in each statement, as well as the validity of the frame shift within each pair of
statements. Comments and criticisms from panelists were taken into account during
development of the field test version of the questionnaire.
Statement pairs that appeared grossly out ofline with the other statements were
either omitted or altered dramatically, based on panelists' qualitative comments, to
reduce whatever extraneous factor was affecting the response. For example, an early
' iteration of the human health topic used a version of the benefit side that read more or
less the same as the final version: Incidents of cold-related human illnesses and deaths
could be reduced in some areas of the country that may experience less severe winter
conditions (obtain gain version only). Meanwhile, the original detriment-oriented
alternate human health topic read: Diseases that are water and animal borne may
intensify in the summer, which could increase incidents of human illness and death in
some areas experiencing more heat waves (suffer loss version only).
The initial factor analysis interpretation indicated that the benefit alternate fit
relatively well with other sociological benefit topics. But, the detriment alternate loaded
high on a very different factor than any other topic in its category. Upon closer
examination of the panelists' written comments and a few one-on-one discussions
63
revealed that the detriment version was most likely introducing a confounding concept
that was affecting the way the panelists were responding. In this particular case it was
clear that the addition of" ... areas experiencing more heat waves" was adding an outcome
of climate change that conceptually was being perceived as above and beyond the
potential increase in water and animal borne diseases. Panelists were consistently
considering this particular topic as "extremely important," because it not only referred to
human diseases but also the rather large-scale health and economic impacts associated
with heat waves. Obviously, this additional concept skews the intended equity both
among related topics and between alternate detriment/benefit topic pairs. Consequently,
the heat wave reference was omitted from the next iteration, and follow-up analysis
during the pilot test indicated that the textual correction had more or less solved this
problem.
A factor analysis was conducted on the results to ascertain similarities in
responses in order to validate that statements pertaining to either detriments or benefits
are judged as similar enough in importance to eventually be averaged to measure a single
variable [see Tables 3.6 & 3.7]. The unrotated principal components analysis resulted in
50.4% of the variance explained by the first factor (Eigenvalue= 10.1), suggesting a
strong unidirectionality inherent in the choice of topics. All loadings were 2: 0.50, with
half of them;::: 0.70. A Varimax rotated principal components analysis revealed roughly
two discrete factors, one for detriments and one for benefits. Most loadings for each
were;::: 0.40 per factor, with two exceptions for each component. Though the sample size
for this factor analysis was small (N = 12), the high number of factor loadings 2: 0.40, at
64
least four loadings among the total that were 2: 0.60, and communalities that were very
high 2: 0.80, all helped validate the use of this analysis under these circumstances (Hair et
Sociological: Agriculture Energy Health Economy Irrigation
Cronbach's Alpha= 0.90
N=12.
Mean
4.0 3.8 3.5 4.1 3.3
4.0 3.3 4.2 2.9 4.0
SD
0.8 1.1 0.8 0.8 0.8
0.7 0.9 0.6 1.1 1.0
Item-Total Correlation
0.83 0.72 0.86 0.79 0.75
0.69 0.25 0.68 0.44 0.72
Means based on a 5-point scale: 1 =Not important at all, 2 = Slightly important, 3 =Important, 4 =Very important, 5 =Extremely important.
Table 3.8: Item analysis of Detriment statements, based on an internal consistency method using Item-total correlations and Cronbach's Alpha, for expert panel responses.
Sociological: Agriculture Energy Health Economy Irrigation
Cronbach's Alpha= 0.92
N= 12.
Mean
2.6 3.4 3.2 2.8 2.9
2.8 2.8 2.8 2.3 3.3
SD
0.8 0.8 1.2 0.9 0.8
1.1 0.9 1.0 1.2 0.9
Item-Total Correlation
0.72 0.54 0.78 0.69 0.83
0.86 0.58 0.83 0.55 0.80
Means based on a 5-point scale: I =Not important at all, 2 = Slightly important, 3 =Important, 4 =Very important, 5 =Extremely important.
Table 3.9: Item analysis of Benefit statements, based on an internal consistency method using Item-total correlations and Cronbach's Alpha, for expert panel responses.
70
Field and Pilot Tests
An early draft of the questionnaire was field tested with a panel of eight graduate
students currently enrolled in the School of Natural Resources who are familiar with
social science methodologies applied to natural resource issues, including the Theory of
Reasoned Action. Each field test participant received a $20 gift for participating in the
session and handing in a written critique of the instrument. Comments and criticisms
from this session were used to provide a sense of the face validity of the questionnaire
and to refine instructions, experimental passage, questions and scales prior to pilot testing
the instrument.
A pilot study was conducted with 32 subjects, consisting of22 female and 10
male respondents. Participants in the pilot test were volunteers solicited from a sample
frame that consisted of all graduate students, who are U.S. residents, currently enrolled in
the School of Natural Resources at The Ohio State University. This sample frame
represented 80 eligible individuals, of which 40% participated in the study. Each
participant received a $10 gift for completing a pilot questionnaire.
Using the pilot test results, internal reliability was calculated using Cronbach's
alpha for each set of items designed to constitute a single variable [see Table 3.10].
Gross anomalies found in any of the items were corrected before the actual experiment.
The reliability of the final experimental version of the questionnaire was also
observed as a follow-up, again using Cronbach's Alpha [see Table 3.10]. The control
group results, from 32 cases, was used as a sample, since reliabilities would not be
differentially affected by the treatments.
71
I
I
I
I
I
I I
I I
I
I
Prior Background Clarity of Information Belief in Climate Change
Decision Intention Subjective Norm Overall Attitude Belief in Outcome:
Detriments Benefits
Evaluation of Outcome: Detriments Benefits
Prioritization of Use: Detriments Benefits
Number of items
3 2 5
2 4 2
10 10
10 10
10 10
Pilot Group: N = 32; Control Group: N = 32.
Pilot Test Control Group Cronbach's Alpha Cronbach's Alpha
0.60 0.69 0.61 0.69 0.80 0.83
0.93 0.77 0.86 0.83 0.41 0.56
0.73 0.68 0.51 0.56
0.44 0.54 0.43 0.65
0.85 0.81 0.78 0.78
Table 3 .10: Reliability of instrument, based on an internal consistency method using Cronbach's Alpha, for both the pilot and control groups.
72
I I I
I
I
I
Dependent Variable Measures
The affective domain was assessed using primarily fue Theory of Reasoned
Action (TRA) model defined by Fishbein (1967) and later developed into a descriptive
and predictive model for analyzing human behavior (Fishbein & Ajzen, 1975; Ajzen &
Fishbein, 1980). This involved five separate measures: Decision Intention, Overall
Attitude, Subjective Norm, Belief in Outcome, and Outcome Evaluation.
For each TRA measure subjects were asked to rate their direction and magnitude
of agreement to a series of statements. One of two versions of a seven-point, bipolar
semantic differential scale commonly used for TRA studies (Ajzen & Fishbein, 1980)
were used for each question.
Decision Intention, Subjective Norm and Belief in Outcome variables were
3.) Belief in Outcome (Sub-sets): a.) Belief in Detriments b.) Belief in Benefits
4.) Outcome Evaluation (Sub-sets): a.) Evaluation of Detriments b.) Evaluation of Benefits
5.) Prioritization oflnformation Use (Sub-sets): a.) Prioritization ofDetriments b.) Prioritization of Benefits
80
I
Variables
Set A: Clarity of Information Trust in Credibility
SetB: Decision Intention Overall Attitude
Decision Intention Subjective Norm
Overall Attitude Subjective Norm
Set C: Belief in Outcome:
Detriments Benefits
SetD: Outcome Evaluation:
Detriments Benefits
SetE: Prioritization of Information Use:
Detriments Benefits
r
0.40
0.54
0.57
0.39
0.15
0.50
0.90
N = 160. Pearson correlation coefficient (r).
Sig. (p)
0.001 ***
0.001 ***
0.001 ***
0.001 ***
0.032*
0.001 ***
0.001 ***
Significance determined at a= 0.05, based a one-tailed test. *Significant at p :S 0.05 level.
**Significant at p :S 0.01 level. ***Significant atp :S 0.001 level.
Table 4.1: Correlations of related dependent variables with each other, for multivariate analysis of variance.
81
Correlations with Covariate
Prior Background regarding any issue is considered an important concomitant
variable in many studies of psychological response, particularly when a decision response
is being solicited (e.g. Ajzen & Fishbein, 1980; Payne et al., 1993). It stands to reason
that a person's cognitive and affective responses can be influenced by prior experience
and knowledge regarding an issue. Accounting for Prior Background as a covariate in
the analyses of variance could help refine error variance, in turn increasing the power of
the test to discern differences (Keppel, 1991; Kirk, 1995; Hair et al., 1998). This measure
was included in the questionnaire as a series of three questions posed just before the
experimental text passage was presented. One question asked for a self-assessment of
how knowledgeable the subject considered him or herself regarding the climate change
issue. The other two questions asked for an assessment of how informed the subject was
about the issue from media sources and classroom experiences respectively. Subjects
were asked to respond to these three before reading any further in the questionnaire. This
format hopefully insured a high degree of independence between this particular measure
and the experimental manipulations.
A bivariate correlation, using the Pearson correlation coefficient, was conducted
to ascertain the relationship of the Prior Background variable with each of the dependent
variables and their sub-sets. A reasonable assumption was made that any potential
relationships would be unidirectional, so one-tailed analyses were conducted. The
significance level was set at 95% confidence (a = 0.05).
82
Tue following results were used, in conjunction with theoretical reasoning, to
determine whether Prior Background should be added to the subsequent analyses of
variance as a covariate. Five of the nine dependent variables showed a significant
correlation with Prior Background: Belief in Climate Change, Trust in Credibility of
Information, Decision Intention, Overall Attitude, and Belief in Outcome (Detriments);
plus Clarity of Information showed a very close trend toward significance. Though none
of the significant correlations demonstrated strong magnitudes, ranging from r = 0.14 to
0.23, they were all significant at the p :':'. 0.05 level [see Table 4.2]. Prior Background was
used as a covariate in analyses of variance associated with these variables in order to help
reduce error variance and increase power.
83
Variables
Clarity of Information Trust in Credibility Decision Intention Overall Attitude Subjective Norm Belief in Climate Change Belief in Outcome:
Detriments Benefits
Outcome Evaluation: Detriments Benefits
0.16
0.09
Prioritization of Information Use: Detriments 0.01 Benefits
r
0.12 0.18 0.14 0.23 0.09 0.20
0.019* 0.10
0.121 0.06
0.431 - 0.01
N = 160. Pearson correlation coefficient (r).
Sig. (p)
0.071 0.019* 0.045* 0.002** 0.141 0.005**
0.116
0.224
0.439
Significance determined at a= 0.05, based a one-tailed test. *Significant at p :S 0.05 level.
**Significant at p :S 0.01 level.
Table 4.2: Correlations of each of the dependent variables with potential covariate, Prior Background.
84
Analysis of Main Effects: Univariate
Differences among subjects' responses to each dependent variable, and their sub
sets, were analyzed using ANOV A or the corresponding covariance procedure.
Univariate results of these analyses were used to determine main effects of the two
experimental factors after error variance from the covariate, when applicable, and gender
differences were accounted for in the factorial model.
A Levene's Test of equality of error variance was used to determine homogeneity
by testing the null hypothesis that the error variance of the dependent variable was equal
across groups. Most variables upheld the null hypothesis for this test. Those that
rejected the null did, however, all have F-values that were :S 3.00, suggesting that
heterogeneity of variance among groups was probably not severe enough to warrant
concern (Keppel, 1991 ).
Statistical power was a major concern during the design and execution of this
experiment, as very few studies have been conducted with this combination of variables.
A priori effect size was, consequently, difficult to ascertain. The target power level was
::". 0.80 to detect an effect size of approximately f* ::". 0.25. In order to increase power and,
to some extent, control for Type II error, the blocking technique with Gender and the use
of Prior Background as a covariate were used to help reduce error variance.
Significant differences among particular treatment means were determined using
a Bonferronipost-hoc, multiple comparison technique at the corresponding confidence
level for significance. When the covariate was included as part of the factorial model,
comparisons were conducted on adjusted means.
85
Research questions posed in this study were broken down into two basic
approaches to analyzing the data. The first series of questions asked if there were
differences in the magnitude and direction of responses to each of the dependent
variables among the various treatments. In other words, multiple comparisons were made
among mean response to a single variable such as Outcome Evaluation of Detriments,
where one treatment may provoke a stronger positive response to this variable than
another. These analyses were considered comparisons of direct responses to each
variable.
The other set ofresearch questions asked if there were differences among the
differential responses to variable sub-sets such as Belief in Outcome Detriments versus
Benefits. For example, one treatment may evoke a strong positive response to both
Belief in Outcome Detriments and Benefits, resulting in a small difference score
(Benefits - Detriments). Meanwhile, another treatment may evoke a strong positive
response to Belief in Outcome Detriments but a negative response to Benefits. The
resulting differential score would be much greater than in the first case. A multiple
comparison of difference scores for Detriments versus Benefits revealed differences
among treatment effects on the differential responses to these components. These
analyses were considered comparisons of differential responses between Detriments
(DET) and Benefits (BEN).
86
Comparison of Direct Responses:
Clarity of Information revealed no significant difference in responses among
hedging treatments, but did show a trend (F = 2.40,p = 0.071) among the framing
treatments [see Table 4.3]. Multiple comparison of means revealed this trend as a
difference between the Control group response (Mean = 2.1) and both the Suffer Loss
DET-Forgo Gain BEN (Mean= 1.1) and Avoid Loss DET-Forgo Gain BEN (Mean=
1.3). This indicates that the Control group, who of course did not have an experimental
passage to read, considered the introductory paragraph as "quite" easy to read and
understand. Subjects appear to have considered the two framing treatments that included
the Forgo Gain frame to be only "slightly" easy to read and understand. This result was
consistent with qualitative comments made during the development of the questionnaire
regarding the relative difficulty ofreading a passage framed as Forgo Gain.
Trust in Credibility of Information showed no significant difference among
framing treatments, but did show a trend toward significance among hedging treatments
(F = 2.28,p = 0.083) [see Table 4.4]. Multiple comparisons showed the differences to be
between two sets of treatments 1) the Control (Mean= 0.9) and Hedge DET-Not Hedge
BEN (Mean= - 0.1), and2) NotHedgeDET & BEN (Mean= 0.8) andHedgeDET-Not
Hedge BEN (Mean= - 0.1). This result reveals an interesting pattern whereby treatments
with Not Hedge BEN indicate a significantly lower level of trust in the information
presented in the text passage compared to the Control and when both DET and BEN are
Not Hedged. Given the environmentally conscientious nature of the population sampled
this may be an indicator that information perceived as not environmentally friendly,
87
namely promoting the benefits of not slowing the rate of human-induced climate change,
may be taken by this population as Jess credible if it is presented in a definitive, non-
hedged manner.
The three upper tier variables that constitute the Theory of Reasoned Action:
Decision Intention, Overall Attitude, and Subjective Norm did not reveal any significant
results among treatments of either factor [see Tables 4.5, 4.6, & 4. 7]. However, one trend
did emerge. For Decision Intention it appears Not Hedging DET & BEN (Mean= 2.0)
versus Hedging DET & BEN (Mean= 1.3) was trending toward significance (F = 2.22,
p = 0.090). Since this result is only between the treatments that did not distinguish
' between Detriments and Benefits, it is a hard to interpret what this trend may indicate at
this time, with Not Hedging eliciting a slightly stronger "likely" to support climate
change reductions response than Hedging.
Belief in Climate Change did not appear to be strongly affected by either factor,
as no significant differences were found among treatments of either hedging or framing
[see Table 4.8]. But, one trend toward significance did emerge regarding framing (F =
2.25,p = 0.085). Avoid Loss DET-Forgo Gain BEN (Mean= 1.1) appeared to elicit a
slightly more positive "agree" response than Suffer Loss DET-Forgo Gain BEN (Mean=
0.8).
Belief in Outcome and Evaluation of Outcome sub-sets ofrespective variables
(Detriments and Benefits) showed no significant differences among treatments for either
hedging or framing [see Tables 4.9 - 4.12]. The Theory of Reasoned Action describes
these two variables as constituting the Overall Attitude variable (Ajzen & Fishbein,
88
;, II
I
1980). This study revealed no significant differences among responses for that higher
order variable in this model, so it stands to reason that its constituent components would
reflect this as well.
The most compelling results involved the sub-sets of the Prioritization of
Information Use variable. Significant differences among responses under treatments
were shown for both Prioritization of Detriments and Prioritization of Benefits for
framing and a strong trend toward significance for hedging [see Tables 4.13 & 4.14].
Subjects were asked to rank the importance of each statement of topical
information regarding a detrimental or beneficial component of the climate change issue.
'The scale was from one (1) for "most important" to ten (10) "least important," so average
rankings resulted in lower numbers representing a perceived higher priority than higher
numbers.
A strong trend toward significance indicates that Prioritization of Detriments
(F = 2.47,p = 0.065) and Prioritization of Benefits (F = 2.38,p = 0.073) were affected by
hedging. Multiple comparisons revealed that for Prioritization of Detriments Hedge
DET-Not Hedge BEN elicited an average ranking of the Detriment information
components that was slightly toward "more important" (Mean= 4.8) than Not Hedge
DET-Hedge BEN (Mean= 5.2). Similarly, Prioritization of Benefits showed a trend
toward Not Hedge DET-Hedge BEN eliciting a slightly stronger "importance" ranking
for the Benefit components (Mean= 5.8) than Hedge DET-Not Hedge BEN (Mean=
6.1 ). This trend is consistent with the hypothesis that hedging of infonnation promotes a
stronger response. Curiously, though, the treatments that were either Hedging Detriments
89
and Benefits or Not Hedging both did not appear to evoke a difference in prioritization
for either Detriments or Benefits.
The most dramatically significant difference in direct response found in this study
involved the effects of framing on Prioritization of Detriments and Benefits.
Prioritization of Detriments showed significant effects of framing (F = 6.30,p = 0.001),
and Prioritization of Benefits (F = 6.11,p = 0.001).
Multiple comparisons revealed that responses were significantly different among
nearly all of the framing treatments. For Prioritization of Detriments, ranking under
Suffer Loss DET-Obtain Gain BEN (Mean= 4.8) showed a higher average priority than
both Avoid Loss DET-Forgo Gain (Mean = 5.1) and Suffer Loss DET-F orgo Gain BEN
(Mean= 5.3). Similarly, Avoid Loss DET-Obtain Gain BEN (Mean= 4.8) elicited a
higher ranking than both Avoid Loss DET-Forgo Gain (Mean= 5.1) and Suffer Loss
DET-Forgo Gain BEN (Mean= 5.3).
For Prioritization of Benefits, the same treatments caused significantly different
responses, but the direction of priority was the reverse of the Detriment responses. Suffer
Loss DET-Obtain Gain BEN (Mean= 6.2) showed a lower average priority than both
Avoid Loss DET-Forgo Gain (Mean= 5.9) and Suffer Loss DET-Forgo Gain BEN
(Mean= 5.7). Similarly, Avoid Loss DET-Obtain Gain BEN (Mean= 6.1) elicited a
lower ranking than both Avoid Loss DET-Forgo Gain (Mean= 5.9) and Suffer Loss
DET-Forgo Gain BEN (Mean= 5. 7).
Results for both Prioritization of Detriments and Benefits were consistent with the
hypothesis that negative framing elicits a stronger response than positive. For example,
90
Prioritization of Benefits information presented in two of the treatments as Forgo Gain
(negative) consistently elicited a slightly higher prioritization of Benefits than when the
same information was presented as Obtain Gain (positive).
Information presented as Suffer Loss (negative) resulted in a higher prioritization
of Detriments than when those statements were presented as Avoid Loss (positive).
However, this result appears to have reversed when Suffer Loss was presented with
Forgo Gain for the Benefits and Avoid Loss with Obtain Gains. This may indicate that
the manner in which information about the opposing view is presented influences the
viewpoint under investigation. This influence will be examined in greater detail in the
following section on comparisons of differential responses.
Also note that a significant interaction between hedging and framing effects
occurred with both Prioritization of Detriments and Benefits. The nature of this
interaction will be discussed in a subsequent section, so interpretation of main effects
from these results should be looked at in light of this interaction.
91
Variables Mean SE
Hedging: Hedge DET & BEN 1.3 0.2 Not Hedge DET & BEN 1.6 0.2 Hedge DET-Not Hedge BEN 1.5 0.2 Not Hedge DET-Hedge BEN 1.4 0.2 Control 2.1 0.2
Framing: Suffer Loss DET-Obtain Gain BEN 1.8 0.2 Avoid Loss DET-Forgo Gain BEN 1.3 0.2 A void Loss DET-Obtain Gain BEN 1.7 0.2 Suffer Loss DET-Forgo Gain BEN 1.1 0.2 Control 2.1 0.2
Hedging * Framing
DET =Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N = 160. Main effect: n = 32. Significance determined at a= 0.05.
F df Sig. (p)
0.171 3 0.916
2.400 3 0.071
1.161 9 0.326
Means based on 7-point scale: -3 =Extremely difficult to understand, -2 =Quite difficult to understand, -1 = Slightly difficult to understand, 0 =Neither/Nor, 1 = Slightly easy to understand, 2 = Quite easy to understand, 3 = Extremely easy to understand.
Table 4.3: Main effects and interactions for Clarity of Information.
92
Variables Mean SE
Hedging: Hedge DET & BEN 0.3 0.2 Not Hedge DET & BEN 0.8 0.2 Hedge DET-Not Hedge BEN - 0.1 0.2 Not Hedge DET-Hedge BEN 0.6 0.2 Control 0.9 0.2
Framing: Suffer Loss DBI-Obtain Gain BEN 0.5 0.2 Avoid Loss DET-Forgo Gain BEN 0.3 0.2 Avoid Loss DBI -Obtain Gain BEN 0.3 0.2 Suffer Loss DET-Forgo Gain BEN 0.4 0.2 Control 0.9 0.2
Hedging* Framing
DET = Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n=32. Significance determined at a= 0.05.
F df Sig. (p)
2.277 3 0.083
0.122 3 0.947
1.388 9 0.200
Means based on 7-point scale: -3 =Extremely difficult to trust, -2 =Quite difficult to trust, -1 =Slightly difficult to trust, 0 =Neither/Nor, 1 =Slightly easy to trust, 2 =Quite easy to trust, 3 = Extremely easy to trust.
Table 4.4: Main effects and interactions for Trust in the Credibility of Information.
93
Variables Mean SE F df Sig. (p)
Hedging: 2.215 3 0.090 Hedge DET & BEN 1.3 0.2 Not Hedge DET & BEN 2.0 0.2 Hedge DET-Not Hedge BEN 1.7 0.2 Not Hedge DET-Hedge BEN 1.6 0.2 Control 1.9 0.2
Framing: 0.215 3 0.886 Suffer Loss DET-Obtain Gain BEN 1.8 0.2 Avoid Loss DET-Forgo Gain BEN 1.6 0.2 Avoid Loss DET-Obtain Gain BEN 1.7 0.2 Suffer Loss DET-Forgo Gain BEN 1.7 0.2 Control 1.9 0.2
Hedging* Framing 0.408 9 0.929
DET =Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n=32. Significance determined at a= 0.05. Means based on 7-point scale: -3 =Extremely unlikely, -2 =Quite unlikely, -1 =Slightly unlikely, 0 =Neither/Nor, 1 = Slightly likely, 2 =Quite likely, 3 =Extremely likely.
Table 4.5: Main effects and interactions for Decision Intention.
94
Variables Mean SE F df Sig. (p)
Hedging: 0.272 3 0.846 Hedge DET & BEN 1.9 0.1 Not Hedge DET & BEN 2.1 0.1 Hedge DET-Not Hedge BEN 2.0 0.1 Not Hedge DET-Hedge BEN 2.0 0.1 Control 2.0 0.1
Framing: 0.577 3 0.631 Suffer Loss DET-Obtain Gain BEN 1.9 0.2 Avoid Loss DET-Forgo Gain BEN 2.1 0.2 Avoid Loss DET-Obtain Gain BEN 2.1 0.2 Suffer Loss DET-Forgo Gain BEN 2.0 0.2 Control 2.0 0.2
Hedging * Framing 0.605 9 0.791
DET =Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N = 160. Main effect: n = 32. Significance determined at a= 0.05. Means based on 7-point scale: -3 =Extremely bad, -2 =Quite bad, -1 =Slightly bad, 0 = Neither/Nor, 1 = Slightly good, 2 =Quite good, 3 =Extremely good.
Table 4.6: Main effects and interactions for Overall Attitude.
95
I
I I I I I I I I
I I I
I I
I I I
--- - ----
Variables Mean SE F df Sig. (p)
Hedging: 0.466 3 0.707 Hedge DET & BEN 1.4 0.2 Not Hedge DET & BEN 1.4 0.2 Hedge DET-Not Hedge BEN 1.1 0.2 Not Hedge DET-Hedge BEN 1.2 0.2 Control 1.2 0.2
Framing: 0.990 3 0.400 Suffer Loss DET-Obtain Gain BEN 1.4 0.2 Avoid Loss DET-Forgo Gain BEN 1.1 0.2 Avoid Loss DET--Obtain Gain BEN 1.1 0.2 Suffer Loss DET-F orgo Gain BEN 1.4 0.2 Control 1.2 0.2
Hedging* Framing 0.989 9 0.452 .. DET = Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n = 32. Significance determined at a= 0.05. Means based on 7-point scale: -3 =Extremely unlikely, -2 =Quite unlikely, -1 =Slightly unlikely, 0 =Neither/Nor, 1 =Slightly likely, 2 =Quite likely, 3 =Extremely likely.
Table 4.7: Main effects and interactions for Subjective Norm.
96
Variables Mean SE F df Sig. (p)
Hedging: 0.201 3 0.895 Hedge DET & BEN 1.4 0.2 Not Hedge DET & BEN 1.4 0.2 Hedge DET-Not Hedge BEN 1.1 0.2 Not Hedge DET-Hedge BEN 1.2 0.2 Control 1.2 0.2
Framing: 2.254 3 0.085 Suffer Loss DET-Obtain Gain BEN 1.4 0.2 Avoid Loss DET-Forgo Gain BEN 1.1 0.2 Avoid Loss DET-Obtain Gain BEN 1.1 0.2 Suffer Loss DET-Forgo Gain BEN 1.4 0.2 Control 1.2 0.2
Hedging * Framing 0.421 9 0.922
DET =Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n=32. Significance determined at a= 0.05. Means based on 5-point scale: -2 = Strongly disagree, -1 =Disagree, 0 =Neither/Nor, 1 = Agree, 2 = Strongly agree.
Table 4.8: Main effects and interactions for Belief in Climate Change.
97
Variables Mean SE F df Sig. (p)
Hedging: 0.182 3 0.909 Hedge DET & BEN 0.9 0.1 Not Hedge DET & BEN 0.8 0.1 Hedge DET-Not Hedge BEN 0.8 0.1 Not Hedge DET-Hedge BEN 0.8 0.1 Control 0.6 0.1
Framing: 2.615 3 0.115 Suffer Loss DET-Obtain Gain BEN 0.7 0.1 Avoid Loss DET-Forgo Gain BEN 1.1 0.1 Avoid Loss DET-Obtain Gain BEN 1.0 0.1 Suffer Loss DET-Forgo Gain BEN 0.5 0.1 Control 0.6 0.1
Hedging* Framing 0.921 9 0.509
DET =Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n=32. Significance determined at a= 0.05. Means based on 7-point scale: -3 =Extremely unlikely, -2 =Quite unlikely, -1 =Slightly unlikely, 0 =Neither/Nor, 1 =Slightly likely, 2 =Quite likely, 3 =Extremely likely.
Table 4.9: Main effects and interactions for Belief in Outcome (Detriments).
98
Variables Mean SE F df Sig. (p)
Hedging: 0.936 3 0.426 Hedge DET & BEN - 0.1 0.1 Not Hedge DET & BEN 0.2 0.1 Hedge DET-Not Hedge BEN 0.1 0.1 Not Hedge DET-Hedge BEN 0.1 0.1 Control - 0.2 0.1
Framing: 0.401 3 0.753 Suffer Loss DET-Obtain Gain BEN 0.1 0.1 Avoid Loss DET-Forgo Gain BEN 0.1 0.1 Avoid Loss DET-Obtain Gain BEN 0.2 0.1 Suffer Loss DET-Forgo Gain BEN 0.1 0.1 Control - 0.2 0.1
Hedging * Framing 0.874 9 0.551
DET = Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n=32. Significance determined at a= 0.05. Means based on 7-point scale: -3 =Extremely unlikely, -2 =Quite unlikely, -1 =Slightly unlikely, 0 =Neither/Nor, 1 = Slightly likely, 2 =Quite likely, 3 =Extremely likely.
Table 4.10: Main effects and interactions for Belief in Outcome (Benefits).
99
Variables Mean SE F df Sig. (p)
Hedging: 0.339 3 0.797 Hedge DET & BEN 1.4 0.1 Not Hedge DET & BEN 1.5 0.1 Hedge DET-Not Hedge BEN 1.4 0.1 Not Hedge DET-Hedge BEN 1.5 0.1 Control 1.4 0.1
Framing: 0.314 3 0.816 Suffer Loss DET-Obtain Gain BEN 1.4 0.1 Avoid Loss DET-Forgo Gain BEN 1.5 0.1 Avoid Loss DET-Obtain Gain BEN 1.4 0.1 Suffer Loss DET-Forgo Gain BEN 1.4 0.1 Control 1.4 0.1
Hedging * Framing 1.048 9 0.406
DET =Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n=32. Significance determined at a= 0.05. Means based on 7-point scale: -3 =Extremely bad, -2 =Quite bad, -1 =Slightly bad, 0 = Neither/Nor, 1 = Slightly good, 2 =Quite good, 3 =Extremely good.
Table 4.11: Main effects and interactions for Outcome Evaluation (Detriments).
100
Variables Mean SE F df Sig. (p)
Hedging: 0.413 3 0.744 Hedge DET & BEN 0.8 0.1 Not Hedge DET & BEN 0.8 0.1 Hedge DET-Not Hedge BEN 0.7 0.1 Not Hedge DET-Hedge BEN 0.9 0.1 Control 1.0 0.1
Framing: 1.391 3 0.249 Suffer Loss DET-Obtain Gain BEN 0.7 0.1 Avoid Loss DET-Forgo Gain BEN 0.8 0.1 Avoid Loss DET-Obtain Gain BEN 0.8 0.1 Suffer Loss DET-Forgo Gain BEN 1.0 0.1 Control 1.0 0.1
Hedging * Framing 0.512 9 0.864
DET =Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n=32. Significance determined at a= 0.05. Means based on 7-point scale: -3 =Extremely bad, -2 =Quite bad, -1 =Slightly bad, 0 = Neither/Nor, 1 =Slightly good, 2 =Quite good, 3 =Extremely good.
Table 4.12: Main effects and interactions for Outcome Evaluation (Benefits).
101
Variables Mean SE
Hedging: Hedge DET & BEN 5.0 0.1 Not Hedge DET & BEN 5.0 0.1 Hedge DET-Not Hedge BEN 4.8 0.1 Not Hedge DET-Hedge BEN 5.2 0.1 Control 5.1 0.1
Framing: Suffer Loss DET-Obtain Gain BEN 4.8 0.1 Avoid Loss DET-Forgo Gain BEN 5.1 0.1 Avoid Loss DET-Obtain Gain BEN 4.8 0.1 Suffer Loss DET-Forgo Gain BEN 5.3 0.1 Control 5.1 0.1
Hedging * Framing
DET = Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n = 32. Significance determined at a= 0.05.
F df
2.470 3
6.300 3
3.086 9
Sig. (p)
0.065
0.001 *** a b a b a,b
0.002**
Means based on 10-point scale, ranging from 1 to 10, with 1 = Most important and 10 = Least important.
*Significant at p :S 0.05 level. **Significant at p :S 0.01 level.
***Significant atp :S 0.001 level. Means with different letter designations (a,b,c) are significantly different from each other, and means with either the same letter or no letter at all are not significantly different.
Table 4.13: Main effects and interactions for Prioritization of Information Use (Detriments).
102
Variables Mean SE
Hedging: Hedge DET & BEN 6.0 0.1 Not Hedge DET & BEN 6.0 0.1 Hedge DET-Not Hedge BEN 6.1 0.1 Not Hedge DET-Hedge BEN 5.8 0.1 Control 5.9 0.1
Framing: Suffer Loss DET-Obtain Gain BEN 6.2 0.1 Avoid Loss DET-Forgo Gain BEN 5.9 0.1 Avoid Loss DET-Obtain Gain BEN 6.1 0.1 Suffer Loss DET-Forgo Gain BEN 5.7 0.1 Control 5.9 0.1
Hedging * Framing
DET =Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n=32. Significance determined at a= 0.05.
F df Sig. (p)
2.380 3 0.073
6.109 3, 0.001 *** a b a b a,b
3.050 9 0.002**
Means based on 10-point scale, ranging from 1 to 10, with 1 = Most important and 10 = Least important.
*Significant at p :':'. 0.05 level. **Significant at p :':'. 0.01 level.
***Significant at p :':'. 0.001 level. Means with different letter designations (a,b,c) are significantly different from each other, and means with either the same letter or no letter at all are not significantly different.
Table 4.14: Main effects and interactions for Prioritization of Information Use (Benefits).
103
Comparisons of Dijferential Responses:
Analysis of difference scores between Detriments versus Benefits for both Belief
in Outcome and Outcome Evaluation variables showed no significant differences among
differential responses for either hedging or framing effects [see Tables 4.15 & 4.16].
Given that the results of comparisons of direct response also revealed no significant
differences, this result was not surprising.
Similar to the direct responses, differentials between responses to Prioritization of
Detriments versus Benefits resulted in a strong trend toward significance for hedging
effects (F = 2.43,p = 0.069), and significant results for framing effects (F = 5.61,
p = 0.001) [see Table 4.17].
For hedging, Hedge DET-Not Hedge BEN difference score (Mean Diff. = 1.3)
trends toward being a significantly greater differential response to prioritization between
Detriments versus Benefits than when information is presented as Not Hedge
DET-Hedge BEN (Mean Diff. = 0.6). The aforementioned results from comparisons of
direct responses indicate that the hedging effect within each sub-set, Detriments and
Benefits, is about the same magnitude. Therefore, this differential result indicates that
the hedging effect produces a greater differential response between sub-sets, favoring a
higher priority for Detriments relative to Benefits, when Detriments are hedged and
Benefits are not hedged than when the converse is used, Detriments not hedged and
Benefits hedged. This is consistent with the hypothesis that hedging evokes a stronger
response, in this case toward a higher priority for Detriments.
104
Regarding framing effects, differential responses under both Suffer Loss
DET-Obtain Gain BEN (Mean Diff. = 1.3) and Avoid Loss DET-Obtain Gain BEN
(Mean Diff. = 1.3) were significantly greater than under Avoid Loss DET-Forgo Gain
BEN (Mean Diff. = 0.8) and Suffer Loss DET-Forgo Gain BEN (Mean Diff. = 0.5), as
well as the Control (Mean Diff. = 0.8). These results were consistent with the hypothesis
that negative framing elicits a stronger response than positive framing.
As with the direct response results, a significant interaction between hedging and
framing was observed. The nature of this interaction will be examined in a subsequent
section, and interpretation of these main effects will be qualified accordingly.
105
Variables Mean SE F df Sig. (p) Difference
Hedging: 0.649 3 0.585 Hedge DET & BEN 1.0 0.2 Not Hedge DET & BEN 0.7 0.2 Hedge DET-Not Hedge BEN 0.7 0.2 Not Hedge DET-Hedge BEN 0.7 0.2 Control 0.8 0.2
Framing: 1.763 3 0.158 Suffer Loss DET-Obtain Gain BEN 0.7 0.2 Avoid Loss DET-Forgo Gain BEN 1.1 0.2 Avoid Loss DET-Obtain Gain BEN 0.8 0.2 Suffer Loss DET-Forgo Gain BEN 0.5 0.2 Control 0.8 0.2
Hedging * Framing 0.614 9 0.784
DET = Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n=32. Significance determined at a= 0.05. Mean difference based on responses to Detriments minus responses to Benefits.
Table 4.15: Main effects and interactions for difference between responses to Detriments versus Benefits for Belief in Outcome.
106
Variables Mean SE F df Sig. (p) Difference
Hedging: 0.728 3 0.537 Hedge DET & BEN 0.5 0.1 Not Hedge DET & BEN 0.7 0.1 Hedge DET-Not Hedge BEN 0.7 0.1 Not Hedge DET-Hedge BEN 0.6 0.1 Control 0.4 0.1
Framing: 1.934 3 0.127 Suffer Loss DET-Obtain Gain BEN 0.7 0.1 Avoid Loss DET-Forgo Gain BEN 0.7 0.1 Avoid Loss DET--Obtain Gain BEN 0.6 0.1 Suffer Loss DET-Forgo Gain BEN 0.4 0.1 Control 0.4 0.1
Hedging* Framing 0.698 9 0.710
DET =Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n=32. Significance determined at a= 0.05. Mean difference based on responses to Detriments minus responses to Benefits.
Table 4.16: Main effects and interactions for difference between responses to Detriments versus Benefits for Outcome Evaluation.
107
Variables Mean SE
Hedging: Hedge DET & BEN 1.0 0.2 Not Hedge DET & BEN 1.0 0.2 Hedge DET-Not Hedge BEN 1.3 0.2 Not Hedge DET-Hedge BEN 0.6 0.2 Control 0.8 0.2
Framing: Suffer Loss DET-Obtain Gain BEN 1.3 0.2 Avoid Loss DET-Forgo Gain BEN 0.8 0.2 Avoid Loss DET-Obtain Gain BEN 1.3 0.2 Suffer Loss DET-Forgo Gain BEN 0.5 0.2 Control 0.8 0.2
Hedging * Framing
DET = Detriments resulting from rapid climate change. BEN = Benefits resulting from rapid climate change. N= 160. Main effect: n=32. Significance determined at a= 0.05.
F df Sig. (p)
2.426 3 0.069
6.207 3 0.001 *** a b a b a,b
3.069 9 0.002**
Mean difference based on responses to Benefits minus responses to Detriments. *Significant at p :<; 0.05 level.
**Significant atp :<; 0.01 level. ***Significant atp :<; 0.001 level. Means with different letter designations ( a,b,c) are significantly different from each other, and means with either the same letter or no letter at all are not significantly different.
Table 4.17: Main effects and interactions for difference between responses to Benefits versus Detriments for Prioritization oflnformatiort Use.
108
Analysis of Main Effects: Multivariate
A multivariate statistic, Wilks' Lambda, was used to determine the significance of
main effects on the combined "variate" of correlated dependent variables used for each
MANOVA. This was conducted for each of the five sets of significantly correlated
variables and sub-sets listed earlier. This was particularly useful for analyzing the higher
order variables comprising the Theory of Reasoned Action model (Decision Intention,
Overall Attitude, and Subjective Norm), and the relationship among sub-sets within
Belief in Outcome, Outcome Evaluation, and Prioritization of Information Use variables
respectively.
As with the univariate analysis of variance significance was determined at the
95% confidence level (a = 0.05). A Box's M Test was used to determine the equality of
covariance matrices across groups; in all cases the null hypothesis was upheld.
Of all the analyses, only one set demonstrated a significant multivariate
relationship with one of the factors [see Tables 4.18 & 4.19]. The linear combination of
Prioritization of Detriments and Prioritization of Benefits was significantly affected by
framing (Wilk's Lambda= 0.853, F = 3.457,p = 0.003). This result is not surprising in
that univariate analyses of these components revealed highly significant results for both
direct and differential responses between the two information components. In addition,
the strong directionality of prioritization, with Detriments consistently considered "more
important" than Benefits, produces a strong negative relationship between the two
components that tends to enhance discernment of multivariate effects (Hair et al., 1998).
109
I I
I
I
I
I I
I
I I I'
Set of Variables Wilk's Lambda F Sig. (p)
Set A: Clarity of Information 0.942 1.258 0.277 Trust in Credibility
*Significant at p :5 0.05 level. **Significant atp :5 0.01 level.
Table 4.19: Main effect of framing on each set of correlated variables, using multivariate analysis of variance technique.
111
Analysis of Interactions
Interactions between factors for each of the univariate analyses were examined.
Tue only variables that demonstrated a significant interaction between hedging and
framing were Prioritization of Detriments (F = 3.09,p = 0.002) and Prioritization of
Benefits (F = 3.05,p = 0.002) direct responses [see Tables 4.13 & 4.14], and the
differential responses calculated from the two (F = 3.07,p = 0.002) [see Table 4.17].
In order to help interpret the nature of these interactions simple effects and
comparisons were conducted using a series of one-way ANOVAs of framing effects,
holding each level of the hedging factor constant for each analysis. In addition, profile
plots, that graphically illustrated the simple comparisons, were visually examined for
signs of ordinal versus disordinal interaction trends. Generally, interactions among the
four framing treatment groups appeared ordinal, with one exemption. Examination of the
actual numbers proved more useful.
Significant differences among framing groups were found within two of the four
hedging treatments. These were when both Detriments and Benefits were Hedged
(F = 4.493,p =0.012) and when Detriments Hedged but Benefits Not Hedged
(F = 7.902,p = 0.001). Multiple comparisons revealed that for the Hedged DET & BEN
situation a significant difference existed between Suffer Loss DET-Obtain Gain BEN
(Mean Diff. = 2.1) and Avoid Loss-Obtain Gain (Mean Diff. = 0.5). This result does
suggest a disordinal interaction, as the two means should be about the same. But, the
considerably lower mean difference score was apparently not significantly different than
the other two responses, so an ordinal relationship is maintained.
112
The second case in question revealed a difference between the same two treatment
groups, but with an opposite mean difference effect. With hedging held constant as
Hedge DET-Not Hedge BEN, framing treatment Suffer Loss DET---Obtain Gain BEN
elicited a mean difference (Mean Diff. = 1.2) significantly smaller than Avoid
Loss-Obtain Gain (Mean Diff. = 2.4). This maintains an ordinal interaction, but also
suggests that not hedging Benefits tends to enhance the deprioritization of the Benefits
caused by the Obtain Gain framing effect (previously demonstrated by the analysis of
main effects).
This result appears consist with the persistent effect that not hedging Benefits
seems to have on this sample groups' response to certain questions. More importantly, it
appears that the original interpretation of main effects for Prioritization of Information
Use is not compromised by the significant interaction between hedging and framing.
Rather, the interaction may actually be demonstrating an enhancement effect between
certain hedging and framing combinations.
113
CHAPTERS
INTERPRETATION & CONCLUSIONS
Intemretation ofHvootheses Tests
Results of this study were analyzed and each of the seven general hypotheses,
described in Chapter 1, was tested for each of the relevant variables. Many of the
variables, particularly the affective ones associated with the Theory of Reasoned Action,
did not produce significant results to support the hypotheses. The cognitive variable,
Prioritization ofinformation Use, however, provided the most intriguing and productive
significant results that support the stated hypotheses rather well.
Hl. Hedging of both or either information component (detriments v. benefits) will result in differential direct responses, with the hedged component(s) eliciting a response of relatively greater magnitude than the not hedged component(s). When components are differentially hedged, the direction of the response will be toward supporting the hedged component.
None of the variables demonstrated a statistically significant result regarding this
hypothesis. However, three variables, namely Trust in the Credibility of Information,
114
Decision Intention and Prioritization of Information Use, demonstrated strong trends
toward significance. Generally, results of the Prioritization variable supported this
hypothesis. The other two variables, however, appear to contradict this hypothesis by
supporting the converse.
Results of Trust in the Credibility of Information under hedging suggest that not
hedging information regarding Benefits, particularly when information regarding
Detriments was Hedged, actually evokes a stronger response than when Benefits were
Hedged. The trend was a decrease in Trust when Benefits were Not Hedged relative to
when either Benefits were Hedged or when both Benefits and Detriments were Not
Hedged.
This contradiction of the expected result may have a reasonable, albeit untested,
explanation. Given that the sample of subjects who participated in this study were from a
population of people who are generally environmentally conscientious, namely natural
resources students, it is reasonable to assume that most responses would favor a decision
to protect the environment. Though environmental disposition was not directly
measured, differential responses to Detriments versus Benefits of this issue serve as a
proxy measure of this; not to mention the average "agreement" with the actual presence
of human-induced climate change observed with the Belief in Climate Change variable.
Indeed, all of the direct responses to the variables indicated a strong pro-environment
inclination, favoring concern over Detriments of climate change relative to Benefits. It is
possible that Not Hedging the Benefits component when Detriments were Hedged
accentuated the difference by drawing attention to the relative "boldness" of claims that
115
not supporting climate change reductions would be somehow beneficial. This may have
elicited an unanticipated negative reaction to such perceived hyperbole regarding the side
of the issue less associated with pro-environment. Whereas, the same treatment of the
more pro-environmental Detriments side of the issue did not appear to elicit the same
negative response, as the subjects' belief in the relative "correctness" of that side of the
issue may have differentially affected the way in which not hedging influenced their
perceptions.
Another curious result, albeit only a trend, was a slightly stronger positive
response to Decision Intention when both Detriments and Benefits were Not Hedged
' versus when they both were Hedged. If Hypothesis 1 held, then one would expect the
Hedged version to elicit the stronger response. However, in light of the Trust in
Credibility result it is possible that this pro-environmental Detriments-bias effect, that
was not accounted for in the initial experimental design, may be influencing this result as
well. Again, it may be that Not Hedging the less favorable Benefits side of the issue is
having a greater influence on subjects' perception of the importance to support the other,
more pro-environment side, regardless of whether the Detriment side is Hedged or Not
Hedged. This could account for the observed trend here that although both sides of the
issue were Not Hedged this treatment nevertheless elicited a stronger pro-environment
response than when both were Hedged.
A strong trend toward significance indicated that Prioritization of Detriments and
Prioritization of Benefits were affected by hedging in accordance with Hypothesis 1.
Hedging the information regarding Detriments while Not Hedging information regarding
116
Benefits did result in subjects prioritizing Detriments slightly toward "more important"
than when information regarding Detriments was Not Hedged. Similarly, Prioritization
of Benefits showed a trend toward a slightly stronger "importance" ranking for the
Benefit component when information regarding Benefits was Hedged versus when it was
Not Hedged.
In both of the aforementioned cases, the hedging status of the alternate component
was the converse of the component in question. When both components, Detriments and
Benefits, where either Hedged or Not Hedged there was not a significant difference
between responses to either component between those two treatments, or the control for
· that matter. It appears that hedging affects the magnitude ofresponse only when the two
sides of the issue are differentially treated with respect to hedging; otherwise, both sides
appear to be treated the same when it comes to prioritizing information during decision
making.
H2. Framing of both or either information component (detriments v. benefits) will result in differential direct responses, with the component(s) framed in a negative manner eliciting a response of relatively greater magnitude than the component(s) framed in a positive manner. When components are differentially framed, the direction of the response will be toward supporting the negatively framed component.
Two strong trends toward significance emerged regarding the Clarity of
Information and Belief in Climate Change variables. However, a very significant finding
emerged upon examination of the Prioritization of Information variable.
Regarding the trend observed with the Clarity of Information variable, both
framing treatments that used Forgo Gain to present the Benefits were considered
117
relatively more "difficult" to read and understand than the control. Superficially this is
not very surprising, as the control group did not have a series of experimental statements
to read at all. But, the other framing option for Benefits, namely Obtain Gain, remained
statistically equivalent to the control. So, it is reasonable to conclude that the Forgo Gain
frame was indeed more difficult to process. This result actually supports qualitative
comments that were made by subjects during the instrument development and pilot
testing phase. Several participants in those studies commented that the Forgo Gain frame
was difficult or awkward to read.
Subsequent efforts were made in order to mitigate this difficulty such as adding
the phrase "do without" next to the initial inclusion of "forgo gain" as a textual element
and as part of the question statements. Sentence structure was also modified to ease
understanding of this particular frame. Nevertheless, it appears this may have been a
problem during the experiment. One speculation on this issue is that Forgo Gain is not a
commonly used frame in most circumstances in which we hear or read about issues.
Suffer Loss, A void Loss, and Obtain Gain are all much more common and, therefore,
easier for subjects to recognize and process. Even the word "forgo" is not common
diction, hence some of the difficulty trying to process its meaning in the context of the
issues presented. Short of omitting this frame, which would take away one quarter of the
possible frames available, a solution to this possible disparity in readability is not obvious
at this time.
Though a trend emerged with the Belief in Climate Change variable indicating a
slightly stronger belief in the occurrence of human-induced change under the positive
118
frame for Detriments (Avoid Loss) versus the negative frame (Suffer Loss), while the
Benefit frame was negative (Forgo Gain) in both cases, the actual difference may not be
theoretically significant as both means represent the same qualitative response: "agree."
Prioritization oflnformation Use revealed the most significant evidence in
support of Hypothesis 2. Responses were significantly different among nearly all of the
framing treatments for both Detriments and Benefits.
For Prioritization of Detriments, ranking under Suffer Loss DET-Obtain Gain
BEN showed a higher average priority than both Avoid Loss DET-Forgo Gain and
Suffer Loss DET-Forgo Gain BEN. Similarly, Avoid Loss DET-Obtain Gain BEN
· elicited a higher ranking than both Avoid Loss DET-Forgo Gain and Suffer Loss
DET-Forgo Gain BEN.
For Prioritization of Benefits, the same treatments caused significantly different
responses, but the direction of priority was the reverse of the Detriment responses. Suffer
Loss DET-Obtain Gain BEN showed a lower average priority than both Avoid Loss
DET-Forgo Gain and Suffer Loss DET-Forgo Gain BEN. Similarly, Avoid Loss
DET-Obtain Gain BEN elicited a lower ranking than both Avoid Loss DET-Forgo Gain
and Suffer Loss DET-Forgo Gain BEN.
These results corroborate the Hypothesis 2 notion that negative framing elicits a
stronger response toward the issue component that was presented in the negative frame.
Suffer Loss (strong negative) appears to have influenced a higher prioritization of
Detriments over the Avoid Loss (weak positive) frame. Conversely, and probably
working in concert with the aforementioned result, Forgo Gain (weak negative) appears
119
to have boasted prioritization of Benefits relative to Obtain Gain (strong positive)
presentation.
H3. Differential hedging of one information component (detriments v. benefits) while the other is not hedged will result in greater differences between responses to the two components than when both components are either hedged or not hedged.
Prioritization of Information Use was the only variable that provided a trend
toward significance in support of this hypothesis. Hedge DET-Not Hedge BEN
produced a trend toward being a significantly greater differential response to
prioritization between Detriments versus Benefits than when information was presented
as Not Hedge DET-Hedge BEN. Results from comparisons of direct responses,
mentioned earlier, indicate that the hedging effect within each sub-set, Detriments and
Benefits, is about the same magnitude. Therefore, the differential result here indicates
that the hedging effect produces a greater differential response between sides of the issue,
favoring a higher priority for Detriments relative to Benefits, when Detriments are
Hedged and Benefits are Not Hedged than when the converse is used, Detriments Not
Hedged and Benefits Hedged.
This is consistent with the Hypothesis 3 notion that hedging evokes a stronger
response, in this case toward a higher priority for Detriments. It is, however, hard to
distinguish this from the potential converse notion that Not Hedging the Benefits may
have evoked a stronger de-prioritization of those information components. The trend
toward a negative influence on Trust in Credibility of Information associated with Not
Hedging Benefits would help support this alternate explanation.
120
H4. Differential framing of one information component versus the other (detriments v. benefits), with one framed in a negative manner and the other positive, will result in greater differences between responses to the two components than when both are framed either as negative or positive.
Again, Prioritization of Information Use was the only variable that revealed a
highly significant effect in support of this hypothesis. Differential responses under both
Suffer Loss DET-Obtain Gain BEN and Avoid Loss DET--Obtain Gain BEN were
significantly greater than under Avoid Loss DET-Forgo Gain BEN and Suffer Loss
DET-Forgo Gain BEN. In this case, treatments that elicited statistically equal responses
used both framing alternatives for Detriments (Suffer Loss and A void Loss).
Framing used for Benefits in statistically equal responses were the same: Obtain
Gain for one and Forgo Gain for the other. This allows for a comparison of the effects of
framing for Benefits across both possible framing categories for Detriments. It appears
that when Benefits are presented in the Forgo Gain (negative) frame the differential
prioritization between Benefits and Detriments is reduced relative to the differential when
Benefits are presented in the Obtain Gain (positive) frame. In other words, framing the
Benefits in a negative manner seems to provoke subjects to "close the gap" in their
prioritization of information regarding the Detriments and Benefits associated with the
climate change issue. This result is consistent with the Hypothesis 4 notion that negative
framing elicits a stronger response than positive framing.
121
HS. Regarding multivariate combinations of variables, hedging of both or either information component (detriments v. benefits) will result in differential direct responses, with the hedged component(s) eliciting a response of relatively greater magnitude than the not hedged component(s). When components are differentially hedged, the direction of the response will be toward supporting the hedged component.
There were no statistically significant findings or obvious trends to support this
hypothesis. It is assumed that this study failed to reject the null hypothesis regarding
Hypothesis 5.
H6. Regarding multivariate combinations of variables, framing of both or either information component (detriments v. benefits) will result in differential direct responses, with the component(s) framed in a negative manner eliciting a response of relatively greater magnitude than the component(s) framed in a positive manner. When components are differentially framed, the direction of the response will be toward supporting the negatively framed component.
Only one multivariate combination of variables demonstrated a statistically
significant relationship in support of this hypothesis: Prioritization of Detriments with
Prioritization of Benefits. This result is not surprising in that univariate analysis of these
components revealed highly significant results for both direct and differential responses
between the two information components. It is also possible that the strong directionality
of prioritization, with Detriments consistently considered "more important" than
Benefits, produces a strong negative relationship between the two components that
enhances discernment of multivariate effects (Hair et al., 1998).
122
H7. Interactions between hedging and framing will occur, with the combination of hedging and negative framing enhancing the magnitude of the response.
Both the direct responses for each and the difference score between Prioritization
of Detriments and Prioritization of Benefits revealed a hlghly significant interaction
between hedging and framing.
Closer examination of simple effects and comparisons provided evidence that the
nature of this interaction effect was ordinal, supporting the original interpretation of main
effects. Further, results of this secondary analysis suggests that hedging and framing>
effects in certain combinations may enhance the overall influence of the textual
manipulations on a subject's responses. For example, the interaction reveals that the
persistent de-prioritization effect, presumably caused when Benefits are Not Hedged but
Detriments are Hedged, appears to be greatly enhanced when presented in conjunction
with the strong positive frame Obtain Gain.
Though this interaction has not been discussed in previous literature, as it appears
this combination has never been tested before, it does seem reasonable that two factors
known to independently have strong psychological influences on subjects would have an
enhanced effect when presented in concert.
123
Summary and Implications
Summary of Hedging Effects:
• When Benefits are Not Hedged, perceived Trust in the Credibility of information presented decreases (trend).
• When both Detriments and Benefits are Not Hedged, Decision Intention toward supporting climate change reductions increases (trend).
• When either Detriments or Benefits is Hedged, Prioritization of Information Use increases for that component (trend).
• Differential responses when both Detriments and Benefits, or just Detriments, are Hedged favors Detriments over Benefits for Prioritization of Information Use (trend).
Summary of Framing Effects:
• When use Forgo Gain frame, perceived Clarity of Information presented decreases (trend).
• When a negative frame is used for either Detriments or Benefits, Prioritization of Information Use increases for that component (p:::; 0.001).
• Differential responses indicate that the Benefit component is positively affected when presented in its negative frame (Forgo Gain) more than when Detriments is presented in its negative frame for Prioritization of Information Use (p:::; 0.001).
In general, evidence gathered in this study tends to support the notion that the use
of hedging enhances the emphasis subjects cognitively assign to the information
presented in this manner, namely priority of use during decision making. Though
untested in this study, it has been suggested that this is caused by an increase in
processing time shown to be associated with the presence of hedging (Vande Kopple &
Crismore, 1990). Time spent cognitively processing is known to positively affect the
124
relative importance placed on information (Payne et al., 1993). As evidenced by the
curious reverse effect of Not Hedging information regarding the Benefits of not
supporting climate change reductions, it is important to examine the context and audience
biases as well.
This finding would suggest that the use of hedging evenly during presentation of
both sides of the issue should be used. Hedging both sides of an issue should promote
more cognitive processing, perhaps scrutiny, of the detriments and benefits inherent in
most environmental issues. It also appears to negate any obvious differential treatment of
one side of the issue or the other, which could otherwise produce an inadvertent biasing
effect if differential hedging, or even all not hedging, were employed.
Evidence from this study helps support the notion that negative framing of either
side of an issue also promotes greater emphasis placed on the negatively framed
component. Again, this may be caused, in part, by more cognitive processing time
associated with negative frames, though this conclusion is not necessarily supported by
prior literature. It may be more the case that the explanation is linked with conclusions
drawn from well known studies on the cognitive effects of negative framing on human
subjects' responses that demonstrate this pattern of greater emphasis in just about any
Research suggests that this is linked to an innate human sense for paying more
attention to potential losses, often perceived as negative, as they may be life threatening
(Tversky & Kahneman, 1981 ). In other words, people tend to pay more attention to sides
125
of an issue presented to them as a possibility of losing something they already have.
Whereas, the same people pay relatively less attention, and act correspondingly less,
toward the side of an issue presented as either a potential gain or even as the loss of an
opportunity to gain something they don't already have. This study corroborates these
other studies that examine a variety of different decision making scenarios but all point
toward the primacy of negative framing as a motivator and influential frame in terms of
prioritization of information use (e.g. Tversky & Kalmeman, 1981; Maheswaran &
Meyers-Levy, 1990; Davis, 1995; Levin et al., 1998).
In summary, if the goal of a communication plan for an environmental decision
making situation is to balance the equity of the information presentation and optimize
cognitive and affective processing, then hedging all statements and using negative
framing for both sides of an issue is prudent.
Recommendations for Future Study
Using a blocking technique for Gender proved extremely useful, as gender
response differences were very strong among the variables. Prior Background was
somewhat useful as a covariate, as it did account for some error variance among some of
the variables, thus increasing power. The population under study here was rather
homogenous in this regard though. If a more diverse population were to be studied, this
variable would most likely need to be assessed in advance and also used as a block. It
would also be useful to make distinctions among various environmental dispositions
within the population by conducting an environmental inventory of some sort on each
126
subject. The New Environmental Paradigm, 15-question survey by Dunlap et al. (2000),
would be a good example. This variable could, in tum, be used to establish either a block
or be used as a covariate when analyzing responses from more diverse, but inferentially
sound, populations of human subjects.
A psychological principle underlying explanations as to why hedging and framing
variations differentially affect decision making, particularly cognitive processes, has to
do with the time spent by a subject actually processing or working through the
information (Payne et al., 1993). A useful variable to examine in future studies would be
a measure of precisely how much time is spent on each experimental text, and perhaps
each question set as well. A crude measure would be self-reported time, but this often
lacks the accuracy and precision necessary to detect nuances of time differentials between
short text passages. A computerized questionnaire that automatically calculates time
spent on each component would be ideal for this measure (e.g. Payne et al., 1993).
Overall, the results of this study did help corroborate previous work on both
hedging and framing, particularly regarding effects on human subjects' cognitive domain.
Continued refinement of those questions, Prioritization of Information Use and Clarity of
Information, would enhance those results. Investigating the interactions of hedging and
framing to a greater extent on cognitive variables could also prove fruitful.
Results representing the affective domain were a bit disappointing, particularly
the dominant use of variables derived from the Theory of Reasoned Action. It may be
that extrapolation of a model designed to measure tangible personal behavioral intentions,
such as voting habits or a decision to take a particular medication or not, was not
127
appropriate for a study of a much larger scale and relatively intangible topic such as
climate change. Although decision intention, attitude, outcome evaluation, and belief in
outcomes are all pertinent and relevant variables for investigating such a decision making
process, it may be that this instrument was too coarse-grained to detect potential
differences using this model. Other affective models designed to elicit responses in the
context of more intangible and abstract scenarios may prove more appropriate. An
example that comes to mind is Willingness to Pay or Willingness to Act measures that
are commonly used to provide a proxy assessment of subjects' "attitude" and general
decision intention toward a particular issue (e.g. Berk, 1995).
Another potential problem with the use of the Theory of Reasoned Action was the
nature of how each statement needed to be presented within the questionnaire, especially
for eliciting Belief in Outcome and Outcome Evaluation responses. The statements
presented matched the experimental treatment versions of each statement very closely.
The hedging variable was easily held constant for these questions by simply presenting
all response statements in the Not Hedged format. Holding framing constant, on the
other hand, was not easily attainable. Actually, it is linguistically impossible to present
issue statements without any framing effects. There are two general ways this could be
handled differently. One way would have been to present each statement in both of its
possible frames and take the average of those responses. Given that this study involved
twenty different statements regarding climate change, this method would have required
either doubling each for each major variable, which would have made for a very long
questionnaire. The other option would be a double presentation of a sub-set of the
128
I
I
I L
statements. This latter option would have been a fair alternative; however, repetition of
essentially the same statement may introduce yet another bias: a form of practice or
fatigue effect. Item analyses and reliability studies during the piloting phase of this study
indicated that issue sets (Detriments and Benefits) where better off as a set of ten each,
with equal presentation of both ecological and sociological components for each side.
The approach used in this study was to include a representation of each of the
twenty statements, but alternate the framing reference evenly between the two issue sides
and then among the variables. For example, for the Belief in Outcome variable half of
the statements about Detriments were presented in its Suffer Loss frame, while the other
half in its A void Loss frame. Meanwhile, for the Outcome Evaluation variable the same
split was used but frames were reversed for individual statements. The same technique
was used for Benefits. The aim was to present all possible statements without
overburdening the questionnaire to a point where fatigue effect and redundancy would
taJce hold of subjects, but to also nullify the unwanted effects of framing in the questions
themselves by evenly distributing the various frames throughout all of the questions.
It is quite possible that despite this effort to mitigate the extraneous effects of
framing in the questions themselves, the interaction of treatment and question format may
have been overlooked. Keeping in mind that each group only received two framing
conditions out of four that were possible in the experimental text passage, it is
conceivable that presence of the same frames, or different frames for that matter, in the
question sets may have either enhanced or diminished the treatment effect respectively.
129
A very different approach to this problem would be to forgo the use of the
experimental text passages all together and use the question statements within the
questionnaire to present the various treatments. This would work only for the two TRA
variables, Belief in Outcome and Outcome Evaluation, that lend themselves to directly
stating the information inherent in the issue under investigation. A concern with this
approach would be that each treatment group would, of course, receive different
questions. Validity issues may arise as to how the linguistics, beyond just the planned
manipulations, may affect the results. A repeated measures approach may help mitigate
this problem, but could introduce the practice effect again.
Another dramatically different approach to potentially enhancing the measurable
effect of hedging and framing on the affective TRA variables would be to use a more
tangible environmental issue. For example, a controversial issue such as oil exploration
and development in the Arctic National Wildlife Refuge could provide a more immediate
and tangible set of statements on both sides of the issue for subjects to relate to and
respond to with greater conviction and discernment.
Further studies designed to validate this aspect of the instrument to a greater
extent, perhaps by trying different strategies such as those mentioned here, would help
discern whether this question framing effect is actually a problem or not. As it stands
now, it is hard to say whether such an extraneous effect had any influence on the results
or not. It may be the case that the null hypothesis is truly upheld, and variations in these
two factors simply do not have a significant effect on the affective variables associated
with the Theory of Reasoned Action.
130
Regardless of what new format this questionnaire may take in a future iteration, it
would be prudent to begin establishing inferential conclusions from these results by
administering this instrument to more heterogeneous populations. Ultimately, the goal of
this study was to begin validating this instrument with the intention of examining intact
populations of environmental decision makers to test if these textual variations do indeed
affect such populations. This goal will hopefully be attained with future studies based on
what was learned during this study about the variables under investigation and aspects of
the methods that should be refined.
131
APPENDIX A
CLIMATE CHANGE ISSUE QUESTIONNAIRE
Note: This is an example of one of the questionnaires used for this study. The experimental text passage on pages 4 and 5 of the questionnaire is the only section that varies among the 16 different treatment combinations. See Appendix B for those variations.
132
I
I
I
I I
I '
I
I I
I
I I I I I
GENERAL INSTRUCTIONS
This questionnaire is designed to measure your opinions and beliefs in response to a passage you will read about the climate change issue. Note that all information presented in the passage is based on a consensus of rigorously studied, well accepted sources. This is not a test of your knowledge or comprehension of the issue; there are no "correct" answers. So, read the passage, then read each questlon carefully and respond to the statements with your honest opinion.
You are welcome to refer to the original passage as you need while responding to questions.
You will be asked to respond to statements using slightly different scales. Please make an "X" mark in the place that best describes your opinion.
Several questions will seem to repeat statements with slight changes. Please read the instructions carefully, you will be asked to respond to these similar statements in a different manner.
For example, if you were asked to rate your opinion about the outcome implied by the statement "Allowing clothing to become wrinkled," and you believe that allowing clothing to become wrinkled is quite bad, then you would place your mark as follows:
Or, if you were asked to rate the likelihood of the outcome implied by the statement "Letting laundry pile up in your room results in wrinkled clothing'' actually occurring, and you believe that it is extremely likely that letting laundry pile up in your room will wrinkle clothing, you would place your mark as follows:
Letting laundry pile up in your room results in wrinkled clothing.
You will find other scales with slightly different endpoints, but each should be treated with the same general interpretation demonstrated by the examples given above.
When selecting your ratings please remember the following points:
(1) Place your marks in the middle of the spaces, not on the boundaries:
x x _____ _ THIS NOT THIS
(2) Be sure you answer all items - please do not omit any.
(3) Never put more than one mark on a single scale.
133
Once you've read the General Instructions on the previous page ..•
Answer these questions before reading the following passage on the next couple of pages.
a. How knowledgeable are you about the issue of human-induced climate change and its impacts on the U.S.?
Not at All Knowledgeable
Slightly Knowledgeable Knowledgeable
Very Knowledgeable
Extremely Knowledgeable
b. How ieformed are you on the issue of human-induced climate change and its impacts on the U.S. from reading, watching or listening to news media sources?
Not at All Informed
Slightly Informed
Informed Very Informed
Extremely Informed
c. How ieformed are you on the issue of human-induced climate change and its impacts on the U.S. from lectures, class discussions or readings in your college courses?
Not at All Informed
Slightly Informed
Informed
134
Very Informed
Extremely Informed
,.
CLIMATE CHANGE INFORMATION
Carefully read the following two-page passage.
Humans are affecting some of the key factors that govern climate by changing the
composition of the atmosphere and by modifying the land smface. Rising atmospheric
concentrations of carbon dioxide (C02) and other greenhouse gases are increasing Earth's natural
greenhouse warming effect. This increase has resulted from the burning of coal, oil, and natural
gas, and the clearing and burning of forests around the world. If the current rate of human
produced emissions is maintained, atmospheric COz concentration will continue to rise, reaching
between two and three times its pre-industrial level by the year 2100.
Long-term observations confirm that our climate is now changing at a rapid rate. With
continued growth in atmospheric greenhouse gas concentrations, average temperature in the U.S.
will rise in the next 100 years. There will also be more precipitation overall, with more of it
coming in heavy downpours. In spite of this, some areas will get drier as increased evaporation
due to higher temperatures outpaces increased precipitation. The warming is causing permafrost
to thaw, and is melting sea ice, snow cover, and mountain glaciers, and sea level is rising.
Studies suggest that ifthe rate of human-induced climate change is not reduced,
allowing the climate to change rapidly over the next several decades, then the U.S. will likely
suffer some losses. For example, the U.S. might experience the following outcomes:
• Shoreline erosion might intensify, and coastal wetland losses will potentially increase.
• Disturbance of fish habitat could occur, possibly threatening the survival of some cold-water fish species.
• Delicate and isolated ecosystems such as alpine meadows, mangroves, and tropical mountain forests might decline, and some could disappear altogether.
• Forests in many regions may become more susceptible to pests and fire, with damage to forest ecosystem productivity increasing by roughly 10%.
• The rate of loss of biodiversity will probably increase, as some plant and animal species may not be able to adapt to rapid changes.
135
• Water availability for irrigation might decrease, potentially complicating irrigation management.
• Demands for air conditioning might increase, possibly increasing the cost of energy during the summer.
• Diseases that are water and animal borne may intensify in the summer, which could increase incidents of human illness and death in some areas.
• The U.S. could incur an economic loss of about 1% of the gross domestic product (GDP) from climate-related damages.
• The risk of flash floods and soil erosion will probably increase, which may decrease agricultural productivity.
Studies also suggest that ifthe rate of human-induced climate change is not reduced,
allowing the climate to change rapidly over the next several decades, then the U.S. will likely
obtain some gains. For example, the U.S. might experience the following outcomes:
• The number of inland, non-tidal wetlands will potentially increase, and the area where floodplain wetlands form might expand.
• Over-winter mortality of many species of wildlife could decrease as cold stress is reduced and seasonal availability of food possibly increases.
• Tree growth and forest expansion might increase, which could increase the coverage and range of forest ecosystems.
• Plant productivity may increase by roughly I 0% throughout various ecosystems.
• Migrating birds may not fly as far south, nesting earlier in the season, which will probably improve the odds of young birds swvi ving winters.
• Crops that Will potentially develop at faster rates might reduce agricultural use of irrigation water.
• Winter heating needs might decrease, possibly reducing the seasonal cost of energy.
• Incidents of cold-related human illnesses and deaths could be reduced in some areas of the country that may experience less severe winter conditions.
• The U.S. could save about I% of the gross domestic product (GDP) that would have been spent on emissions reduction.
• The food supply from agricultural productivity may increase, probably dropping prices for food products.
136
Now, answer the following three questions.
d. How difficult or easy did you find it to read the preceding passage?
Following are a series of questions designed to measure your OPINIONS and BELIEFS about climate change. Read each statement carefully and give your honest response. Remember, there are no "correct" answers, just viewpoints.
A) Each statement poses a situation from the perspective of one or the other possible decision choices regarding the climate change issue (i.e. to support or not support reductions). Rate how likely or unlikely you believe that what is said in each statement would actually occur.
1. My supporting a large-scale effort to reduce the rate of human-induced climate change in the U.S. is ...
B) Each statement poses a "what if" in terms of each of two possible decision choices regarding the climate change issue. Rate each outcome in terms of whether you believe it would be a good or a bad outcome for the U.S.
7. Ifa large-scale effort to reduce the rate of human-induced climate change in the U.S. was generally supported the future outcomes or consequences of that decision would be ...
8. Ifa large-scale effort to reduce the rate of human-induced climate change in the U.S. was generally NOT supported the future outcomes or consequences of that decision would be ...
BAD ____ --=-.,.--- ____ ___ ____ ---.,--,-- -=--~GOOD
C) Following are statements about the status of climate change. Rate how strongly you agree or disagree with what is implied in each statement.
9. Humans are affecting climate by changing greenhouse gas concentrations in the atmosphere.
Strongly Disagree
Disagree Neither/ Nor
10. Our climate is now changing at a rapid rate.
Strongly Disagree
Disagree Neither/ Nor
Agree
Agree
11. Average temperature in the U.S. will rise in the next 100 years.
Strongly Disagree
Disagree Neither/ Nor
Agree
Strongly Agree
Strongly Agree
Strongly Agree
12. There will be more precipitation overall, with more of it coming in heavy downpours.
Strongly Disagree
Disagree Neither/ Nor
Agree Strongly Agree
13. Some areas will get drier as increased evaporation outpaces increased precipitation.
Strongly Disagree
Disagree Neither/ Nor
139
Agree Strongly Agree
D) Each statement below presents an aspect of the climate change issue that you read in the preceding passage. You have been asked to consider the issue and make a decision whether to support or not support a large-scale effort to reduce the rate of human-induced climate change in the U.S.
Now, with this task in mind, prioritize these ten topics in what you believe is the order of their relative importance (i.e. 1, 2, 3, ... 10) in terms of helping you make that decision.
Place a number from one (1) !!!11§!. important to ten (10) l£!!!!. important next to each statement NOTE: Do not use the same number more than once.
Incidents of cold-related human illnesses and deaths.
__ Forest susceptibility to pests and fire, and damage to forest ecosystem productivity.
__ Over-winter mortality of many species of wildlife, cold stress, and seasonal availability of food for wildlife.
Water availability for irrigation, and irrigation management complications.
Economic impacts on the U.S. gross domestic product (GDP).
__ The rate ofloss of biodiversity, and plant and animal species' adaptability to rapid changes.
__ Tree growth and forest expansion, and the coverage and range of forest ecosystems.
__ Demands for air conditioning and the cost of energy during the summer.
__ The food supply from agricultural productivity and prices for food products.
Shoreline erosion and coastal wetland losses.
140
E) Again, each statement below presents an aspect of the climate change issue that you read in the preceding passage. You have been asked to consider the issue and make a decision whether to support or not support a largescale effort to reduce the rate of human-induced climate change in the U.S.
Now, with this task in mind, prioritize these ten topics in what you believe is the order of their relative importance (i.e. 1, 2, 3, ... 10) in terms of helping you make that decision.
Treat these statements independently from the previous set.
Place a number from one (1) "!!l!!.§!. important to ten (10) ~important next to each statement NOTE: Do not use the same number more than once.
__ The risk of flash floods and soil erosion, and agricultural productivity.
__ Plant productivity throughout various ecosystems.
__ Sustainability of delicate and isolated ecosystems such as alpine meadows, mangroves, and tropical mountain forests.
__ Winter heating needs and the cost of energy.
__ Economic impacts on the U.S. gross domestic product (GDP).
__ The number of inland, non-tidal wetlands, and the area where floodplain wetlands can form.
__ Fish hab.itat disturbance and the survival of cold-water fish species.
__ Crops developing at faster rates and agricultural use of irrigation water.
__ Water- and animal-home related diseases, and incidents of human illness and death.
__ Migrating birds extent of flying south, timing of seasonal nesting, and the odds of young birds surviving winters.
141
F) Each statement below presents an ontcome or consequence of a general, nationwide decision to support large-scale climate change reductions. Regardless of whether you agree with this decision or not, rate how likely or unlikely you believe that what is said in each statement would actually occur if climate change reduction was generally supported.
In other words, supporting a large-scale effort to reduce the rate of humaninduced climate change in the U.S. will result in ...
14. Avoiding a decline in delicate and isolated ecosystems such as alpine meadows, mangroves, and tropical mountain forests.
G) Each statement below presents an outcome or consequence of a general, nationwide decision to NOT support large-scale climate change reductions. Regardless of whether you agree with this decision or not, rate how likely or unlikely you believe that what is said in each statement would actually occur if climate change reduction was generally NOT supported.
In other words, NOT supporting a large-scale effort to reduce the rate of human-induced climate change in the U.S. will result in ...
24.Allowing an economic loss of 1% of the U.S. gross domestic product (GDP).
UNLIKELY _____ _
Extremely Quite ~~- -~-- ___ LIKELY
Slightly Neither/Nor Slightly Quite Extremely
25.Allowing an improvement in the odds of young birds of migratory species surviving winters.
The next set Qf statements may appear similar to those you just read, with slight changes. Please read the instructions carefully, you will be asked to respond to these similar statements in a different manner •••
144
H) Each statement presents an outcome of a general decision to either support or not support large-scale climate change reductions. Regardless of which decision you would make, rate each future consequence in terms of whether you believe it would be a good or a bad outcome for the U.S.
34. Allowing a reduction in agricultural use of irrigation water is ... BAD _____ _
Extremely Quite
______ GOOD Slightly Neither/Nor Slightly Quite Extremely
35.Avoiding an increase in the cost of energy during the summer is ...
BAD ..,-----.,..- --,---Extremely Quite
_______ ____ GOOD
Slightly Neither/Nor Slightly Quite Extremely
36. Allowing an increase in the coverage and range of forest ecosystems is ...
BAD GOOD Extremely Quite Slightly N either/N" or Slightly Quite Extremely
37.Allowing an increase in coastal wetland losses is ...
BAD GOOD Extremely Quite Slightly Nelthen'Nor Slightly Quite Extremely
38. Doing without saving 1 % of the U.S. gross domestic product (GDP) is ...
BAD ___ ---- ___ _ ___ GOOD Extremely Quite Slightly Neither/Nor Slightly Quite Extremely
39.Allowing a decrease in agricultural productivity is ...
BAD ---- ----Extreme! y Quite Slightly Neithen'Nor Slightly
___ _ ___ GOOD
Quite Extremely
40. Doing without an increase in plant productivity throughout various ecosystems is ...
BAD ___ ---- ---- ___ GOOD Extremely Quite Slightly Neither/Nor Slightly Quite Extremely
41.Allowing an increase in threats to the swvival of some cold-water fish species is ...
BAD ____ ---- ___ _ ___ GOOD Extreme! y Quite Slightly Neilher/Nor Slightly Quite Extremely
42. Doing without a reduction in incidents of human illnesses and deaths in winter is ...
BAD GOOD Extremely Quite Slightly Neither/Nor Slightly Quite Extremely
43.Allowing irrigation management complications is ...
BAD GOOD Extremely Quite Slightly Neitht:r/Nor Slightly Quite Extremely
145
44. Doing without an improvement in the odds of young birds of migratory species surviving winters is ...
BAD ___ _ _ ___ GOOD Extremely Quite Slightly Neither/Nor Slightly Quite Extremely
45. Allowing a decline in delicate and isolated ecosystems such as alpine meadows, mangroves, and tropical mountain forests is ...
BAD GOOD Extremely Quite Slightly Neither/Nor Slightly Quite Extremely
46. Doing without a reduction in winter heating energy costs is ...
BAD GOOD Extremely Quite Slightly Neither/Nor Slightly Quite Extremely
47. Avoiding an increase in incidents of human illness and death during the summer is ...
50. Allowing an increase in the food supply from agricultural productivity is ...
BAD ___ _ _ ___ GOOD Extremely Quite Slightly Neither/Nor Slightly Quite Extremely
51. Avoiding an economic loss of 1 % of U.S. gross domestic product (GDP) is ...
BAD ___ _ _ ___ GOOD Extremely Quite Slightly Neither/Nor Slightly Quite Extremely
52. Allowing a decrease in over-winter mortality of many species of wildlife is ...
BAD---- ____ GOOD Extremely Quite Slightly Neither/Nor Slightly Quite Extremely
53. Avoiding an increase in the rate ofloss of biodiversity is ...
BAD ___ _ ____ GOOD Extremely Quite Slightly Neither/Nor Slightly Quite Extremely
Just a few more questions on the back ...
146
I) Please answer the following questions as directed.
54. You are ... Female
Male
55. Your class rank ...
Freshman _Sophomore
Junior
Senior
Graduate Professional
Other
56. Yourethnicity ...
African American Asian American
_Hispanic
Native American
White/Caucasian
Other
57. Your approximate cumulative G.P .A ...
under 1.00
1.00-1.99 2.00-2.99
3.oo-4.oo don't know
58. Your age: ___ _
59. Are you a U.S. resident? ___ _
Treatment: 1
60. If you are a U.S. resident, the State you have spent the most time living in: ___ _
This is the end of the questionnaire. Thank you for your time and effort!
147
APPENDIXB
ALTERNATE VERSIONS OF EXPERIMENTAL TEXT
148
VERSION A (Hedged/Strong)
Studies suggest that ifthe rate of human-induced climate change is not reduced,
allowing the climate to change rapidly over the next several decades, then the U.S. will
likely suffer some losses. For example, the U.S. might experience the following
outcomes:
• Shoreline erosion might intensify, and coastal wetland losses will potentially increase.
• Disturbance of fish habitat could occur, possibly threatening the survival of some cold-water fish species.
• Delicate and isolated ecosystems such as alpine meadows, mangroves, and tropical mountain forests might decline, and some could disappear altogether.
• Forests in many regions may become more susceptible to pests and fire, with damage to forest ecosystem productivity increasing by roughly 10%.
• The rate ofloss of biodiversity will probably increase, as some plant and animal species may not be able to adapt to rapid changes.
• Water availability for irrigation might decrease, potentially complicating irrigation management.
• Demands for air conditioning might increase, possibly increasing the cost of energy during the summer.
• Diseases ·that are water and animal borne may intensify in the summer, which could increase incidents of human illness and death in some areas.
• The U.S. could incur an economic loss of about 1 % of the gross domestic product (GDP) from climate-related damages.
• The risk of flash floods and soil erosion will probably increase, which may decrease agricultural productivity.
149
Studies also suggest that ifthe rate of human-induced climate change !!.m!! reduced, allowing the climate to change rapidly over the next several decades, then the
U.S. will likely obtain some gains. For example, the U.S. might experience the following
outcomes:
• The number of inland, non-tidal wetlands will potentially increase, and the area where floodplain wetlands form might expand.
• Over-winter mortality of many species of wildlife could decrease as cold stress is reduced and seasonal availability of food possibly increases.
• Tree growth and forest expansion might increase, which could increase the coverage and range of forest ecosystems.
• Plant productivity may increase by roughly I 0% throughout various ecosystems.
• Migrating birds may not fly as far south, nesting earlier in the season, which will probably improve the odds of young birds surviving winters.
• Crops that will potentially develop at faster rates might reduce agricultural use of irrigation water.
• Winter heating needs might decrease, possibly reducing the seasonal cost of energy.
• Incidents of cold-related human illnesses and deaths could be reduced in some areas of the country that may experience less severe winter conditions.
• The U.S. could save about I% of the gross domestic product (GDP) that would have been spent'on emissions reduction.
• The food supply from agricultural productivity may increase, probably dropping prices for food products.
150
VERSION B (Not Hedged/Strong)
Studies claim that ifthe rate of human-induced climate change is not reduced,
allowing the climate to change rapidly over the next several decades, then the U.S. will
suffer some losses. For example, the U.S. will experience the following outcomes:
• Shoreline erosion will intensify, and coastal wetland losses will increase.
• Disturbance of fish habitat will occur, threatening the survival of some cold-water fish species.
• Delicate and isolated ecosystems such as alpine meadows, mangroves, and tropical mountain forests will decline, and some will disappear altogether.
• Forests in many regions will become more susceptible to pests and fire with damage to forest ecosystem productivity increasing by 10%.
• The rate ofloss of biodiversity will increase, as some plant and animal species will not be able to adapt to rapid changes.
• Water availability for irrigation will decrease, complicating irrigation management.
• Demands for air conditioning will increase, increasing the cost of energy during the summer.
• Diseases that are water and animal borne will intensify in the summer, which will increase incidents of human illness and death in some areas.
• The U.S. will incur an economic loss of 1 % of the gross domestic product (GDP) from climate-related damages.
• The risk of flash floods and soil erosion will increase, which will decrease agricultural productivity.
151
Studies also claim that ifthe rate of human-induced climate change is not
reduced, allowing the climate to change rapidly over the next several decades, then the
U.S. will obtain some gains. For example, the U.S. will experience the following
outcomes:
• The number of inland, non-tidal wetlands will increase, and the area where floodplain wetlands form will expand.
• Over-winter mortality of many species of wildlife will decrease as cold stress is reduced and seasonal availability of food increases.
• Tree growth and forest expansion will increase, which will increase the coverage and range of forest ecosystems.
• Plant productivity will increase by 10% throughout various ecosystems.
• Migrating birds will not fly as far south, nesting earlier in the season, which will improve the odds of young birds surviving winters.
• Crops that will develop at faster rates will reduce agricultural use of irrigation water.
• Winter heating needs will decrease, reducing the seasonal cost of energy.
• Incidents of cold-related human illnesses and deaths will be reduced in some areas of the country that will experience less severe winter conditions.
• The U.S. will save 1 % of the gross domestic product (GDP) that would have been spent on emissions reduction.
• The food supply from agricultural productivity will increase, dropping prices for food products.
152
VERSION C (Hedged/Weak)
Studies suggest that ifthe rate of human-induced climate change is reduced,
slowing changes in the climate over the next several decades, then the U.S. will likely
avoid some losses. For example, the U.S. might experience the following outcomes:
• Shoreline erosion might not intensify, and coastal wetland losses will potentially avoid an increase.
• Disturbance of fish habitat could be avoided, possibly preventing threats to the survival of some cold-water species.
• Delicate and isolated ecosystems such as alpine meadows, mangroves, and tropical mountain forests might keep from declining, and some could avoid disappearing altogether.
• Forests in many regions may avoid becoming more susceptible to pests and fire with damage to productivity remaining roughly the same.
• The rate ofloss of biodiversity will probably avoid an increase, as some plant and animal species may not have to adapt to rapid changes.
• Water availability might not decrease, potentially avoiding irrigation management complications.
• Demands for air conditioning might not increase, possibly avoiding increases in the cost of energy during the summer.
• Diseases that are water and animal borne may not intensify in the summer, which could avoid increases in incidents of human .illness and death in some areas.
• The U.S. could avoid an economic loss of about 1% of the gross domestic product (GDP) from climate-related damages.
• The risk of flash floods and soil erosion will probably not increase, which may avoid a decrease in agricultural productivity.
153
Studies also suggest that ifthe rate of human-induced climate change is reduced,
slowing changes in the climate over the next several decades, then the U.S. will likely
forgo or do without some gains. For example, the U.S. might experience the following
outcomes:
• The number of inland, non-tidal wetlands will potentially not increase, and the area where floodplain wetlands form might forgo expansion.
• Over-winter mortality of many species of wildlife could forgo a decrease as cold stress remains the same and seasonal availability of food possibly does not increase.
• Tree growth and forest expansion might not increase, which could forgo an increase in the coverage and range of forest ecosystems.
• Plant productivity may forgo an increase, remaining roughly the same throughout various ecosystems.
• Migrating birds may fly just as far south, not nesting any earlier in the season, which will probably forgo any improvement in the odds of young birds surviving winters.
• Crops that will potentially not develop at faster rates might forgo reductions in agricultural use of irrigation water.
• Winter heating needs might not decrease, possibly forgoing a reduction in the seasonal cost of energy.
• Incidents of cold-related human illnesses and deaths could forgo reductions in some areas of the country that may continue to experience severe winter conditions.
• The U.S. could forgo saving about 1 % of the gross domestic product (GDP) that will be spent on emissions reduction.
• The food supply from agricultural productivity may not increase, probably forgoing a drop in prices for food products.
154
VERSION D (Not Hedged/Weak)
Studies claim that ifthe rate of human-induced climate change is reduced,
slowing changes in the climate over the next several decades, then the U.S. will avoid
some losses. For example, the U.S. will experience the following outcomes:
• Shoreline erosion will not intensify, and coastal wetland losses will avoid an increase.
• Disturbance of fish habitat will be avoided, preventing threats to the survival of some cold-water species.
• Delicate and isolated ecosystems such as alpine meadows, mangroves, and tropical mountain forests will keep from declining, and some will avoid disappearing altogether.
• Forests in many regions will avoid becoming more susceptible to pests and fire, with damage to productivity remaining the same.
• The rate ofloss of biodiversity will avoid an increase, as some plant and animal species will not have to adapt to rapid changes.
• Water availability will not decrease, avoiding irrigation management complications.
• Demands for air conditioning will not increase, avoiding increases in the cost of energy during the summer.
• Diseases that are water and animal borne will not intensify in the summer, which will avoid increases in incidents of human illness and death in some areas.
• The U.S. will avoid an economic loss of 1 % of the gross domestic product (GDP) from climate-related damages.
• The risk of flash floods and soil erosion will not increase, which will avoid a decrease in agricultural productivity.
155
Studies also claim that ifthe rate of human-induced climate change is reduced,
slowing changes in the climate over the next several decades, then the U.S. will forgo or
do without some gains. For example, the U.S. will experience the following outcomes:
• The number of inland, non-tidal wetlands will not increase, and the area where floodplain wetlands form will forgo expansion.
• Over-winter mortality of many species of wildlife will forgo a decrease as cold stress remains the same and seasonal availability of food does not increase.
• Tree growth and forest expansion will not increase, which will forgo an increase in the coverage and range of forest ecosystems.
• Plant productivity will forgo an increase, remaining the same throughout various ecosystems.
• Migrating birds will fly just as far south, not nesting any earlier in the season, which will forgo any improvement in the odds of young birds surviving winters.
• Crops that will not develop at faster rates will forgo reductions in agricultural use of irrigation water.
• Winter heating needs will not decrease, forgoing a reduction in the seasonal cost of energy.
• fucidents of cold-related human illnesses and deaths will forgo reductions in some areas of the country that will continue to experience severe winter conditions.
• The U.S. "'.ill forgo saving 1 % of the gross domestic product (GDP) that will be spent on emissions reduction.
• The food supply from agricultural productivity will not increase, forgoing a drop in prices for food products.
156
I
II
LIST OF REFERENCES
Ajzen, I. & M. Fishbein (1980). Understanding Attitudes and Predicting Social Behavior. Englewood Cliffs, NJ: Prentice Hall.
Allen, M.J. & W.M. Yen (1979). Introduction to Measurement Theory. Monterey, CA: Brooks/Cole.
Allison, D. (1991). Textual explicitness and pragmatic inferencing: The case of 'hypothetical-real' contrasts in written instructional scientific discourse in English. Journal of Pragmatics I5: 373-393.
Anderson, J.L. (1998). Embracing uncertainty: The interface of Bayesian statistics and cognitive psychology. Conservation Ecology 2(1): 2. [online] URL:http://www.consecol.org/vol2/issl/art2
Bazerman, C. ( 1988). Shaping Written Knowledge: The Genre and Activity of the Experimental Article in Science. Madison, WI: University of Wisconsin Press.
Bazerman, C. (1990). Discourse analysis and social construction. Annual Review of Applied Linguistics I I: 77-83.
Bazerman, C. (1995). The Iriformed Writer: Using Sources in the Disciplines. Boston: Houghton-Mifflin.
Berk, R.A. & D. Schulman (1995). Public perceptions of global warming. Climatic Change 29: I-33.
Biesenbach-Lucas, S. (1994). A comparative genre analysis: The research article and its popularization. Doctoral Dissertation. Washington, DC: Georgetown University.
Bohrnstedt, G. & E.F. Borgatta (I98I). Level of measurement: Once again. In G. Bohrnstedt & E.F. Borgatta (Eds.), Social Measurement: Current Issues. Beverly Hill, CA: Sage.
Brown, G. & G. Yule (I983). Discourse Analysis. Cambridge: Cambridge University Press.
I57
Brown, P. & S. Levinson (1987). Politeness: Some Universals in Language Use. Cambridge: Cambridge University Press.
Carmines, E.G. & R.A. Zeller (1979). Reliability and Validity Assessment. Newbury Park, CA: Sage.
Chess, C., A. Saville, M. Tamuz & M. Greenberg (1992). The organizational links between risk communication and risk management: The case of Sybron Chemicals Inc. Risk Analysis 12(3): 431-438.
Christensen, N.L., A.M. Bartuska, J.H. Brown, S. Carpenter, C. D'Antonio, R. Francis, J.F. Franklin, J.A. MacMahon, R.F. Noss, D.J. Parsons, C.H. Peterson, M.G. Turner, & R.G. Woodmansee (1996). The report of the Ecological Society of America committee on the scientific basis for ecosystem management. Ecological Applications 6: 665-691.
Clark, R.H. & S.E. Haviland (1977). Comprehension and the given-new contract. In R.O. Freedle (Ed.), Discourse Production and Comprehension. Norwood, NJ: Ablex Publishing.
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2°d). Hillsdale, NJ: Erlbaum.
Covello, V.T. (1989). Communicating right-to-know information on chemical risks. Environ. Sci. Technol. 23(12): 1444-1449.
Crismore, A. & W.J. VandeKopple (1988). Reader's learning from prose: The effects of hedges. Written Communication 5(2): 184-202.
Crookes, G. (1986). Towards a validated analysis of scientific text structure. Applied Linguistics 7(1): 57-70.
Davis, J.J. (1995). The effects of message framing on response to environmental communications. Journalism & Mass Communication Quarterly 72: 285-299.
Dietz, T., P.C. Stem & R.W. Rycroft (1989). Definitions of conflict and the legitimation ofresources: The case of environmental risk. Sociological Forum 4(1): 47-70.
Dillman, D.A. (2000). Mail and Internet Surveys: The Tailored Design Method. New York: John Wiley & Sons.
158
Dunlap, R.E., K.D. Van Liere, A.G. Mertig & R.E. Jones (2000). Measuring endorsement of the new ecological paradigm: A revised NEP scale. Journal of Social Issues 56(3): 425-442.
Ellison, A.M. (1996). An introduction to Bayesian inference for ecological research and environmental decision-making. Ecological Applications 6: 1036-1046.
Epstein, S. (1994). Integration of the cognitive and the psychodynamic unconscious. American Psychologist 49: 709-724.
Fagley, N.S. & P.M. Miller (1990). The effect of framing choice: Interactions with risktaking propensity, cognitive style, and sex. Personality and Social Psychology Bulletin 16(3): 496-510.
Fischhoff, B. (1991). Value elicitation: Is there anything there? American Psychologist 46: 835-847.
Fischhoff, B., P. Slovic, S. Lichtenstein, S. Read, & B. Combs (1978). How safe is safe enough? A psychometric study of attitudes towards technological risks and benefits. Policy Sciences 9: 127-152.
Fishbein, M. (Ed.) (1967). Readings in Attitude Theory and Measurement. New York: Wiley.
Fishbein, M. & I. Ajzen (1975). Belief attitude, intention and behavior: An introduction to theory and research. Reading, MA: Addison-Wesley.
Francis, G. (1993). Ecosystem management. Natural Resources Journal 33: 315-345.
Freudenburg, W.R. (1988). Perceived risk, real risk: Social science and the art of probabilistic assessment. Science 242: 44-49.
Gigerenzer, G. & U. Hoffrage (1995). How to improve Bayesian reasoning without instruction: Frequency formats. Psychological Review 102: 684-704.
Gray, B. (1997). Framing and reframing of intractable environmental disputes. Research on Negotiation in Organizations 6: 163-188.
Gross, A.G. (1988). Discourse on method: The rhetorical analysis of scientific texts." Pre/Text 9(3/4): 169-185.
Gross, A.G. (1990). The Rhetoric of Science. Cambridge, MA: Harvard University Press.
159
I
II
I
I
Grwnbine, R.E. (1994). What is ecosystem management? Conservation Biology 8: 27-38.
Grwnbine, R.E. (1997). Reflections on "What is ecosystem management?" Conservation Biology 11: 41-47.
Habermas, J. (1984). Theory of Communicative Action, Volume I: Reason and the Rationalization of Society. Translated by T. McCarthy. Boston: Beacon Press.
Habermas, J. (1987). Theory of Communicative Action, Volume II: Systems and Lifeworld. Translated by T. McCarthy. Boston: Beacon Press.
Hair, J.F., R.E. Anderson, R.L. Tatham, & W.C. Black (1998). Multivariate Data Analysis. Upper Saddle River, NJ: Prentice Hall.
Halliday, M.A.K. (1988). On the language of physical science. In M. Ghadessy (Ed.), Registers of Written English: Situational Factors and Linguistic Features. London: Pinter. 162-178.
Halliday, M.A.K. & R. Hasan (1976). Cohesion in English. London: Longman Group.
Holling, C.S. (Ed.) (1978). Adaptive Environmental Assessment and Management. London: John Wiley & Sons.
Hopkins, K.D. (1998). Educational and Psychological Measurement and Evaluation. Boston: Allyn & Bacon.
Hyland, K. (1994). Hedging in academic writing and EAP textbooks. English for Specific Purposes 13: 239-256.
Hyland, K. (1996a). Talking to the academy: Forms of hedging in science research articles. Written Communication 13(2): 251-281.
Hyland, K. (1996b). Writing without conviction? Hedging in science research articles. Applied Linguistics 17( 4): 433-454.
Johnson, D.H. (1999). The insignificance of statistical significance testing. Journal of Wildlife Management 63: 763-772.
Kasperson, R.E., 0. Renn, P. Slovic, H.S. Brown, J. Emel, R. Goble, J.X. Kasperson & S. Ratick (1988). The social amplification of risk: A conceptual framework. Risk Analysis 8(2): 177-187.
160
' , I
Keppel, G. (1991). Design and Analysis: A Researcher's Handbook. Upper Saddle River, NJ: Prentice-Hall.
Kirk, R.E. (1995). Experimental Design: Procedures for the Behavioral Sciences (3'd). Pacific Grove, CA: Brooks/Cole.
Kirschbaum, M.U.F. & A. Fischlin (1996). Climate change impacts on forests. In: RT. Watson et al. (Eds.), Climate Change 1995: Impacts, Adaptations and Mitigation a/Climate Change: ScientijfocTechnical Analyses (pp. 95-129). Cambridge: Cambridge University Press.
Kuhn, T.S. (1977). The Essential Tension: Selected Studies in Scientific Tradition and Change. Chicago: University of Chicago Press.
Lackey, R. T. (1998). Seven pillars of ecosystem management. Landscape and Urban Planning40: 21-30.
Lakoff, G. (1972). Hedges: A study in meaning criteria and the logic of fuzzy concepts. In P. Peranteau, J. Levi & G. Phares (Eds.), Papers From the Eighth Regional Meeting, Chicago Linguistic Society (pp. 183-228). Chicago: University of Chicago Press.
Latour, B. (1987). Science in Action: How to Follow Scientists and Engineers Through Society. Cambridge, MA: Harvard University Press.
Latour, B. & S. Woolgar (1979). Laboratory Life: The Social Construction of Scientific Facts. Beverly Hills, CA: Sage Publications.
Lee, K.N. (1993). Compass and Gyroscope: Integrating Science and Politics for the Environment. Washington, DC: Island Press.
Lessard, G. (1998). An adaptive approach to planning and decision making. Landscape and Urban Planning40: 81-87.
Levin, LP., S.L. Schneider & G.J. Gaeth (1998). All frames are not created equal: A typology and critical analysis of framing effects. Organizational Behavior and Human Decision Processes 76(2): 149-188.
Maheswaren, D. & J. Meyers-Levy (1990). The influence of message framing and issue involvement. Journal of Marketing Research 27: 361-367.
161
Melillo, J.M., LC. Prentice, G.D. Farquhar, E.D. Schulze & O.E. Sala (1996). Terrestrial biotic responses to environmental change and feedbacks to climate. In: J.T. Houghton et al. (Eds.), Climate Change I995: The Science of Climate Change (pp. 445-482). Cambridge: Cambridge University Press.
Miller, A. (1983). The influence of personal biases on environmental problem-solving. Journal of Environmental Management 17: 133-142.
Mueller, D.J. (1986). Measuring Social Attitudes: A Handbook for Researchers and Practitioners. New York: Teachers College Press.
Myers, G. (1989). The pragmatics of politeness in scientific articles. Applied Linguistics, JO(l), 1-35.
Myers, G. (1990). Writing biology: Texts in the social construction of scientific knowledge. Madison, WI: University of Wisconsin Press.
National Assessment Synthesis Team (NAST) (2000a). Climate Change Impacts on the United States: The Potential Consequences of Climate Variability and Change (Overview). Washington, DC: U.S. Global Change Research Program.
National Assessment Synthesis Team (NAST) (2000b ). Climate Change Impacts on the United States: The Potential Consequences of Climate Variability and Change (Foundation). Washington, DC: U.S. Global Change Research Program.
NEETF/Roper (1998). The National Report Card on Environmental Knowledge, Attitudes and Behaviors: The Seventh Annual Survey of Adult Americans. Washington, DC: NEETF.
Payne, J.W., J.R. Bettman, & E.J. Johnson (1993). The Adaptive Decision Maker. Cambridge: Cambridge University Press.
Plough, A. & S. Krimsky (1987). The emergence of risk communication studies: Social and political context. Science, Technology, & Human Values 12: 4-10.
Popper, K. (1999). Falsificationism. In: R. Klee (Ed.), Scientific Inquiry: Readings in the Philosophy of Science (pp. 65-71). New York: Oxford University Press.
Rossi, P.H., J.D. Wright & A.B. Anderson (1983). Handbook of Survey Research. Orlando, FL: Academic Press.
Rycroft, R.W., J.L. Regens & T. Dietz (1987). Acquiring and utilizing scientific and technical information to identify environmental risks. Science, Technology, & Human Values 12: 125-130.
162
Salager-Meyer, F. (1994). Hedges and textual communicative function in medical English written discourse. English for Specific Purposes 13(2): 149-170.
Salant, P. & D.A. Dillman (1994). How to Conduct Your Own Survey. New York: John Wiley & Sons.
Sandman, P.M., P.M. Miller, B.B. Johnson, & N.D. Weinstein (1993). Agency communication, community outrage, and perception ofrisk: Three simulation experiments. Risk Analysis 13(6): 585-598.
Shafir, E., I. Simonson, & A. Tversky (1993). Reason-based choice. Cognition 49: 11-36.
Shindler, B. & K.A. Cheek (1999). Integrating citizens in adaptive management: A propositional analysis. Conservation Ecology 3(1): 9. [online] URL:http ://www.consecol.org/vol3/iss 1/art9
Skelton, J. (1988). The care and maintenance of hedges. ELT Journal 42(1): 37-43.
Slovic, P. (1987). Perception of risk. Science 236: 280-285.
Slovic, P., J. Flynn & M. Layman (1991). Perceived risk, trust, and the politics of nuclear waste. Science 254: 1603-1607.
SPSS (1999a). SPSS Base 10.0 User's Guide. Chicago, IL: SPSS, Inc.
SPSS (1999b). Advanced Models 10.0. Chicago, IL: SPSS, Inc.
Starr, C. (1969). Social benefit versus technological risk. Science 165: 1232-1238.
Stern, P.C. (1991). Learning through conflict: A realistic strategy for risk communication. Policy Sciences 24: 99-119.
Swales, J.M. (1990). Genre Analysis: English in Academic and Research Settings. Cambridge, England: Cambridge University Press.
Tarone, E., S. Dwyer, S. Gillette & V. Icke (1981). On the use of the passive in two astrophysics journal papers. The ESP Journal 1 (2): 123-140.
163
Tufte, E.R. (1983). The Visual Display of Quantitative !reformation. Cheshire, CT: Graphics Press.
Tversky, A. & D. Kahneman (1981). The framing of decisions and the psychology of choice. Science 211: 453-458.
United Nations Framework Convention on Climate Change (UNFCCC) (1997). Kyoto Prate Kyoto, Japan: 3rd Session of the Conference of the Parties.
United Nations Framework Convention on Climate Change (UNFCCC) (2001). Climate Che Resources. Source: http://unfccc.int/climate/index.html. Bonn, Germany: UNFCCC
U.S. State Department (2001). The Kyoto Protocol on Climate Change. Source: http://www.state.gov/global_issues/climate/index.html. Washington, DC: U.S. State Department.
Ure, J. (1982). Introduction: Approaches to the study of register range. Intl. J. Soc. Lang. 35: 23.
Vande Kopple, W.J. & A. Crismore (1990). Readers' reactions to hedges in a science textbook. Linguistics & Education 2: 303-322.
Vaughan, E. & M. Seifert (1992). Variability in the framing of risk issues. Journal of Social Issues 48: 119-135.
Walsh, V. (1982). Reading scientific texts in English. System 10(3): 231-239.
Walters, C.J. & C.S. Holling (1990). Large-scale management experiments and learning by doing. Ecology 71: 2060-2068.
Webler, T.H. (1992). Modeling public participation as discourse: An application of Habermas's theory of communicative action. Doctoral Dissertation, Clark University.
Weinstein, N.D. & P.M. Sandman (1992). A model of the precaution adoption process: Evidence from home radon testing. Health Psychology 11(3): 170-180.
Weissberg, R.C. (1963). Given and new: Paragraph development models from scientific English. TESOL Quarterly 18(3): 485-499.
Yaffee, S.L. (1999). Three faces of ecosystem management. Conservation Biology 13: 713-725.