DEEP IMMERSION ACADEMIC LEARNING (DIAL): AN ANALYSIS OF SCIENCE LEARNING IN CONTEXT by Michael Giamellaro B.S., University of Wyoming, 1997 M.A., University of Colorado Denver, 2004 A thesis submitted to the Faculty of the Graduate School of the University of Colorado in partial fulfillment of the requirements for the degree of Doctor of Philosophy Educational Leadership and Innovation 2012
350
Embed
DEEP IMMERSION ACADEMIC LEARNING (DIAL): AN ANALYSIS …digital.auraria.edu/content/AA/00/00/00/87/00001/... · authentic, contextualized learning environments in high school students’
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
This thesis for the Doctor of Philosophy degree by
Michael Giamellaro
has been approved for the
Educational Leadership and Innovation Program
by
Deanna Sands, Chair & Advisor
Maria Araceli Ruiz-Primo
Nancy Leech
Casey Allen
August 28th, 2012
iii
Giamellaro, Michael (Ph.D, Educational Leadership and Innovation)
Deep Immersion Academic Learning (DIAL): An Analysis of Science Learning in Context.
Thesis directed by Professor Deanna Sands
ABSTRACT
This study was an investigation into high school students’ deep immersion
academic learning (DIAL) experiences in science. Defined in this dissertation, DIAL is
an experiential learning process that is content-driven, facilitated by a teacher, and
conducted through immersion into an authentic, contextualized environment. The study
relied on a theoretical foundation of situated constructivism. The goals of the study were
to determine if students’ conceptual science knowledge structures change following
DIAL experiences and if so, to determine what elements of the learning environment
contributed to those changes. Four high school science classes using DIAL participated
(n=67). Each class was considered to be a case for this mixed methods, multiple case
study. A pretest/posttest design was used in conjunction with the Pathfinder algorithm to
measure changes in structural science knowledge. The students’ test scores showed
significant change from pretest to posttest across the full sample but variability from case
to case. Testing was followed by student and teacher interviews and field observations to
characterize environmental contributors to learning. Both peripheral and facilitated
learning opportunities within the learning environment were important for DIAL and a
iv
synergistic effect led to deeper student learning when both were utilized. The social
aspect of the learning environment was the most important source of cues for students’
contextualization of targeted content knowledge. The physical environment was also an
important contributor. Contextualization of target science content led to more expert
knowledge structures, and occurred as a result of the individual learner indexing and
making connections amongst all of the environmental components. The study contributes
to the fields of experiential education and contextualized science learning by introducing
the DIAL framework, offering a novel way to assess experiential learning, and providing
empirical evidence of the degree and sources of learning in contextualized settings. The
implications for DIAL teaching and further research are discussed.
The form and content of this abstract are approved. I recommend its publication.
Approved: Deanna Sands
v
DEDICATION
I dedicate this work to my wife Monica Giamellaro. It was her perpetual support and
guidance that allowed this project to come to completion.
vi
ACKNOWLEDGEMENTS
I would like to thank the members of my dissertation committee for their support
and extensive feedback throughout this process, particularly my advisor, Dr. Deanna
Sands for her tireless advice, editing, and guidance. I would also like to thank Dr. Carole
Basile for her help in conceptualizing and launching this project. I would like to thank
the members of the UCD LEARN lab for their feedback along the way, particularly Dr.
Maria Araceli Ruiz-Primo who contributed much wisdom to this project and guidance to
this developing researcher.
To all of the teachers and students who participated in this project, I am forever
grateful for their insight and efforts. I would also like to thank the various and fluid
members of my writing group who contributed their thoughts along the way.
Finally, and most importantly, I would like to thank my wife Monica who was the
primary funder, cheerleader, and counselor for the project. Although my daughter Chloe
joined the project late in the game, she reminded me how important it was to step away
from the computer and just bang on something.
vii
TABLE OF CONTENTS
CHAPTER
I. INTRODUCTION .................................................................................................................... 1 Defining the Problem ..................................................................................................... 2
Difficulties with Investigating Experiential Learning ................................................ 7 Defining Deep Immersion Academic Learning (DIAL) ............................................ 9
Deep Immersion ................................................................................................... 12 Academics ............................................................................................................ 13 Learning ............................................................................................................... 13
Purpose and Significance of the Study ......................................................................... 15 Research Questions ...................................................................................................... 16 Theoretical Framework- “Situated Constructivism” .................................................... 16 Conceptual Framework ................................................................................................ 22
Context Vehicles ...................................................................................................... 27 Identifying the Environmental Components ............................................................ 30
Social Interactions ................................................................................................ 30 Physical environment. .......................................................................................... 31 Cultural Environment .......................................................................................... 32 Emotional Environment ....................................................................................... 33 Artifacts and Tools ............................................................................................... 34 Internal Dialog and Expression ............................................................................ 35
Learner-Networks .................................................................................................... 36 Method Overview ......................................................................................................... 37 My Background ............................................................................................................ 39 Chapter One Summary ................................................................................................. 40
II. LITERATURE REVIEW ......................................................................................................... 42 Introduction .................................................................................................................. 42 Theoretical Foundations ............................................................................................... 43
Experiential Learning Theory .................................................................................. 43 Situated Learning Theories ...................................................................................... 49
The Social Environment ...................................................................................... 51 The Physical Environment ................................................................................... 53
viii
The Cognitive Approach to Learning ....................................................................... 54 Schema Theory .................................................................................................... 57 Hierarchies and Networks .................................................................................... 58 Scripts and Plans .................................................................................................. 59 The Role of Context in Schema Theory .............................................................. 60
Situated Constructivism ........................................................................................... 62 Context and Learning ................................................................................................... 64
General Understanding of Context ........................................................................... 64 Context in School ..................................................................................................... 67
Environmental Components ......................................................................................... 82 Social Contributions to Learning ............................................................................. 82 Physical Environment .............................................................................................. 84 Tools ......................................................................................................................... 85 Affective and Individual ........................................................................................... 85 Culture ...................................................................................................................... 86
Facilitated Versus Peripheral Learning ........................................................................ 87 Chapter Two Summary ................................................................................................. 92
III. METHOD ................................................................................................................................ 94 Overview ...................................................................................................................... 94 Participants and Settings ............................................................................................... 95
Case Selection and Sampling ................................................................................... 95 Similarities Across the Cases ................................................................................... 97 Case 1, Winter Ecology ............................................................................................ 98
The School, Case 1 .............................................................................................. 98 The Students, Case 1 ............................................................................................ 99 The Teacher, Case 1. .......................................................................................... 100 The Class, Case 1 ............................................................................................... 101 The DIAL Experience, Case 1 ........................................................................... 102
ix
Case 2, Winter Environmental Science .................................................................. 102 The School, Case 2 ............................................................................................ 102 The Students, Case 2 .......................................................................................... 104 The Teacher, Case 2 ........................................................................................... 105 The Class, Case 2. .............................................................................................. 105 The DIAL Experience, Case 2 ........................................................................... 106
Case 3, Crane Migration Study .............................................................................. 107 The School, Case 3 ............................................................................................ 107 The Students, Case 3 .......................................................................................... 107 The Teacher, Case 3 ........................................................................................... 108 The Class, Case 3 ............................................................................................... 108 The DIAL Experience, Case 3 ........................................................................... 109
Case 4, Everglades Ecology ................................................................................... 110 The School, Case 4 ............................................................................................ 110 The Students, Case 4 .......................................................................................... 110 The Teacher, Case 4 ........................................................................................... 111 The Class, Case 4 ............................................................................................... 112 The DIAL Experience, Case 4 ........................................................................... 112
Research Design ......................................................................................................... 113 Procedures- Research Question 1 ............................................................................... 114
Preparing the Pathfinder Instruments ..................................................................... 118 Creating the Referent ............................................................................................. 122 Administering the Assessments ............................................................................. 122 Data Analysis for Q 1 ............................................................................................. 122
Procedures- Research Question 2 ............................................................................... 124 Teacher Data .......................................................................................................... 125 Student Data ........................................................................................................... 126 Data Preparation, Coding and Analysis ................................................................. 128
Field Study ............................................................................................................. 141 Analysis ...................................................................................................................... 144
Field study data analysis ........................................................................................ 146 Synthesis ................................................................................................................. 146
Data Handling and Protection of Informants .............................................................. 148 Validity / Legitimation ............................................................................................... 148
E4.1 Individual Reasoning and Internal Reflection ........................................... 244 E4.2 Writing and Verbal Articulation ................................................................ 247 E4.3 Linking Across Events .............................................................................. 248 E4.4 Connection to Past Learning ..................................................................... 250
E5 Emotional Contributors to Learning ................................................................. 253 Contextualization ........................................................................................................ 260
Misconceptions ...................................................................................................... 264 Chapter Five Summary ............................................................................................... 264
VI. DISCUSSION .................................................................................................................... 267 Overview .................................................................................................................... 267 Discussion and Implications: Research Question 1 .................................................... 268 Discussion and Implications: Research Question 2 .................................................... 272
Social Interactions and Cultural Elements ......................................................... 280 Physical Environment ........................................................................................ 283 Tools .................................................................................................................. 285 Individual Role and Emotional Environment .................................................... 287
Contextualization ................................................................................................... 290 Revised Conceptual Framework ................................................................................. 292 Limitations .................................................................................................................. 296 Contributions .............................................................................................................. 299 Recommendations for Future Research ...................................................................... 301 Chapter Six Summary ................................................................................................. 303
2005) and there is a wide field of research into the classroom as a learning environment
(see Fraser, 2007 for review) but we do not know much about real world learning
contexts.
There is also a lack of clarity on how comparable various experiential pedagogies
actually are. Because the term, ‘experiential education’ is used so widely, it hinders
comparability between studies and fosters broad stereotypical generalizations across
programs and curricula. It seems that experiential education is often celebrated or
criticized as whole, neglecting the wide diversity of programs and curricula that it
encompasses. In one of the more blistering critiques Hirsch defined “learning-by-doing”
as “process–heavy, devoid of content, and a holdout from the 1960s progressivist
approaches” (as cited by Roberts, 2002, p. 256). He goes on to assert “learning by doing
and its adaptations are among the least effective pedagogies available to the teacher.”
Such broad statements are difficult to interpret when one considers the broad scope of
programs, curricula, and their associated goals that are to be included in this
pronouncement.
Even those who tend to support experiential education have presented generalized
critiques, as does Seaman (2008) who describes the lack of ongoing, empirical research
around experiential education as having led to an evolution of “practice–driven models
with historically specific purposes into a broader belief system underwritten more by
liberal–humanist ideology, folk psychology, and administrative interests than by scientific
or epistemological foundation for learning” (p. 228). While Seaman’s observation
regarding the lack of empirical evidence is valid, the overgeneralization of the field may
7
be more to blame as it makes it almost impossible to define exactly what can be compared
or what the focus of inquiry should be.
Similarly, there is a general sense that science education can be lumped into
formal and informal settings with formal including traditional classroom formats and
anything outside of the classroom being lumped together as informal (Falk, 2005). There
are a number of problems with the formal/informal designation (Falk, 2005), particularly
the categorization of everything occurring outside the classroom as being somehow
similar. This designation speaks more to traditional assumptions of what education
should look like than it does to providing a meaningful designation of the relationship
between a learner and a learning environment. As a learning environment, a guided field
trip through a museum probably has more in common with the classroom than with an
experience in which students are working with scientists in the field to gather legitimate
scientific data. In order to better understand experiential science learning in authentic
environments we need to be able to compare experiences within meaningfully comparable
groups, moving beyond attempts to describe “informal learning” or “experiential learning”
as if these represented groups of comparable processes. The best research on free choice
learning in a museum or on self efficacy developed on an Outward Bound course may
have little or no validity when applied to a group of students doing field work with a
scientist.
Difficulties with Investigating Experiential Learning
A number of barriers to understanding the experiential learning process present
themselves in any attempt to research it. These include the accurate assessment of
learning that is highly individualized, the more open-ended nature of the variables of
8
authentic versus classroom learning environments, the highly variable nature of the
enactment of any given experiential education program, and as previously described, the
categorization for comparison of disparate approaches. The atomization of the learning
process is a historical reality that has also contributed to these difficulties. This has been a
natural result of the research process, particularly in understanding the role of context in
education, as Nardi (1996) reflects: "How can we confront the blooming, buzzing
confusion that is “context'' and still produce generalizable research results?" This is true
but it is unlikely that the whole of learning is equal to the sum of the parts and it is likely
that there are substantial differences between what happens in a naturally complex
environment and what happens under controlled conditions (Salomon, 1993a). Rickinson
et al. (2004) offer a word of caution: “The difficulty of identifying, measuring and
evaluating the benefits of fieldwork and field trips should not be underestimated by
researchers, practitioners or policy makers. There are far too many poorly conceptualised,
badly designed and inadequately carried out studies” (p.24).
There is an ever-present tension between complexity and parsimony and while it
has been necessary to subdivide the learning process into manageable units in order to
understand it, we may be at a point where we can move toward consilience and approach
learning from a more systemic perspective, as proposed by Lee (2011). To look at
learning in authentic environments we must acknowledge the varied pathways that
knowledge can be developed as an individual interacts with the actors and objects within
her environment.
To use the image of the black box of experiential education, research has shown
us some parts that make up the black box and it has shown us the results of a learner who
9
has gone through the black box but we don’t know how many of the elements in the box
work, nor how the elements of the box work together. We need to know more about how
the parts work together to generate specific outcomes. Without this knowledge
practitioners cannot manipulate the components to target specific outcomes nor to
maximize science learning for a particular group or individual. It is not enough to know
that strong social relationships contribute to learning nor is it enough to understand simply
that being immersed in a real-world environment increases information retention or
application. If practitioners do not understand how authentic learning environments
contribute to learning there is a real danger that experiential learning experiences are not
designed to utilize the potential benefits and student learning suffers.
Experiential pedagogies represent potentially powerful tools for teachers in
schools and informal education settings, particularly those focused on science content, but
without understanding how the tools work, that potential is limited. The problem is clear:
we need to get past the notion that experiential learning is “too mysterious a phenomenon
to fully comprehend” (Conrad & Hedin, 1982, p. 58) by considering both a greater range
of environmental contributors to learning, the interactions among elements within the
learning environment, and their role in developing student knowledge. This study was a
step toward exploring those factors.
Defining Deep Immersion Academic Learning (DIAL)
‘Experiential education’ has become an omnibus term used to describe a wide
range of ideas and practices from Outward Bound type adventure education courses to
service learning experiences, to in-class activities. It is a value-laden term, often and
incorrectly equated with “hands-on learning,” “learning by doing,” “active learning,” and
10
learning “outside the four-walled classroom” (Roberts, 2008). One use of the term is to
describe the immersion of learners into learning environments that are either
representative of environments where the target knowledge can be applied, or
environments that closely approximate the ‘real-world.’ The labels authentic, in-situ,
immersive, and contextualized all contribute important descriptors to this type of learning.
It could be argued that every learning environment is imbued with some context
or another but the term is used within this dissertation as it is described by Rivet &
Krajcik (2008):
Contextualizing instruction refers to the utilization of particular situations or
events that occur outside of science class or are of particular interest to students to
motivate and guide the presentation of science ideas and concepts.
Contextualizing often takes the form of real-world examples or problems that are
meaningful to students personally, to the local area, or to the scientific
community. These are situations in which students may have some experience
with (either directly or indirectly) prior to or in conjunction with the presentation
of target ideas in science class, and that students engage with over extended
periods of time. (p. 80)
Contextualized experiences then, stand in contrast to decontextualized
experiences, wherein the context is a scholastic one, abstracted from events that the
students are experiencing and from the content knowledge as it is typically used in
practice (Rivet & Krajcik, 2008). In the typical secondary classroom, for example, the
knowledge that students are intended to learn may be presented in conjunction with a
description of contexts in which the knowledge is applicable but all of the actual contexts
11
the students are operating within are not likely to be related to the content knowledge.
The physical, cultural, social, and temporal surround is the context of school; even the
best-intentioned posters and visuals provide scholastic rather than actual contexts. When
the class ends in forty-five minutes, the context switches to other parts of the school and
socio-cultural surround and the peripheral context cues the student is exposed to no longer
have anything to do with the target knowledge.
Contrast this with a language immersion program in which the student travels to
and immerses herself in a culture with a different language. She receives formal
instruction on vocabulary and the proper ways to apply it but in addition everything else
outside of class provides contextual cues to support her learning. She can practice, test,
question, and apply the new knowledge throughout the environment and she is presented
with countless opportunities to extend her knowledge in directions that mesh with her own
interests. Her learning is a function of both the facilitated formal curriculum and the
peripheral elements of the context. While these types of immersion experiences do
happen in other academic disciplines at the secondary level, they are not common. There
is no unified body of research within which this type of learning happens and so it is
typically described simply as experiential education. Because that term is used so widely,
however, it is not of much use for understanding this more specific use of contextualized
learning experiences.
A sub-category of experiential education is needed to distinguish the pursuit of
academic knowledge through a combination of facilitated curricula and immersion in a
contextualized environment. As the literature does not provide a label, I introduce the
phrase deep immersion academic learning (DIAL) to indicate both the contextualized
12
nature of the learning environment and the abstract/academic nature of the learning
targets. Though the practice has existed for a long time under the more general label of
experiential education and although the practice is increasingly enacted, the label of DIAL
has not specifically been identified or defined. The label of DIAL applies to a real world
pedagogy that fosters student learning in authentic environments over an extended period
of time, much like the language immersion programs. In addition, DIAL has aspects that
are very intentional and facilitated as well elements that are more open, has content-based
learning goals, and occurs in contexts specifically chosen to enhance the academic content
of the course. As such, DIAL offers a laboratory with which to understand the role of
environmental contexts in student thinking, learning, and development.
Deep Immersion
The first part of the term, “deep immersion”, implies that students are introduced to an
intentional place, time, social setting, and overall environment specifically intended to
enhance the experience and understanding of the topic of study. Within this context,
there are environmental elements that are specifically facilitated and scaffolded by the
teacher and others that are directly related to the content being taught but peripheral,
incidental, or not specifically accounted for by the teacher. Additionally, deep immersion
implies an extended period of time, typically multiple days, in which students are
immersed in the milieu of the learning experience and not being directly influenced by
the distractions of typical daily life. The deep immersion aspect of DIAL often takes the
form of an extended field trip experience but there are cases of deep immersion that do
not necessarily involve a distant trip, and more commonly there are trips that do not rise
to the level of deep immersion.
13
Academics
Similarly, there are deep immersion experiences that are not intentionally
academic, such as group-building experiences and adventure education trips. That is not to
say that learning does not occur during these experiences but that the learning is not
intentionally academic. The “academic” piece of DIAL refers to the specific use of
experience to deliver academic content, predetermined by standards or curricular
expectations, albeit with the understanding that each student will construct their content
knowledge somewhat differently. It is not what I loosely refer to as “the Columbus
method” (send them on their way and hope they discover something). This academic
content knowledge can be declarative, procedural, schematic, or strategic1 (Li, Ruiz-
Primo, & Shavelson, 2006). Typically, the academic content knowledge is well grounded
in application in at least part of the experience.
Learning
The final piece of the DIAL definition is learning through experience. For the
purpose of defining DIAL, I refer to learning in an in-situ, relevant, contextualized,
perhaps embodied process, in which the students are engaged in a transactional form of
information exchange, and using all or most of their sensory perception to construct
knowledge in conjunction with the elements of their environment. I see this learning as
situated within and distributed throughout the environment but represented uniquely
within each individual learner. A more detailed description of this learning process is
1 In the framework there are four types of knowledge: declarative knowledge, or knowing what, is conceptual or factual in nature; procedural knowledge, or knowing how, indicates understanding of sequential processes applicable to a class of acts; schematic knowledge, or knowing why, is explanatory and can be used to make predictions, and strategic knowledge, or knowing when, where, and how to apply knowledge.
14
described below and in Chapter Two. The experience piece is an important distinction as
it is possible to be deeply immersed but still learning in a largely didactic manner, and not
truly experiencing an event.
DIAL stands in contrast to what Roberts (2008) refers to as “one-off” experiences
in which students take a day off from normal school activities to participate in a challenge
course or visit a nature center, participating in activities without any direct link to their
school studies. An example of DIAL might be a high school biology class taking an
extended trip to coastal California to study marine biology. The trip might include
exploration of tide pools; a day working on a commercial fishing vessel; another day
helping out at a Marine research facility, performing a necropsy on a beached dolphin
alongside a marine biologist; a service learning project at a local estuary rehabbing critical
habitat; and a project in which the class gathers data of species abundance while
snorkeling through a kelp forest. Throughout the experience students may be reading
appropriate texts and reflecting both on their own constructions of knowledge and
connections back to the intended curriculum that explores the human relationship with
marine systems. The facilitating teacher is responsible for intentionally structuring each
experience, helping the students understand the connections between the canonical science
knowledge and the students’ experiences, addressing misconceptions, and delivering
critical content that does not neatly emerge from the experiential elements of the trip.
While these roles may manifest differently within different contexts, they are all critical to
the DIAL process and help differentiate DIAL from other experiential approaches.
The balance between structure and free-choice, abstract and applied knowledge,
continuity and novel experience, and canonical and social information land DIAL
15
somewhere between the worlds of formal and informal education. The goals and some
academic tools are more closely aligned with formal education while the methods and
venues are more readily associated with informal pedagogies. DIAL attempts to find a
balance between the learning of “just plain folks” (Lave, 1988) while also addressing the
deficiencies of that method, as described by Choi and Hannafin (1995):
While "just plain folks" behave and learn in everyday life, their knowledge and
performance is not the same as the experts'. They do many things inaccurately and
inefficiently and possess many misconceptions about daily life. Some
understanding, such as scientific concepts like gravity and earth rotation, require
opportunities beyond our everyday experience. In many cases, everyday
experiences actually hinder learning. (p. 67).
Relatedly, DIAL tends to embrace both the intentional contexts of the learning
environment facilitated by the teachers, as well as the incidental or peripheral, again
finding the balance between the informal and formal. It takes the natural learning
processes of “just plain folks” and forms a bridge to more expert ways of understanding a
given topic.
Purpose and Significance of the Study
The goal of this study was to describe cases of student learning in authentic,
contextualized environments over the course of DIAL experiences in order to fulfill the
purpose of exploring how the components of the environment contribute to that learning.
The study explored how physical environment, social interactions, social constructions of
knowledge, and both facilitated and peripheral opportunities influenced student learning
during DIAL experiences. Because this study was largely a new line of research and was
16
more exploratory than confirmatory in nature, it also serves the purpose of generating new
ideas that can be tested later in this line of inquiry. Through tracking the elements of a
learning environment, including peers and other actors, and how they contribute to
individual students’ knowledge of highlighted academic content, we can better understand
the connected nature of learning in-situ. As this is arguably one of the most complex
phenomena, the goal was more truly to begin understanding it.
The work contributes to the fields of science education and experiential education
by providing empirical evidence on how the contexts of authentic learning environments
support changes in students’ conceptual knowledge structures within four science class
DIAL experiences. The work also provides a tested methodology for investigating
learning in highly complex environments that combines a more formal assessment of
concept knowledge change with a qualitative assessment of the complexity of
environmental supports for learning.
Research Questions
To meet these goals, the following research questions guided the study.
Q1: Do students’ knowledge structures reflect greater understanding of science
concepts following a DIAL experience?
Q2: If so, do students’ interactions with the components of a DIAL environment
contribute to change in their conceptual science knowledge structures?
Theoretical Framework- “Situated Constructivism”
This study is an investigation into learning. In this section I provide an overview
of the learning theory that provides the foundation for the work. A more developed
17
discussion of this theory appears in Chapter Two. I use a general definition of learning to
encompass its breadth: “Learning is the process by which knowledge is increased or
modified. Transfer is the process of applying knowledge in new situations” (Greeno, et
al., 1996). Of course, exactly what that process is or what knowledge is makes this simple
definition much more complex. For my purposes here, no singular theoretical tradition
adequately describes the process and the results of learning. Rather, I adopt a more
synthetic understanding that is heavily influenced by situated, cognitive, and experiential
learning theories.
Greeno et al. (1996) divide perspectives on cognition and learning into three
Greeno, 1997; Greeno, et al., 1996; Perkins, 1993; Salomon, 1993a, 1993b). I support this
latter notion, viewing the two as lenses looking at learning from different levels of
granularity such that situative theories address the interactional network of learning within
an environment and cognitive theories focus on one piece of that network- the individual.
In a recent panel discussion at the 2012 Annual Meeting of the American Educational
Research Association, a group of learning theory luminaries including Barbara Rogoff,
Roy Pea, Carol Lee, and James Greeno revisited the premise of the heavily cited National
Research Council report “How People Learn” (Bransford, Brown, & Cocking, 2000),
concluding that a more synthetic, multi-level model more accurately reflects the learning
process than does any, one, singular approach.
This study examined learning as it exists in a situated context but did so largely
by looking at the meanings and representations assigned by individual students. To do so
a theory that combines the cognitive and situative perspectives was needed. Cobb &
Yackel (1996) offer a theoretical framework for such a union called “the emergent
approach.” I refer to this general idea as situated constructivism to avoid the ambiguity of
Cobb & Yackel’s term. Within their framework, it is possible to locate analyses of
individual’s constructive activities in a social context (Cobb & Yackel, 1996). They
describe the impetus for this approach in this way:
In general, analyses conducted from the psychological constructivist perspective
bring out the heterogeneity in the activities of the members of a classroom
20
community. In contrast, social analyses of classroom mathematical practices
conducted from the interactionist perspective bring out what is jointly established
as the teacher and students coordinate their individual activities. In drawing on
these two analytic perspectives, the emergent approach takes both the individual
and the community as points of reference. This approach seeks to analyze both
the development of individual minds and the evolution of the local social worlds
in which those minds participate. (Cobb & Yackel, 1996, p. 180)
Perkins (1993) introduces a useful concept to be used with situative views of
learning and one that also works well with the idea of situated constructivism, the
“person-plus” as a unit of analysis in understanding learning. The person-plus represents
the individual along with all of the external tools, practices, and other individuals that
allow for a given cognitive process. This is contrasted with the more conventional view
of the person-solo, the conception of learning as being entirely ‘in the head’ (Perkins,
1993). Thus, the cognitive process as well as any memory or “cognitive residue” are
distributed throughout the learning environment, such that the learner off-loads some
memory into notebooks, other people, etc. (Brown, Collins, & Duguid, 1989; Perkins,
1993) in addition to maintaining some representations within their own memory as is
described in schema theory and the cognitive perspective of learning.
This perspective should not be seen as “person-solo” cognition occurring within a
larger social vessel but rather as person-solo as an entity with specific roles within the
larger person-plus system. These roles include perception, indexing, and the assignation
of meaning. Brown & Duguid (1996) offer a useful analogy:
21
The process is not, then, like the addition of a brick to a building–where the brick
remains as distinct and self–contained as it was in the builder's hand. Instead it is
a little like the addition of color to color in a painting, where the color that is
added becomes inseparably a part of the color that was there before and both are
transformed in the process. (p. 49)
Vygotsky’s thoughts on social mediation and internalization also offer some
insight into the interaction of learning roles between the person-solo and the person-plus.
The gist is that all human thought has an external, social precedent such that,
Every function in the child's cultural development appears twice, on two levels.
First, on the social, and later on the psychological level; first, between people as
an interpsychological category, and then inside the child, as an
intrapsychological category. This applies equally to voluntary attention, to
logical memory and to the formation of concepts. The actual relations between
human individuals underlie all the higher functions. (Vygotsky, 1978, pp. 125,
emphasis original)
In this way, internal patterns of thought, are at least fundamentally reflections of similar
patterns that happened between the learner and her learning environment.
A final, uniting aspect that needs to be considered in this idea of situated
constructivism is the role of experience. Experience is the process that unites the
individual learner with the person-plus; the interactions in the physical world with the
cognitive constructions of the mind (Hunt, 1981). Carver (1996) describes the individual
learner as situated within her environment not as an independent entity integrating
experience and reflection, but as one doing so with myriad contributing and confounding
22
factors. Knowledge becomes co-constructed by the learner, experience, reflection,
environment, and social inputs. Seen another way, “Experience itself is often commonly
understood as knowledge held in context–we have experience in something, we
participate in something. These ‘somethings’ are related to contexts. Transfer cannot be
understood apart from the recognition of the importance of context learning” (Quay, 2003,
p. 185). Experience is a process of incorporating learner and environment with
knowledge and contextualization as the residues of that process.
In summary, an understanding of DIAL is best accomplished with a view that
encompasses the individual mental representations described through schema theory, and
a more holistic account of how the schemata and higher-order thinking of the person-solo
interact with innumerable external physical and social elements to result in a system of
learning that is distributed throughout the environment but centered around an individual.
Experience becomes a person-solo perspective of a learning environment. Knowledge is
constructed as an individual gives meaning to information that is processed by and
distributed throughout the physical and socio-cultural environment.
Conceptual Framework
The theoretical framework presented above provides a foundation for the
introduction of a new conceptual framework for learning while immersed in
contextualized environments (Figure 1.1), such as in a DIAL experience. Building on the
theoretical framework of “situated constructivism” outlined above, this conceptual
framework takes into consideration the roles of the individual as well as the components
of the environment in modeling the DIAL process. The framework does not model every
aspect of DIAL, instead focusing on the central goal of supporting the development of
23
academic content knowledge for the learner via the affordances of a contextualized
environment.
The framework allows for the manipulation of the components to both test and
manipulate practice in the field and while there are countless ways in which the
framework could be organized, the delineations are intended to facilitate these
manipulations in manageable ways. Fundamentally this framework explores the
relationship of distributed environmental cues to each individual learner’s present state
and the interaction amongst these elements that lead to and support learning. I refer to
these person-plus systems as learner-networks.
24
Learner/environment network components
Facilitated social interactions
Peripheral social interactions
Facilitated physical environment
Peripheral physical environment
Figure 1.1. Learning environments provide a contextual surround that lead to elaborations and greater integration of learning targets with schemata. Deeper and more connected learning occur when the environmental components add contexts that are related to a learning target. .
Context
Vehicle
Learner
Learning Target
Learner elaborates the learning target with a unique set of environmental context cues
Facilitated non-‐academic tools
Peripheral non-‐academic tools
Facilitated emotional environment
Peripheral emotional environment
Facilitated academic tools
Peripheral academic tools
Facilitated cultural environment
Peripheral cultural environment
Fac. internal dialog & expression
Per. internal dialog & expression
Learning targets without contextual elaborations are less likely to interface with the learner’s schemata and less likely to be learned.
DIAL Framework: Contextualization of Learning Targets Through Environmental Interactions
25
The target knowledge, shown in the upper left of Figure 1.1, is learned within the
contexts of the learning environment. Within this framework, the components of the
learning environment, shown as inward pointing arrows, can be grouped into: social
interactions, cultural environment, emotional environment, tools and artifacts, physical
environment, and internal dialog & expression. These components are somewhat
artificial as they may not be mutually exclusive and any given object or event in the
learning environment likely crosses boundaries and networks with other objects/events.
However, this taxonomy is useful in its ability to focus study, and more importantly, it
provides a focus for adjusting pedagogy in manageable ways. For example, it is true that
peer interactions are informed by the cultural and emotional environment but by isolating
elements of the interactions it becomes easier to highlight them for study and to adjust
their facilitation when teaching. Understanding how these components work together is
also an important phenomenon to be explored. These components are described and
differentiated below.
For each of these environmental components, a categorical distinction is made
between what is facilitated by the teacher or curriculum and what is peripheral.
Facilitated components are those objects and events that were planned by or
spontaneously enacted by the teacher/curriculum. Peripheral contributions to learning
occur when students pick up relevant information directly from the environmental
components without the direct intervention of the teacher. This is not to say that the
peripheral components are necessarily distracters or unimportant for learning. On the
contrary, these peripheral elements are critical to DIAL. Positioning peripheral
components in contrast with facilitated components does not imply that the teacher is
26
unaware of them. Rather, a teacher would use DIAL in large part to capitalize on these
peripheral context cues for their students. Classroom teaching typically focuses on the
facilitated aspects of the environment and tries to minimize the peripheral. This, of
course, makes sense if the peripheral offers little potential to support and much potential
to distract from the learning target(s). Some of these cues play a much bigger role than
others do in learning and combinations of cues might amplify their independent effects.
The tenets of this conceptual framework are summarized here:
(a) Target knowledge is a socio-cultural construction that a teacher, curriculum,
society, etc. deems should be known by individuals.
(b) In the presentation of target knowledge there exist countless components of the
learning environment that can be associated/elaborated with the target knowledge as a
person learns it (learning is distributed).
(c) Within a given environment, some learning opportunities are facilitated by the
teacher and some are embedded within the environment, peripheral to the intended
learning opportunities.
(d) Each individual keys into different combinations of environmental components
with which the target knowledge is elaborated. These unique combinations become
“context vehicles”.
(e) The context vehicle interfaces with the learner’s schema and allows for the
development of mental representations, though some of the knowledge may remain
distributed throughout the environment and is indexed by the learner.
(f) Target knowledge that is not associated with environmentally-sourced
elaborations is less likely to interface well with the learner’s schemata.
27
(g) Because each learner is both dynamic and unique, no single context vehicle can
be universally effective across time or population.
From these tenets, the following hypothesis can be drawn: Increasing the depth
and breadth of contextual cues increases the chances of finding combinations to
effectively elaborate target information into context vehicles for each individual learner.
Context Vehicles
As mentioned, a learning target must begin as a socio-cultural construction. The
central arrow in Figure 1.1 illustrates the process of the learning target being perceived by
the learner, but perceived in conjunction with much additional information and action that
is distributed throughout the environment. All of these factors become elaborated with the
target knowledge and result in a networked mental representation. For example, the
learning target might be an understanding of how marine organisms deal with issues of
buoyancy. As the learner develops his understanding of this idea, it becomes elaborated
with his experience of how his wetsuit was buoyant while snorkeling (facilitated non-
academic tools), with a spontaneous conversation he had with a friend about the topic
(peripheral social interaction), with a lecture introducing the idea (facilitated social
interaction) and with perceptions of how excited his peers are about the topic (peripheral
emotional environment). All of these factors become elaborated with the target
knowledge and result in a networked mental representation. Together, these contributors
can be thought of as a context vehicle.
Ideally all of these associations would be directly related to the content to be
learned and while this seems more likely in a learning environment where more of the
components are conceptually bound to the learning target, such as in DIAL, it is
28
unrealistic to assume that everything a learner perceives will be so. Rather, there may be
contextual components that are conceptually unrelated but still become elaborated with
the learning target. Extending the previous example, the student studying buoyancy may
also be taking in much information from the environment that is unrelated to that concept.
If a student is exposed to a context-free and isolated idea, there are limited
potential connections through which she can situate that idea within her existing schemata.
When asked to recall or use that idea later, only by triggering that limited pathway can she
do so (J. R. Anderson, 1990). If, on the other hand, she learns the idea in a manner that
assists her in making multiple connections to existing schemata, she is in a better position
to access and use that information later. She has built, in conjunction with her
environment, a context vehicle, or a bundle of contextual cues that become associated with
target information and allow for the delivery of that information where it would otherwise
be unavailable to the learner due to a lack of relevance or positioning within an existing
schema. Rivet & Krajcik (2008) refer to this process as “contextualization”. Our brains
are particularly adept at filtering out irrelevant information (Bransford, et al., 2000) and
the context vehicle provides the means to access a schema and make it through this
filtering process. Experts within a given context are particularly adept at making
connections between conceptual knowledge and relevant information within that context
(de Groot, 1965; Schneider, Gruber, Gold, & Opwis, 1993). The implication of the
conceptual framework presented here is that interactions with authentic contexts may
support learners to build this ability by fostering the development of context vehicles that
are relevant to knowledge being learned.
29
The intentional manipulation of context typically represents only a small fraction
of what constitutes an actual context vehicle in a learning situation. All other sensory
cues are combining with and are being associated with the target information as well.
Though the use of context vehicles can be an effective pedagogical tool, there are two
problems that arise in conjunction: first, no two individual learners nor their schemata are
the same so it is impossible to create a universal context vehicle, and second, context
vehicles are inevitable in the sense that even if context is not assigned, it is impossible to
entirely divorce information from context, intentional or otherwise. A teacher then,
cannot entirely create a context vehicle for a student and certainly not for a group, but he
can facilitate an environment that is replete with context cues that support rather than
distract from the targeted information.
Viewed from the environment side, knowledge on any given subject is distributed
throughout the people and objects of the learning environment and so limiting learners’
access to that distributed knowledge necessarily limits the learners’ conceptions. The
important recognition here is that even seemingly insignificant or peripheral
environmental cues can add or detract from the assimilation of the targeted information as
the contexts become elaborated with it. Thus, a student who is learning in a classroom
may have a more difficult time assimilating information deeply and broadly as compared
to a student who is learning in an environment in which most of the contextual cues
support the learning targets, as in DIAL. Further, there is a danger of students who are
learning in strictly academic environments associating learned information largely with
academic settings.
30
Identifying the Environmental Components
The purpose of this study is to understand the roles of environmental contributors
in the development of conceptual knowledge, and so it becomes useful to group those
environmental components so that trends can be explored. This becomes more important
for future or resultant interventions and manipulations of learning environments. The
component groups shown in figure 1.1 are arranged in such utilitarian groups. It is
important to reiterate that these groups may be more a function of the lens used to look at
them than delineations that exist in the complexities of the real world. The following
sections define these groupings for the purposes of this study.
Social Interactions
For the purposes of this conceptual framework, social interactions refer only to
direct human-to-human communication that will typically have both verbal and non-
verbal elements. It can be assumed that these social interactions, including conversations,
class discussions, and lectures play a large role in contextualizing learning targets. We
have the ability, largely through abstract language, to prepare information for other
learners (Vygotsky, 1978), thus creating a context vehicle that very effectively activates
the schemata of the other. When we are sharing information in a conversation, we
typically provide a context; we express emotion through word choice, inflection, and body
language; we inquire as to previous connections the listener might have; we are constantly
monitoring the listener for nonverbal feedback; and we inadvertently link the shared
information to ourselves, as the expresser of it.
Perhaps more significantly, when we share information via language we have
abstracted it in a way that meshes well with generalized schemata. We use language as a
31
mediating tool to universalize a concept (Wertsch, 2007). When we interact directly with
the environment, we need to first take the step of abstracting the information while in
human-to-human interactions the information often comes pre-abstracted and bound in
contextual clues. The contextualization allows us to take in information that has been pre-
filtered for relevancy and assigned a meaning for ready assimilation. Looked at from a
situative perspective, the learning is distributed between participants as they co-construct
an idea. This also becomes apparent when we contrast social, transactional information
exchange with information gained from artifacts (e.g. text, art, etc.) that also contextualize
information but in a much more static manner. In DIAL environments, these social
interactions, whether facilitated by the teacher or spontaneous, inevitably begin to
incorporate the other elements of the environment, assisting the learner in interpreting that
environment.
Physical Environment
When processing raw information from the environment our task of learning is
difficult but not impossible. When interacting directly with the environment, learning is
still largely socially mediated. We situate new information within the language and
contexts that we already know and we often support each others’ learning via reflection
and debrief (Vygotsky, 1978). From this it would be logical to conclude that this sort of
direct immersion in the environment is unnecessary- logical but not accurate.
Rather, the environment around us provides important contextual cues that are
more easily assimilated via social mediation and, in turn, help elaborate socially mediated
information. A teacher may help a student couch their observations in a culturally
common schema and therefore find a connection to an individual student’s schema or a
32
student may be cataloging sensory information in conjunction with the teacher’s
description of a concept. In either case, the information is value-added as context cues
and elaborated information are combined for more diverse connections to schemata and
therefore greater chance of recall/application. This contextual support may have a much
more significant impact on learning than is typically ascribed to it.
These contextual cues may also help to customize the context vehicle for each
individual learner. That learner is constantly associating the targeted information with a
combination of context cues that they uniquely perceive from the environment. One
student may be tuned in to a deep sense of place, the motivation of her peers, and a
particularly poignant visual cue. Another student might be focused on the sounds and
smells of an environment but they are both still learning the target information. For the
purpose of this framework then, the physical environment category refers to landscapes,
flora, fauna, and objects not used as tools that students interact with and experience in the
pursuit of DIAL.
Cultural Environment
Disentangling the social from the cultural is a difficult task and is beyond the
scope of this dissertation. Rather, the grouping cultural environment is used here to
categorize a narrow range of cultural phenomena. The label refers to cultural practices or
their effects that differ from the mainstream culture of the learner. More specifically, the
label refers to cultural practices that are part of the class or school culture or those that are
related to the group within which the DIAL immersion takes place. Certainly there are
broad cultural factors at work in any learning environment but those that can be
manipulated are of most use to this framework.
33
For example, if the school uses an acronym or a memorized phrase to encourage
certain behaviors and the teacher uses this tool to motivate students in a given situation,
this could be considered contextualization through a facilitated aspect of the cultural
environment. To use the previous example of the Marine Biology class, a student may be
struggling to understand why human impacts on the ocean are not immediately stopped
but after spending the day within the culture of commercial fishermen, they contextualize
the issue by understanding the economic needs of that cultural group and how they may be
in tension with conservation efforts. This too, would be cultural contextualization.
It is important to remember that these component groups are designated with the
purposes of observation and pedagogical manipulation in mind. Background cultural
phenomena that are not noticed by the learner may not play a useful role in the
differentiation and representation of the target knowledge as ever-present cultural
elements would be bound to all learning for the student. Cultural as well as social
subtleties clearly have an impact on every aspect of a learning environment but the
subtleties are beyond the scope of this study and are probably not easily manipulated.
Emotional Environment
Similarly, it can be difficult or impossible to disentangle emotion from any other
aspect of learning. For the purposes here, I refer to either the very intentional use of
emotion in instruction and/or metacognitive identification of emotional elements. For
example, the teacher may facilitate a very specific ‘tone set’ to prime students for what the
teacher hopes will be a moving experience. Alternatively, a student might identify
frustration that they felt regarding an assigned task they could not master or a deep sense
of awe associated with a natural phenomenon they experienced.
34
Artifacts and Tools
Human artifacts including texts, art, architecture, recordings (video/voice), and any
other object that is manmade also provide the learner with uniquely human context
associations to facilitate integration with schemata. Similarly, known heuristics and
procedures have a similar effect. In the case of text, voice recordings, or any other
symbolic language, this contextualization may be a function of the abstraction. Artifacts
share this with direct human communication but there are important differences as well,
predominantly the non-transactional and static nature of artifacts.
Artifacts also play a critical role in a rapidly changing society as they provide an
unchanging referent such that learners can all go back to the same source. Although each
will learn the information via unique pathways and interactions with their schema, will
have different access to the materials, and may index the sources differently, they are all
starting with the same information, unchanged by additional learners/teachers in the chain.
I define academic tools as artifacts, heuristics, or procedures that have been
designed or co-opted for the purpose of academic instruction or the facilitation of abstract
thought for pedagogical ends. Clear examples include textbooks, worksheets,
journals/notebooks, educational media, and content-related websites. Other cases might
be less clear such as computers/computer programs, non-fiction books, calculators, etc.
The definitive test is the intention for use so that a computer can be an academic tool or a
recreational tool, depending on how it is used.
Though there is a fine line between when a tool is academic and when it is not, the
distinction is an important one in understanding how DIAL occurs in the field. In the
earlier example of the student discovering buoyancy through use of a wetsuit, this would
35
be considered a non-academic tool but if the teacher created a mini-lesson using the
wetsuits as an example, it would then become a co-opted academic tool for the purposes
here. Thus, non-academic tools are man-made objects, procedures, or heuristics used for
some purpose that is not intentionally related to the content being taught.
Internal Dialog and Expression
Learning and the incorporation of new ideas into the schemata are not limited to
sensory information that moves from the external to the internal. Rather, learning can also
occur via internal dialogue and by moving ideas from the internal to the external such as
when a learner expresses an idea. While these ideas likely have a person-plus origin, they
can be manipulated within the person-solo to varying degrees. Both internal dialogue and
expression add elaborations to the schemata, leading to increased generalization or
specialization of the schemata (J. R. Anderson, 1990)
Learners often catalog experiences they do not have strong connections to but later
make those connections as relevant information becomes available. For example, a
student might notice while in the field that different plants grow on north and south slopes
but might not situate that knowledge until a later ecology lesson helps them create an
explanation for it. Though asynchronous, those episodes become linked via internal
dialog (Kolb, 1984).
Both internal dialog and expression can be either facilitated through prompting or
can be spontaneous. The only access researchers have to this process is when the learner
recognizes it in himself and can articulate it to someone else. This creates difficulties for
studying it but it is a critical piece of the person-plus learning network.
36
Learner-Networks
To bring all of these parts together then, we see a dynamic network in which the
learner is in constant interaction with her environment, extensively filtering incoming
information with existing schemata and offloading cognitive and perception tasks to other
aspects of the environment. When raw information is bundled with contextual clues, the
learner is better positioned to find a connection between the new information and past
experience.
We must look beyond the context cues that are tightly bound to targeted content
and consider how knowledge is distributed throughout the entire learning environment.
Different components of the environment have very different implications for learning as
they each offer different ways and degrees with which to access information related to
learning targets. Though peripheral connections may seem as if they have only weak ties
to the targeted information, I am proposing that there is strength in these weak ties,
particularly when combined with or in supporting the stronger ties of socially mediated
learning.
These context cues are often neglected in most education settings but probably
provide significant contributions to how information is elaborated and therefore, to how it
can be recalled or applied. These context cues may also be of little apparent use at the
time of learning but may become more useful later when further or more advanced
learning on the subject takes place. When information is presented in such a way that
most of the context cues are related to the target content, as in DIAL, the information is
more effectively elaborated and an effective context vehicle has been created. In the
classroom, learners do not cease elaborating information with environmental context cues,
37
they simply elaborate the context cues of the classroom with the new information, thereby
associating academic content largely with academic settings, rather than the real world
they are intended to be applied to.
Every learning event is a function of (a) information distributed throughout the
environment, including social and communicated information, (b) the experience of the
learner, and (c) the current state of activation of the myriad schemata of the learner.
However, it is difficult to conceive of any learning event that could truly isolate any
singular learning. Rather, we must see learning as an environmentally networked event in
which many bits of information are learned together and become, at least in part,
associated in memory. Through DIAL, we support that process.
Method Overview
To answer the research questions, a mixed-methods, multiple case study design
(Yin, 2009) was used. Four high school science classes that participated in DIAL
experiences served as the four cases of the study. These cases included 68 students, the
teachers of each class, and local experts who participated in the experiences of two of the
cases. Students in two of the cases studied various aspects of the winter environment
while participating in residential programs situated in montane and alpine ecosystems.
Students were often required to travel on skis through the environment. The third case
traveled by van to a sandhill crane migration staging area to study the birds and human
impact on the birds’ habitat. The final case traveled to the Florida Everglades to study
that ecosystem while traveling by canoe and on foot.
The first research question regarding whether or not students learned through their
DIAL experiences was addressed through a pretest-posttest design using a graph-theoretic
38
assessment of structural knowledge, Pathfinder Network Modeling (Schvaneveldt,
Dearholdt, & Durso, 1988). The Pathfinder process uses students’ judgments of
relatedness between pairs of germane concepts to create a network diagram, or PFnet, that
illustrates the most salient connections that students make amongst the set of concepts.
These data were used largely in a quantitative manner by comparing various measures of
similarity between each students’ pre- and post-PFnet to an expert referent, noting change
in similarity to the referent over the span of the DIAL experience. Wilcoxon Matched
Pairs Tests were used to assess for statistically significant change at the case level. The
PFnets were also used qualitatively to (1) analyze for patterns in the nature of the changes
students were making in their knowledge structures as a result of the DIAL experiences,
and (2) to drive the interview process used to answer the second research question.
That second research question, regarding the contributions to learning made by
components of the learning environment, was answered using a qualitative approach. As
mentioned, students were interviewed immediately following their DIAL experiences and
they were shown the PFnets from their pre- and post- assessments. Changes in the PFnets
that represented conceptual shifts important to the learning goals of the class were
highlighted and pointed out to the students. For each of these, students were asked to
describe their current understanding of the highlighted relationship, if the change was
indeed a conceptual shift that they felt they made, and how they learned about or made
that shift. Follow-up questions were often asked to help students clarify their self-
identified learning process. The interviews were audio recorded, transcribed and coded
using the method of pattern matching logic (Yin, 2009). Cross-case analysis was used to
identify common themes and patterns across the four DIAL experiences.
39
In order to triangulate the data gathered through the interview process, I directly
observed one case, the Everglades class, throughout their DIAL experience. I recorded
video, audio, photographs, and field notes of student learning and interactions with their
environment, conducting on-the-spot interviews as we traveled. While four students were
intentionally highlighted within this process to capture as complete a record of their
experience as possible, all students in the class, their teacher, and a local guide hired for
the trip, were all included. My role in the group could be described as a quasi-participant
as I was not involved in the targeted learning but participated in general camp and travel
activities and engaged in casual as well as data-collection conversations. The data
collected through this process were coded and analyzed using the same scheme as for the
interview process. The formal interviews conducted on the trip were recorded,
transcribed, and coded, while all other audio, video, and photographic data were coded
directly with a qualitative research software tool. The data were compared to the findings
from the interview process and included in the cross-case analysis. A more in-depth
discussion of the methods used in this study can be found in Chapter Three.
My Background
In qualitative research the researcher is the primary instrument and as such it is
important for the reader to understand the background and perspective of the researcher as
it relates to the methods and data being presented (Creswell, 2007). As this study includes
qualitative methods I address my background in this section.
My own background in contextualized science education began as a freshly minted
wildlife biologist working for the U.S. Fish and Wildlife Service. In that position it
became clear to me that there were many aspects of my undergraduate education that did
40
not fully come to light until I experienced the use of learned knowledge in the context of a
working field biologist interacting with other scientists, wildlife, ecosystems, and a body
of focused knowledge.
When I transitioned into teaching science at the secondary level, I tried to foster
similar approaches to contextualize the targeted information for my students, using
experiential learning, problem-based learning, service learning, integrated curricula, and
what I am now calling DIAL. It was clear to me that these approaches led to much higher
student engagement but it was always difficult to determine if student learning was
greater, categorically different, or longer lasting than that which resulted from more
traditional pedagogies. It seemed as though students’ interactions with people and their
environments were often markedly different during DIAL experiences than they were with
more traditional approaches but identifying these differences proved elusive and the
literature on experiential education did not offer much guidance. While I often felt as
though experiential approaches to learning could be very powerful, I have often observed
situations where I doubted that any significant learning was occurring, even in my own
teaching. With that perspective, I approached the present research not in an attempt to
prove the efficacy of experiential education or DIAL, but to test and explore it.
Chapter One Summary
In this chapter I presented the problem this study addressed: the need for science
pedagogies that foster deeper conceptual knowledge, offering DIAL as a potential but
untested solution to this problem. I explained the role that situated constructivism played
as the theoretical foundation for the study and introduced a new conceptual framework
that was tested in this study. I described some of the difficulties of studying authentic
41
learning environments and provided an overview for the mixed methods approach I used
to work around these difficulties.
42
CHAPTER II
LITERATURE REVIEW
Introduction
Thinking about DIAL as a unique learning process is a new endeavor and as such
there is no existing literature that directly informs an understanding of it. However, there
are a number of bodies of research that inform elements of DIAL. That past work
directed the design and implementation of this study. The first part of this chapter
provides a more in-depth discussion of the theoretical foundations of the study, what I am
calling situated constructivism. That first section explains the contributions of situative,
cognitive, and experiential learning theories as well as the thinking of others who have
found utility in a combined theoretical view of learning.
A simple way to conceive of DIAL is as a pedagogy, and a process in which
cognitive learning happens in conjunction with a contextualized, real-world environment
that was specifically chosen by the teacher to support academic learning. With this
framing, the relationship between the environment, the content, and the learner are deeply
interrelated through the processes of contextualization and experience. In the second
section of this chapter I present some empirical evidence on contextualized science
learning from existing studies. This is done in three parts outlining (a) understandings of
context and contextualization, (b) evidence concerning the role of experience in learning
within authentic learning environments, and (c) a look at past studies that have compared
facilitated and peripheral learning opportunities.
43
Theoretical Foundations
The theoretical foundation for this study was introduced in Chapter One. The
approach was described as being based on the assumptions of situated learning theories
that assert learning is a complex process involving all of the animate and inanimate
objects within a learning environment, continuously processing information and
recording changes within the system. The cognitive view is one of learning as an
individual process that happens within the learner’s head through changing
representations of knowledge. The perspective used here combines these two, seeing
specific and critical roles for the individual within the more complex ecology of the
person-plus. Experience is the interaction between the individual and the system. In the
next sections, each of these theoretical traditions is explained in isolation. Some more
recent thinking on bringing the traditions together is then presented. At the outset of this
research, the work used experiential learning theory (ELT) as a theoretical foundation.
ELT is presented first to capture the evolution of the thinking that went into the
development of the present theoretical basis.
Experiential Learning Theory
In scanning the experiential education literature, one finds almost as many
definitions for EE as there are authors writing about it. Curiously, and perhaps in
reaction to the broad sweep of what has been called EE, many writers choose to define it
by what it is not, as in Chapman, McPhee, & Proudman (1992):
Experiential education is not simply ‘learning by doing.’ Living could be
described as learning by doing. Often this is not education, but simply a routine,
prescribed pattern of social conditioning… Learning that takes place without
44
reference to relationships is not experiential as it does not allow learners an
opportunity to see how they fit into the bigger picture. (p. 18)
In contrast, Kolb (1984) offers an affirmative definition that is deceptively simple,
“the process whereby knowledge is created through the transformation of experience”
(p.38). The Association for Experiential Education defines EE as “both a philosophy and
methodology in which educators purposefully engage with learners in direct experience
and focused reflection to increase knowledge, develop skills, and clarify values”
(Breunig, 2008, p. 78). Itin (1999) offers a more complete understanding of experiential
education, and a definition that most closely resembles DIAL:
Experiential education is a holistic philosophy, where carefully chosen
experiences supported by reflection, critical analysis, and synthesis, are structured
to require the learner to take initiative, make decisions, and be accountable for the
results, through actively posing questions, investigating, experimenting, being
curious, solving problems, assuming responsibility, being creative, constructing
meaning, and integrating previously developed knowledge. Learners are engaged
intellectually, emotionally, socially, politically, spiritually, and physically in an
uncertain environment where the learner may experience success, failure,
adventure, and risk-taking. The learning usually involves interaction between
learners, learner and educator, and learner and environment. It challenges the
learner to explore issues of values, relationship, diversity, inclusion, and
community. The educator's primary roles include selecting suitable experiences,
posing problems, setting boundaries, supporting learners, ensuring physical and
emotional safety, facilitating the learning process, guiding reflection, and
45
providing the necessary information. The results of the learning form the basis of
future experience and learning. (p. 139)
Still others identify a theory of experiential education that has emerged in the
collective works of scholars who have turned their attention to understanding learning
Instructions: Please rate how ‘related’ each pair of words or concepts is. A 7 indicates that the two concepts are very closely related and a 1 indicates that the two concepts are not related in any way that you can think of. Use a 4 if you do not know one or both of the concepts. The remaining numbers are gradations so a 2 is only a tiny bit related and a 5 is definitely related but not as closely as a 7. It is helpful to create ‘anchors’ for 1 and 7. To do this, look at the words/concepts listed below these instructions. Pick the two that are definitely the most related-‐ this pair will be a 7. Pick the two that have the least in common-‐ this pair will be scored a 1. It is important that you ‘go with your gut’ and don’t second guess-‐ go with what feels right at first and don’t over-‐think it. For each of the pairs listed below, circle the relatedness score that you associate with that pair.
Word/Concept Bank
ecosystem adaptation water flow food web shell midden
human impact tides invasive species air plants niche
Circle the number that indicates how related each of these concept pairs are (1) hardwood hammock and food web
1 2 3 4 5 6 7
not related not sure very related
(2) cypress swamp and biomagnification
1 2 3 4 5 6 7
not related not sure very related
(3) human impact and shell midden
1 2 3 4 5 6 7
not related not sure very
Figure 3.3. Example of Pathfinder assessment used for Case 4. Each concept is paired with every other, resulting in 190 pairs.
122
Creating the Referent
The most consistently predictive referent for this procedure is an average of the
ratings of several experts (Acton, et al., 1994). To do this, three content experts were
recruited to rate the relatedness of each pair of concepts, exactly as the students did. One
of the experts for each assessment was the teacher for each class. Two ecologists were
also asked to complete the assessment for each of the four cases. For each pair of
concepts, the experts’ scores were averaged (mean), and the referent PFnet was generated
as described in the next section. For example, if the three experts rate the relatedness of
“plant” and “animal” as 5, 5, and 7, the referent used the averaged and rounded score of
6. The rounding is necessary so that it would be possible for students to show an exact
match where appropriate.
Administering the Assessments
The assessments were printed on double-sided paper and distributed to students
during regular class time. In most cases I administered the assessments to all students
within one day of beginning or ending the DIAL experience and up to three days in two
instances. One student in Case 2 opted out of the study. Students were given as much
time as they needed to complete the assessment and ranged from 15 to 30 minutes to do
so.
Data Analysis for Q1
Due to the requirements of the Pathfinder software (KNOT), each student’s
response data were first entered into an excel spreadsheet that was programmed to
generate a matrix in text form (.txt). The excel step allowed for more accurate data entry
123
and quality control. In the text matrix form the Pathfinder software could process the
data and generate a PFnet as well as values for C, csim, and coherency (described below).
Pathfinder determines the similarity or closeness (C or sim) between two PFnets
by determining the number of links in common between the two PFnets and dividing that
figure by the total number of unique links in both PFnets, showing the proportion of links
that the two PFnets share (Goldsmith & Davenport, 1990). Pathfinder also calculates a
value showing the similarity or closeness between two PFnets that is corrected for the
similarity predicted by chance (csim), a figure that expresses the difference between
actual and random predicted values. This was the primary value used in comparing
PFnets for this study.
€
csim =links in commontotal unique links
"
# $
%
& ' ×1+ probability of links in common by chance
Csim scores were first compared from pre to post to look for change in each
student’s knowledge structures (∆C). The PFnets were also qualitatively examined as it
was possible to have a change in structure that did not necessarily make the PFnet more
similar to the expert referent but represented an important semantic difference. These
differences could then be examined through the student interviews. Descriptive statistics
were calculated on students’ pre and post C scores to determine the distribution of
content knowledge structure changes and where each individual fell within that
distribution (Z score). This also allowed for a stratified comparison through the grouping
of individuals based on their pre-existing knowledge. That is, through the pre-test, it was
possible to determine if there was a difference in learning for those whose content
knowledge structure was already close to the experts’ as compared to those who started
with a more rudimentary knowledge structure. Inferential statistical analysis on a case
124
level was not possible due to insufficient sample sizes and therefore insufficient power.
A Wilcoxon Matched Pairs test was run across the entire sample (n=65) to determine if
there was significant growth from pre to post. A-priori power was determined to be .97
(very high) with this sample size and an alpha level of .05.
Procedures- Research Question 2
In order to answer the second research question, “do students’ interactions with
the components of a DIAL environment contribute to change in their conceptual science
knowledge structures? ” the data generated in Part 1 of the study were considered in
conjunction with qualitative data in a multiple case study format. Table 3.1 shows the
data that was collected and analyzed across the four cases in the study. All cases used the
Pathfinder data (Part 1), pre/post teacher interviews, and student interviews that followed
the DIAL experience. For two of the cases student notebooks/journals were available and
used. In Case 4, the Everglades experience, I conducted a full field observation of the
DIAL experience as well. The procedures for the collection and analysis of these data are
described in this section beginning with the common elements and concluding with the
field study.
125
Table 3.1
Data Used to Inform the Multiple Case Study
Data Used
Case 1 Winter Ecology
Case 2 Winter Environmental Science
Case 3 Crane Migration
Case 4 Everglades Ecology
Teacher pre-‐DIAL interview X X X X
Teacher post-‐DIAL interview X X X X
Pathfinder pretest X X X X
Pathfinder posttest X X X X
Student post-‐DIAL interviews X X X X
Student notebooks/journals X X
DIAL field notes X
DIAL video recordings X
DIAL audio recordings X
DIAL photographs X
DIAL on-‐the-‐spot teacher interviews X
DIAL on-‐the-‐spot student interviews X
Teacher Data
Semi-structured interviews were conducted with the teacher of each class prior to
the DIAL experience. The interviews were open conversations lasting about one hour,
intended to guide the teacher in laying out his or her expectations for how they planned to
use the DIAL experience to facilitate their target content. Each interview was driven by
the goal of co-creating these final products:
• A list of science concepts to be used with the Pathfinder analysis.
• A collection of course materials.
126
• An outline of the anticipated facilitated events of the DIAL experience and
their related target concepts.
• A list of the teacher’s predictions of peripheral contexts that could influence
students.
The teacher interviews were digitally audio recorded, transcribed, and coded using
HyperRESEARCH qualitative data analysis software (http://www.researchware.com).
These data were primarily used to later categorize students' descriptions of events as
either facilitated by the teacher or peripheral to their instruction/facilitation.
Following the DIAL experience teachers were interviewed again in a semi-
structured format, and again recorded, transcribed and coded for facilitated/peripheral
events. The post-DIAL interviews followed the outline of anticipated events created in
the pre-DIAL interview to discuss additions, deletions, and deviations from the plan as
well as events that the teacher thought to be particularly valuable to learning. Teachers
were also asked about learning events for the group or individuals that they did not
anticipate. Though the teacher interview data were used predominantly to frame and
reference the student data, their perspectives on learning events did inform some aspects
of the case analyses and cross-case analysis.
Student Data
Student interviews were conducted within a few hours to a day after students took
the posttest and so they fell within a few days (usually just one day) of completing the
DIAL experience. With the exception of Case 2, all available students were interviewed
for this study. Case 2 was randomly sampled, though stratified by gender.
127
The 30-minute interviews followed a semi-structured, two-part format based on
an interview protocol (Appendix C) and the student’s pretest and posttest PFnet
knowledge maps. The interviews were audio recorded, transcribed and notes were
recorded and digitized. In the first part of the interview students were asked to discuss
any changes that occurred in their pre to post PFnets including significant changes in
individual relatedness scores and, more importantly, significant changes in the more
global structure of their concept knowledge representation. I identified the most
significant changes before the interview and a list of salient pattern changes was
generated to discuss with each student. For each of these pattern changes the following
general questions were asked, although the actual wording was altered to promote the
conversational nature of the interviews:
1. “According to your relatedness responses, the concept mapping program
organized your ideas like this before the trip and like this after the trip
(showing the PFnets to the student). If you look at the second one, you can
see how it changed here. Does that seem accurate?”
2. “Can you tell me about your present understanding of this concept or this
connection”?
3. “Why do you think that relationship/understanding changed for you? (or)
How did you learn that?”
Often, additional follow-up questions were asked to further probe a student’s
understanding or learning process. An excerpt from one interview can be found in
Appendix D. This question pattern continued for the first 15 minutes of the interview.
The second half of the interview was also used to both probe for more depth on
the answers from part one, and to ask targeted questions about the components of the
128
learning environment outlined in the conceptual framework of this study (Appendix B).
Though the conversation was allowed to go in any direction that continued to inform an
understanding of the student’s learning experience, questions were asked or adapted from
a predetermined list when the conversation stalled or when prompted by the student’s
previous answers:
• Did you have any aha! moments during the course?
• Where there any places or settings that you found particularly educational?
• Did you learn from any other students in the course?
• Did the field and classroom components work well together or did they feel
separate?
• What was (Teacher’s/Guide’s/Expert’s) role in the course?
• Did you have any personal discoveries; something you noticed or realized without
being taught?
• Were there any concepts for which it was helpful to see it, experience it, or hear
about it multiple times or in multiple settings?
• Was there any part of the course that you had/have a strong emotion associated
with, either good or bad?
• Were you nervous or scared about anything on the trip? Was it resolved?
Data Preparation, Coding and Analysis
All of the interviews were transcribed from the audio recordings and both the
original audio files and the transcriptions were uploaded and aligned using
HyperRESEARCH qualitative data analysis software (http://www.researchware.com).
This program was used for all of the transcript, video, audio, and image coding.
129
Descriptive Codes
The interview coding began with descriptive a-priori codes aligned with the
conceptual framework for the study (Figure 1.3) and was further developed as emergent
codes reflected patterns I was observing in the data. For example, the code of Social
Interactions was originally used to indicate any reference a student made to a social
interaction associated with their learning. This was later refined to include more specific
codes such as Group Discussion, Peer-to-Peer, and Guided Observation. Any of the
broader codes were later revisited and recoded with the more specific codes if
appropriate. Some codes were later condensed back to more general codes if there were
few references across the cases, such as Good Emotion. The codebook for descriptive
codes is shown in Table 3.2. All of these codes in this first level of coding were
descriptive codes rather than pattern codes or interpretive codes as they simply labeled
what the students were directly reporting (Miles & Huberman, 1994). These codes were
applied to any segment of text that fit the code’s definition with the purpose of later
defining pattern codes within specific units of analysis and clarifying aspects of those
patterns. In order to focus on a small group of codes at a time, I typically made six
passes through each transcript in the original coding process. Before any manual coding,
each transcript was auto-coded by the software through a word search feature. The auto-
codes were used exclusively to show references to the target science concepts selected for
the Pathfinder assessment. Please see Appendix D for an example of a coded transcript.
130
Table 3.2
Codebook for Qualitative Analysis: Descriptive Codes
Category Code Definition Application Level
Use / Justification
Change in Concept Knowledge (from Pathfinder)
Extreme .14 < csim
Student (entire transcript)
Provides reference to results from Part 1 of the study, the Pathfinder assessments
High .07 < csim < .14 Moderate .02 < csim < .07 Little or no -‐.02 < csim < .02 Moderately Negative
-‐.07 < csim < -‐.02
Highly Negative
csim < -‐.07
Learning Factors: Social
Interactions
Teacher said…
Teacher conveying verbal information, usually in the form of “X said…”
Phrase
All used to indicate how social factors contribute to the learning of TSCs. Reflect the social component of the conceptual framework
We talked about…
Any reference of the form “we talked about”, “we discussed”, etc.
Phrase
Group action Action that the group performed together
Phrase
Group discussion
Specific description of a facilitated, academic, participatory discussion
Phrase
Teacher Any reference to words or action of the teacher of the class
Word
Local expert Any reference to words or action of a science expert recruited to participate in the class
Word
Guided observation
Teacher or expert draw attention to some aspect of the environment and describe it or solicit student thoughts on it
Phrase to paragraph
Lecture Specific reference to lecture or description of teacher formally speaking, often with visuals
Phrase
Peer to peer Peer teaching/learning between students
Phrase
Heard generally
Something student remembers hearing but can’t remember source
Phrase
131
Table 3.2 (con’t.)
Category Code Definition Application Level Use / Justification
Learning Factors: Social Interactions
Small group Reference to any discussion or action in student groups divided from whole class
Phrase
All used to indicate how social factors contribute to the learning of TSCs. Reflect the social component of the conceptual framework
Demonstra-‐tion
Teacher/expert provide visual or kinesthetic demonstration of TSC
Phrase to paragraph
Teacher and individual
Discussion or action between just the speaking student and the teacher or expert
Phrase
Teacher said…
Teacher conveying verbal information, usually in the form of “X said…”
Phrase
We talked about…
Any reference of the form “we talked about”, “we discussed”, etc.
Phrase
Learning Factors: Physical Environ-‐ment
Field Mention or description of learning in the field
Phrase
Inform the role of the physical environment component from the conceptual framework as well as the facilitated/peripheral designation
Classroom Mention or description of learning in the classroom
Homework Mention or description of learning via independent assignments
Visual evidence of concept
Saw an example of a TSC within the environment
Phrase to paragraph
Describe the role of the physical environment component from the conceptual framework. Inform how students use the physical environment to learn TSCs
Visual of process in action
Saw a process associated with TSC take place within the environment
Illustrated relationships
Saw an example of the relationship between TSCs within the environment
Connection to specific place
Refers to s specific, geographic place as associated with learning
Embodied experience
Refers to physical interaction with environment associated with learning
Moving through environment
Refers to movement or travel through environment as associated with learning
132
Table 3.2 (con’t)
Learning Factors: Tools
Books or Readings
Reference to book or reading, assigned or otherwise Phrase
Describe the role of various tools, one component of the conceptual framework in the learning process
Board or Projections
Reference to information presented on white board, projected slides, videos, posters, etc
Phrase
Worksheet/ prepared materials
Reference to worksheets or handouts prepared by the teacher
Phrase
Notebook, journal or similar
Use of notebooks or journals
Phrase
Non-‐academic tools
Any other object described as a tool but not specifically intended to aid learning
Phrase
External educational resources
Any signs, pamphlets, books, posters etc intended to support learning but not presented by teacher
Phrase
Measuring devices
Any reference to tools used for measuring or aiding scientific observation
Phrase
Learning Factors: Individual Learning Processes
Developed deeper understanding
Specifically mentions developing a deeper, more meaningful, etc. understanding during DIAL
Phrase to concept unit
These codes emerged from the transcripts as important for the study. They account for more than internal dialog and expression’ to include students’ descriptions of their learning processes they were experiencing beyond reflection and expression. They also address an emergent element of the conceptual framework.
Linking across events
Ascribes learning TSC to multiple, connected events or conceptually connects multiple events
Phrase to concept unit
Connections to past learning
Describes a connection between learning on DIAL experience and past learning any time prior
Phrase to paragraph
Application of knowledge
describes putting TSC to use in an applied way
Phrase to paragraph
Personal discovery
Learning related to TSC through un-‐facilitated observation or realization
Phrase to paragraph
Individual reasoning
Describes a personal reasoning process that led to understanding of TSC
Phrase to paragraph
133
Table 3.2 (con’t)
Category Code Definition Application Level Use / Justification
Learning Factors: Individual Learning Processes
Internal reflection
Specific reference to thinking about or reflecting on a topic
Phrase to paragraph
See above cell Writing Mention of writing as processing of TSC
Phrase to paragraph
Verbal articulation
Process of articulating an idea to another person
Phrase to paragraph
Individual Learning Factors:
Motivational and
Emotional
Anticipation or need-‐to-‐know
Describe motivation to learn TSC due to anticipated future need
Phrase to paragraph
Describe the role of the emotional and motivational environment as related to the learning of TSCs and as described in the conceptual framework. Also Indicate the student’s more internalized emotional emotional reactions to the process of learning the TSCs
Curious/ Interesting
Expressed interest or curiosity in some aspect of the TSCs or learning environment
Phrase
Engaged Described engagement with learning/TSC
Phrase to paragraph
Challenged Expressed physical, emotional, academic challenge in some way
Pride in completion, overcoming obstacles, accomplishment Phrase to
paragraph
Amazement, Fascination
Expressed amazement or fascination associated with TSC
Phrase to paragraph
Surprise Expressed surprise or astonishment at an idea/event
Phrase
Bad Emotion Otherwise uncategorized negative emotion (anger, frustration, etc)
Phrase
Nervous/ scared
Expressed fear or nervousness regarding some aspect of experience
Phrase to paragraph
Confused Described confusion or lack of clarity on TSC related idea
Phrase
134
Table 3.2 (con’t)
Category Code Definition Application Level
Use / Justification
Concepts
Autocodes (n=75)
Individual codes for each of the target science concepts (TSCs) in the Pathfinder assessments
Word or phrase
Automatically assigned to searched keywords. Helped define concept units and assess most important concepts
Related science
Student refers to a related science concept not listed in Target Concepts
Phrase Accounts for related science learning not addressed on Pathfinder assessment
Related non-‐science
Student refers to a non-‐science but related academic concept
Phrase Accounts for other learning conceptually but not scientifically related to TSCs
Distal science Student refers to a science concept that is not directly related to course curriculum
Phrase Accounts for other science learning unrelated to TSCs
Misconception or naïve conception
Student expresses a view of a science concept that is counter to canonical knowledge
Phrase + Shows error in or incomplete learning process
Environmental components/ learning factors descriptive codes. The codes
associated with the components of the learning environment were the most heavily used
and important to the later pattern coding and inferences made in the cross-case analysis.
As such, they are described in more depth here. A code category was created for each of
the environmental components of the conceptual framework (Appendix B): social
interactions, physical environment, internal dialog and expression, tools, emotional
environment, and cultural environment (Table 3.2). In the process of early analysis and
assigning descriptive codes, it became clear that these environmental components were
better defined as learning factors as they were internal to the learner as well as external
135
environmental contributors to learning and so they are listed in the descriptive codebook
(Table 3.2) as “Learning Factors”.
Codes within each of these categories were created as trends emerged in the way
students discussed their learning. For example, within the code category of the physical
environment many students discussed seeing visual evidence of a target concept within
the environment and this became a code. As more students mentioned this, it became
clear that there was an important distinction between seeing a static visual reference and
observing a process that was occurring, or being able to detect a relationship between
TSCs within the physical environment, and so these became independent codes. When
more specific codes emerged in this way, I would revisit text formerly coded as visual
evidence to see if it also fit the more specific codes, recoding as needed.
In the case of the code category internal dialog and expression it became clear
that the group also needed to include more elaborate but internalized learning processes
that the students were describing. This addition is described in Chapter Five.
Conversely, the category of the Cultural Environment resulted in almost no references in
the interviews and this will also be discussed later. The categories of Academic Tools
and Non-academic Tools were combined into a single group due to the difficulty of
reliably making the distinction between the two in the coding process.
Pattern Codes
Once the descriptive codes were assigned to a transcript, I assigned pattern codes
to indicate the thematic elements relevant to the research question (contributors to change
in knowledge structures). The descriptive codes were used in conjuction with broader
patterns within each unit of analysis to determine the application of the more inferential
136
pattern codes. These pattern codes are shown in Table 3.3. The first step was delineating
concept units or sections of the transcript that tracked a student’s discussion of a target
science concept (TSC) or relationship between TSCs and the student’s description of how
they learned about the concepts. At times these were brief sections of one question and
one answer and at other times they were extended discussions and dialog. These concept
units served as an embedded unit of analysis that allowed me to individually track the
learning process for any given concept for each student. An example of one of the
shorter concept units is shown in Figure 3.4 and a more extensive example is shown in
Appendix D.
Table 3.3
Codebook for Qualitative Analysis: Pattern Codes
Category Code Definition Application Level
Use / Justification
Concept Unit: Unit of Analysis
Section of transcript that follows student’s discussion of a concept or relationship between concepts, and associated learning process.
variable-‐ 1+ ¶s. Can overlap speakers
Embedded unit of analysis to track student’s description of a TSC or relationship between TSCs
Learning Opportun-‐
ities
Facilitated Refers to learning process that teacher specifically provided for, either through planning or spontaneously
Concept Unit
Describe fundamental distinction in conceptual framework between facilitated and peripheral learning opportunities of the learning environment. Determined based on analysis of descriptive codes within concept unit.
Peripheral Refers to learning process that teacher did not anticipate or specifically facilitate but still addressed TSCs
Facilitated/ peripheral interaction
Refers to learning process in which both played a specific role
137
Table 3.3 (con’t)
Category Code Definition Application
Level Use / Justification
Context-‐ualization Scores
X-‐CS No TSC is mentioned in concept unit
Concept Unit
Relates to the “context vehicle” in the conceptual framework. Describes how much student relates learning and knowledge to real, experienced contexts or isolates them as abstract ideas. Determined based on analysis of descriptive codes within concept unit.
0-‐CS TSC is mentioned or discussed with no reference to context
1-‐CS TSC is mentioned or discussed but is incorrect in some way
2-‐CS TSC is mentioned in relation to unelaborated, generalized context
3-‐CS TSC is described in relation to generalized context or secondary source context
4-‐CS TSC is mentioned in conjunction with direct, personal experience in/with the context
5-‐CS TSC is described in conjunction with direct, personal experience in/with the context
6-‐CS Direct, personal experience is in/with the context is explicitly credited with elaborated TSC
Figure 3.4 shows a screen shot from the coding window of the HyperRESEARCH
qualitative data analysis software I used to code interview transcripts. The codes are
displayed on the left side of the screen and can be highlighted or hidden as needed within
the program, showing which codes overlap each other and fall into each concept unit.
This example shows the concept unit highlighted and displayed with the embedded
pattern and descriptive codes for that excerpt.
138
Learning opportunities. Learning Opportunities and Contextualization Scores
were the two pattern code categories. The learning opportunities codes (Table 3.3) were
used as an overall characterization indicating how the students described they had learned
a given TSC or relationship between concepts: Facilitated, Peripheral, or Both. This
code group indicated whether the student had described learning opportunities that were
entirely facilitated by their teacher, that they had encountered on their own without the
specific facilitation by the teacher, or some combination of these opportunities. At times
these judgments were made with other data outside of the concept unit being considered.
For example, a student may have described the same event multiple times in the
interview and provided information beyond the given concept unit. To preserve the
Figure 3.4. Screen shot of a coded transcript excerpt using HyperRESEARCH qualitative data analysis software. Highlighted text indicates one concept unit, the unit of analysis.
139
perspective of each informant, data external to the interviewee were not considered for
these judgments.
Contextualization. The contextualization score codes were used to judge the
degree to which students were relating their understanding of a given concept unit to their
real-world experience. These scores were adapted from Rivet & Krajcik (2008) who
present a rubric, designed for use with Project-Based Learning applications, that allows
the researcher to analyze a learning event and determine a relative measure of how a
student relates target knowledge to their environmental contexts. The process focuses on
how a student refers to anchoring events from the learning context, the relationships the
student detects between target concepts and contextual events, and the student’s own
contextual experience outside of class. For example, a student might explain inertia by
referring to a class lab or to an experience he had falling off of his bike (Rivet & Krajcik,
2008). Their scoring system includes a scale of 0 to 5 that simultaneously measures
student participation (e.g., speaking up in class or in a group discussion), level of
expressed understanding, and contextualization. A 0 indicates no student participation
and therefore no way to measure contextualization, while the rarely scored 5 (in the Rivet
and Krajcik study, 2008) indicates a detailed explanation of the science content in
conjunction with a clear example of the concept that is related to the learning context.
For the present study, a modified version of the Rivet and Krajcik (2008)
contextualization scale was used that expands the range by one level and removes the
participation aspect. This latter adjustment was possible because the scale was used on
student recollections of their own experiences and student work and so participation is
implied but not possible to differentiate. This revised contextualization scoring scale is
presented in the pattern codebook, Table 3.3.
140
Student Notebooks
Student notebooks/journals were available for Cases 1 and 3 and varied in their
extent of use. The teacher in Case 1 required a complete notebook from each student as a
final assessment piece and so they were generally complete, well-developed, and
provided an accurate view of the work generated by the students throughout the class.
Case 3 was more variable in the quality and extent of the work. Each notebook was
scanned into digital image files, entered into the HyperRESEARCH database/program
and coded with the same scheme as used for the interviews (Tables 3.2 and 3.3).
PFnets
The results of each student’s Pathfinder assessment was coded as a categorical
level of change from pretest to posttest, and assigned to a student’s entire transcript. The
categories ranged from highly negative change to exceptional learning (Table 3.2).
Although no formal scale exists with which to correlate Pathfinder similarity values (C,
or csim) to level of mastery or learning, Acton et al. (1994) found that the experts in their
study of Pathfinder referents tended to show C values of .30 between experts. In the
present study, between-expert values were closer to .35. In another study, college
undergraduates ranged from an average similarity (C) with their instructor of .24 at the
first week of class to .32 by the 15th week, a change of .08 C (Goldsmith & Johnson,
1990). Though future work is needed in this area to further explore valid levels of
mastery and learning, these existing studies provided some guidance on creating the scale
presented here, though note that the csim values used in this study are an average of 50%
less than the raw C values. Based on these numbers, a ∆ csim value of about .04 should
be average and this was indeed the case for the values found in this study (mean = .046).
141
Using the standard deviation of this sample (.079) as a loose guide, a classification of
∆ csim-based learning levels was developed and is presented in Table 3.2. This allowed
for analysis by degree of learning as a variable. In addition the images for each student’s
Pre and Post PFnet were entered into the HyperRESEARCH program along with the
referent for each class, to be used for analysis of the nature as well as the degree of
change for each student.
Field Study
In addition to the assessment and interview processes, I also conducted a full field
study of Case 4, the Everglades group. There were three goals behind this additional
layer of data collection: (a) to triangulate by adding an outsider’s perspective of the DIAL
experience to the insider’s perspective gained through the interviews, (b) to capture in-
the-moment experience, lost after time and reflection, and the details of the experience
that are not easy to capture through interview, and (c) to test the validity claims of the
interview process by triangulating those data with the data collected through field study.
To conduct the field study I traveled with the teacher and eight students of the
Everglades group throughout their eight-day DIAL experience. I met the group at their
school, flew with them to Florida, traveled with them in the field and camped with them
at night. The group knew my purposes as a researcher but did not know the specific
research questions I was asking, nor which behaviors and interactions I was observing
most closely. My role in the educational aspects of the experience was non-participatory
in the sense that I did not do any instruction, answer science questions, or plan any aspect
of the experience. However, I did participate in camp chores and other “expedition
behavior” as well as being a social member of the group rather than an entirely separated
142
observer. Another important difference between the approach I used with this field study
and participant observation was that I was not tuned in to my own experience of the
events, nor recording them, rather I was trying to record the experience of the students;
albeit through my own interpretations, along with their in-the-moment observations that
they shared with me (e.g. Stake, 2010).
The observations and recordings that I made were all focused on evidence of
learning and the roles of the environmental components outlined in the conceptual
framework. The observations and recordings were made on a number of levels. An
attempt was made to video or audio record lessons, discussions, demonstrations, and
group activities when possible. Extensive field notes were made in both descriptive and
interpretive forms (Anderson-Levitt, 2006). The descriptive notes captured my
perspective on actions, relationships, conversations, settings, and on-the-spot interviews
(often one or two questions) as well as time and place stamps. Interpretive notes
involved preliminary analysis of trends and patterns I was beginning to see in the nature
of the learning process within the contextualized environment.
During the majority of the trip the group was traveling by canoe and would
become spread out, gathering periodically for mini lessons, breaks, or discussions. The
teacher and guide were paddling the same canoe. I traveled by kayak in order to paddle
along with different sets of students, write field notes in a waterproof notebook, catch up
to the group, and so on. During the mini lessons I tried to video or audio record as much
as possible in addition to writing field notes on the events. I did not interrupt students or
teachers during learning events but would record audio, photo, and video evidence;
practices that the group quickly became comfortable with. I would often follow-up with
them shortly afterward, asking about those recent experiences. An effort was made to
143
also engage students in casual conversation in order to diffuse the sense that they were
being scrutinized. At times students would offer their unsolicited reflections or thoughts
on an idea or an event, or they would have conversations with each other about the
content or events. On land, the process was similar though I used a notebook and pen
that simultaneously recorded a digital as well as a physical copy of the notes
(www.livescribe.com).
Each night, I transcribed all of my notes onto a laptop computer, completing
thoughts and adding interpretative and analytical comments while the experiences were
still fresh. This process was useful for early analysis, creating an audit trail, and guiding
the next steps of data collection during the DIAL experience (Esterberg, 2002).
Throughout the experience all of the students, the teacher, and the guide became
informants for the study. However, four students were asked to participate more heavily
in order to ensure more complete and consistent perspectives from a subsample. These
students were chosen through purposive sampling, representing the two girls on the trip
(11th and 12th grade), a high performing 11th grade boy (based on the pretest), and a low
performing 9th grade boy. Having these focus students helped me to choose which
groups to track when they were spread out and provided a structure/reminder to make
sure I spoke with them about their experience at least twice per day, even if briefly. In
addition I conducted at least one, sometimes two, more formal interviews during the trip,
asking about specific learning events and students’ individual learning experiences.
Conversations with the teacher and guide throughout the trip helped to delineate aspects
of the day that were facilitated and those that were peripheral.
144
Following the field study all of the digitized notes, videos, photos, and audio were
added to the HyperRESEARCH database to be coded and analyzed with the other data.
The mid-trip formal interviews with the focus students were transcribed.
Analysis
This study was driven heavily by the research questions and the conceptual
framework. As such, the qualitative analysis was best addressed through an overall
approach of pattern matching logic (Yin, 2009), or the similar prestructured case
analysis (Miles & Huberman, 1994). Through this process, the data and patterns within
the data are compared to expected outcomes, relationships or a conceptual framework.
Similarities, differences, and unanticipated phenomena are explored (Miles & Huberman,
1994; Yin, 2009).
Analysis proceeded by asking a series of iterative, analytical questions that were
based on the conceptual framework and contributed to answering the second research
question, “do students’ interactions with the components of a DIAL environment
contribute to change in their conceptual science knowledge structures? ” Using selective
sorting of the assigned codes within HyperRESEARCH, various data displays illustrated
the data germane to these analytical questions at multiple levels. These data patterns and
trends were saved and displayed in matrices for further analysis. As potential answers to
the analytical questions emerged, they were recorded along with the evidence from each
data source and then checked for consistency or important differences across the
individual informants and the four cases.
To illustrate this process, we can look at one example. If we start with the very
broad question of “how did students use the physical environment in their learning?” I
145
first looked at code frequencies and displayed the frequencies of the physical
environment code group as a percentage of all of the environmental component codes, by
case, by individual students, by Pathfinder results, by facilitated or peripheral
opportunities, or by any combination of variables. I would also look at the sub-codes
within the physical environment code group to tease out which aspects of the
environment were most heavily referenced.
Looking at code frequencies across or within cases was a first step but it was not
assumed to be equated with importance. Rather, the code frequencies indicated places to
begin analyzing the relationships between learning and the components of the learning
environment. The relative importance of the data was also determined by how the
students discussed the learning within a concept unit, the importance that the informants
assigned to a given learning event, their measured learning (Pathfinder), and the way in
which their connections between the TSCs and the learning factors suggested deep
understanding.
Once some direction was established through code frequencies, I would ask more
specific questions and use the QDA software to display various groupings of text based
on the code references. For example, if the code frequencies indicated that seeing visual
evidence was often described as a way that students learned through the physical
environment, I could ask more specific questions such as “was the visual evidence
usually facilitated or peripheral?”, “did the evidence confirm learning or initiate it?”,
“Was this an important factor across all cases or just one or two?”, “how did students
describe how this contributed to their understanding?” and so on, calling up custom
displays to highlight each of those questions. Because the displays include hyperlinks
back to the original text sources, it was possible to quickly toggle back and forth between
146
the summary displays and the context of the students’ more complete thoughts,
developing a better connection between patterns and context.
Based on the co-occurring codes and the way that students talked about the topics,
patterns were identified, described and tested within and across cases by looking for
confirming and disconfirming examples. As these supporting sub-questions were
answered, additional questions developed and were pursued through the same technique.
This process continued until saturation was reached and no further patterns emerged. The
results of each query were recorded in a series of matrices for big picture, cross-case
analysis.
Field study data analysis
There is little or no separation between data collection and data analysis with a
field study approach (Anderson-Levitt, 2006). Data is constantly analyzed in the head of
the researcher and within the pages of the field notes. That being said, further analysis
continued beyond the event and was conducted using the HyperRESEARCH program.
For consistency, fidelity to the research question, and smoother cross-case analysis, the
same coding and questioning scheme was used on the field study data as it was for the
interview data. The text associated with those code references tended to be richer than
what was possible to elicit from the half hour interviews.
Synthesis
The final level of analysis for this study was a cross-case analysis using the
method of pattern-matching logic by examining the data as compared to the predicted
pattern (Yin, 2009), in this case the conceptual framework (Appendix B). Cross-case
147
analysis highlights patterns and differences amongst the cases studied, allowing for
triangulation of the data (Yin, 2009). Patterns that agree with, conflict with, and expand
beyond the conceptual framework were identified. As shown in Figure 3.1, there are
three clusters of data that informed the cross-case analysis: (a) the case analyses for each
class experience that are, in turn, generated from the PFnets, contextualization scores,
student work samples, and interview data; (b) the rich descriptions from the field study of
the focus class DIAL experience; and (c) the statistical analysis of the student knowledge
development (∆C) across the four cases. In addition to the previously described data
displays produced through HyperRESEARCH, a content analytic summary table (Miles
& Huberman, 1994) was used to help facilitate the data analysis. This type of table
displays data in a meta-matrix by highlighting characteristics of two variables that have
some commonality across multiple cases (Miles & Huberman, 1994).
At times, variables were substructed as described by Miles and Huberman (1994).
Through this process, two of the analytical questions described earlier were placed
opposite each other on a matrix, along with potential answers. Cases that met the
resulting criteria within the matrix were listed within appropriate cells. The purpose of
this process is to help clarify an overly general variable (Miles & Huberman, 1994).
The final level of analysis and the transition to interpretation was facilitated
largely through the process of writing the descriptive multiple case report (Wolcott,
2009). Interpretive notes were maintained as comments within the evolving text and
were later collected and synthesized for more global interpretation.
148
Data Handling and Protection of Informants
The anonymity of all informants was maintained throughout the study.
Pseudonyms were used for all students within field notes and computer files. A hardcopy
of the key is stored in a secure location. Class level PFnet data was provided to the
teacher of each class for the purpose of generalized formative assessment but the data
were aggregated across the class, removing any personal identifiers of the students.
All participating students signed a document of assent (Appendix E) and were
provided with both verbal and written briefings on the project. Parents of the students
and teachers also signed consent forms (Appendix E) that included a description of the
project and how the data were to be used. It was made clear to all participants and
guardians that any participant could choose to not participate in the study or withdraw
without any academic or other penalty. All participants were given pseudonyms that are
used in this dissertation and any other communication regarding the study. The protocol
for this project was subjected to review by the University of Colorado Denver’s Human
Subjects Internal Review Board. The approved version of the protocol was followed
throughout this study (Appendix F, approval letter). All of the data for the project were
digitized and organized using the HyperRESEARCH database. All of these files and the
database itself are backed up to an external hard drive and to a disaggregated cloud site.
Validity / Legitimation
Assessing what is called validity in quantitative research, trustworthiness in
qualitative research (Morrow, 2005), and legitimation in mixed-methods research
(Onwuegbuzie & Johnson, 2006) becomes difficult when the use of both quantitative and
qualitative data are part of a study. Although the goals are similar, these constructs are
149
not the same things and do not measure exactly the same things. Onwuegbuzie &
Johnson (2006) describe these goals as assessing the ability to make inferences that are
credible, trustworthy, dependable, transferable, and/or confirmable. Because each of
these research traditions also has its own vocabulary to address these constructs, an
additional tension is added to the problem of communicating them.
The validity framework offered by Yin (2009) and specific to case study research,
helps alleviate some of that tension as the vocabulary should be recognizable to most
researchers and the categories are defined broadly enough to encompass both quantitative
and qualitative data. Yin’s framework was used in this study to assess validity. An
important idea within this framework is in considering each case to be akin to a single
experiment rather than a single subject or sample. In this multiple-case study, we can see
the cases as four replications testing a theory rather than a sample size of four. Within
each of those cases there are embedded units of analysis comparable to multiple subjects
in an experimental design.
Construct Validity
A number of factors were used to establish strong operational measures for the
constructs being explored in this study. First, the measures, including the Pathfinder
assessments, interview protocols and observational focus were tied very closely to the
theory upon which they were built, linked through the conceptual framework. Second,
multiple sources of evidence including student and teacher interviews from four distinct
cases, student notebooks, field observations, and a pre/post test were used to converge on
and establish chains of evidence that support the developed constructs, what Patton
(2002) refers to as “data triangulation”. Four cases, each comprising numerous
150
informants, provided perspectives through multiple means. One case added an outsider
perspective through the field study.
“Methodological triangulation” (Patton, 2002)also added to the construct validity
of the study through the utilization of both qualitative and quantitative methodologies
where appropriate. An established construct of knowledge was assessed through the
quantitative measure of knowledge structures before and after the experiences. This
provided a more objective framework on which to base the qualitative inquiry within the
study.
Some member checking (Stake, 2010) added to the construct validity as students
were able to confirm or disconfirm that their PFnets accurately represented their states of
knowledge before and after the DIAL experience. In one case, students did not feel that
they did, which allowed me to identify and correct a problem with the generation of the
PFnets for their class and prior to the interviews. Member checking of the constructs
produced through the qualitative leg of the project would have strengthened the study but
were not logistically possible as most students were no longer associated with the classes
or schools following the analysis of the data.
Internal Validity
Although this study was non-experimental and not intended to make causal
inferences, a number of structures were in place to increase internal validity of the
relational inferences that were made, as described by Yin (2009). Again, the cross-case
analysis relied heavily on the convergence of evidence across cases and from multiple
sources/types of sources. In addition, the inferences were drawn predominantly from the
informants’ actual descriptions of their experiences rather than interpretations of their
151
words. The patterns in the qualitative data presented in Chapter 5 are supported heavily
by the direct quotes of the informants. While I cannot claim that there are no rival
explanations for the inferences made, much consideration was given to considering and
ruling out rival explanations in the data analysis process, predominantly in the cross-case
analysis phase, as presented in Chapter 6. All inferences were based on patterns across
the cases rather than single instances.
External Validity
In the statistical measure used (Wilcoxon matched pairs test for Pathfinder data)
the assumptions of the test were met, the sample size was sufficient for appropriate
power, and the results were significant.
The case study approach relies on “analytical generalization” rather than
statistical generalization (Yin, 2009) and thus, external validity relies on the ability of the
data to consistently support the theory upon which the study is built rather than on
statistical significance. The greater the number of cases (equated to experiments) that
support the theory, the greater the external validity (Yin, 2009). This study used four
cases with embedded units of analysis for that purpose. The study’s results delineate
which aspects of the theory were supported across multiple cases and which were not. As
explained in Chapter One, we need to be cautious about comparing learning experiences
across only loosely similar learning environments and pedagogies. The external validity
of the inferences made in this research becomes increasingly limited as applied to more
dissimilar cases. It would be inappropriate to apply the results reported here to science
education, or experiential education, or informal education, or outdoor learning writ
large.
152
Reliability
While a case study can never truly be replicated (Yin, 2009), measures can be
taken to maximize the ability of others to review the work. To this end, the data for this
study are centrally stored in a database with easy and replicable access via the qualitative
data analysis software HyperRESEARCH. In addition, the protocols used for interviews
and field observations are shared in Appendix C .
To further enhance the reliability of the work, the process of researcher debriefing
(Onwuegbuzie, Leech, & Collins, 2008) was used following the field study in order to
help interpret the results and examine issues of reflexivity, bias, and legitimation. In this
process, the researcher is interviewed by a knowledgeable party who asks the researcher
questions,
that pertain directly to bias including those that tap the researcher’s interview
background and experience; perceptions of the participant(s); perceptions of
nonverbal communication; interpretations of interview findings; perceptions of
how the study might have affected the researcher; perceptions of how the
researcher may have affected the participant(s); awareness of ethical or political
issues that might have arisen before, during, or after the interview(s); and
identification of unexpected issues or dilemmas that emerged during the
interview(s). (Onwuegbuzie, et al., 2008, p. 6)
The debriefing was conducted with Dr. Deanna Sands of the University of
Colorado and was audio recorded. The data from this debriefing session helped to guide
further analysis and was used as a filter to reconsider early analysis that I had conducted.
153
Researcher Bias and Reflexivity
Though an attempt has been made to reduce researcher bias in this study there are
still some elements that must be acknowledged. First, I have been working in
experiential science education and using DIAL for the majority of my career in
education. As such I am committed to its success and this could have the potential to bias
the results. Recognizing this, the study is not aimed at defending or challenging the
practices but at better understanding the machinations of them. This bias has also been
reduced through much of the research design. The quantitative measures used to
determine knowledge development remove some of the potential for bias. For the
qualitative portions of the study, a heavy reliance on direct quotes and insider
perspectives was used to balance my own perceptions and interpretations.
It should be noted that Case 3 took place through a school where I was formerly
employed. As such, I knew the teachers and some of the students who attend, but I did
not know any of the students who took the class I studied.
The field study aspect of the research was probably both benefitted and
compromised by my past experience with DIAL. Having led many such experiences, I
had a better sense of what key events and interactions to look for and was able to both
anticipate and understand student actions from a perspective of past experience. Of
course, this could have also been a detriment as it may have limited an openness to
interpreting the events. One mechanism for evaluating and minimizing bias in the field
study was the process of researcher debrief described above.
It is likely that the Pathfinder assessments, my presence during the Case 4 DIAL
experience, and the nature of being studied changed the experience for students and
154
teachers somewhat. A couple of the students specifically mentioned being more keyed in
to thinking about some of the TSCs after taking the pretest. When they did hear them,
they paid more attention. While this may have affected the results slightly, it is unlikely
that this had a big impact and all of the TSCs were ideas that the teacher had intended to
teach before knowing about the study. Because the combination of the Pathfinder
assessment and the follow-up interviews tended to elicit understanding much deeper than
awareness of an idea, again this problem was mitigated. My presence on the trip did not
seem to have a big impact on learning either. The teacher, guide, and students all acted
very naturally around me and did not seem to be trying to prove their teaching or learning
prowess. Still, we must assume there was some effect.
Chapter Summary
In this chapter I described the design and implementation of the study, outlining
the sequential, mixed-methods case study design. The methods behind three key aspects
of the study were described: an assessment of student learning via Pathfinder Network
Analysis, a student interview process to explore the contributors to that learning, and a
field study investigation of one of the cases. The collection of supporting data was also
described. The multiple levels of analysis were explained, including the statistical
analysis of the pathfinder data, pattern-matching analysis of the qualitative data, and
cross-case analysis that encompassed all of the data from all of the cases. Finally
validity, bias and reflexivity were addressed.
155
Chapter IV
Pathfinder Results
Overview
The findings for Research Question 1, “do students’ knowledge structures reflect
greater understanding of science concepts following a DIAL experience?” are presented
in this chapter. In other words, was there evidence to suggest that the students in the
study learned as a result of their DIAL experiences? Descriptive data of the Pathfinder
assessment results across all four cases are first presented along with a statistical analysis
of these data. Some analyses of the emergent patterns are then presented.
Pathfinder Results
The results for the Pathfinder assessments, measured as the similarity to the
expert referent and corrected for chance (csim), were recorded for each student’s pretest
and posttest. The distribution of the sample was somewhat positively skewed. To
address this, the pretest/posttest pairs were compared using the Wilcoxon Matched Pairs
Test. The test indicated a significant difference between pretest and posttest (Z = 4.24, p
< .001) across the full sample. This shows that students’ content knowledge structures
did become more like the experts’ over the course of the DIAL experiences, and therefore
it suggests that the students developed a deeper understanding of the concepts . Though
the test was also run for the four cases individually, the small sample sizes of Cases 1, 3,
and 4 lacked the power for a robust comparison. Like the full sample, Case 2 showed a
156
significant positive difference from pretest to posttest (Z = 4.24, p < .001). These data
are presented in Table 4.1.
Table 4.1
Wilcoxon Matched Pairs Test: Results of Pre to Post Assessments
Some student test data were excluded from the statistical analysis. There is
always a danger that students will randomly rather than purposively complete the tests.
159
The Pathfinder software provides a measure of Coherence that indicates the consistency
of the data by considering the network level of relatedness scores (Goldsmith &
Davenport, 1990). For example, if A is very closely related to B and B is closely related
to C, we would usually expect A to have some relationship with C, although this is not
always the case. If random values are used, we would see very low coherence, usually
below .2 (Goldsmith & Davenport, 1990). For this reason, any student score pair with a
posttest coherence value below .2 but a pretest that was greater than .2 was excluded
from these data. This resulted in the exclusion of one student from Case 1, two from
Case 2, two from Case 3, and three from Case 4.
Distributions of Student Learning
Figures 4.1, 4.2, 4.3, and 4.4 show the pretest-to-posttest change in csim for
individual students in each of the four cases. Individual students are shown on the Y axis
(e.g. “S104”) and the csim values for both their pretest and posttest are shown on the X
axis. For each student and within each case we can see the level of learning from pretest
to posttest. For example, Student 101 started the class with a very low similarity to the
expert referent and this did not change by the end of the course while Student 103 also
started out very low but exceeded all other students by the end of the class. As measured
by this assessment and the Pathfinder algorithm we can assume that learning was greatest
for student 103 in this case. The patterns of learning in Cases 1 (Figure 4.1) and 4
(Figure 4.4) were what one would hope to see: low levels of target knowledge before the
experience and moderate to high levels afterward.
160
0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4
S108
S101
S103
S102
S106
S107
S105
csim
Individual Students
Case 1 Students' Change in Knowledge Structures
CSIM Pre
CSIM Post
Figure 4.1. Case 1, Winter Ecology 5 week course, individual students’ pretest and posttest values for similarity to the expert referent, corrected for chance (csim).
161
Figure 4.2. Case 2, 2.5 week portion of residential course in Winter Env. Sci., individual students’ pretest and posttest values for similarity to the expert referent, corrected for chance (csim).
162
Figure 4.3. Case 3, 3-‐day immersion to study crane migration, individual students’ pretest and posttest values for similarity to the expert referent, corrected for chance (csim). S308’s pretest csim value was 0.
163
Negative Change
Case 2 (Figure 4.2) also shows some interesting patterns. Like Case 3 (Figure
4.3) there are examples of students who seem to regress, in that their PFnets are more
similar to the referent before the DIAL experience than after it. In most of these cases we
see students who already seem to have a solid understanding of the material who then
show big changes to their knowledge structures following the experience. Student 224 is
an extreme case of this, starting with a csim value of .36 and ending with a csim of .11. A
Figure 4.4. Case 4, 8-‐day immersion to study Everglades ecology, individual students’ pretest and posttest values for similarity to the expert referent, corrected for chance (csim).
164
look at Student 224’s PFnets (Figures 4.5, 4.6, and 4.7) helps us understand this pattern.
In Figure 4.5, the student’s pretest PFnet, we see patterns that do match pretty well with
those in the expert referent (Figure 4.6). In both cases energy, snow, plant, and
seasonality are central, highly inter-related ideas, indicating that they are important and
unifying ideas within the topic of winter ecology. In contrast, the concepts orographic
precipitation, conifer, and community are less important on the referent and on Student
224’s pretest.
Figure 4.5. Pathfinder network graph showing relative relatedness of concepts as judged by student 224 before the DIAL experience
PFnet of student 224’s Pretest.
165
What we see when we move to the student’s posttest PFnet (Figure 4.7) is that
some of these have shifted. Some TSCs such as energy and snow remain central.
However seasonality and plant, for example, move to the periphery while orographic
precipitation and community both become more interrelated to the other concepts. While
PFnet of Case 2 Referent
Figure 4.6. Pathfinder network graph showing relative relatedness of concepts as judged and averaged by three expert ecologists
166
these two concepts are not as important as other ideas for an understanding of winter
ecology writ large, they were topics that were important and heavily covered in the
course during the time between tests (as indicated by lesson plans and teacher
interviews). Seasonality and plants are important to an expert level understanding of
winter ecology but they were not well covered in this segment of the course.
PFnet of Student 224’s Posttest
Figure 4.7. Pathfinder network graph showing relative relatedness of concepts as judged by student 224 after the DIAL experience
167
What can be seen for these students who are decreasing in their levels of
knowledge is that they seem to be shifting their focus from a fairly well-developed
understanding of the overall topic, learning more, and then apparently assigning an undue
importance to a few of the new ideas. It is not clear if the students are reacting to the
novelty in the short term or if these will become lasting knowledge structures. The
pattern was true for all of the students in this study who started out relatively close to the
referent on the pretest, and then were less so on the posttest. There were two students in
Case 2 who started out low and moved lower but these students did not seem to have the
same shift in focus to newly introduced ideas and their interview data confirmed that they
did not have a command of the content.
Growth in the Middle
The larger sample size of Case 2 allows us to examine patterns that cannot be
detected in the other cases. One such pattern is that students in the middle two thirds of
the distribution of pretest scores tend to show more change in knowledge structures than
do the students who scored well on the pretest or those who scored low on the pretest
(Figure 4.2). As discussed in the previous section, some of the top performing students
decreased substantially while others only changed by small amounts. Because these top
tier scores are very close to what we would expect for between-expert PFnet similarity, a
ceiling effect is possible. Another possibility is that the material these students were
exposed to in the course was all review for them. There would be little change if they did
not have an opportunity to learn new information or understand new relationships
amongst the concepts.
168
Students at the low end of the pretest csim range also tended to show less
dramatic change than those in the middle (Figure 4.2). If they started low they tended to
stay low, or as mentioned, move even lower. Again, it's not clear why this is but it could
be due to ability levels or it could be related to a threshold of required background
knowledge that these students did not have at the outset of the course and did not make
up along the way.
For those students in the middle of the pretest distribution, who accounted for
most of the growth across the case, we see again what might be a ceiling effect. Despite
what they scored on the pretest, students in the middle and upper ranges all seemed to
score within a fairly narrow range around the average of .15 csim on the posttest (Figure
4.2). This could be the limits of sensitivity of the assessment, a ceiling effect, or an
indicator of the limits to the learning opportunities the students in the class had.
Patterns in the Other Cases
When one looks at the other three cases: 1, 3, and 4, we do not see the patterns of
negative change in csim at the top of the pretest distribution, the most change in the
middle, and very little change at the bottom. Rather, Cases 1 and 4 showed positive
change for all students and fairly even distribution across the groups. If anything, the
Case 1 data suggest that learning was greater for students at the bottom as they caught up
with those students who started ahead. In Case 4 all students started out with low csim
scores and ended up much higher, showing the greatest and most consistent gains of the
four cases. Recall though that some students were dropped from the analysis for lack of
coherence in their posttest scores and these scores would have been less positive.
169
Chapter Summary
The results presented in this chapter address the question: “Do students’
knowledge structures reflect greater understanding of science concepts following a DIAL
experience?” A Wilcoxon Matched Pairs Test of the Pretest and Posttest Pathfinder
assessments suggest that students’ knowledge structures of targeted science content did
change significantly over the course of their DIAL experiences. Descriptive statistics
suggest that positive learning occurred in three of the four cases. Some patterns
identified in the data suggest that the Pathfinder assessments may have a ceiling on their
sensitivity. Qualitative analysis of the PFnets helps to illuminate patterns in the data that
were not apparent in the statistical analysis. There also may be differences in patterns of
learning across cases. These are examined further in Chapter Five.
170
CHAPTER V
RESULTS, CONTRIBUTORS TO LEARNING
Overview
The results presented in this chapter address the second research question of this
study: If (students’ knowledge structures reflect greater conceptual understanding), do
students’ interactions with the components of a DIAL environment contribute to change
in their conceptual science knowledge structures? ” The conceptual framework outlined
in Chapter One (Appendix B) presents a theoretical answer to this question, suggesting
six environmental components that might contribute to learning: the social environment,
the physical environment, the cultural environment, tools, the emotional environment,
and internal dialog and expression. Based on the conceptual framework (Appendix B) all
of these components have the potential to influence learning through either facilitated or
peripheral means. Qualitative data from a number of sources, predominantly student
interviews, were analyzed through pattern matching logic to determine if they aligned
with the conceptual framework. Thus, the chapter is organized according to the
conceptual framework but diverges according to the patterns that emerged from the data
and deviated from the conceptual framework. Data on the role of learning opportunities
(facilitated, peripheral) are first presented followed by data explaining the role of the
various environmental components to student learning in these four cases.
In this chapter an attempt is made to present the data as authentically as possible,
resulting in extensive use of the direct language of participants. Quotes presented are
from student interviews unless otherwise indicated. In those interviews students
171
described either their understanding of a given topic or they described the learning
process that led to that understanding. Again all of the names have been changed to
pseudonyms for this report.
Learning opportunities
The fundamental dimension of the conceptual framework guiding this study is the
distinction between learning opportunities in DIAL that are facilitated by the teacher and
those learning opportunities that are available within the learning environment but are
more peripheral and accessed without the direct intervention of the teacher. These
learning opportunities have the potential to support learning of the targeted science
concepts. The student interview transcripts and work samples were coded to indicate the
opportunities students used to learn each of the concepts mentioned. Students were not
asked to make these judgments themselves. Rather, pattern codes were assigned after
consulting a list of activities/events that the teacher described as facilitating and through
cues in how students described their learning (e.g. “I think I noticed a lot of examples by
myself” Student 401, Everglades Trip) within a given “concept unit”, the unit of analysis.
The resulting code frequencies are presented in Table 5.1. Overall 53% of the
concepts that students discussed were learned through exclusively facilitated
opportunities while 15% were learned through exclusively peripheral opportunities.
Another 32% of learning processes were described by students as involving an interaction
of both facilitated and peripheral opportunities such as when a student would learn
something from the teacher and then develop that knowledge further through interaction
with the environment. The percentages in the table represent the proportion of
frequencies within the column categories such as the percentage of codes that were
172
facilitated, peripheral, and combinations across all cases. Because the number of students
per case and the number of concept units per student varied by case, percentages provide
a more useful comparison that raw counts. Also shown in the table are the percentages of
learning opportunities that are associated with the achieved learning levels of students.
Meaningful statistical analysis was not possible with these data due to small sample sizes
but the patterns in the data suggested areas to focus the qualitative analysis.
Table 5.1
Frequencies of Learning Opportunity Codes Across Cases
Learning Opportunities
Facilitated Peripheral Both
All Cases 53% 15% 32%
Case 1 41% 11% 47%
Case 2 68% 7% 24%
Case 3 55% 8% 38%
Case 4 45% 32% 23%
Negative, Little, or No
Learning 54% 12% 35%
Moderate Learning 49% 15% 36%
High or Exceptional
Learning 64% 7% 29%
These pattern codes were assigned at the ‘concept unit’ level
173
The data suggest that facilitation was an important element for student learning as
85% of the learning opportunities involved some level of facilitation and 53% involved
facilitated opportunities alone. Peripheral opportunities alone accounted for only 15% of
the learning but almost half of all the learning described, when considered in interactions
with the facilitated opportunities. This latter finding on peripheral opportunities suggests
that these DIAL experiences were creating opportunities for students to learn targeted
content knowledge in ways that were not anticipated by the teachers. Students were
developing a proportion of their knowledge through peripheral means. It is also clear
though that those peripheral opportunities were not as powerful alone as they were in
conjunction with facilitated aspects of the course.
The bottom portion of Table 5.1 shows the relationship between student learning
(based on Pathfinder data) and how often students at each of those levels used facilitated
and peripheral opportunities. There is not a big difference between students at the lower
and middle levels but we do see a slightly greater reliance on facilitated over peripheral
opportunities for the learners with the greatest gains. How these opportunities
contributed to student learning is discussed in the next sections.
Facilitated Opportunities
The data in Table 5.1 show that the teachers and the facilitation they provide have
critical roles in DIAL. Learning did happen without those opportunities but it was less
common. The teacher’s role will be discussed further in the Social Interactions section
of this chapter but in this section I show how (F1) guiding observations, (F2) providing
instructional resources, (F3) facilitating assignments and activities, (F4) making
connections, (F5) demonstration, (F6) providing expertise, (F7) direct instruction, and
174
(F8) synthesis all played important roles in students’ knowledge development. Each of
these manifestations of facilitated learning emerged as patterns from the interviews, field
study, and student work samples. To be included in this report, each of these forms of
facilitation were described as important for learning by multiple students across all four
cases.
F1 Guiding Observations
Students engaged in DIAL are operating in an environment where much of the
surround has the potential to support their learning of TSCs. Examples of the content
they are learning exist throughout the environment. However, these environmental cues
may not be obvious to the untrained eye. Students in this study often described how a
teacher, guide, or local expert helped them to see examples of TSCs in the environment.
In one such case, a student in the Everglades class (Case 4) describes a situation where
the teacher led the group up to and into a copse of trees on an otherwise grassy plain in
order to illustrate the concept of hardwood hammocks and how those plant communities
are a function of the physical conditions of the environment:
I definitely didn't know what a hardwood hammock was before we went on the
trip. And then within the second day or so when we pulled up in the van to go
check out the hardwood hammocks and stuff, then Paul explained how even 2 feet
of elevation can create this whole different ecosystem for plants to live in…. Once
you're inside, then you... he pointed out how it was on the limestone, I think it
was. And so then you could, I could see the elevation change and then he
explained how the elevation change allows for the water to not totally cover the
175
hardwood hammock. And the sawgrass prairie still has water flowing through it.
(Austin, Student 405, 11th grade, Case 4)
As in this case, the teachers across the cases would address the whole group in
this way as they pointed out and described aspects of the environment. The teachers and
students described numerous occasions like the one Austin describes above where
spontaneous occasions or “teachable moments” would present themselves. Teachers
would recognize some element of the environment that was a good example of one of the
TSCs and capitalize on the situation through guided observation. Other times the pattern
seemed to start with the teacher asking students to generally observe the area and then
ask a series of more focused questions until the illustration of the TSC was clear.
Students described this pattern in all of the cases.
Guided observation was also important as teachers interacted with individual
students through impromptu lessons. Mei, a 12th grade student, described such an event
on the Everglades trip of Case 4:
When Kevin (guide) was talking about the white mangrove, he pulled out the leaf
to see that on the roots of the leaf, you have two little black dots, and he was
saying that the ants are eating the sugar (excreted at the dots) but then the ants are
keeping away other insects. I think that's another time that I had a deeper
understanding of it (Niche). (Student 408, 12th grade, Case 4)
Some of the guided observation reported by students and teachers was more
planned, as in this series of events from Case 2, the Winter Environmental Science class:
176
Ryan will show us a PowerPoint and then we'll also go outside. Like today we
went outside for a couple minutes and Ryan was just showing us certain things.
Even today he just went outside today to show us that surface hoar had formed on
top of the snow and I think it was yesterday we went out and Ryan dug a pit
earlier so we could just look at the snowpack and examine the different snow
crystals and certain things like that. (Kelsey, Student 230, 11th grade, Case 2)
In this series of events, the teacher prepared the lesson and then dug a pit in the
snow. He later used the pit by bringing the class out to see it and illustrate the point he
was making in the lesson about crystal formation and snowpack. He prefaced both
lessons by bringing students outside first thing to see a crystal feature that would
disappear shortly. These guided observations were a function of the teacher both
planning ahead and reacting to evolving conditions. Many of the students in Case 2
reported this lesson sequence as being helpful to their understanding of snow
metamorphism.
Most students in the study described guided observation as being important for
their understanding of at least one TSC, though which one was highly individualized,
despite the more or less common experience within each case. For Mei the relationship
between the ants and the mangrove became clear to her through the process while for
Kelsey the digging of the snow pit was important. There was no way to measure how
many of these guided observation events took place but it was clear that their
effectiveness was dependent on more than the fact that they occurred. Based on my field
observations of Case 4, these guided observation events happened very frequently and
177
while some were described by multiple students as being influential learning events (e.g.
the hardwood hammock lesson), others were not mentioned at all.
F2 Providing Instructional Resources
Like most teachers, the participant teachers in this study provided learning
resources to their students and, in turn, students often reported these resources as being
useful for developing understanding. An important difference in DIAL learning is that
once immersed, resources can be hard to come by. Students cannot necessarily do an
internet search for a topic of interest, particularly in the outdoor settings where much of
the experiences in this study occurred. Across the cases the teachers provided
photocopied handouts and/or had resources available for students in the field. In Cases
1,2, and 3 which had some classroom components, students also reported videos shown
by the teacher as being useful for learning. A student from Case 3, the crane migration
group, described the role of handouts in understanding some of the crane behaviors they
observed:
Before we left we got a couple different handouts. One was just about flight and
function of the different birds, and you know sort of the internal. And the other
one was about behavior, which sort of allowed me to grasp the more complex
behavioral attributes that the cranes have. (Nate, Student 309, grade 9, Case 3)
Many of the students in Cases 1,2, and 3 reported that their understanding of some
topics changed from the pretest to the posttest as a result of new information that was
made available to them via these types of resources given as intended assignments. In
other instances teachers or guides facilitated resources to be available as students needed
178
them as on-demand information. The teacher of Case 4 did not provide any handouts or
other resources at all to the students. However, the local guide brought a waterproof
bucket full of guidebooks, maps, and other resources for students to use. Some students
used them regularly and others did not. During my field observations of this group, I
often observed the teachers reading or looking up information in the books as well.
Similar to the process of guided observation, teachers often expected the students
to make observations of their environments with the aid of resources such as
dichotomous keys or field guides to help them interpret, as in this case:
Well the first time we stopped and looked at some trees, a student and I were
partnered up to find, to identify, two different trees and we had these books and
going through the books, we could tell what they are. Like “oh there's a lodgepole
because it has the same consistency trunk throughout”, you know, and “oh the-the
needles are in packets of two or three.” You know, stuff like that. I definitely
think that helped us have a greater understanding of trees. (Jason, Student 103,
Case 1, no grade levels)
The teachers of Cases 1 and 4 described a part of their role as helping match the
right resources to the right students, particularly around ability and interest. They
described their students as having a wide range of ability levels and grade levels that
were best served by choosing specific resources that best matched those abilities.
F3 Facilitating Assignments and Activities
Even when teachers were not directly involved with the social interactions of
instruction, the role of facilitation remained important. Assignments and planned
179
activities were both cited by students as important for their learning. In Cases 1 and 2,
the residential programs, students were assigned homework to be completed outside of
class time, though still within the context of the immersion experience. Students often
described the role of these assignments as priming them for what they would experience
during instruction time or helping them to process their learning in a way that they could
relate to.
The teachers in Cases 1 and 2 also set up more activities that were bounded and
targeted (but still allowed the students to build a sense of discovery) than did the teachers
in Cases 3 and 4. In these activities students would be given instructions and a goal and
then sent out to accomplish it, as was described above with the students using field guides
to identify trees. Another student described how they were sent out following a
classroom lesson to look for real examples of what was diagramed on the board:
So subnivean is the environment under the snow, between the ground and the
snow. I guess there are a few ways we learned about it. We talked about it in class
a fair amount. And then actually, we did an activity where we went out and we
were looking for tracks and we found, or my group found, 6 or 7 burrows that
went all the way down to the ground. It was a pretty good idea of what subnivean
actually looked like for me. (Mitch, Student 207, 11th grade, Case 2)
These facilitated discovery activities were important for a number of students but they
were also a gamble. The teachers predicted what the students would experience during
these activities but they did not always happen as planned. In the case described above
many students did not see any burrows and did not have the opportunity to link the
180
classroom lesson with the field observations. They were still able to describe the TSC
“subnivean” and link it to other contexts they had experienced but they did not seem to
have the same appreciation for the idea nor the level of detail in their descriptions as did
the two students who described seeing the burrows.
Interestingly, the students in Case 1 described activities that the teacher, Jacob,
facilitated much more often than information that he simply said. The opposite was true
for the other cases. When students did describe Jacob speaking, they usually referred to
his questioning rather than what he directly told them. The students of Case 1, with one
exception, also described themselves as not being very good at learning in traditional
settings. While it is possible that Jacob used less direct instruction and more facilitation
of activities, this was not the impression he gave in his teacher interview. That
proportion was on par with the other cases. It seems likely that this particular group of
students learned more through facilitated activities than through direct instruction.
Daniel described how this distinction was important to him:
Instead of being told that coniferous trees have these (adaptations), we'd actually
go out, look at trees, draw them, like literally taste them. Just anything we could
to like learn more about the tree in the field and get a better understanding of why
trees adapt to what environments or anything like that. It was really fun. (Student
102, no grade levels, Case 3)
F4 Making Connections
Whether living in a subalpine environment, traveling through the jungle-like
Everglades, or being surrounded by the cacophony of tens of thousands of cranes, the
181
students who participated in these DIAL experiences were generally not in familiar
environments. The teachers helped bridge the gap between the exotic settings and the
students’ personal experience. Similarly, the teachers helped the students bridge the gap
between their own experience and the also unfamiliar science content. One way teachers
did this was by helping the students to see the immediate connection between the
environment, content, and the students’ experience. In teaching about tides, the teacher
and guide in Case 4 elicited the students’ experience in paddling against the tides and
then paddling with the tides to illustrate how the force of the tides was a geometric
function determined by the gravitational pull of the sun and moon. Reversing the
process, they used the students’ new understanding of tidal flow to plan canoe travel the
next day. I observed this sequence during the field study of the case and then both
students and the teacher described aspects of it in their interviews, most of whom
described it as a first time they truly understood what tides were. In a similar process, the
teacher in Case 2 built interest in learning about the subnivean environment (under the
snow) by making the connection to the knowledge students would need when they were
living out in the snow themselves, as one student recounts: ”With the snow unit we talked
about our application of making (igloos) during the winter trip, those being insulated and
that being really the same way animals can use underneath the snow to stay warm”
(Andrew, Student 211, 11th grade). There was, however, a downside to this metaphoric
teaching style as it may have led to some misconceptions. This is explained at the end of
this chapter.
By making connections between experience and the TSCs teachers harnessed the
excitement of novelty to serve the learning of the TSCs. An alligator sighting a few feet
182
from one’s canoe is certainly attention-getting but the teacher and guide I observed in the
field often acknowledged the excitement and then linked it to a lesson. In this case,
pointing out how the animal had created a niche for other organisms by keeping bank
areas clear. A student described another case of her teacher connecting novel experience
to a TSC, snow metamorphism:
There was one day where we went out and tested out our skins (traction devices
for skis), sort of in the backcountry… and we sort of looked at the snow and
sometimes when we would walk on it, or like, break a trail, it would "whump",
make noises and stuff like that, and Ryan took the opportunity to be like, “hey,
snow, it's probably faceted because it's making that noise”. (Amy, Student 240,
11th grade, Case 2)
Helping students understand their experiences was important but experience is
also limited in that some concepts are too broad or abstract to encompass within personal
experience. Understanding tides through personal experience is possible on one level but
to understand the role of gravitational pull and global movement of the ocean requires
some abstraction. In that case I observed the teacher using an effective kinesthetic
demonstration to help the students make the conceptual jump. In another case the guide
on the Everglades trip was trying to help students see the entirety of Southern Florida as a
single interactive system. Dante recalled that lesson:
I remember Kevin saying one time, when they put all the those dikes up, he said
it was pretty much blocking all the arteries of the heart. Once you do that, nothing
183
can go anywhere from there and it dies. I thought that was a good analogy.
(Student 406, 9th grade, Case 4)
F5 Demonstration
Demonstrations are used by most science teachers and these DIAL experiences
were no exception, as illustrated with the kinesthetic tide demonstration. As in other
settings, students found demonstrations useful to help them build content knowledge and
make connections. We often see demonstrations in classrooms or lab science used to
model natural phenomena that are inaccessible from within the classroom. In these DIAL
cases teachers could rely on guided observation to illustrate many concepts that could not
be shown in a classroom setting and so they would not need to model them. Still, they
used demonstration and modeling to illustrate more abstract ideas, as described above. In
these DIAL environments scientific apparatus were not readily available as they might be
for a laboratory demonstration. Note that this need not apply to DIAL in general.
Instead, the teachers would co-opt other materials or students to serve as models within
the demonstrations.
In the tides demonstration mentioned above, Paul (teacher) used one student to
represent the Earth and two more to represent the Moon and Sun, showing the two
different orbital patterns. Two more students held hands and encircled the “Earth”
representing the water on the surface. As the Moon revolved around the Earth and they
both revolved around the Sun, the two water people moved their arms to show how the
water bulged out in response to gravitational pull. This demonstration could be effective
in the classroom but in the DIAL setting Paul could also use guided observation to point
184
out the high tide line on the mangrove roots, note how the area they were standing in was
under water a few hours before, and discuss the impact of tides on people trying to paddle
against them, all of which I observed in the field. Austin (Student 405, 11th grade)
reflected on this during our conversation:
Austin: On tides, I knew generally they came in every once and a while and went
back out, and it had something to do with the moon and gravitational pull. But
yeah, after Paul’s demonstration on the beach, that kind of... that was sort of like
an “aha moment”… I realized what caused all of that and how it looked on a
global scale.
Mike: What does it look like?
Austin: Depending on where the sun and the moon are, the oceans can be
stretched and so like in on one side of the earth and out on the other side. Or just
since the sun and the moon are in different places all the time, the tides are all
over the place, basically.
Ryan, the teacher in Case 2 used a surprisingly similar set-up to demonstrate to
his students the role of Earth’s angle in relation to the sun in creating seasonality while
students directly experienced the resulting cold.
There were a number of other events where teachers used demonstrations that
could work in the classroom but made them more salient by using the local context to
support the learning, as in this example from Case 2:
I think the thing that registered most for me was that he put outside two water
bottles, one that was open and had a fan on it, and one that was closed and deeper
185
in the snow and also with a black wrapper around it. And he asked us.... The
temperatures were very different and they've been there since the same time of
day, and he asked us why the temperatures were different. We talked about all of
the ways that one had lost heat and all the ways one had kept its insulation and
that really registered on a lot of different levels I think. (Rachel, Student 204, 11th
grade, Case 2)
By conducting the experiment outside, Ryan was able to reduce one layer of
abstraction and put the students within the experimental conditions. Through that set up
hee was also able to make the connection to how a person or an animal can reduce heat
transfer.
F6 Providing Expertise
We would hope that every science teacher has some level of expertise to share
with their class. In these cases of DIAL, that expertise seemed to manifest in more ways
than it might in a typical classroom. Students described teachers as not only sharing
knowledge through lessons but also helping students to interpret their environments and
responding to questions inspired by the surround. In addition, students experienced or
witnessed the modeling of an expert as he or she became interested in notable
observations and communicated about the environment as an expert would. This was
apparent in the observations I made of Case 4 and was also described by students in the
other cases, particularly Case 3 as Jennifer, the teacher pursued her own interests in
learning more about the Cranes, as she led the class. In Cases 3 and 4, the teachers
recruited local experts to assist with instruction/interpretation and thus modeled for
186
students conversation between experts. Two quotes from students reflect the contribution
the local experts made: “He's (Kevin, the guide) really knowledgeable I guess in his
field. He knows this stuff about the Everglades. He really knows like a lot about all the
plants and animals. He obviously is really enthusiastic about it all.” (David, Student
404, 9th grade, Case 4). “The two things that taught me most of this was....a little bit of
stuff that I learned in the classroom that was mainly just in general about all birds and
just talking to Kelly who was the bird...the crane expert.” (Nate, Student 309, 9th grade,
Case 3). Many students expressed awe at the knowledge of the local experts and
commonly discussed times where they gained clarity on a topic based on a question
answered by the teachers or the local expert.
A number of students in Cases 3 and 4 discussed how their teacher’s role
changed rather drastically when the local expert was brought on board, how the teachers
would become more like parent figures or administrators while the local experts delivered
the knowledge. I detected a more subtle shift in my observations of Case 4. Before
Kevin, the guide, joined the group, Paul, the teacher, readily dispensed facts, prompted
students for interpretations of what they were seeing, and guided the learning toward the
big ideas and TSCs. After Kevin joined, Paul was more reserved, let Kevin share most of
the declarative knowledge, and typically asked for confirmation from Kevin when he did
share information. However, Paul also often made critical instructional moves to help
students move beyond natural history and develop big picture connections and schematic
ideas. It was clear that Kevin had much local knowledge but perhaps did not understand
why the information was important for the bigger picture. Also, Paul often modeled his
intrigue by asking Kevin questions or consulting a field guide and sharing his findings.
187
While I did not observe Case 3, interviewed students reported some similar interactions
between the teacher and local expert.
Teachers acting as experts in context also seemed to help students understand
scientific language. Students were able to pick up vocabulary when the teacher as expert
used it in context. This was true for both scientific words and common words used in a
scientific way. The following quotes illustrate these ideas:
Robert: Well, Ryan (teacher)… I guess we've been talking a lot about snow and
snowfall and the snowpack recently, and those words just sort of came up and I
guess they're sort of vocabulary words that he kept on repeating. We all just
understood it eventually. At first I had no clue what he was talking about by
“orographic precipitation”, but he did a good job explaining it and how… what it
really means. (Student 215, 11th grade, Case 2)
Robert: Before I thought of resistance as...I didn't really understand it. I just sort
of understood it like the common definition of being stubborn or not really
moving. Then we talked a lot about survival strategies and how resistance is one
of them. It's like hibernation, migration, resistance. And how it's not really related
to the geology anymore, it's more related to snow and seasonality, because in the
snow it's an adaptation or an acclimation I guess, rather than just a common term
anymore. (Student 215, 11th grade, Case 2)
188
F7 Direct Instruction
For the purposes of this study direct instruction refers to a teacher-centered
pedagogical approach defined by a direct transfer of information and learning supports
from teacher to student and that stands in contrast to a more inductive inquiry method of
instruction (Kirschner, et al., 2006). The use of the term “direct instruction” here
describes learning events rather than the overall pedagogical approach of any given
teacher. Of all manners of facilitation that students reported as helping them develop
understanding of the TSCs, direct instruction was one of the most prevalently coded
within the student transcripts. Quite often students reported that they learned a given idea
simply because the teacher or local expert had said it. At times students identified very
specifically what was said along with the context. More often they reported in
generalities such as “I think he just told us what it was” or “we talked about…” When
pressed on what “we talked about” actually meant or looked like students typically
described lecture with questions and answers or a teacher-focused discussion as Andrew
describes here:
That was generally Ryan (teacher) and sometimes the apprentice Andrea lecturing
about different types and we would generally take notes but it wasn't a full
lecture. There would be some class participation. We would shout out ideas about
why we thought certain adaptations would help. It was more of a team effort than
purely just note taking and lecture. (Student 211, 11th grade, Case 2)
The direct instruction led to a mix of both declarative knowledge, such as
describing an adaptation to a particular niche, and to schematic knowledge such as the
complex relationship in this description:
189
He wrote thermoconductivity. he wrote a lot of the equations on how to figure out
what the thermoconductivity of an object or and animal is. And we sort of defined
it and explained it and sort of I guess reviewed how that actually affects animals
and basically everything in winter and summer, I guess. (Robert, Student 215,
11th grade, Case 2)
Direct instruction seemed to be prevalent in the field as well as when students
were actually sitting in classrooms. Teachers brought portable white boards, printed
photos, or drew in the sand to simulate classroom practices.
F8 Synthesis
A final and critical way that facilitation played a role during these DIAL
experiences was through bringing all of the lessons learned together to inform the big
idea(s) of each course. Because there was such a variety of experiences and many of
them were impromptu, it would be easy for students to come away with a collection of
disconnected information. Across all of the cases the students described many instances
of the teachers helping them to see how it all fit together. Interestingly, none of the
teachers identified this as a specific teaching goal. In the following quote, a student in
Case 3 describes how the teacher brought the field and classroom lessons together:
The layout of the class in the week… we would have a class on Monday, in class
to introduce concepts and then (Ryan would) say, “be ready, have boots and
gaiters on Wednesday, we're going to go trek around in the snow looking for these
tracks that we've talked about today in class”. And then generally the field classes
being three hours long, we wouldn't necessarily always be out for the full three
190
hours, but we would come back to the class and rehash what we learned and
utilize the field knowledge and then translate them into note form and more
straightforward information. I think he did a good job of relating the two and it
never felt like a field class was totally disjointed from our unit, we were not just
going outside to go outside and take advantage of the time and do something else.
It was always pretty grounded in the unit that we were studying, which was good.
(Andrew, Student 211, 11th grade, Case 2)
This deductive process of learning a concept in a more formal setting and then
going out in the field to look for examples or to test a theory was commonly described by
students and seemed to empower them by making them feel like they were
knowledgeable about what they were observing. The opposite, inductive tack of moving
from observations to ideas was also reported by students as effective to help synthesize
knowledge, as in this example:
We went and dug snow pits and then we had to identify each storm that had
happened-like each layer of snow and then measure the temperatures. We learned
that and we went back to the class and the next day or something he gave us a
worksheet that had the different layers of snow and then he told us what they
were. So we learned-we did it and then we learned what it was. (Ashley, Student
105, no grade levels, Case 1)
All of the teachers described in their pre-DIAL interviews intentional plans to
create a blend of formal and informal lessons specifically intended to work together to
191
help students learn the TSCs. They also all described wanting students to see how all of
the information fit together into a bigger scheme. In Case 1 everything came back to
adaptation, Case 2 was founded on the relationship between biotic and abiotic, Case 3
came back to habitat needs of cranes and humans and what happens when they clash, and
Case 4 was similar, in understanding micro-environments and their sensitivity to
disturbance.
In comparing teacher plans and student descriptions of their learning, much but
not all of the synthesis that students described when talking about their PFnets seemed to
happen as a result of the plans that teachers designed and enacted. Students reported that
as they moved from one lesson or activity to another, teachers would often help them see
how it all fit together either through direct instruction, synthesis assignments, or
reflection. Cases 1, 3 and 4 all used prompted written reflection to help students
synthesize information. The teachers in Cases 2 and 3 explicitly outlined the big ideas
for students as described here:
I remember our first homework assignment, he just asked us to answer a question,
what is energy? And just certain things to get us thinking about it ahead of time.
And then in class he'll kind of ask a central question to what we're gonna be
talking about at the beginning of the period maybe. Like maybe how something
relates and usually we'll discuss it a little bit and then he'll have a PowerPoint to
show us pictures and that sort of stuff. (Kelsey, Student 230, 11th grade, Case 2)
192
Peripheral Opportunities
As indicated, peripheral learning opportunities were discussed in conjunction with
students’ learning of TSCs much less than were facilitated opportunities. Peripheral
opportunities in isolation accounted for few accounts of direct content learning. Rather,
peripheral learning opportunities accounted for a different class of learning built largely
around the affective domain, and at times an abductive learning process where students
began to form loose hypotheses based on their direct observations. There was a strong
supporting connection to academic learning as will be discussed in the following
sections. Four forms of peripheral learning opportunities were supported with evidence
from multiple students from each of the four cases: (P1) personal discoveries, (P2)
discordant observations, (P3) affective connections, and (P4) other resources.
P1 Personal Discoveries
In some instances students did seem to learn TSC-related content directly from peripheral
opportunities. It is difficult to know if these instances were truly without any facilitation
but a few students attributed some learning to ideas that they picked up entirely on their
own. One student in particular described a number of such cases. An 11th grade student
on the Everglades trip, Jake did not express any of these ideas during the course while I
was observing, nor did I hear others instructing him or mentioning these ideas
themselves. His impression that he discovered and internalized these ideas seems
credible. In the following exchange, Jake explains two interrelated ideas that he
discovered.
Jake: I didn't realize that the air plants relied so heavily on the mangroves.
Because 90% of the air plants were on mangroves it seemed. Like going through
193
the tunnel, the mangrove tunnel, there was a ton of them so that was kind of, the
mangrove tunnel mainly was what made me really connect mangroves and air
plants… Tides and water flow I connected, I related those to mangroves because
they were so a part of that because the mangroves it seemed, were mainly in zones
that affected, that were affected by the tides.
Mike: was that something you just noticed (responding to an earlier claim)?
Jake: Yeah. It seems like once the water started getting brackish and there was… I
mean it started pretty early in the tunnels you could notice where the tide was
going up and down.
Mike: how could you tell?
Jake: just by like the mud, you could see where the water used to be and had come
down a little bit. You can't really tell that much at high tide… but I think when
you're going through it, the tunnels, that’s the part where I really noticed that.
(Student 401, 11th grade, Case 4)
Jake also described an experience of using an available resource to support an
observation he made:
There was one shell, I don't remember what it was, but I saw it when I was tide
pooling, or when we were tide pooling. I didn't really point it out but I looked at
it, and later on after the swamp hike, we had some books and I saw the shell and
that was kind of like a personal learning moment I guess. (Student 401, 11th
grade, Case 4)
194
While Jake seemed to simply internalize this learning without applying or sharing
it, Rebecca, a student from Case 1, explains somewhat the opposite. She described taking
a lesson that she learned about her own relationship to the context of high altitude living
and was able to apply that on the Pathfinder assessment more broadly, making
connections to the TSC desiccation that she had not made before:
I think it's like how the moisture gets sucked out of you right? And so I know that
happens up here just being up here and (sigh)
Mike: Just from your personal experience?
Rebecca: Yeah, from my personal experience being up here and my hair and my
lotion...gotta oil every day and so… I just remember learning I'm pretty sure it
just sucks the moisture out of you which I know has to do with elevation.
(Student 106, no grade levels, Case 1)
In a final example of students making conceptually related personal discoveries
Shannon, a 9th grade student in Case 3 describes an idea that was not specifically
important to the big idea but indicated skill in observation and possibly set the stage for
future learning:
Seeing their...like how the cranes fly and their wing rhythms…. It was just their
call sounded so much like a goose, but their wing beats were so different.
Mike: Can you describe it?
Shannon: Instead of being a straight flap, like up and down and even, they took
their wings straight up and then lowered them slowly. (Student 302, 10th grade,
Case 3)
195
The examples presented in this section were among a small set of such examples.
Overall, there was little evidence to support that much direct, conceptual learning
happened directly as a result of peripheral opportunities for most students. However, for
one student in each of the cases, this was a proportionally important avenue for learning.
These students seemed more anxious to talk about this peripheral learning than that
which was facilitated. For most of the other students the peripheral learning
opportunities became important as supports that led to or enhanced the conceptual
science learning. This is addressed in the remainder of this chapter.
P2 Discordant Observations
Another learning phenomenon that emerged and was, by definition, peripheral to
the teachers’ facilitation occurred when students were confronted with the situation of
having preconceived notions that were discordant with observations they were making.
No such events in this study were described by students in ways that could be considered
paradigmatic shifts or major conceptual changes for students but they seem to have
contributed to the students’ understanding of some TSCs or created a reason for the
students to become more interested. In the student descriptions that follow, all of the
information students report could have been simply told to them but based on their
descriptions, discovering it on their own seemed important to their learning processes:
Anna: On the first day we saw this alligator swimming and I never really thought
about it but they only swim with their tail. That was kind of surprising to me.
And even I don't know why that’s so surprising to me but I definitely thought
196
they're using their feet and that was something I discovered just from looking at
them. (Student 202, 11th grade, Case 4)
Jake: We found that turtle on the swamp thing. I never realized when they go into
their shell, just how secure they are in there. I kind of thought they, I mean if you
really wanted it you could probably pull it out or something but that thing was in
there and that was kind of a learning moment, it was just like whoa!
(Student 401, 11th grade, Case 4)
Mei: I guess when I first imagined that kind of ecosystem, I couldn't picture,
because the creeks they're just narrow and running all the time and the ocean is
always that bluebird color, but like....like I would hate the color of black water
running, 'cause I would think of coffee. But then I actually understood it was
because the cypress turn the waters that color. And I guess it was just far from my
expectations. This was just really different from what I thought. (Student 408,
12th grade, Case 4)
This last quote implies learning that is perhaps broader than the first two. Before
the experience, Mei tried to imagine what a cypress swamp would look like but had
trouble reconciling her images of the ocean and mountain streams with this third potential
that was repugnant to her. Once she saw the cypress swamp and came to terms with it, it
was both more understandable and palatable. Had she maintained the schema of black
197
water as repugnant it seems unlikely that she would have been as interested in exploring
that ecosystem.
P3 Affective Connections
The most important role for peripheral learning opportunities across all cases was
in students developing affective connections to the curriculum, as determined by both
related code frequencies and the manner in which students described their experiences.
Some students described these connections as helping them become engaged in the
curriculum and for others, emotionally stirring events seemed to create memorable
connections to examples of TSCs. Within their narratives of learning events they would
often weave together their affective memories with the concepts they were learning.
Most of the students involved in the study had a great deal of choice as to whether
or not to participate in these DIAL experiences. However, in Case 1 some students
enrolled simply because they needed a science credit and in Case 3, the students could
choose to attend the school or not but could not choose the class. Heather (Case 3) was a
student for whom crane migration was not an interesting topic. Her evolution of attitude
over the course of the brief DIAL experience that led to her becoming more interested in
the subject can be attributed to peripheral, affective events:
Heather: Actually seeing the cranes made me a lot more interested in them. So I
mean that's...besides all the factual stuff, like what we learned here (home) and
what we learned there (Nebraska), which are almost the same things. It really just
related because it makes me want to learn more about them…
Mike: Why do you think that is? Why do you think it is that seeing the cranes
changed that for you?
198
Heather: 'Cause I've never liked birds and I just kind of stereotyped them into a
bird. Instead of like a specific kind of species. And so, you know, whenever I'd
go bird watching with my grandma, I'd always find it so boring and... So I thought
it was gonna be a super boring trip and it would just be sitting there for hours
watching cranes and I wouldn't have fun at all. But ...at first the noise that they
make was annoying, but then it's kind of hypnotizing, or entrancing after a while
and it's like, I don't know. It's almost close to meditation for me or something. It
was cool.
There was one moment. It was when we were in the blind, I think it was the first
night. And I saw Eva and George standing really close together and he had his
arm around her and they were looking out at the cranes and I just like...it was
really cool, 'cause it just kind of... I don't know how to describe the feeling. Just
made me feel really happy, because it just kind of made me realize that cranes are
so much like humans.
Mike: What do you mean?
Heather: That like when they mate for life, it's just... it's so much more important
than just having a bunch of different mates. So when you have one person you
depend on them, it's a lot bigger of a deal. (Student 301, 10th grade, Case 3)
In all of the cases, students witnessed awe-inspiring natural events that seemed to
become deeply seated in their memories. They were not, however, always well-
connected to the curriculum, and therefore did not come up in interviews in conjunction
with learning the TSCs. Rather they would be described when I asked students about
199
general memorable events. One such event I will describe from my field notes rather
than student accounts for that reason.
The Case 4 group had been canoeing since mid-day through claustrophobic
mangrove tunnels that would occasionally widen into areas the size of a small pond. It
was dark and the group had not eaten nor had much of a break but we could not stop until
we reached the only suitable place to camp. One could barely see the canoe in front of
them and there was a real danger of taking a wrong turn, ending up separated from the
group. Students were nervous, tired, hungry, cold, and generally down. From the middle
of the group a student yelled and raised his hand in the air holding a glowing jellyfish.
Within a few minutes what were actually comb jellies began to luminesce all around us
and we could see that we had made it out into a wide body of water. For at least an hour
more every paddle stroke resulted in comb jellies lighting up. It was a truly amazing
sight to behold and this was not lost on the students. They acted excited by the find and
seemed reinvigorated for the trip. Surprisingly, neither the teacher nor the guide ever
referred to it again or turned it into a teachable moment. They did not use the event to
talk about pulse breeding, tidal influence on marine life, or any similar topic. It seemed
like a surprising omission. Students mentioned the event throughout the rest of the trip
but I never heard them refer to any associated science content. Events like this, with
strong emotional content, seemed to become spatial and temporal markers that students
used to index their experiences. While the comb jelly event was not used by students to
provide a context for the learning they described in the interviews, there were many other
events across all of the cases in which students did begin their recall of learning with
descriptions of these emotionally moving events.
200
As with Heather and the cranes, students were keyed into wildlife encounters
which were necessarily peripheral events. A bobcat walked up to the window where the
students of Case 1 were working and numerous students reported seeing snowshoe hares
in both of the winter courses. More than any other topic, students reported wildlife as
prompting them to seek out more information about what they saw. Students in Case 3
reported emotional reactions to the noise and sight of 10,000 cranes. There were many
wildlife encounters that students reported as stirring on the Case 4 Everglades trip. Being
surrounded by dolphins, seeing rare birds, watching alligators face off for territory,
seeing giant orb weaver spiders in their webs, and following an endangered 6’ long
prehistoric sawfish as it patrolled the length of a beach were all described by students as
memorable events for which they had a visceral reaction.
Of course those visceral reactions were not always positive. In many cases the
novelty of perceived threat from the environment, including cold, drowning, avalanche,
spiders, alligators, pythons, or just a general sense of exposure were distracting elements
of the periphery. When asked about these feelings of fear or nervousness, every student
who brought it up also said that the fear was alleviated after some time in the
environment. Anna described her transition while walking through waist-deep water in a
cypress swamp:
When we started walking in the water, I was not like super scared but it was like
freaking me out with all the woody stuff around my feet and I didn't know what
was going on. We had just talked about pythons and what they are, they are
everywhere and we were like looking out for alligators I kind of knew I was safe
201
but it still did not make me feel good. But in the end I liked it. Like I like when
stuff is not super comfortable to you. (Student 402, 11th grade, Case 4)
When students made this transition, it seemed to come with other important shifts.
Many students described a sense of empowerment over perceived threats and their own
emotions. In a few cases students described how the distracting affects of novelty were
reduced once they became familiar with some aspect of the environment that at first felt
threatening and how that familiarity allowed them to notice details about the environment
that they perceived inaccurately at first. This last point is illustrated by Teddy’s account:
There was one little moment when I was...when David and I were paddling...I
don't know which day it was, second day. Third day maybe. I don't know. But we
were paddling and I looked off to my left and I saw something chasing stuff in the
water. And it was like a fin and I thought it was a shark. My heart started
pounding and I then I noticed it was a dolphin. (Student 407, 9th grade, Case 4)
Having observed this event, I would add that it took place over several minutes
and the boys were somewhat panicked and paddling very fast to catch up to the group
before they realized it was a dolphin. With the panic dissipated, the boys noticed details
of the dolphin’s anatomy and behavior that they were previously closed to. I observed
this pattern multiple times during my observation of Case 4 as the group or individuals at
first reacted sensationally to alligators, spiders, swamps, etc. and then began to express
curiosity and observe details about the elements that were previously seen as a threat.
202
P4 Other Resources
Though not prevalent, there were some reports of students using resources that
provided information but that were not facilitated by their teachers. Examples included
park signage, overhearing other park visitors talking, learning ski skills from other
students, and even a poster on a bathroom wall. Overall, these were minor and infrequent
events though present in all of the cases.
Interactions Between Facilitated and Peripheral Opportunities
In the DIAL cases presented here the development of conceptual science
knowledge was more associated with facilitated than with peripheral learning
opportunities. However, peripheral opportunities were more associated with affective
elements of student learning and with students building personalized relationships to the
content knowledge. A synergistic effect seemed to present when the two types of
opportunities were used together. In learning events in which students reported both
types of opportunities together, their learning also tended to take on characteristics that
were different than they were for either one alone. Four themes emerged across the cases.
Students described (B1) a sense of completing a picture which at times led to a much
deeper understanding of the TSC by filling in a missing but critical piece. There were
often (B2) critical events that led to a deeper understanding of a concept. The (B3)
application of knowledge in an undirected, personally relevant way was also cited as an
important learning process outcome for many students. Finally, some students described
situations where they were able to consider information gained through facilitation in
conjunction with peripheral observations to (B4) extend their conceptual understanding
beyond the intended curriculum.
203
B1 Completing the Picture
Students often described an interaction between facilitated learning opportunities
and their own peripheral observations that they were making in the field. This typically
involved a process of taking a framework of abstract ideas learned through instruction
and filling in visual or conceptual cues learned through concrete experience. Jared of
Case 3 did an excellent job of describing this phenomenon:
It (a detailed lecture by the teacher) was before the trip and it was just pure facts.
And that was really cool and then kind of the duality of that was kind of the first
night we were on the trip, we were in the blind and we were watching the cranes
and the sun was kind of setting and all those facts that Jennifer had told us were
starting to just like come together and make sense. And then I was able to
visualize, put a face to all of those facts that she gave us. So that was kind of
cool. So the lesson… I don't think the lesson would have been important if I
hadn't ended up seeing that. And I don't think the blind experience would have
been quite as helpful if I hadn't learned all that. So those kind of come together
and I think learning and then visualizing was good. (Student 305, 9th grade,
Case 3)
As described previously, both inductive and deductive processes were at work.
For some students the peripheral would precede the facilitated and this would still lead to
significant learning. Rather than an idea being supplied with an illustration, an
illustration of a concept was given an explanation. Anna also described such a process
204
when discussing how she came to understand the relationship between tides and
pneumatophores, a specialized root system found on mangrove trees:
The first time it actually came up was when we went through those mangrove
tunnels and that was just like the tunnel was impressive but I didn't really know
what was going on. And then the first time I actually understood that they were
actually living from the saltwater and that they use it was at the chickee thing (an
elevated camping platform). And I think we woke up the next morning and looked
at all the roots and Kevin explained that to us. (Student 402, 11th grade, Case 4)
Following that series of events, Anna continued to notice and be amazed by the
mangrove islands growing in the salt water. Because she had noticed the
pneumatophores peripherally, Kevin’s explanation made sense to her. She had a picture
that was completed by the explanation.
For other students and/or other ideas, the picture seemed to be filled in gradually
as more information or visual evidence was acquired. Students described noticing
multiple examples, subtleties amongst examples, and counterexamples to build deeper
understanding of a concept, as Jake describes:
I think I learned little by little about the niche, like I was talking about before, like
how I kind of knew basically what it was but as we kind of went along and saw
different animals and plants in their habitat I kind of realized what makes it, what
puts it into its niche more. (Student 401, 11th grade, Case 4)
205
It was clear from student explanations of their learning processes that seeing an
actual event, object, animal, etc., was more powerful than seeing a recorded image and it
was more likely to help them develop a more complete conceptual understanding. This
was a common idea, though when pressed, most students had difficulty articulating why
that was an important difference. Student attempts to describe this are highlighted in the
following quotes:
Kelsey: I think it's really cool when we get to go outside and stuff like that,
because we learn about it in the classroom and we see pictures on the PowerPoint
which is really nice and you know what the information is and then going out and
actually getting to see what it looks like is kind of a cool thing to be able to say,
“oh well that's what that actually is.” So it's kind of a really good balance between
being able to learn outside and see what it is and getting to learn the information
in the classroom. (Student 230, 11th grade, Case 2)
Vern: You can only do so much in a classroom and talk about something of that
sort, and leave the rest up to imagination. But going out and seeing what it would
look like, it kind of implants a memory into your head a lot easier. (Student 107,
no grade levels, Case 1)
Robert: So we sort of learned the theoretical aspect of it in class “and this
happened because of this”, “how the sun affects the snow”. Then by going outside
and really experiencing it, it just proved to all of us that this really does happen
and here's the proof right in front of us. I guess just those two together it really
206
makes an effective learning style for me I guess. (Student 215, 11th grade,
Case 2)
Jared: If you're writing an essay or if you’re trying to describe it, it's definitely
going to be a lot easier. It's going to come to you a lot more naturally after having
seen it rather than having heard about it…It would be a lot more difficult to
explain it because I heard it from an outside source but it's much easier to explain
it coming from the source. (Student 305, 10th grade, Case 3)
From these and other accounts, it seems that the difference between words or
pictures and personally seeing a phenomenon is not entirely a function of the type or
details of the information but the perspective that comes along with it. To consider crane
behavior, for example, a video would do a better job of highlighting specific behaviors
and seeing them up close but all of the students in the Case 3 reported that actually seeing
the cranes was more important for their learning than seeing the more detailed videos.
They seemed to trust their own observations and had a sense of ownership of their own
personal observations that made their peripheral observations more powerful than
provided images, videos, or other evidence.
Despite this apparent trust in personal, peripheral observation, students did not
seem to use their observations in opposition to the more abstract information they were
receiving, as is often the case with “folk knowledge.” Rather, they seemed comfortable
fitting their observations into the conceptual frameworks they learned from teachers or
fitting explanations into their observations. It is possible that the concepts were
207
straightforward enough to mitigate that potential clash but a number of the topics,
including tides and thermal conductivity, are notorious for the common misconceptions
associated with them.
B2 Keystone Events
Some interactions between facilitated and peripheral learning opportunities led to
more than simply filling in details of a concept for students. The combination would lead
to a conceptual breakthrough for a student. A barrier to understanding would be lifted or
a much deeper level of understanding would be developed. I labeled these occurrences
keystone events as one event would complete and hold together a concept much like a
keystone in a stone arch holds everything else in place. In most of these instances, a
peripheral event would provide that one last piece of information or perspective that
allowed the student to fully understand a facilitated concept. Mei described how one
such keystone event helped her better understand the complexities of one natural system:
I read my research, I realized tides are related to pneumatophores, but not until
when Kevin explained this and really pointed that out for us. That visual really
helped me to remember it. But the day when we were at the Pavilion Keys, we
had the day off, I was laying right next to that red mangrove...actually a white
mangrove… I was writing in my journal and I was watching the tide, the high
tides just coming in on my right and I saw the high tides like slowly covered the
pneumatophores. I think that was the moment of like, yeah, this is how it works. It
just all makes sense suddenly. (Student 408, 12th grade, Case 4)
208
In Mei’s case, the timing and sequence of the facilitated opportunities worked
well with her chance encounter and visual cue. As she described it, the facilitated
learning opportunities provided the critical information to understand the phenomenon
but the peripheral experience of seeing it in context provided the piece that allowed her to
truly understand the concept and the relationship between the concepts. For Robert and
situations similar to the one he describes below, the peripheral opportunity was more
embodied. Again the facilitated opportunity provided most of the information but
physically experiencing the concept helped him put everything together:
For example he (teacher) was talking about how the days change with how the
earth rotates in the winter time and how that affects the temperature and I guess it
just really... I guess, we were outside and it was sort of a cold day and because we
were experiencing a lot of those same conditions that he was talking about, it just
made that connection in my mind that oh, this is what he's talking about, and sort
of just really assisted me. 'Cause I guess I would have understood it if we hadn't
been outside, but definitely not as well, and it definitely helped me remember and
fully understand it. (Student 215, 11th grade, Case 2)
As in the previous two examples, in all of the students’ references to keystone
events, context was a critical ingredient along with the content knowledge and the
personalized perspective. For Mei it was not just a simple visual and the declarative
information she had received that led to the keystone event, it was the full experience of
having all of those pieces come together and seeing how all of the details fit together.
Similarly for Robert, he had surely had other experiences of being cold before but the
209
contextualization of the lesson through the experience of being cold as a result of the
concept being taught helped him solidify his understanding. The students did not imply
that they could not understand the abstract ideas. Instead, they indicated that the concrete
experience helped them develop a deeper understanding that allowed them to then better
comprehend the abstract idea, and see how it manifested in actual contexts.
B3 Personal Application of Facilitated Learning
The application of facilitated knowledge was another way in which peripheral
experience added to a more complete understanding of concepts. In all of the examples
of application of knowledge within these cases, the application was also described as
physically embodied and there were indications that the students felt they were personally
relevant. As discussed earlier, students in Case 4 became acutely aware of the tides and
their influence on how hard their paddling would be. At the beginning of the DIAL
experience the students paddled with or against the tides without understanding what was
behind them but as they learned more those embodied experiences seemed to become
reminders of the lessons and the lessons informed the way in which they interacted with
the tides:
When we first started I kind of knew about the tides but I didn't really pay that
much attention to it and then when we were on the island (formal lesson on tides)
I understood it and then when we were on the last day, when we were paddling to
Chockoloskee it was really like applied to the situation so I think that went step-
by-step right there.
Jake (Student 401), 11th grade, Case 4
210
Similarly, the students in Case 2 were able to apply their facilitated learning about
snowpack and crystal formation to peripheral situations when they were traveling on skis,
reportedly strengthening their understanding, as Nick describes:
We would go out skiing in the mornings and we would have class often in the
afternoons. We'd talk about avalanche danger and how that will impact us on
expedition. We talked about why the snow felt a certain way on our skis, for
instance, especially 'cause we had so much snowfall this week. With all the
powder we would be able to see the difference between skiing on the packed
down groomed surfaces, which is kinda promoted, destructive metamorphism, as
opposed to the fresh snowfall which is kind of a week layer in the snow pack.
(Nick, Student 201, 11th grade, Case 2)
In both of the winter courses, students discussed how their own experiences of
trying to stay warm and move on snow helped them to understand how organisms’
adaptations were useful for the winter environment and how they could take lessons from
those adaptations to better their own experiences. This also may have led to some
misconceptions by misapplying the metaphor, as will be discussed at the end of this
chapter.
The immersion aspect of these DIAL experiences seemed to be particularly
important as it provided opportunities for facilitated and peripheral learning opportunities
to work together. The application of lessons learned reportedly happened for students at
various times, not just when they were participating in facilitated activities. Rachel and
Amy from Case 2 explained how this immersion element worked for each of them:
211
Rachel: I definitely started thinking about the concepts that we learned in class a
lot outside of class. Just living here I guess, I'm not used to this climate and this
environment. I think it's really cool, but we learned a lot about taking care of
yourself here properly and so I think it really registered learning about
thermoconductivity and then thinking about the layers that I had on. We had ski
week and I had to think a lot about if I was going to wear cotton then I would get
wet and if it was a cloudy day how I should protect myself that way. I think what
I learned in class, a lot applied to what I was doing every single day here.
(Student 204, 11th grade, Case 2)
Amy: It's not like we're learning about something that's really distant from us, it's
just right outside. And I felt like we would reference a lot of times to lab in class,
and so you could picture in your mind what you saw and sort of use that to help
think about new concepts or stuff like that. (Student 240, 11th grade, Case 2)
As with keystone events, the personal connection to the material seemed to attach
relevance to the learning as the previous two examples indicated. It was not simply a
matter of using the knowledge, it was important because the information was useful and
relevant. Students described need-to-know information such as reducing thermal
conductivity at 10,000 feet in the middle of winter as having a direct impact on their
immediate life. It was relevant because it had direct personal ramifications. In this way
students described an appreciation of facilitated science concepts when they could apply
212
them to directly influence the quality of their own experience within the context in which
they were living and learning.
B4 Extension of Learning
A final theme that emerged from the analysis of the interaction between facilitated
and peripheral learning opportunities was that the combination led to students extending
their learning beyond the intended curriculum. Armed with facilitated knowledge,
students described using it to reinterpret their environments on their own, developing
hypotheses, questions and conclusions. In one of the more interesting examples, Nick
from Case 2 used his peripheral observations along with facilitated learning and came up
with a conclusion that has been a hot topic within ecologist circles in recent years,
unbeknownst to him:
I thought it was interesting to see when we went out on our tracking lab, the way
that animals did interact with manmade elements. There's snowmobile trails and
nordic skiing trails just out there and there would be birds that walked across the
groomed trail. There was a snowshoe hare that had gone on the snowmobile trail.
I thought it was interesting that an animal might make use of human elements. We
talked a lot in the field about leave no trace, backcountry ethics and why if you
leave your scraps from dinner out on a rock and an animal eats it, it reduces the
animals' ability to survive on its own. It was interesting to think of how a
snowshoe hare might use a snowmobile trail and how because we have given it
this trail to work with, it's not having to jump through deep snow and it's saving
itself energy. For me, that clicked back to the leave no trace thing. How we're
impacting the ecological community, just by having a Nordic trail or having a
213
snowmobile trail, because these animals will use it. (Student 201, 11th grade,
Case 2)
When I asked during the interview Nick did not realize that his thought process was
paralleling those of experts in the field, it was simply an interesting observation to him,
and one that he continued to inform with later observations. His interest and observations
combined with the facilitated learning opportunities of the class allowed him to extend
his knowledge to a higher level. It seems unlikely that this same scenario would have
played out without either the peripheral or the facilitated learning opportunities that were
available.
In the previously discussed example of learning about the tides in Case 4, the
students used a variety of peripheral and facilitated means to come to a complete
understanding. One student sought to go further after independently observing how
drastic the tidal change was where we were staying and where perhaps 400 meters of
ocean floor were bare at low tide:
After Paul’s demonstration in the evening...or he gave his demonstration in the
morning, but in the evening I realized that I'd only seen the...like the tide went in
and out pretty drastically, where we were staying. And the only other ocean or
beach I'd really been at was at a sea, and so I was wondering if maybe I just hadn't
spent that much time there. I kind of thought maybe a smaller body of water has
less of a visible tide than a big body of water. I asked Paul about that and he kind
of confirmed that. (Austin, Student 405, 11th grade, Case 4)
214
Again, Austin’s learning sequence began with a facilitated lesson, was pursued
further based on a peripheral observation and moved further still with a student-initiated
facilitated conversation with the teacher. In this case it also seems unlikely that Austin’s
realization would have happened without both the facilitated and peripheral
opportunities.
When students were given choice in the assignments they were given or the
research they needed to conduct, they often described how their choices were driven by
peripheral events that had piqued their interest. In this way, they informed a facilitated
aspect of the class based on their peripheral experiences and extended their understanding
of a concept beyond the level facilitated by the teacher. In the following exchange
Ashley from Case 1 explains her choice in such a project:
Ashley: we saw a bobcat while we were in class the other day. It was really cool.
Mike: You were sitting in the building and you saw it?
Ashley: Yeah, you know where the (classroom building) is? Well we were sitting
in the door that's facing west and the windows and we saw the bobcat like walk
by. And it wasn't even scared of us. It was cool… Everybody was all excited.
They were like “oh my god, it's a bobcat!” Only half of us saw it so it was cool. I
was like "yeah, I saw a bobcat." Then I decided to do bobcats (for an assignment)
because we had to pick from like an elk, a bobcat and a bunch of different animals
and I was like oh we saw a bobcat so I'll pick that. (Ashley, Student 105, no
grade levels, Case 1)
215
Environmental Components
In the previous sections evidence of student learning was presented as framed by
the roles of facilitated and peripheral learning opportunities. The contributions of the
environmental components outlined in the DIAL conceptual framework (Appendix B)
were evident in much of the data presented, though it was not highlighted. One could
rescan those passages and note the influences of social interactions, the physical
environment, tools, and individual/affective factors in each pattern of learning
opportunities. For example, there is a strong relationship between the facilitated
opportunities and social interactions, between peripheral opportunities and the affective
component, and between the combination of peripheral and facilitated opportunities with
the physical environment. However these are not exclusive relationships.
In the following sections evidence is presented that illustrates the role of each of
the environmental components from the DIAL framework on student learning. The
patterns that are presented in this section are the themes that emerged in multiple student
interviews across all of the cases through the process of pattern-matching logic (Yin,
2009)during cross-case analysis. The emergent patterns were considered against the
theory presented in the conceptual framework (Appendix B). Because the data did not fit
the conceptual framework perfectly, they are presented here with some small changes to
the organization to reflect the evidence that supports the conceptual framework as well as
the evidence that does not. Evidence describing the roles of (E1) social interactions, and
the (E2) physical environment are first presented. Very little evidence suggested a role
for non-academic tools in these four cases and therefore the role of (E3) tools is presented
as one category. The role of culture was also very difficult to detect or disentangle from
216
the social component with the methods used. As such, the few detected cultural elements
are presented in conjunction with the social elements. Similarly, the emotional surround
was difficult to detect. However, there were strong individual emotional connections that
came up and these were associated with a much more complex set of (E4) individual
learning factors and processes than what was proposed in the conceptual framework.
Supporting data are presented in sections on the general (E5) emotional component
following the discussion on individual learning factors.
E1 Social interactions
Based on both the frequency that students mentioned the social component of the
learning environment in conjunction with their learning and the directness with which
they made connections between learning and social aspects, the social component of the
environment was the most prominently represented contributor to student learning for
most of the students in these DIAL cases. For the purposes of this study there was no
distinction made between formal and informal social interactions, though all of the
interactions that were coded and that are described here contributed in some way to the
learning of the TSCs. Even when other factors were involved, students often referred to a
social interaction that added to their learning process. Figure 5.1 shows code frequencies
of the most common social code references applied to the collected data. These were
descriptive codes that were applied to the transcripts prior to the delineation of the
“concept unit” unit of analysis and thus reflect all references that students made within
each of the social component categories across all four cases. The distribution of code
frequencies in this case accurately reflects the relative importance of each of the codes.
These codes were later aggregated into broader pattern groups that are discussed below:
217
(E1.1) teacher-student interactions, (E1.2) group interactions, (E1.3) peer-to-peer
interactions, and (E1.4) cultural interactions.
E1.1Teacher-Student Interactions
The codes “teacher said…” and “we talked about…” were prevalent across the
cases and usually indicated a direct, top-down transmission of information from teacher
to student. Even though students’ sentences would literally begin with the phrase “we
talked about…” they would then indicate that the situation was actually more teacher-
centered than it was balanced discussion. As many of the quotes within the facilitated
Figure 5.1. Frequency of descriptive code references within the social interactions code group before transcripts were divided into units of analysis for inferential coding. Includes all 4 cases.
218
learning opportunities section show, the students relied very heavily on these traditional
teacher-student interactions as they learned the TSCs. This was true regardless of where
the learning took place. There does seem to be the sense from students that these types of
interactions with their teachers were an agreed upon exchange of information rather than
a mandate to receive information. They spoke of receiving information from their
teachers as a natural course of action and none of the students described lectures as a
burden . Vern described the interplay that he perceived between the teachers’ and
students’ roles in these interactions: “there's a lot of effort put in by Jacob to introduce
that kind of stuff, but to me it felt like, if you weren't interested in it, like with anything
else, you wouldn't be able to pay attention” (Student 107, no grade levels, Case 1). That
is, he seemed to see the teacher as having the specific role of delivering information but
that students were only capable of learning that information if they had some interest in
it. This was a uniquely expressed viewpoint amongst the cases though almost all of the
students spoke of receiving information verbally from the teacher and ascribed some of
their learning to this pathway.
As was also previously described (section F1), the teachers played an important
role in helping the students to notice and interpret their environments through guided
observation. In the two cases in this study where local experts were brought in, the roles
those experts took on, as described by students and teachers, were more aligned with
teaching as an expert rather than working as an expert and so these codes can be added to
an understanding of how teacher-student relationships informed the learning process.
In some cases described by the students these teacher-student interactions were
used to facilitate formative assessment, such as when teachers would quiz students in the
219
field on identifying organisms or processes and then fill in the gaps in the students’
understanding. Students reported these interactions to be good learning experiences as
well. A student from Case 3 described his experience with them during his DIAL
experience:
I think that it was just like implanted in our heads in the classroom and then when
we actually got into the field, we would talk about them (the TSCs) and then we
would know what we were talking about. We were just put in that situation of
“what is this tree and tell me how you know”, you know. “Look at the bark, look
at the needles, how many packets- I mean how many needles are in each packet?”,
you know. “Tell me about the berries, tell me about the cones”, all that kind of
stuff, you know. And once we figured out what kind of tree it was, I mean of
course there was just a bunch of questions running through your mind like, “oh I
wonder what the adaptations are for?” (Jason, Student 103, no grade levels, Case
1).
Not all social interactions described by the students involved the direct
transmission of information, nor verbal exchanges at all. Students also described the
teachers modeling learning and actions for the students. Although this passage is focused
on paddling technique rather than learning science, Teddy describes an alternative way
that he learned from the teacher and guide: “I learned by listening to them and watching
them probably. By watching Kevin and Paul paddle, made my paddling better” (Student
407, 9th grade, Case 4). As described above (section F6) students noticed how teachers
modeled the practice of inquiring into the environment they were exploring together and
how they conversed with other experts when they were available.
220
The roles of the teachers during these DIAL experiences was described by
students as being quite different than one might experience with a classroom teacher,
even these same teachers when they were in the capacity of classroom teachers. Teachers
were often described as either “parental” or “more human” than normal. In an
impromptu conversation during the Everglades trip Mei (12th grade) and Anna (11th
grade) described to me how they liked that during these DIAL experiences the teachers
still acted like teachers at times but other times they joked around and were less intense.
Teachers in all of the cases were described by students as being very approachable and
easy to relate to though students other than Mei and Anna did not specify whether these
traits were qualities that they always noticed in these teachers or if the qualities were
somehow enhanced during DIAL experiences.
E1.2 Group Interactions
Based on the frequency and quality of student descriptions of their learning
processes, group level interactions were much less important than the teacher-student
interactions but they did register as contributing to learning. It was difficult to compare
small group and large group interactions because three of the four classes were small
groups already. Some students described valuing the perspectives and insights of other
students, though when asked directly, very few of the students could cite any cases of
learning from other students. It is possible that students may not have recognized the
degree to which group learning was happening. One student described her perspective of
the interactions in a typical classroom session from her course: “in class when we're
discussing, people ask a lot of really good questions. So it's not so much learning new
stuff that they bring in, but just learning from the questions they ask and then Ryan
221
answering the questions or even other students attempting to answer the questions”
(Kelsey, Student 230, 11th grade, Case 2).
Perhaps the greatest disconnect between the interview data and the data that I
collected in the field with Case 4 involved the role of the group in influencing the
learning of individual students. As in the other cases, students in the Everglades class did
not attribute much of their learning to group or peer-related interactions but in my field
notes I recorded many instances of this type of social learning. Teddy (Student 407, 9th
grade), for example, became enamored with roseate spoonbills, a rare and charismatic
bird with a pinkish hue and a large spoon-shaped bill that they use to filter food out of the
mud. Teddy is an avid hunter and though the spoonbills are not a game species, he was
able to notice them and most other wildlife before anyone else. The few times we did see
them he would point them out, ask questions about them, and get the other students
involved. At one point the canoes were lashed together to form two catamarans. When
Teddy’s group passed some feeding spoonbills they excitedly pointed out and discussed
how the birds were using their bills and other behavioral characteristics. The other group
noticed the birds but then quickly returned to a social conversation. Later, in the
interviews, all of Teddy’s group indicated being interested in the birds while none in the
other group did. It seemed as though Teddy served as a catalyst for their interest but they
did not recognize his role in it. There were a few other cases where I noted significant
peer-influenced, group learning during my field observations that were not described as
such during student interviews either during or following the DIAL experience. It is
unclear if this disconnect was isolated to Case 4 or if students across the cases did not
recognize peer/group influence on their learning.
222
There were a few other situations in which students described group problem
solving or interpretation as being beneficial to their learning, particularly when they were
working in small groups without an instructor present. Kelly described an exchange
resulting from an animal tracking activity they did: “we'd be outside and we'd see
footprints and I'd say ‘oh it's a cougar’ and then we'd get into this heated discussion about
it and then it turned out it was the snowshoe hare we saw minutes ago. It was the same
prints because a snowshoe hare has really big feet” (Student 106, no grade levels,
Case 1). It was the group exchange that helped her detect and correct her originally
erroneous interpretation of the tracks she was seeing.
In a very similar encounter in Case 2, Mitch also described being corrected on
identification of a track but through another student using a field guide as evidence. In
each of the Cases 1,2, and 4, students described this type of group problem solving to
interpret their surroundings, usually as a facilitated activity but at times it happened in
passing. It did not come up in Case 3 but students in that case also did not discuss any
individual problem-solving. During my field observations I noticed many examples of
brief exchanges between small groups of students as they worked together to identify
what they were seeing. Dante (Student 406, 9th grade) was particularly adept at learning
to identify an organism from a single interaction with the local expert and then sharing
the information later in a small group. In one notable instance he demonstrated to a small
group how the large snail he was holding was a channeled apple snail (invasive) rather
than the native apple snail. This was a peripheral event. I do not have any data indicating
that students ever took that to a higher conceptual level beyond identification of
223
organisms or behaviors though all of the students in Case 4 accurately discussed invasive
species as they talked about their PFnets in the interviews.
E1.3 Peer-to-Peer Interactions
As with Teddy’s roseate spoonbills, individual students would take an interest in a
particular idea or individualized assignments would lead them there. All of the students
on the Everglades trip, for example, were assigned a research topic that they were
expected to present at some point in the trip. They each spent an hour or less before the
trip preparing for it and so most were lackluster. A few were higher quality and other
students cited these talks as being informative. In particular, Thomas (Student 403, 11th
grade) presented on the natural history of epiphytes (air plants) and a few students cited
that presentation or follow-up conversations with Thomas as the chief way in which they
learned about those plants, despite the topic being heavily discussed throughout the trip.
It is unclear and difficult to detect if or to what degree students were motivated by
their peers. It is probably difficult to detect even within oneself. It is worth reporting one
interview segment in which Daniel candidly explains the role of his peers in his own
motivation:
Daniel: I felt like in the tree part we went really quick and I wasn't able to learn a
lot of it. When we did our first assessment, some of the other guys knew
everything, and I was like “how the hell do they know this”. And I just found they
just became really interested in it and I started asking them, I was like “what do
you like about the tree adaptions (sic)?” and they would start telling me all this
cool stuff and I was like “that does sound pretty cool” and that's when I started
getting more interested. Just following the crowd I guess.
224
Mike: And were those interactions happening in class, or in the field or outside of
class?
Daniel: In class, out of class, talking while we're hiking, just everywhere. Always
trying to talk to people about why they think the class is fun. (Student 102, no
grade levels, Case 1)
Again, there were a few cited instances of students seeking out help from other
students, particularly for skills such as skiing and clarification on assignments, but it was
not commonly discussed in the interviews. As with the group interactions, it seems likely
that there were more peer-to-peer supports than the students realized.
E 1.4 Cultural Interactions
As discussed in Chapter One, the cultural component of the conceptual
framework does not try to capture culture writ large. The component is intended to
account for cultural elements of the environment that are novel for the students and
related to the target concepts, as might be experienced while students worked on a project
with practicing scientists or while immersed in another culture. This component rarely
came up directly in the student interviews or it was not made clear through the analyses I
conducted. It could be argued, and situative learning theories would suggest that cultural
elements were operating in the background, determining such things as the student-
teacher relations and the relationship between students and the origins of knowledge but
these background levels of influence were beyond the scope of the study.
There may have been some manifestations of learning that could be considered
cultural in the field observations I made but their influence seemed minimal based on my
225
observations and their absence from the interviews. Kevin, the guide/local expert,
seemed to approach the Everglades from a natural history perspective in which there
were human and non-human members who all had identities and life stories. The
instruction that I observed him providing was typically providing oral mini-lessons and
stories to the students when some environmental cue such as a particular place or species
presented itself. During a mid-trip interview with Kevin he presented his viewpoint of
the environment as containing stories that could influence the student’s trip through it.
He did not seem to see the environment as providing examples of broader ecological
concepts as Paul, the teacher, did. For example, when teaching about tides, Kevin
focused heavily on what that meant for paddling, travel, and camping while Paul focused
on using those observations to understand the big picture of tidal fluctuations. Students
associated both perspectives with important learning of relationship between tides and
other TSCs.
E2 Physical Environment
Second to social contributions, the physical environment seemed to be the most
heavily cited and valued source of learning for the students. Figure 5.2 shows the
frequency of descriptive code references assigned to the data in this study. These codes
were used in the preliminary coding process and were later organized into three thematic
categories describing how these elements contributed to student learning: (E2.1)
providing evidence of concepts, (E2.2) embodied experiences, and (E2.3) geographic
cues.
226
E2.1 Visual Evidence of Concepts
Across all of the cases the physical environment was described by students as an
important contributor to their learning. In the majority of described instances, the
environment provided evidence of concepts that students learned in lectures, readings or
through otherwise formal means as was described above in the “completing the picture”
(B1) section. Whether facilitated or peripheral, there were a number of ways that the
physical environment was seen by students to provide evidence of the TSCs. First,
students discussed seeing direct examples of the TSCs, giving them a personalized visual
image to attach to the concept, as in this example:
Figure 5.2. Frequency of descriptive code references within the Physical Environment code group before transcripts were divided into units of analysis for inferential coding. Includes all 4 cases.
227
What gave me that connection was seeing it (an air plant) attached to those plants
in person and seeing its connection to the environment, like seeing the strap fern
or the vanilla orchid, those that were attached to the actual trees themselves rather
than just having this concept. I can actually relate them by seeing them together”
(Thomas, Student 403, 11th grade, Case 4)
In Case 4 students described having difficulty with visualizing the role of human
impact on the Everglades but when Jake did find some evidence, it stuck with him: “The
logging that we saw when we did the swamp hike, like we saw the stumps where there
had been logging like a long time ago” (probably 70 years, Student 401, 11th grade).
When I asked Jake in his interview about human impact, one of the TSCs for his course,
that was the image that first came to mind for him. Other students in Case 4 recounted
different images that reminded them of the human impact TSC and allowed them to begin
their discussions of how human impact was related to other TSCs. Related to the same
TSC of human impact Jake also made connections to niche and invasive species, but not
immediately. It took a series of observations throughout the ecosystem:
Jake: We are introducing invasive species and making some species go extinct so
it's really connected. Niche and invasive species I connected because invasive
species are kind of taking over niches and driving other organisms out of their
specific niche.
Mike: Was there any one moment where either you or something you learned
connected all of those things to niche?
Jake: I think it happened or it happens throughout the trip. Really like before, I
never really had known all of how these things have their own niche and how they
228
kind of affected everything and have their own place in it. I think it happened a
little by little during the trip… I think I just understood it more and more because
I think when I did niche in school it was kind of a basic understanding of it.
(Student 401, 11th grade, Case 4)
Not only did Jake find evidence to build a deeper understanding of a concept from
this course but the visual evidence he accumulated allowed him to extend his learning
from a previous class. He held what sounds like a declarative understanding of the
concept that became a much more nuanced, schematic understanding of niche. As he
describes it, this change was largely due to the accumulation of visual evidence across the
duration of the course.
The process of looking for visual evidence also seemed to foster the development
of procedural knowledge of how to make detailed observations, a requisite skill in
science (N. R. C. NRC, 2012). When students were guided through observations they
began to do so on their own as well. This was a common theme in my field notes of Case
4 and is described by Joseph here:
(I learned) how to pay more attention to my surroundings I guess. Like the colors,
texture, the leaves, the pines, the cones, the animals, the season, everything. And
just realize what they go through. What the animals and plants go through because
they are all living organisms. Just learning that was amazing. Just being more
aware of your surroundings. (Student 108, no grade levels, Case 1)
229
In Joseph’s case the procedural knowledge of observation also supported his
understanding of adaptations, one of the TSCs for the course, as he begins to describe in
the above passage. In all of the classes observation was an instructed and assessed skill
according to the teacher interviews. Even when information was first presented through
traditional means, students described relying more heavily on their own observations,
suggesting they were in some way more powerful or complete than transmitted
information. In the following dialog, the student describes his assumption of how what
was presented in the classroom was somehow wrong or incomplete and how he was
surprised to find that was not the case when he was able to make his own observations in
the actual context. His observations confirmed what was taught in the classroom:
Mitch: I guess the idea of when snow crystals facet they're actual small pyramids
and I thought it was more of an abstract idea where it's not really like that but
when we looked at the snow layers we had some really huge clear facets and it
was actually really amazing to see.
Mike: Why was that amazing or surprising to you?
Mitch: In class when we talked about it, it was drawn on the board. I guess I didn't
really.... I thought they were more solid and instead when we looked at them they
were hollow in the middle, which was kind of a cool thing... Like a little cup.
Mike: And you could see that with a magnifying glass?
Mitch: Yeah, the snow crystals we got were huge. (Student 207, 11th grade,
Case 2)
230
Natural processes, which often need to be abstracted to be taught in the classroom
were instead observed directly by students during these DIAL experiences and they
reported that the observations supported their understanding of the related concepts. In
this way students could pick out complexities within those processes lost through
abstraction and also see realistic versions that are not overly dramatized as they might be
in a video, for example. Students could see the dramatic plunge of an osprey as it caught
a fish but also saw the more realistic events in which the bird missed a few times before
finally succeeding.
Prior to the Nebraska trip Jared had completed a research project on bird flight
and he described having a good sense of the science behind it but he also described how
seeing the actual process helped him understand the concpet much better:
When I originally read about Bernoulli's principle it made sense to me, like I got
the theory down, but I didn't really picture it in my head. I got how it worked, but
then seeing it, I was able to visualize how it would work. 'Cause their wings are
curved like this. You know, air has to move faster over the top to meet up with the
air on the bottom. So... it made...it brought it together. Like I had thoughts and
then I could put an image to those thoughts. A more defined image...refined
image. (Student 305, 9th grade, Case 3)
When snow science is taught, dramatic examples of avalanches are often used but
the reality is typically subtler. In the next quote a student from Case 2 describes a
process related to snow metamorphism, one of the TSCs, that he observed while in the
field. To describe the phenomenon to a class would not be very riveting but for this
231
student, seeing this fairly subtle process and knowing what had caused it was an exciting
moment:
Mitch: We've talked about snow compacting, where all of a sudden the surface of
the snow will compact… We actually saw that happen when we were walking
five minutes that way, and it was really cool to see.
Mike: What did that look like?
Mitch: It's like, if this is the snow right, it's like a jagged line of snow, it just goes.
A certain section of it just goes down.
Mike: So like settles lower than the surrounding area?
Mitch: Yeah. Only like a half inch but it's still really cool to see. (Student 207,
11th grade, Case 3)
It seems unlikely that Mitch would have noticed the event if he had not had the
knowledge of snow compacting and as he describes it, he may not have had the
appreciation for the information without also seeing an example of it in context.
Students also described being in the field and interpreting evidence of former
processes to extrapolate back , again helping them to better understand the TSCs. In
Cases 1 and 3 many students talked about animal tracking activities helping them to
understand the lives and adaptations of the animals. This use of evidence was common in
both facilitated and peripheral opportunities to learn.
A final way that environmental evidence seemed to contribute to learning was
through the illustration of relationships. Some of these described relationships were
simple such as air plants growing on trees, or birds gathering around alligator wallows.
Students also described more complex relationships that they detected, suggesting the
232
importance of being able to experience and see how an idea fit into a much bigger
scheme. In all of the cases students implied how that helped them to develop an
ecosystem-level understanding, though they also tended to struggle articulating this idea:
“I guess you could kind of just ...it was more... you kinda see the scale of everything, how
many birds there actually were and you could hear it a lot better” (Meghan, Student 304,
9th grade, Case 3) and “I guess the thing is when we were in the blind, there were literally
thousands of birds flying in all around us. It gave me actual, sort of, real world context
about what this was and why it's so important” (Nate, Student 309, 9th grade, Case 3).
E2.2 Embodied Experience
In three of these four DIAL experiences, students described learning some
concepts in an embodied way. Moving far beyond simple kinesthetic learning in which
some physical movement is incorporated into a lesson, students fully and physically
experienced tidal changes by paddling against them, experienced behaviors and materials
that allow organisms to resist the cold and desiccation of winter, and other topics. The
students in Case 3, the crane migration class, did not report any embodied experiences.
The most heavily cited example of a concept that students physically experienced,
reported in Cases 1and 2, was thermal conductivity and the resistance to cold. This
physical embodiment of the concept occurred in both facilitated and peripheral situations,
as in this report in which the student describes how different materials affect thermal
conductivuty:
So talking about thermal conductivity we... I've been sitting in snow with just
basically a base layer and then snow pants on and then also with fleece pants and
snow pants, and there's a huge difference. And then also the sit pads that we had,
233
which are basically 1/2 inch thick foam pads, those help a ton with conserving
energy. (Mitch, Student 207, 11th grade, Case 2)
Kelly (Student 101) described the embodiment of the concept simply as “you are
one of the animals” to explain how she came to understand how animals have adapted to
the cold conditions. According to students, in a simple exercise, Ryan, the teacher of
Case 2, had them stand outside with one shoe on and one shoe off to illustrate the
difference in conductivity even a very thin sole can make. Tara explained how that
simple, embodied activity helped her to grasp the idea of applied thermal conductivity:
Tara: One time we took one shoe off and that was to talk about insulation… we
went out onto the porch with one shoe on. Ryan doesn't mind the cold, which is
weird, but everyone else does. And so then you're like, “so now your foot is
freezing and the other one's not, why?” So it's different than “IF you went outside
your foot WOULD be cold”.
Mike: Is that a big difference for you?
Tara: Sometimes.
Mike: Why is that?
Tara: 'Cause things can make more sense if you're experiencing them and you can
talk about them more accurately without hypothesizing about what it would be
like. You know exactly what it's actually like. (Student 224, 11th grade, Case 2)
In another lesson Ryan was teaching about seasonality and how the angle of
incidence of the sun’s rays on the atmosphere is what determines the amount of thermal
234
energy available (as described by Ryan in his post-DIAL interview). Rachel reflected on
that lesson:
Rachel: I think because we were outside it was… we're in winter it registered
more than it would have inside the classroom.
Mike: Why do you think that is?
Rachel: Because we could feel the sun and it's sunny but it's also really cold and
you’re sitting in the snow. It just registers on a lot of levels that it probably
wouldn't if you were just sitting inside. (Student 204, 11th grade, Case 2)
The discrepancy between what her eyes were telling her and what her body was feeling
helped her understand the target concept.
Experiencing the tidal changes (Case 4) was described earlier in the chapter. Also
in the canoes, the students of Case 4 experienced the density of the mangroves and what
it would be like to live in that ecosystem, including the difficulties caused by heat,
dampness, mosquitoes, and the diversity of other life. Anna describes making her way
through the mangrove tunnels:
I think it was the first day we started canoeing through the mangrove tunnels, not
in the beginning because they were really cut down and stuff, but then afterwards
when we canoed through it and we had to push the sticks away and get stuck, and
there were spiders and I kind of liked that (the whole experience). (Student 402,
11th grade, case 4)
235
Through directly experiencing the difficulties of trying to paddle through that
ecosystem, Anna and other students described developing a better sense of its structural
complexity and both the difficulty of living in that ecosystem and the many niches within
it. Students in Cases 1 and 2 also described their difficulties with traveling through the
snow and how that led to an appreciation for animal adaptations for doing so. On the
much-anticipated, or much-feared swamp hike at the end of Everglades trip students
described going in with expectations that the ecosystem would be an endless body of
water with malevolent elements trying to do them harm at every turn. By leaving the trail
and hiking through the swamp, students seemed to discover that it was not a bottomless
pit and that they could make their way through the water and patches of dry land to
successfully traverse the ecosystem. In my field notes and videos for that day I
chronicled that gradual change in students as they became more accustomed to the
environment and their discussions and actions became less hyperbolic in reaction to the
environment. At the beginning of the hike students were jumpy and spoke almost
exclusively of pythons, alligators, and spiders. By the end of the hike they were walking
more assertively and discussing the plants and more benign features of the ecosystem.
The embodied experiences seemed to allow the learners to use all of their senses
to interpret their surroundings. Students recalled using all of their senses within the
DIAL experiences, including smell from time to time. Joseph described a multi-sensory
experience in trying to identify a tree during an assigned task: “we looked around the
tree, we didn't know. We went ok, so how does the bark feel? How does the color look?
How does the pines look? What's the elevation of this area?”
236
E2.3 Geographic Cues
Another consistent theme that emerged across the four cases as students discussed
their learning was the connections they made between their understanding of concepts
and specific geographic places where they learned it. Particularly for Case 4, in which
the students visited many places, but also for the other cases, students quite often
described their learning as situated in a specific place. Their descriptions implied a
narrative and contextualized understanding of the concepts they spoke about but they did
not seem to then only associate a concept with a given place. Rather, the place seemed to
provide a memory stamp that helped them access and communicate the idea and to recall
a specific event or visual sequence. It seemed to be a tool they used to help index their
knowledge, if inadvertently. I asked some of the students to try to articulate this process
when they mentioned it. The following is an example of a resulting dialog:
Robert: I guess I would have understood it if we hadn't been outside, but
definitely not as well, and it definitely helped me remember and fully understand
it.
Mike: So when you think about that concept now, do you think about.... do you
put yourself back in that place? Or do you think of it more abstractly?
Robert: I guess I don't go back to where we were in the woods but it just sort of
helped me understand it really well. I guess it just sort of cemented the ideas
rather than drew me back to a place where I could…”Oh this is where I was, it
must be that”. It sort of is hidden back in my mind somewhere that it's just like
this. I don't know how to put it in words. (Student 215, 11th grade, Case 2)
237
The students tended to use to these geographic memory stamps with novel
settings and seemed to use them in such a way that one place was associated with one
concept. While these associations were individualized, there were some places that
multiple students associated with a given topic. There was one particular camp in Case 4
that students connected to understanding pneumatophores and another camp that students
associated with tides. One of the blinds that Case 3 students visited was more associated
with understanding flight while another one was associated with understanding crane
behavior.
Moving through a landscape or moving from one landscape to another also
seemed to support student learning by providing contrast between places that emphasized
different aspects of a concept, as in this instance:
I think I was skiing on-one day-I don't know what happened but I was skiing and I
was just thinking to myself and I was looking at the trees because we were trying
to figure out which tree was which and I was thinking “well it can't be this tree
because this tree wouldn't survive in this environment” because I mean we were
high in the park (elevation) and there is- I don't remember what tree it was but
that tree is at Bald Mountain Academy so it's on campus there but I was thinking
it's not going to be able to survive that high in the park because it's branches won't
be able to hold up the snow. (Kate, Student 101, no grade levels, Case 1)
Based on their descriptions of their learning experiences students often seemed to
be wrapping their understanding up within a geographic context that made the concept
real for them. They tended to explain the TSC(s) at a schematic level when they could
238
fill in the full narrative of a concept’s application with specific examples. When asked to
recall the information, the geographic place was often recalled with it. To search back
through the previous quotes, one can find many examples in which students refer to
specific geographic places as they explain their understanding of various TSCs.
E3 Tools
Students indicated using tools and resources to help in their learning of the TSCs.
Figure 5.3 shows the relative use of the most commonly referenced tools. Again, these
data reflect frequencies of descriptive codes assigned prior to the inferential coding stage
and represent the four aggregated cases. There were no patterns of tool use that clearly
emerged in the cross-case analysis other than the broad idea that students did report using
various academic tools in their learning processes. The pattern-matching analysis within
the cross-case analysis did not support the prediction within the conceptual framework
(Appendix B) that non-academic tools would play a significant role in science concept
learning. Rather, students made few references to non-academic tools in relation to the
learning of TSCs. Even the 11 references reported in Table 5.3 represent very loose
connections between the tools and the TSCs.
239
Student descriptions of tool use were overwhelmingly facilitated rather than
peripheral though there were a few instances of students finding and using tools on their
own, such as park signage. Most of the references to the tools that students used cited
assigned readings, videos, and notes that were written on the board. As such, students
described these as more often used in the more formal settings of classrooms or as
homework. Even in Case 3, in which the group traveled to the natural habitat of the
cranes, students described learning much of their declarative knowledge within a
classroom at the Audubon Center where the local expert showed videos and wrote notes.
One student from Case 2 described a PowerPoint slide that she connects to her
understanding of thermal conductivity:
Figure 5.3. Frequency of descriptive code references within the academic tools and non-‐academic tools code groups before transcripts were divided into units of analysis for inferential coding. Includes all 4 cases.
240
The image that comes to mind most is the Power Point image of an elk standing in
the snow and there are arrows going in and out, for insulation, metabolism, and
then there's also the heat loss through the feet, through the contact with the air,
and that sort of thing. (Student 224, 11th grade, Case 2)
When tools were used in the field, they seemed to take on a supporting rather than
a central role. Students described using thermometers to measure temperature within the
snowpack and shovels to access the layers of snow. Field guides and dichotomous keys
were used to identify trees. Skis and canoes were used to move through the environments
and students and teachers described those vehicles being used to illustrate concepts such
as tidal changes and snow crystallization. All of these tools seemed to remain in the
background and none were identified by teachers as important learning tools. A couple
of the teachers described bringing small whiteboards or printed pictures into the field to
illustrate concepts or write important notes when needed and some students refered to
these during their interviews. In the following passage, Vern describes a learning process
that was dependent on the tools at the various stages but they are not heavily
acknowledged and become an important part of the learning environment background:
It was near the end of class and we were kind of reading. We went out into the
park with shovels and we shoveled out snow. What we were trying to get to
exactly was the bottom of the ground. It was about 5 1/2 feet and 2 big around.
Jacob was explaining there were different layers. So we were taking, we were
testing the rigidity of it so the top layer was kind of soft. The middle was kind of
hard. It was just more packed. We were taking temperatures of the different
241
levels. For the surface it was pretty cold. Near the middle it was warmer. And
then when you get lower into the ground it's still pretty cold, 'cause the earth is
kind of a conductor. So we were learning about that and we came back to class
the day afterwards and he gave us a sheet and it was like, “nivean means snow not
lotion”. And it was explaining how they're different layers of snow and they all
have different terms. And so there's the supernivean which is the top layer.
Subnivean and then the 3rd one I seem to have forgot. (Vern, Student 107, no
grade levels, Case 1)
In this sequence the group needed skis and related equipment, shovels,
thermometers, notebooks, pencils, and the worksheets to make it happen. We can assume
the tools fundamentally changed the experience by considering what the experience
would have looked like without them but in the student’s description the tools were part
of the background rather than critical elements of the lesson. This illustrates the
possibility that tools played a more important role than I was able to discern from the
interview process.
As described in a previous section of this chapter (F5), teachers readily co-opted
available materials to use as demonstration tools when needed: balls and students to
represent celestial bodies, water bottles to simulate thermal conductivity in organisms and
tidal changes. Associated with the theme of geographic links to learning (see section
E2.3), students and teachers described the regular use of maps in the four cases, both for
planning travel and for helping students to understand landscape-level concepts such as
water flow through the Everglades or trans-national migration of the cranes. In one
242
sequence captured in a video from the Case 4 field study, the guide gathered the students
around a nautical chart of the area they were traveling through and the group
spontaneously created a TSC referenced narrative of the events that unfolded as they
retraced their route. They then used the map along with a tide chart to predict and plan
the best route and timing for the next day.
E4 Individual Factors
Within the DIAL conceptual framework (Appendix B) the individual learner
contributes to a situated learning process through representation, indexing, and higher-
order processing. In this section some evidence is presented on how indexing and
processing seemed to contribute to students’ learning in this study. However, in the
cross-case analysis, it became clear that the patterns as they are presented in the
framework were not well supported by the data across these four cases. Rather, there
seemed to be a collection of learning processes that could be described as being attached
to the individual learner instead of to the whole learning environment as are the other
identified contributors to learning. To use Perkins’(1993) terms, there were
manifestations of the learning process that were associated with the person-solo rather
than the person-plus. These have been included into the heading of Individual Factors
that influenced learning in this chapter. Figure 5.4 shows the frequencies of the
descriptive codes that were used to define the themes of individual learning processes
that emerged from the data. Some of these code references, including application and
personal discovery were discussed in previous sections (sections B3 and P1, respectively)
when they were closely tied to learning opportunities. The development of deeper
understanding is related to many of the other codes and has been referenced throughout
243
this chapter. The pattern themes (E4.1) of individual reasoning and internal reflection,
(E4.2) writing and verbal articulation, (E4.3) linking across events, and (E4.4) making
connections to past learning were informed by these descriptive codes (figure 5.4) and
emerged as consistent trends through cross-case analysis. These themes are described
below.
Figure 5.4. Frequency of descriptive code references within the individual processes code group before transcripts were divided into units of analysis for inferential coding. Includes all 4 cases.
244
E4.1 Individual Reasoning and Internal Reflection
It is well beyond the scope of the study to understand student thinking processes
in much depth. Rather, the goal for this aspect of the learning environment was to
develop some sense of how these processes of the individual learner interacted with the
other components of the learning environment. It is clear from the data that these person-
solo-centered processes were informed by and, in turn, informed the other environmental
contributors to learning in these four cases. For this study, the individual reasoning code
indicated a student-described process or event in which they indicated needing to reason
through a conceptual connection or in some way add an extra layer of thinking or
processing to make sense of incoming information. This was a fairly common code
across the four cases. The following passage came at the end of a dialog with Heather
about a realization she came to regarding migration:
Mike: And how did you learn about that?
Heather: More of my own mind figuring it out.
Mike: Do you have any sense of when that came to you?
Heather: Well yeah. Jennifer was drawing out a chart of when and where they (the
cranes) are. At what times of the year, and I just kind of noticed...I started
thinking about why they migrate and it's obviously because they can't survive in
the cold in the winter up in Canada, and they can't...it's too hot for them down in
the south in the summers. So kind of tied in with habitat. (Student 301, 10th grade)
Another student captured the role of individual processing in his learning:
245
He (teacher) teaches it to you but then I guess you sort of have to come to a
certain point of realization to fully understand the concept. He brings you 99% of
the way but then that last 1%, to really have a full understanding of the concept,
that sort of has to come from within, I guess. (Robert, Student 215, 11th grade,
Case 2)
These two examples reflect an interaction between directly facilitated learning
opportunities and the individual students’ role in processing the garnered information
through a unique thought process. Peripheral and synthetic learning opportunities were
also involved in cited instances of individual reasoning interacting with information from
other elements of the learning environment. In contrast, a number of students also
described the purely abstract development of understanding about a given concept by
learning how other concepts related to it, and without ever being taught about the original
concept. Ashley describes one such sequence in which she is referring to a conclusion
she correctly came to as a logical certainty born of learning the related concepts:
If the trees didn't stop growing in the winter, then it would die because it would be
cold and it wouldn't have enough nutrients because the sun doesn't shine a lot.
And I don't know-yeah I guess I got to that by learning everything around it.
(Ashley, Student 105, no grade levels, Case 1)
By learning about photosynthesis, seasonality, and snow load, Ashley pieced
together the reason why trees stopped growing in the winter. Though this information
246
was generally available as declarative information, Ashley reasoned it out into a
schematic understanding through her own logic processes.
The Internal reflection code was used somewhat differently, to indicate instances
where students recalled thinking about or reflecting on an idea in the moment, when they
learned an idea rather than a more general sense of having processed the information.
The previously used example of Austin (Student 405) reflecting on past places where he
had seen tidal changes and thinking about the relationship to the size of the body of water
is a good example of this. As in that case, reflection was often associated with a
peripheral learning opportunity, though the teachers in all of the classes also assigned
reflective journal prompts and thus encouraged this type of processing. Like instances of
individual reasoning, internal reflection could be considered a person-solo phenomenon
that occurs within and is influenced by the person-plus. Student descriptions in this study
usually described the internal processing and the external influence as asynchronous.
Internal reflection was also described by students as being helpful for keeping the
momentum of their learning progress. One learning event would lead to reflection which
would then lead to new hypotheses or questions and so on, as in this instance:
Once we figured out what kind of tree it was, I mean of course there was just a
bunch of questions running through your mind like “oh I wonder what the
adaptations are for it?” you know. And just like that kind of stuff. (Jason,
Student 103, no grade levels, Case 1)
There can be no doubt that the role of the individual learner and her thought
processes add a layer of complexity well beyond what was captured here. For the
247
purposes of the study the data suggest that there was a close link between internal
reasoning and bringing together the other elements of the learning environment as
students often described them in conjunction. This seemed to be particularly true in cases
where both facilitated and peripheral learning opportunities contributed to learning.
When both were discussed as contributing within a concept unit, some level of reflection
or internal reasoning was often described as bringing those pieces together.
E4.2 Writing and Verbal Articulation
Neither the process of writing nor the process of verbal articulation were
described by students as playing a significant role in their learning of the science
concepts. Journals/notebooks were collected and coded for Cases 1 and 3, as described in
Chapter Three. Most of the descriptive codes assigned to the notebooks within those two
cases were references to the TSCs though there were few other codes to indicate that the
journals were used by students for much beyond the recording of declarative knowledge
and events. Although a few students used the notebooks more openly, the majority of
entries were in response to facilitated prompts from the teachers to record information
(based on teacher interviews and similarity in entries across each of the two classes.
Similarly, during the interviews students rarely described the processes of writing or
verbally expressing their ideas to others as contributing to their learning or in conjunction
with their understanding of the TSCs. In one previously described case, that of Mei
(Student 408, Case 4) coming to a deeper understanding of the relationship between tides
and mangroves as she observed the tide coming in, the student was in the process of
journaling when she came to that realization. A few other students reported that written
assignments or thinking about the assignments helped them pull their thoughts together
248
but this was not common. This is not to say that these processes did not contribute to
learning, only that the data collected for this study do not lead to that conclusion.
E4.3 Linking Across Events
The Pathfinder assessments offer one view into how students are indexing their
knowledge by showing the structure of their knowledge organization. Another indicator
is how students conceptually link different learning events, recognizing that one has a
conceptual similarity to another. Within a given concept unit in which students described
their current understanding of a TSC, relationship between TSCs, and changes in their
understanding of them over the course of the DIAL experience, I looked for patterns in
how students recognized different events as representing or illustrating the same concept.
Because these patterns were often associated with the longer and more elaborated concept
units it is difficult to present concise examples here but the following excerpt is a more
contained example in which Jake responds to the question of how he learned about
invasive species, illustrating the trend of linking disparate events through a TSC:
Jake: Probably, the thing, just everything where Kevin stopped and showed us an
invasive species, like when he was talking about the Burmese python,
Mike: where was that?
Jake: let me think about that. I'm not really sure but I remember him talking about
it, and the competition between alligators and pythons for like food and territory
and stuff. And like when we stopped along the road before the swamp hike and
looked at the Australian pine or something I think it was. And on the swamp hike
there was that, it was a tree from Brazil that had all the little red berries on it, that
he was talking about how the trees are hard to get rid of it. And that they’d
249
probably never get rid of it completely. That's all I can remember. (Student 401,
11th grade, Case 4)
Linking across events was often associated with the combination of peripheral
and facilitated events as students not only recognized a link but created or applied one in
an informal setting as Rachel describes:
I definitely started thinking about the concepts that we learned in class a lot
outside of class. Just living here I guess, I'm not used to this climate and this
environment. I think it's really cool, but we learned a lot about taking care of
yourself here properly and so I think it really registered learning about thermal
conductivity and then thinking about the layers that I had on. We had ski week
and I had to think a lot about if I was going to wear cotton then I would get wet
and if it was a cloudy day how I should protect myself that way. I think what I
learned in class a lot, applied to what I was doing every single day here. (Rachel,
Student 204, 11th grade, Case 2)
As students experienced learning situations that linked conceptually to past
events, either form their personal experience or the course events, they often described
developing a deeper understanding with each new event. Their conceptual understanding
and organization was seemingly becoming more elaborated with new experiences and
new types of experiences in a manner suggesting an important role for a constructivist
person-solo aspect of learning as well as the environmentally-centered person-plus
aspects of learning. Jake also described this progression in his understanding of tides:
250
When we first started I kind of knew about the tides but I didn't really pay that
much attention to it and then when we were on the island I understood it and then
when we were on the last day, when we were paddling to Chockoloskee it was
really applied to the situation. (Student 401, 11th grade, Case 4)
E4.4 Connection to Past Learning
Similar to the previous section, student references to past learning indicate some
indexing within the structures of their conceptual knowledge, though in relation to pre-
DIAL experience learning. Some of these connections were simple associations, some
were described as present continuations of past learning, and others were connections to
big picture ideas. As an example of the associations students made, Robert described
how a word he originally associated with another topic took on an entirely new meaning
for him within this new domain of ecology and thus changed the structure of his domain
knowledge to include a new way to understand the term, a change that was confirmed by
his pre to post PFnets:
Robert: Before I thought metamorphism was changes in the rock and I don't
know. I didn't really know it. I'd heard the word a couple times....
Mike: And it is by the way.
Robert: Yeah. I guess it still is, but now I more think of metamorphism as change
in the snow pack, like constructive and destructive and how that changes the snow
into facets and rounds and how that really impacts the stability of the snow pack
and how through metamorphism that can really increase or decrease the danger of
avalanches and things like that. (Student 215, 11th grade, Case 2)
251
At this point in his learning, the association he made is only through the word,
apparently not seeing any conceptual connection.. As reported in Chapter 4 and reflected
in the PFnets there were times when students who performed well on the pretest
performed much worse on the posttest and this seemed to be a result of these students
reorganizing their structural knowledge around their recent learning rather than a broader
view of the domain knowledge. This example is one such case in that Robert almost
abandoned a previous and correct understanding of metamorphism within a different
domain in favor of a new concept he had learned through DIAL. He did not seem to
make the connection that they were essentially the same idea applied to different
contexts. Of course the potential exists that he will see the word again in the future in an
entirely different context and begin to see how metamorphism is a common theme across
the natural sciences
In other instances students did describe building on their past learning. One
student described learning about photosynthesis in fifth grade and how that made it easier
for her to understand the topic when they learned about it in this course. Interestingly,
she still referred to the process in naive phrases such as the plant “eating the sunlight”.
Another student also described still being in the process of trying to connect past learning
with her DIAL experience:
Tara: I didn't know what thermal conductivity was before but I assumed it had to
do with energy because heat has to go in with energy and thermal has to do with
heat and then we learned about thermal conductivity which still kind of confuses
me, and I still don't understand what the difference is between it and specific heat
capacity, but apparently there is one.
252
Mike: Is specific heat capacity something you talked about in class?
Tara: No, but I took chemistry last year. (Student 224, 11th grade, Case 2)
For many of the students who discussed these past connections, they seemed to
sense that there was a connection, as in the cases above, but could not make a complete
conceptual connection in a manner consistent with canonical domain knowledge. This
suggests that closer formative assessment and facilitated support may have helped the
students make more conceptually sound connections between past and recent learning.
Finally, a few students indexed their learning within big picture ideas that they
had developed or picked up previous to the DIAL experience and found a role for the
new knowledge within that big idea. Although the theme that Thomas describes here was
not an overt lesson of the course, he found that there was ample evidence to support his
developing idea:
I guess “aha moments” came when I connected humans' motivations for further
conquest of natural areas for simply monetary reasons for the most part. I've
noticed that in the past but seeing it also in the Everglades solidified that and
made it more concrete. (Student 403, 11th grade, Case 4)
Austin expressed a very similar idea, and while human impact, in general was a
TSC, the broader themes were not:
I think over the past couple years I've been interested more and more in like
human impact and environmental studies, and global warming and stuff. And so
that was kind of something I was experiencing first hand and it was cool to be
253
able to be there and also know what was going on. (Student 405, 11th grade,
Case 4)
For these two students, the conceptual science knowledge they developed
over the course of the DIAL experience informed personally relevant schemata
that they had already been developing previously and that had applicability within
but also external to the learning goals of the course.
E5 Emotional Contributors to Learning
The DIAL conceptual framework (Appendix B) includes the contributions of the
emotional environment to student learning. Figure 5.5 shows the frequencies at which
emotional environment descriptive codes were assigned to the data. Good emotion and
bad emotion each encompass infrequently used codes that fit those general
characteristics. At an early stage of the coding process it became clear that most of these
codes referred to students’ descriptions of how they were feeling at different times
throughout their DIAL experiences rather than capturing the originally intended
emotional atmosphere of the whole group. There was little evidence to support the
notion that students retained an explicit memory of the emotional environment except in
a few cases. Based on field observations of Case 4, the emotional environment was a
contributor but it may not have been obvious to participants and, more importantly, times
of heightened emotional intensity seem to have been disassociated from learning events.
The data concerning both personal and group emotional factors are described below.
254
Students in Cases 1, 2, and 3 cited personal emotional ups and downs but there
were not many events that multiple students cited and that would suggest an overall
emotional environment. This is not to say that this was not the case but that students did
not explicitly detect it or articulate it. That being said, there were emotional highs and
challenges for students. Almost every student mentioned times when they were
particularly excited by the learning or events, engaged in the learning process, or
generally enjoying the course. A few students in Case 1 also cited the skiing as being a
challenge that they were nervous about or struggled with. With one exception, they saw
Figure 5.5. Frequency of descriptive code references within the emotional environment code group. before transcripts were divided into units of analysis for inferential coding. Includes all 4 cases.
255
that as a challenge that they were proud to have overcome and enjoyed in the end. The
student who never really came to enjoy the skiing describes her experience in this way:
I kind of feel like when I was out there (skiing) I was in such a bad mood that I
wasn't really paying attention and I just liked being in the class working on my
own. I just prefer that you know. But I did feel like it did connect because
everything we were talking about we saw out there. And sometimes even if we
didn't talk about it when we were out there, there were some days we would talk
about like what we were learning in class out there, but some days we didn't. I
feel like people were just kind of noticing, you know. I know that sometimes I
was noticing. (Student 106, no grade levels, Case 1)
Rebecca goes on to describe a series of highly relevant observations she made
while out skiing. Although she felt she was not paying attention to direct instruction, she
was still learning in that situation. In the same case, Kelly described the opposite
problem. She was so engaged in the non-academic element of the course that she had
trouble focusing on the academics: “It was really hard to balance my work and fun in that
class and I was challenged by just trying to stay on task and just getting my work done
when all I was thinking about was going skiing the next day (Kelly, Student 101, no
grade levels, Case 1).” She does describe overcoming that challenge with increased
focus and with a sense of accomplishment that she developed through the physical
challenge:
I’d be the fastest one out of everybody and it was just cool because I feel like
even though maybe I wasn't in the best shape, out-out of everyone, I still like- I
256
pushed myself most out of everyone. And I got like a really-it was like really
gratifying for me because it felt good. (Student 101, no grade levels, Case 1)
In Case 3 a few students described being bored at times or uncomfortable
watching the cranes for extended periods in the blinds or in the hot sun:
They (cranes) are all doing the same things and we'd be out there for a couple
hours and it got really cold and we couldn't talk at all. We couldn't make any
sound. We were hiding behind these little squares of wood. I was pretty bored the
whole trip. (Meghan, Student 304, grade 9)
Despite these occasional reports of motivational struggles and disengagement
overall sentiment and indicators of motivation/engagement across the cases were
overwhelmingly positive. Most students described some degree of engagement or
interest generated by the experiential aspects of the course, as Daniel does here:
That's kind of what I thought was so cool about it. Like we would hear about, I
don't know, certain-like an example of an adaption (sic) of a tree, we would have
a reading on it and then like I said, we would go up to the park and actually see it
doing it. And it's like “whoa, I know what that is!” We learned about that. I just
think that's one of the coolest parts of the class is actually going to watch it
instead of just hearing about it which is boring. (Daniel, Student 102, no grade
levels, Case 1)
257
As an outside observer of Case 4 I was in a better position to observe the overall
emotional environment of the group than were the members of it who were enmeshed
within it. At most times the emotional scene was pretty level as students moved through
the environment, listened to mini-lessons, observed, and socialized. There were a
number of emotional highs and lows that the group experienced together and these did
seem to have a direct impact on learning. As described with the jellyfish scene earlier,
there were times when the whole group was excited together. Teddy mentioned a few of
these:
We'd seen so much stuff that day, like the roseated (sic) spoonbills. What else did
we see? We saw the...oh yeah, like right before, I think the dolphins cheered
everybody up and then once we saw the roseated spoonbills that cheered people
up too. Once we got up to the ocean everybody was all happy and that was just a
good day. (Student 407, 9th grade, Case 4)
In this passage you can detect the ebb and flow of the emotional surround and this
was confirmed by my field notes and videos for the day. The dolphins that Teddy
mentions were not the first the group had seen. The group had been struggling mightily
against tides and headwinds for a number of hours. At the first chance to stop on dry
land, we were attacked by swarms of mosquitoes. Once back out on the water,
everything had calmed down, the tide was with us, the sky was turning pink with the
sunset, and finally a large pod of dolphins began breaking the surface of the water all
around us. A few students mentioned this as a highlight of the trip but, as with the
jellyfish, none expressed any association with any TSC learning during the interviews.
258
Some students did describe feeling a personal connection to the Everglades after the trip
and cited these types of experiences. It seems likely that these feelings led to greater
engagement overall but they did not seem to lead to peripheral learning. It is unclear if
facilitation could have influenced the making of connections at these hyper-emotional
events though it seems likely based on the abundant data showing the learning linked to
other events in which the teachers followed peripheral observations with facilitated
lessons.
On the opposite end of the spectrum, there were a few times during my Case 4
field observations in which there was an overall sense of nervousness or unease
surrounding the whole group. During interviews most students also described some of
these, though from a personal level rather than as an overall emotional environment. The
previously described swamp hike of Case 4 seemed to be one of the most anxiety-
provoking. It was an unfamiliar environment with real and perceived dangers including
snakes, spiders, and scenes that are classically associated with foreboding places. There
was a similar sense at the onset of the canoe trip. Students were paddling through tunnels
carved out of the mangrove forests with barely enough room overhead beneath the
branches and tight maneuvering amongst the roots. Alligators sat on the banks and the
air was filled with exotic bird sounds. Large orb-weaver spider webs were set at eye
level as students bumped through the thickets.
In both the hike and the paddle, students responded to the stimuli in a way that
reflected a sensationalized view of the places- they shouted and tried to scare each other,
pointed out the dangers, and over-reacted to minor events such as kicking an underwater
stump or seeing a spider web. Also in both cases the teacher and guide let them
259
experience that but then reset the emotional tone. After the introductory period of
novelty during both the hike and the canoeing, the guide asked that students spend the
next 20 minutes in complete silence. There was an immediate shift in both instances
where students still pointed out the dangers to each other but they also began pointing out
orchids, birds, ferns and other less threatening but more interesting objects. Although my
recordings on the trip captured some very interesting and TSC-related topics pointed out
by the guide during those introductory periods of novelty, none of it was described by
students in the subsequent interviews as contributing to their learning. However, there
were many examples in the periods of silence that were discussed by students in the
interviews, some of which have been described already. Interestingly, none of the
students mentioned the imposed silence but almost all of them mentioned a personal shift
in their comfort level. Austin described that transition:
Austin: On our swamp hike I was nervous, especially after we saw the big orb
weaver or banana spider, ‘cause I'm pretty afraid of spiders. And then at first
getting in the water, I was a little uncomfortable, but I think after 10 minutes or
so, I felt comfortable and was able to just go along with it.
Mike: Any idea what that transition was... like why you made that transition or
how?
Austin: At first it was like, that I've never done something like this.
Mike: Walking through a swamp?
Austin: Knee deep in swamp water you can't really see. And we had already seen
alligators and all that stuff. So... but then Kevin seemed pretty confident and
everybody else was so I just went for it. (Student 405, 11th grade, Case 4)
260
The codes describing emotional references (figure 5.5) were common
across the four cases but, again, the references that students made were related to
personal emotional responses rather than as factors of an emotional surround. For
Case 4 these codes often (but not always) closely matched my field observations
and what I recorded as a more collective emotional environment. As I did not
conduct full field studies of the other three cases it is not possible to determine if
this pattern existed across all of the cases. What is apparent is that students either
attributed emotional elements of their learning experience to personal emotions or
they did not recognize/describe them at all, good or bad. If the other three cases
did indeed have emotional elements that were manifest at the environmental level,
they were not recognized or described by students and were perhaps operating as
a subtle background element, much like the cultural environment may have been.
Contextualization
The final component of the DIAL conceptual framework (Appendix B) is the
context vehicle, the construct that describes how the learner combines multiple cues from
the environment and associates them with a target concept, resulting in either a
contextualized understanding or a decontextualized understanding of the concept. The
level of contextualization was a concept unit-level assessment of the degree to which a
student discussed TSCs within a concept unit in relationship to the environment in which
they were learning. Therefore it allowed for analysis beyond how students learned a
given TSC and elucidated how described interactions with the environmental components
influenced students’ understanding of the concept at the time of the interview.
261
The contextualization scores used (See table 3.3) reflect a spectrum of knowledge
that ranges from decontextualized to complete and contextualized. Figure 5.6 shows the
level of contextualization achieved across the four cases. Each pattern code reference,
assigned to a complete concept unit includes one student’s description of a TSC or
relationship between TSCs and the level to which that idea was associated with
experienced contexts at the time of the interview. The lowest level, 0, indicates no
contextualization. A score of 1 indicates that there is some misconception or incorrect
element in their description of the science. The remaining scores indicate an increasing
level of both understanding and association with real contexts. Based on these scores
68% of the knowledge that students described was contextualized to some degree. That
is, across the concept units coded in student interviews, 68% were scored as a 2 or above,
a high value compared to past research(Rivet & Krajcik, 2004a, 2004b, 2008) , as is
discussed in Chapter 6. Through the lens of the DIAL conceptual framework, this is
evidence that the conceptual knowledge structures that these students developed were
heavily but not entirely influenced by context vehicles constructed with the components
of their DIAL environments.
262
Figure 5.7 shows the breakdown of mean contextualization scores by case,
presented with the mean changes in csim for each case, the measure of learning
determined through the Pathfinder procedure. This four-case study does not provide
sufficient power to conduct meaningful statistical analysis though the pattern in Figure 5
suggesting a relationship between contextualization and learning is borne out in the
qualitative data. Students in Case 4, the group that showed the greatest learning, all
relied heavily on real-world examples from their own experiences when describing their
concept knowledge. Case 3 students spoke more about decontextualized ideas that were
pulled from readings, lectures and videos, though not to the exclusion of contextualized
knowledge. Case 1 and 2 students were more balanced in the manner in which they
Figure 5.6. Contextualization level frequency judged for each concept unit within student interviews across all four cases. Higher score indicates greater contextualization.
263
learned and discussed the TSCs. This suggests that there may be a relationship between
the degree to which these students contextualized their learning and the degree to which
their conceptual knowledge structures became more expert-like following their DIAL
experience. However, if that relationship were to prove true within a larger sample it is
not clear if contextualization leads to more advanced knowledge structures or if more
expert knowledge allows for a greater ability to contextualize.
Figure 5.7. The bars represent the learning as shown in Pathfinder ∆ csim values across the cases. The line graph represents the mean contextualization scores for case. Case 3 had a mean contextualization score of 0.
264
Misconceptions
The contextualization score of 1 deserves some special attention. It refers to cases
in which the knowledge expressed may or may not have been contextualized but was
incorrect in some way when compared to accepted understandings among scientists.
There was only one of these misconceptions that came up within the study and it may be
directly related to contextualization. In three of the four cases (1, 2, 3) students used two
different definitions of adaptation interchangeably. They seemed to equate the behavioral
adaptations that people need to make when encountering new situations with the idea of
evolutionary adaptation driven by natural selection. This is a fundamental misconception
of evolution (Engel Clough & Wood-Robinson, 1985) and it seemed to be supported by
the metaphor students, and perhaps teachers, were making between the environments
they were trying to survive in on a daily basis and the adaptations that organisms had
made over millennia. The following is one example, ”when I first came to Bald
Mountain Academy, I had to adapt to how high it was because I'm from Seattle and that's
sea level. And then deciduous, that's a tree and then also connected to trees because trees
have to adapt” (Kelly, Student 101, no grade levels, Case 1). In this way
contextualization by making connections between TSCs and experience with the
environment probably moved some students’ understanding of this common TSC away
from the way that scientists in the domain understand it.
Chapter Five Summary
In this chapter I have presented analysis of qualitative data to answer the research
question “do students’ interactions with the components of a DIAL environment
contribute to change in their conceptual science knowledge structures??” Through
265
pattern matching across cases and aligned with the DIAL conceptual framework, a
complex picture emerged to explain how the identified environmental components and
learning opportunities did contribute to learning for the students in the four cases of this
study, based largely on associations that students made during their post-DIAL interviews
and supported by my field study observations, teacher interviews, and student work
samples.
Both facilitated and peripheral learning opportunities contributed to learning in
these cases through largely different means. Facilitated opportunities were more directly
associated with the learning of the targeted science concepts, particularly through
elements of direct instruction. Teachers played an important role in this facilitation as
they guided student observations, provided learning resources, helped make conceptual
connections, and provided information directly to students. Peripheral opportunities,
however, added personal connections to student learning largely through individual
discoveries and affective connections that students made.
Student-described learning processes that included an interaction between
facilitated and peripheral learning opportunities tended to be associated with
understandings of the TSCs that could be described as more schematic and complete than
when the learning processes were either facilitated or peripheral alone. This
combination often resulted in students generating a “complete picture” of a concept as
facilitated information and personal experience informed each other. Keystone events
occurred when a peripherally learned idea or piece of evidence led to a much deeper
understanding of a concept that was otherwise learned through facilitation. Students’
266
peripheral application or extension of previously facilitated learning also proved to be an
important interaction for changes in students’ conceptual knowledge.
The construct of a context vehicle, presented in the DIAL framework (Appendix
B), was supported in that students did associate many of the environmental components
with the learning and recall of concepts and this contextualization seemed to bolster
student learning. Of the environmental components, social interactions seemed to be
associated with the greatest contribution to the change in knowledge structures. Most of
the social interactions that students associated with learning were facilitated and involved
teacher-centered practices. The physical environment also played an important role in
learning, particularly in helping students to create visual, embodied, temporal, and spatial
associations to their knowledge. Individual learning processes, including the affective
elements, seemed to provide a bridge between the various environmental components as
students reasoned about the connections between disparate events and concepts, their
relevance, and gave personal meaning to the context vehicles formed from those parts.
Based on the data collected for this study the other components of the learning
environment from the conceptual framework (Appendix B), including the cultural and
emotional environments and the tools used played a less central role in learning for most
students in these four cases. It seems unlikely that they simply did not play a role but
they may be operating in the background at a level that the students do not readily
recognize, a finding suggested by the data collected in the field study portion of this
project. Details of how each of the environmental components contributed to learning
were summarized in the chapter.
267
CHAPTER VI
DISCUSSION
Overview
This study was an investigation into the process of deep immersion academic
learning (DIAL) and was guided by two research questions:
Q1: Do students’ knowledge structures reflect greater understanding of science
concepts following a DIAL experience?
Q2: If so, do students’ interactions with the components of a DIAL environment
contribute to change in their conceptual science knowledge structures?
The first goal was to determine if DIAL experiences can be an effective tool to
support the learning of targeted science content knowledge. If so, the second goal was to
determine how the contextualized environments of DIAL and opportunities to access
those environments contributed to any learning. A theoretical framework of situated
constructivism along with a review of the relevant literature on learning in authentic
contexts was used to conceptualize and design the study. From those foundations a
conceptual framework (Appendix B) was proposed to model the DIAL process. The
conceptual framework highlighted the role of facilitated and peripheral opportunities to
interact with various components of the learning environment in creating a context
vehicle to interact with and add to an individual learner’s knowledge structures.
That conceptual framework has also been used throughout this dissertation to
outline the various chapters; connect the work to previous research; provide the structure
for pattern-matching, cross-case analysis; and to present the results in discrete chunks. A
268
discussion of those results is presented in this chapter, followed by the limitations and
contributions of the study, a revised conceptual framework developed based on the
results of this study, and a discussion of future, recommended research.
Discussion and Implications: Research Question 1
Aggregated student data in this study did show significant changes in structural
knowledge following the DIAL experiences. As a whole, the DIAL experiences were
effective in that regard as 70% of students showed changes in their conceptual knowledge
structures that made them more similar to expert knowledge structures, and almost 40%
showed high or exceptional levels of change. These results are in agreement with other
studies that have shown cognitive learning in contextualized environments (Eaton, 1998;
Knapp & Barrie, 2001; Milton & Cleveland, 1995; Prokop, et al., 2007) though this study
adds two important contributions. First, the use of the interview process in conjunction
with the structural knowledge assessment of Pathfinder allowed for a greater depth of
understanding of the state of the students’ knowledge. The knowledge structures
assessed through the Pathfinder process and then discussed in student interviews often
seemed to show the development of schematic knowledge as students discussed not only
declarative facts about the concepts, but also the complex relationships between those
ideas in applied contexts. Most of the students spoke of the relationships highlighted in
their PFnets at a schematic level, confirming DIAL practitioner anecdotes. Second, this
study followed students who were deeply immersed in context over longer durations of
time than the more typically studied daylong field trips (see Chapter Two for review). As
has been shown with affective changes in students (Bogner, 1998; Emmons, 1997), it is
possible that the longer duration of the experiences may have contributed to the students’
269
cognitive learning, though this was not sufficiently measured in this study to definitively
say. Case 3, for example was the shortest experience (three days) and had essentially no
aggregated change while Case 4 students experienced the most concentrated immersion
and showed the greatest growth. This is not to say that there was a direct causal
relationship between immersion and learning but it is a relationship that deserves further
study.
It is important to note that the learning was not consistent across the cases. Cases
3 (zero growth) and Case 4 (highest growth) represent the starkest contrast while Cases 1
and 2 showed moderate changes in knowledge structures. Based on the analysis of
student descriptions of their learning, field study data, and the other supporting data, it
appeared that these differences were a function of many factors, including differences in
access to or utilization of the environmental components described in the next section.
Case 2, with the largest sample (n=41), was instructive in that it allowed for the
examination of how a larger distribution of students learned through the same DIAL
experience. One important pattern that emerged was that most of the growth was in the
middle of the distribution of students’ pretest values. That is, students with the highest
and lowest pretest values did not tend to show as much change in knowledge structures as
those students with pretest values closer to the mean. This suggests that students at the
bottom might need more support. It could be that these students have insufficient
background knowledge to begin to access the information in the course or it could be a
difference of ability levels. It is clear that these students could have benefitted from a
teacher-administered pretest, early formative assessments, and extra supports throughout
the class to help address any gaps.
270
Those students who were at the top of the pretest distribution might also need
more supports with moving beyond the intended curriculum and with teasing out
subtleties of the content knowledge to develop more expert knowledge. In Case 2 as well
as Case 3, a number of students with high pretest scores actually changed their
knowledge structures to be much less similar to the expert referents following the DIAL
experience. Based on the PFnets and student interviews, these students appeared to be
coming in to the classes with strong background knowledge and then keying in on
particular aspects of the content that were interesting or new to them. As described in the
previous chapter, two of the students in this category reliably described accurate
conceptions of TSCs that they held before the experience and then described new
understandings of these ideas that were more highly focused on the specific content of the
class rather than the broader understandings reflected by the expert referents. Because of
this, they assigned greater importance to these new ideas and assigned higher levels of
relationship to other TSCs in the Pathfinder assessment. Perhaps this was a function of
the novelty, moving former learning to the periphery, even if that past learning was more
conceptually central to an expert’s way of organizing the knowledge. This was a
fascinating phenomenon within this case that deserves further attention from both
researchers and practitioners. It would be important to know if these over-highlighted
ideas remain so in students’ schemas or if they attenuate once the novelty is past, leaving
a more expert view of the content. It would also be important for practitioners to be able
to identify this process and to help students see their newfound knowledge within the
bigger picture. DIAL practitioners could use some guidance on this in the form of
longitudinal research.
271
The Case 2 distribution also showed that in addition to those middle level learners
showing more growth than the high and low pretest scorers, they also tended to reach
about the same level of similarity to the expert referent by the end of the course. The
similarity (csim) scores could have theoretically gone much higher, suggesting that a
ceiling effect was not the explanation for this. It is possible that the Pathfinder
assessment tool or process has a limited sensitivity that made it difficult to distinguish
structural similarities beyond a certain point but this is not reflected in other research
using Pathfinder. It is also possible that the Pathfinder assessment process accurately
reflected the extent of the learning opportunities available to students such that the
apparent ceiling on the students’ csim scores did accurately show the extent of the
learning opportunity within the class. In either case, the largely consistent change in
structural knowledge that was detected in this study suggested that these students were
learning conceptual science knowledge to a degree that led to significant positive changes
in their knowledge structures though there were also important differences from case to
case. Further investigation into the limits of Pathfinder sensitivity are warranted for
future research.
Some of the difference in learning between cases might be explained by the
design of the study. To look at the contrast of Case 3 (zero growth) and Case 4 (highest
growth), the background knowledge of the students coming in to each experience was
quite different. In Case 3, the teacher had spent a significant amount of time preparing
the students and teaching content in class before the experience and before the pretest,
while in Case 4 the students had not had any pre-instruction, thus they had more room to
272
grow. However, it has been shown that on day trips, pre-instruction improves learning
(Orion & Hofstein, 1994) so it is difficult to tease out the differences with these longer
experiences.
One conclusion to draw from the results of the first research question is that
although DIAL can lead to significant learning, the process and context do not
automatically do so. There are clearly variables that must be addressed well to increase
the chances of student learning. Some of these variables are addressed in the next section
but it is clear that more work needs to be done to better understand what makes one
DIAL experience a successful support of cognitive learning and another one less so. The
next section discusses both the findings from this study on how some of these variables
affected learning in these cases as well as a discussion of further work that needs to be
done.
Discussion and Implications: Research Question 2
Learning Opportunities
Because DIAL tends to provide ample opportunity for both independent and
directed learning, a central aspect of the DIAL framework (Appendix B) is the distinction
between facilitated and peripheral learning opportunities. How students used these
learning opportunities in DIAL was a key finding of this study. Facilitated learning
opportunities were more often cited as influences on the development of TSC knowledge
than were peripheral opportunities, though the most important learning processes in
which students developed personally relevant schematic knowledge of the TSCs tended
to involve interactions between both facilitated and peripheral learning opportunities.
273
I found that the students with the greatest positive changes in structural
knowledge tended to rely more heavily on facilitated opportunities, though there were
important exceptions. It is not surprising that the facilitated opportunities were more
often associated with cognitive learning than were peripheral opportunities alone as
facilitated learning has been shown to be generally more productive than “minimally
guided instruction” (Kirschner, et al., 2006; Klahr & Nigam, 2004). What is surprising is
that peripheral learning accounted for as much of the learning as it did. It is difficult to
think of another formal education venue in which students pick up a substantial portion of
their information in a peripheral manner. They may do internet research or similar tasks
but these are generally assigned and therefore facilitated by a teacher. In these cases of
DIAL, students were picking up some important lessons directly from the peripheral
opportunities. For one student in each of the cases, they described the peripheral learning
opportunities more often and in ways that suggested they were more important to the
students’ learning than the facilitated opportunities. This suggests that for those
individuals the opportunity to interact directly with the contextualized environment was
critical to their learning.
Past studies of authentic learning environments have shown that peripheral events
are more highly anticipated by students than are facilitated events prior to a field trip
(Ballantyne & Packer, 2010) and that learning is more resilient over time when students
are more actively engaged in the environment on a field trip (MacKenzie and White
1982) but it was unclear if or how peripheral opportunities contributed to the learning
process. This study has shown that peripheral learning opportunities helped students to
make personal and affective connections to the target concepts. The immersion aspect of
274
DIAL allowed students constant access to the context they were studying and through
peripheral learning opportunities, students extended their learning into events that did not
have educational intent.
Neither Mayer’s (2004) detailed review of discovery learning in which he
concluded that pure discovery learning pedagogies did not hold up to scrutiny, nor other
2004; Novak & Musonda, 1991), considered the learning of individual students. This
study confirms Lai’s (1999) finding that access to peripheral learning opportunities may
be an important way to differentiate instruction for the minority of students for whom that
is important. Based on the positive affective connections to the TSCs that students
described in conjunction with aspects of the TSCs they had discovered on their own, they
seemed to be more invested and attached to what they had discovered on their own than
to the information learned through other means. If this is true across other DIAL
experiences, it would be important for teachers to recognize and honor this type of
learning, and to assess the accuracy of it.
There are two other important differences between those studies and this one.
First, in the cited studies that decry discovery learning (Dean & Kuhn, 2007; Klahr &
Nigam, 2004; Novak & Musonda, 1991) the learning takes place in contextually
impoverished learning environments- contrived experiences in classrooms. This study
suggests that the context and the environment are critical contributors to this type of
learning. How could discovery learning be effective when there is nothing to actually
discover? The second and more important difference between those studies and this one
is that the discovery aspect was considered in isolation and in contrast to directed
275
learning while in this study, the interaction between facilitated and peripheral learning
opportunities emerged as the most important learning pattern for the students in these
DIAL cases. This study confirms that discovery learning or peripheral learning
opportunities alone were not highly effective for most students but to think of the issue in
such a dichotomous manner misses the point that peripheral learning was one effective
tool for some students and when facilitated and peripheral opportunities were available to
students in conjunction, the most powerful learning seemed to emerge. Although the
facilitated learning opportunities were more associated with cognitive learning across the
cases, it is important to consider the needs of the individuals who did not fit those
patterns. If these trends that were consistent across the cases are also consistent across
the wider population, DIAL practitioners would need to keep in mind the importance of
the teachers’ facilitation on student learning but also recognize that some students may
benefit from an alternative, peripheral path to knowledge development.
Deeper learning seemed to most often come from learning processes that included
both facilitated and peripheral opportunities, often in the pattern of peripheral
opportunities providing the keystone event that made sense of the facilitated learning.
This may be due to the types of learning and cognition that were associated with each.
Students reported cognitive understanding more often with facilitated opportunities and
affective understanding more often through peripheral means. It seems then, that the
combination of facilitated and peripheral opportunities tends to result in a more holistic
understanding that involves a personal connection as well as external information.
Students gained declarative or schematic knowledge but also contextualized the
information and gave it relevance. Students were able to combine the canonical
276
knowledge gained through facilitation with their own observations and affective
connections. They could make connections that were personally relevant. Because
students were immersed in authentic contexts while receiving instruction along the way,
they could quickly move back and forth between the facilitated and peripheral allowing
for both inductive and deductive learning processes to build their knowledge.
This pattern of learning that includes both personal constructions of knowledge
and a heavy influence from the learning environment, particularly the social aspects of it,
is in agreement with the idea of situated constructivism presented in earlier chapters. The
learning for these students was neither a “person-solo” (Perkins, 1993) gathering and
processing of information nor an entirely social construction of knowledge, but an
interplay of both elements, situated within a physical, geographical space. It was a
“person-plus” (Perkins, 1993) system with a spectrum of learning from highly individual
sourcing of knowledge development to highly social constructions. Within that
spectrum, however, the deepest learning seemed to be associated with the construction of
knowledge that included both elements in conjunction, although not necessarily at the
same time. When students described their understanding of concept relationships and
described learning events across the person-solo/person-plus spectrum, they most often
described the events as temporally distinct but conceptually linked. The situated and
constructivist aspects of learning seemed to be integral rather than distinct processes.
The lesson in these findings is that both facilitated and peripheral learning were
critical for these DIAL experiences. It was important for teachers to lecture, guide
student observations in the field, create contextualized demonstrations, and facilitate
discussions, but it was also important for students to have opportunities to explore the
277
environment and discover evidence on their own. Case 4, which had by far the greatest
learning gains, had a much higher proportion of undirected time within the DIAL
experience than did the other cases, but also provided students instruction, largely
through guided observations. Because each student was picking out their own peripheral
opportunities that were meaningful to them, it seemed advantageous that there were a
wide variety of opportunities available to them. In Case 3, with essentially zero gain in
learning, students had very little opportunity for peripheral learning due to the short
duration and a sequence of events that was described by the teacher as being highly
scripted. Of course, there were other factors identified in this study that may have
contributed to the difference in gains between Cases 3 and 4 but the difference in
peripheral learning opportunities may have contributed as well.
Although students involved in these DIAL experiences were using peripheral
context cues for their learning, just knowing how to make use of those opportunities may
have had its genesis in the facilitated. Guided observation, for example, may have
become internalized to the point where the practice was personally useful, a process
described by Vygotsky (1978). Seen in other terms, by working within a community of
practice, students seemed to be observing through legitimate peripheral participation until
they were competent enough to make meaningful observations on their own in more
expert ways (Lave & Wenger, 1988). The students who relied most heavily on the
peripheral learning opportunities were those students who had either high or particularly
low background knowledge (based on pretest). The former seemed like it led to
productive learning while the latter led to observations and experiences that students
could not easily connect to big picture science concepts. This study suggests that the
278
balance between facilitated and peripheral learning opportunities in DIAL should not be a
fixed formula but may depend on the level of expertise of the class and individual
students. It may be helpful for students to be scaffolded/facilitated through the process of
how to effectively take advantage of peripheral learning opportunities though it seems
unproductive in most educational settings that the balance should ever move to entirely
peripheral learning opportunities, certainly not in DIAL if the data presented here are an
indication. It is also important to reiterate that facilitated instruction is not synonymous
with classroom instruction. As shown in these four cases there are ways to facilitate
learning that are not typically associated with classroom learning such as impromptu
observations of the environment, and it seems conceivable that a creative classroom
science teacher could foster opportunities for students to discover peripheral learning
within the classroom. The data presented here indicate that it is important in DIAL to
heavily rely on the context of the environment but to also use demonstration, and guided
observations along with the occasional lecture.
Experiential Learning Theory in general, and the cyclical models of learning in
particular (Chapman, et al., 1992; Kolb, et al., 2000) rely on students making sense of
their experience through reflection. This study suggests that individual reflection, while
important, may not be as effective as teachers more directly helping students to
understand the connections between abstract ideas and the students’ experiences, often in
what could be described as social reflection. Although a controlled study would be
helpful in comparing these avenues for making connections, students across these four
cases were more likely to report the role of teachers in facilitating the students’ making of
connections than they reported making connections on their own, particularly in writing.
279
If this were to hold true across other DIAL experiences teachers would need to rely
heavily on formative assessment so they may be aware of where each student falls on this
spectrum and so they can give more exploratory freedom to those students who will
benefit from it and more supports to help students who are struggling with making those
connections. Although it was important for students to pick up personally meaningful
information peripherally, facilitation was almost always required to help students see how
that information fit into the big picture.
Teachers also need to be aware of the metaphors that students are picking up
directly from the environment. While these metaphors can be powerful learning devices
that the teachers in all of the cases used well, they can also lead to misconceptions, as
was the case for students in Cases 1 and 2 who confused behavioral and evolutionary
adaptations.
The role of novelty in field trip learning has been shown to be both beneficial and
problematic in that it heightens awareness and engagement but also compromises task-
oriented learning (Falk, et al., 1978; Martin, et al., 1981; Orion & Hofstein, 1994). In all
of the cases described novelty was interpreted as being important for developing student
interest, even for students who came into the experiences disinterested. Student curiosity
led them to explore further, even if those explorations were not directly associated with
the concepts they were intended to learn. In all but Case 3, there was some element of
risk and therefore distraction associated with the novelty. However, for every student
who mentioned the feelings of risk, they described a transition from threat to
understanding that occurred over time. Trying to connect content to context, facilitated
to peripheral, may be ineffective when the novelty space is too high but once students
280
have adjusted to the novel situation, they may be poised for much deeper learning, armed
with the contextual inputs. This process seems to be important for DIAL as the time
exists for students to make this transition. Teachers who use DIAL can allow the novelty
to engage the students but then use that novelty to deliver the lessons, as all of the
teachers in this study did. Facilitating that transition was important as students in Case 4
did not tend to notice much beyond the sensational aspects of the environment until they
had moved past the novelty space. A better understanding of the process and the time
required to effectively use it deserves further study.
Environmental Components
Through pattern-matching during cross-case analysis, the findings of this study
supported some aspects of the conceptual framework (Appendix B) and did not support
others when considering the contributions of the environment to the DIAL process.
These are discussed in the following sections.
Social Interactions and Cultural Elements
The environmental components did not contribute equally to learning across the
four cases of the study. The students in these cases associated their learning more heavily
with social interactions than with any of the other components. The heavy emphasis on
the social aspects of learning are in agreement with situative conceptions of learning (e.g.
Brown, et al., 1989; Cole & Engeström, 1993; Rogoff, 1990; Vygotsky, 1978) as well as
theories that could be called situated constructivism (e.g. Cobb & Yackel, 1996; Pea,
1993; Perkins, 1993). As in many educational settings, there was a very heavy reliance
on teacher-centered interactions where the teacher was the dispenser of knowledge.
281
Students seemed to value that traditional relationship. However, students and teachers
described and I observed in Case 4, teachers adopting non-traditional roles as they acted
more as experts, interacted with other experts, modeled learning for the students, and
acted in non-instructional roles, as also observed by Lai (1999) and DeWitt & Hohenstein
(2010).
It is important to understand the role of social interactions in DIAL. When
thinking about examples of DIAL experiences, including those in this study, it is easy to
think of the exotic physical or geographical settings or the non-traditional academic
activities in which students are engaged. All of this is important to DIAL but the social
interactions, particularly the teacher-centered instruction, seem to be of critical
importance to the learning of the content knowledge. Context is important but the
teachers largely provided the primary conceptual connections between the environment
and the learners’ experiences.
The findings of this study suggest that social interactions were an important
mediating factor (Vygotsky, 1978; Wertsch, 2007) for the cultural and emotional
components. Based on student perceptions of their learning processes, the cultural and
emotional environments seemed to contribute very little directly to the learning of the
content but it was clear that there were emotional and cultural contributions to learning
associated with the other identified components: Social Interactions, Physical
Environment, and Tools. This suggests that environmental contributors to DIAL may be
operating at different levels and in different ways as they influence the context vehicle.
Though not specifically addressed in this study, cultural norms must have contributed
heavily to establishing the relationships with a given group. That is, all of the social
282
interactions are based on cultural foundations and influenced by the emotional
environments.
Both Dewitt & Hohenstein (2010) and Lai (1999) found that power structures
between teachers and students as well as relationships between them changed on field
trips. This also seemed to be true for these DIAL experiences. In all of the cases
students had interacted with the teachers as both classroom teachers and during the DIAL
experiences of the study. A number of students reported that they appreciated the more
informal affect of their teachers and how they appreciated seeing their teachers learn
alongside them. The relationship between teachers and local experts in Cases 3 and 4 (as
described by teachers, students and observed in the field) also seemed to change the
learning environment by modeling expert dialog and a culture of professional interaction
as scientists. A more in-depth look at these relationships would add much to our
understanding of DIAL and science education and thus deserves attention in future
research.
One of the more surprising findings regarding the role of social interactions in
learning was the almost universal agreement amongst students that they had learned little
or nothing from their peers. Students did not report being distracted by social relations
and tensions, as reported by Smith et al. (2010) in a study of high school science camps
run as part of the public school curriculum in New Zealand. Based on a comparison
between student interview data and my field observations of Case 4 regarding peer
interactions, it seems that student learning may be influenced heavily by peers but they
do not seem to recognize that influence. In many cases students shared information with
each other, generated interest in a TSC, and discussed content knowledge together. This
283
was an ongoing process in Case 4 and so it is unclear if those students did not recognize
these as learning processes, did not remember the encounters, or if there was some other
factor that led students to believe they were not learning from each other. Again, further
investigation is warranted.
There are three primary implications of these findings on social interactions for
DIAL learning, centered around the idea that teachers need to recognize the importance
of their role in the process. It is not enough to simply provide the context or the
experience for students. Teachers must (1) guide students through the process, (2)
directly provide information for the students to interpret in context, and (3) help students
make connections between their experience and targeted information. The use of local
science experts was a useful tool in many ways but it was also important for teachers to
help students make sense of the experts’ information and see how it fit into the big
picture. Although the majority of data in this study did not suggest a strong peer
influence on learning, the discrepancy between field and interview data suggest that it
should be considered as potentially important.
Physical Environment
The physical environment was the second component that directly contributed
many contextual cues to the individual learners as they elaborated their understandings of
the TSCs. This is in contrast to existing research and one of the more important findings
of this study. To repeat a previous quote, “the physical environment does not so much
increase learning when it is excellent as inhibit it when it is poor” (Tessmer & Richey,
1997, p. 96). This was absolutely not the case in these DIAL experiences. Rather,
students picked up much important information directly from the physical environment as
284
they developed their understandings of the TSCs. At times the teachers guided the
students’ observations and at times the students noted examples of TSCs and
relationships on their own. In many cases these context cues were described by students
helping to develop complete pictures of the concepts or understand the ideas in a broader
context. Often these context cues from the physical environment became keystone events
that allowed a given student to finally understand a concept they had been wrestling with
or understand it at a much deeper, even schematic level.
The physical environment provided context cues through all of the senses and
allowed students to embody some of the concepts in ways that could not be done in an
abstracted way. Seeing examples of TSCs was described as important, as was the
association of information with geographic places. For students there was something
categorically different about direct experience with the physical environment that allowed
them to understand the concepts in ways that they could not when the information was
entirely abstract. This “you had to be there” effect was described as important by most of
the students in the study as they listed the many ways in which they felt that direct
experience provided some level of information that was different than they could access
through other means. though they had trouble defining the mechanism behind it.
Students struggled with explaining why that was so categorically different but their
descriptions suggest that this effect might have something to do with trusting one’s own
senses more than secondary information (even if implicitly) and the ability to judge scale
and complexity which cannot be done through description or recorded media. This is
certainly another area that needs further study.
285
The significant role of the physical environment in DIAL was an important
finding. DIAL hinges on the idea that students should be deeply immersed in authentic
contexts to enhance learning. If the physical setting of a place does not contribute to
learning then there is little sense in the logistical and financial difficulties associated with
providing many DIAL experiences. This study overwhelmingly showed that students
were using the physical environment to support the learning of conceptual knowledge and
in a number of ways that were not available through other means.
The implications of this finding are clear for the implementation of DIAL
experiences: the choice of the physical environment in which the experience takes place
is critically important. Although logistically challenging, bringing students into an
authentic context, conceptually linked to a relevant context, seems to be a powerful way
to add depth and relevance to science learning. Conversely, it may make more sense to
match the teaching to existing contexts, making use of schoolyards and even school
buildings as the context to teach ecology or engineering principles, for example, so that
the physical environment can be effectively utilized to support science learning and it is
no longer seen simply as a source of distraction.
Tools
Tools, including predominantly traditional academic tools, made up the third
category of environmental components that contributed cues directly to the formation of a
context vehicle. However, tools did not contribute to learning as heavily as social
interactions and the physical environment. The students in Case 4 had no required
reading, and very little access to other tools, and yet they showed the most learning. It
seems plausible that the role of tools could be more substantial in other cases of DIAL,
286
such as an experience that is more heavily driven by text-based source material or an
experience in which the context is a working science lab. The distinction between
academic and non-academic tools in the original conceptual framework was not borne out
in the data. Tools either contributed to learning or they did not, regardless of the
intentionality behind them and students rarely saw non-academic tools as directly
contributing to their learning.
Ballantyne & Packer (2010) reported that students prior to field trips had very low
interest in using tools such as worksheets during the trip and reported them as among the
least useful for learning after the trip. Students in this study did not necessarily report
academic tools as being particularly exciting to them, but they did often discuss them as
important aspects of their learning. Perhaps one difference is that the students in this
study tended to use or access tools when they needed them (e.g. dichotomous keys,
thermometers) or saw the tools as helping them understand what they were observing in
the field (e.g. readings, videos). This may have added the relevance that was lacking for
the students in the Ballantyne & Packer (2010) study. In agreement with Orion &
Hofstein (1994), the use of readings and preparatory materials was valued by the students
who had them (Cases 1,2,3), allowing them to interpret the environment once there, but
this did not seem to be critical, as evidenced by large changes in knowledge structures for
Case 4 students despite the lack of such materials.
The implications for DIAL are that tools should be chosen and used very
carefully. Educators are used to relying very heavily on tools such as books and
computers to deliver information. Certainly this role still exists for tools in DIAL but a
more important role might be in helping students interpret the information that is already
287
present in the environment. Tools should be used to preface an experience but not so
much that the information supersedes the students’ experience. Tools should be ready on
an on-demand basis so that students can bridge their own experience with established
scientific knowledge. Of course, this process needs to be modeled and facilitated by the
teacher, particularly at first.
Individual Role and Emotional Environment
Although I originally conceptualized the role of the individual and the emotional
environment as different elements in the DIAL conceptual framework (Appendix B), the
findings of this study indicated that they were more blended. Largely, the role of the
individual seemed to be bringing all of the environmental components together. The
emotional environment, apparent during the field study but rarely reported by students,
seemed to be influencing learning as more of a background element than as a direct
contributor, much like the cultural environment. The emotional / affective elements of
learning were expressed by students as individual rather than environmental factors.
When there were instances that could be considered as influenced by the emotional
environment, that influence was mediated by the social interactions and physical
environment components. For example, the comb jellies or dolphins in Case 4 were
emotional highs that were mediated by the physical environment (Wertsch, 2007).
Perhaps the most significant role of the individual was indexing the knowledge
distributed throughout the environment and within the mental representations of that
individual, as described in situated constructivism (Brown, et al., 1989; Cobb & Yackel,
1996; Perkins, 1993). Although the teachers often helped students to make connections
between concepts, the environment, and student experiences (past, present, and future), it
288
was up to each student to determine their relevance, accept those connections, or build on
them to incorporate past learning or their own unique perspectives. This indexing was
strengthened through the interactions of peripheral and facilitated learning opportunities
as students readily built contextual understanding around TSCs by associating them with
events, places, visual examples, embodied experiences, and communicated information.
Each student created these elaborate context vehicles by incorporating many elements of
the learning environment though teachers often facilitated the connection-making
process. This conception of the context vehicle is reflected in the conceptual framework
but the role of the individual learner is probably more active than originally proposed.
In the framework the learner adds context back into the learning environment
through reflection, a central theme in Experiential Learning Theory (Chapman, et al.,
1992; Kolb, 1984). The results of this study made it clear that the role of the individual is
more significant than simply reflecting. When one considers the emotional reactions,
reflection, reasoning, and indexing that students seemed to be doing consistently
throughout the learning process, it was clear that this role was what unified the
information into a rational, whole context vehicle.
The case of the novelty space (Falk, et al., 1978; Orion & Hofstein, 1994) is a
good example of how the individual has a pivotal and flexible role in DIAL. Novelty can
be seen as recognition that the context cues are unfamiliar to the learner and in need of
assimilation into her existing schemata or adjustment of her schemata (Rumelhart &
Ortony, 1977). Students often described this process as involving an emotional response
as well as a heightened sense of engagement for them, though perhaps this was
engagement in the event rather than in the TSC. Although the affective sphere includes
289
more than engagement, this study’s results do agree with past work showing the ties
between engagement and cognitive learning (Ballantyne, et al., 2001; Bogner, 1999;
Chapman, et al., 1992; Jakubowski, 2003; Shellman & Ewert, 2010). The field study
data from Case 4 confirmed student descriptions showing that once the novelty wore off
and the experience became de-sensationalized, the relationship to the context changed
and both the learning and understanding also changed character. When the learner was
taking in information in reaction to a perceived threat (avalanche, pythons, cold) his
reaction seemed to be more emotional and though students still described context during
those heightened emotional events, there seemed to be a disassociation from the TSCs.
Once the sense of threat or excitement wore off, students were open to new types of
context cues which they did not seem to perceive during the heightened emotional period.
Some emotional connection helped engage the students in the TSCs but too much, either
positive or negative, seemed to temporarily hinder content learning. It is possible that
these heightened emotional events changed the course of future learning for students
when the situation was de-sensationalized but it was not clear from this study. Further
study is needed in this area.
The most important implication of these findings is that teachers who use DIAL
need to be cognizant of the individualization of the learning. When the environment is so
complex physically, emotionally, socially, and conceptually, students are working with
much more information than they are in a typical classroom learning environment.
What’s more, students are potentially associating all of this information with the target
knowledge. Science teachers using DIAL experiences need to recognize and capitalize
on this environmental diversity and use highly individualized formative assessments to
290
make sure each individual student is developing their knowledge in ways that agree with
scientifically accepted understanding.
Contextualization
The results of this study confirmed that the students did associate many context
cues with the target knowledge and used them for indexing (Perkins, 1993) and recall.
The contextualization of the target knowledge happened in a number of key ways. First,
students acquired real world visual examples of the concepts they were tasked with
learning and could use these to recall and articulate their understanding of the concepts.
By seeing the concepts and processes illustrated in authentic contexts, students could pick
out subtleties based on a series of observations or note how the concept was not the clean
and precise concept it might have appeared to be when first hearing about it. In short,
they were able to develop more expert representations of the concept by understanding
the context that was now bound to the target concepts.
In addition to visual representations students also seemed to be adding
geographical references to the contextualization process- an idea that was not found
through the literature review and not accounted for in the conceptual framework. When
asked about a given topic, students often referred to the geographical place where that
concept was most clearly illustrated for them. However, this was truer for the cases in
which there was much geographical variety such as Case 4 in which students were
constantly on the move and each place was substantially different than the others. Thus,
geographical association was important for those students in contextualizing their
knowledge. In Case 2, the students experienced much less variety and, in turn, they
spoke more generally about place and did not seem to associate specific concepts with
291
specific places. This is an important finding in that the role of geographical
contextualization has not come up in the science education literature but it may be a
useful tool in helping students to understand and contrast concepts. By highlighting the
connections between specific places and concepts, teachers could help students recall
ideas and develop common understanding.
Through all sources of contextualization there was an observed relationship
between the level of contextualization and the level of learning across the cases, as shown
by the Pathfinder results and the student interviews. As in Rivet and Krajcik (2008),
contextualization was tied to learning. Contextualization did much more than help
students see how a concept could be applied in the real world, it actually helped the
students understand the concepts and helped them to develop knowledge structures that
were closer to the way experts organized their knowledge. The contextualization led to
more expert concept knowledge structures, in part by helping the students to see how the
various concepts were interrelated in the real world and giving the students a basis for
deciding how related two topics were. This was particularly evident in the described
cases of student PFnets in which a concept was entirely unconnected in the pretest and
then connected in a manner that agreed with the expert referent in the post-test. In all of
those cases interviewed students accurately described their new understanding of the
concepts and did so by framing them in the authentic contexts in which they were learned
and could be applied. Students were able to learn about a discrete concept but then
observe the concept within the entire ecosystem.
This is perhaps the most important and broadly applicable finding from the study.
Authentic contextualization is a powerful pedagogical tool that can significantly enhance
292
science learning. The levels of contextualization found in this study through DIAL,
though not directly comparable, seemed to far exceed those found in classroom-centered,
problem-based learning activities (Rivet & Krajcik, 2004a, 2004b, 2008). During the
DIAL experiences it seems that there were vastly more opportunities to access contextual
information from the authentic environment than can be done through more abstract
means in the classroom. Providing opportunities for students to generate contextualized
understanding of science concepts may have many applications beyond DIAL
experiences though it is unclear if this level of contextualization is possible without
DIAL and this too deserves further study.
Revised Conceptual Framework
The process of pattern matching analysis in case study research tests a theoretical
conceptualization against relevant data collected from multiple sources (Yin, 2009). In
the current study the DIAL conceptual framework (Appendix B) was built based on
relevant learning theory and past findings in contextualized learning. Based on the
discussion above, some elements of that framework were supported by the data and some
were not. In order to illustrate those differences a revised conceptual framework is
shown in Figure 6.1 and is shown side-by-side with the original framework in Appendix
B, to reflect the results of this study. The purpose of this revised framework is not to
definitively say that DIAL writ large is more accurately reflected by the new framework
but that it more accurately reflects the findings of this study. It is my hope that these two
versions of the framework will form the foundation of future study and that future work
will continue to test the patterns illustrated in both as we better develop our
understanding of contextualized learning and DIAL. In this section I highlight the
293
changes in the framework and discuss how the results of this study led to those changes
or to maintaining original elements.
Figure 6.1. In DIAL, target knowledge is inevitably bound to environmental and individual inputs that form a context vehicle to elaborate and associate the information. The learner stores representations that are modified through experience with the environment and thought processes. Learner access to context cues can be facilitated by a teacher or peripheral. Each learner contributes to and is influenced by the cultural and affective background through the learning process.
Learning Target
Context Vehicle
Learner
Social Interactions
Physical Environment
Peripheral
Facilitated
Context Cues
Cultural & Affective Background Environment
Memory
Indexing Reflecting Connecting Emoting
The Deep Immersion Academic Learning Process
294
One of the changes to the framework is the reduction in the number of
components directly contributing to the context vehicle. A situative learning perspective
(e.g. Brown, et al., 1989; Greeno, et al., 1996) suggests that all elements within any given
context are contributing to learning, as was reflected in the original framework.
The results of this study suggest that those components may be contributing in different
ways. Social interactions, tools, and cues from the physical environment all seemed to
directly contribute to context cues that students associated directly with the TSCs they
learned.
In contrast, students made only vague references to the cultural and emotional
environments as they described their understanding of concepts or the ways in which they
felt they had learned new content though the field study data suggested these elements
were operating in the background of the learning process. For this reason, the new
framework shows the cultural and emotional environment components as background
elements that have the potential to indirectly impact the other aspects. These background
elements probably influence the entire process and become elaborated into a learner’s
representations (memory) through mediation by social interactions and tools as
previously discussed. This idea agrees closely with Vygotsky’s (1978) description of the
learning process along with other situative learning theorists (Brown, et al., 1989; Brown
1993; Perkins, 1993; Rogoff, 1990; Wertsch, 2007). Although the student interview data
did not support this, the revised conceptual framework (figure 6.1) maintains these
elements because they are so consistently represented in learning theory, the field study
295
data did support their inclusion, and one of the goals of this new framework is to
encourage future research and these are elements that clearly deserve further study.
Based on student descriptions of their learning, three components of the
environment were regularly and directly associated with the learning of the TSCs: social
interactions, the physical environment, and tools. A fourth component, the individual
learner’s contribution was also important but seemed to be of a different nature, one of
processing rather than contributing new information. The three external components
were reconfigured on the revised framework to reflect a number of findings from this
study. First, the (now) three contextualizing environmental components are represented
as three different sizes to indicate the degree that each seems to contribute to DIAL.
Social interactions contribute most heavily, followed by the physical environment, and
then tools. The proportional sizes of the environmental components in the conceptual
framework should be seen as somewhat flexible and the contributions each one makes to
DIAL should be tested across a wider range of DIAL experiences.
Another distinction in the revised framework as compared to the original is the
connectivity of the environmental components. The original framework acknowledged
that the various components all became mingled as overall context but the results of the
study indicated that the components were interrelated at a process level as well. Social
interactions, for example, changed based on the physical setting while the interpretation
of the physical setting was dependent on social interactions, particularly guidance from
the teachers. Tool use was almost entirely driven by social interactions, again
predominantly based on guidance from the teachers. To account for this connectivity, all
of the components are now grouped together as a body of sources that together create
296
multi-faceted context cues for the learner. This higher degree of connectivity is also
more in keeping with a situated perspective of learning.
In the original conceptual framework, each environmental component was
represented as having equal contributions from facilitated and peripheral learning
opportunities. The revised framework indicates both the dominance of facilitated
opportunities as well as the interaction of both facilitated and peripheral opportunities in
forming context cues for learning. A final and important change to the framework
reflects the greater and multi-faceted role of the individual learner in the DIAL process,
showing the role as not simply reflection but indexing, emoting, and making connections
between all of the other elements of the learning environment.
Limitations
This study provides a view into how students use the components of a learning
environment to develop conceptual science knowledge. By looking at multiple cases, one
can get a better sense of how trends hold up in diverse settings. However, there are
infinite variables that go into any DIAL experience and each experience is therefore
unique. The ability to generalize is limited by this fact and thus this study should be seen
as a testing of the conceptual framework, a first step into exploring DIAL, rather than a
definitive account of the DIAL process.
A fundamental limitation of the study is that it relied largely on self-report of
student learning experiences. Although the assessment-driven interviews helped students
to recall learning events, it is still unrealistic to assume that their meta-cognitive
processes would recognize all aspects of learning. I can be more confident in reporting
what did contribute to DIAL in these cases than in ruling out elements that did not. This
297
study should be seen as a report on some contributors to DIAL rather than all
contributors. Similarly, the relative importance of each environmental contributor to
learning reflects students’ perceptions to a large degree as was shown by the disconnect
between field study data and interview data regarding the role of peer contributions to
learning. The reliance on sticking close to students’ own accounts of their experiences
was used to increase the trustworthiness of the account (Creswell, 2007) but it also adds
these inherent limitations.
The sampling design also limited this study, particularly for the quantitative
aspects. Larger samples within each case would have allowed a more robust comparison
between them. The intensity sample likely introduced a level of bias into the results. All
of the schools were independent schools and all but Case 1 served white, middle to upper
SES students. Although Case 1 represented a diverse and generally low SES subsample,
there are a number of selection mechanisms within the school that alter the make-up of
the student body. Further, almost all of the students had specifically chosen to participate
in the DIAL experiences. If the DIAL experiences had been implemented in a school
where not all of the students were excited about the experience, the results might have
been quite different. There was some suggestion of that in Case 3 with one or two
students who were not as engaged. Though case selection was limited in this study to
outdoor learning of ecology, DIAL is conceptualized more broadly and it is likely that
DIAL manifests differently when the context changes substantially. Caution should be
used in how the results are generalized to other populations.
Analysis of the data could have been strengthened with multiple coders and the
creation of a coding system that was cooperatively created and tuned. A measure of
298
inter-rater reliability would have strengthened the trustworthiness of the study. Similarly,
the use of member checking was more limited than what would have been ideal.
Students were able to review the PFnets to confirm that they truly reflected how they
organized their knowledge but due to the timing of the analysis coinciding with the
schools’ summer breaks and the lack of a database to track students when they left these
programs, it was not practical to conduct further member checking.
The Pathfinder process also has a number of limitations. First, it is a fluid
assessment that could be expected to fluctuate to a small degree even in repeated
measures with the same subject. The referents used are based on expert knowledge that
is also somewhat fluid. Acton et al. (1994) showed that the average of expert responses
was the best metric to determine student learning but that within the experts there could
be significant differences. As such, the expert referents should not be seen as an absolute
benchmark of correct answers but as a guide with which to judge general changes. As
the sample size increases the csim scores are more telling but qualitative examinations of
the PFnets are probably more valuable at the individual student level. It also seems that
there may have been a ceiling effect with the assessments. In two of the cases, there
seemed to be a ∆ csim value that may have reached a maximum. Within this study the
use of the Pathfinder assessments would have been strengthened with a more formal
instrument validation process.
The role of facilitation in this study was important but it was treated as either
contributing or not. Clearly there is wide variety in what facilitation looks like, along
with associated efficacies, and this was not taken into account in this study. Class size
was also an issue not only from the perspective of small sample sizes but also because it
299
most likely affected the interactions between students and teacher-student interactions,
both of which were shown to contribute to learning in this study. It seems likely that
some of these dynamics would change as class size increased.
Contributions
This work represents a number of contributions to the fields of science education,
learning theory, and experiential education. First, the DIAL construct and the two
associated conceptual frameworks define a heretofore undefined but practiced
pedagogical approach to contextualized science (and other disciplines) education. In
providing a way to conceptualize DIAL, practitioners and researchers have a more
defined starting point from which to manipulate and test the various aspects of it. The
data presented in this study suggest some trends within the framework that can also
provide some guidance in how teachers might approach DIAL to enhance student
learning and guidance to researchers for areas that need further study.
As outlined in Chapter Two, the fields of experiential learning and contextualized
science education suffer from a lack of empirical evidence on if and how the learning of
content knowledge occurs as a result of these pedagogical approaches. This study does
provide both quantitative and qualitative evidence to show that science concept learning
did take place for most of the participating students and outlines how those students
interacted with their learning environments to lead to that learning.
This study was based on a theoretical foundation that encompasses both cognitive
and situative conceptions of learning in a manner that is gaining traction in learning
theory literature and discussions (Cobb & Bowers, 1999; Greeno, et al., 1996; Pea, 1993;
Perkins, 1993; Salomon, 1993a, 1993b) but also needs further empirical testing. The
300
cases studied here provided strong support for this idea of “situated constructivism”
showing that there was an ever-present interaction between the individual and
environmental learning processes as students built their concept knowledge within the
given domains.
This study illustrated an evaluation tool that could be used by both practitioners
and researchers to measure the efficacy of DIAL experiences or other similarly open
learning environments. The Pathfinder algorithm proved to be an effective tool to
measure conceptual knowledge within the content domain of each class that allowed
content-specific feedback but also seemed to be responsive to multiple ways of knowing
or contextualizing the given concepts. Pathfinder has much potential for future use as an
assessment or evaluation tool in many aspects of experiential and contextualized
education and addresses the dearth of rigorous assessment tools typically available for
these pedagogical approaches.
The Pathfinder algorithm and the resulting graphics of structural knowledge
(PFnets) were shown to have much potential for mixed methods research. The
quantitative nature of the process allowed for meaningful statistical analysis of the
sample while the highly individualized graphic results shown in this study provided for
an efficient interview process that allowed the questions to immediately focus on each
students’ individualized knowledge structures.
Overall this study introduced a new line of research into DIAL, a newly defined
approach to learning contextualized academic content through immersion in a relevant
learning environment. The implications of this line of research extend beyond the
practice of DIAL and have the potential to inform science and other disciplinary
301
education from the field to the classroom as we come to better understand the learning
process in contextualized, authentic learning environments.
Recommendations for Future Research
Because this study was largely exploratory, it generated more questions than
answers, providing much fodder for future research. Probably the most needed study in
this line of inquiry would be a large-scale, comparative study of DIAL and a more
traditional approach with matched curricula and students. The most direct offshoot of
this study should be the further testing and adjusting of the original and revised
conceptual frameworks (Appendix B). It was developed based on theoretical constructs
and adjusted based on the results of this multiple case study but there are a number of
related questions that still need to be answered:
1. Facilitated and peripheral learning opportunities:
a. Do students interpret or value information differently when it comes from
facilitated versus peripheral sources?
b. Can a learning environment with more peripheral than facilitated learning
opportunities be as effective under the right conditions or with more
advanced learners?
c. How do variable approaches to facilitation affect DIAL?
d. How can facilitation be used to enhance peripheral learning?
e. Do the relative benefits of peripheral and facilitated learning opportunities
shift with the expertise of the students? Does expertise allow for greater
learning potential from peripheral learning opportunities?
302
f. Are there identifiable characteristics of individual students that would
allow practitioners to predict whether facilitated or peripheral learning
opportunities are more likely to be effective for them?
2. Contributions of the environmental components:
a. Are all of the environmental components needed to lead to effective
contextualization or can it be achieved with just one ore two?
b. How consistent are the proportional contributions of the environmental
components across DIAL experiences?
c. Why do students not readily recognize peer-to-peer learning in DIAL? Is
this common across DIAL experiences?
d. How do teacher-expert interactions affect learning in DIAL settings?
e. When students index their learning in association with geographical
places, what are the implications for long-term recall?
f. Do heightened emotional events occurring in context prime students for
later learning?
3. Contextualization:
a. Can the levels of contextualization found in relation to the DIAL
experiences be transferred to or fostered in classroom settings through
creative facilitation by teachers and curricula?
b. Why or how does one’s physical presence in an authentic context change
the way information is learned? What explains the “you had to be there
effect”?
303
4. DIAL:
a. Does the conceptual framework accurately model learning in other and
different DIAL environments?
b. When students focus their attention on new learning to the detriment of
past learning, does that effect attenuate over time or are students left with
a skewed sense of importance?
c. Are learning gains achieved through DIAL resilient over time and new
learning?
d. Is there a relationship between the duration of a DIAL event and the level
or type of learning that students achieve?
e. How does novelty space attenuate over the course of a DIAL experience
and how does this impact learning?
5. Methodology: Are there predictable limits to the sensitivity of the Pathfinder
algorithm and process?
Chapter Six Summary
In the final chapter of this dissertation I discussed the findings of the study,
following the two research questions. First I discussed the science concept learning that
occurred in the four cases and concluded that although DIAL can lead to significant
learning, the process and context do not automatically do so. There are variables that
must be addressed well to increase the chances of student learning, as was shown in
comparing Case 3 (zero growth) to the other cases . Those variables were discussed and
a revision of the study’s conceptual framework was presented as a result. Although
facilitated learning opportunities were more often associated with science concept
304
learning, both peripheral and facilitated learning opportunities were important for DIAL,
each contributing different qualities to the learning process, and a synergistic effect
seemed to lead to greater or deeper learning when they were used together. In agreement
with past work, the social aspect of the learning environment proved to be the most
important source of contextualizing cues. In contrast to the literature, the physical
environment also proved to be an important direct contributor to learning. Tools were
less so. Contextualization led to more expert knowledge structures, and occurred as a
result of the individual learner indexing and making connections amongst all of the
environmental components. The implications for DIAL teaching and further research
were discussed.
305
REFERENCES
Achieve. (2005). Rising to the challenge: Are high school graduates prepared for college and work? A report on a study of recent high school graduates, college instructors, and employers. Washington, DC.
ACT. (2011). A report on the condition of college and career readiness. Retrieved from www.act.org/readiness/2011
Acton, W. H., Johnson, P. J., & Goldsmith, T. E. (1994). Structural knowledge assessment: Comparison of referent structures. Journal of Educational Psychology, 86(2), 303-311. doi: 10.1037//0022-0663.86.2.303
Adey, P., & Shayer, M. (1990). Accelerating the development of formal thinking in middle and high school students. Journal of Research in Science Teaching, 27(3), 267-285. doi: 10.1002/tea.3660270309
Anderson, D., Thomas, G. P., & Nashon, S. M. (2009). Social barriers to meaningful engagement in biology field trip group work. Science Education, 93(3), 511-534. doi: 10.1002/sce.20304
Anderson, J. R. (1990). Cognitive psychology and its implications (3rd ed.). New York: W.H. Freeman and Company.
Anderson, J. R., Reder, L. M., & Simon, H. A. (1996). Situated learning and education. Educational Researcher, 25(4), 5-11. doi: 10.3102/0013189X025004005
Anderson, J. R., Reder, L. M., & Simon, H. A. (1997). Rejoinder: Situative versus cognitive perspectives: Form versus substance. Educational Researcher, 26(1), 18-21. doi: 10.2307/1176868
Anderson-Levitt, K. M. (2006). Ethnography. In J. L. Green, G. Camilli & P. B. Elmore (Eds.), Handbook of complementary methods in education research (pp. 279-295). New York: Routledge.
Baldwin, C., Persing, J., & Magnuson, D. (2004). The role of theory, research, and evaluation in adventure education. Journal of Experiential Education, 26(3), 17.
Ballantyne, R., Fien, J., & Packer, J. (2001). School environmental education programme impacts upon student and family learning: A case study analysis. Environmental Education Research, 7(1), 23-37. doi: 10.1080/13504620124123
Ballantyne, R., & Packer, J. (2010). Nature-based excursions: School students' perceptions of learning in natural environments. International Research in Geographical and Environmental Education, 11(3), 218-236. doi: 10.1080/10382040208667488
306
Barab, S. A., Scott, B., Siyahhan, S., Goldstone, R., Ingram-Goble, A., Zuiker, S. J., & Warren, S. (2009). Transformational play as a curricular scaffold: Using videogames to support science education. Journal of Science Education and Technology, 18(4), 305-320. doi: 10.1007/s10956-009-9171-5
Bartlett, F. C. (1932). Remembering. Cambridge, UK: Cambridge University Press.
Battista, M. T. (1994). On Greeno's environmental/model view of conceptual domains: A spatial/geometric perspective. Journal for Research in Mathematics Education, 25(1), 86-94. doi: 10.2307/749293
Bell, M. (1993). What constitutes experience? Rethinking theoretical assumptions. Journal of Experiential Education, 16(1), 19–24.
Bogner, F. X. (1998). The influence of short-term outdoor ecology education on long-term variables of environmental perspective. The Journal of Environmental Education, 29(4), 17-29. doi: 10.1080/00958969809599124
Bogner, F. X. (1999). Empirical evaluation of an educational conservation programme introduced in Swiss secondary schools. International Journal of Science Education, 21(11), 1169-1185. doi: 10.1080/095006999290138
Branaghan, R. J. (1990). Pathfinder networks and multidimensional spaces: Relative strengths in representing strong associates. In R. W. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 111-120). Norwood, NJ: Ablex.
Bransford, J. D., Brown, A. L., & Cocking, R. R. (Eds.). (2000). How people learn: Brain, mind, experience, and school (expanded ed.). Washington, D.C.: National Academy Press.
Breunig, M. (2008). The historical roots of experiential education. In K. Warren, D. Mitten & T. Loeffler (Eds.), Theory & practice of experiential education (pp. 77–92). Boulder, CO: Association for Experiential Education.
Brewer, W. F., & Treyens, J. (1981). Role of schemata in memory for places. Cognitive Psychology, 13, 207-230. doi: 10.1016/0010-0285(81)90008-6
Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32-42. doi: 10.3102/0013189X018001032
Brown, J. S., & Duguid, P. (1996). Stolen knowledge. In H. McLellen (Ed.), Situated learning perspectives (pp. 47-56). Englewood Cliffs, NJ: Educational Technology Publications.
BSCS. (2006). The cornerstone-to-capstone approach: Creating coherence in high school science. Colorado Springs, CO: BSCS.
307
Bulte, A. M. W., Westbroek, H. B., de Jong, O., & Pilot, A. (2006). A research approach to designing chemistry education using authentic practices as contexts. International Journal of Science Education, 28(9), 1063-1086. doi: 10.1080/09500690600702520
Burnett, J. (1996). Small group behavior in a novel field environment: Senior science students visit a marine theme park. Australian Science Teachers Journal, 42(4), 59-70.
Carver, R. (1996). Theory for practice: A framework for thinking about experiential education. Journal of Experiential Education, 19(1), 8-13.
Cason, D., & Gillis, H. L. (1994). A meta-analysis of outdoor adventure programming with adolescents. Journal of Experiential Education, 17(1), 40-47.
Chapman, S., McPhee, P., & Proudman, B. (1992). What is experiential education? Journal of Experiential Education, 15(2), 16–23.
Choi, J.-I., & Hannafin, M. (1995). Situated cognition and learning environments: Roles, Structures, and implications for design. Educational Technology Research and Development, 43(2), 53-69. doi: 10.1007/BF02300472
Cobb, P., & Bowers, J. (1999). Cognitive and situated learning perspectives in theory and practice. Educational Researcher, 28(2), 4-15. doi: 10.3102/0013189X028002004
Cobb, P., & Yackel, E. (1996). Constructivist, emergent, and sociocultural perspectives in the context of developmental research. Educational Psychologist, 31(3/4), 175-190. doi: doi:10.1207/s15326985ep3103&4_3
Cole, M., & Engeström, Y. (1993). A cultural-historical approach to distributed cognition. In G. Salomon (Ed.), Distributed cognitions: Psychological and educational considerations (pp. 1-46). Cambridge, UK: Cambridge University Press.
Cole, M., & Scribner, S. (1978). Introduction. In M. Cole, V. John-Steiner, S. Scribner & E. Souberman (Eds.), Mind in society (pp. 1-14). Cambridge, MA: Harvard University Press.
Conrad, D., & Hedin, D. (1982). The impact of experiential education on adolescent development. In J. Beker, D. Conrad & D. Hedin (Eds.), Youth participation and experiential education (Vol. 4, pp. 57-76). New York: Haworth Press.
Creswell, J. W. (2007). Qualitative inquiry and research design: Choosing among five approaches. Thousand Oaks, CA: SAGE.
CTGV, T. C. a. T. G. a. V. (1990). Anchored instruction and its relationship to situated cognition. Educational Researcher, 19(6), 2-10. doi: 10.3102/0013189X019006002
308
Daniel, B. (2010). Canvas, catalyst, crucible: Exploring the role of the setting in the wilderness expedition experience. Paper presented at the National Conference on Outdoor Leadership, Estes Park, CO.
de Groot, A. D. (1965). Thought and choice in chess. The Hague, Netherlands: Mouton.
Dean, D., & Kuhn, D. (2007). Direct instruction vs. discovery: The long view. Science Education, 91(3), 384-397. doi: 10.1002/sce.20194
Dearholt, D. W., & Schvaneveldt, R. W. (1990). Properties of pathfinder networks. In R. W. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 1-30). Norwood, NJ: Ablex.
Dewey, J. (1884). The new psychology. The Andover Review, 2.
Dewey, J. (1938/1997). Experience and Education (First Touchstone ed.). New York: Simon & Schuster.
DeWitt, J., & Hohenstein, J. (2010). School trips and classroom lessons: An investigation into teacher-student talk in two settings. Journal of research in science teaching, 47(4), 454-473. doi: 10.1002/tea.20346
Dillon, J., Rickinson, M., Tearney, K., Morris, M., Choi, M. Y., Sanders, D., & Benefield, P. (2006). The value of outdoor learning: Evidence from research in the UK and elsewhere. School Science Review, 87(320), 107-111.
Dochy, F., Segers, M., Van den Bossche, P., & Gijbels, D. (2003). Effects of problem-based learning: a meta-analysis. [Meta-Analysis]. Learning and Instruction, 13(5), 533-568. doi: 10.1016/s0959-4752(02)00025-7
Durso, F. T., & Coggins, K. A. (1990). Graphs in the social and psychological sciences: Empirical contributions of pathfinder. In R. W. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 31-50). Norwood, NJ: Ablex.
Eaton, D. (1998). Cognitive and affective learning in outdoor education (Unpublished doctoral dissertation). University of Toronto, Toronto.
Emmons, K. M. (1997). Perceptions of the environment while exploring the outdoors: A case study in Belize. Environmental Education Research, 3(3), 327-344. doi: 10.1080/1350462970030306
Engel Clough, E., & Wood-Robinson, C. (1985). How secondary students interpret instances of biological adaptation. Journal of Biological Education, 19(2), 125-130. doi: 10.1080/00219266.1985.9654708
Esterberg, K. G. (2002). Qualitative methods in social research. Boston, MA: McGraw Hill.
309
Falk, J. H. (2005). Free-choice environmental learning: framing the discussion. Environmental Education Research, 11(3), 265-280. doi: 10.1080/13504620500081129
Falk, J. H., & Balling, J. D. (1982). The field trip milieu: Learning and behavior as a function of contextual events. Journal of Educational Research, 76(1), 22-28.
Falk, J. H., & Dierking, L. D. (1997). School field trips: Assessing their long-term impact. Curator, 40(3), 211-218. doi: 10.1111/j.2151-6952.1997.tb01304.x
Falk, J. H., & Dierking, L. D. (2010). The 95 percent solution. American Scientist, 98(6), 486-490. doi: 10.1511/2010.87.486
Falk, J. H., Martin, W. W., & Balling, J. D. (1978). The novel field-trip phenomenon: Adjustment to novel settings interferes with task learning. Journal of Research in Science Teaching, 15(2), 127-134. doi: 10.1002/tea.3660150207
Farmer, A. J., & Wott, J. A. (1995). Field trips and follow-up activities: Fourth graders in a public garden. Journal of Environmental Education, 27(1), 33-35. doi: 10.1080/00958964.1995.9941969
Fensham, P. J. (2009). Real world contexts in PISA science: Implications for context-based science education. Journal of Research in Science Teaching, 46(8), 884-896. doi: 10.1002/tea.20334
Fenwick, T. J. (2000). Expanding conceptions of experiential learning: A review of the five contemporary perspectives on cognition. Adult Education Quarterly, 50(4), 243. doi: 10.1177/07417130022087035
Fox, K. (2008). Rethinking experience: What do we mean by this word “experience”? Journal of Experiential Education, 31(1), 36-54. doi: 10.5193/JEE.31.1.36
Fraser, B. J. (2007). Classroom learning environments. In S. K. Abell & N. G. Lederman (Eds.), Handbook of research on science education (pp. 103-124). Mahwah, NJ: Lawrence Erlbaum.
Gammack, J. G. (1990). Expert conceptual structure: The stability of pathfinder representations. In R. W. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 213-226). Norwood, NJ: Ablex.
Gerber, B., Cavallo, A., & Marek, E. (2001). Relationships among informal learning environments, teaching procedures and scientific reasoning ability. International Journal of Science Education, 23(5), 535-549. doi: 10.1080/09500690116971
Gilbert, J. K. (2006). On the nature of "context" in chemical education. International Journal of Science Education, 28(9), 957-976. doi: 10.1080/09500690600702470
310
Goldsmith, T. E., & Davenport, D. E. (1990). Assessing structural similarity of graphs. In R. W. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 75-87). Norwood, NJ: Ablex.
Goldsmith, T. E., & Johnson, P. J. (1990). A structural assessment of classroom learning. In R. W. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 241-254). Norwood, NJ: Ablex.
Goldsmith, T. E., Johnson, P. J., & Acton, W. H. (1991). Assessing structural knowledge. Journal of Educational Psychology, 83(1), 88-96. doi: 10.1037//0022-0663.83.1.88
Greeno, J. G. (1991). Number sense as situated knowing in a conceptual domain. Journal for research in mathematics education, 22(3), 170-218.
Greeno, J. G. (1997). Response: On claims that answer the wrong questions. Educational Researcher, 26(1), 5-17. doi: 10.2307/1176867
Greeno, J. G., Collins, A. M., & Resnick, L. B. (1996). Cognition and learning. In D. C. Berliner & R. C. Calfee (Eds.), Handbook of educational psychology (pp. 15-46). New York: Simon & Schuster Macmillan.
Gruenewald, D., A. (2003). The best of both worlds: A critical pedagogy of place. Educational Researcher, 32(4), 3-12. doi: 10.3102/0013189X032004003
Hake, R. R. (1998). Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. American Journal of Physics, 66(1), 64-74. doi: 10.1119/1.18809
Hanscombe, K. B., Haworth, C. M., Davis, O. S., Jaffee, S. R., & Plomin, R. (2011). Chaotic homes and school achievement: A twin study. Journal of Child Psychology and Psychiatry, 52(11), 1212-1220. doi: 10.1111/j.1469-7610.2011.02421.x
Hattie, J., Marsh, H. W., Neill, J. T., & Richards, G. E. (1997). Adventure education and Outward Bound: Out-of-class experiences that make a lasting difference. Review of Educational Research, 67(1), 43-87. doi: 10.3102/00346543067001043
Hunt, J. S. J. (1981). Dewey's philosophical method and its influence on his philosophy of education. Journal of Experiential Education, 4(1), 29–34.
Itin, C. M. (1999). Reasserting the philosophy of experiential education as a vehicle for change in the 21st century. Journal of Experiential Education, 22(2), 91–98.
Jakubowski, L. M. (2003). Beyond book learning: Cultivating the pedagogy of experience through field trips. Journal of Experiential Education, 26(1), 24-33.
311
John-Steiner, V., & Souberman, E. (1978). Afterword. In M. Cole, V. John-Steiner, S. Scribner & E. Souberman (Eds.), Mind in society (pp. 121-133). Cambridge, MA: Harvard University Press.
Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed-methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14-26. doi: 10.3102/0013189X033007014
Joplin, L. (1981). On defining experiential education. Journal of Experiential Education, 4(1), 17–20.
Kesidou, S., & Roseman, J. E. (2002). How well do middle school science programs measure up? Findings from Project 2061's curriculum review. Journal of Research in Science Teaching, 39(6), 522-549. doi: 10.1002/tea.10035
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41(2), 75-86. doi: 10.1207/s15326985ep4102_1
Klahr, D., & Nigam, M. (2004). The equivalence of learning paths in early science instruction: Effects of direct instruction and discovery learning. Psychological Science, 15(10), 661-667. doi: 10.1111/j.0956-7976.2004.00737.x
Knapp, D., & Barrie, E. (2001). Content evaluation of an environmental science field trip. Journal of Science Education and Technology, 10(4), 351-357. doi: 10.1023/A:1012247203157
Knapp, D., & Benton, G. M. (2006). Episodic and semantic memories of a residential environmental education program. Environmental Education Research, 12(2), 165-177. doi: 10.1080/13504620600688906
Kolb, D. A. (1984). Experiential learning: Experience as the source of learning and development. Upper Saddle River, NJ: Prentice Hall.
Kolb, D. A., Boyatzis, R. E., & Mainemelis, C. (2000). Experiential learning theory: Previous research and new directions. In R. J. Sternberg & L. F. Zhang (Eds.), Perspectives on cognitive, learning, and thinking styles. Mahwah, NJ: Lawrence Erlbaum.
Kraft, R. J. (1986). Toward a theory of experiential education. In R. Kraft & M. Sakofs (Eds.), The theory of experiential education (2nd ed., pp. 7–38). Boulder, CO: Association for Experiential Education.
312
Lai, K. C. (1999). Freedom to learn: A study of the experiences of secondary school teachers and students in a geography field trip. International Research in Geographical and Environmental Education, 8(3), 239-255. doi: 10.1080/10382049908667614
Lave, J. (1988). Mind, mathematics, and culture in everyday life. Cambridge, MA: Cambridge University Press.
Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. New York: Cambridge University Press.
Lee, C. D. (2011). Soaring above the clouds, delving the ocean's depths: Understanding the ecologies of human learning and the challenge for education science. Educational Researcher, 39(9), 643-655. doi: 10.3102/0013189x10392139
Leech, N. L., & Onwuegbuzie, A. J. (2007). A typology of mixed methods research designs. Quality & Quantity, 43(2), 265-275. doi: 10.1007/s11135-007-9105-3
Li, M., Ruiz-Primo, M. A., & Shavelson, R. J. (2006). Towards a science achievement framework: The case of TIMSS 1999. In S. J. Howie & T. Plomp (Eds.), Contexts of learning mathematics and science: Lessons learned from TIMSS (pp. 291-311). Florence, KY: Routledge.
Lisowski, M., & Disinger, J. F. (1991). The effect of field-based instruction on student understandings of ecological concepts. Journal of Environmental Education, 23(1), 19-23. doi: 10.1080/00958964.1991.9943065
MacKenzie, A. A., & White, R. T. (1982). Fieldwork in geography and long-term memory structures. American Educational Research Journal, 19(4), 623-632. doi: 10.3102/00028312019004623
Martens, S., & Wyble, B. (2010). The attentional blink: Past, present, and future of a blind spot in perceptual awareness. Neuroscience and Biobehavioral Reviews, 34(6), 947-957. doi: 10.1016/j.neubiorev.2009.12.005
Martin, W. W., Falk, J. H., & Balling, J. D. (1981). Environmental effects on learning: The outdoor field trip. Science Education, 65(3), 301-309. doi: 10.1002/sce.3730650309
Mayer, R. E. (2004). Should there be a three-strikes rule against pure discovery learning? The case for guided methods of instruction. [Review]. The American Psychologist, 59(1), 14-19. doi: 10.1037/0003-066X.59.1.14
McCaslin, M., & Good, T. L. (1992). Compliant cognition: The misalliance of management and instructional goals in current school reform. Educational Researcher, 21(3), 4-17. doi: 10.3102/0013189X021003004
313
McCloskey, M. E., & Glucksberg, S. (1978). Natural categories: Well defined or fuzzy sets? Memory and Cognition, 6(4), 462-472. doi: 10.3758/BF03197480
Menon, V., Boyett-Anderson, J. M., Schatzberg, A. F., & Reiss, A. L. (2002). Relating semantic and episodic memory systems. Cognitive Brain Research, 13(2), 261-265. doi: 10.1016/S0926-6410(01)00120-3
Miles, M. B., & Huberman, M. A. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks, CA: SAGE.
Miller, G. A., & Gildea, P. (1987). How children learn words. Scientific American, 94-99. doi: 10.1038/scientificamerican0987-94
Milton, B., & Cleveland, E. (1995). Changing perceptions of nature, self, and others: A report on a park/school program. Journal of Environmental Education, 26(3), 32-40. doi: 10.1080/00958964.1995.9941443
Mink, A., & O'Steen, B. (2003). Reaching beyond the choir: Taking experiential education down from the mountain and into the public school. Journal of Experiential Education, 25(3), 355–355.
Moll, L., Tapia, J., & Whitmore, K. (1993). Living knowledge: The social distribution of cultural resources for thinking. In G. Salomon (Ed.), Distributed cognitions (pp. 139-163). Cambridge, UK: Cambridge University Press.
Morrow, S. L. (2005). Quality and trustworthiness in qualitative research in counseling psychology. Journal of Counseling Psychology, 52(2), 250-260. doi: 10.1037/0022-0167.52.2.250
Nardi, B. A. (1996). Studying context: A comparison of activity theory, situated action models, and distributed cognition. In B. A. Nardi (Ed.), Context and consciousness: Activity theory and human-computer interaction. Boston, MA: MIT Press.
NCES. (2009). Science in action: Hands-on and interactive computer tasks from the 2009 science assesment (I. o. E. Science, Trans.) The Nation's Report Card (pp. 24). Washington, DC: U.S. Department of Education.
Novak, J. D., & Musonda, D. (1991). A twelve-year longitudinal study of science concept learning. American Educational Research Journal, 28(1), 117-153. doi: 10.3102/00028312028001117
NRC. (2011a). Promising practices in undergraduate science, technology, engineering, and mathematics education: Summary of two workshops. Washington, DC: National Academies Press Retrieved from http://www.nap.edu/catalog.php?record_id=13099.
314
NRC. (2011b). Successful STEM education: Identifying effective approaches in science, technology, engineering, and mathematics. Washington, DC: National Academies Press Retrieved from http://www.nap.edu/catalog.php?record_id=13158.
NRC, N. R. C. (2012). A framework for K-12 science education (C. o. a. C. F. f. N. K.-S. E. Standards, Trans.). Washington, D.C.: National Academy of Sciences.
Nundy, S. (1999). The fieldwork effect: The role and impact of fieldwork in the upper primary school. International Research in Geographical and Environmental Education, 8(2), 190-198. doi: 10.1080/10382049908667608
O'Connor, K. B. (2009). SEER 2008 abstract: Northern exposures: Models of experiential learning in indigenous education. Journal of Experiential Education, 31(3), 415-429.
OECD. (2010). PISA 2009 results, what students know and can do- student performance in reading, mathematics, and science (Volume I): Organisation for Economic Co-Operation and Development.
Onwuegbuzie, A. J., & Johnson, R. B. (2006). The validity issue in mixed research. Research In The Schools, 13(1), 48-63. doi: 10.1080/00219266.1993.9655305
Onwuegbuzie, A. J., Leech, N. L., & Collins, K. M. T. (2008). Interviewing the interpretive researcher: A method for addressing the crises of representation, legitimation, and praxis. International Journal of Qualitative Methods, 7(4), 1-17.
Openshaw, P. H., & Whittle, S. J. (1993). Ecological field teaching: How can it be made more effective? Journal of Biological Education, 27(1), 58-67. doi: 10.1080/00219266.1993.9655305
Orion, N., & Hofstein, A. (1994). Factors that influence learning during a scientific field trip in a natural environment. Journal of Research in Science Teaching, 31(10), 1097-1119. doi: 10.1002/tea.3660311005
Patton, M. Q. (2002). Qualitative research and evaluation methods (3rd ed.). Thousand Oaks, CA: SAGE.
Pea, R. D. (1993). Practices of distributed intelligence and designs for education. In G. Salomon (Ed.), Distributed cognitions: Psychological and educational considerations. (pp. 47-87). Cambridge, UK: Cambridge University Press.
Perkins, D. (1993). Person-plus: A distributed view of thinking and learning. In G. Salomon (Ed.), Distributed cognitions: Psychological and educational considerations (pp. 88-110). Cambridge, UK: Cambridge University Press.
315
Plante, T. G., Lackey, K., & Hwang, J. Y. (2009). The impact of immersion trips on development of compassion among college students. Journal of Experiential Education, 32(1), 28-43. doi: 10.5193/JEE.32.1.28
Pressley, M., McDaniel, M. A., Turnure, J. E., Wood, E., & Ahmad, M. (1987). Generation and precision of elaboration: Effects on intentional and incidental learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 13(2), 291-300. doi: 10.1037//0278-7393.13.2.291
Prokop, P., Tuncer, G., & Kvasničák, R. (2007). Short-term effects of field programme on students’ knowledge and attitude toward biology: A Slovak experience. Journal of Science Education and Technology, 16(3), 247-255. doi: 10.1007/s10956-007-9044-8
Purdie, N., & Neill, J. (1999). Japanese students down-under: Is Australian outdoor education relevant to other cultures? Australian Journal of Outdoor Education, 4(1), 48-56.
Purdie, N., Neill, J. T., & Richards, G. E. (2002). Australian identity and the effect of an outdoor education program. Australian Journal of Psychology, 54(1), 32-39. doi: 10.1080/00049530210001706493
Quay, J. (2003). Experience and participation: Relating theories of learning. Journal of Experiential Education, 26(2), 105–116.
Resnick, L. B. (1987). The 1987 presidential address: Learning in school and out. Educational Researcher, 16(9), 13-20+54. doi: 10.2307/1175725
Rickinson, M., Dillon, J., Tearney, K., Morris, M., Choi, M. Y., Sanders, D., & Benefield, P. (2004). A review of research on outdoor learning. London, UK: National Foundation for Educational Research and King's College London.
Rivet, A. E., & Krajcik, J. S. (2004a). Achieving standards in urban systemic reform: An example of a sixth grade project-based science curriculum. Journal of Research in Science Teaching, 41(7), 669-692. doi: 10.1002/tea.20021
Rivet, A. E., & Krajcik, J. S. (2004b). Contextualizing instruction in project-based science: Activating students' prior knowledge and experiences to support learning. Paper presented at the 6th International Conference on Learning Sciences, Santa Monica, CA.
Rivet, A. E., & Krajcik, J. S. (2008). Contextualizing instruction: Leveraging students' prior knowledge and experiences to foster understanding of middle school science. Journal of Research in Science Teaching, 45(1), 79-100. doi: 10.1002/tea.20203
316
Roberts, J. (2002). Beyond learning by doing: The brain compatible approach. Journal of Experiential Education, 25(2), 281–285.
Roberts, J. (2008). From experience to neo-experiential education: Variations on a theme. Journal of Experiential Education, 31(1), 19-35. doi: 10.5193/JEE.31.1.19
Robinson, W. R. (2001). Cognitive requirements of open-ended learning environments. Journal of Chemical Education, 78(1), 20-21. doi: 10.1021/ed078p20
Rogoff, B. (1990). Apprenticeship in thinking: Cognitive development in social context. New York: Oxford University Press.
Rubin, D. C. (1990). Directed graphs as memory representations: The case of rhyme. In R. W. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 121-132). Norwood, NJ: Ablex.
Rumelhart, D. E., & Ortony, A. (1977). The representation of knowledge in memory. In R. C. Anderson, R. J. Spiro & W. E. Montague (Eds.), Schooling and the acquisition of knowledge. Hillsdale, NJ: Lawrence Erlbaum.
Salomon, G. (1993a). Editor's introduction. In G. Salomon (Ed.), Distributed cognitions: Psychological and educational considerations (pp. xi-xxi). Cambridge, UK: Cambridge University Press.
Salomon, G. (1993b). No distribution without individuals' cognition: A dynamic interactional view. In G. Salomon (Ed.), Distributed cognitions: Psychological and educational considerations (pp. 111-138). Cambridge, UK: Cambridge University Press.
Schank, R. C., & Abelson, R. P. (1975). Scripts, plans, and knowledge. Paper presented at the The Fourth International Joint Conference on Artificial Intelligence, Tbilisi, Georgia, USSR.
Schneider, W., Gruber, H., Gold, A., & Opwis, K. (1993). Chess expertise and memory for chess positions in children and adults. Journal of Experimental Child Psychology, 56, 328-349. doi: 10.1006/jecp.1993.1038
Schvaneveldt, R. W. (1990). Proximities, networks, and schemata. In R. W. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 135-148). Norwood, NJ: Ablex.
Schvaneveldt, R. W., Dearholdt, D. W., & Durso, F. T. (1988). Graph theoretic foundations of pathfinder networks. Computers and Mathematics with Applications 15(4), 337-345. doi: 10.1016/0898-1221(88)90221-0
Schvaneveldt, R. W., Durso, F. T., Goldsmith, T. E., Breen, T. J., & Cooke, N. M. (1985). Measuring the structure of expertise. International Journal of Man-Machine Studies, 23, 699-728. doi: 10.1016/S0020-7373(85)80064-X
317
Seaman, J. (2008). Experience, reflect, critique: The end of the “learning cycles” era. Journal of Experiential Education, 31(1), 3-18. doi: 10.5193/JEE.31.1.3
SEER. (2000). The effects of environment-based education of student achievement. San Diego, CA: State Education & Environment Roundtable, California Student Assessment Project.
Shavelson, R. J. (1972). Some aspects of the correspondence between content structure and cognitive structure in physics instruction. Journal of Educational Psychology, 63(3), 225-234. doi: 10.1037/h0032652
Shavelson, R. J. (1974). Methods for examining representations of a subject-matter structure in a student's memory. Journal of Research in Science Teaching, 11(3), 231-249. doi: 10.1002/tea.3660110307
Shavelson, R. J., & Stanton, R. J. (1975). Construct validation: Methodology and application to three measures of cognitive structure. Journal of Educational Measurement, 12(2), 67-85. doi: 10.1111/j.1745-3984.1975.tb01010.x
Shellman, A., & Ewert, A. (2010). SEER 2009 abstract: A multi-method approach to understanding empowerment processes and outcomes of adventure education program experiences. Journal of Experiential Education, 32(3), 275-279.
Shirilla, P. (2009). SEER 2008 abstract: Adventure-based programming and social skill development in the lives of diverse youth: Perspectives from two research projects. Journal of Experiential Education, 31(3), 410-414.
Smith, E. F., Steel, G., & Gidlow, B. (2010). The temporary community: Student experiences of school-based outdoor education programmes. Journal of Experiential Education, 33(2, Special Issue), 136-150. doi: doi:10.5193/JEE33.2.136
Son, J. Y., & Goldstone, R. L. (2009). Contextualization in perspective. Cognition and Instruction, 27(1), 1-39. doi: 10.1080/07370000802584539
Spiro, R. J. (1988). Cognitive flexibility theory: Advanced knowledge acquisition in ill-structured domains (pp. 20): Center for the Study of Reading, University of Illinois at Urbana-Champaign.
Stake, R. E. (2010). Qualitative research: Studying how things work. New York: Guilford Press.
Strobel, J., & van Barneveld, A. (2009). When is PBL more effective? A meta-synthesis of meta-analyses comparing PBL to conventional classrooms. The Interdisciplinary Journal of Problem-Based Learning, 3(1), 44-58. doi: 10.7771/1541-5015.1046
318
Teddlie, C., & Tashakkori, A. (2009). Foundations of mixed methods research: Integrating quantitative and qualitative approaches in the social and behavioral sciences. Los Angeles: SAGE.
Tessmer, M., & Richey, R. C. (1997). The role of context in learning and instructional design. Educational Technology Research and Development, 45(2), 85-115. doi: doi:10.1007/BF02299526
Tulving, E. (1985). How many memory systems are there. American Psychologist, 40(4), 385-398. doi: 10.1037//0003-066X.40.4.385
Tulving, E., & Thomson, D. M. (1973). Encoding specificity and retrieval processes in episodic memory. Psychological Review, 80(5), 352-373. doi: doi:10.1037/h0020071
Uzzell, D. (1999). Education for environmental action in the community: New roles and relationships. Cambridge Journal of Education, 29(3), 397-413. doi: 10.1080/0305764990290309
Verfaellie, M., Croce, P., & Milberg, W. P. (1995). The role of episodic memory in semantic learning: An examination of vocabulary acquisition in a patient with amnesia due to encephalitis. Neurocase, 1(4), 291-304. doi: 10.1080/13554799508402374
Vermunt, J. D. (2005). Relations between student learning patterns and personal and contextual factors and academic performance. Higher Education, 49(3), 205-234. doi: 10.1007/sl0734-004-6664-2
Vygotsky, L. S. (1978). Mind in society. Cambridge, MA: Harvard University Press.
Wertsch, J. V. (2007). Mediation. In H. Daniels, M. Cole & J. V. Wertsch (Eds.), The Cambridge companion to Vygotsky (pp. 178-192). New York: Cambridge University Press.
Whitehead, A. N. (1929). The aims of education. New York: MacMillan.
Wolcott, H. E. (2009). Writing up qualitative research (3rd ed.). Los Angeles: SAGE.
Yin, R. K. (2009). Case study research: Design and methods (4th ed.). Thousand Oaks, CA: SAGE.
Zahorik, J. A. (1997). Encouraging and challenging students' understandings. Educational Leadership, 54(6), 30-32.
APPENDICES
APPENDIX A: Important Terms and Abbreviations
Concept Unit: The primary unit of analysis for this study. Defines a block of transcribed
interview in which a student describes a complete thread of the understanding of a
given science concept
DIAL: deep immersion academic learning, an approach to learning in which students are
immersed within an real-life, authentic context directly related to the subject
being learned, usually for an extended period of time.
ELT: Experiential Learning Theory
Facilitated: Used in this dissertation to describe learning opportunities in which the
teacher has a direct role in supporting the learning.
Keystone Event: an event that allows a student to complete a conceptual picture of a
concept and thereby develop a deeper understanding.
Peripheral: Used in this dissertation to describe learning opportunities in which the
teacher does not have a direct role in facilitation, in which the student discovers
relevant knowledge on their own.
PFnet: The graphical network output resulting from the Pathfinder algorithm and
representing an individual’s structural knowledge in a given domain.
TSC: targeted science concept, the concepts associated with the learning goals of each
class involved in the study. They are contrasted with science concepts that may
be important but were not specific learning goals of the course.
319
320
APPENDIX B: Original and Revised Conceptual Frameworks
Learner/environment network components
Facilitated social interactions
Peripheral social interactions
Facilitated physical environment
Peripheral physical environment
Figure B1. Learning environments provide a contextual surround that lead to elaborations and greater integration of learning targets with schemata. Deeper and more connected learning occur when the environmental components add contexts that are related to a learning target. .
Context
Vehicle
Learner
Learning Target
Learner elaborates the learning target with a unique set of environmental context cues
Facilitated non-‐academic tools
Peripheral non-‐academic tools
Facilitated emotional environment
Peripheral emotional environment
Facilitated academic tools
Peripheral academic tools
Facilitated cultural environment
Peripheral cultural environment
Fac. internal dialog & expression
Per. internal dialog & expression
Learning targets without contextual elaborations are less likely to interface with the learner’s schemata and less likely to be learned.
DIAL Framework: Contextualization of Learning Targets Through Environmental Interactions
321
Figure B2. In DIAL, target knowledge is inevitably bound to environmental and individual inputs that form a context vehicle to elaborate and associate the information. The learner stores representations that are modified through experience with the environment and thought processes. Learner access to context cues can be facilitated by a teacher or peripheral. Each learner contributes to and is influenced by the cultural and affective background through the learning process.
Learning Target
Context Vehicle
Learner
Social Interactions
Physical Environment
Peripheral
Facilitated
Context Cues
Cultural & Affective Background Environment
Memory
Indexing Reflecting Connecting Emoting
The Deep Immersion Academic Learning Process
322
APPENDIX C: Student Interview Protocol
Student # (teacher initials and #): Date: Class: C (pre/post/change): Part I Procedure: 1. Remind student about project, ability to opt out, non-assessment. 2. Show student the second concept map and ask if it seems like an accurate
representation. 3. Show student original map and point out major differences, one at a time (table below
to be filled out before interview) Differences in pair scores or clusters (list in order of decreasing significance)
Notes
i.e. ecosystem-keystone +4 i.e. ecosystem highly linked i.e. in first map ecosystem was only connected to
symbiosis (space expanded for actual use) 4. “Your relatedness score for concept X and Y changed quite a bit from the pre to
the post (adjust to fit) , does that seem accurate?” (space expanded for actual use) 5. Can you tell me about your present understanding of the concept(s)? (space expanded for actual use) 6. Why do you think that relationship/understanding changed for you? (space expanded for actual use) 7. Move on to next concept. Part Two: clarify answers from part one and/or key experiences listed by teacher (focus on: physical, emotional, cultural env; social interactions academic/non-academic tools, & facilitated vs. peripheral) Notes from part 1 to follow up with: (space expanded for actual use) Notes from Part two: (space expanded for actual use)
323
APPENDIX D: Coded Interview Sample
The following graphics are screen shots of a student interview coded for this study using
HyperRESEARCH qualitative analysis software. The graphics represent a series of
concept units (the inferential unit of analysis) and the associated descriptive and pattern
codes assigned. In practice all of these codes would not typically have been shown
together. Rather, the codes of interest at any given point in the analysis would have been
highlighted or compiled.
324
325
326
327
328
APPENDIX E: Consent and Assent Forms
Student Assent Form
Date: Valid for Use Through: Study Title: Investigating Learner Networks in Contextualized Science Learning Environments Principal Investigator: Michael Giamellaro, PhD Candidate Advisor: Dr. Deanna Sands HSRC No: 11-1708 Version Date: 3/28/12 Version No: Jeffco_3 – Student Assent
You are being asked to be in a research study. This form provides you with information about the study.
Why is this study being done?
The goal of this study is to better understand how high school students learn during experiential trips. About 90 students will participate in the study. Your class, led by teacher XXXXXX, has been asked to participate in the study because it is a good example of learning science during a long field trip.
What will I need to do/ what can I expect if I agree to join this study? If you agree to participate in Level One of this study, you will be asked to fill out a form. The form allows a computer to create a diagram of how you organize your ideas about the class topics. You will be asked to do this before and after the trip. Some students in the class will be randomly selected to be interviewed after the trip. Samples of your work from the class may be collected. If you agree to participate in Level Two of this study, a researcher will briefly interview you during the trip. The researcher will use video, audio, photo and written recordings of trip events. You can ask that we erase any report about your learning that you do not agree with. You can ask us to erase any recording you do not wish us to keep or use.
What are the possible discomforts or risks? There are no physical, mental, legal or emotional risks in this study.
What are the possible benefits of the study? Results of this study will help teachers and researchers understand how learning happens during field trips. You will receive copies of your before and after computer diagrams that you can use to see how your knowledge changed over the course of the trip.
329
Who is paying for this study? This study does not have any external funding.
Will I be paid for being in the study? Will I have to pay for anything? You will not be paid for participating in this study and it will not cost you anything to be in the study.
Is my participation voluntary? Taking part in this study is voluntary. You have the right to choose not to take part in this study. If you choose to take part, you have the right to stop at any time. Participating or not participating will not affect in any way your grades or your relationship with your teacher, school or school district.
Who do I call if I have questions? If you have questions, you may call Michael Giamellaro at 720-352-4796 or email him at [email protected]. Your teacher can also provide you with more information.
Who will see the research information? We will do everything we can to keep the records from this study a secret. The results from the research may be shared at meetings and in published articles. Your name will be kept private and a pseudonym will be used to identify your words or work.
Agreement to be in this study I have read this paper about the study or it was read to me. I understand the possible risks and benefits of this study. I know that participation in this study is voluntary.
I agree to participate in Level One of the Study (pre/post test & possible interview)_____ initial here
I agree to participate in Level Two of the Study (on-trip interviews and observations)______ initial here
I agree to be audio recorded during the study______ initial here
I agree to be video recorded during the study______ initial here
I agree to allowing my recorded voice or image to be used in presentations______ initial here
Student Signature: Date: ___
Print Name:
330
Parental Consent Form
Date: 1 /25/12 Valid for Use Through: 1/25/13 Study Title: Investigating Learner Networks in Contextualized Science Learning Environments
Principal Investigator: Michael Giamellaro, PhD candidate Advisor: Dr. Deanna Sands HSRC No: 11-1708 Version Date: Version No:
Your son or daughter is being asked to be part of a research study and information will be collected about your child as part of this study. This form provides you with information about the study.
Why is this study being done?
The goal of this study is to better understand how high school students use their learning environment to learn science during extended field trips. Five teachers from different schools and 90 students will participate in the study. Your daughter’s/son’s class, led by teacher XXXXXX, has been asked to participate in the study as it is a good example of this type of approach to learning science.
What happens if I consent to my son or daughter joining this study?
If you consent to allow your child to be included in this study, the following will occur: • Your daughter/son will be asked to complete a survey before and after the trip. Changes in their responses
between the before and after surveys will help show how much they have learned about the science in the class.
• Samples of your daughter’s/son’s class work may also be looked at. • Your son/daughter may be briefly interviewed during or after the trip and observations of them may be
audio or video recorded during the trip. • The class and the experience will not be different from normal, however some class events may be
recorded. These recordings will make it easier to describe how students are learning in their environment. Names of students will be ‘bleeped-out’ in any recordings and changed when a written report is made.
• Students will have an opportunity to ask that any recording or observation is erased and not used. • Any document for this study will be scanned into a computer, password-protected and the hard copies will
be destroyed.
What are the possible discomforts or risks? There are no physical, mental, legal, social or economical risks with this study. Professional standards of protecting confidentiality will be followed; pseudonyms (fake names) will be used; consent forms will be kept separately from the information we collect; information will be stored in a password-protected electronic file or stored in a locked file cabinet.
What are the possible benefits of the study?
Results of this study will be available to all educators to help them better understand how students’ learn science during extended field trips. This should help educators to improve how they teach and support student learning. The teacher of this class may be able to use the results to enhance his/her teaching of this class for the rest of the semester and in future years. Your daughter/son will be given a report showing the change in their knowledge from before to after the trip.
331
Who is paying for this study?
This study does not have any external funding.
Will I be paid for being in the study? Will I have to pay for anything?
Neither you nor your son/daughter will be paid to be in the study. It will not cost you anything to be in the study.
Is my participation voluntary?
Taking part in this study is voluntary. You have the right to choose not to let your daughter/son take part in this study. If you choose to take part, you have the right to stop at any time. Your son’s/daughter’s grades will not be changed based on your decision to be in the study.
Who do I call if I have questions?
The researcher carrying out this study is Michael Giamellaro. If you have questions, you may call Michael at 720-352-4796 or email him at [email protected]. You can also call the Human Subject Research Committee (HSRC) at the University of Colorado Denver at 303-315-2732.
Who will see the research information?
We will do everything we can to keep the records from this study a secret. It cannot be guaranteed. The consent form signed by you may be looked at by others. They are: • Federal agencies that monitor human subject research • Human Subject Research Committee at UCD • The group doing the study • Regulatory officials from the institution where the research is being conducted who want to make sure the
research is safe The results from the research may be shared at meetings and educator professional development opportunities. The results from the research may be in published articles. The name of your daughter/son will be kept private.
Agreement to allow my son/daughter to be in this study
I have read this paper about the study or it was read to me. I understand the possible risks and benefits of this study. I know that allowing my son/daughter to be filmed as part of this study is voluntary.
I agree that my daughter/son may be audio recorded during the study______ initial here
I agree that my daughter/son may be video recorded during the study______ initial here
I agree that the recorded voice or image of my daughter/son may be used in academic presentations. _____ initial here
Date: 1/25/12 Valid for Use Through: 1/25/13 Study Title: Investigating Learner Networks in Contextualized Science Learning Environments Principal Investigator: Michael Giamellaro, PhD Candidate Advisor: Dr. Deanna Sands HSRC No: 11-1708 Version Date: 1/12/12 Version No: 2 – Teacher Consent
You are being asked to be in a research study. This form provides you with information about the study.
Why is this study being done?
The goal of this study is to better understand how high school students use different aspects of their learning environment to support their development of science concepts during immersive, experiential trips. Five teachers and 90 students will participate in the study.
What happens if I consent to joining this study? If you consent to allow yourself to be included in Level One of this study, students in your class will be given a concept map assessment before and after the trip experience and some of your students will be interviewed following the trip. If you consent to allow yourself to be included in Level Two of this study, a researcher will accompany and observe your class during the trip. You will be interviewed briefly before and after the trip.
What are the possible discomforts or risks? There are no anticipated physical, psychological, legal or emotional risks in this study.
What are the possible benefits of the study? Results of this study will be made available to all educators to help them better understand how components of experiential learning environments can contribute to students’ concept development. This should allow educators to highlight key contributors or shift the focus to better achieve learning targets when appropriate. This study holds promise for improving experiential education practice and increasing student achievement. Your participation may also give you specific feedback into how elements of your class/program contributed to students’ conceptual development. You will be given the assessment results from your class within one month of test administration, which may be used in a formative manner. A full presentation of the results and implications of the study can be scheduled for your school/faculty
333
Who is paying for this study? This study does not have any external funding.
Will I be paid for being in the study? Will I have to pay for anything? You will not be paid for participating in this study and it will not cost you anything to be in the study.
Is my participation voluntary? Taking part in this study is voluntary. You have the right to choose not to take part in this study. If you choose to take part, you have the right to stop at any time. Participating or not participating will no affect in any way your relationship with your school or with the school district.
Who do I call if I have questions? The researcher carrying out this study is Michael Giamellaro. If you have questions, you may call Michael at 720-352-4796 or email him at [email protected]. You can also call the Human Subject Research Committee (HSRC) at the University of Colorado Denver at 303-315-2732.
Who will see the research information? We will do everything we can to keep the records from this study a secret. It cannot be guaranteed. The consent form signed by you may be looked at by others. They are:
• Federal agencies that monitor human subject research • Human Subject Research Committee at UCD • The group doing the study • Regulatory officials from the institution where the research is being conducted
who want to make sure the research is safe The results from the research may be shared at meetings and educator professional development opportunities. The results from the research may be in published articles. Your name and the names of your students will be kept private.
Agreement to be in this study I have read this paper about the study or it was read to me. I understand the possible risks and benefits of this study. I know that participation in this study is voluntary. I agree to participate in Level One of the Study (pre/post assessment & student interviews)_____ initial here
I agree to participate in Level Two of the Study (class observed by a researcher)_N/A____ initial here Teacher Signature: Date: ___