Top Banner
THE EFFECTS OF SUPERVISORY SUPPORT, AGE AND GENDER ON SELF EFFICACY AND METACOGNITIVE ACTIVITY IN A LEARNER CONTROLLED TRAINING ENVIRONMENT A Dissertation Presented to the Faculty of the College of Business Administration Touro University International In Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Business Administration By James V. Polizzi October 2008
114

Final 2008

Jul 25, 2015

Download

Documents

Jim Polizzi
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Final 2008

THE EFFECTS OF SUPERVISORY SUPPORT, AGE AND GENDER ON SELF

EFFICACY AND METACOGNITIVE ACTIVITY IN A LEARNER

CONTROLLED TRAINING ENVIRONMENT

A Dissertation

Presented to the Faculty of the College of Business Administration

Touro University International

In Partial Fulfillment of the Requirements for the Degree of

Doctor of Philosophy in Business Administration

By

James V. Polizzi

October 2008

Page 2: Final 2008

ii

Copyright by James V. Polizzi

2008

All rights reserved

Page 3: Final 2008
Page 4: Final 2008

ii

BIOGRAPHICAL SKETCH

James Polizzi earned a Bachelors of Business Administration (Marketing) from The City College of New York in 1966. He received a Masters of Business Administration (Management) from Wagner College in 1996. He received a Doctor of Philosophy, Business Administration from Touro University International in 2008. He is currently an instructor in the Management Department at Berkeley College, New York City and Online Campuses and President of The Aegis Group – a strategic consultancy.

Page 5: Final 2008

iii

DEDICATION

I dedicate this dissertation to my wife, Josephine. Her continuous support, understanding

and encouragement gave me the will to finally complete this endeavor.

Page 6: Final 2008

iv

ACKNOWLEDGEMENTS

I would like to thank SimuLearn, Inc for their permission to use the Virtual Leader

leadership training software in the conduct of this study. Particular thanks to Mr. Pierre

Thiault for his advice and continuous support for this project.

Page 7: Final 2008

v

Table of Contents

Page

List of Figures ................................................................................................................... vii

List of Tables ................................................................................................................. .viiii

Abstract………………………………………………………………………………...…ix CHAPTER I: INTRODUCTION........................................................................................ 1

Problem Background .............................................................................................. 1

Identification of the Issues ...................................................................................... 7

CHAPTER II: LITERATURE REVIEW ........................................................................... 9

Learning Theory...................................................................................................... 9

Metacognition and Training.................................................................................. 13

Learner Controlled Training and Metacognitive Interventions ............................ 18

Motivation and Self Efficacy................................................................................ 23

Age, Gender and Computer Self Efficacy ............................................................ 26

Supervisory Support.............................................................................................. 28

CHAPTER III: METHODOLOGY .................................................................................. 35

Research Design.................................................................................................... 36

Operationalization of Variables ............................................................................ 37

Sample................................................................................................................... 39

Procedure .............................................................................................................. 39

Research Questions............................................................................................... 40

Data Analysis Plan................................................................................................ 42

CHAPTER IV: ANALYSIS OF DATA........................................................................... 47

Preliminary Analyses ............................................................................................ 48

Page 8: Final 2008

vi

Research Questions............................................................................................... 54

Research Question 1 ................................................................................. 55

Research Question 2 ................................................................................. 56

Research Question 3 ................................................................................. 56

Research Question 4 ................................................................................. 60

Research Question 5 ................................................................................. 63

CHAPTER V: DISCUSSION AND IMPLICATIONS.................................................... 65

Summary of Findings............................................................................................ 65

Implications........................................................................................................... 68

Metacognitive Activity for Children Versus Adults................................. 68

Gender, Age, and Computer Self-Efficacy............................................... 69

Supervisory Support and Self-Efficacy .................................................... 70

Metacognitive Activity and Self-Efficacy ................................................ 71

Recommendations for Future Research ................................................................ 72

Recommendations for Practice ............................................................................. 75

Conclusions........................................................................................................... 77

References......................................................................................................................... 79

Appendix A: Demographic Survey................................................................................... 88

Appendix B: Learner Control Self Efficacy Scale............................................................ 89

Appendix C: Computer Self-Efficacy Scale ..................................................................... 91

Appendix D: Supervisory Support Scale .......................................................................... 95

Appendix E: Metacognitive Activity Scale ...................................................................... 96

Appendix F: Full Regression Results for Path Models..................................................... 98

Page 9: Final 2008

vii

List of Figures

Page Figure 1. Path Model for Research Questions 1-4 ............................................................46 Figure 2. Path Model for Research Question 5 .................................................................46 Figure 3. Path Model for Research Questions 1 and 2 with Regression Coefficients.......55 Figure 4. Path Model for Research Question 3 with Regression Coefficients for Males..................................................................................................................................57 Figure 5. Path Model for Research Question 3 with Regression Coefficients for Females ..............................................................................................................................57 Figure 6. Path Model for Research Question 4 with Regression Coefficients for Younger Participants..........................................................................................................60 Figure 7. Path Model for Research Question 4 with Regression Coefficients for Older Participants.........................................................................................................................61 Figure 8. Path Model for Research Question 5 with Regression Coefficients..................63

Page 10: Final 2008

viii

List of Tables

Page

Table 1. Descriptive Statistics for Sample Demographic Characteristic (N=120)...........49 Table 2. Descriptive Statistics for the Composite Measures (N=120) ..............................50 Table 3. Correlations Between Composite Measures (N=120) ........................................51 Table 4. Correlations Between Composite Measures as a Function of Gender (N=120) ............................................................................................................................52 Table 5. Correlations Between Composite Measures as a Function of Age Group (N=120) .............................................................................................................................53

Page 11: Final 2008

ix

ABSTRACT

THE EFFECTS OF SUPERVISORY SUPPORT, AGE AND GENDER ON SELF

EFFICACY AND METACOGNITIVE ACTIVITY IN A LEARNER CONTROLLED

TRAINING ENVIRONMENT

James V. Polizzi, Ph.D.

Touro University International 2008

The increase in costs and frequency of training have driven U.S. businesses to a

greater use of learner controlled training, i.e. training delivered in the absence of a live

instructor. Success in learning complex material has been positively related to

metacognitive activity, yet learner controlled training may present unique challenges to

the formation of learning strategies. This study investigated the relationships between

employee self efficacy, computer self efficacy, supervisory support, gender and age and

their effect on metacognitive activity. The research was conducted during

organizationally sponsored, learner controlled training among adults. The study results

suggest a positive role for supervisory support on self-efficacy and metacognitive

activity. Metacognitive activity increased with higher levels of learner control self

efficacy which, in turn, was associated with higher levels of computer self efficacy.

Page 12: Final 2008

1

CHAPTER I: INTRODUCTION

Problem Background

As organizational efforts to improve productivity increase, employee training has

become an even more critical element of firm activities. Importantly, in addition to

productivity, the very nature of the business organization is shifting. As projected by the

RAND Corporation (2004), the required skills for a productive workforce in the 21st

century will include: problem solving skills, communication and collaborative ability.

The emergence of a knowledge-based workforce demands that education and training

become a continuous process throughout the life course, involving training and retraining

that continue well past initial entry into the labor market. Technology-mediated learning

is a promising tool for life-long learning, both on the job and through traditional public

and private education and training institutions. (RAND, 2004)

The American Society for Training and Development (ASTD; 2008) estimates

2006 learning and development spending for U.S. firms at $129.6 billion. Expenditures

per employee have risen to $1,040 in 2006, approximately 2% above 2004. Together,

managerial and executive development training totaled more learning content in 2004

than technology, business processes and industry-specific content (ASTD, 2004). A key

indicator of the trends in business organizations is the increasing use of terms such as

“workforce development” and “organizational effectiveness” as part of the titles of in-

house trainers and the establishment of a “Chief Learning Officer” (Rodriquez, 2005).

Human Resources Focus (“Despite Economy,” 2004) noted some significant

trends in training budgets and the nature of training methodologies: U.S. companies spent

more money on training, provided more hours of training and increased use of technology

Page 13: Final 2008

2

for training in 2002 versus 2001. Training delivered via learning technologies increased

to 15.4% in 2002, from 10.5% in 2001; while training delivered via a traditional

classroom technique declined to 72%, versus 77% in 2001. More recently, 2004 saw 50%

of technology based delivery in an online format, with 75% of online learning classified

as “self-paced” (ASTD, 2004).

According to ASTD (2004), organizations with high levels of investment in

training aligned learning with business needs and achieved efficiency and effectiveness in

the learning function. Collins and Clark (2003) found that human resource practices (i.e.

training) were found to be positively correlated with creating organizational competitive

advantages. The increase in use of technology to deliver training, coupled with the

concurrent decline in traditional instructor-led training has been facilitated by the

widespread use of desktop computers and near universal access to the World Wide Web

in U.S. firms. Additionally, the rising costs of training have stimulated a move to more

efficient methods of delivering training in organizations.

Training without a live instructor encompasses many methods of instruction,

either as single or mixed method approaches, including Web based training, Intranet

training programs, and CD-ROM. Collectively called learner controlled training

(Schmidt, 2003), the benefits of self-pacing, flexible access and lower costs are driving

more firms to increase use of this design in training programs. The increased availability

of interactive training designs gives individuals increased control over the pace, sequence

and time spent on training (Tannenbaum, 1992).

Research on learner controlled training has shown generally positive, but mixed

results. Learners who are allowed to choose the sequence of learning, content, and time in

Page 14: Final 2008

3

study have reported positive attitudes towards training and improved outcomes (e.g.,

Brown, 2001; Kinzie & Sullivan, 1989; Milheim & Martin, 1991; Morrison, Ross, &

Baldwin, 1992). Despite these observed advantages, increased learner control has not

shown consistent improvements in post training performance. Brown (2001) found that

learner control is associated with a number of negative processes, including lower time

on task and inadequate learning strategies. Eom and Reiser (2000) found a poorer posttest

result for learner control subjects than for program control subjects. Pollock and Sullivan

(1990) found that students with no control over practice had higher posttest scores than

students given control over the amount of practice. Gist, Schwoerer and Rosen (1989)

found that a modeling approach resulted in higher performance levels than computer-

assisted instruction among managerial trainees. Hannafin and Sullivan (1996) found that

learner ability affected the amount of control students applied in a learner controlled

program.

In a review of interactive learning environments (Aleven, Stahl, Schworm,

Fischer & Wallace, 2003), the authors identify the need for further investigation of the

effects of the context in which learning occurs. Specifically, they identify the physical,

social and institutional environment as factors potentially affecting the learning process.

Thus, an important area for research is to identify the variables that might influence

learners in learner controlled training. One result of these findings has been an increased

focus on the learner as an active participant in the learning process. A significant

conclusion is that not all learners are capable of successfully directing their learning; they

fail to take advantage of the control they are given.

Page 15: Final 2008

4

A review of the literature suggests that learner controlled training can be

improved by incorporating learning theory to increase the understanding of how people

learn. Many employees, especially older workers, approach these nontraditional training

environments with some trepidation and are easily frustrated with the inability to directly

question a live instructor. Thus, training design can be improved by understanding the

attitudes and capabilities of workers to utilize the technology. Most empirical studies of

learner control have been conducted among students in academic environments.

Developing a greater understanding of adult learners in an organizational setting can

improve the effectiveness of training.

A significant criticism of learner controlled training has been the lack of teaching

of higher order cognitive skills. Live instruction has traditionally been viewed as the best

method for communicating these skills. A growing number of training designs utilize in-

training interventions to guide the learner in the cognitive processes need to master the

training material. These can be broadly classified as metacognitive interventions;

explained as guiding the learner to think about their thinking process. Metacognitive

interventions have been associated with positive outcomes in learner controlled training

environments and holds promise for improving organizational training designs (Schmidt,

2003). Antecedents of metacognitive activity have been identified as learner mastery and

performance orientations, where performance orientations include the learner’s

motivation and perception of self efficacy (Schmidt).

Training outcomes can also be influenced by the potential effects of an

employee’s perception of their ability to learn without a live instructor. This general

construct of perception of ability is identified as self efficacy (Bandura, 1986). Self

Page 16: Final 2008

5

efficacy refers to an individual’s belief in his/her ability to accomplish a given task

(Bandura). Self efficacy relates to effort expended on a task, and persistence in achieving

a positive task result (Gist & Mitchell, 1992). In a training environment, self efficacy

beliefs are likely to contribute positively to successful outcomes. Research has

consistently demonstrated a positive relationship between self efficacy, positive

motivation and learning (e.g. Gist, Stevens & Bavetta, 1991; Martocchio, 1994; Mathieu,

Tannenbaum & Salas, 1992). However, the literature reveals very few studies of the

relationships between self efficacy and metacognitive interventions in business

organizations (e.g., Schmidt, 2003). The first question raised here, then, is whether an

adult learner’s self efficacy perception affects metacognitive activity in a learner

controlled training environment in the context of a business organization.

While Bandura (1986) posited an individual’s behavior as a result of external

approval or disapproval, the landmark Ohio State Leadership research (Halpin & Winer,

1957) studied the link between supervisory behavior and subordinate attitudes and

performance. The external influences the employee observes – namely, the attitude of

their supervisor for this alternative training design can affect perceptions of self efficacy

(e.g., Bandura, 1986; Illeris, 2003; Martocchio, 1992).

To summarize, two variables may affect the level of metacognitive activity in a

learner controlled training environment: the learner’s perception of self-efficacy in the

absence of a live instructor, and the degree to which the individual’s supervisor exhibits

support/trust for the learner in learner controlled training. The nature of the delivery of

learner controlled training in the contemporary organization (e.g., via desktop

computers), raises the possibility that two further variables may affect learning: age and

Page 17: Final 2008

6

gender. Given recent trends, we can presume continued and increasing use of computers

to deliver training, thus examination of these variables may prove useful.

It is a general perception among those in business and in the general population

that older workers are less comfortable and less proficient than younger workers in the

skillful use of desktop computers. Specifically, older users were found to have low

confidence in their ability to use computer technology (Comber, Hargreaves & Dorn,

1997). We can speculate that older workers will exhibit lower self efficacy in training

delivered by computer than training delivered with traditional instructor-led training.

While gender has generally been shown to have mixed effects on computer

competency (e.g., Ford, Miller & Moss, 2001; Henry & Stone, 1999); the differences in

masculine sex role traits (e.g., independence, assertiveness and competitiveness) and

feminine sex role traits (e.g., dependence and interpersonal relationships) may have an

effect in a learner controlled training environment where the absence of a live instructor

prevents interaction. Gilley (2002) reports that females do not perceive themselves as

manipulators of computer technology; but merely as end users of pre-designed programs.

The American Association of University Women (AAUW; 2000) studies found that

females have been encouraged to participate in computer technology through the use of

productivity software such as graphics programs, databases, page layouts, and so forth,

whereas males are more adventurous in their learning with respect to computer

technology. Gender differences in computer self efficacy is revealed in Brosnan’s (1998)

study which found that 64% of females agreed that computing was a “male activity” and

that “men were better at computing than women” (1998, p. 63). Gender, therefore, may

Page 18: Final 2008

7

have an effect on a learner’s perception of self efficacy in training delivered in the

absence of a live instructor.

Identification of the Issues

The increasing complexity of job requirements has fostered a continuing increase

in training activities and related costs for U.S. firms. Training designs have evolved to

meet these challenges by increasing use of training without a live instructor and are

increasingly utilizing in-learning interventions to improve acquisition of thinking skills

(metacognitive activity). There is empirical evidence that increased metacognitive

activity improves the effectiveness of learner controlled training, yet not all learners show

consistently positive results. What, then, are the key variables affecting metacognitive

activity? Self efficacy perceptions and supervisory support have been shown to affect

learning outcomes; with self efficacy viewed as both an independent variable affecting

learning outcomes and a dependent variable affected by supervisory support. With the

trend to even greater use of learner controlled training, age and gender are two

moderating variables important to evaluate when researching self efficacy in this

environment.

The research questions guiding this study are:

1. Is supervisory support related to learner control self efficacy and computer

self-efficacy in a learner controlled training environment?

2. Are computer self-efficacy or learner control self-efficacy related to

metacognitive activity in a learner controlled training environment?

Page 19: Final 2008

8

3. Do the relationships between supervisory support, learner control self-

efficacy, and metacognitive activity vary as a function of the gender of the

learner?

4. Do the relationships between supervisory support, learner control self-

efficacy, and metacognitive activity vary as a function of the age of the

learner?

5. Does computer self-efficacy have an effect on learner control self-efficacy

which subsequently has an effect on metacognitive activity?

In order to address these questions, a quantitative study to test the effects of supervisory

support, age and gender on an adult learner’s perception of self-efficacy and

metacognitive activity when metacognitive interventions are utilized in a learner

controlled training environment was performed. The results of this study provide insights

potentially valuable in improving the effectiveness of learner controlled training.

Page 20: Final 2008

9

CHAPTER II: LITERATURE REVIEW

This section will review and apply the significant theories and empirical research

encompassing learning theory, metacognitive processes, an individual’s perception of

self-efficacy, the effects of supervisory influences, and experience with metacognitive

interventions as a training strategy. This review will also establish the relationship of

metacognitive activity to potential successful training outcomes and metacognitive

interventions as a factor which improves individual metacognitive activities. Individual

self-efficacy will be shown to be influenced by supervisory support for the specific

training activity. The present study examined the interaction of the internal effects of

metacognition and self-efficacy, as well as the external influence of supervisory support

on self efficacy in a learner controlled training environment.

Learning Theory

Skinner (1968, 1969) proposed that learning is a result of patterns of behavior

developed as a response to a stimulus. Skinner built on Watson’s work from the

beginning of the twentieth century using an empirical approach with animals, termed

stimulus-response behaviorism (DeMar, 2004). Ultimately termed classical behaviorism,

the theory viewed learning as changing the behaviors of individuals, sometimes through

trial and error experiences until a positive reinforcement was obtained (Semple, 2000).

Skinner’s experiments led him to modify Watson’s original view of behavior by adding

the concept of intermediary purposefulness to the stimulus – response formula (DeMar).

This concept is now described as operant conditioning, i.e. people behave in a particular

way because of the past consequences of that behavior, and thus one acts in expectation

of a certain outcome (DeMar). Skinner’s research with rats showed that punishment

Page 21: Final 2008

10

halted a previously rewarded behavior almost immediately; but previously rewarded

behavior continued for some time when only the reward was withheld (Naik, 2004).

Behaviorists embrace four main steps regarding learning: first, each step should

be brief and follow from previously learned behavior; second, behavior is shaped by the

pattern of reinforcements, so learning should be regularly rewarded; third, provide

immediate feedback; fourth, the learner should be given direction to the most successful

path (Semple, 2000). Behaviorist theories of learning led to the introduction of

“programmed learning” (also programmed instruction) by machines in the 1950’s and

1960’s (Semple). In a learning environment, behaviorism relies on an instructor centered

approach where the learner is largely passive and controlled by the instructor’s processes

(Constructivist Learning Theory, n.d.).

Constructivist Learning Theory (n.d.) views learning differently from the

behaviorist stimulus-response phenomena. Constructivism posits the concepts of self-

regulation and acquisition of conceptual cognitive structure through reflection and

abstract thought (Constructivist Learning Theory, n.d.). Two major themes of

constructivism relate to how people learn: order and self (Mahoney, n.d.). Mahoney

explains that order reflects a person’s activities devoted to establishing a pattern to prior

experiences using emotional “meaning-making” processes (p.3). Constructivists further

posit that the organization of activity is fundamentally self-referent and self-repeating;

people continually experience and monitor their sense of personal identity (Mahoney).

Flavell (1977) posits that a person’s knowledge affects and is affected by how one

perceives things; and how one classifies and conceptualizes influences the way a person

reasons about those things. Cognition can be described as a system of “interacting

Page 22: Final 2008

11

processes which generate, code, transform and otherwise manipulate information”

(Flavell, p. 14). Viewed more narrowly, cognition addresses physical and mathematical

objects while social cognition concerns human affairs and social interactions (Flavell).

Social cognition explains that courses of action are chosen as a result of a person’s

perceived capabilities and sustained partly on the basis of expected outcomes (Bandura,

1986).

In expanding the constructivist learning theory, Bandura (1986) explains that, in

the social cognitive view, humans are not driven solely by inner forces or by external

stimuli. Rather, the interaction of behavior, cognitive and personal factors, and

environmental events describe a model of reciprocity of these elements that seeks to

explain human functioning (Bandura). Each of these factors can be of different strengths

and can occur at different times. The influence of any factor can take time to develop and

to trigger a reciprocal influence.

Bandura (1986) describes the nature of social cognition, and its differences from

Behaviorism, in terms of “capabilities” (p. 18-21). Symbolizing capability refers to the

human capacity to transform experiences into internal models that serve as guides for

future action (Bandura). This suggests that experience mediates the classical stimulus-

response view. Forethought capability is explained (Bandura) as the use of a visualized

future which is affected by goals and potential courses of action; suggesting that

stimulus-response is also mediated by anticipated future outcomes – not necessarily an

immediate outcome. Bandura also posits an external influence on learning: vicarious

capability, i.e. the ability to learn through observation of actions of others and

consequences of those actions. Self-regulatory capabilities are, perhaps, central to social

Page 23: Final 2008

12

cognitive theory (Bandura). Behavior is motivated and regulated by a person’s internal

goals and standards as well as their assessment of their performance towards those goals

(Bandura). Thus, self-produced influences mediate the stimulus-response model. Bandura

describes the distinctively human characteristic of self-reflective capability:

This (self-reflective capability) enables people to analyze their experiences and to think about their own thought processes. By reflecting on their varied experiences and on what they know, they can derive generic knowledge about themselves and the world around them. People not only gain understanding though reflection, they evaluate and alter their own thinking. In verifying thought through self-reflective means, they monitor their ideas, act on them or predict occurrences from them, judge the adequacy of their thoughts from the results, and change them accordingly. (p.21)

With regard to the nature of cognitive and personal factors, Wood and Bandura (1989a)

discuss the role of cognitive, vicarious, self-regulatory and self-reflective processes as

central to people’s behavior in organizations. Wood and Bandura explain that people

develop competencies through behavior modeling, cultivation of beliefs in their

capabilities, and enhancement of motivation through goals.

Gagne´ and Briggs (1974) describe the act of learning as composed of three

internal states: information, intellectual skills and strategies. Information can be stored in

memory for retrieval as required or accessed directly as in printed directions. Intellectual

skills are described as the ability to learn new things based upon cues that must be

previously learned and recalled. A learning situation often requires the use of strategies

for learning and remembering. These strategies are very general and apply to a wide

range of learning situations. Referred to as “self-management” (Gagne´ & Briggs, 1974

p. 9), the concept embodies a learner’s individual process for solving problems and

recalling previously learned methods of cognitive paths.

Page 24: Final 2008

13

Variations in adult learning – both inter personal and intra-personal – have been

attributed to differences in prior knowledge, cognitive processes, and learning and

memory strategies (Weinert & Kluwe, 1987). The identification and explanation of the

role of learning strategies in organizational training are examined in detail in the

following section - Metacognition and training.

Metacognition and Training

In general, Metacognitive theory focuses on first, the awareness and management

of one’s thinking; second, differences in self-efficacy perceptions; third, knowledge and

knowledge and development of thinking strategies from one’s experiences and fourth,

strategic thinking (Paris & Winograd, 1990). Cognitive strategy is an internal skill in

which the learner consciously or unconsciously selects a mode of thinking about and

solving a problem. The object of the skill is to manage thinking behavior (Gagne´ &

Briggs, 1974). The quality of one’s cognitive strategies affects the degree of creativity,

fluency and criticality of the learning process (Bruner, Goodnow & Austin, 1956, Gagne´

& Briggs).

Flavell is most often cited as the developer of original propositions about what are

called metacognitive processes. Flavell (1976) attempted to explain why children could

not solve problems although they were given correct solution procedures. He believed

that this was “the central problem in learning and development, namely, how and under

what conditions the individual assembles, coordinates or integrates his already existing

knowledge and skills into new functional organizations” (p. 231). In examining the

inability of children to solve problems consistently, Flavell posed two questions: “what

problem-adaptive things might they be failing to do, or what problem mal-adaptive things

Page 25: Final 2008

14

might they be doing instead?” (p. 232). From these questions, he developed the construct

of metacognition. Flavell described the construct as follows:

Metacognition refers to one’s knowledge concerning one’s own cognitive processes and products or anything related to them, e.g., the learning-relevant properties of information or data . . . Metacognition refers, among other things, to the active monitoring and consequent regulation and orchestration of these processes in relation to the cognitive objects or data on which they bear, usually in the service of some concrete goal or objective. (p.232) Flavell (1979) explained metacognitive experiences as “any conscious cognitive

or affective experiences that accompany and pertain to any intellectual enterprise” (p.

906). These experiences are conscious and are generally accompanied by emotions such

as anxiety, feeling of knowing, or judgments of learning. Flavell (1987) explained

metacognitive experiences with the following:

If one suddenly has the anxious feeling that one is not understanding something and wants and needs to understand it, that feeling would be a metacognitive experience. One is having a metacognitive experience whenever one has the feeling that something is hard to perceive, comprehend, remember or solve; if there is a feeling that one is far from the cognitive goal; if the feeling exists that one is, in fact, just about to reach the cognitive goal; or if one has the sense that the material is getting easier or more difficult that it was a moment ago. (p. 24)

Metacognitive experiences aid in the assessment of metacognitive goals, modification of

metacognitive knowledge and in the utilization of strategies (Flavell, 1979).

Flavell (1979) developed a model of metacognition and cognitive monitoring that

contained four classes of cognitive phenomena: metacognitive knowledge, metacognitive

experiences, tasks and actions (strategies). Flavell described metacognitive knowledge as

“that segment of your stored world knowledge that has to do with people as cognitive

creatures and with their diverse tasks, goals, actions, and experiences” (p. 906).

Metacognitive knowledge consisted of three factors: (a) person, (b) task and (c) strategy.

Page 26: Final 2008

15

The person factor of metacognitive knowledge concerns knowledge and beliefs

about one’s self and others as cognitive processors. Flavell (1987) identified three

subcategories of the person factor: intraindividual, interindividual and universal.

Intraindividual knowledge relates to the variation in interests, propensities and aptitudes.

Interindividual knowledge concerns comparisons between persons. Universal knowledge

is concerned with “intuitions about the way the human mind works – knowledge of such

universal mental phenomena” (Flavell, p. 22).

The task factor of metacognitive knowledge relates to the availability of

information and the use of that information in the context of task demands or goals.

According to Flavell (1987), the task factor concerns how information “affects and

constrains how one should deal with it” (p. 22). Flavell explains that if information is

very difficult, one proceeds slowly and carefully to insure deep and comprehensive

understanding. The strategy variable concerns “what strategies (means, processes, and

actions) are likely to be effective in achieving what subgoals and goals in what sorts of

cognitive undertakings” (Flavell, 1979, p. 907). In 1982, Kluwe expanded the concept by

identifying two common attributes of metacognitive activities: the subject has some

knowledge of his own thinking and the subject may monitor and regulate the course of

his own thinking.

Metacognition has been defined in various ways by different researchers;

however, the various approaches contain the following concepts: knowledge of one’s

knowledge, thought processes, and cognitive and affective states; the ability to

consciously and deliberately monitor and regulate one’s knowledge, processes, and

cognitive and affective states (Hacker, 2003, p. 6). Metacognition can also be explained

Page 27: Final 2008

16

as the ability to control one’s cognitive processes, viewed as self-regulation (Livingston,

1997) or self-management (Gagne´ & Briggs, 1974).

Metacognitive skill has been found to distinguish successful learners from

unsuccessful learners (Tannenbaum & Yuki, 1992). Metacognitive interventions (in-

learning training strategies) have been found to increase the amount and accuracy of

learner’s knowledge and to improve strategies for allocating time and effort (Schmidt &

Ford, 2003). In one study among students (Relan, 1995) subjects receiving learning

strategy training in a computer based instruction environment performed better in posttest

results than those who received no strategy training.

The increased availability of interactive training designs gives individuals

increased control over the pace, sequence and time spent on training (Tannenbaum &

Yuki, 1992). Brown (2001) concludes that learner choices regarding study time and

practice positively affected knowledge acquisition in a computer based training program.

Learners with increased control can consciously tailor training, leading them to learn the

task more effectively (Ford, Smith, Weissbein, Gully & Salas, 1998). However, Brown

also found that learner control is associated with a number of negative processes,

including lower time on task and inadequate learning strategies.

Gagne´ and Briggs (1974) proposed that cognitive strategies can be learned by

organizing external interventions that foster the development of internal processes. They

posit a design whereby “favorable conditions” (1974, p. 72) must be designed and present

for instruction in cognitive strategy development. Those conditions suggest that in order

to learn to think, a learner must be guided into opportunities to think.

Page 28: Final 2008

17

Glaser and Pellegrino (1987) suggest that the improvement of the skills of

learning will take place through the development of procedural (problem-solving)

knowledge. While their research attempted to identify cognitive components of

performance on tasks used to assess aptitude, their ultimate goal was to use the

knowledge gained to design instruction to directly or indirectly teach the processes that

facilitate learning. This research is one of the early investigations into what is now known

as metacognitive intervention in training design. The authors analyzed the processes used

by high and low performing individuals and concluded that the problem solving strategies

employed differed for each group. An oral problem solving technique was employed to

identify the processes used by each group in a standardized analogy test. The findings

suggest that high-ability individuals limit their approach to a few plausible mathematical

relationships; whereas, the low-ability individuals do not solve analogies with a

systematic approach. The implications which can be drawn involve the possibility of

influencing mental processing skills by teaching individuals to employ better methods of

searching memory and seeking connections.

Livingston (1997) posits that learners with greater metacognitive abilities tend to

be more successful in their cognitive activities and that individuals can learn how to

improve cognitive activities. Metacognition can enable learners to gain greater benefit

from instruction and influences the use and maintenance of cognitive strategies

(Livingston). Cognitive Strategy Instruction is a technique that emphasizes the

development of thinking skills and processes as a means to enhance learning

(Livingston).

Page 29: Final 2008

18

Schmidt and Ford (2003) studied the effect of trainee characteristics on

metacognitive activity in a learner controlled training environment and found that

metacognitive activity was mediated by the level of the trainee’s goal avoidance

orientation. The implication of this finding for the present study is that the outcomes of

metacognitive interventions are not consistently positive among all learners, but that

individual differences may account for variations in metacognitive activity. These

individual differences may include trainee motivation and perceptions of self-efficacy.

Flavell (1979) explains that metacognitive processes can lead a learner to select, evaluate

and revise cognitive strategies with regard to a learner’s ability and interest in what is

being learned.

Relevant to this current study, metacognition had been linked to self-efficacy

perceptions early in Flavell’s (1987) thinking about the construct. Flavell referred to

metacognition as having a psychological space. He hypothesized the interactions that

may link metacognition and other constructs. The constructs included “executive

processes; formal operations; consciousness; social cognition; self-efficacy; self-

regulation; reflective self-awareness and the concept of psychological self or

psychological subject” (Flavell, p. 25).

Much of the empirical research on interventions has been conducted among

children and/or in academic settings, suggesting the opportunity for a more generalizable

study among adult learners in an organizational training environment.

Learner Controlled Training and Metacognitive Interventions

Learner controlled training has increased in usage as a result of widespread

availability of workplace and personal computers (Schroeder, 1994). Learner control

Page 30: Final 2008

19

refers to the degree to which learners are able to choose the method, timing, practice and

feedback during training (Milheim & Martin, 1991). A major advantage of learner

controlled training over traditional forms of training is its potential to allow trainees to

proceed through training at their own rate, controlled by their own needs and preferences

(Eom & Reiser, 2000).

However, empirical research as shown mixed results for learner controlled

training (Eom & Reiser, 2000). This section will briefly present the underlying theory

and research for learner controlled training, leading to the assessment that metacognitive

interventions may have the potential to improve outcomes in learner controlled training

environments.

Hilgard and Bower (1966) explain that the beginnings of learner controlled

training, then referred to as “programmed learning”, emerged from a behaviorist

perspective. Programmed instruction is characterized by having information broken down

into smaller, simpler groups of information. While considered a more effective teaching

method than historical methods, several weaknesses emerge: behavioral models of

programmed instruction isolate factual information thus, learners learn in isolation, not in

the context of the interrelationships of the material (Hilgard & Bower). The programmed

instruction technique evolved into many tools, the most common today called Computer-

Assisted Instruction (CAI), a technique which can be designed to incorporate both the

original behaviorist view of learning (e.g., Skinner, 1968, 1969) and the more widely

accepted cognitive view (e.g., Bandura, 1986). Learner controlled training does not

presume the use of the computer as the training delivery method, but the computer’s near

Page 31: Final 2008

20

total availability in organizations today has made its use more widespread than traditional

paper, audio and video techniques.

Eom and Reiser (2000) posit that the conflicting or mixed results of learner

control are possibly due to the characteristics of the learner population. Kinzie (1990)

found that the degree of experience and comfort with learner control instruction

influences the effectiveness of the instruction. Kinzie, Sullivan and Berdel (1988) found

that pre-test reading levels were a more significant predictor of performance than the

level of learner control and called for an examination of self regulatory skills in learner

controlled environments.

Bandura (1986) describes the widely accepted view that social learning practices

are improved by structuring the learning environment in such a way as to allow learners

to judge themselves in reference to their own capabilities and standards, rather than in

comparison with others.

Self regulatory skills are a learner characteristic that may affect a learner’s ability

to benefit from learner controlled instruction (Armstrong, 1989; Eom & Reiser, 2000).

Self regulated learning strategies have been defined as metacognitive, motivational, and

behavioral techniques that a learner can use to control his or her learning process

(Zimmerman & Martinez-Pons, 1988). Eom and Reiser (2000) explain that intrinsic

motivation and self efficacy have an impact on self regulated learning. Boekaerts (1995)

indicated that self regulated learning strategies involve affective variables (e.g., anxiety)

as well as cognitive variables. Bandura (1986) viewed self regulation as composed of

multiple processes such as self observation, self judgment and self reaction. Motivational

factors such as attribution and self efficacy influence self regulated learning strategies;

Page 32: Final 2008

21

thus self regulated learners can be considered self motivated and are self directed in a

metacognitive sense as well (Eom & Reiser, 2000). Jegede, Taplin, Fan, Chan and Yum

(1999) found a higher level of use of metacognitive strategies among students describing

themselves as high achievers in a learner controlled environment.

Computer based training designs allow users to exert significant control over

sequence of learning, content and pace of instruction (Bell & Kozlowski, 2002). In a

review of the literature examining effectiveness of learner control in CAI, Lunts (2002)

reports that the amount of learner control affects the effectiveness of the method, with

greater control associated with improved creativity and learner initiative. Lunts further

reports that, generally, the literature suggests that learner control is a useful tool for

adapting a learning environment to students’ needs. Perceived learner control positively

affects motivation and the amount of effort invested in the learning task (Perez, Kester &

Van Merrienboer, n.d.). Eom and Reiser (2000) explain that poor performance under

learner control appears due to the learners’ failure to use effective learning strategies and

poor metacognitive skills. However, when learner control is supplemented with in

learning interventions, individual performance increases (Bell & Kozlowski). In his

summary of five meta-analyses of the impact of technology on student achievement,

Schacter (1999) reports that CAI, integrated learning systems and instruction in higher

order thinking show positive gains in researcher constructed tests, standardized tests and

national tests.

Gagne´ (1977), in reporting a series of experiments of in-training interventions ,

proposed that learners are able to exercise more successful control over their own

learning process by using a cognitive strategy that is presented to them during the

Page 33: Final 2008

22

learning experience or by using a cognitive strategy that may have previously been

learned. The use of frequent numerical or technical questions interspersed in a long

reading passage resulted in an improved retention of the information compared to those

not exposed to interruptive questions. Gagne´ (1977) suggests that the question

interventions had the effect of “activating a strategy of attending” (p. 168) to the facts to

be learned. This anticipated Flavell’s (1979) theory of metacognitive processes and the

use of in-training interventions to stimulate a learner’s ability to increase learning

effectiveness.

Watson (n.d.) reported significant positive performance improvement among

students receiving metacognitive prompts during a computer based learned controlled

tutorial. Embedded metacognitive training resulted in a significant increase in

performance versus both strategy training and a no-training control group among primary

school students (Mevarech, 1999). Hill and Hannafin (1997) report improvements in

posttest performance as a result of embedded cues. Metacognitive training for math

students resulted in increased performance versus traditional learning methods in a two-

year study among eighth-grade students (Mevarech & Kramarski, (2003).

As with metacognitive studies, much of the empirical research on learner control

has focused on students in a school learning environment. In fact, this situation led Lunts

(2002) to characterize learner control research as “excessively targeting younger and

inexperienced learners” (p. 68). Lunts further implies that learner control should have a

greater chance for success with adult learners, as they are likely to be more motivated and

able to comprehend the higher order skills (versus factual information) contained in many

organizational training programs.

Page 34: Final 2008

23

Motivation and Self Efficacy

Motivation has been described as a cognitive process which directs choices

among alternative paths of voluntary actions (Vroom, 1964). A number of theorists have

explained motivation in terms of the expectancy-valence model (Atkinson, 1964;

Fishbein, 1967; Vroom). This model suggests that one’s degree of motivation is

dependent upon both the belief that specific actions will produce particular outcomes and

the value of those outcomes to the individual. Valence is described as the anticipated

satisfaction (positive or negative) of an outcome, whereas value refers to the actual

satisfaction derived. A learner’s perception of self-efficacy can be measured in terms of

their judgments of capabilities and the strength of that belief (Bandura, 2003).

Bandura (1988) joins motivation and self-efficacy as follows:

People’s beliefs in their capabilities affect their motivation as well as the activities they undertake. Significant human accomplishments require perseverant effort. It is renewed effort in the face of difficulties and setbacks that usually brings success. … The important matter is not that difficulties arouse self-doubt –which is a natural immediate reaction – but the recovery from difficulties. Some people quickly recover their self-confidence; others lose faith in their capabilities. It is resiliency of self-belief that counts. (p.282)

Evaluations of self-efficacy affect an individual’s initiation of behavior, the amount of

effort to be expended, and the duration of that effort in the face of disconfirming evidence

(Bandura, 1977). Wood and Bandura (1989a) explain self-efficacy as a regulatory

mechanism affecting motivation:

There is a difference between possessing skills and being able to use them well and consistently under difficult circumstances. To be successful, one not only must possess the required skills, but also a resilient self-belief in one’s capabilities to exercise control over events to accomplish desired goals. People with the same skills may, therefore, perform poorly, adequately, or extraordinarily, depending on whether their self-beliefs of efficacy enhance or impair their motivation and problem-solving efforts. (p. 364)

Page 35: Final 2008

24

Self-efficacy, as explained by Bandura (1986), mediates the relationship between one’s

knowledge and actions. Knowledge and skills are needed, but insufficient alone for

successful performance. People often perform at less than optimum levels, although they

know the correct actions because their self-efficacy perceptions affect their actions.

Bandura (1988) lists four sources of perceived self-efficacy: mastery experiences,

vicarious experience, social persuasion, and physiological state. Mastery experiences,

also called success experiences, help an individual gain a sense of capability. When an

individual achieves success through sustained effort, setbacks and failures can be

managed more easily. Individuals partly judge their capabilities through comparison with

others by observing them through vicarious experiences. Self-efficacy beliefs can also be

affected by modeling – access to successful models can increase an individual’s

perception of self-efficacy. Conversely, observing others’ failures despite high efforts can

lower an individual’s perception of probable success. Social persuasion concerns the

impact of the opinions of others regarding the individual’s likelihood of successfully

completing a task. Realistic encouragement can lead to greater individual effort. The

concept of physiological state also affects an individual’s perception of self-efficacy.

Emotional arousal and tension can signal a possible poor performance. Particularly in

strength-related activities, individuals judge their possible efficacy in terms of perceived

fatigue levels, and presence/absence of pain.

Relevant to this study, the effect of social persuasion, particularly from one’s

organizational supervisor can be a key determinant of an individual’s perception of self-

efficacy as they begin a training task. Bandura’s (1988) key point on this factor is that

individuals who have a strong belief in their efficacy work, think and behave differently

Page 36: Final 2008

25

than those who doubt their capabilities and that social persuasion, e.g. supervisory

behavior, can be a factor in an individual’s perception of self-efficacy. This view of

supervisory support as an independent variable affecting self-efficacy is explained and

elaborated upon in depth in the following section: Supervisory Support.

Self-efficacy is learner’s judgment of their capability to perform actions related to

training (Hill & Hannafin, 1997). Self-efficacy beliefs affect activities through cognitive,

motivational and decisional processes (Bandura & Locke, 2003). In his elaboration of

Kolb’s Learning Cycle model, Vince (1998) proposes that learner anxiety; fear and doubt

at the start of a learning process can either promote or discourage learning. Learner

anxiety in training may impact learning and is likely to be negatively associated with

learning (Warr & Bunce, 1995).

Bandura and Wood (1989) found that a learner’s perception of efficacy, in this

case, achievable standards of performance in operating a simulated firm, affected use of

strategically effective thinking. Results indicated both an initial higher level of strategic

thinking and subsequent increased use of strategic thinking for individuals with highest

perceived initial self-efficacy.

The positive expectation of other organizational members may result in improved

performance (the Pygmalion effect); and self-efficacy can be positively affected through

the persuasive effect of the other organizational members (Gist, 1987). Supervisors and

organizations are clear sources of support for employees and affect employee

commitment to organizational activities (Stinglhamber& Vandenberghe, 2003).

The instructional processes involved in training should increase trainee self-

efficacy and improve expectations that the training will have a positive outcome

Page 37: Final 2008

26

(Tannenbaum & Yuki, 1992). Employees who begin training with the belief that they are

able to successfully learn the content are likely to have more successful training

experiences (Tannenbaum & Yuki). Martocchio (1994) found a significant decline in

anxiety when trainees began training with the belief that they could build on their present

abilities. A key issue, therefore, emerging from this review is whether the level of

metacognitive activity in a non-academic, learner controlled training environment is

influenced by the trainee’s perception of self-efficacy.

Age, Gender and Computer Self Efficacy

Additional variables may have an effect on self efficacy perceptions in a learner

controlled training environment: age, gender and computer self efficacy. While

demographic characteristics have been studied as variables in training studies, they most

often have been viewed as statistical control variables. The two most frequently studied

variables have been age and gender (Colquitt, LePine & Noe, 2000). In their meta

analytic path analysis of training motivation, Colquitt et al. found that older trainees

demonstrated lower motivation, learning and self efficacy. Maurer, Weiss and Barbeite

(2003) reported that older workers had lower self efficacy with regard to learning abilities

and cognitive processes. Other empirical studies have reported a negative relationship

between age and learning (Gist, Rosen & Schwoerer, 1988; Martocchio, 1994).

Age effects were noted in a study of computer attitudes (Czaja & Sharit, 1998), as

older adults reported less comfort, less competence and less control over computers than

did younger adults. Similarly, Henderson, Deane, Barrelle and Mahar (1995) found that

older users have low confidence in their ability to use computer technology. Comber,

Colley, Hargreaves and Dorn (1997) found that older employees demonstrated less

Page 38: Final 2008

27

interest in and poor attitudes towards computer-based training. Thus, the age of the

employee may affect self efficacy in training delivered solely by computer.

Examining self efficacy with regard to gender, Choi (2004) reports that masculine

sex role traits are strongly related to independence, assertiveness and competitiveness,

while feminine sex role traits are related to dependence and interpersonal relationships.

Thus, gender may have an effect on self efficacy perceptions in training that is

accomplished on an individual basis in the absence of a live instructor. Studies of the

effect of gender on computer self efficacy have shown mixed results. Qutami and Abu-

Jaber (1997) reported that male and female college students performed equally in

computer skills training, while Comber et al. (1997) reported lower computer self

assurance for females than males. In independent tasks involving computer based Internet

use, Ford et al. (2001) found that females studied exhibited poorer performance and

lower self efficacy than males on most tasks, but no difference in overall self efficacy

related to computer use. Henry and Stone (1999) found that females had lower computer

self efficacy and lower outcome expectancy than males in using computer systems at

work. Pajares (2002), however, concludes that gender differences in self efficacy can be

eliminated or minimized when employees receive unequivocal feedback about their

capabilities as well as progress in learning.

The above suggests that age and gender could be important variables in the study

of self efficacy in learner controlled training. These were examined as moderating

variables in the research design. Since age and gender are expected to influence

metacognitive activity, self efficacy and supervisor support, the relevant research

questions appear in the next section.

Page 39: Final 2008

28

Supervisory Support

While it would appear natural for an individual to assume responsibility for his or

her own learning, this would unreasonably dismiss the influence of the social

environment. Gagne´ (1977) explains the important effect of events in the external

environment on what and how learning takes place. From early infancy and throughout

adulthood, individuals are subject to the influences of others (parents, peers, teachers and

supervisors) on learning.

Bandura (1986) lays a theoretical foundation for the effect of external influences

on personal effort:

“People who are persuaded verbally that they posses the capabilities to master given tasks are likely to mobilize greater sustained effort than if they harbor self-doubts and dwell on personal deficiencies” (p.231).

In a study of pretraining motivation (Facteau, Dobbins, Russell, Ladd & Kudish,

1995) found that supervisory support was positively related to training motivation;

whereas, peer support, subordinate support and top management support were negatively

related to motivation.

Wood and Bandura (1989b) showed that interpretation of personal efficacy can

affect performance and that perceptions of efficacy can be affected by external factors.

Wood and Bandura’s study induced conceptions of ability among two groups of MBA

students by instructing one group that decision-making skills were acquirable through

practice (acquirable skill condition), while the second group was instructed that decision-

making reflected basic cognitive capacities already possessed (entity condition). The

sample did not differ in pretest perceived self-efficacy. The findings provided evidence

that the conception of ability has substantial impact on self-regulatory behaviors.

Page 40: Final 2008

29

Understanding ability as an acquirable skill resulted in a highly resilient sense of

self-efficacy and high performance outcomes among that group of students. Conversely,

the group in the entity condition viewed substandard performance as due to their own

limitations and performance declined as the decision-making tasks became more complex

and difficult. Relevant to the present study was the finding that the use of analytic

strategies for decisions also varied by group. That is, the acquirable skill group developed

and successfully used strategies to improve performance, with the entity group failing to

successfully develop and utilize strategies. Thus, perceptions of efficacy affect learning

strategies as well as task performance. Jacobs, Prentice-Dunn, and Rogers (1984)

demonstrated that efficacy beliefs can be artificially altered, with subject performance

consistent with the level of efficacy imposed from the outside. Bandura and Locke (2003)

posited that competencies can be can be increased by instilling a strong sense of learning

efficacy.

The effects of supervisor behavior on subordinate attitudes and behavior was the

subject of the Ohio State Leadership Studies. Halpin and Winer (1957) identified two

independent dimensions of leader behavior: Consideration and Initiating Structure.

Consideration encompasses friendship, mutual trust and respect as aspects of supervisory

behavior towards subordinates. Initiating Structure refers to the organization and

definition of subordinate activities. Subordinate satisfaction has been found to be related

to supervisory consideration in a number of studies in the 1950’s (Fleishman, 1957;

Halpin & Winer, 1957; Halpin, 1957).

Bandura (1986) offers a social psychologist’s explanation of the relationship of

subordinate satisfaction and supervisory behavior. Bandura explains that, in human

Page 41: Final 2008

30

development, physically rewarding events often are accompanied by expressions of

interest and approval of others, while non-rewarding events are associated with

disapproval. People choose particular actions for approval and avoid actions which elicit

disapproval. Thus, the predictive value of the social reactions of others serves as an

incentive for a person’s actions. Bandura (1986) stated:

The approval or disapproval of those who can exercise reward and punishment power has more influence on one’s actions than similar expressions by those who cannot affect one’s life....It is difficult to conceive of a society populated with people who are completely unmoved by the respect, approval and reproof of others (p. 235)

In 1961, Likert found large differences between satisfied and dissatisfied work

groups’ reporting of supervisory behaviors. For example, 61% of employees with

favorable attitudes reported that their supervisor recommends promotions, transfers and

pay increases while only 22% of employees with unfavorable attitudes reported that

particular supervisory behavior. This pattern of relationships between positive employee

attitudes and supportive supervisory behavior was consistent throughout the study. In

their meta-analysis of organizational behavior modification, Stajkovic and Luthans

(1997) found that social rewards, such as recognition and attention, were statistically

equal to financial rewards in generating increased task performance in both

manufacturing and service organizations.

Feedback from authority figures can be viewed as a form of persuasion that

affects motivation (Latham & Locke, 1991). Perceptions of a task environment can be

influenced by verbal or written persuasion from others in the social environment

(Martocchio, 1992). Supervisory cues have been found to affect employee intrinsic and

extrinsic satisfaction in a task environment (Griffin, 1983). Learners exhibit greater

Page 42: Final 2008

31

effort and are more likely to succeed if they receive encouragement from other

organizational members (Wood & Bandura, 1989a). Perceptions of positive supervisory

support have been linked to increased trainee motivation prior to training (Cohen, 1990).

Supervisory support for training has been positively associated with successful learning

transfer (Huczynski & Lewis, 1980). Managerial knowledge of the benefits of online

training and interest in implementation fosters faster and more effective implementation

of online training designs (Newton, Hase, & Ellis, 2002).

Gist and Mitchell (1992) explain that self-efficacy is an individual’s judgment of

perceived capability to perform a specific task and that, in an organizational context,

information obtained from the individual, the task itself and others in the organizational

environment may affect the individual’s assessment of capability. The authors further

propose a model of the formation of self-efficacy that contains three broad categories of

factors: analysis of task requirements, assessment of personal and situational resources,

and attributional analysis of experience. Within attributional experience, verbal

persuasion cues may include feedback about an individual’s abilities. Gist and Mitchell

develop the concept of pure persuasion, that is, the use of emotional and cognitive

arguments to convince an individual that he or she can perform a task at a given level.

While the authors hold that this concept may result in more weakly held efficacy beliefs,

there is a clear potential for impact on efficacy beliefs.

Gist and Mitchell (1992) further propose that one’s judgment of self-efficacy is

composed of variable and stable components and that equal self-efficacy judgments may

result in unequal performance due to the individual differences in variable and stable

levels. In this research, therefore, it is hypothesized that a worker’s level of self-efficacy

Page 43: Final 2008

32

is affected by the variability in social persuasion – operationalized in this study as

supervisory support.

Age and gender are expected to have a moderating effect in this study. To address

this, gender was examined in the context of both perceived supervisory support and its

effect on self efficacy and self efficacy and its effect on metacognitive activity.

The above review suggests the following research questions and relevant

hypotheses:

The first research question is: Is supervisory support related to learner control

self efficacy and computer self-efficacy in a learner controlled training environment?

Two research hypotheses were examined in addressing this question:

H1: There is a positive relationship between supervisory support and computer

self-efficacy in a learner controlled training environment.

H2: There is a positive relationship between supervisory support and learner

control self-efficacy in a learner controlled training environment.

The second research question is: Are computer self-efficacy or learner control

self-efficacy related to metacognitive activity in a learner controlled training

environment? The corresponding research hypotheses are:

H3: There is a positive relationship between computer self-efficacy and

metacognitive activity in a learner controlled training environment.

H4: There is a positive relationship between learner control self-efficacy and

metacognitive activity in a learner controlled training environment.

Page 44: Final 2008

33

The third research question is: Do the relationships between supervisory support,

learner control self-efficacy, and metacognitive activity vary as a function of the gender

of the learner? The corresponding research hypotheses are:

H5: The relationship between supervisory support and computer self-efficacy

varies by gender.

H6: The relationship between supervisory support and learner control self-efficacy

varies by gender.

H7: The relationship between computer self-efficacy and metacognitive activity

varies by gender.

H8: The relationship between learner control self-efficacy and metacognitive

activity varies by gender.

The fourth research question is: Do the relationships between supervisory

support, learner control self-efficacy, and metacognitive activity vary as a function of the

age of the learner? The corresponding research hypotheses are:

H9: The relationship between supervisory support and computer self-efficacy

varies by age.

H10: The relationship between supervisory support and learner control self-

efficacy varies by age.

H11: The relationship between computer self-efficacy and metacognitive activity

varies by age.

H12: The relationship between learner control self-efficacy and metacognitive

activity varies by age.

Page 45: Final 2008

34

The fifth research question is: Does computer self-efficacy have an effect on

learner control self-efficacy which subsequently has an effect on metacognitive activity?

The research hypothesis is:

H13: Computer self-efficacy has a positive, indirect effect on metacognitive

activity through learner control self-efficacy.

Page 46: Final 2008

35

CHAPTER III: METHODOLOGY

The literature review above identified a number of limitations of the existing

theory and empirical research on metacognitive interventions. While it is not feasible to

address all of these limitations in this study, the focus is to understand the relationships of

the variables in an organizational environment. The generalizability of findings to

organizational training is the primary limitation of prior studies. The majority of research

with metacognitive interventions has been among children and young adults in

educational settings. Indeed, the theoretical foundations of the construct by Flavell (1976,

1977, 1979 & 1987) are almost totally based on observations and research among pre-

adult populations. In this study, pre-adult is defined as individuals who are primary or

secondary school students. The present study explored the effect of variables on

metacognitive activity among adult learners in an organizationally sponsored setting.

A second limitation of prior research has been the limited consideration of the

role of self efficacy in the learner’s approach to learner controlled training. The

influences of trainee motivation and self efficacy have been virtually ignored in past

studies of learner control. This study attempted to identify the relationship between two

types of self efficacy (i.e. computer self-efficacy and learner control self-efficacy) and

metacognitive activity in a learner controlled training environment. Further, the influence

of supervisory support on self efficacy perceptions, while reasonably well researched, has

not been extensively examined in the context of training. Finally, age and gender in

learner controlled training have been almost universally viewed as control variables;

Page 47: Final 2008

36

whereas this study examined them as moderating variables. That is, rather than merely

controlling for age and gender, their specific effects were examined.

Research Design

This was a survey-based field study designed to gather data on metacognitive

activity, learner control self efficacy, computer self-efficacy, and supervisory support in a

learner controlled training environment. Age and gender were assessed and examined as

potential moderating variables. The study is a non-experimental design; the data support

associational inferences among the variables, but not causal relationships.

The study was conducted among managers whose graduate school education is

being fully or partially sponsored by their employer. Embedded in the graduate school

curriculum is the Virtual Leader© program from Simulearn Inc. The philosophy behind

Virtual Leader is that leadership is a complex skill that can become intuitive through

practice. The program provides applied training focusing on situational awareness, group

dynamics, and managing and empowering others. The Virtual Leader program is

designed as a learner controlled training simulation with managers accessing the program

at their convenience over the 8-10 hour total training content. The Virtual Leader

program is a CD-ROM based training tool where managers utilize a traditional

desktop/laptop computer located on the organization’s premises or at the educational

institution.

The program contains three distinct sections: Leadership Fundamentals, Learning

the Principles and Applying the Principles. The final section consists of six simulated

meeting scenarios where the manager is placed in the position of a manager conducting a

meeting in a graphic interface. The manager uses the principles from the preceding

Page 48: Final 2008

37

sections to manage the simulated participants to a successful meeting outcome. The

simulated meeting can be halted to allow the manager to review either the Fundamentals

or Principles sections preceding the meeting simulation. In this manner, managers can

alter their leadership strategies during the simulation to adapt to changing meeting

conditions.

Hacker (2003) defined metacognitive activity as “knowledge of one’s knowledge,

thought processes, and cognitive and affective states; the ability to consciously and

deliberately monitor and regulate one’s knowledge, processes, and cognitive and

affective states” (p. 6). Metacognitive activity within Virtual Leader is engendered

through on-screen progress bars detailing emotional conditions of the meeting

participants in real time, options for agreeing or disagreeing with opinions from the

simulated participants, changing the topic under discussion, and providing praise or

criticism for any participant. Feedback to the trainee’s responses (from the simulated

participants) is immediate, allowing the trainee to continue or change the strategy being

utilized.

Operationalization of Variables

A short demographic survey (Appendix A) was administered to the respondents at

the beginning of the study. Gender was assessed as male or female. Age was assessed as

a continuous variable. Ethnicity was assessed as White, Black, Hispanic, American

Indian (or Eskimo or Aleut), Asian (or Pacific Islander) or other.

Learner control self efficacy was measured using a pre-training, self-administered

questionnaire consisting of seven items to assess a learner’s confidence to perform

successfully on this task (see Appendix B). Learners rated their self efficacy on a five

Page 49: Final 2008

38

point Likert-type scale ranging from strongly disagree to strongly agree. The instrument

is a selection of appropriate items from previous instruments used to collect self efficacy

data (Ford et al., 1998; Gist et al., 1989; Gist, 1989; Tannenbaum & Yuki, 1992). The

internal reliability of these instruments ranged from .88 to .90 (Cronbach’s α).

Computer self-efficacy was measured using a modification of the Computer Self-

Efficacy scale (Computer Self-Efficacy Survey, n.d.). The instrument (see Appendix C)

uses a five-point Likert-type scale ranging from Very Little Confidence to Quite a Lot of

Confidence. The internal reliability of the section used is .94 (Cronbach’s α).

Supervisor support was measured using a pre-training, self-administered

questionnaire consisting of five items to assess the learner’s perception of supervisory

support for the learner in a learner controlled training environment. The instrument (see

Appendix D) consisted of a selection of questions from Jiang and Klein’s (2000) scale

measuring supervisor support, internal reliability of entire instrument was α =.83. This

questionnaire was administered after the individual completed the initial self efficacy

questionnaire to minimize possible bias caused by the order of the information sought.

For example, one could reasonably speculate that asking questions about supervisory

support initially could impel the respondent to answer subsequent questions about self

efficacy in a manner artificially consistent with prior answers. Answering the questions in

an order other than intended, therefore, threatens both the reliability and the validity of

the instrument.

Metacognitive activity was measured using a post-training, self-administered

questionnaire. The training activity was administered in a learner controlled environment

which utilizes metacognitive interventions. A selection of questions appropriate for this

Page 50: Final 2008

39

study were taken from Ford et al.’s (1998) instrument measuring metacognitive activity

(see Appendix E). Internal reliability for the entire instrument was α =.83. Learners

reported their metacognitive activities for each of ten items on a five point Likert-type

scale ranging from strongly disagree to strongly agree.

Sample

This study was conducted among managers whose graduate school business

education is being fully or partially sponsored by their employer. Questionnaires were

distributed to geographically dispersed graduate business schools across the United

States. The Virtual Leader leadership training program is used by these schools as part of

the leadership curriculum. While all students are required to participate in the training,

only those managers with organizational sponsorship were included in the data for this

study. The study ran for about three months; yielding a sample size of 120 qualified

subjects.

Procedure

The study consisted of pre and post training questionnaires administered

immediately prior to and upon completion of the leadership training session. The four

questionnaires were assembled in a set (Computer Self Efficacy, Learner Control Self

Efficacy, Supervisory Support and Metacognitive Activity), stapled and each set

numbered for identification. Oral and/or written instructions were given to the course

instructor indicating that the respondents should complete the measures in the order of

the stapled packet. All pages within a set contained the same identification number so

that the data for each individual can be identified, even if the pages become separated.

Page 51: Final 2008

40

The course instructors distributed and collected the questionnaires during the

Virtual Leader training session. All instructors were briefed on the study and were able to

administer the questionnaires and answer any procedural questions. The instructors

mailed the completed questionnaires to the researcher.

All data were collected anonymously with age, gender and ethnicity collected on

the cover page containing instructions before the first (learner control and computer self

efficacy) questions are completed. Respondents were asked to complete the first

questionnaire (containing the demographic items, learner control self-efficacy, and

computer self-efficacy scales) before the training begins; respondents were then asked to

complete the final questionnaire (containing the supervisory support and metacognitive

activity scales) immediately upon completion of the Virtual Leader © training.

Research Questions

The current study addressed five research questions incorporating the variables of

learner control self-efficacy, computer self-efficacy, supervisory support, metacognitive

activity, age, and gender. The first four research questions are based on the model shown

in Figure 1. The first research question is: Is supervisory support related to learner

control self efficacy and computer self-efficacy in a learner controlled training

environment?

Two research hypotheses were examined in addressing this question:

H1: There is a positive relationship between supervisory support and computer

self-efficacy in a learner controlled training environment.

H2: There is a positive relationship between supervisory support and learner

control self-efficacy in a learner controlled training environment.

Page 52: Final 2008

41

The second research question is: Are computer self-efficacy or learner control

self-efficacy related to metacognitive activity in a learner controlled training

environment? The corresponding research hypotheses are:

H3: There is a positive relationship between computer self-efficacy and

metacognitive activity in a learner controlled training environment.

H4: There is a positive relationship between learner control self-efficacy and

metacognitive activity in a learner controlled training environment.

The third research question is: Do the relationships between supervisory support,

learner control self-efficacy, and metacognitive activity vary as a function of the gender

of the learner? The corresponding research hypotheses are:

H5: The relationship between supervisory support and computer self-efficacy

varies by gender.

H6: The relationship between supervisory support and learner control self-efficacy

varies by gender.

H7: The relationship between computer self-efficacy and metacognitive activity

varies by gender.

H8: The relationship between learner control self-efficacy and metacognitive

activity varies by gender.

The fourth research question is: Do the relationships between supervisory

support, learner control self-efficacy, and metacognitive activity vary as a function of the

age of the learner? The corresponding research hypotheses are:

H9: The relationship between supervisory support and computer self-efficacy

varies by age.

Page 53: Final 2008

42

H10: The relationship between supervisory support and learner control self-

efficacy varies by age.

H11: The relationship between computer self-efficacy and metacognitive activity

varies by age.

H12: The relationship between learner control self-efficacy and metacognitive

activity varies by age.

The fifth research question is based on the model shown in Figure 2. In this

model, computer self-efficacy was hypothesized to have an effect on learner control self-

efficacy, which subsequently has an effect on metacognitive activity. The research

hypothesis is:

H13: Computer self-efficacy has a positive, indirect effect on metacognitive

activity through learner control self-efficacy.

Data Analysis Plan

The current study employed both descriptive and inferential statistical techniques.

Descriptive statistics consisted of (a) a description of the sample and (b) a description of

the scores on the four primary scales of interest (i.e. supervisory support, computer self-

efficacy, learner control self-efficacy, and metacognitive activity). The description of the

sample consisted of frequencies and relative frequencies for gender, age group, and

ethnicity. The description of scores on the supervisory support, learner control self-

efficacy, computer self-efficacy, and metacognitive activity scales consisted of means

and standard deviations, as well as an assessment of reliability. Reliability was assessed

with Cronbach’s α (internal consistency).

Page 54: Final 2008

43

All inferential analyses consisted of two-tailed tests and an α level of .05. Two-

tailed tests were appropriate for this analysis as the directions of the relationships were

unknown, although where one-tailed tests were required to obtain statistical significance,

the results of these tests are reported as well. Initially, the correlations between the

supervisory support, learner control self-efficacy, computer self-efficacy, and

metacognitive activity were computed for the entire sample, and then separately for

males and females and for younger and older individuals. Then, a series of path models

were examined in which perceived supervisory support is specified as a predictor of

learner control self-efficacy and computer self-efficacy, which in turn are specified as

predictors of metacognitive activity.

Path analysis is essentially a combination of several simultaneous regression

analyses where selected variables can serve as both predictors and outcomes. In the

current study, learner control self-efficacy and computer self-efficacy took on this dual

role, serving as outcomes of supervisory support and predictors of metacognitive activity,

as shown in Figure 1. The hypotheses of the current study were tested by examining the

statistical significance of the standardized regression coefficients (β) for each variable. Z

scores express value in terms of how many standard deviations it is from the mean for

that set of data. It is useful when comparing results from variables with different scales as

is the case in the current study.

The first hypothesis is: There is a positive relationship between supervisory

support and computer self-efficacy in a learner controlled training environment. The

effect marked ‘a’ in Figure 1 represents the relationship between supervisory support and

computer self-efficacy. The relationship between supervisory support and computer self-

Page 55: Final 2008

44

efficacy was tested via the statistical significance of the standardized regression

coefficient (β) calculated for the effect marked ‘a’. The second hypothesis is: There is a

positive relationship between supervisory support and learner control self-efficacy in a

learner controlled training environment. The relationship between supervisory support

and learner control self-efficacy is represented by the effect marked ‘b’ in Figure 1, and

this relationship was tested in the same manner as the first hypothesis.

The third hypothesis is: There is a positive relationship between computer self-

efficacy and metacognitive activity in a learner controlled training environment. This

relationship is represented by the effect marked ‘c’ in Figure 1. The fourth hypothesis is:

There is a positive relationship between learner control self-efficacy and metacognitive

activity in a learner controlled training environment, and this relationship is represented

by the effect marked ‘d’ in Figure 1. To test these relationships for statistical significance,

the standardized regression coefficients (β) associated with the effects marked ‘c’ and ‘d’

were calculated.

The fifth, sixth, seventh, and eighth hypothesis relate to the effect that gender may

have on the relationships between the four primary variables in the current study (i.e.

supervisory support, computer self-efficacy, learner control self-efficacy, and

metacognitive activity). These hypotheses state that the standardized regression

coefficients labeled ‘a’ ‘b’ ‘c’ and ‘d’ in Figure 1 are not the same for males and females.

To test for differences in these relationships between males and females, a path model

was computed in which the effects marked ‘a’ ‘b’ ‘c’ and ‘d’ were computed separately

for males and females. Then, the fit of this model was compared to the fit of models in

which the effects marked ‘a’ ‘b’ ‘c’ and ‘d’ were computed to be equal for males and

Page 56: Final 2008

45

females. Four models were computed, with the effects marked ‘a’ ‘b’ ‘c’ and ‘d’

computed to be equal between males and females one at a time. If the model in which

the effect is computed to be equal for males and females fits significantly worse than the

model in which the effects are computed separately for males and females (as determined

by the χ2 difference test), then the hypotheses related to gender effects will be supported.

The ninth, tenth, eleventh, and twelfth hypotheses relate to differences in the

relationships between the primary variables in the current study as a function of age

group (younger individuals versus older individuals). The method of testing these

hypotheses was identical to the method used to test the fifth through eighth hypotheses.

That is, models in which the effects marked ‘a’ through ‘d’ in Figure 1 will be compared

to models in which these effects are computed to be equal across the two groups, and the

statistical significance of the difference in fit between the two models will be determined

via the χ2 difference test.

The thirteenth hypothesis deals with the positive, indirect effect of computer self-

efficacy on metacognitive activity through learner control self-efficacy. The statistical

significance of the indirect effects was computed via the Sobol z test (Sobol, 1982). The

Sobol test involves computing the product of the two unstandardized regression

coefficients (the effects marked ‘a’ and ‘b’ in Figure 2) and determining if that product is

larger than would be expected if there was no indirect effect.

Page 57: Final 2008

46

Figure 1. Path Model for Research Questions 1-4

c

b d

Figure 2. Path Model for Research Question 5

a b

Computer Self-Efficacy

Supervisory Support

Learner Control Self- Efficacy

Metacognitive Activity

a

Computer Self-Efficacy

Learner Control Self- Efficacy

Metacognitive Activity

Page 58: Final 2008

47

CHAPTER IV: ANALYSIS OF DATA

Preliminary analyses consisted of (a) a description of the sample and (b) a

description of the scores on the four primary scales of interest (i.e. supervisory support,

computer self-efficacy, learner control self-efficacy, and metacognitive activity). The

description of scores on the supervisory support, learner control self-efficacy, computer

self-efficacy, and metacognitive activity scales consisted of means and standard

deviations, as well as an assessment of reliability. Reliability was assessed with

Cronbach’s α (internal consistency).

All inferential analyses consisted of two-tailed tests and an α level of .05. Two-

tailed tests were appropriate for this analysis as the directions of the relationships were

unknown, although where one-tailed tests would have been significant, they will be

reported along with the two-tailed test results. Initially, the correlations between the

supervisory support, learner control self-efficacy, computer self-efficacy, and

metacognitive activity were computed for the entire sample, using AMOS, and then

separately for males and females and for younger and older individuals. Then, a series of

path models were examined in which perceived supervisory support is specified as a

predictor of learner control self-efficacy and computer self-efficacy, which in turn are

specified as predictors of metacognitive activity.

Path analysis is essentially a combination of several simultaneous regression

analyses where selected variables can serve as both predictors and outcomes. In the

current study, learner control self-efficacy and computer self-efficacy occupied this dual

role, serving as outcomes of supervisory support and predictors of metacognitive activity.

Page 59: Final 2008

48

The hypothesized relationships in the current study were tested by examining the

statistical significance of the standardized regression coefficients (β) for each effect. The

use of standardized regression coefficients is conventional in path analysis and multiple

regression. The standardized regression coefficients also have the advantage of providing

information on the effect size associated with each relationship, as they are interpretable

as the change in the criterion variable that results from an increase of one in the predictor

variable, when both variables have been converted to a common metric (i.e. z scores).

Z scores express value in terms of how many standard deviations it is from the mean for

that set of data. It is useful when comparing results from variables with different scales as

was the case in the current study.

The thirteenth hypothesis deals with the indirect effect of computer self-efficacy

on metacognitive activity through learner control self-efficacy. The statistical

significance of the indirect effects was computed via the Sobol z test (Sobol, 1982). The

Sobol test involves computing the product of the two unstandardized regression

coefficients and determining if that product is larger than would be expected if there was

no indirect effect.

Preliminary Analyses

Descriptive statistics for the sample demographic characteristics are shown in

Table 1 and Table 2. Two-thirds of the sample (66.7%) was male, and White participants

formed the largest ethnic group (78.3%). The age of the participants ranged from 21 to

62 with a mean of 30.33 years (SD=7.64 years). Table 2 shows the descriptive statistics

for the four composite measures in the current study.

Page 60: Final 2008

49

Table 1

Descriptive Statistics for Sample Demographic Characteristic (N=120)

Frequency Percentage Gender

Female 40 33.3 Male 80 66.7

Ethnicity

White 94 78.3 Hispanic 13 10.8 Black 7 5.8 Asian 5 4.2 Refused 1 .8

Mean SD Age 30.33 7.64

Page 61: Final 2008

50

Table 2

Descriptive Statistics for the Composite Measures (N=120)

Number

of Items

Minimum

Maximum

Mean

SD α

Computer Self-Efficacy

32 73 159 130.57 16.26 .96

Learner Self-Efficacy

7 17 35 26.09 3.96 .91

Supervisor Support

4 5 20 13.44 3.46 .89

Metacognitive Activity

8 19 40 33.03 4.11 .88

Cronbach’s α reliability coefficients were computed and were high for each of the

four scales (ranging from .88 for metacognitive activity to .96 for computer self-

efficacy). Table 3 shows the correlations between the four composite measures for the

total sample. Computer self-efficacy was positively correlated with both learner control

self-efficacy (r=.49, p<.001) and metacognitive activity (r=.26, p<.01) but not with

supervisory support. Learner self-efficacy was also correlated with supervisory support

(r=.22, p<.05) and metacognitive activity (r=.34, p<.001). In addition, supervisory

support was positively correlated with metacognitive activity (r=.18, p<.05).

Page 62: Final 2008

51

Table 3

Correlations Between Composite Measures (N=120)

Computer

Self-Efficacy Learner Self-

Efficacy Supervisor

Support Metacognitive

Activity Computer Self-Efficacy 1.00 Learner Self-Efficacy .49*** 1.00 Supervisory Support .13 .22* 1.00 Metacognitive Activity .26** .34*** .18* 1.00 *p<.05, **p<.01, *** p<.001

Table 4 shows the correlations between the four composite measures, but this

time the correlations were computed separately for males and females. For females, the

only statistically significant correlation was between learner control self-efficacy and

metacognitive activity (r=.49, p<.01). Among males, the correlations between computer

self-efficacy and learner control self-efficacy (r=.68, p<.001), supervisory support

(r=.23, p<.01), and metacognitive activity (r=.31, p<.01) were all statistically

significant. In addition, learner control self-efficacy was positively correlated with

supervisory support (r=.23, p<.05) and metacognitive activity (r=.27, p<.05). The

relationship between metacognitive activity and supervisory support was not statistically

significant (but the correlation of .20 would have been statistically significant using a

one-tailed test). Although the fact that there were twice as many males as females

resulted in higher power for the statistical significance of these correlations for males, the

Page 63: Final 2008

52

correlations for males are larger in size as well with the exception of the correlation

between learner control self-efficacy and metacognitive activity (which was larger for

females) and between supervisory support and metacognitive activity (which was

statistically non-significant and identical for both males and females).

Table 4

Correlations Between Composite Measures as a Function of Gender (N=120)

Computer

Self-Efficacy Learner Self-

Efficacy Supervisor

Support Metacognitive

Activity

Females (n=40) Computer Self-Efficacy 1.00 Learner Self-Efficacy .23 1.00 Supervisory Support .04 .18 1.00 Metacognitive Activity .16 .49** .20 1.00

Males (n=80) Computer Self-Efficacy 1.00 Learner Self-Efficacy .68*** 1.00 Supervisory Support .23* .23* 1.00 Metacognitive Activity .31** .27* .20 1.00 *p<.05, **p<.01, *** p<.001

Page 64: Final 2008

53

In order to examine the correlations between the four composite variables as a

function of age, the sample was split into those 28 and younger (n=62, 51.7%) and those

29 or older (n=58, 48.3%). This split was chosen primarily to achieve an approximately

equal sample size for the two groups while providing a younger sample whose work

experience almost certainly includes computer use (i.e. workforce entry after 1998).

Table 5 shows the correlations between the four composite measures for the younger age

group and for the older age group.

Table 5

Correlations Between Composite Measures as a Function of Age Group (N=120)

Computer

Self-Efficacy Learner Self-

Efficacy Supervisor

Support Metacognitive

Activity

Younger Respondents (28 years old and younger, n=62) Computer Self-Efficacy 1.00 Learner Self-Efficacy .68*** 1.00 Supervisory Support .09 .30* 1.00 Metacognitive Activity .31* .37** .21 1.00

Older Respondents (29 years old and older, n=58) Computer Self-Efficacy 1.00 Learner Self-Efficacy .26* 1.00 Supervisory Support .19 .15 1.00 Metacognitive Activity .24 .33* .16 1.00

*p<.05, **p<.01, *** p<.001

Page 65: Final 2008

54

For the younger respondents, computer self-efficacy was positively correlated

with both learner control self-efficacy (r=.68, p<.001) and metacognitive activity (r=.31,

p<.05). In addition, learner control self-efficacy was positively correlated with both

supervisory support (r=.30, p<.05) and metacognitive activity (r=.37, p<.01). Among

the older respondents, computer self-efficacy was again correlated with learner control

self-efficacy (r=.26, p<.05), but not with metacognitive activity (although the correlation

of .24 would have been statistically significant using a one-tailed test). Learner control

self-efficacy, on the other hand, was positively correlated with metacognitive activity

(r=.33, p<.05) but not with supervisory support, and supervisory support and

metacognitive activity were not correlated. Therefore, it appears that the correlations

among the four measures tended to be higher for younger respondents than for older

respondents.

Research Questions

The research questions were addressed using path analysis. Initially, the model

presented in Figure 1 of Chapter 3 was computed, and the resulting standardized

regression coefficients and R2 values are shown in Figure 3 (with full regression results

shown in Appendix F). The answers to the first two research questions are derived from

the coefficients of this model.

Page 66: Final 2008

55

Figure 3. Path Model for Research Questions 1 and 2 with Regression Coefficients

*denotes statistical significance for the regression coefficient (p<.05).

Research Question 1

The first research question was: Is supervisory support related to learner control

self efficacy and computer self-efficacy in a learner controlled training environment?

Under this research question, there were two hypotheses to be examined (H1 and H2). The

first hypothesis was: There is a positive relationship between supervisory support and

computer self-efficacy in a learner controlled training environment. The regression

coefficient for the prediction of computer self-efficacy from supervisory support was .13,

which was not statistically significant. Therefore, the first hypothesis was not supported,

and we can conclude that there is no relationship between supervisory support and

computer self-efficacy in a learner controlled training environment.

The second hypothesis was: There is a positive relationship between supervisory

support and learner control self-efficacy in a learner controlled training environment.

The regression coefficient for the prediction of learner control self-efficacy from

supervisory support was .22, and this was statistically significant. Thus, the second

hypothesis is supported, and we can conclude that there is a positive relationship between

Computer Self-Efficacy

Supervisory Support

Learner Control Self- Efficacy

Metacognitive Activity

.13 .13

.22* .28*

R2=.10

R2=.05

R2=.02

Page 67: Final 2008

56

supervisory support and learner control self-efficacy; higher levels of supervisory support

were associated with higher levels of learner control self-efficacy.

Research Question 2

The second research question was: Are computer self-efficacy or learner control

self-efficacy related to metacognitive activity in a learner controlled training

environment? Two hypotheses were stated for this question (H3 and H4). The third

hypothesis was: There is a positive relationship between computer self-efficacy and

metacognitive activity in a learner controlled training environment. The standardized

regression coefficient for the prediction of metacognitive activity from computer self-

efficacy was .13, which was not statistically significant. Therefore, the third hypothesis

was not supported, and we can conclude that there is no relationship between computer

self-efficacy and metacognitive activity.

The fourth hypothesis was: There is a positive relationship between learner

control self-efficacy and metacognitive activity in a learner controlled training

environment. The regression coefficient of .28 was statistically significant for the effect

from learner control self-efficacy and metacognitive activity, and therefore the fourth

hypothesis was supported. There is a positive relationship between learner control self-

efficacy and metacognitive activity; higher levels of learner control self-efficacy were

associated with higher levels of metacognitive activity.

Research Question 3

The third research question was: Do the relationships between supervisory

support, learner control self-efficacy, and metacognitive activity vary as a function of the

gender of the learner? There were four hypotheses included under this research question

Page 68: Final 2008

57

(H5 to H8), and each was examined by performing a multiple-group path analysis in

which the regression coefficient in question was constrained to be equal or allowed to

vary between males and females, and the fit of the two models was compared. The path

models with all regression coefficients free to vary between males and females are shown

in Figures 4 and 5 respectively (with full regression results shown in Appendix F). This

is the baseline model, and sequentially implementing constraints that specific effects are

equivalent for males and females forms the basis for testing H5 to H8.

Figure 4. Path Model for Research Question 3 with Regression Coefficients for Males

*denotes statistical significance for the regression coefficient (p<.05).

Figure 5. Path Model for Research Question 3 with Regression Coefficients for Females

*denotes statistical significance for the regression coefficient (p<.05).

Computer Self-Efficacy

Supervisory Support

Learner Control Self- Efficacy

Metacognitive Activity

.23* .24*

.22* .12

R2=.07

R2=.05

R2=.05

Computer Self-Efficacy

Supervisory Support

Learner Control Self- Efficacy

Metacognitive Activity

.04 .05

.18 .48*

R2=.23

R2=.03

R2=.00

Page 69: Final 2008

58

For males, the effect from supervisory support to computer self-efficacy was

statistically significant, β=.23, as was the effect from supervisory support to learner

control self-efficacy, β=.22. In addition, the effect from computer self-efficacy to meta-

cognitive activity was statistically significant, β=.24, but the effect from learner control

self-efficacy to metacognitive activity was not, β=.12. For females, the effects from

supervisory to support to computer self-efficacy, β=.04, and to learner control self-

efficacy, β=.18, were not statistically significant (although the standardized regression

coefficient from supervisory support to computer self-efficacy for females would have

been statistically significant under a one-tailed hypothesis test). The effect from

computer self-efficacy to metacognitive activity was also not statistically significant for

females, β=.05, but the effect from learner control self-efficacy to metacognitive activity

was statistically significant, β=.48.

The first hypothesis for this research question was: The relationship between

supervisory support and computer self-efficacy varies by gender. Therefore, the

regression coefficient for the effect between supervisory support and computer self-

efficacy was constrained to be equal for males and females, and the fit of the constrained

model was compared to the fit of the unconstrained model. The χ2 difference test between

the two models was statistically significant, χ2diff(1)=.72, p=.397. This indicates that

constraining the effect from supervisory support to computer self-efficacy to be the same

for males and females did not significantly worsen the fit of the model, and therefore H5

was not supported. We can conclude that the relationship between supervisory support

and computer self-efficacy was the same for males and females.

Page 70: Final 2008

59

The next hypothesis (H6) was: The relationship between supervisory support and

learner control self-efficacy varies by gender. To test this hypothesis, the effect from

supervisory support to learner control self-efficacy was constrained to be equal for males

and females. Imposing this constraint did not significantly worsen the fit of the model,

χ2diff(1)=.00, p=.999. Therefore, we can conclude that the relationship between

supervisory support and learner control self-efficacy was the same for males and females,

and H6 was not supported.

The third hypothesis for the third research question (H7) was: The relationship

between computer self-efficacy and metacognitive activity varies by gender. To examine

this hypothesis, the effect from computer self-efficacy to metacognitive activity was

constrained to be the same for males and females. This constraint did not significantly

worsen the fit of the model, χ2diff(1)=.93, p=.336, indicating that the relationship between

computer self-efficacy and metacognitive activity was the same for males and females,

and therefore H7 was not supported.

The final hypothesis for the third research question (H8) was: The relationship

between learner control self-efficacy and metacognitive activity varies by gender. To

examine this hypothesis, the effect from learner control self-efficacy to metacognitive

activity was constrained to be the same for males and females. The resulting difference

in fit between the constrained and unconstrained models was not statistically significant,

χ2diff(1)=2.34, p=.126. Therefore, H8 was not supported, and we can conclude that the

relationship between learner control self-efficacy and metacognitive activity is the same

for males and females.

Page 71: Final 2008

60

Given the seemingly contradictory results between the preliminary tests and the

subsequent direct tests of moderation, a regression analysis with an interaction variable

for gender was considered as a potential tool to clarify the relationship. In addition to the

issue of small sample size (Female=40), χ2diff is generally considered a more useful tool

to detect differences where sample sizes are small. Further, Russell and Bobko (1992)

found that using Likert-type scales (as in the present study) reduces the likelihood of

detecting true interaction effects.

Research Question 4

The fourth research question is: Do the relationships between supervisory

support, learner control self-efficacy, and metacognitive activity vary as a function of the

age of the learner? To address this research question, four hypotheses were tested using

the same methodology as employed for the third research question. Figures 6 and 7 show

the path model estimated separately for younger and older individuals (with full

regression results shown in Appendix F).

Figure 6. Path Model for Research Question 4 with Regression Coefficients for Younger Participants

*denotes statistical significance for the regression coefficient (p<.05).

Computer Self-Efficacy

Supervisory Support

Learner Control Self- Efficacy

Metacognitive Activity

.09 .12

.30* .29*

R2=.10

R2=.09

R2=.01

Page 72: Final 2008

61

Figure 7. Path Model for Research Question 4 with Regression Coefficients for Older Participants

*denotes statistical significance for the regression coefficient (p<.05).

For younger individuals, the effect from supervisory support to computer self-

efficacy was not statistically significant, β=.09, but the effect from supervisory support to

learner control self-efficacy was statistically significant, β=.30. The effect from

computer self-efficacy to metacognitive activity was not statistically significant, β=.12,

but the effect from learner control self-efficacy to metacognitive activity was significant,

β=.29.

For older participants, neither the effect from supervisory to support to computer

self-efficacy, β=.19, nor the effect from supervisory support to learner control self-

efficacy, β=.15, were not statistically significant. The effect from computer self-efficacy

to metacognitive activity was also not statistically significant for older participants,

β=.17, but the effect from learner control self-efficacy to metacognitive activity was

statistically significant, β=.29.

Computer Self-Efficacy

Supervisory Support

Learner Control Self- Efficacy

Metacognitive Activity

.19 .17

.15 .29*

R2=.12

R2=.02

R2=.04

Page 73: Final 2008

62

H9 was: The relationship between supervisory support and computer self-efficacy

varies by age. Constraining the effect from supervisory support to computer self-efficacy

did not significantly worsen the fit of the model, χ2diff (1) =.30, p=.584. This indicated

that H9 was not supported, leading to the conclusion that the relationship between

supervisory support and computer self-efficacy is the same for younger and older

individuals.

The next hypothesis (H10) was: The relationship between supervisory support and

learner control self-efficacy varies by age. Constraining the effect from supervisory

support to learner control self-efficacy resulted in a model that did not fit significantly

worse than the unconstrained model, χ2diff(1)=.65, p=.421. Thus, H10 was not supported,

and we can conclude that the relationship between supervisory support and learner

control self-efficacy is the same for younger and older individuals.

H11 was: The relationship between computer self-efficacy and metacognitive

activity varies by age. When the effect from computer self-efficacy to metacognitive

activity was constrained to be the same for older and younger participants, fit was not

significantly worse, χ2diff(1)=.08, p=.773. Therefore, H11 was not supported, and we can

conclude that the relationship between computer self-efficacy and metacognitive activity

is the same for younger and older individuals.

The final hypothesis for the fourth research question (H12) was: The relationship

between learner control self-efficacy and metacognitive activity varies by age.

Constraining the effect from learner control self-efficacy to metacognitive activity to be

the same for younger and older respondents did not significantly worsen the model fit,

χ2diff(1)=.00, p=.975. Thus, H12 was not supported, leading us to conclude that the

Page 74: Final 2008

63

relationship between learner control self-efficacy and metacognitive activity is the same

for younger and older individuals.

Research Question 5

The fifth research question is based on the model shown in Figure 2. In this

model, computer self-efficacy is hypothesized to have a positive effect on learner control

self-efficacy, which subsequently has an effect on metacognitive activity. The hypothesis

to be tested (H13) was: Computer self-efficacy has a positive, indirect effect on

metacognitive activity through learner control self-efficacy. Figure 8 shows the results of

this model.

Figure 8. Path Model for Research Question 5 with Regression Coefficients

.49* .34*

*denotes statistical significance for the regression coefficient (p<.05).

The effect from computer self-efficacy to learner control self-efficacy was statistically

significant, β=.49, p<.001, and the effect from learner control self-efficacy to

metacognitive activity was statistically significant, β=.34, p<.001.

The indirect effect of computer self-efficacy on metacognitive activity through

learner control self-efficacy is equal to the product of the β coefficients, or .49 X .34 =

.17. The Sobol z test result for this indirect effect was statistically significant, Sobol

z=3.30, p=.001. This indicated that the hypothesis was supported, and we can conclude

Computer Self-Efficacy

Learner Control Self- Efficacy

Metacognitive Activity

R2=.24 R2=.12

Page 75: Final 2008

64

that computer self-efficacy has an indirect effect on metacognitive activity through

learner control self-efficacy.

Page 76: Final 2008

65

CHAPTER V: DISCUSSION AND IMPLICATIONS

This chapter presents a discussion of the findings of the study. Initially, a

summary of the findings is presented both for the preliminary analyses and those analyses

performed to address the research questions of this study. Then, the implications of these

findings are discussed. Recommendations for future research and for practice are

presented next and, finally, a brief set of conclusions from this study.

Summary of Findings

One-hundred and twenty individuals participated in this study, of which two-

thirds were male. Over three-quarters of the participants were White, and they averaged

just over 30 years of age. The reliability coefficients for the four composite measures

used in this study were high, ranging from .88 to .96. In the combined sample, computer

self-efficacy was positively correlated with both learner control self-efficacy and

metacognitive activity but not with supervisory support. Learner control self-efficacy was

also correlated with supervisory support and metacognitive activity. In addition,

supervisory support was positively correlated with metacognitive activity. When the

sample was divided into male and female groups, differences emerged. For females,

learner control self-efficacy and metacognitive activity were positively correlated, but no

other correlations were statistically significant. For males, however, computer self-

efficacy was positive correlated with all three other measures, and learner control self-

efficacy was positively correlated with supervisory support metacognitive activity. Thus,

the correlations among the four measures were generally larger and more likely to be

statistically significant for males than for females (although it should be noted that the

Page 77: Final 2008

66

sample of males was larger, resulting in more statistical power for the male group than

the female group).

The correlations between the four composite measures were also examined as a

function of age (those 28 and younger versus those 29 or older). For the younger

respondents, computer self-efficacy was positively correlated with both learner control

self-efficacy and metacognitive activity, and learner control self-efficacy was positively

correlated with both supervisory support and metacognitive activity. For the older

respondents, computer self-efficacy was positively correlated with learner control self-

efficacy, but not with metacognitive activity, and learner control self-efficacy was

positively correlated with metacognitive activity, but not with supervisory support.

Supervisory support and metacognitive activity were not correlated for the older

respondents. Overall, the correlations among the measures tended to be stronger for the

younger respondents than for older respondents.

The first research question of the current study was: Is supervisory support

related to learner control self efficacy and computer self-efficacy in a learner controlled

training environment? Results indicated that (a) there was no relationship between

supervisory support and computer self-efficacy, and (b) there was a positive relationship

between supervisory support and learner control self-efficacy, with higher levels of

supervisory support were associated with higher levels of learner control self-efficacy.

The second research question was: Are computer self-efficacy or learner control

self-efficacy related to metacognitive activity in a learner controlled training

environment? Data related to this research question showed that: (a) there was no

relationship between computer self-efficacy and metacognitive activity, and that there

Page 78: Final 2008

67

was a positive relationship between learner control self-efficacy and metacognitive

activity such that higher levels of learner control self-efficacy were associated with

higher levels of metacognitive activity.

The third research question was: Do the relationships between supervisory

support, learner control self-efficacy, and metacognitive activity vary as a function of the

gender of the learner? Results of the analyses performed indicated that (a) the

relationship between supervisory support and computer self-efficacy was the same for

males and females, (b) the relationship between supervisory support and learner control

self-efficacy was the same for males and females, (c) the relationship between computer

self-efficacy and metacognitive activity was the same for males and females, and (d) the

relationship between learner control self-efficacy and metacognitive activity was the

same for males and females. Therefore, the answer to the third research question is that

the relationships between supervisory support, learner control self-efficacy, and

metacognitive activity do not vary as a function of gender of the learner.

The fourth research question was: Do the relationships between supervisory

support, learner control self-efficacy, and metacognitive activity vary as a function of the

age of the learner? Results indicated that (a) the relationship between supervisory

support and computer self-efficacy was the same for younger and older individuals, (b)

the relationship between supervisory support and learner control self-efficacy was the

same for younger and older individuals, (c) the relationship between computer self-

efficacy and metacognitive activity was the same for younger and older individuals, and

that (d) the relationship between learner control self-efficacy and metacognitive activity

is the same for younger and older individuals. Therefore, the answer to the fourth

Page 79: Final 2008

68

research question is that the relationships between supervisory support, learner control

self efficacy and metacognitive activity do not vary as a function of the age of the learner.

A fifth research question was designed to examine the indirect effect of computer

self-efficacy on metacognitive activity through learner control self-efficacy. Results

indicated that computer self-efficacy did in fact have a positive indirect effect on

metacognitive activity through learner control self-efficacy. Thus, higher levels of

computer self-efficacy resulted in higher levels of learner control self-efficacy, which in

turn resulted in higher levels of metacognitive activity.

Implications

This section presents an analysis and integration of the results of this study into

existing theoretical models and empirical studies related to metacognitive activity. First,

the contribution of the current study in terms of examining metacognitive activity in

adults as opposed to children is discussed. Gender and age group differences in computer

self-efficacy are described in the next section. The next section describes supervisory

support and its relationships with the self-efficacy variables employed in the current

study. Then, the relationships between self efficacy and metacognitive activity are

addressed.

Metacognitive Activity for Children Versus Adults

One of the key contributions of this study was the inclusion of adults rather than

children as the subject group. Prior studies of metacognitive activity, especially the

theoretical foundations identified by Flavell (1976, 1977, 1979, 1987), are based almost

entirely on research among pre-adult (primary and secondary school) populations. Thus,

the demonstration that self-efficacy and metacognitive activity were positively related to

Page 80: Final 2008

69

each other in adults is a contribution to the literature on metacognitive activity. In

addition, the current study examined differences between younger adults and older adults

and found no differences (in the direct difference tests, although some indications of

differences were found in the correlational analyses). It may be the case that these

relationships are relatively consistent once an individual reaches adulthood.

Gender, Age, and Computer Self-Efficacy

Confidence in using a personal computer has been shown to relate negatively to

age, that is, older adults evince lower confidence in operating a personal computer than

younger adults and even children (Henderson et al., 1995; Comber et al., 1997). In

addition, gender has also been identified as a variable affecting computer self-efficacy

(Comber et al.; Ford et al., 2001), with females having lower levels of computer self-

efficacy in past research. The current study did not directly test differences in computer

self-efficacy between males and females or between younger and older adults, but did

examine differences in the relationships between computer self-efficacy and other

variables between males and female and between younger and older adults. These direct

tests performed to determine if gender or age moderated the relationships between

computer self-efficacy and the other variables in this study did not reveal any differences.

Thus, it may be the case that males and females or older and younger adults differ in

levels of computer self-efficacy (as past research has indicated) but that these mean

differences do not affect the relationships between computer self-efficacy and other

variables. Alternatively, the issue of computer self-efficacy may no longer be gender or

age related given the ubiquity of these devices in the contemporary business

environment.

Page 81: Final 2008

70

Supervisory Support, Computer Self-Efficacy and Learner Control Self-Efficacy

No relationship was found between supervisory support and computer self-

efficacy in a learner controlled training environment in the current study. This is

contradictory to past studies presented in the literature that have found support for the

hypothesis that supervisor feedback affects motivation (Cohen, 1990; Huczynski &

Lewis, 1980; Latham & Locke, 1991). This inconsistency could be explained by the

multitude of variables that can affect one’s computer self-efficacy. These include: extent

of prior computer training, access and involvement with computers both in the work and

home environment, and the likely wide range of supervisory support for employee

computer skills in general.

Supervisory support was, however, related to learner control self-efficacy for the

combined sample, as well as for males and the younger adult group separately. This

finding of a positive relationship between supervisor support and learner control self-

efficacy suggests that higher levels of supervisor support are associated with higher levels

of learner control self efficacy. Statements and attitudes expressed by supervisors

regarding positive training outcomes appears to reinforce a, employee’s feeling of

confidence. Wood and Bandura (1989a), Griffin (1989), and Martocchio (1992) found

similar relationships as positive supervisory cues increase the degree of employee

motivation and training outcomes. The fact that the relationships between these variables

was stronger for males and for younger adults is worthy of exploration in future research

as will be discussed below.

Page 82: Final 2008

71

Metacognitive Activity and Self-Efficacy

Past research has shown that the ability of the trainee to control time on task and

sequence of learning improves metacognitive activity (Schmidt & Ford, 2003). In the

current study, metacognitive activity was positively associated with both learner self-

efficacy and computer self-efficacy. This finding in the current study supports the

findings from studies such as those by Schmidt and Ford. That is, the finding that higher

levels of self-efficacy (either learner control or computer) were associated with higher

levels of metacognitive activity is consistent with the past finding that the ability of

trainees to control time on task and sequence of learning results in higher levels of

metacognitive activity. In addition to positive relationships with metacognitive activity,

learner control self-efficacy has been shown to relate positively to other training

outcomes (e.g., Martocchio, 1994; Tannenbaum & Yuki, 1993), indicating that it has

broad importance in the field of education.

However, the results of the current study included an examination of the potential

moderating influence of gender and age on this relationship, and the findings were not as

clear. Specifically, the correlational analyses revealed some potential differences in these

relationships based on gender and age (with the relationships between the self-efficacy

variables and metacognitive activity being stronger for males and younger participants

than for females and older individuals), but the direct moderation tests indicated that

there were no differences based on gender or age. This may be due to the moderate

sample size in the current study as the correlational differences between the gender and

age groups appear substantial. Past research involving gender and computer self-efficacy

(e.g., Brosnan, 1998; Henry & Stone, 1999) suggested a lower level of computer self-

Page 83: Final 2008

72

efficacy for females. It may be the case that the very widespread availability of desktop

computers that makes them such an obvious choice for learner controlled training, has

rendered them “gender neutral” office tools like copiers, fax machines, and so forth, and

therefore that a possible gender difference has disappeared over time. In any case, if there

are moderating effects of gender or age on the relationships between metacognitive

activity and self-efficacy, this would suggest that for certain age or gender groups, the

person factors for metacognitive activity, as explained by Flavell (1987) may override the

method of task accomplishment.

Recommendations for Future Research

Based on the results of this study, there are several recommendations that can be

made for future research in the area of supervisory support, self-efficacy and

metacognitive activity. First, the current study was performed within a single learning

environment with a single set of training goals – leadership skills. As mentioned in the

methodology chapter, organizational trainees using the Virtual Leader program from

Simulearn Inc. were the focus of this study. Because a single learning environment was

included in the current study, it is possible that some of the relationships and effects

found (and not found) in the current study are specific to that learning environment.

Therefore, it is recommended that the current study be replicated with other learning

environments to determine if the effects are specific to the Simulearn/Virtual Leader

program or if they are more generalizable.

Second, the current study used a non-experimental research design, but other

designs should be attempted. In the current study, it was not possible to experimentally

manipulate variables such as supervisory support in order to examine their effects on

Page 84: Final 2008

73

other variables. Therefore, firm causal conclusions regarding these relationships are not

possible. While some of the variables of interest in the current study are individual

characteristics (e.g., self-efficacy) and therefore are not easily manipulated in an

experimental situation, others (such as supervisory support) could be manipulated with

relative ease. Therefore, it is recommended that alternative study designs, such as true

experiments, be attempted to advance the results of the current study.

Third, while the current study included several of the key variables related to the

theoretical model of self-efficacy, supervisory support, and metacognitive activity,

including gender and age as potential moderators, there are many other variables that

could be included in subsequent models. For example, it would be interesting to

determine if an individual’s educational level would influence the relationships among

the study variables. When modeling any complex phenomenon, any given study’s list of

included variables will be incomplete, and it is thought that the variables included in the

current study were some of the most important given this subject area. However, future

researchers should attempt to build on the results of the current study by incorporating

additional variables to examine their place within the model.

Fourth, one of the findings that is somewhat contradictory in the current study

was that there appeared to be differences between males and females and between

younger and older adults when the correlations between the key study measures were

examined in the preliminary analyses, but that there were no differences between these

groups in the direct tests of moderation. As noted above, this may be due to the somewhat

small sample sizes in the current study when subgroups were created. Specifically, the

indication in the preliminary analyses that there were potential differences between males

Page 85: Final 2008

74

and females and between older and younger adults were based on statistically significant

correlations in some sub-groups but non-statistically significant correlations in other

groups, despite the fact that the correlations were in the same direction (positive) for all

groups even if they were not statistically significant. Thus, future research should employ

larger samples sizes to remove any ambiguity in whether or not there are differences

between males and females or between older and younger adults in the relationships

between the variables in this study.

Finally, one recommendation for future research involves re-examining the

mediation of the effect of computer self-efficacy on metacognitive activity through

learner control self-efficacy. One of the findings of the current study was that computer

self-efficacy had an indirect effect on metacognitive activity through learner control self-

efficacy (i.e. that higher levels of computer self-efficacy were associated with higher

levels of learner control self-efficacy, which in turn were associated with higher levels of

metacognitive activity). Although this finding is consistent with causality, given the

correlational nature of the current study, firm causal conclusions cannot be drawn. It

should be noted that the sample consisted of graduate school students whose computer

self-efficacy can be reasonably assumed to be higher than the general population.

Therefore, it is recommended that future researchers examine this relationship in a true

experiment. Specifically, the effect of a manipulation of computer self-efficacy (through

computer training) on learner control self-efficacy, and the effect of a manipulation of

learner-control self-efficacy on metacognitive activity should be examined in a true

experiment (involving random assignment of participants to the experimental and control

groups).

Page 86: Final 2008

75

Recommendations for Practice

Given the findings of the current study, there are several recommendations that

can be made for business and training practice. First, the results from the current study

indicated the relationships between supervisory support, computer self-efficacy, learner

control self-efficacy, and metacognitive activity did not differ for males and females.

This indicates that when educational programs such as the one employed in the current

study are designed, one approach should work well for both males and females, and

therefore there is no need to design specific programs for each gender.

Second, the results from this study showed that there were no differences in the

relationships between supervisory support, computer self-efficacy, learner control self-

efficacy, and metacognitive activity for older versus younger participants. As was the

case with gender, this indicates that the age of the learner does not play a key role in

programs such as the one examined in the current study—older learners and younger

learners do not have to be differentiated when designing such programs.

Third, the results of the current study indicated that supervisory support was

related to learner control self-efficacy (such that higher levels of supervisory support

were associated with higher levels of learner control self-efficacy) but not to computer

self-efficacy. Thus, while the level of supervisory support provided is likely to make a

learner have stronger feelings of control, it is unlikely to assist in a learner’s confidence

in their computer activities. Therefore, it is recommended that when computer self-

efficacy is a key component to a learning program, efforts beyond additional supervisory

support will be required.

Page 87: Final 2008

76

Fourth, the results of the current study showed that metacognitive activity could

be predicted by learner control self-efficacy (with higher levels of learner control self-

efficacy associated with higher levels of metacognitive activity) but not by computer self-

efficacy. Thus, learner control self-efficacy appears to be more important than computer

self-efficacy in terms of the possibility of increasing metacognitive activity. Therefore, it

is recommended that in learning situations where metacognitive activity is important, the

focus should be on increasing learner control self-efficacy rather than on computer self-

efficacy (but also see the next recommendation).

Fifth, one of the most interesting findings of the current study was that computer

self-efficacy had an indirect effect on metacognitive activity through learner control self-

efficacy. Specifically, higher levels of computer self-efficacy were associated with higher

levels of learner control self-efficacy, which in turn were associated with higher levels of

metacognitive activity. While the current study was correlational rather than a true

experiment, this finding is consistent with the hypothesis that manipulating computer

self-efficacy could have a downstream effect, increasing learner control self-efficacy and

consequently increasing metacognitive activity. Thus, for educational programs such as

the one in the current study, it is recommended that program administrators begin with

training focused on improving the learners’ computer skills given the effects that it is

likely to have on metacognitive activity (through learner control self-efficacy). It is

important to note that learner control self-efficacy was also directly related to

metacognitive activity, and therefore that efforts to increase learner control self-efficacy

are also likely to be worthwhile.

Page 88: Final 2008

77

A final recommendation for practitioners relates to the size of the effects found in

the current study. Three variables served as dependent variables (predicted by other

variables) in this study: computer self-efficacy, learner control self-efficacy, and

metacognitive activity. For computer self-efficacy, the R2 values ranged from .00 to .05

across all models. For learner control self-efficacy, the R2 values ranged from .03 to .24.

For metacognitive activity, the primary dependent variable in this study, the R2 values

ranged from .10 to .23. Thus, the relatively small R2 coefficients in the current study are

important for practitioners to consider because they imply that the predictive models in

this study explain relatively small percentages of variances in the dependent variables.

There are clearly a variety of other potential predictor variables that should be considered

in attempts to understand metacognitive activity, computer self-efficacy, and learner

control self-efficacy.

Conclusions

The purpose of the current study was to examine the effects of supervisory

support, age and gender on an adult learner’s perception of self-efficacy and

metacognitive activity when metacognitive interventions are utilized in a learner

controlled training environment. The key results of this study were:

1. There was no relationship between supervisory support and computer self-

efficacy.

2. There was a positive relationship between supervisory support and learner control

self-efficacy, with higher levels of supervisory support were associated with

higher levels of learner control self-efficacy.

Page 89: Final 2008

78

3. There was no relationship between computer self-efficacy and metacognitive

activity.

4. There was a positive relationship between learner control self-efficacy and

metacognitive activity such that higher levels of learner control self-efficacy were

associated with higher levels of metacognitive activity.

5. The relationships, or lack thereof, among the key study variables did not vary as a

function of the gender or age of the participant.

Based on these results, it was recommended that practitioners

1. Do not need to consider the age or gender of the learner in learning programs

similar to the one employed in the current study.

2. Should not rely only on supervisory support to enhance computer self-efficacy.

3. Should focus on enhancing learner control self-efficacy when attempting to

increase metacognitive activity.

4. Could also focus on computer self-efficacy as a means of increasing

metacognitive activity due to the indirect effect of computer self-efficacy on

metacognitive activity through learner control self-efficacy.

Finally, it was recommended that future researchers:

1. Replicate the current results within other learning environments to determine if

the effects are specific to the Simulearn/Virtual Leader program or if they are

more generalizable

2. Employ additional research designs such as performing true experiments

3. Include additional variables in the statistical models.

Page 90: Final 2008

79

References

American Association of University Women, Educational Foundation Commission on Technology Gender and Teacher Education. (2000). Tech-savvy: Educating girls in the new computer Age. Washington, D.C.: American Association of University Women Educational Foundation. Retrieved Oct. 30, 2004 from: http://www.aauw. org/member_ center/publications/TechSavvy/TechSavvy.pdf

Aleven, V., Stahl, E., Schworm, S., Fischer, F. & Wallace, R. (2003). Help seeking and

help design in interactive learning environments. Review of Educational Research, 73(3), 277-306.

Armstrong, A. M. (1989). Persistence and the causal perception of failure: Modifying

cognitive attributions. Journal of Educational Psychology, 70(2), 154-166. American Society for Training and Development (2004). State of the industry report.

Retrieved July 5, 2004 from: http://www.astd.org/NR/rdonlyres/49A44CD8-2A3E-471F-B80E-42504F4A1726/0/SOIR_2004_Executive_Summary.pdf

American Society for Training and Development (2008), Industry statistics. Retrieved

January 27, 2008 from: http://www.astd.org/industrystatistics Atkinson, J. W. (1964). An introduction to motivation. New Jersey: Van Nostrand. Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change.

Psychological Review, 84, 191-215. Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory.

New Jersey: Prentice-Hall. Bandura, A. (1988). Organisational applications of social cognitive theory. Australian

Journal of Management 13(2), 275-301. Bandura, A., & Locke, E. A. (2003). Negative self-efficacy and goals effects revisited.

Journal of Applied Psychology, 88(1), 87-99. Bandura, A., & Wood, R. (1989). Effect of perceived controllability and performance

standards on self-regulation of complex decision making. Journal of Personality and Social Psychology, 56 (5), 805-814.

Bell, B. S., & Kozlowski, S.W. (2002). Adaptive guidance: Enhancing self-regulation,

knowledge and performance in technology based training. Personnel Psychology, 55(2), 267-307.

Birdi, K., Allan, C., & Warr, P. (1997). Correlates and perceived outcomes of four types

of employee development activity. Journal of Applied Psychology 82(6), 845-857.

Page 91: Final 2008

80

Brosnan, M. J. (1998). The impact of psychological gender, gender-related perceptions,

significant others, and the introducer of technology upon computer anxiety in students. Journal of Educational Computing Research, 18(1), 63-78.

Brown, K.G. (2001). Using computers to deliver training: Which employees learn and

why? Personnel Psychology, 54(2), 271-297. Boekaerts, M., (1995). Self regulated learning: bridging the gap between metacognitive

and metamotivational theories. Educational Psychologist, 30(4), 195-200. Bruner, J. S., Goodnow, J. J., & Austin, G. A. (1956). A study of thinking. New York:

Wiley. Choi, N. (2004). Sex role differences in specific, academic and general self efficacy. The

Journal of Psychology, 138(2), 149-160. Cohen, D. J. (1990). What motivates trainees? Training and Development Journal,

44(11), 91-94. Collins, C. J., & Clark, K. D. Strategic human resource practices, top management team

social networks, and firm performance: the role of human resource practices in creating organizational competitive advantage. Academy of Management Journal, 46(6), 740-752.

Colquitt, J. A., LePine, J. A., & Noe, R. A. (2000). Toward an integrative theory of

training motivation: A meta-analytic path analysis of 20 years of research. Journal of Applied Psychology, 85(5), 678-707.

Comber, C., Colley, A., Hargreaves, D. J., & Dorn, L. (1997). The effects of age, gender

and computer experience upon computer attitudes. Educational Research, 39, 123-133.

Computer Self-Efficacy Survey (n.d.). Retrieved Oct. 19, 2005, from http://www.

positivepractices.com/EducationalTechnology/ComputerSelf-Efficacy Surv.html#ValidationoftheComputerSelf-EfficacyScaleCSE

Constructivist Learning Theory (n.d.). Retrieved Aug. 26, 2004, from http://www.cdli.ca

~elmurphy/emurphy/cle2b.html. Czaja, S. J. & Sharit, J., (1998). Age differences in attitudes toward computers. The

Journals of Gerontology: Series B: Psychological Sciences and Social Sciences, 53B(5), 329-341.

Despite Economy, companies spent more on training in ’02. HR Focus, 81(2), 8-10.

Page 92: Final 2008

81

DeMar, G (2004). Behaviorism. Retrieved August 19, 2004 from http://psych.athabascau. ca/html/Behaviorism/

Eom, W., & Reiser, R. A., (2000). The effects of self-regulation and instructional control

on performance and motivation in computer-based instruction. International Journal of Instructional Media, 27(3), 247-261.

Facteau, J. D., Dobbins, G. H., Russell, J., Ladd, R. T., & Kudisch, J. D. (1995). The

influence of general perceptions of the training environment on pretraining motivation and perceived training transfer. Journal of Management, 21(1), 1-25.

Fishbein, M. (1967). Readings in attitude theory and measurement. New York: Wiley. Flavell, J. H. (1976). Metacognitive aspects of problem solving. In L. B. Resnick (Ed.),

The nature of intelligence (pp. 231-236). New Jersey: Lawrence Erlbaum Associates.

Flavell, J. H. (1977). Cognitive development. New Jersey: Prentice-Hall. Flavell, J. H. (1979). Metacognition and cognitive monitoring: a new area of cognitive-

developmental inquiry. American Psychologist, 34, 906-911. Flavell, J. H. (1987). Speculations about the nature and development of Metacognition. In

F. Weinert & R. Kluwe (Eds.), Metacognition, motivation and understanding (pp. 21-30). New Jersey: Lawrence Erlbaum Associates

Fleishman, E. A., (1957). A leader behavior description for industry. In R. M. Stogdill

and A. E. Coons (Eds.), Leader Behavior: Its Description and Measurement. Columbus: Ohio State University.

Ford, J. K., Smith, E. M., Weissbein, D. A., Gully, S. M., & Salas, E. (1998).

Relationships of goal orientation, metacognitive activity and practice strategies with learning outcomes and transfer. Journal of Applied Psychology, 83(2), 218-233.

Ford, N., Miller, D., & Moss, N. (2001). The role of individual differences in internet

searching: An empirical study. Journal of the American Society for Information Science and Technology, 52(12), 1049-1066.

Gagne´, R. M., & Briggs, L. J. (1974). Principles of instructional design. New York:

Holt, Rinehart and Winston. Gagne´, R. M. (1977). The conditions of learning. New York: Holt, Reinhart and

Winston.

Page 93: Final 2008

82

Glaser, R., & Pellegrino, J.W. (1987). Aptitudes for learning and cognitive processes. In F. Weinert & R. Kluwe (Eds.), Metacognition, motivation, and understanding (pp. 267-288). New Jersey: Lawrence Erlbaum Associates.

Gilley, J. (2002). Gender and technology awareness training in preservice teacher

education. Tech Trends, 46(6), 21-27. Gist, M. E. (1987). Self-efficacy: Implications for organizational behavior and human

resource management. Academy of Management Review, 12(3), 472-485. Gist, M. E., & Mitchell, T. R. (1992). Self-efficacy: A theoretical analysis of its

determinants and malleability. Academy of Management Review 17(2), 183-211. Gist, M. E., Rosen, B., & Schwoerer. (1988). The influence of training method and

trainee age on the acquisition of computer skills. Personnel Psychology, 41, 255-265.

Gist, M. E., Schwoerer, C., & Rosen, B. (1989). Effects of alternative training methods

on self-efficacy and performance in computer software training. Journal of Applied Psychology, 74(6), 884-891.

Gist, M. E., Stevens, C. K., & Bavetta, A. G. (1991). Effects of self efficacy and post-

training intervention on the acquisition and maintenance of complex interpersonal skills. Personnel Psychology, 44(4), 837-861.

Griffin, R. W. (1983). Objective and social sources of information in task redesign: A

field experiment. Administrative Science Quarterly, 28(2), 184-201. Hacker, D. J., (2003). Metacognition: Definitions and empirical foundations. Retrieved

Nov. 18, 2003 from http://www.psyc.memphis.edu/trg/meta.htm Halpin, A. W. (1957). The observed leader behavior and the ideal leader behavior of

aircraft commanders and school superintendents. In R. M. Stogdill and A. E. Coons (Eds.), Leader behavior: Its description and measurement. Columbus: Ohio State University.

Halpin, A. W., & Winer, B. J. (1957). A factorial study of the leader behavior

descriptions. . In R. M. Stogdill and A. E. Coons (Eds.), Leader behavior: Its description and measurement. Columbus: Ohio State University.

Hannafin, R. D., & Sullivan, H. J. (1996). Preferences and learner control over amount of

instruction. Journal of Educational Psychology, 88(1), 162-173. Henderson, R., Deane, F., Barrelle, K., & Mahar, D. (1995). Computer anxiety:

correlates, norms and problem definition in health care and banking employees using the Computer Attitude Scale. Interacting with Computers, 7(2), 181-193.

Page 94: Final 2008

83

Henry, J. W., & Stone, R. W. (1999). The impacts of end user gender, education,

performance, and system use on computer self efficacy and outcome expectancy. Southern Business Review, 25(1), 10-17.

Hilgard, E.R., & Bower, G.H. (1966). Theories of learning. New York: Meredith

Publishing. Hill, J. R., & Hannafin. M. J. (1997). Cognitive strategies and learning from the World

Wide Web. Educational Technology, Research and development, 45(4), 37-65. Huczynski, A.A., & Lewis, J. W. (1980). An empirical study into the learning transfer

process in management training. Journal of Management Studies 17(2), 227-241. Illeris, K. (2003). Workplace learning and learning theory. Journal of Workplace

Learning, 15(4), 167-179. Jacobs, B., Prentice-Dunn, S., & Rogers, R. W. (1984). Understanding persistence: An

interface of control theory and self-efficacy theory. Basic and Applied Social Psychology, 5, 333-347.

Jegede, O., Taplin, M., Fan, R., Chan, M., & Yum, J. (1999). Differences between low

and high achieving distance learners in locus of control and metacognition. Distance Education, 20(2), 255-274.

Jeongkoo, Y. & Shane, T. (2000). Supervisor support in the workplace: Legitimacy and

positive affectivity. The Journal of Social Psychology, 140(3), 295-317. Jiang, J. J., & Klein, G. (2000). Supervisor support and career anchor impact on the

career satisfaction of the entry-level information systems professional. Journal of Management Information Systems, 16(3), 219-230.

Kinzie, M. B. (1990). Requirements and benefits of effective interactive instruction:

Learner control, self regulation, and continuing motivation. Educational Technology Research and Development, 38(1), 1-21.

Kinzie, M. B., & Sullivan, H. J. (1989). Continuing motivation, learner control, and CAI.

Educational Technology Research and Development, 37, 5-14. Kinzie, M. B., Sullivan, H. J., & Berdel, R. L. (1988). Learner control and achievement

in science computer-assisted instruction. Journal of Educational Psychology, 80 (3), 299-308.

Kraiger, K., Ford, J. K., & Salas, E. (1993). Application of cognitive, skill-based, and

affective theories of learning outcomes to new methods of training evaluation [Monograph]. Journal of Applied psychology, 78(2), 311-328.

Page 95: Final 2008

84

Latham, G. P., & Locke, E. A. (1991). Self regulation through goal setting.

Organizational Behavior and Human Decision Processes, 50(2), 212-248. Likert, R. (1961). New patterns of management. New York: McGraw-Hill. Livingston, J. A. (1997). Metacognition: An overview. Retrieved Nov. 18, 2003 from

http://www.gse.buffalo.edu/fas/shuell/cep564/Metacog.htm. Lunts, E. (2002). What does the literature say about the effectiveness of learner control in

computer-assisted instruction? Electronic Journal for the Integration of Technology in Education, 1(2), 59-75.

Mahoney, M.J., (n.d.). What is constructivism and why is it growing? Retrieved August

29, 2004 from: http://www.constructivism123.com/What_Is/What_is_ constructivism.htm

Martocchio, J. J. (1992). Microcomputer usage as an opportunity: The influence of

context in employee training. Personnel Psychology 45(3), 529-553. Martocchio, J. J. (1994). Effects of conceptions of ability on anxiety, self-efficacy, and

learning in training. Journal of Applied Psychology, 79(6), 819-825. Mathieu, J. E., Tannenbaum, S. I., & Salas, E. (1992). Influences of individual and

situational characteristics on measures of training efficacy. Academy of Management Journal, 35(4), 828-847.

Maurer, T. J., Weiss, E. M., & Barbeite, F. G. (2003). A model of involvement in work-

related learning and development activity: The effects of individual, situational, motivational, and age variables. Journal of Applied Psychology, 88(4), 707-724.

Mevarech, Z. R. (1999). Effects of metacognitive training embedded in cooperative

settings on mathematical problem solving. Journal of Educational Research, 94 (4), 195-205.

Mevarech, Z. R., & Kramarski, B. (2003). The effects of metacognitive training versus

worked-out examples on students’ mathematical reasoning. British Journal of Educational Psychology, 73, 449-471.

Milheim, W. D., & Martin, B. L. (1991). Theoretical bases for the use of learner control:

Three different perspectives. Journal of Computer Based Instruction, 18(3), 99-105.

Page 96: Final 2008

85

Morrison, G. R., Ross, S. M., & Baldwin, W. (1992). Learner control of context and instructional support in learning elementary school mathematics. Educational Technology Research and Development, 40(1), 5-13.

Naik, P. (2004). Behaviorism as a theory of personality: A critical look. Retrieved

Aug.18, 2004 from: http://www.personalityresearch.org/papers/naik.html Newton, D., Hase, S., & Ellis, A. (2002). Effective implementation of online learning: a

case study of the Queensland mining industry. Journal of Workplace Learning, 14(4), 156-166.

Pajares, F. (2002). Gender and perceived self efficacy in self regulated learning. Theory

into Practice, 41(2), 116-128. Paris, S. G., & Winograd, P (1990). How Metacognition can promote academic learning

and instruction. In B. F. Jones & L. Idol (Eds.), Dimensions of thinking and cognitive instruction (pp. 185-218). Hillsdale, NJ: Erlbaum.

Perez, G. C., Kester, L., & Van Merrienboer, J. G. J. (n.d.). Adaptation of education and

learner control: A model for personalized task selection. Retrieved August 31, 2004 from: http://www.iwm-kmrc.de/workshops/sim2004/pdf_files/ Corbalan_et_al.pdf.

Pollack, J. C., & Sullivan, H. J. (1990). Practice mode and learner control in computer-

based instruction. Contemporary Educational Psychology, 15, 251-260. Qutami, Y., Abu-Jaber, M., (1997). Students’ self efficacy in computer skills as a

function of gender and cognitive learning style at Sultan Qaboos University. International Journal of Instructional Media, 24(1), 63-75.

RAND Corporation (2004). The future at work: Trends and implications. Retrieved

January 22, 2008 from: www.rand.org/pubs/research_briefs/rb5070/index1.html Relan, A. (1995). Promoting better choices: Effects of strategy training on achievement

and choice behavior in learner-controlled CBI. Journal of Educational Computing Research 13(2), 129-149.

Rhoades, L., & Eisenberger, R. (2002). Perceived organizational support: A review of the

literature. Journal of Applied Psychology, 87(4), 698-714. Rodriquez, R. (2005). Meet the new learning executive. HR Magazine, 50(4), 64-70. Russell, C. G. & Bobko, P. (1992). Moderated Regression Analysis and Likert Scales,

Too Coarse for Comfort. Journal of Applied Psychology, 77(3), 336-342.

Page 97: Final 2008

86

Schacter, J. (1999). The impact of educational technology on student achievement: What the most current research has to say. Milken exchange on Educational Technology, Santa Monica, CA. (ERIC Document Reproduction Service No. ED 430 537).

Schmidt, A. M., & Ford, K. J. (2003). Learning within a learner control training

environment: The interactive effects of goal orientation and metacognitive instruction on learning outcomes. Personnel Psychology, 56(2), 405-420.

Schroeder, E. (1994, August 29). Training takes off, using multimedia. PC Week, p.33. Semple, A. (2000). Learning theories and their influence on the development and use of

educational technologies. Australian Science Teachers Journal, 46(3), 21-28. Shore, L. M., & Shore, T. H. (1995). Perceived organizational support and organizational

justice. In R. S. Cropanzano & K. M. Kacmar (Eds.), Organizational politics, justice, and support: Managing the social climate of the workplace (pp. 149-164). Westport, Ct: Quorum.

Skinner, B. F. (1968). The technology of teaching. New York: Prentice Hall. Skinner, B. F. (1969). Contingencies of reinforcement: A theoretical analysis. New York:

Prentice Hall. Sobol, M.E. (1982). Asymptotic intervals for indirect effects in structural equation

models. In S. Leinhart (Ed.), Sociological Methodology 1982 (pp. 290-312). San Francisco: Jossey-Bass.

SPSS (2004). Frequently asked questions. Retrieved Oct. 1, 2004 from: http://www.ats.

ucla.edu/stat/spss/faq/ alpha.html Stajkovic, A. D., & Luthans, F. (1997). A meta-analysis of the effects of organizational

behavior modification on task performance, 1975-95. Academy of Management Journal, 40 (5), 1122-1149.

Stinglhamber, F., & Vandenberghe, C. (2003). Organizations and supervisors as sources

of support and targets of commitment: a longitudinal study. Journal of Organizational Behavior, 24, 251-270.

Tannenbaum, S. I., & Yuki, G. (1992). Training and development in work organizations.

Annual Review of Psychology, 43, 339-441. Tharenou, P. (2001). The relationship of training motivation to participation in training

and development. Journal of Occupational & Organizational Psychology 74(5), 599-622.

Page 98: Final 2008

87

The New Economy Index (n.d.). Corporate expenditures on training have slightly declined. Retrieved August 31, 2004 from: http://www.neweconomyindex .org/section3_page18.html

Vince, R. (1998). Behind and beyond Kolb’s learning cycle. Journal of Management

Education, 22(3), 304-319. Vroom, V. H. (1964). Work and motivation. New York: Wiley. Warr, P., & Bunce, D. (1995). Trainee characteristics and the outcomes of open learning.

Personnel Psychology, 48(2), 347-378. Watson, J. B. (n.d.). The effect of metacognitive cues and probes on use of learner

control features in an on-line lesson for elementary students. Retrieved September 1, 2004 from: http://www.pdkintl.org/edres/ddwind2.htm.

Weinert, F. E., & Kluwe, R. H. (Eds.) (1987). Metacognition, motivation, and

understanding. New Jersey: Lawrence Erlbaum Associates. Wood, R., & Bandura, A. (1989a). Social cognitive theory of organizational

management. Academy of Management Review, 14(3), 361-384. Wood, R., & Bandura, A. (1989b). Impact of conceptions of ability on self-regulatory

mechanisms and complex decision making. Journal of Personality and Social Psychology, 56(3), 407-415.

Zimmerman, B. J., & Martinez-Pons, M., (1988). Construct validation of a strategy

model of student self regulated learning. Journal of Educational Psychology, 80 (3), 284-290.

Page 99: Final 2008

88

Appendix A: Demographic Survey

You are asked to participate in a research study conducted by James V. Polizzi, a Ph.D.

candidate at Touro University International. You were selected as a possible participant

in this study because you are utilizing the Virtual Leader© leadership training computer

program.

Your participation in this survey is voluntary and completely anonymous.

Participation in the survey is simple. In the envelope provided, you will find two short

questionnaires. Please complete PART A before you begin the Virtual Leader ©

program.

When you have completed the Virtual Leader © program, please complete PART B.

Please return all materials to the coordinator.

First, three questions for classification purposes.

Gender: Female Male

What is your age_______________?

Are you:

White ___ Black ___ Hispanic, Latino, of Spanish Origin ___ American Indian, Eskimo, Aleut ___ Asian or Pacific Islander ___ Other ___ Don't know ___ Refused ___ Now, please complete PART A. Thank you for your participation and good luck.

Page 100: Final 2008

89

Appendix B: Learner Control Self Efficacy Scale

1. I can meet the challenges of this training

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

2. I am confident in my understanding of how information cues are related to learning

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

3. I can deal with training under ambiguous conditions

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

4. I am certain that I can manage the requirements of this training

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

5. I believe I will fare well in this training as the complexity increases

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

6. I am confident I can cope with learning in the absence of an

instructor

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

7. I believe I can develop methods to handle changing aspects of this

training

Page 101: Final 2008

90

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

Page 102: Final 2008

91

Appendix C: Computer Self-Efficacy Scale

1. I feel confident working on a personal computer

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

2. I feel confident getting software up and running

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

3. I feel confident logging onto the Internet

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

4. I feel confident accessing information on the Internet

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

5. I feel confident using the User’s guide when help is needed

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

6. I feel confident entering or saving data (numbers or words) into a file

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

7. I feel confident escaping/exiting from the program/software

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

8. I feel confident logging off the mainframe computer system

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

9. I feel confident calling up a data file to view on the monitor screen

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

Page 103: Final 2008

92

10. I feel confident understanding terms/words relating to computer hardware

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

11. I feel confident understanding terms/words related to computer software

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

12. I feel confident handling a floppy disk correctly

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

13. I feel confident learning to use a variety of programs (software)

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

14. I feel confident learning advanced skills within a specific program

(software)

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

15. I feel confident making selections from an on-screen menu

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

16. I feel confident using computers to analyze number data

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

17. I feel confident using a printer to make a “hard copy” of my work

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

18. I feel confident copying a disk

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

Page 104: Final 2008

93

19. I feel confident copying an individual file

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

20. I feel confident copying and deleting information from a data file.

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

21. I feel confident moving the cursor around the monitor screen

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

22. I feel confident writing simple programs for the computer

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

23. I feel confident using the computer to write a letter or essay

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

24. I feel confident describing the function of computer hardware (keyboard, monitor, disk drives, and computer processing unit) Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

25. I feel confident understanding the three stages of data processing: input, processing, and output Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

26. I feel confident getting help for problems in the computer system Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

27. I feel confident storing software correctly

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

Page 105: Final 2008

94

28. I feel confident explaining why a program (software) will or will not run correctly on a given computer Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

29. I feel confident using a computer to organize information

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

30. I feel confident getting rid of files when they are no longer needed

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

31. I feel confident organizing and managing files

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

32. I feel confident troubleshooting computer problems

Very Little Confidence Some Confidence Quite a Lot of Confidence

1 2 3 4 5

Page 106: Final 2008

95

Appendix D: Supervisory Support Scale

1. My supervisor takes time to learn about my career goals and

aspirations

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

2. My supervisor cares about whether or not I achieve my career

goals

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

3. My supervisor keeps me informed about training opportunities in

the organization

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

4. My supervisor is supportive of my efforts to acquire new

knowledge and skills

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

Page 107: Final 2008

96

Appendix E: Metacognitive Activity Scale

1. I revised my tactics for learning the material to deal with the different complexity levels of the material

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

2. While engaged in the training, I monitored how well I was learning the material

Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

3. As I practiced the material, I evaluated how well I was learning the material Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

4. When my methods were not successful, I experimented with different procedures for learning the material Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

5. As I practiced applying my learning, I changed how I approached learning the material Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

6. I tried to monitor closely the areas where I needed the most practice Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

Page 108: Final 2008

97

7. I noticed where I made mistakes during practice and focused on improving those areas Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

8. I used my performance on the previous section to revise how I would approach learning the next section Strongly disagree Neither agree nor disagree Strongly agree 1 2 3 4 5

Page 109: Final 2008

98

Appendix F: Full Regression Results for Path Models

Table A5.1

Regression Results for Research Questions 1 and 2

B SEB β t p Supervisory Support as a Predictor of Computer Self-Efficacy (R2 = .02, Adjusted R2 = .01, F(1, 118) = 2.11, p = .149) Constant 122.18 5.95 20.52 < .001 Supervisory Support .62 .43 .13 1.45 .149 Supervisory Support as a Predictor of Learner Control Self-Efficacy (R2 = .05, Adjusted R2 = .04, F(1, 118) = 6.06, p = .015) Constant 22.69 1.43 15.89 < .001 Supervisory Support .25 .10 .22 2.46 .015 Computer Self-Efficacy and Learner Control Self-Efficacy as Predictors of Metacognitive Activity (R2 = .13, Adjusted R2 = .11, F(1, 118) = 8.66, p < .001) Constant 21.23 3.07 6.92 < .001 Computer Self-Efficacy .03 .02 .13 1.31 .194 Learner Control Self-Efficacy .29 .10 .28 2.82 .006

Page 110: Final 2008

99

Table A5.2

Regression Results for Research Question 3 for Males

B SEB β t p Supervisory Support as a Predictor of Computer Self-Efficacy (R2 = .05, Adjusted R2 = .04, F(1, 78) = 4.38, p = .040) Constant 119.02 6.60 18.02 < .001 Supervisory Support 1.03 .49 .23 2.09 .040 Supervisory Support as a Predictor of Learner Control Self-Efficacy (R2 = .05, Adjusted R2 = .04, F(1, 78) = 5.19, p = .044) Constant 22.73 1.57 14.44 < .001 Supervisory Support .24 .12 .22 2.05 .044 Computer Self-Efficacy and Learner Control Self-Efficacy as Predictors of Metacognitive Activity (R2 = .10, Adjusted R2 = .08, F(1, 78) = 4.44, p = .015) Constant 21.85 3.84 5.69 < .001 Computer Self-Efficacy .06 .04 .24 1.59 .116 Learner Control Self-Efficacy .12 .16 .12 .77 .442

Page 111: Final 2008

100

Table A5.3

Regression Results for Research Question 3 for Females

B SEB β t p Supervisory Support as a Predictor of Computer Self-Efficacy (R2 = .00, Adjusted R2 = .00, F(1, 38) = .05, p = .829) Constant 124.25 12.82 9.69 < .001 Supervisory Support .19 .87 .04 .22 .829 Supervisory Support as a Predictor of Learner Control Self-Efficacy (R2 = .03, Adjusted R2 = .01, F(1, 38) = 1.26, p = .269) Constant 23.02 3.27 7.04 < .001 Supervisory Support .25 .22 .18 1.12 .269 Computer Self-Efficacy and Learner Control Self-Efficacy as Predictors of Metacognitive Activity (R2 = .23, Adjusted R2 = .20, F(2, 37) = 5.82, p = .006) Constant 19.33 5.17 3.74 <.001 Computer Self-Efficacy .01 .04 .05 .32 .748 Learner Control Self-Efficacy .45 .14 .48 3.23 .003

Page 112: Final 2008

101

Table A5.4

Regression Results for Research Question 4 for Younger Individuals

B SEB Β t p Supervisory Support as a Predictor of Computer Self-Efficacy (R2 = .01, Adjusted R2 = .00, F(1, 60) = .47, p = .494) Constant 127.80 8.30 15.39 < .001 Supervisory Support .41 .60 .09 .69 .494 Supervisory Support as a Predictor of Learner Control Self-Efficacy (R2 = .09, Adjusted R2 = .07, F(1, 60) = 5.80, p = .019) Constant 22.02 1.94 11.34 < .001 Supervisory Support .34 .14 .30 2.41 .019 Computer Self-Efficacy and Learner Control Self-Efficacy as Predictors of Metacognitive Activity (R2 = .10, Adjusted R2 = .08, F(2, 59) = 4.87, p = .011) Constant 21.03 4.14 5.08 < .001 Computer Self-Efficacy .03 .04 .12 .70 .489 Learner Control Self-Efficacy .30 .17 .29 1.74 .043

Page 113: Final 2008

102

Table A5.5

Regression Results for Research Question 4 for Older Respondents

B SEB β t p Supervisory Support as a Predictor of Computer Self-Efficacy (R2 = .04, Adjusted R2 = .02, F(1, 56) = 2.14, p = .149) Constant 115.73 8.39 13.80 < .001 Supervisory Support .88 .60 .19 1.46 .149 Supervisory Support as a Predictor of Learner Control Self-Efficacy (R2 = .02, Adjusted R2 = .01, F(1, 56) = 1.37, p = .248) Constant 23.24 2.09 11.10 < .001 Supervisory Support .17 .15 .15 1.17 .248 Computer Self-Efficacy and Learner Control Self-Efficacy as Predictors of Metacognitive Activity (R2 = .12, Adjusted R2 = .10, F(2, 55) = 4.42, p = .017) Constant 19.78 4.83 4.10 < .001 Computer Self-Efficacy .04 .03 .17 1.31 .197 Learner Control Self-Efficacy .31 .14 .29 2.24 .029

Page 114: Final 2008

103

Table A5.6

Regression Results for Research Question 5

B SEB β t p Computer Self-Efficacy as a Predictor of Learner Control Self-Efficacy (R2 = .24, Adjusted R2 = .23, F(1, 118) = 36.51, p < .001) Constant 10.62 2.58 4.12 < .001 Computer Self-Efficacy .12 .02 .49 6.04 < .001 Learner Control Self-Efficacy as a Predictor of Metacognitive Activity (R2 = .12, Adjusted R2 = .11, F(1, 118) = 15.52, p < .001) Constant 23.80 2.37 10.04 < .001 Learner Control Self-Efficacy .35 .09 .34 3.94 < .001