BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016 BUAD ASSESSMENT RESULTS 2015 / 2016 ACADEMIC YEAR
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
BUAD ASSESSMENT RESULTS
2015 / 2016 ACADEMIC YEAR
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
I ASSESSMENT CONTENT
ASSESSMENT AREA WHAT IS DONE 1 Oral Rubric BUAD348: applies the rubric to a presentation assignment during the semester
BUAD499: applies the rubric to the policy project presentation at the end of the semester
2 Capstone Project Ratings - Oral Communications BUAD 499 Business Policy Project Presentation Evaluation Form
3 Capstone Project Ratings - Critical Thinking BUAD 499 Business Policy Project Presentation Evaluation Form
4 Critical Thinking - Ratio Analysis Problem BUAD 225 Accounting II o Ratio analysis problem to test critical thinking skills. BUAD342 Corporate Finance o Cost of capital problem
5 MFT - Legal & Social Environment Administered week after break – Fall / Spring
6 Ethics Project in Marketing BUAD 233 Marketing Management - Ethics project
7 MFT - Economics & International Issues Administered week after break – Fall / Spring
8 Capstone Project Ratings - Entry Decision & Analytical Tools
BUAD 499 Business Policy Project Presentation Evaluation Form
9 Global Test Questions in POM BUAD348 Production & Operations Mgmnt - Global supply chain case analysis
10 Internships Supervisor Assessment at the end of the assignment Internship director assessment at the end of the assignment
11 Capstone Project Ratings - Accounting & Finance BUAD 499 Business Policy Project Presentation Evaluation Form
12 Capstone Project Ratings - Marketing BUAD 499 Business Policy Project Presentation Evaluation Form
13 Capstone Project Ratings - Management BUAD 499 Business Policy Project Presentation Evaluation Form
14 Capstone Project Ratings - Management Science BUAD 499 Business Policy Project Presentation Evaluation Form
15 Capstone Project Ratings - Information & Systems BUAD 499 Business Policy Project Presentation Evaluation Form
16 MFT - Accounting & Finance Administered week after break – Fall / Spring 17 MFT - Marketing Administered week after break – Fall / Spring 18 MFT - Management Administered week after break – Fall / Spring 19 MFT - Management Science Administered week after break – Fall / Spring 20 MFT - Information Systems Administered week after break – Fall / Spring 21 Embedded Exam Questions - Accounting & Finance BUAD 215 Accounting I – 20 questions on final exam
BUAD 225 Accounting II – 15 questions in individual topic exams BUAD 342 Corporate Finance Assessment Questions
22 Embedded Exam Questions - Marketing BUAD233 Marketing Management - 10 questions on final exam
23 Embedded Exam Questions - Management BUAD254 Org. Behavior - 11 questions on final exam BUAD499 - 5 questions on final exam
24 Embedded Exam Questions - Management Science BUAD348 Production Operations – 20 Assessment Questions BUAD248 Quantitative Methods – 20 Assessment Questions
25 Embedded Exam Questions - Information Systems BUAD258 Information Systems I – 10 questions on final exam
26 Written Rubric BUAD254: applies the rubric to a written assignment during the semester BUAD499: applies the rubric to the policy project presentation at the end of the semester
27 Capstone Project Ratings - Written Communications BUAD 499 Business Policy Project Presentation Evaluation Form
28 Senior Survey Senior survey is administered to all seniors when they take BUAD499 policy.
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
II PROCESS
WHAT WHEN OWNER
1 The faculty is reminded that individual assessment programs are to be executed. This is placed on department meeting agenda’s and discussed at the meeting
Prior to the end of each semester
Assessment coordinator
2 Embedded testing: Each individual faculty member conducts the testing in their classroom using the designated materials established for the particular course and it’s measurements
Final exam or mid course assignments
Faculty
3 Embedded testing: Each faculty member provides the collected test data to the assessment coordinator
Following administering
Faculty
4 MFT testing is conducted – target is the week after Fall and Spring break
Week after college break – Fall / Spring
Assessment coordinator
5 Policy presentations are made and rating sheets are completed by reviewers (internal / external) and provided to the assessment coordinator
Last week of classes
K Baker
6 Graduating student survey results are provided (taken by all graduating seniors)
End of semester report
Statistical coordinator
7 Internship data is provided End of semester Internship coordinator
8 The received data is entered to the master tracking spreadsheet
End of semester Assessment coordinator
9 The data is entered to WEAVE which is the college system for assessment data collection
Mid June (as directed)
Assessment coordinator
10 Any faculty whose data does not meet the standards are assigned to establish a plan of action to be implemented.
Mid June – as part of assessment report
Department Chair Assessment coordinator
11 A report is generated for the year end results – Prior to start of next semester
Target September of academic year
Assessment coordinator
12 The report is attached to the WEAVE system for record retention
Target September of academic year
Assessment coordinator
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
III LEARNING OUTCOMES AND MEASURES
ORAL COMMUNICATIONS
Oral rubric o BUAD348 Production & Operations Management o BUAD499 Business Policy
Site Supervisor – Internship
Capstone Project presentation rating – oral presentation
WRITTEN COMMUNICATIONS
Written rubric o BUAD254 Organizational Behavior o BUAD499 Business Policy
Site Supervisor – Internship
Capstone Project presentation rating – Written skill
EXTERNAL / GLOBAL FORCES
Test questions o BUAD348 Production & Operations Management
CRITICAL THINKING
Ratio analysis problem o BUAD225 Accounting II
Cost of Capital problem o BUAD342 Corporate Finance
Site supervisor – Internship
Capstone Project presentation rating – Critical thinking
ETHICAL REASONING
Ethics problem o BUAD233 Marketing Management
Site supervisor – Internship
MFT sections o Legal & social issues
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
ACCOUNTING & FINANCE
Embedded questions – final exam o Buad215 Accounting I o BUAD225 Accounting II o BUAD342 Corporate Finance
MFT sections o Accounting & finance
Capstone project rating – accounting & finance
MARKETING
Embedded questions – final exam o Buad233 Marketing Management
MFT sections o Marketing
Capstone project rating - marketing
MANAGEMENT
Embedded questions – final exam o BUAD254 Organizational Behavior o BUAD499 Business Policy
MFT sections o Management
Capstone project rating - Management
MANAGEMENT SCIENCE
Embedded questions – final exam o BUAD248 Quantitative Methods o BUAD348 Production & Operations Management
MFT sections o Management Science
Capstone project rating – Management Science
INFORMATION SYSTEMS
Embedded questions – final exam o BUAD258 Information Systems I
MFT sections o Information Systems
Capstone project rating – Information systems
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
IV RESULTS / STATUS / ACTION
Areas needing attention
ASSESSMENT AREA Area not meeting goals 1 Oral Rubric
2 Capstone Project Ratings - Oral Communications
3 Capstone Project Ratings - Critical Thinking Monitor – 78% vs goal of 80%
4 Critical Thinking - Ratio Analysis Problem; Cost of Capital
Need to look at the cost of capital problem in BUAD342
5 MFT - Legal & Social Environment
6 Ethics Project in Marketing
7 MFT - Economics & International Issues
8 Capstone Project Ratings - Entry Decision & Analytical Tools
9 Global Test Questions in POM
10 Internships
11 Capstone Project Ratings - Accounting & Finance Monitor – 78% vs goal of 80%
12 Capstone Project Ratings - Marketing
13 Capstone Project Ratings - Management
14 Capstone Project Ratings - Management Science Monitor – 78% vs goal of 80%
15 Capstone Project Ratings - Information & Systems
16 MFT - Accounting & Finance 17 MFT - Marketing 18 MFT - Management 19 MFT - Management Science 20 MFT - Information Systems 21 Embedded Exam Questions - Accounting & Finance All are below target – need to address in AY 2015/2016
22 Embedded Exam Questions - Marketing
23 Embedded Exam Questions - Management Below target – need to address in AY 2015/2016
24 Embedded Exam Questions - Management Science Below target in BUAD248 – need to address in AY 2015/2016
25 Embedded Exam Questions - Information Systems
26 Written Rubric Below target in BUAD254 – need to address in AY 2015/2016
27 Capstone Project Ratings - Written Communications
28 Senior Survey Senior survey is administered to all seniors when they take BUAD499 policy.
Item 1 – Oral Rubric BUAD348
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
Oral Rubric BUAD348
BUAD258 BUAD348 BUAD348 BUAD348 BUAD348
70% of students will achieve a 3 or better on each component of the oral communications rubric in BUAD 348 (Productions
Eye contact 64% 40% 82% 95% 82%
Mannerisms 51% 51% 91% 96% 91%
Verbal Skills 44% 67% 97% 95% 95%
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
Operations Management) and 80% in BUAD 499 (Business Policy)
Tone 45% 72% 95% 94% 95%
Business attire 55% 78% 91% 94% 89%
Subject knowledge 65% 78% 92% 92% 100%
Consistency & organization 59% 85% 97% 95% 99%
Mechanics 50% 99% 100% 89% 96%
Quality of Slides 71% 90% 99% 80% 98%
Visual Aids/Handouts 62% n/a n/a n/a n/a
COMMENT: No new plans. Evaluation against the rubric is done using a current event written
/ oral presentation project which has been continuously improved upon. The results are
positive. Students present well and continually improve.
Item 1 – Oral Rubric BUAD499
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
Oral Rubric - BUAD499
BUAD499
J Lyon data
BUAD499 J Lyon data
BUAD499 BUAD499 BUAD499
70% of students will achieve a 3 or better on each component of the oral communications rubric in BUAD 348 (Productions Operations Management) and 80% in BUAD 499 (Business Policy)
Eye contact 97% 89% 93% 94% 96%
Mannerisms 95% 90% 95% 92% 93%
Verbal Skills 99% 94% 95% 94% 93%
Tone 94% 99% 97% 96% 96%
Business attire 100% 95% 100% 100% 94%
Subject knowledge
93% 95% 100% 99% 99%
Consistency & organization
95% 98% 99% 99% 99%
Mechanics 96% 99% 100% 96% 89%
Quality of Slides 100% 98% 99% 97% 97%
Visual Aids/Handouts
82% 95% 99% 99% 98%
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
COMMENT: No new plans. Evaluation against the departmental rubric and results are all positive.
Students present well and continually improve.
Item 2 – Capstone Communications
Capstone Project Ratings - Oral
Communications
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
BUAD499 BUAD499 BUAD499 BUAD499 BUAD499
89%
Oral Communication
At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.
95% 81% 100% 87% XIV - Handling
questions
100% 94% 100% 100% XV - Oral
Communication
COMMENT: We have made changes in the evaluation process. Student group projects are
observed by the course professor, a group of faculty, and non-faculty outside participants. We
have struggled to produce a score that took into account the variety of observers and their
knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in
Spring 2016, the course professor has taken the observer inputs and produced one composite
score that will be the one used for evaluation. Results exceed the target and no changes are
planned.
Item 3 – Capstone Critical Thinking
Capstone Project Ratings - Critical Thinking
2011-2012 2012-2013 2013-2014 2014-2015 2015-2016
At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.
85% 88% 94% 87% 78%
COMMENT: We have made changes in the evaluation process. Student group projects are
observed by the course professor, a group of faculty, and non-faculty outside participants. We
have struggled to produce a score that took into account the variety of observers and their
knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in
Spring 2016, the course professor has taken the observer inputs and produced one composite
score that will be the one used for evaluation. Results are slightly below the target and we will
monitor the situation going forward.
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
Item 4 – Critical Thinking (Ratio Analysis / Cost of Capital)
Critical Thinking 2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions 71% 86% 78% 76% 81%
Ratio Analysis - Accounti
ng II
85% 86% 60%
BUAD342 Corporate Finance –
Cost of capital / capital
budgeting problems
COMMENT: Results for Ratio analysis in BUAD225 are on track and will not be changed. In
BUAD342 a new faculty member has joined the department and some corrective measures will
be addressed in AY 2016/2017
Item 5 – MFT Legal & Social Environment
MFT - LEGAL & SOCIAL 2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
MFT MFT MFT MFT MFT
70% of students will be within 1 standard deviation of national level
Legal & social
69% 67% 64% 82% 88%
COMMENT: Results in 2011 – 2014 were close to goal. Subsequent results showed the
benefits of our overall effort to improve the MFT process. No changes to the process are
planned.
Item 6 – Ethics in Marketing
Ethics in Marketing 2011-2012 2012-2013 2013-2014 2014-2015 2015-2016
At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions
71% 86% 96% 84% 97%
COMMENT: Goals are continuously met. In 2015/2016 the case has been upgraded and
refreshed to maintain relevance to today’s marketing environment. No changes to the process
are planned.
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
Item 7 – MFT Economics & International
MFT - Economics & International 2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
MFT MFT MFT MFT MFT
70% of students will be within 1 standard deviation of national level
Economics 54% 62% 49% 72% 82%
International 69% 57% 41% 55% 79%
COMMENT: Results in 2011 – 2014 were close to goal. Subsequent results showed the
benefits of our overall effort to improve the MFT process. No changes to the process are
planned.
Item 8 – Capstone – Entry Decision
Capstone Project Ratings - Oral Communications
2011-2012 2012-2013 2013-2014 2014 - 2015
2015 - 2016
BUAD499 BUAD499 BUAD499 BUAD499 BUAD499
At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.
75% 88% 94% 93% 89%
COMMENT: We have made changes in the evaluation process. Student group projects are
observed by the course professor, a group of faculty, and non-faculty outside participants. We
have struggled to produce a score that took into account the variety of observers and their
knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in
Spring 2016, the course professor has taken the observer inputs and produced one composite
score that will be the one used for evaluation. Results exceed the target and no changes are
planned.
Item 9 – Global Productions & Operations
Global questions in POM 2011-2012 2012-2013 2013-2014 2014-2015 2015-2016
At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions
95% 85% 72% 93% 72%
COMMENT: Results are meeting the goals. No changes planned
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
Item 10 – Internship
2011-2012 2012-2013 2013-2014 2014-2015 2014-2015 Internship Internship Internship Internship Internship Internship
Goal: 80% of students above average; 80% of sites above average. Average = 75%
97% 92% 87% 96% 86%
95% 92% 91% 93% 87%
Percent of students graduating with an internship
47% 44% 56% 42% 44%
COMMENT: Data was not collected in 2015/2016 due to the director being on sabbatical
Item 11 – Capstone – Accounting & Finance
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
Capstone Project Ratings - Accounting & Finance
78%
Accounting & Finance
At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.
48% 69% 69% 87% V -
Accounting
58% 75% 56% 87% VII - Finance
COMMENT: We have made changes in the evaluation process. Student group projects are
observed by the course professor, a group of faculty, and non-faculty outside participants. We
have struggled to produce a score that took into account the variety of observers and their
knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in
Spring 2016, the course professor has taken the observer inputs and produced one composite
score that will be the one used for evaluation. Results are slightly below the target and this
measurement will be monitored in the future.
Item 12 – Capstone – Marketing
2011-2012 2012-2013 2013-2014 2014-2015 2015-2016
Capstone Project Ratings - Marketing
At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.
80% 81% 75% 80% 83%
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
COMMENT: We have made changes in the evaluation process. Student group projects are
observed by the course professor, a group of faculty, and non-faculty outside participants. We
have struggled to produce a score that took into account the variety of observers and their
knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in
Spring 2016, the course professor has taken the observer inputs and produced one composite
score that will be the one used for evaluation. Results exceed the target and no changes are
planned.
Item 13 – Capstone – Management
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
Capstone Project Ratings - Management
89%
Management
At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.
74% 88% 94% 67%
IX - Human Resource
80% 94% 94% 93% II - Mission Statement
80% 94% 88% 73% IV - Core Competencies
COMMENT: We have made changes in the evaluation process. Student group projects are
observed by the course professor, a group of faculty, and non-faculty outside participants. We
have struggled to produce a score that took into account the variety of observers and their
knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in
Spring 2016, the course professor has taken the observer inputs and produced one composite
score that will be the one used for evaluation. Results exceed the target and no changes are
planned.
Item 14 – Capstone – Management Science
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
Capstone Project Ratings - Management Science
78%
At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.
85% 81% 94% 73%
COMMENT: We have made changes in the evaluation process. Student group projects are
observed by the course professor, a group of faculty, and non-faculty outside participants. We
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
have struggled to produce a score that took into account the variety of observers and their
knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in
Spring 2016, the course professor has taken the observer inputs and produced one composite
score that will be the one used for evaluation. Results are slightly below the target and will be
monitored in the future
Item 15 – Capstone – Information Systems
2011-2012 2012-2013 2013-2014 2014-2015 2015-2016
Capstone Project Ratings - Information Systems
At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.
64% 75% 88% 93% 89%
COMMENT: We have made changes in the evaluation process. Student group projects are
observed by the course professor, a group of faculty, and non-faculty outside participants. We
have struggled to produce a score that took into account the variety of observers and their
knowledge base. Due to the many variables, we feel the scoring is not informative. Starting in
Spring 2016, the course professor has taken the observer inputs and produced one composite
score that will be the one used for evaluation. Results exceed the target and no changes are
planned.
Item 16 – MFT – Accounting & Finance
MFT - Accounting & Finance 2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
MFT MFT MFT MFT MFT
70% of students will be within 1 standard deviation of national level
Accounting 61% 64% 65% 79% 85%
Finance 60% 70% 83% 85% 90%
COMMENT: Results in 2011 – 2014 were close to or met the goal. Subsequent results show
the benefits of our overall effort to improve the MFT process. This will continue.
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
Item 17 – MFT – Marketing
MFT – Marketing
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
MFT MFT MFT MFT MFT
70% of students will be within 1 standard deviation of national level
Marketing 77% 69% 69% 79% 86%
COMMENT: Results in 2011 – 2014 were close to or met the goal. Subsequent results show
the benefits of our overall effort to improve the MFT process. This will continue.
Item 18 – MFT – Management
MFT - MANAGEMENT 2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
MFT MFT MFT MFT MFT
70% of students will be within 1 standard deviation of national level
Management 83% 76% 77% 87% 97%
COMMENT: Results consistently meet goals. No changes are planned
Item 19 – MFT – Management Science
MFT - MANAGEMENT SCIENCE 2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
MFT MFT MFT MFT MFT
70% of students will be within 1 standard deviation of national level
Management 46% 49% 56% 87% 91%
COMMENT: Results in 2011 – 2014 were close to or met the goal. Subsequent results show
the benefits of our overall effort to improve the MFT process. This will continue.
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
Item 20 – MFT – Information Systems
MFT - INFORMATION SYSTEMS 2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
MFT MFT MFT MFT MFT
70% of students will be within 1 standard deviation of national level
Information Systems 52% 57% 72% 65% 73%
COMMENT: Results in 2011 – 2014 were close to or met the goal. Subsequent results show
the benefits of our overall effort to improve the MFT process. This will continue.
Item 21 – Embedded Questions in Accounting & Finance
EMBEDDED QUESTIONS 2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
ACCOUNTING & FINANCE
At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions
58% 65% 72.0% 72.0% 58.6% Embedded Questions - Accounting I
58% 65% 65.8% 100.0% 58.9% Embedded Questions -
Accounting II
40% 76% 54% 67.2% 66.0% Embedded Questions -
Corporate Finance
COMMENT: Accounting & finance faculty are working to address the questions used and
making efforts to improve results by looking at teaching practices and measurements. One
significant item was that a faculty member was suddenly on medical leave and teaching was
distributed to other faculty members causing some level of ineffectiveness
Item 22 – Embedded Questions in Marketing
Embedded questions - Marketing 2011-2012 2012-2013 2013-2014 2014-2015 2015-2016
At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions 37% 59% 83% 76% 90%
COMMENT: Marketing faculty have addressed shortcomings and results are now meeting
goals
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
Item 23 – Embedded Questions in Management
Embedded Questions – Management – BUAD254
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions
60% 64% 57% 66% 67%
COMMENT: Organizational Behavior faculty are addressing shortcomings. A new Tenure
track faculty member has been hired and is facing this issue with strong efforts to make
changes in the methods and teaching practices.
Embedded Questions – Management – BUAD499
2011-2012 2012-2013 2013-2014 2014-2015 2015-2016
At least 80% of our students will be competent as defined by a score of 70 or better on embedded questions 81% 86% 92% 81% 92%
COMMENT: No action needed
Item 24 – Embedded Questions in Management Science
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
Embedded Questions – Management Science
At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions
BUAD248 61% 69% 79% 91% 55%
BUAD348 87% 94% 87% 80% 82%
COMMENT: BUAD248 has been redeveloped and is still in it’s initial stages of development.
Faculty teaching this course will be working to address the shortcomings.
Item 25 – Embedded Questions in Information Systems
2011-2012 2012-2013 2013-2014 2014-2015 2015-2016
Embedded Questions - Information Systems
At least 70% of our students will be competent as defined by a score of 70 or better on embedded questions
92% 89% 90.0% 90.7% 84.3%
COMMENT: Goals are met. No action needed
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
Item 26 – Written Rubric – Organizational Behavior
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
Written Rubric BUAD254 BUAD254 BUAD254 BUAD254 BUAD254
70% of students will achieve a 3 or better on each component of the oral communications rubric in BUAD 254 (Organizational Behavior) and 80% in BUAD 499 (Business Policy)
73% 71% 76% 78% 73% Material
71% 63% 79% 75% 64% Reasoning
66% 77% 68% 69% 61% Evidence
57% 60% 69% 80% 81% Organization
56% 63% 80% 69% 68% Style
COMMENT: Organizational Behavior faculty are addressing shortcomings. A new Tenure
track faculty member has been hired and is facing this issue with strong efforts to make
changes in the methods and teaching practices.
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
Written Rubric BUAD499 BUAD499 BUAD499 BUAD499 BUAD499
70% of students will achieve a 3 or better on each component of the oral communications rubric in BUAD 254 (Organizational Behavior) and 80% in BUAD 499 (Business Policy)
96% 87% 100% 100% 89% Material
96% 93% 94% 100% 89% Reasoning
100% 87% 88% 100% 89% Evidence
100% 93% 81% 100% 89% Organization
100% 87% 75% 100% 89% Style
COMMENT: No action needed
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
Item 27 – Capstone – Written communications
COMMENT: No action needed
Item 28 – Senior Survey
Senior survey 2009 - 2010
2010 - 2011
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
The majority of students should be satisfied with our program and its offerings. (Somewhat satisfied, satisfied, very satisfied)
99% 98% 99% 94% 96% 97% 99%
COMMENT: No action needed
2011-2012
2012-2013
2013-2014
2014-2015
2015-2016
Capstone Project Ratings - Written Communications
BUAD499 BUAD499 BUAD499 BUAD499 BUAD499
89% Written Communication
At least 80% of our students will be competent. Competency is defined as a score of at least 3.5 or higher.
95% 88% 88% 80% XVI - Written
communication
95% 94% 100% 93% XIII -
Presentation
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
V MAJOR FIELD TEST - The ETS® Major Field Tests are comprehensive undergraduate
and MBA outcomes assessments designed to measure the critical knowledge and
understanding obtained by students in a major field of study. The Major Field Tests go beyond
the measurement of factual knowledge by helping you evaluate your students' ability to analyze
and solve problems, understand relationships and interpret material from their major field of
study.
The following charts show the status and progress over several years. In Spring 2014 we felt
that the program needed attention and steps were taken to
1- Create study guides to be used for material refreshing
2 – Raise the level of reward (grade) for test score
3 – Change student culture regarding the test and the importance of doing well even
though they were graduating seniors
The results in 2016 show sustained improvement
The score of 161.49 in Fall 2015 puts our program in the top 25% of 442 comparison
schools
150.33 150.20
147.69
156.76
148.22
153.71 153.60
150.97
155.18157.03
161.49
159.41
153.39
140.00
145.00
150.00
155.00
160.00
165.00
RC data - MFT mean score variation
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
9
24
35
60
8695
81
42 45
22
116
2 1
<130 135 140 145 150 155 160 165 170 175 180 185 190 195
BUAD499 Student CountMFT Total
Fall 2010 thru Spring 2016
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
VI ACBSP
Feb 15, 2015 Issued the required QA report to ACBSP
June 19, 2015 Received ACBSP feedback report
Feedback:
Remove Condition on 3.2. Remove Note on Criterion 5.7.2. from 2013
Maintain Note on Criterion 5.3: Information for two faculty members was either incomplete or unclear. These portfolios (see Appendix B of the Standards and Criteria) should be submitted to ACBSP to establish that the faculty members are qualified to teach the courses to which they are assigned.
Opportunity for Improvement on O9: Although up-to-date data are presented in the evidence file of the Campus Labs Report, Roanoke's web site presents a link which leads to 2010-2012 data. Please update the web site with current information.
Place a Condition on Standard 4: The business unit must have a learning outcomes assessment program with learning objectives for each program, a minimum of three successive sets of periodic assessment results to identify trends, comparisons with similar programs, and evidence that it is analyzing and using the results to improve educational processes and student learning. This means
All concentrations must be assessed as a program - Need measures of outcomes for each concentration
- Report – 2/15/2017
- Clear – 4/20/ 2019
VII SACS
Reported through academic year 2015/2016
Reflecting on assessment this year, what does the data reveal about student
learning in the program?
The data shows
o Student performance is stable in most areas of evaluation o Some areas of deficiency still require attention to meet goals o The results of effort to improve the MFT score has been sustained through
Increased student effort to score well Development and availability to students of material refresher guides for
prior coursework Application of stronger weighting and penalty for lack of participation /
performance in the MFT testing process
BUSINESS PROPGRAM ASSESSMENT SUMMARY – AY 2015/2016
Areas still requiring attention
o Capstone project – critical thinking o Capstone project – Accounting & Finance o Capstone project – Management Science o Embedded questions – Accounting & Finance o Embedded questions – Management o Embedded questions – Management science o Written rubric – BUAD254 o BUAD342 – Critical thinking
Reflecting on assessment this year, what does the data reveal about student
learning in the program?
o Critical thinking skills remain a challenge. Student do better when they can memorize what to do rather than think through a problem and decide what to do
o Quantitative areas have bimodal populations which carries over into assessment o The importance of a solid math skills base to do well in quantitative courses o Students present well orally o Student effort is tied to the level of reward – grade points, credit. If there are not
enough points tied to assessment, then students do not prepare to the extent possible.
Summarize the program improvements for next year based on assessment results
The major plans for 2016/2017 are to address
o Transition assessment coordination duties to a new coordinator. o Continue to work on specific areas of embedded question testing where scores
are below target. This will be a topic at the Fall start of semester retreat. o Continue to look for ways to incorporate more global / international content into
individual courses o Continue assessment training of new and existing faculty o Continue development of a process to assess at the concentration level using E-
portfolio as required by ACBSP
Considering changes implemented as a result of prior assessment, how was student
learning affected? Please provide evidence of changes to student learning
o The BUAD program MFT mean score in Fall semester was 161.49 and in Spring semester it
was 159.41 placing us in the top 1/4 of 442 comparison schools. 161.49 is the highest score
since beginning using MFT in Fall 2010.
o In areas where more points are tied to assessment activity, students work harder to do well.
In BUAD348 global assessment – For one faculty the assessment quiz provided was 3% of
the final grade and 17 out of 18 scored above the target for 94%. For another faculty
teaching the same material but counting the assessment quiz for very little of the overall
course grade, the result was 49%.