Program Assessment in Workforce Education Florida Community College at Jacksonville Core Competencies, Flexible Implementation.

Program Assessment in Workforce Education

Florida Community College at Jacksonville

Core Competencies,

Flexible Implementation

FCCJ Workforce Education

• Over 80 workforce education programs– Automotive

– Aviation

– Business and Finance

– Information Technology

– Construction Trades

– Public Service

– Culinary and Hospitality

– Engineering and Industrial Technology

– Allied Health

– Legal and Office Systems

• Workforce program features:– AS/AAS degrees, college

credit certificates, vocational certificates, and continuing ed

– College preparatory and vocational preparatory instruction (remediation)

– Dual enrollment for traditional and adult high school students

– Articulation between all educational levels and credit for prior learning

Workforce Program Assessment Model

Student learning outcomes

Assessmentmethods

Datacollection

Programimprovement

Timeline/schedule

Faculty achieve consensus on learning outcomes to be assessed, and map outcomes to curriculum

Faculty choose assessment methods appropriate to the outcomes, purpose of assessment, and student population

Faculty develop timeline for gathering assessment data,

both formative and summative

Faculty and staff work together to gather

formative and summative assessment data and

compile for review

Faculty and staff collaborate to interpret assessment data and develop strategies to improve

student learning outcomes

Continuous improvement

cycle

Assessment Program Components

• Identify Core Competencies: – Literacy (verbal, written, quantitative)– Problem-solving– Discipline-specific knowledge and skills

• Map competencies to curriculum and modify where necessary

• Identify/develop assessment strategies• Orient/train adjuncts• Gather, compile, and interpret data• Share with program advisory committee and other

stakeholders

Mirrors University outcome categories

Available Tools and Resources

• Professional development opportunities for faculty and staff

• Research analyst - assistance with data collection and analysis

• Faculty Fellows – support for planning and implementation

• Program Assessment Rubric – self-evaluation of progress

Core Competencies:Literacy (verbal, written, quantitative)

• Culinary arts:– Develop and execute, in both written and oral formats, such

foodservice management documents as a: menu plan, restaurant concept overview, purchasing specification, food production schedule, and catering contract proposal

• Practical Nursing:– Demonstrate grammatical and format proficiency in written

documentation of patient care.

• All:– Demonstrate the ability to conduct research via Internet and

other resources and put information together in a logical and concise written report.

Core Competencies:Problem-Solving

• Cisco CCNP:– When presented with problem or design scenarios, students will

demonstrate problem-solving abilities and critical thinking skills by performing appropriate configuration, design, assessment, and/or solution(s)

• Paramedic:– When presented with simulated patient scenarios students will

demonstrate problem-solving abilities and critical thinking skills by selecting appropriate assessment and treatment modalities

• All:– Demonstrate proficiency in working with customers (internal and

external) and colleagues who come from diverse backgrounds, age groups, socioeconomic groups

Core Competencies:Discipline-specific knowledge/skills

includes teamwork and productivity

• Aviation Maintenance:– Evaluate the requirements of a maintenance task and complete

it in a timely manner meeting industry standards

• Office Administration:– Demonstrate the ability to prioritize projects and assignments,

use effective time management techniques, and employ effective records management techniques

• Cosmetology:– Demonstrate leadership and exemplary interpersonal skills while

performing in groups simulating salon settings

Network Engineering TechnologyNetwork Engineering TechnologyE-Portfolio RequirementsE-Portfolio Requirements

CET2629 Internetwork Troubleshooting (CCNP4) - CET2629 Internetwork Troubleshooting (CCNP4) - Case StudyCase Study

CET2628 Building Remote Access Networks (CCNP2) - CET2628 Building Remote Access Networks (CCNP2) - Case StudyCase Study

CET2623 Quality of Service - CET2623 Quality of Service - NBar Case StudyNBar Case Study

CET2627 Building Multilayer Switched Networks (CCNP3) - CET2627 Building Multilayer Switched Networks (CCNP3) - HSRP Case StudyHSRP Case Study

EEV0585 or CET1175 Technical Support - EEV0585 or CET1175 Technical Support - Resume and PresentationResume and Presentation

EEV0531 or CET2186 - Computer Peripherals - EEV0531 or CET2186 - Computer Peripherals - Certificate of DisassemblyCertificate of Disassembly

EEV0543 or CET1512 - Operating Systems - EEV0543 or CET1512 - Operating Systems - DOS CertificateDOS Certificate

CET2677 Voice Over IP - CET2677 Voice Over IP - Case StudyCase Study

EEV0544 or CET1742 Intro to Networking - EEV0544 or CET1742 Intro to Networking - Putting it all together labPutting it all together lab

EEV0570 or CET2600 Cisco I - EEV0570 or CET2600 Cisco I - Report/LabReport/Lab

EEV0571 or CET2610 Cisco 2 - EEV0571 or CET2610 Cisco 2 - Case StudyCase Study

CET2626 Building Scalable Networks - CET2626 Building Scalable Networks - Case Study 1Case Study 1

Network Engineering TechnologyNetwork Engineering TechnologySample E-Portfolio Assignment, Cisco 7Sample E-Portfolio Assignment, Cisco 7

For each case study, submit For each case study, submit one Word document that one Word document that contains the following:contains the following:The graphic for the case study The graphic for the case study provided or created yourself provided or created yourself from the PowerPointfrom the PowerPointAll the configurations of each All the configurations of each device (make sure each device device (make sure each device is properly labeled with a is properly labeled with a hostname so it is easily hostname so it is easily identified)identified)Captured pertinent show Captured pertinent show commands that prove the commands that prove the requirements of the case studyrequirements of the case studyScreen captures of the host IP Screen captures of the host IP address and default gatewayaddress and default gatewayScreen captures of successful Screen captures of successful pings to the other hostspings to the other hosts

Legal Studies – Targeted OutcomesLegal Studies – Targeted Outcomes

Effective legal writingEffective legal writing

TeamworkTeamwork

Ethics and professionalismEthics and professionalism

Legal Studies – Assessment MethodsLegal Studies – Assessment Methods

Curriculum-embedded assessments covering the Curriculum-embedded assessments covering the targeted skillstargeted skills Teaches the skillsTeaches the skills Provides feedbackProvides feedback Administered in the courses each student must take to Administered in the courses each student must take to

complete the programcomplete the program

Transformation of Internship into a Capstone Transformation of Internship into a Capstone CourseCourse Internship work experienceInternship work experience Group presentation of solution to ethical dilemma present Group presentation of solution to ethical dilemma present

in a real life factual scenarioin a real life factual scenario Portfolio – to be compiled from specified embedded Portfolio – to be compiled from specified embedded

assessments throughout the required Legal Assisting assessments throughout the required Legal Assisting coursescourses

Group presentation and portfolio to be assessed by a Group presentation and portfolio to be assessed by a panel that includes employers and practicing paralegalspanel that includes employers and practicing paralegals

Aviation MaintenanceAviation Maintenance

GoalsGoals:: All graduates All graduates

complete written complete written exams within 60 days exams within 60 days of graduationof graduation

At least 90% will pass At least 90% will pass the exam on first the exam on first attemptattempt

Increase the number Increase the number of certified techniciansof certified technicians

Learning/Assessment Learning/Assessment Methods:Methods:

Entry and exit surveysEntry and exit surveys Examiner-Examiner-

administered practice administered practice oral examsoral exams• Provide students and Provide students and

instructors with instructors with feedback on students’ feedback on students’ skillsskills

• Encourage students to Encourage students to take the official examtake the official exam

Aviation MaintenanceAviation MaintenanceSpring 2006 OutcomesSpring 2006 Outcomes

73% of graduates have completed 73% of graduates have completed the licensure exam – up from 14% the licensure exam – up from 14% two years agotwo years ago

91% of graduates have a job in the 91% of graduates have a job in the aviation industryaviation industry

The practice exams show that there The practice exams show that there is room for improvement and is room for improvement and continuing evaluationcontinuing evaluation

Culinary ArtsClassroom vs. Program Assessment

Classroom Assessment Example: Chef-Instructor evaluates student mystery basket assignment and provides feedback to student via written and class critique (feedback for instructor…)

Program Assessment Example: Faculty members develop rubric for evaluating the mystery basket assignment, formally collect, aggregate and evaluate this data, and suggest and ultimately make meaningful curricular changes based on data (feedback for program…)

Culinary Arts Practical Assessment Rubric

Standard Levels of Quality

ProfessionalismHighly Competent (3) Competent (2) Needs Improvement (1)

Industry/course terms and nomenclature

Excellent knowledge of terms and technical nomenclature.

Overall good knowledge of terms with some improvement needed.

Overall knowledge of terms not adequate to perform successfully.

Professional dress and conduct

Excellent professional dress and demeanor observed.

Overall good dress and professional demeanor observed with some habits needing improvement.

Significant lapses in dress and professional demeanor were observed.

Teamwork and collaborative skills

Worked very well in team environment and showed initiative and outstanding group skills. Potential leadership attributes emerged.

Worked fairly well in a team environment with some group skills needing improvement.

Difficulty performing in team setting. Significant improvements needed in order to function well with others, and to successfully collaborate with working members of a group.

Interaction with site proctor or professor

Interacted with site proctor in a professional manner, reflecting outstanding industry expectations.

Proctor interaction was adequate with improvement needed in the area of interpersonal communication.

Some conflict emerged while interacting with site proctor. Significant improvements needed in the area of respect and overall professionalism.

Office Administration

Identified core competencies Mapped core competencies to

curriculum – spreadsheet that hyperlinks to actual assessment tools

Updated official course outlines with core competencies and assessment methods

Developing tracking and data management strategies

Office AdministrationCurriculum Map

Problem Solving OST 1100 OST 1581 OST 1384 OST 2771 OST2501

Demonstrate problem solving abilities by being able to troubleshoot minor computer operational problems.

Link to assignment

rubric

Link to assignment

rubric

When presented with typical business scenarios for which there are no obvious solutions, students will demonstrate problem solving abilities by selecting correct resources and actions to deal effectively with the scenarios.

Link to case studies

Link to exam and

scoring guide

Demonstrate proficiency in working with customers from diverse backgrounds and with a variety of issues, utilizing analytical and problem-solving tools.

Link to assignment

rubric

Link to project rubric