Ray Magnan - Lean Instructional Design
Post on 21-Jan-2017
2078 Views
Preview:
Transcript
Copyright © 2008 Ray Magnan 1
Lean Instructional Design TM For Today’s Competitive Environment
DocTrain East - October 2008
Ray Magnan M.Ed.
Education Technology Consultantraymagnan@yahoo.comhttp://www.linkedin.com/
2Copyright © 2008 Ray Magnan
Agenda• Examine the challenges of training in today’s
competitive business environment. • Brief discussion of various approaches to
business improvement such as Six Sigma and Lean Six Sigma.
• Focus on a systematic approach to training program development using Lean Instructional Design TM principles and the ADDIE model. – Analysis, Design, Develop, Implement, Evaluate
3Copyright © 2008 Ray Magnan
Background: Ray MagnanDesign education solutions for software, insurance, and banking industries.
– Primarily distance education• Instructor-led, self-paced, or blended.
– Web-based learning portals • Structured training paths with links to a full range of
additional resources.
4Copyright © 2008 Ray Magnan
And You Are?• Involved with training?
– Most of the time– Part time– Not currently
– Healthcare– Retail– Insurance– Hotel/Restaurant– Other
• Industry:– Software/Hardware– Finance/Banking– Biotech– Manufacturing– Transportation
Copyright © 2008 Ray Magnan 5
Challenges of Training in Today’s Competitive Business Environment
6Copyright © 2008 Ray Magnan
Challenges• In today’s competitive business environment,
training professionals are under constant pressure to deliver more of the right training in less time with fewer resources.
• Key challenges include:– Global competition– Reductions in corporate resources– Need to attract and retain talented people
7Copyright © 2008 Ray Magnan
The Past• Traditionally, training departments were often
separate from their organization’s day-to-day business.
• Multi-day live classroom training was the primary approach. – Expensive from a dollars and resource perspective– Difficult to schedule because of travel arrangements
and other work commitments.• Management frequently viewed training as
necessary but costly.
8Copyright © 2008 Ray Magnan
The Distant PastNuremberg Funnel
– Humorous description of a mechanical way of learning and teaching.
– Evokes images of: • A student learning his lessons
almost without effort
• A educator teaching everything to even the "stupidest" pupil.
9Copyright © 2008 Ray Magnan
The Present: Increased Efficiency• Distance education was a step in the right
direction. – Reduced travel costs and scheduling issues.
• Other initiatives such as web-based training, mentoring, blended learning, and just-in-time learning are also beneficial.
• However, this is like picking the low-hanging fruit on a tree.
• Additional savings and improvements require more innovative approaches.
10Copyright © 2008 Ray Magnan
The Future• Besides efficiently delivering training, today’s training
departments must be tightly aligned and integrated with their organization’s business goals and needs.
• Common goal is to drive higher performance and create strong business results by improving employee performance.
• Lean Instructional Design TM is an improvement process designed to help organizations meet their goals and their customers’ needs.
11Copyright © 2008 Ray Magnan
When Projects Go BadExample 1:• Extensive needs analysis conducted to determine
the need for internal training on the company’s complex technical products.
• Numerous interviews and focus groups held to outline need.
• Created detailed proposal listing over 20 needed courses.
• Result: No courses were created because of resource issues.
12Copyright © 2008 Ray Magnan
When Projects Go BadExample 2: • Internal Web-Based Training Center• Included only high-level information
about all products. • Did not meet student’s need for
more detailed information.• Overly rigid structure resulted in
many pages being flagged as “under construction”
13Copyright © 2008 Ray Magnan
When Projects Go BadCommon Elements:• Unrealistic goals or expectations• Lack of buy-in from all participants• Lack of focus on customers’ needs• Lack of focus on business needs• Too much time/resources spent on issues that
were not important to the customer.• Inappropriate use of educational technology.
Copyright © 2008 Ray Magnan 14
Approaches to Process Improvement
• William Deming - Early Innovator• Six Sigma • Lean Production• Lean Six Sigma
15Copyright © 2008 Ray Magnan
Deming: Early InnovatorWilliam Edwards Deming (1900 - 1993)
– Widely credited with improving production in the US during World War II.
– Best known for his work in Japan from 1950 on. Focus on improvements in:
• Design• Service• Product quality• Testing
– Significant contribution to Japan's reputation for innovative high-quality products.
– Although considered a hero in Japan, only began to win widespread recognition in the U.S. at the time of his death.
16Copyright © 2008 Ray Magnan
Deming: Key Points• “By adopting appropriate principles of management,
organizations can increase quality and simultaneously reduce costs (by reducing waste, rework, staff attrition and litigation while increasing customer loyalty). The key is to practice continual improvement and think of manufacturing as a system, not as bits and pieces.
• His 85/15 rule stated that:– 85% of problems were built into the way work was done– Only 15% was the fault of individual employees.
17Copyright © 2008 Ray Magnan
Six Sigma - History• Business management strategy, originally
developed by Motorola around 1986. • Inspired by previous quality improvement
methodologies. • Other early adopters include Honeywell and
General Electric. • Originally developed to improve manufacturing
processes and eliminate defects and errors.• Later extended to other types of business
processes.
18Copyright © 2008 Ray Magnan
Six Sigma - Origins of Name• Sigma (the lower-case Greek letter σ) is used to
represent the standard deviation (a measure of variation) of a statistical population.
• If one has six standard deviations between the mean of a process and the nearest specification limit, there will be practically no items that fail to meet the specifications.
19Copyright © 2008 Ray Magnan
Six Sigma - Key Elements• Uses quality management methods, including
statistics.• Creates a special infrastructure of people within
the organization (Black Belts) who are experts in these methods.
• Each Six Sigma project follows a defined sequence of steps and has quantified financial targets (cost reduction or profit increase.)
20Copyright © 2008 Ray Magnan
Six Sigma Assertions: • Continuous efforts to achieve stable and predictable
process results (i.e. reduce process variation) are of vital importance to business success.
• Manufacturing and business processes have characteristics that can be measured, analyzed, improved and controlled.
• Achieving sustained quality improvement requires commitment from the entire organization, particularly from top-level management.
• A clear commitment to making decisions on the basis of verifiable data, rather than assumptions and guesswork.
21Copyright © 2008 Ray Magnan
Lean Production• Lean manufacturing or lean production is often known
simply as Lean.• Considers the use of resources for anything that does
not create value for the customers to be wasteful, and something to be eliminated.
• Derived from the Toyota Production System (TPS) 1948 to 1975.
• TPS organizes manufacturing and logistics, including interaction with suppliers and customers.
• Based on work by Deming and Henry Ford.
22Copyright © 2008 Ray Magnan
Lean Production - TPS• Main goals of Toyota Production System (TPS)
are to eliminate:– Overburden or stress in the system (muri)– Inconsistency (mura) – Waste (muda)
• Goal is to design a process that runs smoothly, can flex without stress, and eliminates waste.
• Using TPS, Toyota was able to reduce lead-time and cost, while improving quality.
23Copyright © 2008 Ray Magnan
Lean Six Sigma• Combines elements of Six Sigma and Lean Production• Core concepts:
– Only customers can define quality– Things that do not meet customer needs are called defects.
• Challenge: How to define and measure defects. – In training this could include:
• Information gaps• Out of date information• Not delivered on time• Lack of focus on business needs
24Copyright © 2008 Ray Magnan
Lean Six Sigma: Key Themes• A process that makes a lot of errors cannot keep up
its speed. – So, high quality makes it possible to attain fast speed.
• A process that works slowly is prone to errors. – Long lead times, wait times, queues, or delays can
cause problems. • Low quality and slow speed make processes (and
services and products) expensive.• Unnecessary complexity adds cost, time, and waste.
25Copyright © 2008 Ray Magnan
Lean Six Sigma - Emphasis On:• Documenting how work gets done• Examining the flow of work• Giving people the knowledge and methods they
need to constantly improve that work.
Copyright © 2008 Ray Magnan 26
Lean Instructional Design TM
27Copyright © 2008 Ray Magnan
Central Themes of Lean ID• Unnecessary complexity adds cost, time, and waste. • Only customers can define quality. • Anything that does not meet a customer need can be
considered a defect. • Is the customer willing to pay for “improvements”?• Low quality and slow processes make the
corresponding services and products expensive. • Eliminate waste.• By focusing on improvements to the process flow, we
can improve training development speed, quality, and integration with organizational business goals.
28Copyright © 2008 Ray Magnan
Skills Needed for Lean ID
• Instructional Design Skills– Education courses, certificate programs.
• Instructional Technology Skills– Courses, hands-on, self-study.
• Business Knowledge– Business courses, industry publications, conferences,
company training.
Copyright © 2008 Ray Magnan 29
Applying Lean Instructional Design TM to the ADDIE Model
30Copyright © 2008 Ray Magnan
What is ADDIE?• Widely used methodology for developing new
training programs.• Advantages: Flexible and scalable.• Provides a step-by-step system for:
– Evaluation of students’ needs– Design and development of materials– Evaluation of training effectiveness
31Copyright © 2008 Ray Magnan
Classic ADDIE Model
Phases
• Analyze
• Design
• Develop
• Implement
• Evaluate
32Copyright © 2008 Ray Magnan
Enhanced ADDIE Model• Analyze
– Initial analysis– Create project charter
• Design– Course outline– User interface (UI)– Prototype. Test technology and UI.
• Develop– Create materials– Review, edit, QA
• Implement– Roll out to trainers and students.
• Evaluate– Was training effective?
•Track Time Spent–Use for future projects
–Prove Return on Investment (ROI)
•Ongoing Maintenance–Accommodate new features or versions.
33Copyright © 2008 Ray Magnan
Roles• Project stakeholders
– Those with a stake in the success of the project• Development Team
– Project sponsor– Project manager– Training department management– Instructional designers, developers
• Resources– Subject matter experts (SMEs)
Copyright © 2008 Ray Magnan 34
Analysis
ADDIE
35Copyright © 2008 Ray Magnan
Training Request• Request from senior management or other
departments.– New product– Enhancements to existing product – Problems with existing product or process
• Stakeholders: Have a vested interest in the success of the training.
Analysis
36Copyright © 2008 Ray Magnan
Business Analysis• Does this require training?
– Are there other alternatives? • Job aids• Existing resources
• Other higher-priority training projects? – Sales pipeline
• Budget for training?• Delivery date?• Departmental or corporate business issues?
Analysis
37Copyright © 2008 Ray Magnan
Analysis: Info Resources • Stakeholders• Subject matter experts (SMEs)• Product managers• Development• Existing documents
– Functional and technical specifications– Test guides
• Sales and marketing– Sales pipeline. Business benefit.
Analysis
38Copyright © 2008 Ray Magnan
Needs Assessment• Interview cross-section of target audiences and
management– What do they need to know to do their job– Past issues– Potential issues
Analysis
39Copyright © 2008 Ray Magnan
Audience Analysis• Who are the audiences for the training?
– Size of audience. Location.• Is there any overlap in the required skills?
– Could use a modular approach. – Different combinations for different users
• Task Analysis• Performance Gaps
Analysis
40Copyright © 2008 Ray Magnan
Media Analysis• Which delivery methods should you use?• What technology is available?
– Development and delivery• Be careful about using new authoring or development
software in a major project.• Consider the learning curve of the new technology.• Will it speed up or slow down development?
Analysis
41Copyright © 2008 Ray Magnan
Media Analysis• Budget considerations
– Consider time, money, personnel, other resources.– Balance costs with quality of learning. Example.
• Simulations and interactivity are resource intensive. • Use them where they give you the best return on
investment (ROI) or “Most bang for your buck.”
Analysis
42Copyright © 2008 Ray Magnan
Media Analysis• Sample Alternatives:
– Instructor led training: Classroom or distance education
– Self-paced online learning– Blended learning: Instructor-led and self-paced.– Web portal with training materials and links to
additional resources
Analysis
43Copyright © 2008 Ray Magnan
Results of Analysis• Create an initial proposal
– Summarize your analysis– Identify the audiences and tasks– Include high level outline of training modules– Proposed delivery methods– Proposed technology
• Provide alternate proposals– Plan A: Comprehensive. 6 months development.– Plan B: Less comprehensive. 3 months development.
Analysis
44Copyright © 2008 Ray Magnan
Project Charter (Proposal)• Defines scope of project
– Incorporate feedback from initial analysis– Get approval and buy-in from stakeholders– Project plan with milestone dates.– Identify sponsor, stakeholders and others involved.
• SMEs, reviewers, technical and other resources.• Define responsibilities and time availability for input and
feedback– Communication strategy for this group.– Rollout plan for training.– Plan for handling Scope Creep and RAID.
• Risks, Assumptions, Issues, and Dependencies
Analysis
Copyright © 2008 Ray Magnan 45
Design
ADDIE
46Copyright © 2008 Ray Magnan
Design Phase• Using information from the analysis phase:
– Outline modules and lessons.– Create detailed instructional objectives for all
modules and lessons. – Create sequence of learning.– Determine the delivery method for each portion of
the training. – Establish look and feel of user interface.
• Ideally, you already have a UI you can use– Design assessment strategy to match the objectives.
Design
47Copyright © 2008 Ray Magnan
User Interface• Goal is consistent U.I.
– Looks more professional– Easier for student to navigate through material
• Examples: – Templates - Paper and online– User interface for web delivery
• Navigation• Online quizzes• Simulations
Design
48Copyright © 2008 Ray Magnan
Prototype• Very useful to create a prototype or pilot
– Especially if using new technology• Validate with stakeholders and SMEs • Receive feedback early in the process• Example of possible issues:
– Problems with plug-ins for web browser.– Users who travel may prefer to download material rather
than connect to network.– Security issues.
• Make necessary corrections
Design
Copyright © 2008 Ray Magnan 49
Development
ADDIE
Development
50Copyright © 2008 Ray Magnan
Project Plan• Use project planning methodology for large
scale projects.– Keep on track with milestone dates.– Provides a clear view of interdependencies
• Keep project plan overhead in scale to the project.
Development
51Copyright © 2008 Ray Magnan
Content Production• Incorporate feedback from prototype• Create the module and lesson content for the
selected delivery methods. • Include appropriate exercises, interactions, and
activities to enhance learning. • If appropriate, plan group activities.
Development
52Copyright © 2008 Ray Magnan
Assessments• Develop assessments that tie into the learning
objectives.• Could include:
– Pre-assessment– Quizzes during training– Post-assessment
Development
53Copyright © 2008 Ray Magnan
Review• Subject Matter Expert (SME) Review
– Completeness and accuracy– Due date for feedback– Allow time to incorporate their feedback
• Editor– Formatting and standards– Corporate branding
• Quality Assurance (QA)– Test interface and links in technology solutions
Development
54Copyright © 2008 Ray Magnan
Development/Review ProcessAlternatives when using complex ID technology
SubjectMatterExpert
Instructional Designer & Developer
LearningManagementSystem
SubjectMatterExpert
Instructional Designer
Developer LearningManagementSystem
1.
2.
Copyright © 2008 Ray Magnan 55
Implementation
ADDIE
56Copyright © 2008 Ray Magnan
Implementation Phase• Produce Materials• Announce availability of training• Target employees that management wants to
take the training.• If mandatory, announcement should come from
senior level management.• Deliver training
– Make web site available.– Roll out to trainers (ILT). Include any instructor
specific materials.
Implementation
Copyright © 2008 Ray Magnan 57
Evaluation
ADDIE
58Copyright © 2008 Ray Magnan
Why Evaluate Training?• Ensure that training is effective. • Evaluate the:
– Materials– Instructors– Delivery methods
• Did the students learn the material?• Prove return on training investment (ROI)• Reality check
– Did the training work as planned?– Was your analysis correct?
Evaluation
59Copyright © 2008 Ray Magnan
Levels of EvaluationDonald Kirkpatrick: 4 Levels of evaluation
• Level 1 - Reaction/Satisfaction: Did they like it?• 75% of US companies use this.
• Level 2 - Learning: Did they learn it?• 41% of US companies do this
• Level 3 - Transfer/Application. Apply it to their job?• Difficult to measure. Could use surveys after training.
• Level 4 - Business Results. Did it make a difference to the business?
• Difficult to measure. Hard to separate from other factors.
Evaluation
60Copyright © 2008 Ray Magnan
Level 1: Did They Like It?• AKA Smile Sheets. Questions about:
– Overall Course: • Would you recommend it to others?• Did it meet your needs?• Will you be able to apply it to your job?
– Instructor• Knowledge and performance
– Course materials• Provided appropriate level of detail • Included realistic examples, exercises, and assessments
– Distance education• Online materials well-organized• Variety of learning activities• Any technical issues
Evaluation
61Copyright © 2008 Ray Magnan
Level 2 - Did they learn it?Option: • Learner self-assessments
– Assess their learning and ability to apply it to the job.– Difficult to validate due to subjectivity
Evaluation
62Copyright © 2008 Ray Magnan
Level 2 - Did they learn it?Option: • Testing
– Simulations or final projects• Great testing tools but potentially expensive because of the
time involved.– Hands-on exam
• May be necessary for certain types of skills.– Delivering presentations. Driving a car. Sailing a boat.
– Written tests• Most commonly used method • Cost effective and relatively simple to create.
Evaluation
63Copyright © 2008 Ray Magnan
Level 2 - Suggested Strategy• Pre-assessment
– Measure baseline knowledge. Do not report scores• Quizzes
– Reinforce learning. Provide immediate feedback.– Prepares for post-assessment. Do not report scores
• Assignments and exercises– Measures success of training. Report scores
• Post-assessment– Measures overall success of training. Report scores
Evaluation
64Copyright © 2008 Ray Magnan
Level 3 and 4• Level 3 – Were they able to apply it to their job?
• Difficult to measure.
• Could use surveys after training – 30 or 60 days.
• Can be difficult to get enough participation.
• Level 4 - Did it make a business difference?• Very difficult to measure.
• Hard to separate from other factors.
Copyright © 2008 Ray Magnan 65
Time Tracking
66Copyright © 2008 Ray Magnan
Time Tracking• Track the time that is spent on each aspect of
the project: ADDIE• Use for cost/benefit analysis of this and other
projects. • Useful for planning future projects.• Compare
– Costs of course development – Numbers of students trained– Results of evaluations
Time Tracking
Copyright © 2008 Ray Magnan 67
Questions?
68Copyright © 2008 Ray Magnan
top related