Using Assessment Center Methodology to Accelerate ...€¦ · • Targeted leadership development seminars • Action Learning Projects linked to team assessments and team coaching.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
– Accounting and Information Assurance– Decision, Operations Information Technologies– Finance– Logistics, Business and Public Policy– Management and Organization– Marketing
Setting the Stage:Business Education at a Crossroads
• Managers and recruiters are increasingly questioning the value and relevancy of MBA programs1
– Clear gaps between what’s being delivered in MBA curricula and what’s needed
– Newly minted MBAs lack essential leadership skills, teamwork, critical thinking, creativity and innovation, and cultural awareness
• Especially problematic given global evidence that organizations don’t have the talent to lead them into the future
1 See Rubin, R. S., & Dierdorff, E. C. (2009). How relevant is the MBA? Assessing the alignment of required curricula and required managerial competencies. Academy of Management Learning & Education, 8, 208-224. Also see Datar, S. M., Garvin, D. A., & Cullen, P. (2010). Rethinking the MBA: Business Education at a Crossroads. Boston, MA: Harvard Business School Publishing.
Fast Facts• A recent survey of 425 senior executives in North America,
Europe, and Asia showed that attracting and keeping skilled talent and developing employees into capable leaders were among the top ten business issues cited.1
• A 2005 survey of 750 CEOs indicated that 79% believed the ability to develop leaders was the most important or one of the top 5 factors in achieving a competitive advantage.2
• A recent Center for Creative Leadership (CCL) survey of 2,200 leaders from companies in the United States, India and Singapore identified that the four future key skills ranked mostimportant for future success by respondents were found to be among the weakest for today’s leaders: leading people, strategic planning, inspiring commitment, and managing change.3
1 Accenture consulting study as cited in McGee (2005, August 16th). Why promote from the outside when the talent is inside? Information Week – www.informationweek.com.; 2 see Center for Creative Leadership.; 3 see Taylor, S. (2010, February). Bridging the leadership gap. Chief Learning Officer -www.clomedia.com/business-intelligence/2010/February/2857/index.php.
Business Education at a Crossroads: The Path Forward
• Business schools must rethink accepted beliefs and assumptions and transform their curricula to better leverage hands-on exercises, experiential learning, and opportunities for self-reflection.
– Adding courses on business ethics and financial crises won’t solve the problem
• Key question: Beyond coursework, what techniques can we use to enhance students’ self-awareness and proficiency on essential competencies required for successfully leading during challenging times?
Assessment Centers• Individuals participate in a series of
situations that simulate the real world• Behaviorally-oriented process used for a
variety of organizational/human resources purposes
• Candidates evaluated on multiple competencies across multiple techniques
• Use of multiple assessors (raters) and integration session to reduce rater bias and thus increase rating accuracy
• Effective tools for predicting future overall job performance, management potential, performance in training, and career advancement; valid across cultures.
• Entry-level to executive applications; used increasingly around the world.
Popular Simulations:• Written:
• In-basket exercise• Case analysis
• Interpersonal:• Oral Presentation• Group Discussion exercise• Interview Simulation
Sample Organizations Using Assessment Center (AC) Methodology
a Denotes Capital One runs Executive Development Centers (top-tier) and Leadership Development Centers (next tier) – see Delahoussaye, M. (2002, March). When tomorrow comes. Training; b denotes Microsoft is using ACs as part of their selection process for Country Managers (GMs).
The Smith School is using the AC, in conjunction with the other Executive Coaching components, to help you diagnose and enhance your leadership strengths and development needs. The data may
also be used to facilitate administrative issuesrelated to enhancing the effectiveness of your
Listed below is a detailed, narrative summary of your performance across the various competencies. Evaluations of each competency are supported by behavioral examples (e.g., critical incidents) of performance.
Interpersonal Sensitivity. Mr. Participant exhibited slightly below average interpersonal sensitivity in the Group Discussion Exercise. Although he acknowledged others’ ideas (e.g.., “Yeah”; “Yes, that’s fine”), his comments appeared mechanical in nature. He also displayed weak active listening skills at times (e.g., he had a tendency to “listen to respond” versus “listening to understand” - he interrupted and talked over others to assert his views rather than “learning” what was said; he looked down when others were talking), and he used an insensitive, directive tone at times (e.g., he sometimes disagreed with others in an abrupt manner - "We can do that later..."; "But it said..."; "We need to..."). Overall, rather than coming across as affiliative, his style could be best described as detached, analytical, and task-oriented.
“The simulation was fantastic, would like to add additional role play simulations to the first Assessment center experience though… to really gain an insight in a persons leadership style.”
“I enjoyed the experience, and learned from it! ... This should be a very valuable part of the EMBA.”
“Only gave it a four because I wish it was more thorough. I would like to have done the full assessment center, even if it had to be broken up over 2 days (or a day and a half). Other than that, it was excellent.”
“I am able to communicate much better and more effectively with senior management. Through the executive coaching program I raised significantly my EQ by increasing my self-awareness and controlling my emotion and funned them in the appropriate manner to achieve results.”
1. What a personality test described: 1. What we observed in the AC:
EMBA is insightful concerning how others feel and think. He is quick to respond to social nuances, and is likely viewed by others as reasonably perceptive and observant. He is pleasant to be with and usually easy to have around.
EMBA displayed rather weak interpersonal sensitivity…On the positive side, he occasionally complimented others…On a less positive note… he frequently interrupted others before they finished speaking; instead of responding to others' comments, at times he would transition to his own ideas; although he facilitated consensus on some decisions, at times he disagreed with others’ ideas and subsequently redirected the conversation without regard for their opinions…he usually disagreed in an abrupt, brash manner… using a harsh, rather arrogant tone…Taken together the data suggest that while he can be personable, his assertive, competitive, task-oriented demeanor may prevent such behavior from consistently showing (e.g., he may come across as impatient toward others)…The data further suggest that EMBA may lack “emotional intelligence”(e.g., he demonstrated limited empathy toward others’feelings/needs and appeared to lack self-monitoring skills when interacting with others).
(Actual Behaviors)2. What a cognitive ability test
described:2. What we observed in the AC:
EMBA’s performance places her in the 99th percentile, meaning that her problem solving capabilities are better than 99 percent of [upper division students in four-year colleges]… When compared to a sample of mid- to upper-level managers who have completed a similar assessment battery, her score is [again] in the 99th percentile… Overall, she should have no problem at all recognizing key issues, making inferences, and coming to appropriate conclusions based on information given to her. In short, she should be an excellent problem-solver.
EMBA demonstrated reasonable, though inconsistent, judgment in the LGD… varied dramatically, from instances of excellent judgment, to instances of poor judgment …could have enhanced her performance… by doing a better job of consistently articulating the logic/rationale behind her ideas versus appearing opinionated, and by slowing down to ensure that all other team members were able to follow her thought processes. Doing so would also have had a positive impact on her ability to sway others, and would have ensured that she avoided premature closure on issues. On a final note … she could have also enhanced her performance by better leveraging financial data to support her arguments (e.g., while she had very good grasp on most issues, she confused some of the P&L data).
Executive CharacteristicsWhat characteristics of an EMBA (assessee), if any, help explaindifferences in his/her success in executive coaching?
• “Behavior change” measured after session 4 and 5; based on coach ratings; 4 items: α= .92 (n =46)
• The executive…• Definitely learned and applied new behaviors throughout coaching• Acted on the majority of recommendations from previous meetings• Presents evidence of behavior change• Seems more confident about what s/he is doing on the job as it
Findings consistent with past research that suggests that people with certain characteristics are more likely to accept feedback and participate in developmental activities
•From a broader talent management perspective, the findings highlight the potential link between assessment center methodology and executive coaching for growing leaders (c.f., Poteet & Kudisch, 2008)
•Can we expect cross-cultural consistency in these results?
1 See Ludeman & Erlandson (2004). For more see Gettman, H., Wouters, K., Stevens, C., Kudisch, J., Edinger, S., Russell, J., & Tesluk, P. (2010, April). Factors that influence executive engagement in coaching (and does it even matter?). Paper presented at the 25th annual conference of the Society of Industrial and Organizational Psychology, Atlanta, Georgia.
Interesting & Unexpected Finding• Hierarchical linear regression, controlling for coach• Executive Characteristics’ (measured at T1) effects on engagement from
T1 – T5.
• Contrary to predictions, cognitive ability was negatively related to engagement!
Atchley, E. K., Smith, E. M., & Hoffman, B. J. (2003, September). Examining the relationship between performance, individual differences, and developmental activities: Getting more bang for the buck from DPACs. In T. Maurer (Chair), Where do we go from here? Accepting and applying assessment center feedback. General session presented at the 31st annual meeting of the International Congress on Assessment Center Methods, Atlanta, GA.
Byham, T. M. (2005). Factors affecting the acceptance and application of developmental feedback from an executive assessment program. Unpublished doctoral dissertation. University of Akron.
Jones, R. G., & Whitmore, M. D. (1995). Evaluating developmental assessment centers as interventions. Personnel Psychology, 48, 377-388.
Kudisch, J. D. & Ladd, R. T. (1997, April). Factors related to participants’ acceptance of developmental assessment center feedback. Paper presented at the 12th Annual Conference of the Society for Industrial and Organizational Psychology. St. Louis, MO.
Kudisch, J. D., Lundquist, C. & Smith, A. F. R. (2001, October). Reactions to “dual-purpose”assessment center feedback: What does it take to get participants to buy into and actually do something with their feedback? Paper presented at the 29th International Congress on Assessment Center Methods, Frankfurt, Germany.
Ludeman, K., & Erlandson, E. (2004, May). Coaching the alpha male. Harvard Business Review, 59-67.
Poteet, M. L., & Kudisch, J. D. (2003, September). Straight from the horse’s mouth: Strategies for increasing feedback acceptance. In T. Maurer (Chair), Where do we go from here? Accepting and applying assessment center feedback. General session presented at the 31st annual meeting of the International Congress on Assessment Center Methods, Atlanta, GA.
Poteet, M. L., & Kudisch, J. D. (2008, September). Using executive coaching to leverage assessment center feedback: Tips for success. Paper presented at the 34th annual meeting of the International Congress on Assessment Center Methods, Washington, DC.