Pittsburgh, PA 15213-3890 Sponsored by the U.S. Department of Defense © 2003 by Carnegie Mellon University This material is approved for public release.

Pittsburgh, PA 15213-3890

Sponsored by the U.S. Department of Defense© 2003 by Carnegie Mellon UniversityThis material is approved for public release.

CMMI®

Page 1

SEISM Appraiser Program: Future Directions

3rd Annual CMMI Technology Conference and User Group

SM SEI is a service mark of Carnegie Mellon University.

® CMMI is registered in the US Patent & Trademark Office by Carnegie Mellon University

© 2003 by Carnegie Mellon University

CMMI®

Page 2

AgendaContext setting – the SEI Appraiser Program

Retrospective on SEI Process Appraisal

Today – recent or ongoing improvements

Tomorrow - improvements under consideration

© 2003 by Carnegie Mellon University

CMMI®

Page 3

Context SettingWhat is the SEI Appraiser Program?• Scope• Purpose• Operating mechanism

© 2003 by Carnegie Mellon University

CMMI®

Page 4

SEI Appraiser Program Scope

SEI Appraiser Program

xCMM-based Products CMMI-based Products

Tracks

Supplier Selection

and Monitoring

Internal Process

Improvement

SCE 3.0

SA-CMM

CBA IPI

SA-CMM

P-CMM

Quality Tracks Quality

SCAMPI Family

SCAMPI A

SCAMPI B

SCAMPI C

© 2003 by Carnegie Mellon University

CMMI®

Page 5

SEI Appraiser Program PurposePurpose: Promote and support synergy among SEI appraisal methods and a uniform level of quality in SEI appraisal methods and related products and services

Goals:

- Maximize value and use of SEI appraisal methods facilitated by qualified, trained individuals.

- Transition appraisal technology in an effective manner, maintaining consistency and quality in the process.

© 2003 by Carnegie Mellon University

CMMI®

Page 6

Retrospective – SEI AppraisalsGeneration Method (s) Model (s) Period

0 SEI-assisted Assessments (SEIAAs)

Implicit 1987-1992

1 Software Process Assessment (SPA), SCE

Implicit/SW-CMM

1988-1994

2 CBA IPI/SCE 3.0 SW-CMM 1994-2005

3 SCAMPI (A) CMMI 2001+

© 2003 by Carnegie Mellon University

CMMI®

Page 7

Recent Or Ongoing Improvements

Introduction of formal communication mechanism (notifications)

Appraisal Report Processing Improvements

SCAMPI Lead Appraiser Annual Workshop

SCAMPI Family

SW-CMM-based SCAMPIs

SCAMPI Appraisal Team Training

© 2003 by Carnegie Mellon University

CMMI®

Page 8

1st Annual SCAMPI Lead Appraiser WorkshopConducted in Washington, DC November 4-5; co-located with workshop for CMMI instructors (November 6)

Approximately 135 SCAMPI Lead Appraisers participated

Annual event which focuses on the SLA community• Interactive• 2-way communication• Multi-purpose (upgrades, currency, inform, feedback,

etc.)

© 2003 by Carnegie Mellon University

CMMI®

Page 9

Selected SLA Workshop TopicsCode of Conduct

Changes to SCAMPI Lead Appraiser Authorization renewal criteria

Improvements to SCAMPI Method and materials

CMMI Product Suite and International Standards

SCAMPI Asset Library proposal

SCAMPI B/C pilots

© 2003 by Carnegie Mellon University

CMMI®

Page 10

Workshop Snipets -1

© 2003 by Carnegie Mellon University

CMMI®

Page 11

Workshop Snipets -2

© 2003 by Carnegie Mellon University

CMMI®

Page 12

Workshop Snipets -3

© 2003 by Carnegie Mellon University

CMMI®

Page 13

Workshop Snipets -4

© 2003 by Carnegie Mellon University

CMMI®

Page 14

Workshop Snipets -5

© 2003 by Carnegie Mellon University

CMMI®

Page 15

Workshop Snipets -6

© 2003 by Carnegie Mellon University

CMMI®

Page 16

Workshop Snipets -7

© 2003 by Carnegie Mellon University

CMMI®

Page 17

Improvements Under Consideration

Maintenance of SCAMPI Lead Appraiser Proficiency - a broader perspective

Draft Notifications

Synergy with selected international standards

SCAMPI asset library

© 2003 by Carnegie Mellon University

CMMI®

Page 18

Renewal Criteria (current)

2 Years

© 2003 by Carnegie Mellon University

CMMI®

Page 19

Renewal Criteria (future)

4 Years

…

© 2003 by Carnegie Mellon University

CMMI®

Page 20

Recognition of Appraisal Experience

PAIS Repository

• the appraisal method documentation required by ARC requirements in clause 4.2 is freely available to the public,

• a detailed mapping which shows how the method satisfies the relevant ARC requirements is freely available to the public (e.g. as in appendix D of the SCAMPI MDD),

• submissions of appraisal reports to the SEI meet requirements consistent with the ARC and similar to those imposed on members of the SCAMPI Family of appraisal methods; in particular, an ADS-like artifact would be a required part of such appraisal reporting.

SCAMPI Appraisal

Report

ARC (B) Appraisal

Report

ARC (C) Appraisal

Report

…

© 2003 by Carnegie Mellon University

CMMI®

Page 21

Draft NotificationsSCAMPI-N-0003: Goal rating profile

SCAMPI-N-0004: Appraisal feedback form submission

SCAMPI-N-0005: Appraisal Input submission

SCAMPI-N-0006: F2F affirmation

SCAMPI-N-0007: Minimum requirements for observation appraisal

SCAMPI-N-0008: Use of non-standard SCAMPI artifacts

SCAMPI-N-0009: Reporting appraisal findings

SCAMPI-N-0010: Announcement for scampi-quality

SCAMPI-N-0011: Announcement for SLAT for SWCMM

SCAMPI-N-0012: Change in renewal period

© 2003 by Carnegie Mellon University

CMMI®

Page 22

Synergy With Selected International Standards -1

Identify areas where there are opportunities for synergy between key international standards and the CMMI Product Suite

Exploit these opportunities by developing appropriate work products and/or liaising with appropriate individuals and organizations

© 2003 by Carnegie Mellon University

CMMI®

Page 23

Synergy With Selected International Standards -2Two of the key areas identified to date are the ISO 9000:2000 family of standards and the (emerging) ISO/IEC 15504 standard

Note that 15504 provides a mechanism for establishing important relationships to other international standards such as ISO 9000:2000, 12207, 15288 and others

© 2003 by Carnegie Mellon University

CMMI®

Page 24

Future Directions for SCAMPICapability to conduct fully conformant appraisals relative to selected PRMs; possibilities include• 12207• 15288• 9000:2000• Native CMMI PRM

Pace and selection (of PRMs) dependent on market needs.

Point of Contact – Dave Kitson (dhk@sei.cmu.edu)