01 Portfolio Summary 02 Business Enablement Assessment 03 Business Function Drilldown 04 06 Criticality Assessment 07 Criticality Assessment Drilldown 08 Individual Applications Summaries 05 REPORT OVERVIEW Product Effectiveness Assessment Vendor Effectiveness Assessment APPLICATION PORTFOLIO METRICS PROGRAM PREPARED FOR: John Doe, CIO Computer Business Inc. March 20, 2014 POWERED BY:
11
Embed
PORTFOLIO METRICS PROGRAM - Amazon S3 · 2014-12-20 · HINDERING APPS OPERATIONALLY BURDENSOME APPS SKILLS DEFICIENT APPS These apps may have technical or functional limitations
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
These applications have been fl agged as eliciting
discrepancies between IT and business users
in terms of the future fi t of the application at
the organization.
Assessment of the fi t of an application to the needs of the organization is critical as a fi rst step, regardless of the technical and functional quality of an app, or the vendor effectiveness. Evalute applications according to business function, to ensure that each function has a collection of apps that meet those needs, according to both IT and Business Users.
These applications are aligning poorest with
the future needs of the organization from the
perspective of both IT and Business users. These likely
need to be addressed fi rst.
Adequacy to Meet Future Needs
# of Apps
Total # of Apps
AverageScore Growth Maturity DeathFunctional Area
Production 7 1
92%
92%
91%
86%
84%
79%
76%
72%
65%
58%
55%
6 0
12
9
4
4
7
7
1
1
R&D
Industry Specifi c
SAP Crystal Reports 2008
For The Record Falcon
Overall Portfolio Alignment Satisfaction
This score is an overall indication of how well evaluated applications are setting up the organization to meet current and future business needs. This score is made up of alignment with business needs, fl exibility to adjust to changing needs, and overlap with other apps in the portfolio.
81%
84%
68%
89%
76%
51%
53%
54%
55%
55%
CONTROVERSIALAPPLICATIONS
ADEQUACY TO MEET FUTURE NEEDS ACCORDING TO BUSINESS FUNCTION
MOST IN NEEDOF ADDRESSING
5 most
5 apps
Legend
8%
31%
32%
29%
APPLICATION BUSINESS FUNCTION ENABLEMENT
BY LIFECYCLE STAGEGROUP SATISFACTION SUMMARY
At any given time, any organization will have many
applications at various lifecycle stages. Ideally, lifecycle stage
should align with the needs of the business going forward
because the cost of maintaining applications tends to increase
over time as maintenance costs go up and the value of
applications declines. Ensure that dying apps are disposed
of and growing apps are satisfactory to all groups.Growth
Lifecyle StageMaturity Death
0
5
10
15
20
25
30
35
63%Completely
Unique
85%Replaceable
0 Extremely Dissatisfi ed
0 Extremely Dissatisfi ed
0 Extremely Dissatisfi ed
Extremely Satisfi ed 100
Extremely Satisfi ed 100
Extremely Satisfi ed 100
11
9
8
10
5
6
3
1 2
>
IT User Group
BusinessUser Group
Both User Groups
Neither User Groups
Group(s) Satisfi ed (Satisfaction Score —%)
# of
App
licat
ions
Locations Approach
Module Bought BuiltOn-Premises Co-Lo/MSP Cloud
Partial Overlap
Complete Overlap
15%
5%
UniquenessReplaceability
35%Irreplaceable
Customer Service 12 1 6 0
HR 4 1 6 0
Administration 5 1 6 0
Finance 5 1 6 0
6 4 7 1Distribution
IT 12 1 6 0
9 4 7 1Marketing
Sales 11 1 6 0
100
88
82
73
68
65
49
75
84
96
90
90
77
79
61
95
89 93
69
66
61
50
69
80
93
98
61
59
73
59
58
45
49
48
94
78
94
57
59
63
45
51
Company XPrepared for:Name, RoleNumber of Respondents: 100Number of Applications: 48
Business Enablement Assessment – Business Function Drilldown
Managing and rationalizing the application portfolio should involve an assessment of functional overlap by functional process area. This avoids confusion for ends users around when to use what, and also simplifies management.
Effectiveness of applications relies on more than just technical and functional capabilities. Look for systemic issues around business process integration and operations to improve effectiveness of people and process to boost overall application satisfaction.
ITUsers
ITUsers
ITUsers
ITUsers
BusinessUsers
BusinessUsers
BusinessUsers
BusinessUsers
58
59
66
66
71
74
75
73
73
62
67
71
67
67
69
66
69
75
75
75
80
71
75
74
71
63
56
63 66
67
76
76
75
68
81
76
Business Users Satsfaction
IT Users Satsfaction
74% 79%
TechnicalCapability
FunctionalCapability
70% 83%Product Capability
77% 72%
54% 77%
71% 89%
78% 82%
External ApplicationIntegration Features & Functionality
Platform Standards Conformance Ease of Use
Security Adequacy Customizability
Compliance Adequacy Mobile Support
TechnicalIntegration
OpperationalEffi ciency
IT SkillsCapacity
Workfl ow &Data Integration
FunctionalReliability
Business Skills Capacity
85%
68%
75%
69%
76%
92%
Business Process Integration
Operational Effi ciency
Skills Capacity
96%
75%
63%
60%
63%80%
95%
79%
76%
85%
74%
85%
84%
89%
90%
75%
53%
77%
82%
77%
92%
Business Logic Reusability
End User Support Needs
IT Skills Availability
Business Process Effi ciency
Reliability
Availability
User Skills Availability
Business Logic Automation
Ease of Maintenance
IT Skills Complexity
Intra-App Data Consistency
Responsiveness
User Skills Complexity
Data Integration
Data Quality Control Capability
Ease of Troubleshooting
IT Training Availability
Data Relevancy
Reporting & Analytics
Self Suffi ciency (reliance on IT)
User Training Availability
PRODUCT EFFECTIVENESS
Company XPrepared for:Name, RoleNumber of Respondents: 100Number of Applications: 48
Implementation Satisfaction Support Satisfaction Partnership Satisfaction
Aderant CompuLaw Vision 10
Client Communication System
Nurse Aide Registry
EPM Live PPM
For the Record Falcon
Dealer Management System
Salesforce.com Knowledge
IBM Cognos Express 10
Microsoft Dynamics AX 2009
Aegis Health Group, Inc. PRISM
Hootsuite Enterprise
Cisco Identity Services Engine
IBM SPSS Statistics
Microsoft SkyDrive Pro
Sophos SafeGuard Enterprise
The goal of the organization should be to have all applications in the Champion quadrant. This can be accomplished by switching vendors/ applications or by focusing on improvements to internal capabilities.
VENDOR LANDSCAPE OVERVIEW
Vendor partnerships can be critical to initiating and maintaining effective quality of service on applications over time. Not only is it critical to have quality support structures in place, but also to work with vendors that are committed to future innovation and backing their applications fully from a research and development perspective.
Overall Product Partnership Assessment
Application Name
66% 81%
90% 49%
90% 90%
68% 75%
59% 61%
83% 61%
67% 82%
91% 55%
75% 89%
70% 69%
64% 65%
77% 87%
68% 75%
61% 56%
85% 91%
71% I
79% EP
65% I
75% MP
91% I
71% EP
82% I
75% MP
65% C
89% EP
90% EP
75% EP
85% EP
84% MP
67% I
Average
Average
Average
VL Quad.
33% Extremely Ineffective
0 Extremely Dissatisfi ed
0 Extremely Dissatisfi ed
0 Extremely Dissatisfi ed
0 Extremely Dissatisfi ed
0 Extremely Dissatisfi ed
0 Extremely Dissatisfi ed
0 Extremely Dissatisfi ed
0 Extremely Dissatisfi ed
0 Extremely Dissatisfi ed
Extremely Satisfi ed 100
Extremely Satisfi ed 100
Extremely Satisfi ed 100
Extremely Satisfi ed 100
Extremely Satisfi ed 100
Extremely Satisfi ed 100
Extremely Satisfi ed 100
Extremely Satisfi ed 100
Extremely Satisfi ed 100
33% Extremely
Ineffective
Extremely Effective
100%
100% Extremely Effective
POORLY IMPLEMENTEDAPPLICATIONS
POORLY SUPPORTED
APPLICATIONS
APPLICATIONS LACKING VENDOR
PARTNERSHIP
While these apps may be working well currently, they were
poorly implemented by vendors on day one.
These applications have been problematic
in the past from a support standpoint.
While implementation and support may have been satisfactory, the vendor has been less than forthcoming or
negative regarding the future of this product.
5 most
5 most
5 most
57 80 79
8574
64 79
60
9259
65
54
46
42
41
71
96
88
58 81
87
96
97
82
65
96
98
58
87
71
84
75
79
75 82
86
79
90
71
52
73
63
79
91
90
86
63
82
86 52
81
70
52
59
57
72
64
69
73
71
82
77
76
69
81
86
83
75
93 93
92
70
79
86
91
83
86
87
90
51
59
79
71
73
63
60
67
71
71
71
TechnicalCapability
TechnicalCapability
TechnicalCapability
FunctionalCapability
FunctionalCapability
FunctionalCapability
81%
74%
70%
80%
75%
85%
82%
76%
Product Capability
Business Process Integration
Business Process Integration
75% 76%
65% 90%
Support Effectiveness/Timeliness
Support Effectiveness/Timeliness
Support Expertise Support Expertise
74% 85%Speed & Ease of Implementation Speed & Ease of Setup
80% 80%
87% 76%
73% 71%
Platform Commitment
Product Commitment
Product Representation
Product Representation
Negotiation & Renewal Satisfaction
Negotiation & Renewal Satisfaction
Business Users Satsfaction
IT Users Satsfaction
Vendor Support Satisfaction
Implementation & Setup
VENDOR EFFECTIVENESS
Vendor Partnership
Company XPrepared for:Name, RoleNumber of Respondents: 100Number of Applications: 48
Necessary to Legal/ComplianceNecessary to Business SupportIndirectly Tied to RevenueDirectly Tied to Revenue
83%
71%
48%
49%
45%
MissionCritical
Important
Misaligned
Nice to Have
Unused
Unused
6/13%
10/21%
14/28%
12/25%
6/13%
Important MissionCritical
Nice to Have
HAZARDOUS
1 CAUTIONARY
1 UNWANTED
3
CONTENTIOUS
9 CONTROVERSIAL
9 QUESTIONABLE
4
EFFECTIVE
10 UN-PRIORITIZED
7 UNLEVERAGED
4
At Risk
At Risk
At Risk
At Risk
At Risk
At Risk
6
6
2
2
2
2
4
7
4
3
2
0
3
6
2
0
2
1
6
11
9
2
6
2
Expendable
Expendable
Expendable
Expendable
Expendable
Expendable
Misaligned
Misaligned
Misaligned
Misaligned
Misaligned
Misaligned
High Performing
High Performing
High Performing
High Performing
High Performing
High Performing
Average# of
Apps Effectiveness Rating
56%
65%
63%
65%
51%
45%
69%
26%
62%
33%
38%
--%
57%
61%
47%
--%
61%
30%
87%
87%
95%
100%
84%
84%
Total # of Apps 19
Total # of Apps 17
Total # of Apps 34
Total # of Apps 8
Total # of Apps 6
Total # of Apps 12
40%
35%
71%
17%
12%
25%
IN-HOUSE
CLOUD
CO-LO/MSP
BOUGHT
BUILT
MODULE
Many organizations are moving applications to the cloud to improve accessibility and simplify overall management. However, it is critical to ensure overall effectiveness of outsourced apps stay on par with those in-house.
While leveraging in-house expertise to develop applications to build custom modules on top of off the shelf software, it is critical to ensure these apps perform as well as those that are purchased.
OVERALL EFFECTIVENESS BY LOCATION
OVERALL EFFECTIVENESSBY APPLICATION CREATOR
Evaluating the number of applications within each quadrant is the fi rst step in assessing the health of the overall portfolio, and in determining which applications require immediate action.
Number of Applications by Criticality & Effectiveness
The goal of the organization should be to have all applications in the Champion quadrant. This can be accomplished by switching vendors/ applications or by focusing on improvements to internal capabilities.
APPLICATION BREAKDOWN BY RELEVANCE
Misaligned Expendable
At Risk High Performing
% o
f Tot
al A
pplic
atio
ns
Average Criticality Rating
Legend
Legend
TOTAL CRITICALITY
SCORE
+IT Users'
Satisfaction
Business Users'
Satisfaction
Extremely Ineffective Extremely Effective
OVERALL EFFECTIVENESS
BusinessEnablement
Effectiveness
ProductEffectiveness
VendorEffectiveness
+ +
0 Extremely Ineffective
0 Extremely Ineffective
0 Extremely Ineffective
0 Extremely Ineffective
0 Extremely Ineffective
0 Extremely Ineffective
Extremely Effective 100
Extremely Effective 100
Extremely Effective 100
Extremely Effective 100
Extremely Effective 100
Extremely Effective 100
62
61
83
52
46
51
85
55
39
46
80
26
30
75
35
83
66
32
61
65
100
91
50
51
42
30
64
20
25
61
65
100
40
60
93
94
63
76
85
76
63
71
99
90
Company XPrepared for:Name, RoleNumber of Respondents: 100Number of Applications: 48
External ApplicationIntegration Features & Functionality
Platform Standards Conformance Ease of Use
Security Adequacy Customizability
Compliance Adequacy Mobile Support
TechnicalIntegration
OpperationalEffi ciency
IT SkillsCapacity
Workfl ow &Data Integration
FunctionalReliability
Business Skills Capacity
80%
65%
71%
72%
90%
70%
Business Process Integration
Operational Effi ciency
Skills Capacity
80%
50%
73%
27%
80%80%
60%
N/A
75%
60%
61%
95%
100%
90%
90%
N/A
70%
80%
93%
80%
60%
Business Logic Reusability
End User Support Needs
IT Skills Availability
Business Process Effi ciency
Reliability
Availability
User Skills Availability
Business Logic Automation
Ease of Maintenance
IT Skills Complexity
Intra-App Data Consistency
Responsiveness
User Skills Complexity
Data Integration
Data Quality Control Capability
Ease of Troubleshooting
IT Training Availability
Data Relevancy
Reporting & Analytics
Self Suffi ciency (reliance on IT)
User Training AvailabilityOVERALL VENDOR EFFECTIVENESS
OVERALL APPLICATION
EFFECTIVENESS
INNOVATOR
EMERGING PLAYER
MARKETPILLAR
CHAMPION
Vendor Landscape Placement
IT USER(S)
BUSINESS USER(S)
OVERALL END USER(S)
Overall Satisfaction
Overall Satisfaction
323 Respondents
22 Respondents
35 Respondents
78% 83%
TechnicalAlignment
FunctionalAlignment
78% 83%Business Needs Alignment
Strategic Flexibility
87% 87%
69%Biannually
to Annually
Technical Adequacy for future Needs
Functional Adequacy for Future Needs
Adaptability Change Frequency
BUSINESS ENABLEMENT PRODUCT EFFECTIVENESS
81% 81%
78% 84%
Vendor Support Satisfaction
74% 74%
86% 93%
Support Effectiveness/Timeliness
Support Effectiveness/Timeliness
Support Expertise Support Expertise
81% N/A
Implementation & Setup
81% ?Speed & Ease of Implementation Speed & Ease of Setup
85% 78%
94% N/A
85% 78%
76% N/A
Platform Commitment
Product Commitment
Product Representation
Product Representation
Negotiation & Renewal Satisfaction
Negotiation & Renewal Satisfaction
Microsoft SharePoint 2010 Metrics Scorecard
GRO
UP
CRIT
ICAL
ITY
SCO
RE
MissionCritical
100%
33%
33% 100%
Important
Nice to Have
Unused
Extremely Ineffective Extremely Effective
OVERALL EFFECTIVENESS
HAZARDOUS
UNWANTED
CONTENTIOUS
QUESTIONABLE
EFFECTIVE
UNLEVERAGED
STATUS: MISALIGNED
STATUS: CHAMPION
End-Users IT Users Business Users
Legend
VENDOR EFFECTIVENESS
BusinessEnablement
Effectiveness
ProductEffectiveness
VendorEffectiveness
+ +
80%Mature
15%Growth
15%Death
Lifecyle Stage
CloudBought
Approach Location
80% 10% 5%Usability Features Data Quality
20%
0%
0%
0%
Necessary to Legal/Compliance
Necessary to Business Support
Indirectly Tied to Revenue
Directly Tied to Revenue
80%Completely Irrelevant
ALIGNMENT ON APPLICATION CRITICALITY & EFFECTIVENESS
Relevance63%
Completely Unique
85%Replaceable
Partial Overlap
Complete Overlap
15%
5%
UniquenessReplaceability
35%Irreplaceable
78%
81%
46%
Business Function Process AreaR&D
Sales
Customer ServiceAdministration
Marketing
ProductionIT
Distribution
HR
Industry Specifi c
Industry Specifi c
Finance
29
14
26
3
23
0
22
0
0
17
0
15
Respondents
Overall Satisfaction
Vendor Partnership
Company XPrepared for:Name, RoleNumber of Respondents: 100Number of Applications: 48
Last Updated: MMM,YYYY
Q: If the organization had to switch to another solution, what would be your top 3 things that you would want to keep about this solution?
Q: If you could change one thing about this application, what would it be?
† One or more questions were not answered for this category
Version control and version history have been absolutely critical. Access to SharePoint from home has been handy. Use as a communication tool for announcement has been handy.
Version control and version history have been absolutely critical. Access to SharePoint from home has been handy. Use as a communication tool for announcement has been handy.
I would need to maintain the customizability of the app, as well as the mobile capability at a bare minimum. Beyond that I would say integration with our ERP system would be fantastic.
I would need to maintain the customizability of the app, as well as the mobile capability at a bare minimum. Beyond that I would say integration with our ERP system would be fantastic.
It is often very diffi cult to fi nd what we are looking for. An FAQ page on how to navigate, search and use more advanced features would be very helpful.
It is often very diffi cult to fi nd what we are looking for. An FAQ page on how to navigate, search and use more advanced features would be very helpful.
Without a tech steward to represent what's possible and how to use it, and some governance/standards, we will continue to have best-effort, voluntarily assembled, and unreliable content in SharePoint.
Without a tech steward to represent what's possible and how to use it, and some governance/standards, we will continue to have best-effort, voluntarily assembled, and unreliable content in SharePoint.
Criticality
Criticality
Criticality
Criticality
Functional Capabilities
Functional Capabilities
Functional Capabilities
Functional Capabilities
Functional Alignment
Functional Alignment
Functional Alignment†
Functional Alignment†
Workfl ow/DataIntergration
Workfl ow/DataIntergration
Workfl ow/DataIntergration
Workfl ow/DataIntergration
Functional Reliability
Functional Reliability
Functional Reliability
Functional Reliability
Skills Capacity†
Skills Capacity†
Skills Capacity
Skills Capacity
JOHN DOE, BUSINESS ANALYST
JOHN DOE, BUSINESS ANALYST
USER GROUP :
USER GROUP :
Business Enablement Effectiveness
Business Enablement Effectiveness
Business Enablement Effectiveness
Business Enablement Effectiveness
Relevance
Relevance
LifecycleStage
LifecycleStage
ProductEffectiveness
ProductEffectiveness
ProductEffectiveness
ProductEffectiveness
VendorEffectiveness
VendorEffectiveness
VendorEffectiveness
VendorEffectiveness
89%
77%
83%
73%
89%
77%
83%
73%
73%
63%
72%
63%
57%
69%
53%
64%
78%
88%
78%
83%
73%
87%
86%
74%
74%
84%
75%
69%
Implementation
Implementation
Implementation
Implementation
Support
Support
Support
Support
Partnership
Partnership
Partnership
Partnership
90% 80% N/A
87% 78% N/A
89% 80% N/A
92% 76% N/A
Legend
Microsoft SharePoint 2010 – Comments & Respondent Breakdown