Developing Key Performance Indicators Developing Key Performance Indicators Developing Key Performance Indicators Developing Key Performance Indicators for the R&D Programs using Logic Model for the R&D Programs using Logic Model for the R&D Programs using Logic Model for the R&D Programs using Logic Model and Matrix Map and Matrix Map and Matrix Map and Matrix Map Ji Ji hyun hyun Park Park , Researcher ( , Researcher ( [email protected][email protected]) ) Sang Sang ki ki Jeong Jeong , Director ( , Director ( [email protected][email protected]) ) Dong Dong hoon hoon Oh, Research Fellow ( Oh, Research Fellow ( [email protected][email protected]) ) November 3 2006 November 3 2006 R&D Industry & Infrastructure Evaluation Team of R&D Evaluation Center Korea Institute of Science and Technology Evaluation and Planning (KISTEP)
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
for the R&D Programs using Logic Model for the R&D Programs using Logic Model for the R&D Programs using Logic Model for the R&D Programs using Logic Model
and Matrix Mapand Matrix Mapand Matrix Mapand Matrix Map
Main projectsMain projectsPrivate projectsPrivate projects
Performance indicators at the projects levelsPerformance indicators at the projects levelsPerformance indicators at the projects levelsPerformance indicators at the projects levels
Example : Performance indicators from the logic model (Bio area)
·Social cognition
about importance
of Bio-tech
·International
competitiveness
·Promoting application of future genetic resources
·Public concerns about
national security and
bioethics etc. related
with Bio tech
·Status of industry-
academic cooperation and
information network
·Gov/private investment
·Portion of investment of BT
in a whole R&D investment
·Human resources involved
in BT research area
·Ratio of high level HR
·Research
facilities and
information
systems
· Related system and laws ·Ratio of R&D budget
depending on various
standards
·Development high, new
and fusion technologies
(papers, patent etc.)
·Development of HR and research institutions in BT area·Construction of research centers/bio-complex·Building R&D hubs for international cooperation and attracting international co.·Protection of system maintenance such as national safety, bio ethics and intellectual property rights·Application of bio resources
·Fostering ventures and
small co.
·Utilization and
commercialization of BT
·Revitalization of tech transactions
business to business
·Success rates of utilization and
commercialization
·Rates of government
investment
·Market share by creating
high values
·Analyzing in a view of
industrial economy
·Utilizing systems such as
evaluation system
·Extending the share of the market (Effect of industry development)·Improving productivity (Effect of reducing costs)
·Informing about Bio tech to people
·Establishing c-GMP and bioplants
·Strengthening international basis for clinical study
·Certifying safety of LMOs
·Internal bio tech degree comparing with
developed countries
·Advanced bio technology
·Ratio of BT industry among the main
strategic industries
·Important strategic tech in BT industry
·Minimizing redundancy and
duplication
·Establishing related policies
·Upgrade of R&D capacity
·Diffusion of research results
(Public relations etc.)
·Improvement of specialties in BT area·Utilization of network such as information & facilities·Construction of international cooperation system·Standardization and internationalization of BT·Preservation of bio resources for the national benefits
Back
ground
Input
Activity
Output
Out
come
External
factors
Infrastructure
Policy
Issues
Government
Policies
Uncertainty
of R&D
Social
interests
국가적 차원의 종합
조정
Expanding R&D areas and
concentrating on selected areas
Strengthen
ing HRD
in BT
Supplying
research
facilities
Global
networking
System
maintenance
Overall Coordination
Arranging
program
system
Fostering
intensively BT
industry
R&D Industrialization Infrastructure
R&D priority
setting and
coordination
-Biotechnology promotion law
-Biotechnology promotion plan
Positioning R&D programs in a
group of area on the Matrix
Setting up key performance indicators
of each area and utilizing other area’s
indicators as indirect performance
indicators
Setting up Key Performance Indicators on the Matrix
Need for analysis of specific characteristics in different areas
Area
-Too concentrated on public & basic research
-Benefits are invisible in spite of investment
-Long-term planning is necessary
Aerospace & astronomy
-Influenced on international restriction such as national energy safety & the Climatic Change Convention
-Too strong on public research Energy
-Development of industry is very fast
-Progressed rapidly fusion interlaboratory
-Nongorvernment lead area
Information & Communication
-Too strong on public goods
-Influenced on the law, system and restriction
-A technology intensive industry
Environment
-No key trends due to various area involved
-low level infrastructureAgriculture & Forestry
-Many beneficiaries should be satisfied in a short time
-Public area needs for research on aging society
-Ongoing information industrialization is necessary to open health care information
Health care
-Basic industrial technology
-A technology intensive industry in various area
-Outputs are produced in short term
Machinery & Materials
-Government lead mass programs
-Strongly influenced by government on decision making such as construction of new town and highway
-Too concentrated on centralization of capital
Construction & Transportation
Technological & Industrial Characteristics
Example : Key Performance Indicators
• Performance indicators of Bio·Health area
• Technology (know-how) transfer• Strengthening health care technology• Increasing competitiveness of health industries • Information industrialization Information industrialization Information industrialization Information industrialization • Improve customer satisfaction for public service Improve customer satisfaction for public service Improve customer satisfaction for public service Improve customer satisfaction for public service
• Papers• Patents• Effect on making social & economic profits • Advances in technology development• Public based technology • Reinvigorate local economy• Productivity increase• Development of human resources in bio·health area• International cooperative research • Construction and utilization of research facilities
Key Performance
Indicators
Indirect Performance
Indicators
Analysis of technical & Analysis of technical & Analysis of technical & Analysis of technical & Analysis of technical & Analysis of technical & Analysis of technical & Analysis of technical & industrial industrial industrial industrial industrial industrial industrial industrial
characteristics of R&D characteristics of R&D characteristics of R&D characteristics of R&D characteristics of R&D characteristics of R&D characteristics of R&D characteristics of R&D areaareaareaareaareaareaareaarea
Process of developing R&D program performance indicators
Logic model of Logic model of Logic model of Logic model of Logic model of Logic model of Logic model of Logic model of individual programindividual programindividual programindividual programindividual programindividual programindividual programindividual program
Standard Standard Standard Standard Performance Performance Performance Performance IndicatorsIndicatorsIndicatorsIndicators
Standard Standard Standard Standard Standard Standard Standard Standard Performance Performance Performance Performance Performance Performance Performance Performance IndicatorsIndicatorsIndicatorsIndicatorsIndicatorsIndicatorsIndicatorsIndicators
Logic model from R&D Logic model from R&D Logic model from R&D Logic model from R&D Logic model from R&D Logic model from R&D Logic model from R&D Logic model from R&D Policy & National Policy & National Policy & National Policy & National Policy & National Policy & National Policy & National Policy & National
master planmaster planmaster planmaster planmaster planmaster planmaster planmaster plan
Introduction of ‘R&D commercialization for Genome’ program
• Objectives :
- Establish infrastructure for national resources and high tech medical technology
- Promote advanced clinical technology through disease research
- Realize genomic medicine by the predictive and tailored medicine
• Period : 2001∼2010
• Budget : 1,220 billion
• Flow of activities
1111st st st st (01~03) 2222nd nd nd nd (04~07) 3th 3th 3th 3th (08~10)Commercialization of genomic
research
4th(11~15)
Simulation of commercialized
techniques
Genetic analysis related life and
disease
• Program contents
- Planning to analyze Korean genome
- Genome based R&D commercialization
- Development of applied and predictive technology
- Analysis of genes which are related with life cycle and diseases
Establishment of infrastructure for genomic research