WHITE PAPER: THE PROCUREMENT OF NAVAL AND GOVERNMENT SHIPSAbstract The acquisition owarships, or specialist government ships, is a complex undertaking that is increasingly dependent on specialist skills that some governments may not possess within their own procurement organisations. This White Paper describes activities that may be undertaken as part oa ship procurement programme. While it applies primarily to naval and other government ships, the principles are also applicable to commercial vessels. Though the overall approach is centred on the development oa set ostructured requirements supported by rigorous cost modelling, other aspects othe approach can be pursued separately. The paper recognises the wide dierences between various national programmes and seeks to describe a generic approach that can be tailored to meet a government’s own specic requirements.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
“ The last ten percent of performance sought generates one-third of the cost
and two-thirds of the problems.” Augustine’s Law Number VII
1
Requirements can be dened in many ways and their use on a particular project will oten be guided
by the corporate governance demands o the organisation procuring the ship(s). The topic is one o
continual evolution as well as reliance on previous experience.
For example, up to the 1980s the norm or Government ships was to develop a detailed technical
specication that eectively xed the design and subsequent cost and perormance; the majority
o the risk being taken by the Customer. The use o Cardinal, or Key Point Specications turned the
balance through 180 degrees and eectively let the Customer with minimal input.
The 1990s saw the use o structured requirements emanating rom the National Aeronautics and
Space Administration (NASA) and European Space Agency. These sought to demarcate between
dening the use, outputs and characteristics required by the Sponsor and/or Customer (User Re-
quirements) and the System Requirements that may be owned by the system developer (Supplier),and which can be used to model an abstract solution to the ‘Need’.
However, it should be recognised that on some programmes the higher levels o the System
Requirements may be ‘owned’ by the Customer and the lower levels may be ‘owned’ by the Supplier.
The complexity o some programmes saw an even higher level o requirement being introduced, these
are the Key User Requirements, which then cascade down into User and System Requirements.
Some Deence organisations have now moved away rom Requirements and towards Capability
Acquisition. In reality this is another increment in a set o cascaded requirements, and denes the
‘Need’ in a dierent manner.
To some degree or other, all o the above provide a means o structured and auditable communication
between the Sponsor, Customer and Supplier. The detailed Customer technical specication
approach is successul providing the Customer has the expertise to develop the specication, but it
may not allow the Supplier scope to innovate. It also eectively xes the majority o the programme
cost, perormance and risk within the Customer’s sphere. It can be successul in procuring ships
where the Customer has the knowledge to carry out preliminary studies, or where the ships to be
procured are based on a known design and perormance.
1 Augustine’s Laws by Norman R Augustine ISBN 1-5634-7239-2
The Cardinal, or Key Point Specication reverses that position and with its higher level o denition
is most suited or simpler projects probably based on Military (MOTS) and/or Commercial O The
Shel (COTS) solutions.
So where does that leave us? Well, or any project to proceed a Sponsor must have a ‘Need’. Suitably
dened by the Customer in consultation with the uture End Users, this will eventually orm the basis
o an Oer rom one or more prospective Suppliers. The Requirement based approach is now
generally recognised as the most suitable or the use in a government contracting scenario where
there is a dened ‘Need’, and the Supplier has the skill and resources to provide a solution to ull
that ‘Need’.
Requirements Denition is probably the most crucial part o the project. Incorrect, inaccurate, or
excessive denition o requirements must necessarily result in schedule delays, wasted resources, or
Customer dissatisaction. The Requirements Analysis should begin with business or organisational
requirements and translate these into project requirements. I meeting stated requirements would be
unreasonably costly, or take too long, the project requirements may have to be traded, or de-scoped
through discussion between the parties involved.
Any discussion o requirements analysis methods will quickly become specic to the type o project
involved. Many industry areas have specic, proven techniques or obtaining thorough and accurate
denition o requirements. Sometimes it is useul to write a ‘Concept o Operations’ (CONOPS)
paper and/or a ‘Concept o Use’ paper as a way to aid the development o requirements.
A CONOPS paper addresses how the new ships will operate alone or as part o a task orce, and
in the context o the missions and tasks they are expected to undertake. A Concept o Use paper
would address how the internal organisation o the ship unctions during specic operations. For
example, the Concept o Use paper or an amphibious warare ship could describe how the
embarked orce would muster their personal kit, weapons and stores through debarkation and
eventual re-embarkation. Such a paper inorms the Requirements developers and designers and
aids the wider understanding o specialist subjects.
While the methods may dier, the principles remain the same across all types and sizes o projects.
The Requirements Analysis should cover the whole scope o the project, i.e., ship perormance,
sotware, logistics, project management, saety, environment, human resources, test and acceptance,etc.. It must be comprehensive and thorough and it must consider the views and needs o all the
stakeholders.
Using a Requirements based approach allows the Sponsor (and Customer) to control technical
developments without necessarily needing to know the ull complexities o the solutions. It will also
provide a logical basis or maintenance o the design intent and change management throughout
the whole lie cycle. It also ensures that stakeholder inputs and priorities are identied early.
Constructing an early set o User Requirements is essentially a modelling activity; taking the urther
Developed during World War 2 in Great Britain and the USA, Operational Research applies scientic
techniques to analyse the behaviour o complex systems. It is known as Operational Research in the
United Kingdom2 and as Operations Research in most other English-speaking countries, though OR
is a common abbreviation everywhere.
Operational Research is distinguished by its ability to look at and improve an entire system rather than
concentrating only on specic elements. Operational Research at its widest use is the application o
the methods o science to complex systems. It utilises mathematics, simulation and reasoning to
provide the answers to complex real-world systems. It can however bring advantage to the decision-
making process and support to business cases even when applied to less complex systems.
Operational Research is a method o examining the current and historical perormance o systems
and measuring that perormance against a set o parameters, or eectiveness measures. It is
creative in nature, and should trigger considerations o how the objectives could be better met, how
costs could be saved, and whether, indeed, that particular organisation should even be perorming
a given unction at all.
Operational Research should demonstrate that there has been a thorough examination o the need
or the investment, the perormance being achieved by the investment, the advisability o continuing
the investment, and alternative methods o achieving the same investment results. The comparison
and analysis o the results achieved by Operational Research and Programme Costing can be
combined into an activity known as a Combined Operational Eectiveness and Investment Appraisal(COEIA) study.
Examples where Operational Research will support the decision making process or a ship
programme are:
a. The size, range, speed, crew, costs and ship type needed to achieve a desired capability;
b. The ability to examine whether a capability is best achieved using ships o the same
type, a mix o types or even by using manned aircrat, or unmanned vehicles;
c. Consideration o geographic and environmental aspects to support the required
sea-days or deployed capability o the dierent platorm types being considered;
d. Comparisons looking at weapon types, munitions quantities, sensors and
the comparative advantages o hard versus sot kill;
e. Military operations involving the ‘new ships’ and other orce elements including
land, air and allied nations;
. Integrating the logistic support acilities and support requirements or the ship types and
numbers being considered. This could address the need to upgrade bases, increased use
o contractor support and the logistic costs or support against a desired level o availability;
g. Interaces with inormation technology systems ashore or in other air and sea vehicles;
h. Human resource aspects relating to training, retention, and gender mix and
career options, imposed by the ship types being considered;
i. Analyse the socio-economic impact o the dierent procurement options.
2 Operational Research is known as OA, or Operational Analysis, within the UK military and Ministry o Deence to avoid conusion with OR, which is taken to mean Operational Requirements
“ Getting it “wrong” at the outset dooms a program to delays, cost overruns,incessant oversight and realignment,
accusations of mismanagement,and perhaps even program cancellation
…and indictment.” US PODAC
3Program Manager 2001
From the very onset o a programme there is a need or cost estimating; how else will the overall
budget be set?
Initially the budget will be set by the results rom some early concept work, or by analysing similar
past programmes, or by using public data on other countries’ programmes. In reality there will be a
mix o activities to set the initial high-level budgets. Then as the programme moves along its early
phases the budgets will be rened in line with the developing requirements and the outputs o the
Operational Research. This renement will support the business case submissions or approval to
proceed to the next phase(s), until eventually there will be a budget to support the Production,
Operating and Disposal phases.
Given that the Operational phase takes around 70 percent o the whole programme budget, and thatmore than two thirds o whole lie costs are xed by the time that Denition has completed, it can be
seen that the oten limited unds expended during the early programme phases x the vast majority
o the whole lie programme costs (Production, Operating and Disposal). While these gures
are necessarily broad they do indicate that i attention is not paid to whole lie costs early in the
programme, as the programme extends there will be a signicant risk o major delays caused by
budget versus perormance problems.
Programme costing studies may address a number o specic areas, such as:
a. Research Balance o Investment;
b. Cost Capability Trade O;
c. Future Expenditure Plans;
d. Acquisition Strategy alternatives;
e. Investment Appraisal;
. Risk quantication;
g. Related equipment programmes;
h. Platorms and systems concept development;
i. Cost estimating;
j. Value engineering.
3 ‘Navy Develops Product Orientated Design and Construction Cost Model’, Program Manager, January 2001, by Dr Scott C Truver.
Inorming the cost studies will be assumptions regarding systems (Capability and Availability,
Reliability and Maintainability), build strategies, upkeep strategies, manning levels, standards,
procurement approach and mission options.
The cost studies will use the developing Requirements and will also eed into the development o
Requirements and support the Operational Research. The level to which any o the cost studies,
Requirements or Operational Research is conducted will be dependent on the complexity o the
Programme and the Customer’s own preerences. These are all tools to help de-risk the programme
and can be applied to various depths. What is important is to ensure that data interaces and
linkages exist between them.
A typical package o work or cost modelling would be:
a. Provide a baseline (independent estimate) against which dierent User Requirement sets
can be analysed in order to allow the Customer to decide on the best way orward.
The cost drivers can be identied and the work used to support trade studies.
Trade studies are required to obtain the best compromise between cost and capability.
These would address both acquisition costs and the whole lie costs. The outputs can
also be used to support business case submissions, and subsequently to allow tenders
to be compared;
b. Identiy gaps in the tenders and the likely costs o lling those gaps. A typical example
would be the provision o an adequate support package (spares, documentation and
training). Another area could be inrastructure, i.e., shore based acilities required to
operate and maintain the vessels. The tenders may not cover this, but it would be
a real cost to the programme;
c. Identiy risks to the programme and their potential cost impact should they mature.
A typical example would be exchange rate risk. This work would provide a starting point
or the Customer’s risk assessment.
Trade o studies can be as simple or as complex as required to meet the needs o a particular
programme. There are well-publicised examples o complex studies relating to the US National
Missile Deence debate to the more technically biased European Space Agency’s Aurora programmestudies into optical links versus radio requency communications links rom spacecrat.
The cost estimate should be built up using a proven cost model to estimate the build and whole lie
cost estimates. This cost model could be structured around the UK Ministry o Deence De Stan
08–140, Classication o weight groups or surace warships, or the similar US Department o
The Procurement Specication is an intrinsic part o the process o getting into contract, and must
not be seen as a stand-alone document. Its structure must link back to the Requirements such that
when tenders are being assessed the proposals can be evaluated against the Requirements. It has
to be seen as part o the overall process and should address the ollowing:
a. It should ensure that Tender Evaluation would be conducted in a systematic,
objective and auditable manner such that decisions can be justied;
b. It should ensure ull carry through o Requirements so that tenders can be assessed
to ensure that no Requirements or Conditions have been missed;
c. It should have an Evaluation Plan and Evaluation Guide developed in parallel, and the
sensitivity to the proposed assessment weightings should be modelled prior
to the Procurement Specication being issued;
d. It should be a ormally controlled document;
e. It should be capable o being broken down or distribution to the Tender Evaluation Team;
. It should allow or rapid ltering o tenders such that unsatisactory tenders can be
put aside, and the decision justied;
g. It should allow or the value (or money) to be evaluated and not just price alone;
h. Its compatibility with Tender Evaluation sotware (i being used) should be established;
i. It should ensure that like or like comparisons can be made between tenders. Examples
being the labour resources available to build ships in the stated timescale, or to allow
comparison o Whole Lie Cost between tenders?
j. It should be structured to aid the generation o reports supporting investment decisions,
and hence will reduce the workload on the Customer team, while still ensuring
ull auditability.
The eort expended in developing a cohesive Procurement Specication will bring benets bothduring the Tender Evaluation and Negotiation phases, as well as during the Contract Execution
phase. Like all o the other aspects o an acquisition programme it must be tailored to be compatible
with the complexity and risk o the overall programme. It may be possible to use the developing
Procurement Specication to ‘price’ the Project based on industry eedback, or by independent
Some organisations will provide the Tenderers with details o the Evaluation process and also some
inormation on key weightings; this can be helpul to both parties. The Evaluation must be done on
the basis o the tenders submitted and not on any extraneous inormation known or received unless
that inormation is received as clarication o a point raised with a Tenderer. Care must be taken
during the evaluation phase to treat the tenders, as commercial-in-condence. The Evaluating Team
member(s), or Panel must record the evaluation results in writing. Unsolicited proposals, or non-
compliant tenders cannot be evaluated as a part o the Tender Evaluation Plan, and it is under the
Programme Manager’s discretion i these are to be evaluated separately.
Non-compliant tenders should only come into consideration ater the evaluation o compliant tenders
has identied a ront-runner against which it can be compared. A non-compliant tender can be
dismissed or many reasons (or example, that the idea is considered unworkable; it is below an
acceptable standard; it oers no advantage to the Specication as issued; or it involves unacceptable
risks). A non-compliant tender should not be accepted i the other Tenderers could equally well havepriced the proposal had they known that it would be given consideration. I this was the case, it would
call into question the wording o the original Procurement Specication and the other Tenderers should
be invited to submit their corresponding oer.
Where a tender is ambiguous, or where the conditions set out in the ITT otherwise allow, the Evaluation
Team may seek to clariy with the Tenderer. Assumptions must not be made to ll in gaps in a tender.
I the tender is not clear in any aspect, clarication must be sought and recorded in writing. In some
cases it may be desirable to ask each o the Tenderers to give a presentation on their tender. It may
be appropriate to arrange site visits or a complicated, multi-disciplinary activity such as a ship
procurement programme. Inormation received at such presentations must be documented and can
be used in clarication. Tenderers must be treated equally and airly in respect o the opportunity to
give a presentation and the exchange o inormation arising out o submitted tenders.
Clarication must be completed beore the Tender Evaluation Report is nalised, so that tenders can
be properly ranked. While the basis or pricing may be claried, there must be no negotiation in relation
to the overall price submitted by a Tenderer. I a Tenderer was allowed to alter the price, the tender
process may be invalidated as a result. Price negotiation can be conducted under the auspices o
a ‘Revise and Conrm’ approach where there are still potential changes to the tender, or by ‘Best
and Final’, where no urther negotiation is envisaged. As a result o the evaluation the Tenderers will
be ranked in value-or-money order. Sensitivity analysis should be carried out where appropriate to
veriy the ranking where the selection is close. The rankings must be justiable on the basis o the
evaluation criteria that support the value or money recommendation.
The Tender Evaluation Report documents the way in which the tenders were evaluated, the
assessment o the tenders, the resulting ranked list o tenders and makes a recommendation to the
decision authority. It must also identiy any tenders that are unacceptable. It is an important record
or any uture review o how the tendering process was conducted and will be an important toolin debrieing the Tenderers. The report must be based on demonstrable evidence and the
inal recommendation should have been base lined using a sensitivity analysis. It should show the
strengths and weaknesses o all tenders evaluated and should contain actual and demonstrable
evidence. I there was not a clear winner how does the report justiy the recommendation to proceed?
Is there a basis or proceeding without undue risk? Perhaps in such cases the Customer may have
to re-visit the Requirements, budgets or timescales, and may have to go around the cycle, or a part
o it, again. In some cases the Procurement Strategy may have to be re-visited such that perhaps it
is decided to keep two Tenderers in competition or longer until a clear winner is identied.
What the Customer is looking to achieve is best value or money in ullling the ‘Need’. In a complex
process such as ship procurement ‘Value or Money’ does not rest solely on the price to deliver a ship.
It can take account o osets, retention o key skills, government industrial strategy and regional
polices. It can look at nancing options, technology transer, etc., all o which will have a bearing on
the nal decision on award o contact. A well developed and managed Evaluation process will aid
the decision making, but there will still be many areas where qualitative proessional judgment is
required in order to arrive at the nal recommendation.
A robust Tender Evaluation Report will support the debrieng o the unsuccessul Tenderers and
can also be a useul starting point with the successul Tenderer too. It supports the philosophy
o Continuous Improvement and will help all parties in the way in which uture programmes are
Larger navies can draw on signicant deence or government specialist support. Smaller naviesmay not have the national inrastructure to support the acquisition o complex ships. Yet the deence
supply industry is consolidating such that it can provide a turnkey service, albeit sometimes with
government support.
In order to ensure that the Customer retains the ‘Intelligent Decider’ role there is a trend towards
navies calling on the services o specialist companies that provide scientic, technical and programme
management skills. Such specialist services are committed to supporting the Customer in areas o
key skills, acilities or available manpower to meet the programme. The provision o Design
Assurance and Design Agent Services will underpin the Customer’s own skills. Design Assurance
will typically involve the provision o proessional services in the eld o Naval Architecture, Marine
and Combat Engineering. It may also need to provide skills in other areas such as Logistics, Human
Engineering, Materials, Saety, and Environmental. The output o Design Assurance will support the
development o a balanced set o Requirements, the development o the Procurement Specication
and Tender Evaluation Criteria, through to support to the Tender Evaluation process itsel.
The provision o Design Assurance may co-ordinate, but could also conduct laboratory or simulation
tests to support the development o Requirements, or Evaluation o bids. Examples being combat
system eectiveness, hydrodynamic estimates, vulnerability assessment, upper deck airfow,
removal routes and complementing. The aim o the Design Assurance provider(s) is to provide
condence to the Customer that what is being sought is compatible with the overall level o risk and
budgets, and also to ensure that the tenders are also capable o being technically delivered.
Once into contract the Design Assurance provider can review deliverables and provide an independent
view into the Customer team. Such support could include attendance at Design Reviews, review o
the design against the Requirements, assessment o the Supplier’s proposed acceptance activities,
and support to technical investigations. The scope o the Design Assurance role is innitely fexible,
and can be tailored precisely to complement the Customer’s own resources.
To understand the role o the Design Agent, it is necessary to establish the nature and scope
o the Ship Design Authority (SDA) role, and where it is to be established. An SDA is generally the
organisation with the authority or making decisions about the ship design and is responsible or ormally
signing o the design, and the achievement o that design, against the contract requirements.
Within the SDA, the overall responsibility or the saety and perormance o the design and the built ship
is normally vested in a single person. The SDA may change as the project progresses rom design
and build towards in-service. Once in service, the SDA is responsible or maintaining the saety and
perormance against the original requirements and design intent. It is also responsible or managing any
changes throughout the lie o the ship to ensure that saety and design intent are not compromised.
Acceptance starts at the very beginning o a programme, and should be seen as a continuous and
progressive activity throughout the whole programme. Lack o a sound approach to Acceptance
will cause major problems at the end o the programme between the Customer and Supplier,
and possibly between the Customer, Sponsor and the User. The key to a successul outcome is
good planning and expectation management exercised through the process o using a Requirement
based approach. Some key steps that will help to avoid problems are:
a. Start the process o getting acceptance rom the beginning o a project. Set the
expectation that at every key step o the process ormal sign-o procedures will be used.
Establishing and communicating an approach early will change the perception o ormal
acceptance rom a major event to just another step in the process;
b. Dene the acceptance criteria very early in the process. The Requirements (User and
System) should all have acceptance criteria, and the contract should state how the
Supplier would demonstrate the achievement. Clearly this is an evolutionary process
and some criteria may change over the course o a project, but it is the process that
is the key to a successul outcome;
c. Develop an Integrated Test Evaluation and Acceptance Plan (ITEAP) describing the
methodology and allowing the achievement o the Requirements to be identied
against the contract specications;
d. The Customer should prepare ormal closure documents collaboratively with both the
Supplier and Sponsor. Initiate the process o creating the documents well in advanceo the ormal closure meetings so that there is time to review, negotiate and revise.
These closure documents may well be signed o at dierent dates dependent on the
overall programme strategy. Both User and stakeholder involvement throughout
will be important;
e. Allow or some sign-os to have caveats, or comments. Because o the progressive
nature o Acceptance, and that there may be inter-links between events, the Customer
may be uneasy about giving ull sign o. As the project progresses the loose ends
will be cleared up. Any signicant unease must be dealt with as it occurs.
The Acceptance Plan should scope not only the tasks contracted to the Supplier, but may also include
downstream acceptance or weapons, communications, ranging etc, or which the Supplier may
not have had ull, or any, contractual responsibility. In addition to the close out o the Requirements
through a ormal Acceptance Plan, there will also be the lower level acceptance o the ship associated
with eatures that were not totally dened within a Requirement. Despite the use o Design Reviews,
Walk Through Models and Simulations, etc., there will invariably be some aspects o the ship that the
Customer is not happy with. These will have to be dealt with as they are identied, and a pragmatic
There will be occasions when the Customer cannot agree ull Acceptance, but the ship is suciently
completed to continue with downstream programme activities. This will have to be agreed between
the Customer, Supplier and User in light o the overall benets, or risks, to the programme. The status
o each party’s outstanding obligations will have to be careully recorded, as will any impact on the
contact liability.
WARRANTY MANAGEMENT
The warranty period will vary between dierent contracts. Sometimes it will be a straightorward
warranty against deects arising, other options may seek to achieve a set level o availability, or specic
aspect o perormance. The selection o warranty will infuence the price, as the Supplier will need
to hedge the risk. Within the warranty period there will probably be the on-going need to close out
acceptance issues that carried over rom the contract acceptance agreement. These could includeclearing agreed deects and the close out o caveats and conditions to acceptance events.
The Customer and Supplier need to have an agreed process or the close out o pre-warranty actions,
and the management o new warranty claims as they arise. In the warranty period the ship may
be out o area and not available to the Supplier. Ship sta may well be required to undertake
the remedial work using spares provided under the contract. Alternatively a local contractor may
be required to provide assistance to a warranty event, or the Classication Society Surveyor may
become involved. The process must address all likely situations and have people responsible or
making decisions with the inormation available. Inormation capture is important, as this will impact
the downstream agreement o liability and costs. The action taken to correct a problem must be
captured to ensure that the possible implications on saety, operability or subsequent ships are ully
understood. There will be a need to ensure that there is a positive interace with the conguration
management process as documentation, handbooks and spares holdings etc may need to be
updated. The Ship Design Authority may need to be involved i any changes impact on the design
intent, or saety o the ship.
Active warranty management will bring benets to the introduction into service o the rst o class