How to How to Build, Build, Refresh, or Refresh, or Rebuild Rebuild Your Your Datacenter Datacenter on Time and on Time and Under Under
How to Build, How to Build, Refresh, or Refresh, or
Rebuild Your Rebuild Your DatacenterDatacenteron Time and on Time and
Under BudgetUnder Budget
5 Keys to Success5 Keys to Success
Comprehensive budget and timeline
Careful design and capacity planning
Savvy equipment purchasing
Choosing your contractors wisely
Effective construction and project management
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Getting StartedGetting StartedPreliminary questions to ask yourself:
Why am I undertaking this project?
What are my growth projections for the next 3 years?●Revenue●Servers and equipment
How much can I realistically afford to spend?
How am I going to fund this project?
How soon do I need the center to be operational?
What server form factors will the datacenter house?
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Budget and TimelineBudget and Timeline How much can I afford to spend?
How much do I want to spend?
Funding from operating cash vs. financing
Phases●Finding a location and signing a lease●Design●Purchasing equipment●Bid process and selecting contractors●Implementation and construction●Time to bring the center online after the last contractor finishes
Best and worst case timelines
Having a good “plan B”
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Sample Budget FrameworkSample Budget Framework Construction
Generator●Equipment & Install
UPS●Equipment & Install
HVAC●Equipment & Installation●Electrical
Electrical Contractor●Transformers●Lights●Circuits & Panels●Miscellaneous
Raised Flooring
Fire Suppression●Gas system●Wet Sprinklers●Pre-action dry pipe sprinklers
Security●Keycard access●Alarm and monitoring
Architectural Services
Misc. Professional Services
Fiber and/or Telecom Construction
Delivery and Rigging
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Choosing a LocationChoosing a LocationImportant Considerations:
Square footage requirements
Parking
Access to fiber / Internet connectivity
Electrical service capacity
Flex warehouse space vs. officeFlex warehouse space
●Much more affordable per sq. ft.●Be prepared to bear nearly all of the build-out costs
Office space●Landlord may bear some of the build-out space●Higher price per sq. ft. may be partially offset by lower upfront costs
Pitfall!
Choosing a location without affordable and readily available access
to fiber and Internet connectivity can greatly devalue your datacenter.
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Space LayoutSpace Layout Do I need an architect?
●Sealed drawings for permit process
Basic rooms required●Workshop / staging area●Main datacenter (server room)●Power / infrastructure room●Bathrooms
Recommended●Office space●Shipping and receiving area●Secure storage
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Capacity Planning & Design:Capacity Planning & Design: HVAC & HVAC &
Electrical SystemsElectrical SystemsHVAC Systems:HVAC Systems:
What types of servers do I use or plan to use?What types of servers do I use or plan to use?●What is their typical power draw (this relates to heat What is their typical power draw (this relates to heat dissipation)dissipation)●““Rated” heat dissipation vs. actualRated” heat dissipation vs. actual
Liebert vs. other brandsLiebert vs. other brands
Down flow air and raised floor vs. up flow air and ductworkDown flow air and raised floor vs. up flow air and ductwork
Split system vs. rooftopSplit system vs. rooftop
Choosing systems for main server and power rooms, staging Choosing systems for main server and power rooms, staging area, andarea, and offices offices
The bottom line – how many tons of cooling do I need?The bottom line – how many tons of cooling do I need?●N+1 redundancyN+1 redundancy
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Capacity Planning & Design:Capacity Planning & Design: HVAC & HVAC &
Electrical SystemsElectrical SystemsElectrical Systems:Electrical Systems:
What types of servers do I use or plan to use?What types of servers do I use or plan to use?●What is their typical power draw (this relates to heat dissipation)?What is their typical power draw (this relates to heat dissipation)?●““Rated” current draw vs. actual – empirical data is best if availableRated” current draw vs. actual – empirical data is best if available
480 volt vs. 208/120 volt power480 volt vs. 208/120 volt power●Powering HVAC equipmentPowering HVAC equipment●Transformers and harmonicsTransformers and harmonics
Sizing the generator(s)Sizing the generator(s)
UPS systemUPS system●Central vs. “in the rack”Central vs. “in the rack”●Sizing the UPSSizing the UPS●Runtime and expandabilityRuntime and expandability●Maintenance bypassMaintenance bypass
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Capacity Planning & Design:Capacity Planning & Design: HVAC & HVAC &
Electrical SystemsElectrical SystemsEssential Technologies:Essential Technologies:
K-Rated TransformersK-Rated Transformers●Handle non-linear loads Handle non-linear loads from computer power from computer power suppliessupplies●Standard transformer will Standard transformer will overheat and fail overheat and fail prematurelyprematurely●Manufactured with Manufactured with heavier gauge copper and heavier gauge copper and a double sized neutral a double sized neutral conductor conductor
Central UPS SystemCentral UPS System●More cost effective in the More cost effective in the long runlong run●More reliable than “in the More reliable than “in the rack” systemsrack” systems●More manageable – small More manageable – small units overload quickly units overload quickly
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Capacity Planning & Design:Capacity Planning & Design: HVAC & HVAC &
Electrical SystemsElectrical Systems
Pitfall! Underestimating the importance of properly sizing electrical and HVAC systems:
1) Do I need an engineer?2) How does this phase impact the rest of the project?3) How can I structure my build to minimize the impact of a mistake?
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Capacity Planning & Design:Capacity Planning & Design: Raised Floor & Raised Floor &
Cable Mgmt.Cable Mgmt. Tightly tied to HVAC and electrical planningTightly tied to HVAC and electrical planning
Cost comparison vs. ductwork for air deliveryCost comparison vs. ductwork for air delivery
Fire suppression concernsFire suppression concerns●Fire code may require under floor suppression, especially Fire code may require under floor suppression, especially with gas systemswith gas systems
Ramps, steps, and ADA accessibility concernsRamps, steps, and ADA accessibility concerns●Impact on overall square footageImpact on overall square footage
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Capacity Planning & Design:Capacity Planning & Design: Raised Floor & Raised Floor &
Cable Mgmt.Cable Mgmt.Essential Technology:Essential Technology:
Networking overhead, electrical under floorNetworking overhead, electrical under floor●Should I deliver networking cable under the floor?Should I deliver networking cable under the floor?
●Raised floors can become “cable graveyards”Raised floors can become “cable graveyards”●Overhead “ladders” recommended for network Overhead “ladders” recommended for network cablecable
●Excellent for delivering power circuits to racksExcellent for delivering power circuits to racks●Benefits for air distributionBenefits for air distribution
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Capacity Planning & Design:Capacity Planning & Design: SecuritySecurity
Keycard accessKeycard access
Multi-room access restrictionsMulti-room access restrictions
Secure storage area for equipmentSecure storage area for equipment
Biometrics – worth the cost?Biometrics – worth the cost?
Essential Technology:Essential Technology:
Centralized monitoring of security, climate, and various sensorsCentralized monitoring of security, climate, and various sensors
Cost effective to outsourceCost effective to outsource
Under-floor water detectionUnder-floor water detection
Detect condensate leaks from air conditioningDetect condensate leaks from air conditioning
Catch problems early to prevent disasterCatch problems early to prevent disaster
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Capacity Planning & Design:Capacity Planning & Design: Fire Detection & Fire Detection &
SuppressionSuppressionEssential Technology: Essential Technology:
Dual method smoke and fire detectionDual method smoke and fire detection●PhotoelectricPhotoelectric
●Chamber that gets clouded or obstructedChamber that gets clouded or obstructed●If light beam doesn't bounce back it alarmsIf light beam doesn't bounce back it alarms●““Sees" fireSees" fire
IonizationIonization●Invisible state of fireInvisible state of fire●No smoke but detects chemical change associated with fire No smoke but detects chemical change associated with fire in air moleculesin air molecules
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Capacity Planning & Design:Capacity Planning & Design: Fire Detection & Fire Detection &
SuppressionSuppression Clean agent gas systemsClean agent gas systems
●FM 200, FE-227, FE-25 – Halon replacementsFM 200, FE-227, FE-25 – Halon replacements●Single zone vs. multiple zone systemsSingle zone vs. multiple zone systems●Inspection and “fan test”Inspection and “fan test”●Training staff on usage and response to alarmsTraining staff on usage and response to alarms
Wet pipe sprinklersWet pipe sprinklers
Dry pipe “pre-action” sprinkler systemsDry pipe “pre-action” sprinkler systems
Complying with fire code and passing inspectionComplying with fire code and passing inspection
Cost comparisonCost comparison
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Savvy Equipment Purchasing:Savvy Equipment Purchasing: New vs. Used New vs. Used
New Equipment:New Equipment:
From manufacturers and resellersFrom manufacturers and resellers
Benefits of new equipmentBenefits of new equipment●Readily availableReadily available●Factory warrantiesFactory warranties●Latest technologyLatest technology●Less likely to have problems or be “DOA”Less likely to have problems or be “DOA”
Main drawback of new equipment – costMain drawback of new equipment – cost
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Savvy Equipment Purchasing:Savvy Equipment Purchasing: New vs. Used New vs. Used
Used Equipment:Used Equipment:
Used equipment is ideal for all non-critical or highly redundant Used equipment is ideal for all non-critical or highly redundant systemssystems
Reconditioned equipment in “like new” condition is a great Reconditioned equipment in “like new” condition is a great optionoption
Used equipment is available for things you might not expectUsed equipment is available for things you might not expect
Used and reconditioned raised flooring systems are readily Used and reconditioned raised flooring systems are readily availableavailable
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Savvy Equipment Purchasing:Savvy Equipment Purchasing: Sourcing Sourcing
Buying from your contractors vs. directBuying from your contractors vs. direct●What to procure yourselfWhat to procure yourself
●““Big” items – generator, datacenter HVAC units, Big” items – generator, datacenter HVAC units, central UPScentral UPS●Can save 10-20% on high cost itemsCan save 10-20% on high cost items
●What to let your contractors handleWhat to let your contractors handle●Miscellaneous electrical gear (panels, etc…), rooftop Miscellaneous electrical gear (panels, etc…), rooftop air conditioning units, construction materialsair conditioning units, construction materials
New equipment is also available on the secondary market New equipment is also available on the secondary market throughthrough vendors that also sell used vendors that also sell used
Creative sourcing on high dollar items can significantly reduce Creative sourcing on high dollar items can significantly reduce projectproject costs costs
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Choosing Your Contractors WiselyChoosing Your Contractors Wisely Selecting the companies for bidsSelecting the companies for bids
Preparing your RFPPreparing your RFP
Bidding out the jobsBidding out the jobs
Pitfall! Failing to provide sufficient detail to contractors and failing to get detailed proposals in writing.1) Avoid costly change orders as a result of “miscommunication”.2) Give yourself solid footing in the event of a dispute.
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Choosing Your Contractors WiselyChoosing Your Contractors Wisely Building solid relationshipsBuilding solid relationships
Interacting with and evaluating contractors during the bid Interacting with and evaluating contractors during the bid processprocess
How to evaluate bidsHow to evaluate bids●High and low bidsHigh and low bids●Evaluating “outliers”Evaluating “outliers”●Is the cheapest bid always the best?Is the cheapest bid always the best?
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Effective ConstructionEffective Construction & & Project Project ManagementManagementDo I need a General Contractor (GC)?Do I need a General Contractor (GC)?
GC’s and construction management GC’s and construction management companiescompanies
●What they offerWhat they offer●What they costWhat they cost●Why you might want oneWhy you might want one●How you can avoid themHow you can avoid them
Pitfall! Permit and inspection processes can cause significant delays in
your build.
If you choose to bypass the GC, which can substantially reduce project costs, make sure you choose contractors that are well connected and have a
thorough knowledge of the permit processes in your area.Especially important with construction, electrical, and fire
suppression.
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Effective ConstructionEffective Construction & & Project Project ManagementManagementCoordinating Contractors:Coordinating Contractors:
Project planningProject planning
Coordinating facility access for contractorsCoordinating facility access for contractors
Jobs are interdependentJobs are interdependent●ExamplesExamples
●Ductwork and sprinklers before Ductwork and sprinklers before ceilingsceilings●Electrical work required for Electrical work required for HVACHVAC●Electrical work before drywallElectrical work before drywall●Etc…Etc…
●Keeping things flowing in orderKeeping things flowing in order●Contractor meetingsContractor meetings
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Effective ConstructionEffective Construction & & Project Project ManagementManagementManaging Disputes and Accidents:Managing Disputes and Accidents:
Handling a dispute with a contractorHandling a dispute with a contractor●When to disburse paymentsWhen to disburse payments●Taking a hard line when necessaryTaking a hard line when necessary●Contingency plansContingency plans
AccidentsAccidents●Broken equipment, damage to Broken equipment, damage to facilitiesfacilities●How to protect yourselfHow to protect yourself●Insurance requirementsInsurance requirements
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Effective ConstructionEffective Construction & & Project Project ManagementManagement
Pitfall! Failing to hire a rigging company to manage delivery and placement of heavy equipment.
1) Hire a rigging company that is insured and experienced at receiving, handling, and delivering heavy machinery.2) Schedule delivery of large pieces to the rigging company.3) Have the rigging company deliver the equipment and set it in place in your datacenter.4) The rigging company should store the equipment until the proper time in the construction cycle
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Effective ConstructionEffective Construction & & Project Project ManagementManagementAfter the job is done, the work begins.After the job is done, the work begins.
Walkthroughs and punch-lists Walkthroughs and punch-lists
Final payment disbursementsFinal payment disbursements
Once your contractors finish, your work Once your contractors finish, your work beginsbegins
Factoring this piece into your timelineFactoring this piece into your timeline●Installing your networking gearInstalling your networking gear●Network cablingNetwork cabling●Staffing and monitoringStaffing and monitoring
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Must-have Technology SummaryMust-have Technology Summary
K-Rated TransformersK-Rated Transformers
Central UPS SystemCentral UPS System
Raised flooring with overhead network cablingRaised flooring with overhead network cabling
Central monitoring and under-floor water detectionCentral monitoring and under-floor water detection
Dual method smoke and fire detectionDual method smoke and fire detection
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005
Pitfall SummaryPitfall Summary
Choosing a location without affordable and readily available access to fiber and Internet connectivity can greatly devalue your datacenter.
Underestimating the importance of properly sizing electrical and HVAC systems.
Failing to provide sufficient detail to contractors and failing to get detailed proposals in writing.
Failing to hire a rigging company to manage delivery and placement of heavy equipment.
Permit and inspection processes can cause significant delays in your build.
HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005