1 How to build and use a Cloud GIS Redlands, California March 8 th – 9 th, 2010 Web Mapping for Conservation Organizations Workshop.

11

How to build and use a Cloud GIS

Redlands, CaliforniaRedlands, CaliforniaMarch 8March 8thth – 9 – 9thth, 2010, 2010

Web Mapping for Conservation Organizations WorkshopWeb Mapping for Conservation Organizations Workshop

Why Cloud Computing?Why Cloud Computing?

• CheaperCheaper– Only pay for what you use when you need itOnly pay for what you use when you need it

– Based on hourly rate Based on hourly rate

– Terminate machines when they’re not needed anymoreTerminate machines when they’re not needed anymore

• Time to market is shorter than traditional cycleTime to market is shorter than traditional cycle– Procure hardwareProcure hardware

– Hardware setupHardware setup

– IT setupIT setup

– Software setupSoftware setup

– Application and Data loadingApplication and Data loading

– TestingTesting

Gov 2.0Gov 2.0 22

Ready to use in the cloudReady to use in the cloud

33Web Mapping for Conservation Organizations Workshop

Cloud Computing Types

Infrastructure As A Service

(IAAS)

Infrastructure As A Service

(IAAS)

Platform As A Service

(PAAS)

Platform As A Service

(PAAS)

Software As A Service

(SAAS)

Software As A Service

(SAAS)

Framework API (ex: Azure, Google App Engine)Framework API (ex: Azure, Google App Engine)

Web Services API (ex: Amazon)Web Services API (ex: Amazon)

Web Browser (ex: YouTube, SalesForce)Web Browser (ex: YouTube, SalesForce)

Amazon Web site tourAmazon Web site tour

Gov 2.0Gov 2.0 44

ArcGIS For Amazon AMI ArcGIS For Amazon AMI DemoDemo

Gov 2.0Gov 2.0 55

Emerging Usage PatternsEmerging Usage Patterns

• Based on Amazon Machine Based on Amazon Machine Image (AMI), launch a ready to Image (AMI), launch a ready to use Amazon Instanceuse Amazon Instance

• Publish ServicesPublish Services

• Small loadSmall load

• Single point of failure Single point of failure

Gov 2.0Gov 2.0 66

Emerging Usage PatternEmerging Usage Pattern

• Publish large number of Publish large number of servicesservices

• High LoadHigh Load

• High Availability High Availability

Gov 2.0Gov 2.0 77

Emerging Usage PatternsEmerging Usage Patterns

• On Premise system for daily On Premise system for daily use and editinguse and editing

• Cloud is used for publishing Cloud is used for publishing

Gov 2.0Gov 2.0 88

GeodatabaseGeodatabase replicationreplication

Over http/sOver http/s

Amazon Use CaseAmazon Use CaseHigh-Performance ComputingHigh-Performance Computing

Other Other Costs?Costs?

Amazon Use CaseAmazon Use CaseWeb Hosting with Occasional Traffic Spikes Web Hosting with Occasional Traffic Spikes

Gov 2.0Gov 2.0 1010

Other Other Costs?Costs?

Setup CostsSetup Costs

• Before the system is considered up and running for use.Before the system is considered up and running for use.

• Configuration and VerificationConfiguration and Verification– SoftwareSoftware

– DataData

• Data uploadData upload– Time Vs CostTime Vs Cost

– EC2 Vs S3EC2 Vs S3

Gov 2.0Gov 2.0 1111

Operating CostsOperating Costs

• Staging EnvironmentStaging Environment

• Testing Testing – FunctionalFunctional

– Load testingLoad testing

• Monitoring Monitoring

• TroubleshootingTroubleshooting

Gov 2.0Gov 2.0 1212

Maintenance CostsMaintenance Costs

• Data updatesData updates– Data upload costsData upload costs

– Data Testing and Data Testing and VerificationVerification

• Configuration ChangesConfiguration Changes– System capacitySystem capacity

– System featuresSystem features

• Managing load changesManaging load changes

Gov 2.0Gov 2.0 1313

Example ApplicationExample ApplicationDeployment in the Amazon CloudDeployment in the Amazon Cloud

• Hosted componentsHosted components– AGS Server w/ 3 servicesAGS Server w/ 3 services– Web ApplicationWeb Application

• Hosting requirementsHosting requirements– High AvailabilityHigh Availability– Data updatesData updates

Gov 2.0Gov 2.0 1414

Example ApplicationExample ApplicationDeployment ArchitectureDeployment Architecture

Gov 2.0Gov 2.0 1515

Elastic Load BalancerElastic Load Balancer Amazon S3Amazon S3

Example ApplicationExample ApplicationDeployment Cost ListDeployment Cost List

Gov 2.0Gov 2.0 1616

Amazon Service Cost model

3 Instances2 production1 staging

Hourly rate / instanceData In - out / GB

Elastic Load Balancer Data In – out / GB

2 EBS drives Hourly rate / GBData In – out / GB

S3 account Hourly rate / GBIn - out / GB

Project Use CasesProject Use CasesDataBasin Cloud Deployment ArchitectureDataBasin Cloud Deployment Architecture

Gov 2.0Gov 2.0 1717

ArcGIS ServersArcGIS Servers

Database Database ServersServers

Web ServersWeb Servers

Project Use CasesProject Use CasesAmazon S3 Deployment - Disconnected CacheAmazon S3 Deployment - Disconnected Cache

• User ArcGIS Server to create your own CacheUser ArcGIS Server to create your own Cache

• Upload to S3 as filesUpload to S3 as files

• Use AGS Server Flex, JS, or Silverlight APIs to point to the cache Use AGS Server Flex, JS, or Silverlight APIs to point to the cache filesfiles

• Pros:Pros:– CheaperCheaper

• Cons:Cons:– No query on this cache, setup another location for queriesNo query on this cache, setup another location for queries

– Cache completely cooked Cache completely cooked

• Example:Example:– http://marwa.s3.amazonaws.com/s3cache/s3cache.htmlhttp://marwa.s3.amazonaws.com/s3cache/s3cache.html

Gov 2.0Gov 2.0 1818

ArcGIS Server for Amazon JumpstartArcGIS Server for Amazon JumpstartA Professional Services PackageA Professional Services Package

• Available for users nowAvailable for users now

• Users bring their own ArcGIS Server licenses, and their own Amazon Users bring their own ArcGIS Server licenses, and their own Amazon account account

• Includes AMIsIncludes AMIs– ArcGIS Server .Net 9.3.1 sp1ArcGIS Server .Net 9.3.1 sp1– PosGres 8.3.8 GeoDatabasePosGres 8.3.8 GeoDatabase

• Includes 4 days of onsite consultingIncludes 4 days of onsite consulting– Amazon Web Services (AWS) orientationAmazon Web Services (AWS) orientation–   Create and validate sample ArcGIS Server services Create and validate sample ArcGIS Server services –   Create custom AMI based on supported configurationsCreate custom AMI based on supported configurations– High Availability and Scalability Architecture & more…High Availability and Scalability Architecture & more…

Gov 2.0Gov 2.0 1919