ArcGIS Enterprise: Automating Installation and …...ArcGIS Enterprise: Automating Installation and Configuration, 2017 Esri Developer Summit Europe, 2017 Esri Developer Summit Europe--Presentation,

ArcGIS Enterprise: Automating

Installation and ConfigurationMatthias Schenker

Gerhard Trichtl

Overview

• What, Why, When?

• Enterprise Builder

• Unattend Installation

• Esri’s Chef Cookbooks

• Easy Cooking Demo

• Cloud Builder on Microsoft Azure

• Cloud Formation Builder on Amazon AWS

What, Why, When

RecoveryProduction

Dev QA

Why ArcGIS Enterprise Automation

• Business Critical Deployments

- Reliable and testable deployments and upgrades (DEV TEST PROD)

- Faster Disaster Recovery

- Moving between data centers

• Cloud Environments

- Quick configuration with Disposable machines

- Rapid Auto-Scaling

- Simplifies moving VMs between data centers

• Everybody

- Automate and become more efficient at administration

- Focus more on GIS tasks

- Prepares for larger scale and clouds

- Ready-to-use tools with minimum requirements to start

ArcGIS

ArcGIS

ArcGIS

Deploy Operate

SoftwareInstallation

SoftwareConfiguration

SoftwareOperation (HA,

DR)

OrgAdministration

ContentManagement

Analytics

Deploy - GIS Infrastruktur Automation

SoftwareInstallation

SoftwareConfiguration

SoftwareOperation (HA,

DR)

Software Setups, Enterprise Builder, Chef, Cloud formation, Cloud Builder

GIS Workflow Automation - Operate

OrgAdministration

ContentManagement

Analytics

Python API for ArcGIS, WebGISDR, Admin API,ArcPy, R-bridge for ArcGIS, …

ArcGIS Enterprise Software Setups

GIS Infrastructure Automation

ArcGIS Enterprise Builder

SoftwareSetups

ChefArcGIS Cookbooks

Quick start

Easy to use

Typical deployment pattern

Simple deployment

Limited control

Not for repeatable deployments

Reliable

Repeatable

Testable

Documented deployment

Full control

Cloud Builder for AzureAWS Cloud Formation

Preconfigured

Repeatable

Testable

Scaleable

Full control

ArcGIS Enterprise Deployment

+=

ArcGIS

Enterprise

Portal

for ArcGIS

ArcGIS

Server

ArcGIS

Data Store

+

ArcGIS

Web Adaptor

+

ArcGIS Enterprise Builder

ArcGIS Enterprise Builder

• All-in-one deployment

• One GUI setup, 5 or 6 parameters

• Easy to use

• A lot less configurations

• One deployment pattern for one machine quick start

• Not for a system that needs quickly redeployed

• Not a DR deployment?

ArcGIS Enterprise Builder – what gets installed/configured

Portal

for ArcGIS

Hosting

Server

ArcGIS

Data Store

(relational + tile cache)

ArcGIS

Web Adaptor

ArcGIS

Web Adaptor

Finish Installation

Import signed SSL-certificate into IIS and configure bindings of the WebSite

Optionally import the signed SSL-Certificate into ArcGIS Server and Portal for

ArcGIS

Follow UP:

Start customizatioin of your Portal

Start configuration of your Portal

Manually

Use Python API

ArcGIS Enterprise Software Setups

ArcGIS Enterprise Builder

SoftwareSetups

ChefArcGIS Cookbooks

Quick start

Easy to use

Typical deployment pattern

Simple deployment

Limited control

Not for repeatable deployments

Reliable

Repeatable

Testable

Documented deployment

Full control

Cloud Builder for AzureAWS Cloud Formation

Preconfigured

Repeatable

Testable

Scaleable

Full control

Software Setups –

Silent/Unattend Installation

ArcGIS Enterprise Software SetupsArcGIS Enterprise Software Setups

• No need to learn 3rd-party technology.

• Deploy exact the way you want

• Other Esri software

• Time consuming

• More manual steps

• Manual configurations following different docs

• One time task

• For customized deployments

• Not recommended for highly available and

scalable deployments

Silent Installation of ArcGIS Enterprise components

ArcGIS Server

http://server.arcgis.com/en/server/latest/install/windows/silently-install-arcgis-

server.htm

ArcGIS WebAdaptor for IIS

http://server.arcgis.com/en/web-adaptor/latest/install/iis/silently-install-arcgis-

web-adaptor-server.htm

ArcGIS Datastore

http://server.arcgis.com/en/data-store/latest/install/windows/install-data-

store.htm

Portal for ArcGIS

http://server.arcgis.com/en/portal/latest/install/windows/silently-installing-

portal-for-arcgis.htm

ArcGIS Enterprise Deployment Guide

Availible for each version of ArcGIS in combination with ArcGIS Pro

ArcGIS 10.3.1: http://support.esri.com/en/white-paper/2228

ArcGIS 10.4: http://support.esri.com/en/white-paper/3522

ArcGIS 10.4.1: http://support.esri.com/en/white-paper/3534

ArcGIS 10.5: http://support.esri.com/en/white-paper/3542

ArcGIS 10.5.1: http://support.esri.com/en/white-paper/3544

Covers also the integration in Microsoft System Management Server (SMS) or Microsoft

System Center Configuration Manager (SCCM)

Deployment Guide

Guide

Silent Installation of ArcGIS ServerREM Install ArcGIS Server 10.6

REM ==========================

set PROGPATH=%programfiles%

set PYTHONDRIVE=%SYSTEMDRIVE%

REM in case of DOMAIN-User those must already exists and would be specified with DOMAIN\Username

set USER=ArcGISService

set PWD=R3dland2

REM XML-Support - PreRequisite for ArcGIS Server

REM --------------------------------------------

msiexec /i ArcGISEnterprise_Windows\ArcGISServer\SetupFiles\Support\MSXML6\64-bit\msxml6_x64.msi /qb

REM Visual C++ 2017 - PreRequisite for ArcGIS Server

REM ------------------------------------------------

REM 32bit and 64bit needed

ArcGISEnterprise_Windows\ArcGISServer\SetupFiles\Support\VCREDIST\vc_redist.x64.exe /install /passive /norestart

ArcGISEnterprise_Windows\ArcGISServer\SetupFiles\Support\VCREDIST\vc_redist.x86.exe /install /passive /norestart

REM ArcGIS Server

REM =============

REM Optionale Parameter EXPORTCONFIG=Yes CONFIGPATH=%HOMEDRIVE%%HOMEPATH%\Desktop\arcgis_server_cfg.xml ADDLOCAL=GIS_Server,DotNetSupport

msiexec /i ArcGISEnterprise_Windows\ArcGISServer\SetupFiles\setup.msi /qb INSTALLDIR="%PROGPATH%\ArcGIS" INSTALLDIR1=%PYTHONDRIVE%\Python27

USER_NAME=%USER% PASSWORD=%PWD%

REM Geoevent Extension

msiexec /i ArcGISEnterprise_Windows\ArcGISGeoEventServer\SetupFiles\setup.msi /qb INSTALLDIR="%PROGPATH%\ArcGIS\Server\GeoEvent" PASSWORD=%PWD%

REM DataInteropt Server

msiexec /i ArcGISEnterprise_Windows\DataInteropServer\SetupFiles\setup.msi /qb INSTALLDIR="%PROGPATH%\ArcGIS"

REM WebAdaptor IIS

msiexec /i ArcGISEnterprise_Windows\WebAdaptorIIS\SetupFiles\setup.msi /qb WEBSITE_ID=1 VDIRNAME=ArcGIS106 ADDLOCAL=WebAdaptor

REM DB-clients

REM ==========

REM SQLServer NativeClient

msiexec /i DBMSSupportFiles\SQLServer2012SP3NativeClient_64\sqlncli.msi IACCEPTSQLNCLILICENSETERMS=YES /qb

REM SQLServer ODBC

msiexec /i DBMSSupportFiles\ODBC11SQLServer_64\msodbcsql.msi IACCEPTMSODBCSQLLICENSETERMS=YES /qb

msiexec /i DBMSSupportFiles\ODBC131SQLServer_64\msodbcsql.msi IACCEPTMSODBCSQLLICENSETERMS=YES /qb

Additionally the existing Patches could be applied within the setup

REM Patches ArcGIS Server 10.5.1

REM ============================

REM GeoAnalytics Server Patch

msiexec /p Patches\ArcGIS-1051-S-GS-Patch.msp REINSTALL=ALL REINSTALLMODE=omus /qb

REM SQLServer Patch

msiexec /p Patches\ArcGIS-1051-S-SSP-Patch.msp REINSTALL=ALL REINSTALLMODE=omus /qb

REM Flexera Patch

if %PROCESSOR_ARCHITECTURE%==AMD64 msiexec /i Patches\ArcGISFlexCVEx64.msi /qb

Silent Installation of Portal for ArcGISREM Install Portal for ArcGIS 10.6

REM ==============================

set PROGPATH=%programfiles%

REM in case of DOMAIN-User those must already exists and would be specified with DOMAIN\Username

set USER=ArcGISService

set PWD=R3dland2

REM ArcGIS Datastore

REM ================

REM Visual C++ 2017 - PreRequisite for ArcGIS Datastore

ArcGISEnterprise_Windows\ArcGISDataStore\SetupFiles\Support\VCREDIST\vc_redist.x64.exe /install /passive /norestart

ArcGISEnterprise_Windows\ArcGISDataStore\SetupFiles\Support\VCREDIST\vc_redist.x86.exe /install /passive /norestart

REM Parameter:

REM INSTALLDIR

msiexec /i ArcGISEnterprise_Windows\ArcGISDataStore\SetupFiles\setup.msi /qb INSTALLDIR="%PROGPATH%\ArcGIS" USER_NAME=%USER%

PASSWORD=%PWD%

REM Setup Store automatically

REM configuredatastore https://<server>:6443/arcgis/admin <siteadmin> <Pwd> C:\arcgisdatastore

REM Portal for ArcGIS

REM =================

REM Visual C++ 2017 - PreRequisite for Portal for ArcGIS

ArcGISEnterprise_Windows\PortalforArcGIS\SetupFiles\Support\VCREDIST\vc_redist.x64.exe /install /passive /norestart

ArcGISEnterprise_Windows\PortalforArcGIS\SetupFiles\Support\VCREDIST\vc_redist.x86.exe /install /passive /norestart

REM Parameter:

REM INSTALLDIR CONTENTDIR

msiexec /i ArcGISEnterprise_Windows\PortalForArcGIS\SetupFiles\setup.msi /qb INSTALLDIR="%PROGPATH%\ArcGIS"

CONTENTDIR=C:\ArcGISPortal USER_NAME=%USER% PASSWORD=%PWD%

REM WebAdaptor IIS

REM ==============

msiexec /i ArcGISEnterprise_Windows\WebAdaptorIIS\SetupFiles\setup.msi /qb WEBSITE_ID=1 VDIRNAME=Portal ADDLOCAL=WebAdaptor

ArcGIS Enterprise Software Setups

ArcGIS Enterprise Builder

SoftwareSetups

ChefArcGIS Cookbooks

Quick start

Easy to use

Typical deployment pattern

Simple deployment

Limited control

Not for repeatable deployments

Reliable

Repeatable

Testable

Documented deployment

Full control

Cloud Builder for AzureAWS Cloud Formation

Preconfigured

Repeatable

Testable

Scaleable

Full control

CHEF ArcGIS Cookbook

What is Chef

• Chef

- One of the most popular IT automation platforms

- Supported on Windows and Linux

- Provide tools to take on configuration files

• Chef Components

- Cookbook

- Attribute

- Chef-Server vs. Client

• How it works

- Install ready-to-use cookbooks and define the configuration

- Run chef with the configuration file

• Recipe

- Attributes

- Action

• Property Settings: Attributes

• Run-list

ArcGIS Cookbook Recipe

Define Your Own Properties

Define Your Own Run List

Supported ArcGIS Software

• Portal for ArcGIS

• ArcGIS GIS Server as Hosting Server

• ArcGIS Data Store

- General, spatialtemporal

• ArcGIS Web Adaptor

• ArcGIS GIS Server, Image Server, GeoAnalytics Server, GeoEvent Server

• And other Esri Software:

- ArcGIS Pro

- ArcGIS Insight

- ArcGIS Desktop

- ArcGIS License Manager

Easy Cooking Demo

Steps to get started with a single machine deployment with Chef

• Check out Esri Github Chef Cookbooks website – Currently v.3.1

https://github.com/Esri/arcgis-cookbook/wiki/Get-Started-With-ArcGIS-Cookbook

• Install the Chef Client (v. 12.x, Starting from 12.7)

- Chef client 13.* is not yet supported by ArcGIS Coobooks

• Copy ArcGIS Cookbooks to server and unzip to c:\chef

- https://github.com/Esri/arcgis-cookbook/releases/tag/v3.1.0

• Stage Setups and License Files

• Edit JSON configuration file to meet your own needs

- c:\chef\roles\webgis-windows.json

• Run chef-solo from command prompt ‘As Administrator’

- chef-solo -j C:\chef\roles\webgis-windows.json

Distributed Deployment using Chef Server

• Login to every machine and run Chef-Client

• Chef-Server

- Central repository

- Assign roles to every machine

- Run the recipes/updates accordingly

- Setting up:

- By yourself or

- Hosted solution

Distributed Deployment using Chef Server

ArcGIS Enterprise Software Setups

ArcGIS Enterprise Builder

SoftwareSetups

ChefArcGIS Cookbooks

Quick start

Easy to use

Typical deployment pattern

Simple deployment

Limited control

Not for repeatable deployments

Reliable

Repeatable

Testable

Documented deployment

Full control

Cloud Builder for AzureAWS Cloud Formation

Preconfigured

Repeatable

Testable

Scaleable

Full control

Cloud Builder for Azure

AWS Cloud Formation

ArcGIS Enterprise-Support for Cloud Provider

Etc…

ArcGIS Enterprise in der Cloud – customized Tools

Esri recommend to use for those platforms the provided

tools

ArcGIS Enterprise Software SetupsIn the Cloud

• AWS

Esri AMIs

Esri CloudFormation Templates

Python and Powershell scripts

•Microsoft Azure

Esri Images

Cloud Builder

•Highly recommend using our Images and tools

Customization based on our Images and tools

Details: AWS and Azure sessions

Amazon AWS

Requirements for a Deployment

Amazon Web Services Account (AWS-Account)

Hostname for the Domain with a DNS-Record

SSL-Certificate

Esri License

Deployment options

• ArcGIS Server Cloud Builder on Amazon WebServices

- https://server.arcgis.com/en/server/latest/cloud/amazon/overview-cloud-builder.htm

• Amazon CloudFormation templates

- https://server.arcgis.com/en/server/latest/cloud/amazon/deploy-arcgis-using-

cloudformation.htm

• AWS Managment Console

- https://server.arcgis.com/en/server/latest/cloud/amazon/use-aws-management-console-

with-arcgis-server.htm

Availible AMI‘s for ArcGIS 10.5.1:

- Esri ArcGIS Enterprise 10.5.1 on Ubuntu 16.0.4.2 LTS with PostgreSQL 9.5.3

- Esri ArcGIS Enterprise 10.5.1 with SQL Server 2016 (Windows 2016)

- Esri ArcGIS Enterprise 10.5.1 with SQLerver Express 2016 (Windows 2016)

• See also http://server.arcgis.com/en/server/latest/cloud/amazon/arcgis-server-

amis.htm

Overview of AMI’s

AWS Marketplace details of an AMI

See details:

https://aws.amazon.com/marketplace/pp/B01NGYK5KH/ref=portal_asin_url

Deploy ArcGIS Enterprise via AWS CloudFormation

Overview:

https://server.arcgis.com/en/server/latest/cloud/amazon/aws-cloud-formation-and-arcgis-

server.htm

Start Configuration

https://s3.amazonaws.com/arcgisstore1051/7333/docs/index.html

Configure Options

Microsoft Azure

Requirements for a Deployment

Azure Subscription

Hostname for the Domain with a DNS-Record

ArcGIS Enterprise Cloud Builder for Microsoft

Desktop Applikation on Windows

Download from website – see

http://server.arcgis.com/en/server/latest/cloud/azure/install-azure-cloud-builder.htm

SSL-Certificate

Esri License

Choose your type of Deployments

Choose location

ArcGIS Enterprise Software Setups

ArcGIS Enterprise Builder

SoftwareSetups

ChefArcGIS Cookbooks

Quick start

Easy to use

Typical deployment pattern

Simple deployment

Limited control

Not for repeatable deployments

Reliable

Repeatable

Testable

Documented deployment

Full control

Cloud Builder for AzureAWS Cloud Formation

Preconfigured

Repeatable

Testable

Scaleable

Full control

GIS Workflow Automation after Installation

OrgAdministration

ContentManagement

Analytics

Python API for ArcGIS, WebGISDR, Admin API,ArcPy, R-bridge for ArcGIS, …

Please Take Our Survey!

Download the Esri Events app

and go to DevSummit

Select the session you attended

Scroll down to the

“Feedback” section

Complete Answers,

add a Comment,

and Select “Submit”

Thank You to Our Generous Sponsor