1 FOR USE IN IEEL SOLUTION CLASS ONLY Intel® Manager for Lustre* Lustre Installation & Configuration Implementing an IEEL Solution Session 04 June 2014.

1 FOR USE IN IEEL SOLUTION CLASS ONLY

Intel® Manager for Lustre*Lustre Installation & ConfigurationImplementing an IEEL SolutionSession 04June 2014

FOR USE IN IEEL SOLUTION CLASS ONLY

Description of Lustre Installation Lab

• You will use IML Manager to deploy a Lustre file system

• Review Lustre best practices employed by IEEL

• Create a Lustre file system

• Mount Lustre v2.5 Clients

• Review IML monitoring a fully configured Lustre file system

For this lab you will need to access the IEEL Training Cluster via:• Browser (Recommended: Google Chrome v27 or Mozilla Firefox v22)• Terminal or Windows Putty Command Line Interface

FOR USE IN IEEL SOLUTION CLASS ONLY3High Performance Data Division

Lustre Installation and ConfigurationLustre Training Cluster

FOR USE IN IEEL SOLUTION CLASS ONLY4High Performance Data Division

Lustre Installation and ConfigurationIEEL Training Cluster ReviewLustre Installation Requirements

IML implements a set of Lustre Best Practices during Lustre

install• This puts specific requirements against the server hardware

configurations• Install Intel® EE for Lustre* only as described in the IEEL Partner

Installation Guide

Required operating system: Red Hat* Enterprise Linux v6.5 or CentOS v6.5

Network and DNS configuration: Confirm correct network and DNS (FQDNs).

• The management network interfaces must be properly configured and active

• Do not configure IP addresses for the HA crossover cable interfaces (server to target)

RAM and mass storage: Provide adequate memory and disk space

• Take advantage of the IEEL Partner support and request a review by Intel HPDD

• See “Determining Space Requirements” and “Determining Memory Requirements” in the Lustre Operations Manual.

FOR USE IN IEEL SOLUTION CLASS ONLY5High Performance Data Division

Server Configuration: Servers are configured in HA pairs, with a primary and secondary server • Storage servers should have SSH running with root login

permitted.• Non-root users should be prevented from logging into the storage

servers

• Do not install or configure Lustre, Corosync, or Pacemaker.

• Do not configure NTP on storage servers

• Do provide power control to the IML manager via either IPMI or PDU outlets

Storage Configuration: Read “Adding storage servers” in the IEEL Partner Installation Guide • Provide separate Volumes for the MGT and the MDT

• Shared storage for HA on MDT, MGT, OSTs

Lustre Installation and ConfigurationIEEL Training Cluster Review

Lustre Installation Requirements (cont)

FOR USE IN IEEL SOLUTION CLASS ONLY6High Performance Data Division

IML implements High Availability as a part of Lustre Best PracticesSee “Creating a new HA Lustre file system” in the IEEL Installation Guide

• Storage servers are deployed in a high availability (HA) configuration with shared storage.

• Servers are configured in primary and failover server pairs. When a server becomes unavailable, Lustre services that were running on that server are started on another server attached to the same storage.

• To support HA failover, each HA server must be able to automatically power-off its peer server if a failover is required.

• Powering off a faulty server is known as "node fencing”, and ensures that a shared storage device is not mounted by more than one server at a time.

Lustre Installation and ConfigurationHigh Availability Requirements

FOR USE IN IEEL SOLUTION CLASS ONLY7High Performance Data Division

IML implements High Availability as a part of Lustre Best PracticesSee “Creating a new HA Lustre file system” in the IEEL Installation Guide

• Provide shared storage for HA on MDT, MGT, OSTs • Each server of a failover pair must have access to exactly

the same LUNs as its peer. Each LUN is visible only to its two, paired failover servers.

• To properly enforce Lustre file permissions • The MDS must have the same UID/GID database access as the

Lustre clients• Using LDAP, the MDS’s must be configured to check for user

account information on both nodes to ensure proper

functionality in the event of a failover.

Lustre Installation and ConfigurationHigh Availability Requirements (cont)

FOR USE IN IEEL SOLUTION CLASS ONLY8High Performance Data Division

Diagram: MDS pair

FOR USE IN IEEL SOLUTION CLASS ONLY9High Performance Data Division

Diagram: OSS pair

FOR USE IN IEEL SOLUTION CLASS ONLY10High Performance Data Division

Lustre Installation and Configuration

FOR USE IN IEEL SOLUTION CLASS ONLY11High Performance Data Division

Clear IML Status

FOR USE IN IEEL SOLUTION CLASS ONLY12High Performance Data Division

Clear IML Status

FOR USE IN IEEL SOLUTION CLASS ONLY13High Performance Data Division

Server Configuration

FOR USE IN IEEL SOLUTION CLASS ONLY14High Performance Data Division

Server Actions

FOR USE IN IEEL SOLUTION CLASS ONLY15High Performance Data Division

Lustre Network Configuration

FOR USE IN IEEL SOLUTION CLASS ONLY16High Performance Data Division

Server Actions

FOR USE IN IEEL SOLUTION CLASS ONLY17High Performance Data Division

Volume Configuration

FOR USE IN IEEL SOLUTION CLASS ONLY18High Performance Data Division

Note: Due to virtualized environment Power Control is a virtual demonstration

Power Control – Add PDU/IPMI

FOR USE IN IEEL SOLUTION CLASS ONLY19High Performance Data Division

Creating a new MGT

FOR USE IN IEEL SOLUTION CLASS ONLY20High Performance Data Division

Creating a new MGT

FOR USE IN IEEL SOLUTION CLASS ONLY21High Performance Data Division

Creating a new MGT

FOR USE IN IEEL SOLUTION CLASS ONLY22High Performance Data Division

Create a new File System

FOR USE IN IEEL SOLUTION CLASS ONLY23High Performance Data Division

Create a new File System (cont)

FOR USE IN IEEL SOLUTION CLASS ONLY24High Performance Data Division

Create a new File System (cont)

FOR USE IN IEEL SOLUTION CLASS ONLY25High Performance Data Division

File system up and running

FOR USE IN IEEL SOLUTION CLASS ONLY26High Performance Data Division

HA management

FOR USE IN IEEL SOLUTION CLASS ONLY27High Performance Data Division

Advanced Settings

FOR USE IN IEEL SOLUTION CLASS ONLY28High Performance Data Division

Installing and mounting lustre clients

FOR USE IN IEEL SOLUTION CLASS ONLY29High Performance Data Division

Dashboard View

FOR USE IN IEEL SOLUTION CLASS ONLY30High Performance Data Division

Questions?