FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America SRM + gLite IO Server install Emidio Giorgio INFN Catania First EELA Grid Tutorial for user and system administrators Madrid, 21.02.2006
Jan 19, 2016
FP6−2004−Infrastructures−6-SSA-026409
www.eu-eela.org
E-infrastructure shared between Europe and Latin America
SRM + gLite IO Server install
Emidio Giorgio
INFN Catania
First EELA Grid Tutorial for user and system administrators
Madrid, 21.02.2006
First EELA Grid Tutorial for user and system administrators 2FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
SRM + gLite IO server
• IO server is the gLite component in charge of handling user input-output request
• gLite IO server relies against a Mass Storage System implementing SRM interface
• gLite IO server comunicates with MSS through SRM• Tested MSS are CASTOR, dCache and DPM• So to use gLite IO you need an SRM too ! • Further details on DPM
– https://uimon.cern.ch/twiki/bin/view/LCG/DpmAdminGuide
First EELA Grid Tutorial for user and system administrators 3FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Dpm installation
First EELA Grid Tutorial for user and system administrators 4FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Installing DPM via apt
1. Verify if apt is present:– rpm -qa | grep apt– Install apt if necessary:
rpm -ivh http://linuxsoft.cern.ch/cern/slc30X/i386/SL/RPMS/apt-0.5.15cnc6-8.SL.cern.i386.rpm
2. Add gLite apt repository:– Put one of the following lines in a file (e.g. glite.list) inside the
/etc/apt/sources.list.d directory – rpm http://glitesoft.cern.ch/EGEE/gLite/APT/R1.5/ rhel30 externals
Release1.5 updates 3. Update apt repository:
– apt-get update – apt-get dist-upgrade
4. Install DPM server:– apt-get install glite-dpm-disk-server-config – apt-get install glite-dpm-server-mysql-config
Extra packages needed (non freely distributable) :
• J2SE v 1.4.2_08 JRE: http://java.sun.com/j2se/1.4.2/download.html
See http://glite.web.cern.ch/glite/packages/APT.asp
First EELA Grid Tutorial for user and system administrators 5FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
• Request host certificates for the box– https://gilda.ct.infn.it/CA/mgt/restricted/srvreq.php
• Copy host certificate (hostcert.pem and hostkey.pem) in /etc/grid-certificates.– chmod 644 hostcert.pem– chmod 400 hostkey.pem
• If planning to use certificates released by unsupported EGEE CA’s, be sure that their public key and CRLs (usually distributed with an rpm) are installed.– CA GILDA ones are available from https://gilda.ct.infn.it/RPMS/ca_GILDA-0.28.1.i386.rpm
Preliminary
First EELA Grid Tutorial for user and system administrators 6FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
gLite configuration – short reminder
• Configuration files– XML format– templates provided in /opt/glite/etc/config/templates
• Hierarchy of configuration file– Global configuration file– service specific configuration files
• Parameter groups– User parameters (‘changeme’)– Advanced parameters– System parameters
First EELA Grid Tutorial for user and system administrators 7FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Configuration
• Configuration comes through the execution of pyhton scripts, which takes as input xml files.
• So services have to be configured by editing these xml files
• Xml files are provided as templates, under /opt/glite/etc/config/templates
• Copy templates file to /opt/glite/etc/config
glite-dpm-server.cfg.xml glite-rgma-gin.cfg.xml
glite-global.cfg.xml glite-rgma-servicetool.cfg.xml
glite-dpm-disk-server.cfg.xml
glite-rgma-common.cfg.xml glite-security-utils.cfg.xml
vo-list.cfg.xml
First EELA Grid Tutorial for user and system administrators 8FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Other cfg.xml
• vo-list.cfg.xml– Fill with the information on the VO (VOMS) that the services will
support.• glite-rgma-common.cfg.xml
– Set the RGMA-server name(s) • glite-rgma-servicetool.cfg.xml
– Just the machine FQDN name on rgma.servicetool.sitename attribute
• glite-global.cfg.xml – General aspects. Typically just the JAVA_HOME attribute needs to
be changed, put in the location of your JVM
• glite-rgma-gin.cfg.xml– “NO” for both the attributes
• glite-security-utils.cfg.xml– Just set the cron.mailto attribute value
First EELA Grid Tutorial for user and system administrators 9FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
glite-dpm-disk-server.cfg.xml
• Provides configuration for the DPM clients (gsiftp, rfio)• An instance of dpm-disk-server must be running on
each machine exporting disk space• Preliminary
– Each “piece” of fs we want to export must stay on a separate partition, owned by the user running DPM client services
– So create a separate partition on filesystem– See command history for details
Key values : dpm-server.host : set to the DPM server FQDN (itself in this configuration)
dpns-server.host : set to the DPNS server FQDN (itself in this configuration)
Now we need to configure the DPM server…….
First EELA Grid Tutorial for user and system administrators 10
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
glite-dpm-server.cfg.xml
• Key values
– db.type mysql (don’t set root password and be sure that mysql server hasn’t…)
– disk-server.list : fill with list of disk server which are exporting filesystems (the box itself in this case)
– io-server.voname : name of vo in the IO server this DPM will support
– io-server.hostname : put the name of the machine which will run the IO server relying on this DPM (the box itself in this case)
– io-server.certificate.subject : the subject of IO server host certificate
First EELA Grid Tutorial for user and system administrators 11
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Commit configuration
• Once edited xml files, commit configuration for both disk-server and DPM server– cd /opt/glite/etc/config/scripts– ./glite-dpm-disk-server-config.py –-configure– ./glite-dpm-server-config.py –-configure– ./glite-dpm-server-config.py –-start– ./glite-dpm-disk-server-config.py –start
First EELA Grid Tutorial for user and system administrators 12
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Post configuration
• DPM server and disk-server are now running, but they are not exporting any part of filesystem
• We have to build the DPNS namespace, with the right permissions – dpns-mkdir– dpns-chmod– dpns-chown– dpns-setacl
• We should make aware DPM clients of which disk space they have to export– dpm-addfs– dpm-addpool
• The disk portion we’ll export should stay on a separate partition owned by the user running dpm (dpmmgr usually)
• See related history for deep details !
First EELA Grid Tutorial for user and system administrators 13
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
IO server Installation
First EELA Grid Tutorial for user and system administrators 14
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Installing gLite IO server via apt
1. Verify if apt is present:– rpm -qa | grep apt– Install apt if necessary:
rpm -ivh http://linuxsoft.cern.ch/cern/slc30X/i386/SL/RPMS/apt-0.5.15cnc6-8.SL.cern.i386.rpm
2. Add gLite apt repository:– Put one of the following lines in a file (e.g. glite.list) inside the
/etc/apt/sources.list.d directory – rpm http://glitesoft.cern.ch/EGEE/gLite/APT/R1.4/ rhel30 externals
Release1.4 updates 3. Update apt repository:
– apt-get update – apt-get dist-upgrade
4. Install DPM server:– apt-get install glite-io-server-config
Extra packages needed (non freely distributable) :
• J2SE v 1.4.2_08 JRE: http://java.sun.com/j2se/1.4.2/download.htmlSee http://glite.web.cern.ch/glite/packages/APT.asp
First EELA Grid Tutorial for user and system administrators 15
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
• Request host certificates for the box– https://gilda.ct.infn.it/CA/mgt/restricted/srvreq.php
• Copy host certificate (hostcert.pem and hostkey.pem) in /etc/grid-certificates.– chmod 644 hostcert.pem– chmod 400 hostkey.pem
• If planning to use certificates released by unsupported EGEE CA’s, be sure that their public key and CRLs (usually distributed with an rpm) are installed.– CA GILDA ones are available from https://gilda.ct.infn.it/RPMS/ca_GILDA-0.28.1.i386.rpm
Preliminary
First EELA Grid Tutorial for user and system administrators 16
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Configuration
• Configuration comes through the execution of pyhton scripts, which takes as input xml files.
• So services have to be configured by editing these xml files
• Xml files are provided as templates, under /opt/glite/etc/config/templates
• Copy templates file to /opt/glite/etc/config
glite-global.cfg.xml glite-rgma-servicetool.cfg.xml
glite-io-server.cfg.xml
glite-rgma-common.cfg.xml glite-security-utils.cfg.xml
First EELA Grid Tutorial for user and system administrators 17
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Other cfg.xml
• glite-rgma-common.cfg.xml– Set the RGMA-server name(s)
• glite-rgma-servicetool.cfg.xml– Just the machine FQDN name on rgma.servicetool.sitename
attribute
• glite-global.cfg.xml – General aspects. Typically just the JAVA_HOME attribute needs to
be changed, put in the location of your JVM
• glite-security-utils.cfg.xml– Just set the cron.mailto attribute value
First EELA Grid Tutorial for user and system administrators 18
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
glite-io-server.cfg.xml
• VO instance section(s) : for each VO served, need to configure an instance– init.CatalogType (fireman)– io-resolve-common.SeHostname (the name of SRM box)– io-resolve-common.SrmEndPoint SRM endpoint– io-resolve-common.RootPath DPNS namespace for the VO– io-resolve-common.SeProtocol rfio – io-authz-fas.FasEndpoint endpoint of Fireman catalogue– io-resolve-fireman.FiremanEndpoint = FasEndpoint– io-daemon.Port (< 9999)
• General section : service parameter (uid, gid)– init.username init.groupname uid—gid
First EELA Grid Tutorial for user and system administrators 19
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Post configuration
• Before committing configuration, is better to check the gridmap file is filled
• Put on /opt/glite/etc/glite-mkgridmap.conf a line for each served VO
• The vo users will be mapped so to the user running IO daemons
/opt/glite/etc/config/scripts/mkgridmap.py./glite-io-server-config.py --configure./glite-io-server-config.py --start
• Enjoy !
group vomss://voms.ct.infn.it:8443/voms/gilda?/gilda gliteio