The gLite API – Part II

The gLite API – Part IIGiuseppe LA ROCCA INFN Cataniagiuseppe.larocca@ct.infn.it

ACGRID-II School2-14 November 2009 Kuala Lumpur - Malaysia

S E E-G R I D File ManagementJ a v a A P I

ver 1.3

Overview of the SEE-GRID File Management Java APIRequirements & Configuration

The Classes : LFCDataStorage, LFCDirectoryItem and LFCFileItemHands-on

Overview of the gLite DM API

Overview

• SEE-GRID File Management Java API supports most of the data management operations offered by LFC and LCG_UTILS C APIs.

• These Java API are compatible with LCG 2.7.x and gLite grid middleware.

• The initial version was created within SEE-GRID project

Available feature(s)• Uploading / Downloading files

from UI to grid

• Reading file information: permissions, GUID, comment

• Listing file replicas

• File management operations: – replicating files, deleting files

and file replicas, unregistering files and file replicas

• Reading directory information – Permissions, comment

• Listing directory contents

• Reading user and group ids for files and directories

• Reading user and group names for files and directories

• Reading filemode information as described in LFC C/C++ API manual

• Listing file/directory aliases

• Alias management operations (create/rename/delete)

• Reading file/directory date information

• Additional file management operations (rename/move)

• Directory management (create/rename/move)

• File/directory comment modification

• Listing of SE from BDII with the ability to ignore some SEs set in a properties file

• Directory management (delete)

Installation and Configuration /1

0.) First of all you have to install the following APIs:– GFAL C/C++ API– lcg_util C/C++ API– LFC C/C++ API– gLite FTS Java API

1.) Then you have to download the SEE-GRID File Management API (see references)

These APIs come with the last release of gLite middleware and should be already installed and configured by

your sys-admin.

2.) Set the CLASSPATH variable to contain the path of the SEE-GRID File Management API.

– Set the value of the VO variable with the name of your Virtual Organization

– Set the value of bdii.host.name and bdii.host.port

– Optionally, set the value of property SE.ignore.list with the list of SEs to be ignored when obtaining availables SEs from the BDII.

Installation and Configuration /2

$ cat repmngr.properties e.o, LFest Java API properties. This file's location needs to be in classpath.

## Name of Virtual OrganisationVO = gilda# List of available Storage Elements SEList = iceage-se-01.ct.infn.it

aliserv6.ct.infn.it se.hpc.iit.bme.hu gilda-02.pd.infn.it fn2.hpcc.sztaki.hu

# List of Storage Elements to ignore even if published

SE.ignore.list = egee016.cnaf.infn.it

bdii.host.name = gilda-bdii.ct.infn.itbdii.host.port = 2170

3.) Set the LCG_GFAL_INFOSYS and LFC_HOST variables as follow:

export LFC_HOST=lfc-gilda.ct.infn.it

export LCG_GFAL_INFOSYS=gilda-bdii.ct.infn.it:2170

Installation and Configuration /3

• LFCDataStorage class is an implementation of DataStorageInterface which provides information and access to data storage resources of a grid.

• LFCDirectoryItem class provides methods to retrieve directory information and data management.

• LFCFileItem class provides methods to retrieve file information and data management.

Listing directory content of a LFC

$ java LfcLs /grid/gilda/drwxrwxr-x 124 104 0 aula_griddrwxrwxr-x 124 104 0 aula_grid_11drwxrwxr-x 152 104 0 balaskodrwxrwxr-x 137 104 0 cdgdrwxrwxr-x 129 104 0 clermontdrwxrwxr-x 101 104 0 corsogriddrwxrwxr-x 112 117 0 emidio[..cut..]

Retrieve list of SE(s) from the BDII

Copy and register file(s) on the SE

$ java copyAndRegister /home/larocca/HEPIX/Api-Java-LFC-1.3/compile-exercises.sh \

/grid/gilda/tutorials \

compile-exercises.sh \

aliserv6.ct.infn.it

File /home/larocca/HEPIX/Api-Java-LFC-1.3/compile-exercises.sh copied and registed as: /grid/gilda/tutorials/compile-exercises.sh

Copy and register file(s) on the SE /2

Replicating files

$ java replicate

Replicate file to given SE.

Usage: java replicate <gridDestFileName> <target_SE>

$ java replicate

/grid/gilda/tutorials/compile-examples.sh vega-se.ct.infn.it

Replication successful: true

Replicating files

References• SEE-GRID File Management Java API Documentation

http://grid02.rcub.bg.ac.yu/LFCJavaAPI/files/docs/javadoc/version1.3/index.html

• Source code (version 1.3) [released 11/07/2007]

http://grid02.rcub.bg.ac.yu/LFCJavaAPI/files/downloads/SEE-GRIDFileManagementAPI-v1.3.zip

Hands-on

• Connect to the training infrastructure using the information reported in the tutorial sheet

• Run the hands-on available in this web link: http://www.euasiagrid.org/wiki/index.php/WMProxy_Java_API

• Enjoy!

$ cd ${HOME}/Api-Java-LFC-1.3To compile Java code run:

$ source compile-exercises.sh