Jan. 2006 Storage Resource Broker Managing Distributed Data in a Grid A discussion of a paper published by a group of researchers at the San Diego Supercomputer.

Jan. 2006Jan. 2006

Storage Resource BrokerStorage Resource BrokerManaging Distributed Data in a GridManaging Distributed Data in a Grid

A discussion of a paper published by a group of researchers at the

San Diego Supercomputer Center, UCSD

By: Nayef TRAD

INSA-Lyon

22Jan. 2006Jan. 2006

PLANPLAN

What is SRB?What is SRB?

SRB Features & CapabilitiesSRB Features & Capabilities

SRB communication in conjonction with SRB communication in conjonction with MCATMCAT

Federated SRB ZonesFederated SRB Zones

Why Federation?Why Federation?

Cons & ProsCons & Pros

N.T@INSA-Lyon

33Jan. 2006Jan. 2006

What is SRB?What is SRB?

SRB in a NutshellSRB in a Nutshell

A data grid solutionA data grid solutionA digital libraryA digital libraryA distributed but unified file systemA distributed but unified file systemAn advanced archival systemAn advanced archival systemA semantic WebA semantic WebA five nines availability resource brokerA five nines availability resource broker

N.T@INSA-Lyon

44Jan. 2006Jan. 2006

What is SRB? What is SRB?

Features In depthFeatures In depthThe SRB is a client-server middleware that uses datasets to build a logical name The SRB is a client-server middleware that uses datasets to build a logical name space for referencing distributed data.space for referencing distributed data.

The SRB provides a way to organize information stored on multiple heterogeneous The SRB provides a way to organize information stored on multiple heterogeneous systems into logical entities for ease of use.systems into logical entities for ease of use.

The SRB provides access to data stored on archival resources, file systems and The SRB provides access to data stored on archival resources, file systems and databases.databases.

The SRB also provides capabilities to store replicas of data, controlling and auditing The SRB also provides capabilities to store replicas of data, controlling and auditing access to documents and collections, which is also known by logical-to-physical access to documents and collections, which is also known by logical-to-physical mapping hence Metadata Catalogingmapping hence Metadata Cataloging

The SRB also provides a facility for co-locating data together using containers with The SRB also provides a facility for co-locating data together using containers with more flexibility in accessing and updating files and stores user-defined metadata at more flexibility in accessing and updating files and stores user-defined metadata at different levels for better search capabilities.different levels for better search capabilities.

N.T@INSA-Lyon

55Jan. 2006Jan. 2006

What is SRB?What is SRB?

SRB specific capabilitiesSRB specific capabilities

Support for the execution of remote operations.Support for the execution of remote operations.

Access controls and audit trails to control and track data usage

( MCAT )

Interacting with multiple types of storage systems, for its abstraction

User-friendly access through many ways like shells, scripts, libraries and web browsers

N.T@INSA-Lyon

66Jan. 2006Jan. 2006

SRB & MCATSRB & MCAT

N.T@INSA-Lyon

77Jan. 2006Jan. 2006

SRB communicationSRB communication

User

SRB Server A SRB Server BRequesting a file

1

2

MES

Contacting MES

DB Server3

Interpreting queries into SQL statements

4Returning DB query

5

Supplying the location of the file

6Contacting hosting server

7Sending requested file

N.T@INSA-Lyon

88Jan. 2006Jan. 2006

Federated SRB ZonesFederated SRB Zones

DB

SRB

Zone A Zone B

SRB

DB

Trust Relation

SRB Zones recognize the presence of each others and is able to interact, despite the independency of each zone which is forming a federation.

The overall federation is always viewed as a single logical namespace.

N.T@INSA-Lyon

99Jan. 2006Jan. 2006

Federated SRB ZonesFederated SRB Zones

Why Federation?Why Federation?

Federation enables fragmentation of MCAT DataBaseFederation enables fragmentation of MCAT DataBase When a system failure occurs that would bring down an MCAT fragment, When a system failure occurs that would bring down an MCAT fragment,

but shouldn’t affect the entire SRB, as the other sections will isolate the but shouldn’t affect the entire SRB, as the other sections will isolate the temporarily inaccessible server.temporarily inaccessible server.

Federation permits MetaData to reside closer to the resourceFederation permits MetaData to reside closer to the resource To reduce network latency, an MCAT server is hosted closer to the To reduce network latency, an MCAT server is hosted closer to the

resource; in turn the SRB performance improves on a network span basis.resource; in turn the SRB performance improves on a network span basis.

Federation enables the Virtual Organizations notion and makes it Federation enables the Virtual Organizations notion and makes it easier to merge newbies to the network, not to forget the ability of easier to merge newbies to the network, not to forget the ability of transferring and replicating documents across VOstransferring and replicating documents across VOs

N.T@INSA-Lyon

1010Jan. 2006Jan. 2006

Cons & ProsCons & Pros

ConsConsThat paper can be considered as a fine support for understanding That paper can be considered as a fine support for understanding the Data Grids Architecture.the Data Grids Architecture.

Experiencing such enormous projects describes the powerful and Experiencing such enormous projects describes the powerful and huge capabilities of an SRB.huge capabilities of an SRB.

ProsProsAbsence of citation of some important points, like SRB federation Absence of citation of some important points, like SRB federation and MCAT.and MCAT.

Redundancy of similar ideas and information along the examples Redundancy of similar ideas and information along the examples discussed.discussed.

N.T@INSA-Lyon

1111Jan. 2006Jan. 2006

Some Useful ReferencesSome Useful References

http://www.npaci.edu/dice/srb/http://www.npaci.edu/dice/srb/https://srb.npaci.edu/mySRB.htmlhttp://www.eudatagrid.org/grid/papers/data_mgt_grid2000.pdfhttp://www.npaci.edu/dice/srb/mcat.htmlhttp://www.srl.caltech.edu/nvo/http://www.ipac.caltech.edu/2mass/http://www.nbirn.net/

N.T@INSA-Lyon

1212Jan. 2006Jan. 2006

Here come troubles…Here come troubles…

Show me some Show me some MERCYMERCY while while SHOOTINGSHOOTING your your questionsquestions

Thank you !