Jan. 2006 Storage Resource Broker Managing Distributed Data in a Grid A discussion of a paper published by a group of researchers at the San Diego Supercomputer.
Post on 29-Dec-2015
213 Views
Preview:
Transcript
Jan. 2006Jan. 2006
Storage Resource BrokerStorage Resource BrokerManaging Distributed Data in a GridManaging Distributed Data in a Grid
A discussion of a paper published by a group of researchers at the
San Diego Supercomputer Center, UCSD
By: Nayef TRAD
INSA-Lyon
22Jan. 2006Jan. 2006
PLANPLAN
What is SRB?What is SRB?
SRB Features & CapabilitiesSRB Features & Capabilities
SRB communication in conjonction with SRB communication in conjonction with MCATMCAT
Federated SRB ZonesFederated SRB Zones
Why Federation?Why Federation?
Cons & ProsCons & Pros
N.T@INSA-Lyon
33Jan. 2006Jan. 2006
What is SRB?What is SRB?
SRB in a NutshellSRB in a Nutshell
A data grid solutionA data grid solutionA digital libraryA digital libraryA distributed but unified file systemA distributed but unified file systemAn advanced archival systemAn advanced archival systemA semantic WebA semantic WebA five nines availability resource brokerA five nines availability resource broker
N.T@INSA-Lyon
44Jan. 2006Jan. 2006
What is SRB? What is SRB?
Features In depthFeatures In depthThe SRB is a client-server middleware that uses datasets to build a logical name The SRB is a client-server middleware that uses datasets to build a logical name space for referencing distributed data.space for referencing distributed data.
The SRB provides a way to organize information stored on multiple heterogeneous The SRB provides a way to organize information stored on multiple heterogeneous systems into logical entities for ease of use.systems into logical entities for ease of use.
The SRB provides access to data stored on archival resources, file systems and The SRB provides access to data stored on archival resources, file systems and databases.databases.
The SRB also provides capabilities to store replicas of data, controlling and auditing The SRB also provides capabilities to store replicas of data, controlling and auditing access to documents and collections, which is also known by logical-to-physical access to documents and collections, which is also known by logical-to-physical mapping hence Metadata Catalogingmapping hence Metadata Cataloging
The SRB also provides a facility for co-locating data together using containers with The SRB also provides a facility for co-locating data together using containers with more flexibility in accessing and updating files and stores user-defined metadata at more flexibility in accessing and updating files and stores user-defined metadata at different levels for better search capabilities.different levels for better search capabilities.
N.T@INSA-Lyon
55Jan. 2006Jan. 2006
What is SRB?What is SRB?
SRB specific capabilitiesSRB specific capabilities
Support for the execution of remote operations.Support for the execution of remote operations.
Access controls and audit trails to control and track data usage
( MCAT )
Interacting with multiple types of storage systems, for its abstraction
User-friendly access through many ways like shells, scripts, libraries and web browsers
N.T@INSA-Lyon
77Jan. 2006Jan. 2006
SRB communicationSRB communication
User
SRB Server A SRB Server BRequesting a file
1
2
MES
Contacting MES
DB Server3
Interpreting queries into SQL statements
4Returning DB query
5
Supplying the location of the file
6Contacting hosting server
7Sending requested file
N.T@INSA-Lyon
88Jan. 2006Jan. 2006
Federated SRB ZonesFederated SRB Zones
DB
SRB
Zone A Zone B
SRB
DB
Trust Relation
SRB Zones recognize the presence of each others and is able to interact, despite the independency of each zone which is forming a federation.
The overall federation is always viewed as a single logical namespace.
N.T@INSA-Lyon
99Jan. 2006Jan. 2006
Federated SRB ZonesFederated SRB Zones
Why Federation?Why Federation?
Federation enables fragmentation of MCAT DataBaseFederation enables fragmentation of MCAT DataBase When a system failure occurs that would bring down an MCAT fragment, When a system failure occurs that would bring down an MCAT fragment,
but shouldn’t affect the entire SRB, as the other sections will isolate the but shouldn’t affect the entire SRB, as the other sections will isolate the temporarily inaccessible server.temporarily inaccessible server.
Federation permits MetaData to reside closer to the resourceFederation permits MetaData to reside closer to the resource To reduce network latency, an MCAT server is hosted closer to the To reduce network latency, an MCAT server is hosted closer to the
resource; in turn the SRB performance improves on a network span basis.resource; in turn the SRB performance improves on a network span basis.
Federation enables the Virtual Organizations notion and makes it Federation enables the Virtual Organizations notion and makes it easier to merge newbies to the network, not to forget the ability of easier to merge newbies to the network, not to forget the ability of transferring and replicating documents across VOstransferring and replicating documents across VOs
N.T@INSA-Lyon
1010Jan. 2006Jan. 2006
Cons & ProsCons & Pros
ConsConsThat paper can be considered as a fine support for understanding That paper can be considered as a fine support for understanding the Data Grids Architecture.the Data Grids Architecture.
Experiencing such enormous projects describes the powerful and Experiencing such enormous projects describes the powerful and huge capabilities of an SRB.huge capabilities of an SRB.
ProsProsAbsence of citation of some important points, like SRB federation Absence of citation of some important points, like SRB federation and MCAT.and MCAT.
Redundancy of similar ideas and information along the examples Redundancy of similar ideas and information along the examples discussed.discussed.
N.T@INSA-Lyon
1111Jan. 2006Jan. 2006
Some Useful ReferencesSome Useful References
http://www.npaci.edu/dice/srb/http://www.npaci.edu/dice/srb/https://srb.npaci.edu/mySRB.htmlhttp://www.eudatagrid.org/grid/papers/data_mgt_grid2000.pdfhttp://www.npaci.edu/dice/srb/mcat.htmlhttp://www.srl.caltech.edu/nvo/http://www.ipac.caltech.edu/2mass/http://www.nbirn.net/
N.T@INSA-Lyon
top related