Performance and Scalability of xrootd Andrew Hanushevsky (SLAC), Wilko Kroeger (SLAC), Bill Weeks (SLAC), Fabrizio Furano (INFN/Padova), Gerardo Ganis (CERN) Jean-Yves Nief (IN2P3), Peter Elmer (U Wisconsin) Les Cottrell (SLAC), Yee Ting Li (SLAC) Computing in High Energy Physics 13-17 February 2006 http://xrootd.slac.stanford.edu xrootd is largely funded by the US Department of Energy Contract DE-AC02-76SF00515 with Stanford University
Performance and Scalability of xrootd. Andrew Hanushevsky (SLAC), Wilko Kroeger (SLAC), Bill Weeks (SLAC), Fabrizio Furano (INFN/Padova), Gerardo Ganis (CERN) Jean-Yves Nief (IN2P3), Peter Elmer (U Wisconsin) Les Cottrell (SLAC), Yee Ting Li (SLAC). Computing in High Energy Physics - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Performance and Scalability of xrootd
Andrew Hanushevsky (SLAC),Wilko Kroeger (SLAC), Bill Weeks (SLAC),
Fabrizio Furano (INFN/Padova), Gerardo Ganis (CERN)Jean-Yves Nief (IN2P3), Peter Elmer (U Wisconsin)
Les Cottrell (SLAC), Yee Ting Li (SLAC)
Computing in High Energy Physics
13-17 February 2006 http://xrootd.slac.stanford.edu xrootd is largely funded by the US Department of Energy
Contract DE-AC02-76SF00515 with Stanford University
CHEP 13-17 February 2006 2: http://xrootd.slac.stanford.edu
Outline
Architecture Overview Performance & Scalability
Single Server Performance Speed, latency, and bandwidth Resource overhead
Scalability Server and administrative
Conclusion
CHEP 13-17 February 2006 3: http://xrootd.slac.stanford.edu
authentication(gsi, krb5, etc)
Clustering(olbd)
lfn2pfnprefix encoding
Storage System(oss, drm/srm, etc)
authorization(name based)
File System(ofs, sfs, alice, etc)
Protocol (1 of n)(xrootd)
xrootd Plugin Architecture
Protocol Driver(XRD)
CHEP 13-17 February 2006 4: http://xrootd.slac.stanford.edu
Performance Aspects
Speed for large transfers MB/Sec
Random vs Sequential Synchronous vs asynchronous Memory mapped (copy vs “no-copy”)
Latency for small transfers sec round trip time
Bandwidth for scalability “your favorite unit”/Sec vs increasing load
CHEP 13-17 February 2006 5: http://xrootd.slac.stanford.edu
Raw Speed I (sequential)
Disk Limit
Sun V20z2x1.86GHz Opteron 244
16GB RAMSeagate ST373307LC73GB 10K rpm SCSI
sendfile() anyone?
CHEP 13-17 February 2006 6: http://xrootd.slac.stanford.edu
Raw Speed II (random I/O)
(file not preloaded)
CHEP 13-17 February 2006 7: http://xrootd.slac.stanford.edu
Latency Per Request
CHEP 13-17 February 2006 8: http://xrootd.slac.stanford.edu