Setup and run athena locally and on grid

Setup and run atheSetup and run athena locally and on gna locally and on g

ridridCunfeng feng Cunfeng feng

2005.9.192005.9.19

Setup work Setup work environmentalenvironmental

The athena kits have been install in ui.hepg.sdu.eThe athena kits have been install in ui.hepg.sdu.edu.cndu.cn

You should have account in UI.You should have account in UI. Setup work directory in ui (from Li Hengne reporSetup work directory in ui (from Li Hengne repor

t)t) cd /home/atlas/tools/pacman-3.11cd /home/atlas/tools/pacman-3.11 source setup.shsource setup.sh cd /home/atlas/AtlasReleasecd /home/atlas/AtlasRelease source setup.shsource setup.sh source dist/10.0.3/Control/AthenaRunTime/*/cmt/setup.shsource dist/10.0.3/Control/AthenaRunTime/*/cmt/setup.sh cd /home/fengcf/cd /home/fengcf/ >mkdir –p work/10.0.3>mkdir –p work/10.0.3 >cd work/10.0.3>cd work/10.0.3 pacman –get /home/atlas/AtlasReleases :10.0.3/AtlasRelease-slc3_ia32-optpacman –get /home/atlas/AtlasReleases :10.0.3/AtlasRelease-slc3_ia32-opt ls ls o..pacman..o setup.csh setup.pl setup.py setup.sh trusted.cacheo..pacman..o setup.csh setup.pl setup.py setup.sh trusted.cache

CVS AccessCVS Access Help : Help : https://uimon.cern.ch/twiki/bin/view/Atlas/CvsAccesshttps://uimon.cern.ch/twiki/bin/view/Atlas/CvsAccess mv /home/fengcf/.ssh /home/**/.sshmv /home/fengcf/.ssh /home/**/.ssh get identify to CVS get identify to CVS （（ use use [email protected]@lxplus.cern.ch acco acco

unt)unt) mv /home/fengcf/work/10.0.3/setup.sh /home/**/work/mv /home/fengcf/work/10.0.3/setup.sh /home/**/work/ or just adjust your work/setup.sh same as mineor just adjust your work/setup.sh same as mine (set CVSROOT)(set CVSROOT) source setup.shsource setup.sh cd work/10.0.3cd work/10.0.3 cmt co –r AthExHelloWorld-00-01-12 Control/AthenaExcmt co –r AthExHelloWorld-00-01-12 Control/AthenaEx

amples/AthExHelloWorldamples/AthExHelloWorld

ssh ssh [email protected]@isscvs.cern.ch ( don’t need passward) ( don’t need passward)

Modifying Athena HelloworModifying Athena Helloworldld

cd work/10.0.3cd work/10.0.3 source ~/atlas-10.0.3-setup.shsource ~/atlas-10.0.3-setup.sh cmt co –r AthExHelloWorld-00-01-12 Control/AthenaExamplescmt co –r AthExHelloWorld-00-01-12 Control/AthenaExamples

/AthExHelloWorld/AthExHelloWorld cmt co –r UserAnalysis-00-02-02 PhysicsAnalysis/AnalysisComcmt co –r UserAnalysis-00-02-02 PhysicsAnalysis/AnalysisCom

mon/UserAnalysismon/UserAnalysis cd Control/AthenaExamples/AthExHelloWorld/AthExHelloWocd Control/AthenaExamples/AthExHelloWorld/AthExHelloWo

rld-00-01-12/src rld-00-01-12/src vi HelloWorld.cxxvi HelloWorld.cxx cd ../cmtcd ../cmt cmt configcmt config source setup.shsource setup.sh gmakegmake cd PhysicsAnalysis/AnalysisCommon/UserAnalysis/UserAnalycd PhysicsAnalysis/AnalysisCommon/UserAnalysis/UserAnaly

sis-00-02-02/run sis-00-02-02/run get_files HelloWorldOptions.pyget_files HelloWorldOptions.py Athena.py HelloWorldOptions.pyAthena.py HelloWorldOptions.py

ATLAS analysis code ATLAS analysis code installinstall

cd work/10.0.3cd work/10.0.3 source ~/atlas-10.0.3-setup.shsource ~/atlas-10.0.3-setup.sh cmt co –r AnalysisExamples-00-09-18 Physicscmt co –r AnalysisExamples-00-09-18 Physics

Analysis/Analysiscommon/AnalysisExamplesAnalysis/Analysiscommon/AnalysisExamples You will something like:You will something like: /home/fengcf/work/10.0.3/PhysicsAnalysis/An/home/fengcf/work/10.0.3/PhysicsAnalysis/An

alysisCommon/AnalysisExamples/AnalysisExalysisCommon/AnalysisExamples/AnalysisExamples-00-09-18/lsamples-00-09-18/ls

AnalysisExamples cmt doc python scriAnalysisExamples cmt doc python scripts srcpts src

ChangeLog CVS mergingAOD run shaChangeLog CVS mergingAOD run sharere

Run ATHENA Run ATHENA cd cmtcd cmt cmt configcmt config source setup.shsource setup.sh gmakegmake ““InstallArea” will appear in you work/10.0.InstallArea” will appear in you work/10.0.

3/ after above operation.3/ after above operation. cd ../sharecd ../share vi ttbarExample_jobOptions.pyvi ttbarExample_jobOptions.py cd ../runcd ../run athena.py ../ttbarExample_jobOptions.pyathena.py ../ttbarExample_jobOptions.py

ttbarExample_jobOption.pyttbarExample_jobOption.py

Run againRun again copy /home/fengcf2/atlas-10.0.3-setup.sh /home/**/.copy /home/fengcf2/atlas-10.0.3-setup.sh /home/**/. cd work/10.0.3/cd work/10.0.3/ source ~/atlas-10.0.3-setup.shsource ~/atlas-10.0.3-setup.sh cd PhysicsAnalysis/Analysis/Common/AnalysisExapcd PhysicsAnalysis/Analysis/Common/AnalysisExap

les/AnalysisExamples-00-09-18/srcles/AnalysisExamples-00-09-18/src vi *.cxxvi *.cxx cd ../cmtcd ../cmt cmt configcmt config source setup.shsource setup.sh gamkegamke cd ../run/cd ../run/

Modify the codeModify the code

We has add some code in AnalysisExamples-0We has add some code in AnalysisExamples-00-09-180-09-18

You can just copy the file in my src, share, AnYou can just copy the file in my src, share, AnalysisExamples to the same directory where yalysisExamples to the same directory where you work.ou work.

cmt/gmakecmt/gmake vi share/ttbarExample_jobOptions_small.pyvi share/ttbarExample_jobOptions_small.py cd run/cd run/ athena.py ../share/ttbarExample_jobOptions_athena.py ../share/ttbarExample_jobOptions_

small.pysmall.py

Rome files form:Rome files form:rome.AAAAAA.TYPE.DECS._NUM.ENrome.AAAAAA.TYPE.DECS._NUM.EN

DD AAAAAA:AAAAAA:

0040xx and 0049xx is a single particle sample (0040xx and 0049xx is a single particle sample (RomeCalibrationWikiRomeCalibrationWiki) )

0041xx is a "background sample" (0041xx is a "background sample" (RomeBackgroundWikiRomeBackgroundWiki) ) 0042xx is a sample owned by the standard model group (0042xx is a sample owned by the standard model group (

RomeStandardWikiRomeStandardWiki) ) 0043xx is a sample owned by the Higgs group (0043xx is a sample owned by the Higgs group (RomeHiggsWikiRomeHiggsWiki

) ) 0044xx is a sample owned by the SUSY group (RomeSUSYWik0044xx is a sample owned by the SUSY group (RomeSUSYWik

i) i) 0045xx is a sample owned by the Top0045xx is a sample owned by the Top (RomeTopWiki) (RomeTopWiki) 0046xx is a sample owned by the Exotics group (RomeExoticW0046xx is a sample owned by the Exotics group (RomeExoticW

iki) iki) 0047xx is a sample owned by the B-group (RomeBWiki) 0047xx is a sample owned by the B-group (RomeBWiki) 0048xx (xx =01 to 49) 0048xx (xx =01 to 49) is a sample owned by the jet/missing Et grouis a sample owned by the jet/missing Et grou

p group (JetMissingET)p group (JetMissingET) 0048xx (xx =50 to 99) is a sample owned by b-tagging group (R0048xx (xx =50 to 99) is a sample owned by b-tagging group (R

omeBtagging) omeBtagging)

TYPE:TYPE: evgen corresponding to generated events evgen corresponding to generated events simul corresponding events processed by Gesimul corresponding events processed by Ge

ant-4 ant-4 digi corresponding to digitised events with ndigi corresponding to digitised events with n

o pile up (with noise) o pile up (with noise) lumi01 corresponding to digitised events witlumi01 corresponding to digitised events wit

h 1x10**33 pile up (with noise) h 1x10**33 pile up (with noise) reco is an output from reconstructionreco is an output from reconstruction

DECS: string provides a short discription DECS: string provides a short discription of the data (e.g. ttbarWp)of the data (e.g. ttbarWp)

NUM: starting from 00001NUM: starting from 00001 END: log or pool.rootEND: log or pool.root in case of TYPE=reco, in case of TYPE=reco, END=pool.root for ESEND=pool.root for ES

DD END=CBNT.root for CBNTEND=CBNT.root for CBNT END=AOD.pool.root for AODEND=AOD.pool.root for AOD

SamplesSamples Rome samples : 004521 and 004520Rome samples : 004521 and 004520

187985 semileptonic ttbar events (l = e, mu)187985 semileptonic ttbar events (l = e, mu) ParametersParameters

Mtop=175 GeVMtop=175 GeV CTEQ5L(The Coordinated Theoretical-Experimental Project on QCTEQ5L(The Coordinated Theoretical-Experimental Project on Q

CD )CD ) ISR/FSR onISR/FSR on Multiple Interaction = DC2Multiple Interaction = DC2 Q-scale = default Toprex (sqrt(MQ-scale = default Toprex (sqrt(Mtoptop**2+P**2+PTTttop**2)ttop**2)

Generation : 9.0.4Generation : 9.0.4 TopReX 4.09 and Pythia 6.226, with spin correlationTopReX 4.09 and Pythia 6.226, with spin correlation

Simulation, digitization : 9.0.4Simulation, digitization : 9.0.4 Initial detector geometryInitial detector geometry

Reconstruction : 10.0.1Reconstruction : 10.0.1 Use AODUse AOD

Rome.*.recov10.ttbarW*._*.AOD.pool.Rome.*.recov10.ttbarW*._*.AOD.pool.rootroot

Without pileupWithout pileup ref. 4520 : W- decays to leptons (e, mref. 4520 : W- decays to leptons (e, m

u), W+ decays to jets (Wm)u), W+ decays to jets (Wm) ref. 4521 : W+ decays to leptons (e, mref. 4521 : W+ decays to leptons (e, m

u), W- decays to jets (Wp)u), W- decays to jets (Wp) NLO cross-section:125pbNLO cross-section:125pb

Rome dataRome data

Part of rome ttbar AOD data copied to /homePart of rome ttbar AOD data copied to /home/fengcf2/data/romeTopAOD//fengcf2/data/romeTopAOD/

rome.004521.recov10.ttbarWp._00001.AOD.prome.004521.recov10.ttbarWp._00001.AOD.pool.rootool.root

Part of them with error, don’t us:Part of them with error, don’t us: the file whose size is 0the file whose size is 0 0081700817 0088600886 0119001190 run/testDataSample.py include all the data filerun/testDataSample.py include all the data file

On gridOn grid

tar –cvlpf checkout.tar Control PhysicsAntar –cvlpf checkout.tar Control PhysicsAnalysisalysis

vi HelloWorld.cxx (copy from Control/…)vi HelloWorld.cxx (copy from Control/…) vi hello.shvi hello.sh vi hello.jdlvi hello.jdl grid-proxy-initgrid-proxy-init edg-job-submit –vo atlas –o jobID hello.jdledg-job-submit –vo atlas –o jobID hello.jdl

On gridOn grid Hello.shHello.sh #!/bin/bash#!/bin/bash # Script to run AthenaHelloWorld on the Grid# Script to run AthenaHelloWorld on the Grid

source $VO_ATLAS_SW_DIR/software/10.0.1/setup.shsource $VO_ATLAS_SW_DIR/software/10.0.1/setup.sh source $SITEROOT/dist/10.0.1/Control/AthenaRunTime/*/cmt/setup.shsource $SITEROOT/dist/10.0.1/Control/AthenaRunTime/*/cmt/setup.sh

export CMTPATH=`pwd`:$CMTPATHexport CMTPATH=`pwd`:$CMTPATH # Create the checked out package then replace the modified file# Create the checked out package then replace the modified file

tar -xf checkout.tartar -xf checkout.tar

cp HelloWorld.cxx Control/AthenaExamples/AthExHelloWorld/AthExHelloWorld-00-01-12/src/cp HelloWorld.cxx Control/AthenaExamples/AthExHelloWorld/AthExHelloWorld-00-01-12/src/

# Rebuild# Rebuild

cd Control/AthenaExamples/AthExHelloWorld/AthExHelloWorld-00-01-12/cmtcd Control/AthenaExamples/AthExHelloWorld/AthExHelloWorld-00-01-12/cmt

cmt configcmt config source setup.shsource setup.sh gmakegmake

cd ../../../../..cd ../../../../..

athena.py HelloWorldOptions.pyathena.py HelloWorldOptions.py

On gridOn grid Hello.jdlHello.jdl

############# Athena ############################## Athena ################# Executable = "hello.sh";Executable = "hello.sh"; StdOutput = "hello.out";StdOutput = "hello.out"; StdError = "hello.err";StdError = "hello.err"; InputSandbox = {"hello.sh","HelloWorldOptions.py","checkout.InputSandbox = {"hello.sh","HelloWorldOptions.py","checkout.

tar","HelloWorld.cxx"};tar","HelloWorld.cxx"}; OutputSandbox = {"hello.out","hello.err", "CLIDDBout.txt"};OutputSandbox = {"hello.out","hello.err", "CLIDDBout.txt"}; Requirements = Member("VO-atlas-release-10.0.3",Requirements = Member("VO-atlas-release-10.0.3", other.GlueHostApplicationSoftwareRunTimeEnvironment);other.GlueHostApplicationSoftwareRunTimeEnvironment); ############################################################################

Using Don QuijoteUsing Don Quijote(ATLAS Experiment Data Management Syste(ATLAS Experiment Data Management Syste

m )m ) Install DQInstall DQ

cdcd wget wget http://www/mi.infi.it/~gnegri/dms2.tgzhttp://www/mi.infi.it/~gnegri/dms2.tgz tar xvzf dms2.tgztar xvzf dms2.tgz dms2.py search ‘rome.*AOD.pool.root’dms2.py search ‘rome.*AOD.pool.root’ dms2.py get rome.004201.reco.ZeeJimmy._00001.Adms2.py get rome.004201.reco.ZeeJimmy._00001.A

OD.pool.root --catalog=PoolFileCatalog.xml --copy OD.pool.root --catalog=PoolFileCatalog.xml --copy --remote --remote

(copy a file to the current directory and crea(copy a file to the current directory and create a POOL catalogue file PoolFileCatalog.xml)te a POOL catalogue file PoolFileCatalog.xml)