Grid HowTo
From AGATA DAQ wiki
Contents |
General Info
Virtual Organisation
You must be member of the AGATA Virtual Organisation, called vo.agata.org
Please use this link to ask for your membership.
User Interface
The User Interface (UI) is the environment that allows you to interact with Grid world. You must have an account on a AGATA enabled UI. For this ask your local Grid Administrator.
An UI provides a set of command to interact with Grid Resources. In particular, for retrieving data from the Grid, you may use commands from lcg_utils: lcg-cp, lcg-ls, etc. Please see respective man pages for commands details, e.g.
man lcg-cp
Commissioning Data
Commissioning data are stored in Grid sites using the same data structure (directory tree and names) of the data stored at LNL
2009 Week 12
Grid site: INFN CNAF Bologna
Directory is 2009_week12. Total size is ~15TB
Files and directories have the same names and structure of the data stored at LNL
2009 Week 22
Grid site: INFN CNAF Bologna
Directory is 2009_week22. Total size is ~300MB
Files and directories have the same names and structure of the data stored at LNL
2009 Week 27
Grid site: INFN CNAF Bologna
Directory is 2009_week27. Total size is ~2.2TB
Files and directories have the same names and structure of the data stored at LNL
2009 Week 43
Grid site: INFN CNAF Bologna
Directory is 2009_week43. Total size is ~14TB
2009 Week 46
Grid site: INFN CNAF Bologna
Directory is 2009_week46. Total size is ~1.5TB
In order to optimize the data transfer, for 2009_week46 a new policy has been adopted.
Directories
The structure of the directory tree have been maintained for directories Data and Out, while directories Conf_online and Conf_offine have been archived in one file called SRM_AGATA_Conf.tar. To extract Conf_online and Conf_offine directories and inner files from the archive use
tar xvf SRM_AGATA_Conf.tar
Files
Files have been divided into three categories, depending on actual file size:
- SMALL files: file size < 100MB. All small files in a directory have been archived in a file called SRM_AGATA_small_files.tar. To extract files from the archive use
tar xvf SRM_AGATA_small_files.tar
- MEDIUM files: file size >= 100MB && <= 5GB. All medium files have been "soft linked" to a file which has been named with prefix SRM_AGATA_, so if actual file name is "my_medium_file_name.ext" it has been copied with name "SRM_AGATA_my_medium_file_name.ext". To use original name just rename the file
mv SRM_AGATA_my_medium_file_name.ext my_medium_file_name.ext
- LARGE files: file size > 5GB. All large files have been splitted in several files of size 5GB and named with prefix SRM_AGATA_ and suffix _, so if actual file is "my_large_file_name.ext" it has been splitted in several files called "SRM_AGATA_my_large_file_name.ext_aaa", "SRM_AGATA_my_large_file_name.ext_aab", "SRM_AGATA_my_large_file_name.ext_aab", etc. To reunite the parts in one file use this command
cat SRM_AGATA_my_large_file_name.ext_* > my_large_file_name.ext
**** BEWARE THAT THIS OPERATION WILL DOUBLE THE AMOUNT OF SPACE USED BY YOUR DATA ****
2009 Week 49
Grid site: INFN CNAF Bologna
Directory is 2009_week49. Total size is ~6.7TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2010 Week 06
Grid site: INFN CNAF Bologna
Directory is 2009_week06. Total size is ~1.9GB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2010 Experimental Data
2010 Week 07 (42Ca)
Grid site: INFN CNAF Bologna
Directory is 2010_week07. Total size is ~3.4TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2010 Week 09 (136Xe)
Grid site: INFN CNAF Bologna
Directory is 2010_week09. Total size is ~2.9TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2010 Week 19
Grid site: CCIN2P3 Lyon
Directory is 2010_week19. Total size is ~8.0TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2010 Week 21
Grid site: INFN CNAF Bologna
Directory is 2010_week21. Total size is ~8.8TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2010 Week 24
Grid site: INFN CNAF Bologna
Directory is 2010_week24. Total size is ~4.5TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2010 Week 25
Grid site: INFN CNAF Bologna
Directory is 2010_week25. Total size is ~3.4TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2010 Week 28
Grid site: CCIN2P3 Lyon
Directory is 2010_week28. Total size is ~20TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2010 Week 29
Grid site: INFN CNAF Bologna
Directory is 2010_week29. Total size is ~12TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2010 Week 48
Grid site: CCIN2P3 Lyon
Directory is 2010_week48. Total size is 7.1TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2010 Week 49
Grid site: INFN CNAF Bologna
Directory is 2010_week49. Total size is 2.1TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Experimental Data
2011 Week 11
Grid site: INFN CNAF Bologna
Directory is 2011_week11. Total size is ~30TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 12
Grid site: INFN CNAF Bologna
Directory is 2011_week12. Total size is ~11TB Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 14
Grid site: INFN CNAF Bologna
Directory is 2011_week14. Total size is ~3TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 19
Grid site: INFN CNAF Bologna
Directory is 2011_week19. Total size is ~15TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 23
Grid site: INFN CNAF Bologna
Directory is 2011_week23. Total size is ~2.2TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 28
Grid site: INFN CNAF Bologna
Directory is 2011_week28. Total size is ~4.9TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 29
Grid site: INFN CNAF Bologna
Directory is 2011_week29. Total size is ~8.1TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 39
Grid site: INFN CNAF Bologna
Directory is 2011_week39. Total size is ~2,7TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 40
Grid site: INFN CNAF Bologna
Directory is 2011_week40. Total size is ~5.1TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 41
Grid site: INFN CNAF Bologna
Directory is 2011_week41. Total size is ~6.8TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 42
Grid site: INFN CNAF Bologna
Directory is 2011_week42. Total size is ~3.5TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 43
Grid site: INFN CNAF Bologna
Directory is 2011_week43. Total size is ~3.5TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 44
Grid site: INFN CNAF Bologna
Directory is 2011_week44. Total size is ~12TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
2011 Week 45
Grid site: INFN CNAF Bologna
Directory is 2011_week45. Total size is ~5.6TB
Files and Directories have the same structure and names as the ones of 2009 Week 46
