Warning, /eic.github.io/_resources/storage.md is written in an unsupported language. File is not indexed.
0001 ---
0002 title: Distributed Storage
0003 description: Storage
0004 name: storage
0005 layout: default
0006 ---
0007
0008 {% include layouts/title.md %}
0009
0010 ##### NextCloud/BNLbox: pre-generaged event datasets
0011
0012 The EIC group at BNL has a large amount (13 TB and growing) of
0013 pre-generated events from Pythia, Milou, Djangoh, and others available
0014 for download via NextCloud/BNLbox.
0015 To access this data, no lab association is necessary. Simply contact
0016 Kolja Kauder, kkauder_at_bnl.gov, and request a guest account.
0017 You will receive an invitation where you can choose your password. From then on, you can log into
0018 https://bnlbox.sdcc.bnl.gov
0019 and find everything in the ```EIC_Data``` directory via the web interface.
0020
0021 ##### Download from the command line
0022
0023 Instructions for using curl, cadaver, and a script that can download entire directories can be found
0024 {% include navigation/findlink.md name='bnlbox_cli' tag='here' %}.
0025 A few additional points that may simplify life:
0026 * A copy of the ```copy_bnl_box.rb``` script is found inside ```EIC_Data```.
0027 * Note to RCF users, you can access this data directly at
0028 ```bash
0029 /gpfs02/eic/DATA
0030 ```
0031 * IMPORTANT: As the documentation notes, guest accounts work simply with the email + password combination.
0032 However, do choose a reasonably strong password, but do NOT reuse a password you use for any other service!
0033 If you use the command line interface, this password may well be sent unencrypted and/or be in a clear-text
0034 file on your computer.
0035 * Assuming your guest account was created for myemail@myprovider.com, the path to the directory will always have a specific form and you can use an environment variable as a shortcut:
0036 ```bash
0037 export eicdataurl='https://bnlbox.sdcc.bnl.gov/remote.php/dav/files/myemail@myprovider.com/EIC_Data'
0038 ```
0039 or
0040 ```bash
0041 setenv eicdataurl 'https://bnlbox.sdcc.bnl.gov/remote.php/dav/files/myemail@myprovider.com/EIC_Data'
0042 ```
0043 This way, you can (with a suitably configured .netrc) use something like:
0044 ```bash
0045 curl -O -n ${eicdataurl}/copy_bnl_box.rb
0046 ```
0047
0048 ##### Adding to the collection
0049 There is more than enough space available to fulfill all storage needs
0050 of the Yellow Report effort as reported in the recent poll to working
0051 groups. To make use of it, please contact the software working group
0052 so we can determine together the most efficient way to upload your
0053 data and make it accessible to the whole community!
0054
0055 <hr/>
0056
