...
corral is a gigantic (multiple PB) storage system (spinning disk) where researchers can store data. UT researchers may request up to 5 TB of corral storage through the normal TACC allocation request process. Additional space on corral can be rented for ~$80/TB/year.
The UT/Austin BioInformatics Team also has an older, common directory area on corral.
| Code Block | ||||
|---|---|---|---|---|
| ||||
ls /corral-repl/utexas/BioITeam |
A couple of things to keep in mind regarding corral:
...
| Code Block | ||||
|---|---|---|---|---|
| ||||
mkdir -p $WORK2/archive/original/2021.core_ngs cd $WORK2/archive/original/2021.core_ngs wget |
Here are two web links:
- httphttps://web.corral.tacc.utexas.edu/BioinformaticsResource/BioITeamCoreNGS/yeast_stuff/Sample_Yeast_L005_R1.cat.fastq.gzhttp
- https://web.corral.tacc.utexas.edu/BioITeamBioinformaticsResource/CoreNGS/yeast_stuff/Sample_Yeast_L005_R2.cat.fastq.gz
Right-click (Windows) or Control+click (Mac) on the 1st link in your browser, then select "Copy link location" from the menu. Now go back to your Terminal. Put your cursor after the space following the wget command then either right-click (Windows), or Paste (Command-V on Mac, Control-V on Windows). The command line to be executed should now look like this:
| Code Block | ||||
|---|---|---|---|---|
| ||||
wget http://web.corral.tacc.utexas.edu/BioITeamBioinformaticsResource/CoreNGS/yeast_stuff/Sample_Yeast_L005_R1.cat.fastq.gz |
Now press Enter to get the command going. Repeat for the 2nd link. Check that you now see the two files (ls).
| Tip |
|---|
By default wget creates a file in the current directory matching the last component of the URL (e.g. Sample_Yeast_L005_R1.cat.fastq.gz here). You can change the copied file name with wget's -O option. Also note that if you execute the same wget more than once, subsequent local files will be named with a .1, .2, etc. suffix. |
Copy from a Copy from a corral location - cp or rsync
...
cp [options] <source file 1> <source file 2> ... <destination directory>/
Make a directory in your scratch Scratcharea and copy a single file to it. The trailing slash ( / ) on the destination says it the destination is a directory.
| Code Block | ||||
|---|---|---|---|---|
| ||||
mkdir -p $SCRATCH/data/test1 cp $CORENGS/misc/small.fq $SCRATCH/data/test1/ ls $SCRATCH/data/test1 # or.. mkdir -p ~/scratch/data/test1 cd ~/scratch/data/test1 cp $CORENGS/misc/small.fq . ls |
...