Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Overview:

Throughout the course we have spoken to you about 've gone over how errors can pop up in your data and how they can effect confidence in variant calls and knowledge of what variants are actually readreal. Here we provide you with real data to show the difference between a non-corrected library and a error corrected library.

Warning

This tutorial makes use of data generated in the quick Error Correction tutorial. If you have not done that tutorial already you should do it first.

...


Learning Objectives:

  1. Run breseq on fastq files corresponding to error corrected, and non-error corrected data
  2. Gain an understanding of just how powerful error correction can be

...


Running Breseq on SSCS and Trimmed Reads:

The following reference files reference files 1400flanking.gff3, and REL606.maksed.gff3  should be copied from the $BI/gva_course/mixed_population directory into a new folder BDIBGVA_breseq_Error_Correction: 1400flanking.gff3, and REL606.maksed.gff3 while  while DED110_SSCS.fastq, and DED110_all.trimmed.fastq should be copied from your BDIBGVA_Error_Correction folder. 

Expand
titleClick here if you need help copying the reference files...
Code Block
mkdir $SCRATCH/BDIBGVA_breseq_Error_Correction
cp $BI/gva_course/mixed_population/*.gff3 $SCRATCH/BDIBGVA_breseq_Error_Correction
cd $SCRATCH/BDIBGVA_breseq_Error_Correction
Expand
titleClick here if you need help copying the fastq files you made in the previous tutorial...
Code Block
cp $SCRATCH/BDIBGVA_Error_Correction/DED110_SSCS.fastq .
cdcp $SCRATCH/BDIBGVA_Error_Correction/DED110_all.trimmed.fastq .

 


Just like our previous tutorials these commands should be run on an idev shell and they should be run in the background so both comparisons can be run at the same time. 

In this case we are going to be running breseq in both polymorphism mode (-p), and targeted sequencing mode (-t). By default breseq creates a lot of html files as output which ordinarily are very useful to visualize what the characteristics of any mutation are (in a better way than can be done with IGV). For normal runs this is extremely useful. For targeted deep sequencing runs (esspecially especially ones where we have not done error corrections), this can be incredibly time consuming. Since we are ultimately only interested in comparing the difference in number of mutations detected and their frequencies rather tahn the specific characteristics of those mutations, we also include the --brief-html-output option. We will also be using 2 different reference files, 1400flanking.gff3 should be used as a standard reference while REL606.masked.gff3 should be used as a junction only reference. Also we want to make good use of the 48 processors we have available. 

While the above commands are running, can you think why we used two different values for the -j flag?
Code Block
mkdir Logs
module unload samtools
breseq -p -t -j 36 -o SSCS_output/trimmed -r 1400flanking.gff3 -s REL606.masked.gff3 --brief-html-output DED110_all.trimmed.fastq >& Logs/trimmed.log.txt &
breseq -p -t -j 12 -o SSCS_output/SSCS -r 1400flanking.gff3 -s REL606.masked.gff3 --brief-html-output DED110_SSCS.fastq >& Logs/SSCS.log.txt &
# wait a few moments and check that breseq is running using the tail command
tail Logs/*.log.txt
Expand
title

From the breseq -h command, we are reminded that the -j argument corresponds to the number of processors used. From our work in the previous error correction tutorial we saw that the error corrected data had ~1 million reads, while the trimmed data had ~6 million reads. The extra number of reads will make the trimmed files take longer to run, and hence why we give it more processors to speed things up.

 


Generate comparison table for the 2 types of samples

Just like the previous tutorial we now want to create a comparison file using "gdtools compare" so we can see the difference of having the trimmed reads vs the SSCS reads. This time you want to create a file "trimmed_vs_SSCS.html".

...

Warning
titleIf you feel you need a hint at this point raise your hand and let us know

By this point in the course you should be able to do this without assistance if you think through it. If you need help thats fine, but its possible that copy pasting the commands has not helped you to learn the principles of doing this. Raise your hand, ask for help, and let us walk you through what you know about scp and cp and how to get the information you need off of TACC

Evaluating the effect of error correction:

Once you have transfered transferred the trimmed_vs_SSCS.html file back to your computer, open it and scroll around to see what the effects of our SSCS error correction were.

Return to GVA2017GVA2019