NCBI SRA sourced fastq data


In these FASTQ data:

  • The quality score identifier (+) is sometimes not a match for the sequence identifier (@).
  • The forward and reverse reads may be interlaced and need to be separated into distinct datasets.
  • Both may be present in a dataset. Correct the first, then the second, as explained below.
  • Format problems of any kind can cause tool failures and/or unexpected results.
  • Fix the problems before running any other tools (including FastQC, Fastq Groomer, or other QA tools)

For inconsistent sequence (@) and quality (+) identifiers

  • Correct the format by running the tool Replace Text in entire line with these options:

    • Find pattern: ^\+SRR.+
    • Replace with: +

Note: If the quality score line is named like “+ERR” instead (or other valid options), modify the pattern search to match.

For interlaced forward and reverse reads

Solution 1 (reads named /1 and /2)

  • Use the tool FASTQ de-interlacer on paired end reads

Solution 2 (reads named /1 and /2)

  • Create distinct datasets from an interlaced fastq dataset by running the tool Manipulate FASTQ reads on various attributes on the original dataset. It will run twice.

Note: The solution does NOT use the FASTQ Splitter tool. The data to be manipulated are interlaced sequences. This is different in format from data that are joined into a single sequence.

  • Use the Manipulate FASTQ settings to produce a dataset that contains the /1 reads**

    Match Reads

    • Match Reads by Name/Identifier
    • Identifier Match Type Regular Expression
    • Match by .+/2

    Manipulate Reads

    • Manipulate Reads by Miscellaneous Actions
    • Miscellaneous Manipulation Type Remove Read
  • Use these Manipulate FASTQ settings to produce a dataset that contains the /2 reads**

    • Exact same settings as above except for this change: Match by .+/1

Solution 3 (reads named /1 and /3)

  • Use the same operations as in Solution 2 above, except change the first Manipulate FASTQ query term to be:
  • Match by .+/3

Solution 4 (reads named without /N)

  • If your data has differently formatted sequence identifiers, the “Match by” expression from Solution 2 above can be modified to suit your identifiers.

Alternative identifiers such as:

@M00946:180:000000000-ANFB2:1:1107:14919:14410 1:N:0:1
@M00946:180:000000000-ANFB2:1:1107:14919:14410 2:N:0:1
Still have questions?
Gitter Chat Support
Galaxy Help Forum
Want to embed this snippet (FAQ) in your GTN Tutorial?
{% snippet  faqs/galaxy/dataupload_NCBI_SRA_sourced_fastq_data.md %}