Add ability to restart a failed project with `matchids` option

Open
#12 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
30/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Stale
Tech stack
python, r

Research direction

Start at the again command, which the issue identifies as the likely entry point, and trace how it invokes the paired-end filtering step. Read the DADA2 matchids documentation and use the reported mismatched-read example to define the expected behavior. Done means a failed project can be restarted with matchids enabled instead of rerunning as single-end.

Written by the indexing model from the issue text.

Description

In some cases, the forward and reverse read files don't match exactly, apparently because they were filtered separately. The DADA2 matchids option will attempt to pair them up. It'd be nice if we had a way to restart a project with matchids enabled, in situations where there are a practical number of reverse reads and it'd be better than just re-running as single-end.

My first guess is by adding optional flags to the again command.

Example from project PRJNA639644:

Loading required package: Rcpp
Read 227 items
[1] "Thu Jan 12 21:11:08 2023 Paired-end data found!"
[1] "Thu Jan 12 21:11:08 2023 Filtering..."
Error in filterAndTrim(forward_reads, filtered_forward_reads, reverse_reads,  :
  These are the errors (up to 5) encountered in individual cores...
Error in (function (fn, fout, maxN = c(0, 0), truncQ = c(2, 2), truncLen = c(0,  :
  Mismatched forward and reverse sequence files: 39797, 39795.
Error in (function (fn, fout, maxN = c(0, 0), truncQ = c(2, 2), truncLen = c(0,  :
  Mismatched forward and reverse sequence files: 47109, 47108.
Error in (function (fn, fout, maxN = c(0, 0), truncQ = c(2, 2), truncLen = c(0,  :
  Mismatched forward and reverse sequence files: 7700, 7696.
Error in (function (fn, fout, maxN = c(0, 0), truncQ = c(2, 2), truncLen = c(0,  :
  Mismatched forward and reverse sequence files: 39797, 39795.
Error in (function (fn, fout, maxN = c(0, 0), truncQ = c(2, 2), truncLen = c(0,  :
  Mismatched forward and reverse sequence files: 47109, 47108.
In addition: Warning message:
In mclapply(seq_len(n), do_one, mc.preschedule = mc.preschedule,  :
  scheduled cores 1, 5, 7 encountered errors in user code, all values of the jobs will be affected
Execution halted
Dominant language
Python
Stars
9
Forks
0
PR merge metrics
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from blekhmanlab/compendium

All issues in blekhmanlab/compendium

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.