seanome/kmerseek

Split "kmerseek index" into "index-create-sketch", "index-get-kmers", "index-rocksdb"

オープン

#7 opened on 2025/02/14

 (2 件のコメント) (0 件のリアクション) (0 人の担当者)Rust (3 件のフォーク)auto 404
Pythonenhancementgood first issue

Repository metrics

Stars
 (9 個のスター)
PR merge metrics
 (平均マージ 5d 17h) (30d で 13 merged PRs)

説明

Currently kmerseek index wraps three commands in Sourmash/Branchwater:

  • index-create-sketch: sourmash scripts manysketch (uses as many CPUs as available, low-medium memory)
  • index-get-kmers: sourmash sig kmers (takes a long time, but only 1 CPU and low memory)
  • index-create-rocksdb: sourmash scripts index (uses as many CPUs as available, low-medium memory)

These were combined for convenience on the command line, but for creating Nextflow pipelines, we probably want to add the option to separate them so that they can be put into separate processes. For example, sourmash sig kmers only uses one CPU and takes a really long time, like 24hrs+ on larger datasets, but shouldn't be blocking on proceeding with doing kmerseek search.

To clarify, kmerseek-index would still wrap the call to all three of index-create-sketch, index-get-kmers, index-rocksdb.

Notice that each command is named search-VERB-something -- I like this style for clarity. Also taking suggestions on naming, the hardest problem!

コントリビューターガイド