Skip to content

Latest commit

 

History

History
185 lines (165 loc) · 52.3 KB

README.md

File metadata and controls

185 lines (165 loc) · 52.3 KB

DAT2-CWL Testing

As a testing tool, we use gh-trs or yevis-cli.

Workflow

All workflows introduced in the book has been translated in CWL, but yet the testing is ongoing.

Tool

As an example, use tool/cat/cat.cwl.

If tests are prepared, yevis-metadata.yml exists in the same directory.

Using gh-trs and yevis-metadata.yml, run the test as follows:

$ gh-trs ./tool/cat/yevis-metadata.yml

# or

$ gh-trs https://raw.githubusercontent.com/ddbj/yevis-cli/main/tool/cat/yevis-metadata.yml

As a CI using GitHub Actions, action files are available under .github/workflows with a prefix test-tool.

The event handlers for each action are as follows:

on:
  push:
    branches:
      - main
    paths:
      - "tool/cat/**"
  schedule:
    - cron: "00 04 1 */6 *"
  workflow_dispatch: {}

To run all tests, use run_all_tool_tests_with_gh_actions.sh as follows:

$ bash run_all_tool_tests_with_gh_actions.sh

Test status

The test status by GitHub Actions is as follows:

Tool Status
trim_galore.cwl test-tool-trim-galore
trim_galore-pe.cwl test-tool-trim-galore-pe
star_mapping-pe.cwl test-tool-star-mapping-pe
star_index.cwl test-tool-star-index
fastqc.cwl test-tool-fastqc
bedtools_intersect_overlap.cwl test-tool-bedtools-intersect-overlap
bedtools_intersect_no_overlap.cwl test-tool-bedtools-intersect-no-overlap
rsem_calculate-expression-pe.cwl test-tool-rsem-calculate-expression-pe
rsem_index.cwl test-tool-rsem-index
wc.cwl test-tool-wc
extract_transcript_id.cwl test-tool-extract-transcript-id
blast-blastp.cwl test-tool-blast-blastp
blast-blastdbcmd.cwl test-tool-blast-blastdbcmd
blast-makeblastdb.cwl test-tool-blast-makeblastdb
hmmer-hmmsearch.cwl test-tool-hmmer-hmmsearch
bbmap-stats.cwl test-tool-bbmap-stats
HOMER_findMotifsGenome.cwl no test
for_trinity.cwl test-tool-for-trinity
cat.cwl test-tool-cat
qiime2-taxa.methods.collapse.cwl test-tool-qiime2-taxa-methods-collapse
qiime2-diversity.pipelines.core_metrics_phylogenetic.cwl test-tool-qiime2-diversity-pipelines-core-metrics-phylogenetic
qiime2-demux.visualizers.summarize.cwl no test
qiime2-diversity.visualizers.alpha_rarefaction.cwl test-tool-qiime2-diversity-visualizers-alpha-rarefaction
qiime2-feature_table.methods.filter_samples.cwl test-tool-qiime2-feature-table-methods-filter-samples
qiime2-feature_classifier.methods.classify_sklearn.cwl test-tool-qiime2-feature-classifier-methods-classify-sklearn
qiime2-tools.export.cwl no test
qiime2-dada2.methods.denoise_paired.cwl no test
qiime2-diversity.visualizers.alpha_group_significance.cwl test-tool-qiime2-diversity-visualizers-alpha-group-significance
qiime2-composition.methods.add_pseudocount.cwl test-tool-qiime2-composition-methods-add-pseudocount
qiime2-feature_table.visualizers.tabulate_seqs.cwl test-tool-qiime2-feature-table-visualizers-tabulate-seqs
qiime2-composition.visualizers.ancom.cwl test-tool-qiime2-composition-visualizers-ancom
qiime2-metadata.visualizers.tabulate.cwl test-tool-qiime2-metadata-visualizers-tabulate
qiime2-diversity.visualizers.beta_group_significance.cwl test-tool-qiime2-diversity-visualizers-beta-group-significance
qiime2-biom.convert.cwl no test
qiime2-feature_table.visualizers.heatmap.cwl test-tool-qiime2-feature-table-visualizers-heatmap
qiime2-taxa.visualizers.barplot.cwl test-tool-qiime2-taxa-visualizers-barplot
qiime2-phylogeny.pipelines.align_to_tree_mafft_fasttree.cwl test-tool-qiime2-phylogeny-pipelines-align-to-tree-mafft-fasttree
qiime2-tools.import.cwl no test
qiime2-feature_table.visualizers.summarize.cwl test-tool-qiime2-feature-table-visualizers-summarize
fastp-se-html.cwl test-tool-fastp-se-html
fastp-pe.cwl test-tool-fastp-pe
kallisto_quant-pe.cwl test-tool-kallisto-quant-pe
kallisto_index.cwl test-tool-kallisto-index
sample_txt.cwl test-tool-sample-txt
target2gene.cwl test-tool-target2gene
pilon.cwl test-tool-pilon
gzip.cwl test-tool-gzip
mkdir.cwl test-tool-mkdir
wget.cwl test-tool-wget
grep.cwl test-tool-grep
picard-MergeVcfs.cwl no test
annotate-variation.cwl test-tool-annotate-variation
gatk-ApplyBQSR.cwl no test
gatk-HaplotypeCaller.cwl no test
gatk-GenotypeGVCFs.cwl no test
sort-bed.cwl test-tool-sort-bed
picard-CreateSequenceDictionary.cwl test-tool-picard-createsequencedictionary
gatk-BaseRecalibrator.cwl no test
gatk-SelectVariants.cwl no test
picard-MarkDuplicates.cwl test-tool-picard-markduplicates
bedtool-merge.cwl test-tool-bedtool-merge
gatk-VariantFiltration.cwl no test
MACS2-callpeak.cwl test-tool-macs2-callpeak
bwa-index.cwl test-tool-bwa-index
bwa-mem.cwl no test
deepTools_computeMatrix_reference-point.cwl no test
deepTools_plotProfile.cwl no test
deepTools_bamCoverage.cwl no test
deepTools_plotHeatmap.cwl no test
deepTools_computeMatrix_scale-regions.cwl no test
tar.cwl test-tool-tar
deseq2.cwl test-tool-deseq2
Trinity-pe.cwl test-tool-trinity-pe
Trinity-aaea.cwl test-tool-trinity-aaea
nanoplot.cwl test-tool-nanoplot
bowtie2-se.cwl test-tool-bowtie2-se
bowtie2-pe.cwl test-tool-bowtie2-pe
cp_to_directory.cwl test-tool-cp-to-directory
unwrap.cwl test-tool-unwrap
TransDecoder-TransDecoder.LongOrfs.cwl test-tool-transdecoder-transdecoder-longorfs
seqkit-stats.cwl test-tool-seqkit-stats
samtools-faidx.cwl test-tool-samtools-faidx
samtools-sort.cwl test-tool-samtools-sort
samtools-index.cwl test-tool-samtools-index
samtools-view.cwl test-tool-samtools-view
canu.cwl no test
gunzip.cwl test-tool-gunzip
wtpoa-cns.cwl no test
wtdbg2.cwl test-tool-wtdbg2
jellyfish-count.cwl test-tool-jellyfish-count
jellyfish-histo.cwl test-tool-jellyfish-histo
bismark_genome_preparation.cwl test-tool-bismark-genome-preparation
bismark.cwl test-tool-bismark
mkdir_star.cwl test-tool-mkdir-star
platanus-b-assemble.cwl test-tool-platanus-b-assemble
platanus-b-iterate.cwl test-tool-platanus-b-iterate
sample2condition.cwl test-tool-sample2condition
fasterq-dump.cwl test-tool-fasterq-dump
mkdir_rsem.cwl test-tool-mkdir-rsem
sleuth.cwl test-tool-sleuth
listing.cwl test-tool-listing