Performance expectations

Jump to bottom Edit New page

Isaac Overcast edited this page May 23, 2016 · 19 revisions

This page will help give you some idea of how long each step will take for various data types on different platforms.

GBS

Test Data: 1 plate single end GBS, 94 mulitplexed samples. Raw data gzip 25GB.

Test Bed: Mac Pro 2x2.4 GHz 6-Core Intel Xeon with 64GB 1333 DDR3 (not especially great).

Step 1: 6.5 hrs

raw_file                               total_reads    cut_found  bar_matched
D25GWACXX_6_fastq                        297132667    249086024    222233136

Step 2: 3 hrs
Step 3: 3 days

GBS

Test Data: 1 plate single end GBS, 94 mulitplexed samples. Raw data gzip 25GB.

Test Bed: Cluster 40 core Intel Xeon 2.80GHz w/ 125GB main memory

Step 1: ~3hrs

raw_file                               total_reads    cut_found  bar_matched
D25GWACXX_6_fastq                        297132667    249086024    222233136

Step 2: ~1 hours
Step 3: 2 days
Step 4: 1 hour
Step 5: 1 hour
Step 6: <2 days
Step 7: <1 hour