Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bedhost-ui: Bedset constructor cart #11

Open
nsheff opened this issue Feb 24, 2021 · 5 comments
Open

Bedhost-ui: Bedset constructor cart #11

nsheff opened this issue Feb 24, 2021 · 5 comments
Assignees
Milestone

Comments

@nsheff
Copy link
Member

nsheff commented Feb 24, 2021

We had previously discussed the possibility of dynamic bedsets, which we've put on hold for now, because to get the full features of bedsets we'd need to run a pipeline on it.

But when we get to the point of allowing dynamic, user-specified bedsets, which I think will be valuable in the future, then here's one idea for how to enable that:

Sean suggested to allow users to construct their own bedsets using a 'cart' functionality. you could do repeated searches and incrementally add to your 'cart', and once you had selected the bedfiles of interest, you could 'construct bedset'.

@xuebingjie1990 xuebingjie1990 self-assigned this Jun 8, 2022
@xuebingjie1990
Copy link
Member

xuebingjie1990 commented Jun 8, 2022

  • react create bedset with list of bedfiles, insert to the database without stats
  • react submit job to create the bedset: bedsets stats calculation should be done on separate "computing" server
  • add a processed column in the bedsets table, when the job is submitted by react, processed = False

short term:

  • download user defined BED set:
    • download zip file
    • maybe provide file list and command to download them from s3)

xuebingjie1990 added a commit to databio/bedhost that referenced this issue Jun 13, 2022
@xuebingjie1990
Copy link
Member

xuebingjie1990 commented Jun 13, 2022

  • maybe provide file list and command to download them from s3

S3: https://stackoverflow.com/questions/38021661/copy-multiple-files-from-s3-bucket/69018735#69018735
cat <filename>.txt | parallel aws s3 cp {} <output_dir>
filelist:

s3://bucket-name/file1.wav
s3://bucket-name/file2.wav
s3://bucket-name/file3.wav

wget: https://stackoverflow.com/questions/40986340/how-to-wget-a-list-of-urls-in-a-text-file

xuebingjie1990 added a commit to databio/bedhost that referenced this issue Jun 22, 2022
xuebingjie1990 added a commit to databio/bedhost-ui that referenced this issue Jun 22, 2022
@xuebingjie1990
Copy link
Member

  • react create bedset with list of bedfiles, insert to the database without stats

Need to check for existing BED set

@xuebingjie1990 xuebingjie1990 changed the title Bedset constructor cart Bedhost-ui: Bedset constructor cart Jan 27, 2023
@xuebingjie1990 xuebingjie1990 added this to the v0.2.0 milestone Jan 27, 2023
@nsheff
Copy link
Member Author

nsheff commented Mar 15, 2024

Status of this issue?

@xuebingjie1990
Copy link
Member

Status of this issue?

With the upgrade of the new bedhost, we don't have any of the function mentioned above. It should be easy to bring those back, which is just an endpoint to create a file with paths of the bedfiles in the "user defined" bedset.

However, our ultimate goal was to process user defined bedset and add the bedset to our database. @khoroshevskyi do we have any plan for this? let me know if you need anything from me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants