Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Non-fetcheable remote files #75

Closed
MrHedmad opened this issue Mar 14, 2024 · 1 comment
Closed

Non-fetcheable remote files #75

MrHedmad opened this issue Mar 14, 2024 · 1 comment
Labels
feat New feature or request RFC Request For Comments

Comments

@MrHedmad
Copy link
Owner

There might be some cases where a pipeline fetches data in a non-trivial way, and therefore Kerblam! cannot handle it with a get request. In these cases it might be useful to specify extra remote files so that we can cleanup and pack correctly.

E.g. In the kerblam.toml:

[data.remote]
"extra" = ["file_1", "file_two"]

Allowing regex patterns in such cases (maybe with a specific syntax, like /some_regex/) might also be useful.

@MrHedmad MrHedmad added the feat New feature or request label Mar 14, 2024
@MrHedmad MrHedmad added the RFC Request For Comments label Apr 22, 2024
@MrHedmad
Copy link
Owner Author

Fixed in PR #113

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feat New feature or request RFC Request For Comments
Projects
None yet
Development

No branches or pull requests

1 participant