Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove useless explicit LoadingOption param #355

Closed
wants to merge 1 commit into from

Conversation

GlassOfWhiskey
Copy link
Collaborator

This commit removes the useless propagation of the LoadingOptions object when calling the load_step method. This fix also improves performance when parsing large workflows.

@GlassOfWhiskey GlassOfWhiskey changed the title Remove useless explicit LoadingOption param Remove useless explicit LoadingOption param Feb 9, 2025
This commit removes the useless propagation of the `LoadingOptions`
object when calling the `load_step` method. This fix also improves
performance when parsing large workflows.
Copy link

codecov bot commented Feb 9, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 34.01%. Comparing base (039be8f) to head (e3547ce).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #355      +/-   ##
==========================================
- Coverage   34.03%   34.01%   -0.02%     
==========================================
  Files          30       30              
  Lines       35237    35236       -1     
  Branches     9470     9470              
==========================================
- Hits        11993    11986       -7     
- Misses      20599    20602       +3     
- Partials     2645     2648       +3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

GlassOfWhiskey added a commit to alpha-unito/streamflow that referenced this pull request Feb 12, 2025
This commit, combined with common-workflow-language/cwl-utils#355,
improves CWL parsing performance by removing useless propagation of the
`LoadingOptions` object when parsing child CWL documents.
Copy link
Member

@mr-c mr-c left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @GlassOfWhiskey, this PR requires making a new fetcher object instead of passing along the existing one, which would break loading for users who added a S3-aware fetcher, for example. I do agree that some of the LoadingOptions (namespaces, schemas, original_doc, addl_metadata, imports, includes, and container) would not be relevant (and may even be harmful) for loading a CWL Process from a URI. no_link_check should be propagated; and it is likely that sharing/propagating the idx (a cache) would also be good.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants