Skip to content

v0.3.0

Latest
Compare
Choose a tag to compare
@tatiana tatiana released this 29 Nov 15:38
· 11 commits to main since this release
8ccc839

Breaking changes

  • Removal of SubmitRayJob.terminal_states. The same values are now available at ray_provider.constants.TERMINAL_JOB_STATUSES.
  • Simplify the project structure and debugging by @tatiana in #93

In order to improve the development and troubleshooting DAGs created with this provider, we introduced breaking changes
to the folder structure. It was flattened and the import paths to existing decorators, hooks, operators and trigger
changed, as documented in the table below:

Type Previous import path Current import path
Decorator ray_provider.decorators.ray.ray ray_provider.decorators.ray
Hook ray_provider.hooks.ray.RayHook ray_provider.hooks.RayHook
Operator ray_provider.operators.ray.DeleteRayCluster ray_provider.operators.DeleteRayCluster
Operator ray_provider.operators.ray.SetupRayCluster ray_provider.operators.SetupRayCluster
Operator ray_provider.operators.ray.SubmitRayJob ray_provider.operators.SubmitRayJob
Trigger ray_provider.triggers.ray.RayJobTrigger ray_provider.triggers.RayJobTrigger

Features

Bug fixes

  • Fix integration test and bug in load balancer wait logic by @pankajastro in #85
  • Bugfix: Better exception handling and cluster clean up by @venkatajagannath in #68
  • Stop catching generic Exception in operators by @tatiana in #100
  • Stop catching generic Exception in trigger by @tatiana in #99

Docs

Others

Local development

  • Fix the local development environment and update documentation by @tatiana in #92
  • Enable secret detection precommit check by @pankajastro in #91
  • Add astro cli project + kind Raycluster setup instruction by @pankajastro in #83
  • Remove pytest durations from tests by @tatiana in #102
  • Fix running make docker-run when there is a new version by @tatiana in #99 and #101
  • Improve Astro CLI DAGs test so running hatch test-cov locally doesn't fail by @tatiana in #97

CI