Code

Retry OOM killed jobs#4

Code

Draft

cmelone wants to merge 12 commits intodevelopspack/spack-gantry:developfrom add/handle-oomspack/spack-gantry:add/handle-oomCopy head branch name to clipboard

+398-57

Commits

Commits on Oct 29, 2024

• wip

  cmelone

  committed
  6ab2351

  Copy full SHA for 6ab2351

• add migration for new retry/oom columns

  cmelone

  committed
  7c8abf6

  Copy full SHA for 7c8abf6

• gitlab client: refactor of _request and start_pipeline method

  cmelone

  committed
  933ca9a

  Copy full SHA for 933ca9a

• add handle_pipeline function to collect webhook

  Show description for f06b58e
  cmelone

  committed
  f06b58e

  Copy full SHA for f06b58e

• add tests for pipeline handling

  cmelone

  committed
  cef21d3

  Copy full SHA for cef21d3

• clean comment

  cmelone

  committed
  4b31f30

  Copy full SHA for 4b31f30

• remove extra print

  cmelone

  committed
  f3d08aa

  Copy full SHA for f3d08aa

• add check to ensure failed jobs aren't erroneously collected if not called by a pipeline

  cmelone

  committed
  1ec1c55

  Copy full SHA for 1ec1c55

• add automatically bump allocations after OOM detected

  cmelone

  committed
  ae5b611

  Copy full SHA for ae5b611

• add tests for OOM handling

  cmelone

  committed
  888db7a

  Copy full SHA for 888db7a

• Add retry limit check on the collection side

  Show description for 1b2ba20
  cmelone

  committed
  1b2ba20

  Copy full SHA for 1b2ba20

• fix imports from prediction module

  cmelone

  committed
  909d60e

  Copy full SHA for 909d60e