24.03.6

Fixes

• Fix model service sessions created before 24.03.5 failing to spawn (#2318)
• Image commit not working (#2319)
• model service session scheduler (scale_services()) failing when sessions bound to active route already marked as terminated (#2320)
• Fix container metric collection halted on systems with Cgroups v1 (#2321)

Full Changelog

Check out the full changelog until this release (24.03.6).

Full Commit Logs

Check out the full commit logs between release (24.03.5) and (24.03.6).

24.03.5

Features

• New redis client (experimental) (#2041)
• Add support for CentOS 8 based kernels (#2220)
• Allow modifying model service session's environment variable setup (#2255)
• Add endpoint.runtime_variant column (#2256)
• Add new API to show list of supported inference runtimes (#2258)
• Add support for model service provisioning without model-definition.yaml (#2260)

Fixes

• Do not omit to update session's occupying resources to DB when a kernel starts. (#1832)
• Rename no-op access_key parameter of endpoint_list GQL Query to user_uuid (#2287)
• Fix ai.backend.service-ports label syntax broken when image does not expose built-in service port (#2288)
• Improve stability of untag_image_from_registry mutation (#2289)
• SSH not working between kernels started with customized image (#2290)
• Invalid container memory capacity reported (#2291)

Full Changelog

Check out the full changelog until this release (24.03.5).

Full Commit Logs

Check out the full commit logs between release (24.03.5rc1) and (24.03.5).

24.03.5rc1

No significant changes.

Full Changelog

Check out the full changelog until this release (24.03.5rc1).

Full Commit Logs

Check out the full commit logs between release (24.03.5b1) and (24.03.5rc1).

24.03.5b1

Features

• New redis client (experimental) (#2041)
• Add support for CentOS 8 based kernels (#2220)
• Allow modifying model service session's environment variable setup (#2255)
• Add endpoint.runtime_variant column (#2256)
• Add new API to show list of supported inference runtimes (#2258)
• Add support for model service provisioning without model-definition.yaml (#2260)

Fixes

• Do not omit to update session's occupying resources to DB when a kernel starts. (#1832)
• Rename no-op access_key parameter of endpoint_list GQL Query to user_uuid (#2287)
• Fix ai.backend.service-ports label syntax broken when image does not expose built-in service port (#2288)
• Improve stability of untag_image_from_registry mutation (#2289)
• SSH not working between kernels started with customized image (#2290)
• Invalid container memory capacity reported (#2291)

Full Changelog

Check out the full changelog until this release (24.03.5b1).

Full Commit Logs

Check out the full commit logs between release (24.03.4) and (24.03.5b1).

24.03.4

Features

• Allow user to explicitly set filename of model definition YAML (#2063)
• Revamp images GQL query by changing image filtering from flag-based to feature set-based and add aliases field to customized image GQL schema (#2136)
• Added missing fields for keypair_resource_policy in client-py, models, etc. (#2146)
• Add parameters to check-presets SDK function (#2153)
• Add relay-aware VirtualFolderNode GQL Query (#2165)
• Also perform basic model service validation process when updating model service via ModifyEndpoint (#2167)
• Add support for mounting arbitrary VFolders on model service session (#2168)
• Clear zombie routes automatically (#2229)

Fixes

• Let the backend.ai mgr clear-history command clears session records as well as kernel records (#2077)
• Fix orphan model service routes being created (#2096)
• Fix initialization of the resource usage API's kernel-level usage aggregation (#2102)
• Fix model server starting on every kernels (including sub role kernels) on multi container infernce session (#2124)
• Handle fileset-already-exists response of create-filset API request and make sure to wait between all GPFS job polling iterations (#2144)
• • Fix error when calling check_presets Client SDK API with an invalid group parameter
  • Rewrite Client SDK to access all APIConfig fields (#2152)
• Ensure that all pending sessions are picked by schedulers (#2155)
• Fix security vulnerability for sudo_session_enabled (#2162)
• Rename endpoints.model_mount_destiation to model_mount_destination (#2163)
• Wait for real quota scope directory creation after Netapp create_qtree() call (#2170)
• Fix wrong per-user concurrency calculation logic (#2175)
• Fix model service persisting on degraded status forever in rare chance when trying to delete the service (#2191)
• Fix error when query or mutate GraphQL using BigInt field type (#2203)
• Fix backend.ai ssh command execution when packaged as SCIE/PEX (#2226)
• • fix endpoints query not working when trying to load image_row.aliases
  • fix endpoints.status reporting PROVISIONING when its status is in DESTROYING state (#2233)
• Fix GQL raising error when trying to resolve endpoints.errors field occasionally (#2236)

Miscellaneous

• Fix incorrect version notation of GQL Field. (#1993)
• Add max_pending_session_count field to Keypair resource policy GQL schema (#2013)

Full Changelog

Check out the full changelog until this release (24.03.4).

Full Commit Logs

Check out the full commit logs between release (24.03.4rc1) and (24.03.4).

24.03.4rc1

No significant changes.

Full Changelog

Check out the full changelog until this release (24.03.4rc1).

Full Commit Logs

Check out the full commit logs between release (24.03.4b2) and (24.03.4rc1).

24.03.4b2

Fixes

• Fix GQL raising error when trying to resolve endpoints.errors field occasionally (#2236)

Full Changelog

Check out the full changelog until this release (24.03.4b2).

Full Commit Logs

Check out the full commit logs between release (24.03.4b1) and (24.03.4b2).

24.03.4b1

Features

• Allow user to explicitly set filename of model definition YAML (#2063)
• Revamp images GQL query by changing image filtering from flag-based to feature set-based and add aliases field to customized image GQL schema (#2136)
• Added missing fields for keypair_resource_policy in client-py, models, etc. (#2146)
• Add parameters to check-presets SDK function (#2153)
• Add relay-aware VirtualFolderNode GQL Query (#2165)
• Also perform basic model service validation process when updating model service via ModifyEndpoint (#2167)
• Add support for mounting arbitrary VFolders on model service session (#2168)
• Clear zombie routes automatically (#2229)

Fixes

• Let the backend.ai mgr clear-history command clears session records as well as kernel records (#2077)
• Fix orphan model service routes being created (#2096)
• Fix initialization of the resource usage API's kernel-level usage aggregation (#2102)
• Fix model server starting on every kernels (including sub role kernels) on multi container infernce session (#2124)
• Handle fileset-already-exists response of create-filset API request and make sure to wait between all GPFS job polling iterations (#2144)
• • Fix error when calling check_presets Client SDK API with an invalid group parameter
  • Rewrite Client SDK to access all APIConfig fields (#2152)
• Ensure that all pending sessions are picked by schedulers (#2155)
• Fix security vulnerability for sudo_session_enabled (#2162)
• Rename endpoints.model_mount_destiation to model_mount_destination (#2163)
• Wait for real quota scope directory creation after Netapp create_qtree() call (#2170)
• Fix wrong per-user concurrency calculation logic (#2175)
• Fix model service persisting on degraded status forever in rare chance when trying to delete the service (#2191)
• Fix error when query or mutate GraphQL using BigInt field type (#2203)
• Fix backend.ai ssh command execution when packaged as SCIE/PEX (#2226)
• • fix endpoints query not working when trying to load image_row.aliases
  • fix endpoints.status reporting PROVISIONING when its status is in DESTROYING state (#2233)

Miscellaneous

• Fix incorrect version notation of GQL Field. (#1993)
• Add max_pending_session_count field to Keypair resource policy GQL schema (#2013)

Full Changelog

Check out the full changelog until this release (24.03.4b1).

Full Commit Logs

Check out the full commit logs between release (24.03.3) and (24.03.4b1).

24.03.3

Features

• Allow self-ssh in single-node single-container compute sessions. (#2032)
• Allow agent to report its internal registry snapshot via UNIX domain socket server (#2038)
• Expose user info to environment variables (#2043)
• Deprecate the reliance on HTTP cookies for authenticating the pipeline service, switching to the use of HTTP headers instead (#2051)
• Bring back etcetra-backed Etcd as an option for ditributed lock backend (#2079)
• Cache volume objects in RootContext.get_volume (#2081)

Fixes

• Fix container commit not working on certain docker engine versions (#2040)
• add omitted request fetching from client to manager about deleting vfolder in trash bin. (#2042)
• Fix a buggy restriction on VFolder deletion due to wrong query condition (#2055)
• Fix wrong usage of dataloader in GQL group resolver. (#2056)
• Ensure that vfolders, including automount vfolders, are mounted during session creation only if their status is not set to "DEAD" (i.e., deleted). (#2059)
• Fix wrong calculation of resource usage (#2062)
• Fix VFolder file operation not working when user has been granted access to shared but deleted VFolder which has same name with the normal one (#2072)
• Add missing type argument in group query (#2073)
• Fix compute_session_list GQL query not responding on an abundant amount of sessions (#2084)

Documentation Updates

• Fix a typo in the agent.toml example of the package-based installation guide to have a duplicate double quote (#2069)

Full Changelog

Check out the full changelog until this release (24.03.3).

Full Commit Logs

Check out the full commit logs between release (24.03.3rc3) and (24.03.3).

24.03.3rc3

Fixes

• Fix VFolder invitation not accepted when inviting VFolder shares name with already deleted one (#2093)

External Dependency Updates

• Update the prebuilt webui to latest (24.03.3)

Full Changelog

Check out the full changelog until this release (24.03.3rc3).

Full Commit Logs

Check out the full commit logs between release (24.03.3rc2) and (24.03.3rc3).