switch to run directory when running multiple tasks with the same run…

… directory (#708) Co-authored-by: aisi-inspect <166920645+aisi-inspect@users.noreply.github.com>
UKGovernmentBEIS · Oct 16, 2024 · c99e224 · c99e224
1 parent a1ea3da
commit c99e224
Show file tree

Hide file tree

Showing 2 changed files with 3 additions and 1 deletion.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -8,6 +8,7 @@
 - Requirements: require semver>=3.0.0
 - Open log files in binary mode when reading headers (fixes ijson deprecation warning).
 - Bugfix: strip protocol prefix when resolving eval event content
+- Bugfix: switch to run directory when running multiple tasks with the same run directory.
 
 ## v0.3.41 (11 October 2024)
 

diff --git a/src/inspect_ai/_eval/run.py b/src/inspect_ai/_eval/run.py
@@ -177,7 +177,8 @@ async def eval_run(
                 with task_run_dir_switching():
                     return await run_multiple(task_run_options, parallel)
             else:
-                return await run_multiple(task_run_options, parallel)
+                with chdir(run_dir):
+                    return await run_multiple(task_run_options, parallel)
 
         # single mode is for a single task definitions (which
         # could in turn be executed for multiple models)