Code

Improve inspect score command#1293

Code

Merged

jjallaire merged 26 commits intomainUKGovernmentBEIS/inspect_ai:mainfrom feature/score-taskUKGovernmentBEIS/inspect_ai:feature/score-taskCopy head branch name to clipboardFeb 12, 2025

+878-140

Commits

Commits on Feb 12, 2025

• Improved unscored sample score rendering

  dragonstyle

  committed
  378532e

  Copy full SHA for 378532e

• Record scorer configuation with the eval

  Show description for 70c0b0c
  dragonstyle

  committed
  70c0b0c

  Copy full SHA for 70c0b0c

• Don’t require task param in score command

  dragonstyle

  committed
  f31e4be

  Copy full SHA for f31e4be

• Load eval metrics for the eval itself

  Show description for 9c178c1
  dragonstyle

  committed
  9c178c1

  Copy full SHA for 9c178c1

• Try loading scorers from the task file

  dragonstyle

  committed
  2b9127a

  Copy full SHA for 2b9127a

• Don’t throw if call doesn’t have return type

  Show description for 534348f
  dragonstyle

  committed
  534348f

  Copy full SHA for 534348f

• Additional cleanup

  dragonstyle

  committed
  a9b4624

  Copy full SHA for a9b4624

• Correct types

  dragonstyle

  committed
  f440af7

  Copy full SHA for f440af7

• Load scorers from the command line

  dragonstyle

  committed
  dc620fd

  Copy full SHA for dc620fd

• add action to control append/overwrite

  dragonstyle

  committed
  d8df5d5

  Copy full SHA for d8df5d5

• Prompt for overwrite/append

  dragonstyle

  committed
  5c8ec70

  Copy full SHA for 5c8ec70

• minor cleanup

  dragonstyle

  committed
  5970604

  Copy full SHA for 5970604

• Misc fine tuning

  dragonstyle

  committed
  58c7c59

  Copy full SHA for 58c7c59

• Improve results display

  dragonstyle

  committed
  1dbcfa4

  Copy full SHA for 1dbcfa4

• correct types

  dragonstyle

  committed
  4230722

  Copy full SHA for 4230722

• add tests

  dragonstyle

  committed
  09c4f77

  Copy full SHA for 09c4f77

• Add missing arg

  dragonstyle

  committed
  3071bbe

  Copy full SHA for 3071bbe

• fix lint

  dragonstyle

  committed
  1c5ac24

  Copy full SHA for 1c5ac24

• Fix error

  dragonstyle

  committed
  7952dee

  Copy full SHA for 7952dee

• add test files

  dragonstyle

  committed
  a7e40e4

  Copy full SHA for a7e40e4

• correct typo

  dragonstyle

  committed
  f3c3170

  Copy full SHA for f3c3170

• scoring workflow docs

  jjallaire

  committed
  909aa12

  Copy full SHA for 909aa12

• eliminate crossref conflicts

  jjallaire

  committed
  ed16966

  Copy full SHA for ed16966

• eliminate crossref conflicts

  jjallaire

  committed
  6f4863f

  Copy full SHA for 6f4863f

• update changelog

  jjallaire

  committed
  9761841

  Copy full SHA for 9761841

• Merge branch 'main' into feature/score-task

  jjallaire

  authored
  1344c6d

  Copy full SHA for 1344c6d