Skip to content

Commit

Permalink
Information on the number of queries processed by trec_eval as default (
Browse files Browse the repository at this point in the history
#101)

* num_q as additional default measure

* search info updated
  • Loading branch information
chauff authored and Ryan Clancy committed Jun 14, 2019
1 parent f862744 commit e26b16c
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -104,7 +104,7 @@ Options with `none` as the default are required.
| `--qrels` | `string` | `none` | `--qrels $(pwd)/qrels/qrels.robust2004.txt` | the qrels file for evaluation
| `--opts` | `[key]=[value] ...` | `none` | `--opts search_args="-bm25"` | extra options passed to the search script
| `--timings` | `flag` | `false` | `--timings` | print timing info (requires the `time` package, or `bash`, to be installed in Dockerfile)
| `--measures` | `string ...` | `"map P.30"` | `--measures recall.1000 map` | the measures for trec_eval
| `--measures` | `string ...` | `"num_q map P.30"` | `--measures recall.1000 map` | the measures for trec_eval

### Command Line Options - train

Expand Down
2 changes: 1 addition & 1 deletion run.py
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ def str_to_bool(s):
help="the subset of topic ids to use for testing")
parser_search.add_argument("--opts", nargs="+", default="", type=str, help="the args passed to the search script")
parser_search.add_argument("--timings", action="store_true", help="enable timing information to be printed")
parser_search.add_argument("--measures", nargs="+", default=["map", "P.30"], type=str, help="the measures for trec_eval")
parser_search.add_argument("--measures", nargs="+", default=["num_q", "map", "P.30"], type=str, help="the measures for trec_eval")

# Specific to interact
parser_interact = parser_sub.add_parser("interact")
Expand Down

0 comments on commit e26b16c

Please sign in to comment.