Skip to content

Commit ac40de4

Browse files
committed
fix: use the context correctly in mt_bench_branch
The key is supposed to be context, not question. Signed-off-by: Brad P. Crochet <brad@redhat.com>
1 parent 6914d27 commit ac40de4

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

src/instructlab/eval/mt_bench_branch_generator.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -60,7 +60,7 @@ def generate(judge_model_name, branch, taxonomy_dir, output_dir):
6060
if q is None or a is None:
6161
continue
6262

63-
c = ex["question"] if "context" in ex else None
63+
c = ex.get("context")
6464
if c is not None:
6565
t_1 = (
6666
"Given the context below:\n"

0 commit comments

Comments
 (0)