Skip to content

Commit c48e0de

Browse files
Update .buildkite/lm-eval-harness/test_lm_eval_correctness.py
update gpu default usage Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
1 parent 9daacad commit c48e0de

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

.buildkite/lm-eval-harness/test_lm_eval_correctness.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@
1919
def launch_lm_eval(eval_config, tp_size):
2020
trust_remote_code = eval_config.get("trust_remote_code", False)
2121
max_model_len = eval_config.get("max_model_len", 4096)
22-
gpu_memory_utilization = eval_config.get("gpu_memory_utilization", 1.0)
22+
gpu_memory_utilization = eval_config.get("gpu_memory_utilization", 0.9)
2323
batch_size = eval_config.get("batch_size", "auto")
2424
model_args = (
2525
f"pretrained={eval_config['model_name']},"

0 commit comments

Comments
 (0)