diff --git a/references/supported_models.html b/references/supported_models.html index 7368dfe6b..f4daca960 100644 --- a/references/supported_models.html +++ b/references/supported_models.html @@ -581,6 +581,10 @@
Get the reference output by python3 scripts/playground/reference_hf.py --model-path [new model] --model-type {text,vlm}
Get the SGLang output by python3 -m sglang.bench_one_batch --correct --model [new model]
Warning
+When comparing outputs between reference_hf.py and SGLang, ensure that parameters such as --dtype
, temperature, top_p, and other sampling parameters are identical across both scripts. Even small differences in these parameters can lead to variations in output that might be mistakenly attributed to implementation issues.