How can I reduce synchronous testing time with --rate-type=sweep?

[psydok]

When using sweep, it takes a lot of time for the first test (synchronous), despite the fact that the values (latency, ttft, etc) do not change much.

      export GUIDELLM__PREFERRED_ROUTE="chat_completions" &&
      export GUIDELLM__OPENAI__MAX_OUTPUT_TOKENS=${output_sequence_length} &&
      export GUIDELLM__MAX_CONCURRENCY=233 &&
      export GUIDELLM__REQUEST_TIMEOUT=${duration_sec} &&
      export GUIDELLM__PREFERRED_PROMPT_TOKENS_SOURCE=local &&
      export GUIDELLM__PREFERRED_OUTPUT_TOKENS_SOURCE=local &&
      guidellm benchmark
      --target ${llm_base_url}
      --rate-type sweep --rate 5
      --model ${model} --processor ${processor}
      --random-seed ${seed}
      --max-requests=100
....

For other tests, less than 100 requests are unuseful.

[sjmonson]

We have some in-progress plans on auto-stopping based on metric convergence but its probably at least a few months out. One option is to specify a max-seconds that is large enough to allow 100 requests to complete in other runs e.g. --max-requests=100 --max-seconds=10.

[psydok]

But for other tests, max-seconds of 10 is very small value...