Skip to content

Conversation

@sriv
Copy link
Member

@sriv sriv commented Oct 30, 2025

for #2793

How It Works

Auto-generated Seed:

  gauge run --sort=random specs/
  # Output: Randomizing execution with seed: 1761802692487777000

Explicit Seed (Reproducible):

  gauge run --sort=random --random-seed=12345 specs/
  # Output: Randomizing execution with seed: 12345

Repeat Last Execution:

  gauge run --repeat
  # Uses the same seed from previous run

Failed Scenarios:

  gauge run --failed
  # Uses the same seed from previous run, executes only failed scenarios

@sschulz92
Copy link
Contributor

Lookgs great to me, thank you for the Pull-Request, looking forward to it :)

@github-actions
Copy link
Contributor

github-actions bot commented Oct 30, 2025

Benchmark Results

java_simple_multithreaded.csv

Commit CPU Memory Time ExitCode
bb872e3 33% 67488 0:11.24 0
bc05ae1 32% 65608 0:11.87 0
7d3f2cf 30% 65828 0:12.41 0
9863825 33% 65312 0:11.37 0

java_maven_multithreaded.csv

Commit CPU Memory Time ExitCode
bb872e3 68% 204612 0:16.22 0
bc05ae1 58% 206016 0:18.52 0
7d3f2cf 43% 180196 0:23.88 0
9863825 42% 179880 0:24.20 0

java_simple_serial.csv

Commit CPU Memory Time ExitCode
bb872e3 36% 67452 0:17.74 0
bc05ae1 45% 62876 0:14.33 0
7d3f2cf 43% 65616 0:14.85 0
9863825 56% 65248 0:11.45 0

java_gradle_multithreaded.csv

Commit CPU Memory Time ExitCode
bb872e3 9% 121168 0:24.11 0
bc05ae1 9% 124120 0:24.78 0
7d3f2cf 182% 580952 0:28.28 0
9863825 181% 570208 0:27.96 0

java_simple_parallel.csv

Commit CPU Memory Time ExitCode
bb872e3 20% 67792 0:27.00 0
bc05ae1 19% 67884 0:30.30 0
7d3f2cf 20% 67500 0:26.37 0
9863825 21% 68120 0:25.82 0

java_maven_serial.csv

Commit CPU Memory Time ExitCode
bb872e3 76% 220396 0:17.73 0
bc05ae1 78% 221940 0:17.37 0
7d3f2cf 48% 179544 0:27.44 0
9863825 64% 180796 0:21.91 0

java_gradle_parallel.csv

Commit CPU Memory Time ExitCode
bb872e3 6% 123416 0:42.18 0
bc05ae1 5% 115312 0:43.77 0
7d3f2cf 115% 557904 0:44.08 0
9863825 111% 579568 0:47.83 0

java_gradle_serial.csv

Commit CPU Memory Time ExitCode
bb872e3 9% 101224 0:25.11 0
bc05ae1 9% 106956 0:27.26 0
7d3f2cf 180% 559464 0:29.04 0
9863825 189% 551004 0:27.85 0

java_maven_parallel.csv

Commit CPU Memory Time ExitCode
bb872e3 36% 196088 0:33.94 0
bc05ae1 34% 194564 0:36.99 0
7d3f2cf 29% 181836 0:46.20 0
9863825 32% 179128 0:37.81 0

Notes

  • The results above are generated by running against seed projects in https://github.com/getgauge/gauge-benchmark
  • These results are not persisted, but on merging to master the benchmark will be rerun.
  • These benchmark are run in Github Actions' agents, which are virtualized. Results are not to be taken as actual benchmarks.Rather, these are indicative numbers and make sense for comparison.

See Workflow log for more details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

5 participants