Dual JVM benchmarks are failing

[Akirathan]

For example at https://github.com/enso-org/enso/actions/runs/17310891684/job/49144677438#step:10:5492 :

INFO ide_ci::program::command: sbt ℹ️ [info] Execution finished with an error: java.lang.IndexOutOfBoundsException: Range [40, 40 + 65535) out of bounds for length 4096
   INFO ide_ci::program::command: sbt ℹ️ [info]         at <java> java.base/jdk.internal.util.Preconditions.outOfBounds(Preconditions.java:100)
   INFO ide_ci::program::command: sbt ℹ️ [info]         at <java> java.base/jdk.internal.util.Preconditions.outOfBoundsCheckFromIndexSize(Preconditions.java:118)
   INFO ide_ci::program::command: sbt ℹ️ [info]         at <java> java.base/jdk.internal.util.Preconditions.checkFromIndexSize(Preconditions.java:397)
   INFO ide_ci::program::command: sbt ℹ️ [info]         at <java> java.base/java.util.Objects.checkFromIndexSize(Objects.java:417)
   INFO ide_ci::program::command: sbt ℹ️ [info]         at <java> java.base/java.nio.ByteBuffer.get(ByteBuffer.java:913)
  ...

Another failure is in org.enso.benchmarks.generated.Compare_JVM_Modes.Real_Dual_Tests at https://github.com/enso-org/enso/actions/runs/17310891684/job/49144677438#step:10:5657

  INFO ide_ci::program::command: sbt ℹ️ [info] Process: /runner/_work/enso/enso/built-distribution/enso-engine-2025.3.1-dev-linux-amd64/enso-2025.3.1-dev/bin/enso with --run /tmp/temp9615697296109697638.tmp --vm.D=polyglot.enso.classLoading=guest should.be.able.to.get.tables
   INFO ide_ci::program::command: sbt ℹ️ [info] Exit code: 1

... And more problems, like a lot of suspicious logs:

   ...
   INFO ide_ci::program::command: sbt ℹ️ [info] [WARN] [2025-08-29T04:55:47+02:00] [org.enso.librarymanager.local.DefaultLocalLibraryProvider] Candidate library local.Enso_prj13560520769978915109dir at [***/enso_prj13560520769978915109.dir] may not be AOT ready! Use --jvm option when encoutering problems.
   INFO ide_ci::program::command: sbt ℹ️ [info] [WARN] [2025-08-29T04:55:47+02:00] [org.enso.librarymanager.local.DefaultLocalLibraryProvider] Candidate library local.Enso_prj16144645876746290168dir at [***/enso_prj16144645876746290168.dir] may not be AOT ready! Use --jvm option when encoutering problems.
   ...

for example at https://github.com/enso-org/enso/actions/runs/17310891684/job/49144677438#step:10:5937.

Most of these benchmarks seems to fail on Panic "Exit code: 1" throws from

enso/test/Benchmarks/src/Jvms/Execute_Generic_JDBC_Tests.enso

Line 29 in 1d702ef

Panic.throw "Exit code: "+code.to_text

. But the whole benchmark suite continues to run and reports some numbers. Note that this means that all the reported numbers for those failing benchmarks are nonsense.

[Akirathan]

Note that this would have been prevented if #13882 was implemented. When I locally run

sbt -Dbench.compileOnly=true "std-benchmarks/benchOnly org.enso.benchmarks.generated.Compare_JVM_Modes.Real_Dual_JVM_Tests"

It fails with:

[info] welcome to sbt 1.10.6 (Oracle Corporation Java 24.0.1)
[info] loading settings for project enso-build from plugins.sbt...
[info] loading project definition from /Users/pavel/dev/enso/project
[info] loading settings for project enso from build.sbt...
[info] resolving key references (109101 settings) ...
[info] set current project to enso (in build file:/Users/pavel/dev/enso/)
[warn] there's a key that's not used by any other settings/tasks:
[warn]  
[warn] * ThisBuild / additionalOpts
[warn]   +- /Users/pavel/dev/enso/build.sbt:6089
[warn]  
[warn] note: a setting might still be used by a command; to exclude a key from this `lintUnused` check
[warn] either append it to `Global / excludeLintKeys` or call .withRank(KeyRanks.Invisible) on the key
[info] Engine package created at built-distribution/enso-engine-0.0.0-dev-macos-aarch64/enso-0.0.0-dev
[info] Standard library indexes create for built-distribution/enso-engine-0.0.0-dev-macos-aarch64/enso-0.0.0-dev
[info] running (fork) org.enso.benchmarks.libs.LibBenchRunner org.enso.benchmarks.generated.Compare_JVM_Modes.Real_Dual_JVM_Tests
[info] Running benchmarks [org.enso.benchmarks.generated.Compare_JVM_Modes.Real_Dual_JVM_Tests] in compileOnly mode
[info] ::group::org.enso.benchmarks.generated.Compare_JVM_Modes.Real_Dual_JVM_Tests
[info] # Run progress: 0.00% complete, ETA 00:00:01
[info] # Fork: N/A, test runs in the host VM
[info] # *** WARNING: Non-forked runs may silently omit JVM options, mess up profilers, disable compiler hints, etc. ***
[info] # *** WARNING: Use non-forked runs only for debugging purposes, not for actual performance runs. ***
[error] SLF4J(I): Attempting to load provider "org.enso.logging.service.logback.test.provider.TestLogProvider" specified via "slf4j.provider" system property
[error] WARNING: A restricted method in java.lang.System has been called
[error] WARNING: java.lang.System::load has been called by com.oracle.truffle.polyglot.JDKSupport in module org.graalvm.truffle (file:/Users/pavel/Library/Caches/Coursier/v1/https/repo1.maven.org/maven2/org/graalvm/truffle/truffle-api/24.2.0/truffle-api-24.2.0.jar)
[error] WARNING: Use --enable-native-access=org.graalvm.truffle to avoid a warning for callers in this module
[error] WARNING: Restricted methods will be blocked in a future release unless native access is enabled
[info] Iteration   1: [WARN] [2025-08-29 12:18:19,924] [enso.org.enso.interpreter.runtime.EnsoContext] Initializing the context in a different working directory than the one containing the project root. This may lead to relative paths not behaving as advertised by `File.new`. Please run the engine inside of `/Users/pavel/dev/enso/test` directory.
[info] Found Enso executable:/Users/pavel/dev/enso/built-distribution/enso-engine-0.0.0-dev-macos-aarch64/enso-0.0.0-dev/bin/enso
[info] Replacing /var/folders/bl/dj8f8x456nq6fvjlxz5tb_6c0000gn/T/temp5898143129300257515.tmp/package.yaml with:
[info] name: Generic_JDBC_Tests
[info] namespace: enso_dev
[info] version: 0.0.1
[info] license: MIT
[info] author: enso-dev@enso.org
[info] maintainer: enso-dev@enso.org
[info] prefer-local-libraries: true
[info] Enso project created at /var/folders/bl/dj8f8x456nq6fvjlxz5tb_6c0000gn/T/temp5898143129300257515.tmp
[info] Process: /Users/pavel/dev/enso/built-distribution/enso-engine-0.0.0-dev-macos-aarch64/enso-0.0.0-dev/bin/enso with --jvm --run /var/folders/bl/dj8f8x456nq6fvjlxz5tb_6c0000gn/T/temp5898143129300257515.tmp --vm.D=polyglot.enso.classLoading=guest should.be.able.to.get.tables
[info] Exit code: 1
[info] [WARN] [2025-08-29T12:18:26+02:00] [enso.org.enso.interpreter.runtime.EnsoContext] Initializing the context in a different working directory than the one containing the project root. This may lead to relative paths not behaving as advertised by `File.new`. Please run the engine inside of `/private/var/folders/bl/dj8f8x456nq6fvjlxz5tb_6c0000gn/T` directory.
[info] [ERROR] [2025-08-29T12:18:27+02:00] [org.enso.interpreter.runtime.EnsoPolyglotJava] Using experimental OtherJvm support!
[info] [WARN] [2025-08-29T12:18:27+02:00] [org.enso.interpreter.runtime.EnsoPolyglotJava] Cannot register findLibraries
[info] com.oracle.truffle.api.interop.UnknownIdentifierException: Unknown identifier: findLibraries
[info] Execution finished with an error: java.lang.IndexOutOfBoundsException: Range [40, 40 + 65535) out of bounds for length 409
[info]         at <java> java.base/jdk.internal.util.Preconditions.outOfBounds(Preconditions.java:100)
[info]         at <java> java.base/jdk.internal.util.Preconditions.outOfBoundsCheckFromIndexSize(Preconditions.java:118)
[info]         at <java> java.base/jdk.internal.util.Preconditions.checkFromIndexSize(Preconditions.java:397)
[info]         at <java> java.base/java.util.Objects.checkFromIndexSize(Objects.java:417)
[info]         at <java> java.base/java.nio.ByteBuffer.get(ByteBuffer.java:913)
[info]         at <java> org.enso.persistance/org.enso.persist.PerInputImpl.read(PerInputImpl.java:94)
[info]         at <java> org.enso.persistance/org.enso.persist.PerInputImpl.readFully(PerInputImpl.java:117)
[info]         at <java> java.base/java.io.DataInputStream.readUTF(DataInputStream.java:597)
[info]         at <java> org.enso.persistance/org.enso.persist.PerInputImpl.readUTF(PerInputImpl.java:196)
[info]         at <java> org.enso.jvm.interop/org.enso.jvm.interop.impl.OtherJvmObject.readFrom(OtherJvmObject.java:235)
[info]         at <java> org.enso.jvm.interop/org.enso.jvm.interop.impl.OtherJvmMessage$PersistTruffleObject.readObject(OtherJvmMessage.java:159)
[info]         at <java> org.enso.jvm.interop/org.enso.jvm.interop.impl.OtherJvmMessage$PersistTruffleObject.readObject(OtherJvmMessage.java:141)
[info]         at <java> org.enso.persistance/org.enso.persist.Persistance.readWith(Persistance.java:165)
[info]         at <java> org.enso.persistance/org.enso.persist.PerInputImpl.readIndirect(PerInputImpl.java:217)
[info]         at <java> org.enso.persistance/org.enso.persist.PerInputImpl.readObject(PerInputImpl.java:73)
[info]         at <java> org.enso.jvm.interop/org.enso.jvm.interop.impl.OtherJvmMessage$PersistObjectArray.readObject(OtherJvmMessage.java:203)
[info]         at <java> org.enso.jvm.interop/org.enso.jvm.interop.impl.OtherJvmMessage$PersistObjectArray.readObject(OtherJvmMessage.java:182)
[info]         at <java> org.enso.persistance/org.enso.persist.Persistance.readWith(Persistance.java:165)
[info]         at <java> org.enso.persistance/org.enso.persist.PerInputImpl.readIndirect(PerInputImpl.java:217)
[info]         at <java> org.enso.persistance/org.enso.persist.PerInputImpl.readObject(PerInputImpl.java:73)
[info]         at <java> org.enso.jvm.interop/org.enso.jvm.interop.impl.OtherJvmMessage$PersistList.readObject(OtherJvmMessage.java:229)
[info]         at <java> org.enso.jvm.interop/org.enso.jvm.interop.impl.OtherJvmMessage$PersistList.readObject(OtherJvmMessage.java:209)
[info]         at <java> org.enso.persistance/org.enso.persist.Persistance.readWith(Persistance.java:165)
[info]         at <java> org.enso.persistance/org.enso.persist.PerInputImpl.readIndirect(PerInputImpl.java:217)
[info]         at <java> org.enso.persistance/org.enso.persist.PerInputImpl.readObject(PerInputImpl.java:73)
[info]         at <java> org.enso.jvm.interop/org.enso.jvm.interop.impl.PersistOtherJvmMessage.readObject(PersistOtherJvmMessage.java:13)
[info]         at <java> org.enso.jvm.interop/org.enso.jvm.interop.impl.PersistOtherJvmMessage.readObject(PersistOtherJvmMessage.java:4)
[info]         at <java> org.enso.persistance/org.enso.persist.Persistance.readWith(Persistance.java:165)
[info]         at <java> org.enso.persistance/org.enso.persist.PerInputImpl.readInline(PerInputImpl.java:66)
[info]         at <java> org.enso.persistance/org.enso.persist.PerBufferReference.readObject(PerBufferReference.java:48)
[info]         at <java> org.enso.persistance/org.enso.persist.Persistance$Reference.get(Persistance.java:341)
[info]         at <java> org.enso.jvm.channel/org.enso.jvm.channel.Channel.handleWithChannel(Channel.java:285)
[info]         at <java> org.enso.jvm.channel/org.enso.jvm.channel.Channel.toDirectMessage(Channel.java:319)
[info]         at <java> org.enso.jvm.channel/org.enso.jvm.channel.Channel.executeImpl(Channel.java:371)
[info]         at <java> org.enso.jvm.channel/org.enso.jvm.channel.Channel.execute(Channel.java:228)
[info]         at <java> org.enso.jvm.interop/org.enso.jvm.interop.impl.OtherJvmObject.executeMessage(OtherJvmObject.java:203)
[info]         at <java> org.enso.jvm.interop/org.enso.jvm.interop.impl.OtherJvmObject.send(OtherJvmObject.java:196)
[info]         at <java> org.enso.jvm.interop/org.enso.jvm.interop.impl.OtherJvmObjectGen$ReflectionLibraryExports$Cached.send(OtherJvmObjectGen.java:65)
[info]         at <java> org.graalvm.truffle/com.oracle.truffle.api.interop.InteropLibraryGen$Proxy.invokeMember(InteropLibraryGen.java:2899)
[info]         at <java> org.graalvm.truffle/com.oracle.truffle.api.interop.InteropLibraryGen$CachedDispatch.invokeMember(InteropLibraryGen.java:8497)
[info]         at <java> org.enso.runtime/org.enso.interpreter.node.callable.resolver.HostMethodCallNode.resolveHostMethod(HostMethodCallNode.java:223)
[info]         at <java> org.enso.runtime/org.enso.interpreter.node.callable.resolver.HostMethodCallNodeGen.executeAndSpecialize(HostMethodCallNodeGen.java:152)
[info]         at <java> org.enso.runtime/org.enso.interpreter.node.callable.resolver.HostMethodCallNodeGen.execute(HostMethodCallNodeGen.java:114)
[info]         at <java> org.enso.runtime/org.enso.interpreter.node.callable.InvokeMethodNode.doPolyglot(InvokeMethodNode.java:562)
[info]         at <java> org.enso.runtime/org.enso.interpreter.node.callable.InvokeMethodNodeGen.executeAndSpecialize(InvokeMethodNodeGen.java:868)
[info]         at <java> org.enso.runtime/org.enso.interpreter.node.callable.InvokeMethodNodeGen.execute(InvokeMethodNodeGen.java:525)
[info]         at <java> org.enso.runtime/org.enso.interpreter.node.callable.InvokeCallableNode.invokeDynamicSymbol(InvokeCallableNode.java:286)
[info]         at <java> org.enso.runtime/org.enso.interpreter.node.callable.InvokeCallableNodeGen.executeAndSpecialize(InvokeCallableNodeGen.java:274)
[info]         at <java> org.enso.runtime/org.enso.interpreter.node.callable.InvokeCallableNodeGen.execute(InvokeCallableNodeGen.java:226)
[info]         at <java> org.enso.runtime/org.enso.interpreter.node.callable.ApplicationNode.executeGeneric(ApplicationNode.java:97)
[info]         at <java> org.enso.runtime/org.enso.interpreter.node.callable.function.BlockNode.executeGeneric(BlockNode.java:78)
[info]         at <java> org.enso.runtime/org.enso.interpreter.node.ClosureRootNode.execute(ClosureRootNode.java:85)
[info]         at <enso> Result_Set.result_set_to_table.storageTypeMapper<arg-2>(Internal)
[info]         at <enso> Result_Set.result_set_to_table.storageTypeMapper(Result_Set.enso:35-36)
[info]         at <enso> Java_Problems.with_problem_aggregator(Java_Problems.enso:116:14-25)
[info]         at <enso> Result_Set.result_set_to_table(Result_Set.enso:34-37)
[info]         at <enso> Connection.get_tables_advanced.name_dict.table(Connection.enso:672:13-88)
[info]         at <enso> Resource.bracket(Internal)
[info]         at <enso> Connection.get_tables_advanced.name_dict(Connection.enso:671-672)
[info]         at <enso> JDBC_Connection.with_metadata.JDBC_Connection.with_metadata(JDBC_Connection.enso:91:9-23)
[info]         at <enso> Managed_Resource.with_builtin(Internal)
[info]         at <enso> Panic.catch(Internal)
[info]         at <enso> Panic.type.with_finalizer(Panic.enso:174:18-52)
[info]         at <enso> JDBC_Connection.synchronized(JDBC_Connection.enso:49:9-86)
[info]         at <enso> JDBC_Connection.with_connection(JDBC_Connection.enso:67-68)
[info]         at <enso> JDBC_Connection.with_metadata<arg-1>(JDBC_Connection.enso:89-91)
[info]         at <enso> Panic.catch(Internal)
[info]         at <enso> JDBC_Connection.handle_sql_errors(JDBC_Connection.enso:345-348)
[info]         at <enso> JDBC_Connection.with_metadata(JDBC_Connection.enso:89-91)
[info]         at <enso> Connection.get_tables_advanced(Connection.enso:670-675)
[info]         at <enso> Generic_JDBC_Connection.tables(Generic_JDBC_Connection.enso:269:9-104)
[info]         at <enso> H2_Spec.add_specs.config.lower<arg-0>(src/H2_Spec.enso:103:17-40)
[info]         at <enso> H2_Spec.add_specs.config.lower<arg-0>(src/H2_Spec.enso:103:17-52)
[info]         at <enso> H2_Spec.add_specs.config.lower<arg-0>(src/H2_Spec.enso:103:17-64)
[info]         at <enso> H2_Spec.add_specs.config.lower<arg-1>(src/H2_Spec.enso:103:17-87)
[info]         at <enso> Panic.catch(Internal)
[info]         at <enso> Panic.type.with_finalizer(Panic.enso:174:18-52)
[info]         at <enso> H2_Spec.add_specs.config.cleanup(src/H2_Spec.enso:55:13-47)
[info]         at <enso> H2_Spec.add_specs.config.lower(src/H2_Spec.enso:98-114)
[info]         at <enso> H2_JDBC_Config.with_connection.H2_JDBC_Config.with_connection<arg-1>(src/H2_Spec.enso:38:17-27)
[info]         at <enso> Panic.catch(Internal)
[info]         at <enso> Panic.type.with_finalizer(Panic.enso:174:18-52)
[info]         at <enso> H2_JDBC_Config.with_connection.H2_JDBC_Config.with_connection(src/H2_Spec.enso:37-38)
[info]         at <enso> H2_JDBC_Config.with_database<arg-1>(src/H2_Spec.enso:29:13-22)
[info]         at <enso> Panic.catch(Internal)
[info]         at <enso> Panic.type.with_finalizer(Panic.enso:174:18-52)
[info]         at <enso> H2_JDBC_Config.with_database(src/H2_Spec.enso:27-29)
[info]         at <enso> H2_JDBC_Config.with_connection(src/H2_Spec.enso:32-38)
[info]         at <enso> H2_Spec.add_specs.config<arg-1>(src/H2_Spec.enso:98-114)
[info]         at <enso> case_branch.case <internal-1856>(Group.enso:37:61-64)
[info]         at <enso> Helpers.execute_spec_code<arg-1>(Helpers.enso:56:18-34)
[info]         at <enso> Panic.catch(Internal)
[info]         at <enso> Panic.type.recover(Panic.enso:212-217)
[info]         at <enso> Helpers.execute_spec_code(Helpers.enso:55-59)
[info]         at <enso> case_branch<arg-3>(Helpers.enso:45:37-63)
[info]         at <enso> case_branch<arg-1>(Helpers.enso:45:13-64)
[info]         at <enso> Runtime.no_inline(Internal)
[info]         at <enso> Runtime.no_inline(Runtime.enso:90:21-52)
[info]         at <enso> Duration.type.time_execution(Duration.enso:149:18-43)
[info]         at <enso> case_branch(Helpers.enso:44-45)
[info]         at <enso> Helpers.run_spec(Helpers.enso:43-46)
[info]         at <enso> case_branch.test_results(Helpers.enso:24:24-36)
[info]         at <enso> Array_Like_Helpers.map.Array_Like_Helpers.map(Array_Like_Helpers.enso:277:56-77)
[info]         at <enso> Array_Like_Helpers.vector_from_function(Internal)
[info]         at <enso> case_branch(Helpers.enso:21-27)
[info]         at <enso> Helpers.run_specs_from_group(Helpers.enso:18-33)
[info]         at <enso> case_branch(Suite.enso:101:35-92)
[info]         at <enso> Suite.run_with_filter.junit_sb_builder(Suite.enso:99-105)
[info]         at <enso> Array_Like_Helpers.each.Array_Like_Helpers.each(Array_Like_Helpers.enso:317:9-24)
[info]         at <enso> Range.each.go<arg-1>(Range.enso:323:36-51)
[info]         at <enso> Range.each.go<arg-2>(Range.enso:323:21-52)
[info]         at <enso> Range.each.go(Range.enso:322-324)
[info]         at <enso> Range.each<arg-2>(Range.enso:325:13-25)
[info]         at <enso> Range.each(Range.enso:319-325)
[info]         at <enso> Array_Like_Helpers.each(Array_Like_Helpers.enso:316-317)
[info]         at <enso> Vector.each(Vector.enso:933:9-38)
[info]         at <enso> Suite.run_with_filter<arg-1>(Suite.enso:96-105)
[info]         at <enso> Test_Reporter.wrap_junit_testsuites(Test_Reporter.enso:30:14-19)
[info]         at <enso> Suite.run_with_filter(Suite.enso:95-105)
[info]         at <enso> Main.main(src/Main.enso:11:5-32)
[info] java.lang.IndexOutOfBoundsException: Range [40, 40 + 65535) out of bounds for length 4096
[info] <failure>
[info] Exit code: 1
[info] 	at <enso> Panic.throw(Unknown)
[info] 	at <enso> case_branch(../../test/Benchmarks/src/Jvms/Execute_Generic_JDBC_Tests.enso:29:1058-1095)
[info] 	at <enso> Data.startup(../../test/Benchmarks/src/Jvms/Execute_Generic_JDBC_Tests.enso:23-31:767-1158)
[error] Benchmark run failed: Benchmark caught the exception
[error] org.openjdk.jmh.runner.RunnerException: Benchmark caught the exception
[error] 	at jmh.core@1.36/org.openjdk.jmh.runner.Runner.runBenchmarks(Runner.java:575)
[error] 	at jmh.core@1.36/org.openjdk.jmh.runner.Runner.internalRun(Runner.java:310)
[error] 	at jmh.core@1.36/org.openjdk.jmh.runner.Runner.run(Runner.java:209)
[error] 	at org.enso.benchmarks.common/org.enso.interpreter.bench.BenchmarksRunner.runCompileOnly(BenchmarksRunner.java:98
[error] 	at org.enso.benchmarks.common/org.enso.interpreter.bench.BenchmarksRunner.run(BenchmarksRunner.java:43)
[info] 	at <enso> Data.bench_tests(../../test/Benchmarks/src/Jvms/Execute_Generic_JDBC_Tests.enso:14:362-423)
[info] 	at <enso> Execute_Generic_JDBC_Tests.collect_benches.Execute_Generic_JDBC_Tests.collect_benches.real_test_filter<arg-1>(../../test/Benchmarks/src/Jvms/Execute_Generic_JDBC_Tests.enso:61:2771-2861)
[info] 	at <enso> Group_Builder.specify.Group_Builder.specify(../../distribution/lib/Standard/Test/0.0.0-dev/src/Bench.enso:86:2873-2881)
[info] 	at org.graalvm.polyglot/org.graalvm.polyglot.Value.execute(Value.java:1049)
[info] 	at org.enso.runtime/org.enso.benchmarks.generated.Compare_JVM_Modes.Real_Dual_JVM_Tests(Compare_JVM_Modes.java:261)
[info] 	at org.enso.runtime/org.enso.benchmarks.generated.jmh_generated.Compare_JVM_Modes_Real_Dual_JVM_Tests_jmhTest.Real_Dual_JVM_Tests_avgt_jmhStub(Compare_JVM_Modes_Real_Dual_JVM_Tests_jmhTest.java:310)
[info] 	at org.enso.runtime/org.enso.benchmarks.generated.jmh_generated.Compare_JVM_Modes_Real_Dual_JVM_Tests_jmhTest.Real_Dual_JVM_Tests_AverageTime(Compare_JVM_Modes_Real_Dual_JVM_Tests_jmhTest.java:231)
[info] 	at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
[info] 	at java.base/java.lang.reflect.Method.invoke(Method.java:565)
[info] 	at jmh.core@1.36/org.openjdk.jmh.runner.BenchmarkHandler$BenchmarkTask.call(BenchmarkHandler.java:475)
[error] 	at org.enso.runtime/org.enso.benchmarks.libs.LibBenchRunner.main(LibBenchRunner.java:17)
[error] Caused by: org.openjdk.jmh.runner.BenchmarkException: Benchmark error during the run
[error] 	at jmh.core@1.36/org.openjdk.jmh.runner.BenchmarkHandler.runIteration(BenchmarkHandler.java:424)
[error] 	at jmh.core@1.36/org.openjdk.jmh.runner.BaseRunner.runBenchmark(BaseRunner.java:281)
[error] 	at jmh.core@1.36/org.openjdk.jmh.runner.BaseRunner.runBenchmark(BaseRunner.java:233)
[error] 	at jmh.core@1.36/org.openjdk.jmh.runner.BaseRunner.doSingle(BaseRunner.java:138)
[error] 	at jmh.core@1.36/org.openjdk.jmh.runner.BaseRunner.runBenchmarksEmbedded(BaseRunner.java:110)
[error] 	at jmh.core@1.36/org.openjdk.jmh.runner.Runner.runBenchmarks(Runner.java:555)
[error] 	... 5 more
[info] 	at jmh.core@1.36/org.openjdk.jmh.runner.BenchmarkHandler$BenchmarkTask.call(BenchmarkHandler.java:458)
[info] 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:328)
[info] 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:545)
[info] 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:328)
[info] 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1095)
[info] 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:619)
[info] 	at java.base/java.lang.Thread.run(Thread.java:1447)
[error] 	Suppressed: org.graalvm.polyglot.PolyglotException: Exit code: 1
[error] 		at <enso>.Panic.throw(Unknown)
[error] 		at <enso>.case_branch(Execute_Generic_JDBC_Tests.enso:29)
[error] 		at <enso>.Data.startup(Execute_Generic_JDBC_Tests.enso:23)
[error] 		at <enso>.Data.bench_tests(Execute_Generic_JDBC_Tests.enso:14)
[error] 		at <enso>.Execute_Generic_JDBC_Tests.collect_benches.Execute_Generic_JDBC_Tests.collect_benches.real_test_filter<arg-1>(Execute_Generic_JDBC_Tests.enso:61)
[error] 		at <enso>.Group_Builder.specify.Group_Builder.specify(Bench.enso:86)
[error] 		at org.graalvm.polyglot/org.graalvm.polyglot.Value.execute(Value.java:1049)
[error] 		at org.enso.runtime/org.enso.benchmarks.generated.Compare_JVM_Modes.Real_Dual_JVM_Tests(Compare_JVM_Modes.java:261)
[error] 		at org.enso.runtime/org.enso.benchmarks.generated.jmh_generated.Compare_JVM_Modes_Real_Dual_JVM_Tests_jmhTest.Real_Dual_JVM_Tests_avgt_jmhStub(Compare_JVM_Modes_Real_Dual_JVM_Tests_jmhTest.java:310)
[error] 		at org.enso.runtime/org.enso.benchmarks.generated.jmh_generated.Compare_JVM_Modes_Real_Dual_JVM_Tests_jmhTest.Real_Dual_JVM_Tests_AverageTime(Compare_JVM_Modes_Real_Dual_JVM_Tests_jmhTest.java:231)
[error] 		at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
[error] 		at java.base/java.lang.reflect.Method.invoke(Method.java:565)
[error] 		at jmh.core@1.36/org.openjdk.jmh.runner.BenchmarkHandler$BenchmarkTask.call(BenchmarkHandler.java:475)
[error] 		at jmh.core@1.36/org.openjdk.jmh.runner.BenchmarkHandler$BenchmarkTask.call(BenchmarkHandler.java:458)
[error] 		at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:328)
[error] 		at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:545)
[error] 		at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:328)
[error] 		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1095)
[error] 		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:619)
[error] 		at java.base/java.lang.Thread.run(Thread.java:1447)
[error] Nonzero exit code returned from runner: 1
[error] (std-benchmarks / Compile / run) Nonzero exit code returned from runner: 1
[error] Total time: 13 s, completed Aug 29, 2025, 12:18:28 PM

[JaroslavTulach]

• I did execute the benchmarks few times in Benchmark and speed dual JVM mode up #13780!
• and it delivered results: Benchmark and speed dual JVM mode up #13780 (comment)

[Akirathan]

and it delivered results: #13780 (comment)

I see. So this is a regression, then. Note that I am ensuring that no such regression will happen ever again in #13883 by running std-benchmarks/bench dry-run on the CI.

[Akirathan]

Dual JVM benchmarks ignored in b0f32f5