Benchmark and speed dual JVM mode up #13780

JaroslavTulach · 2025-08-14T12:59:01Z

Pull Request Description

benchmark comparing various JVM modes
- native image + Dual NI + JVM Mode for Loading Libraries #13172
- true --jvm mode
- JVM mode + Dual NI + JVM Mode for Loading Libraries #13172
the idea is to measure how long it takes to run test/Generic_JDBC_Tests project
- initial benchmark results obtained
- final benchmark run as well
adding support for histogram of interop JVM messages
- using it in tests to control the number of transferred messages
eliminated the most frequent messages by precomputing, sharing instances of OtherJvmObject and caching computed queries

Checklist

Please ensure that the following checklist has been satisfied before submitting the PR:

All code follows the
Scala,
Java,
TypeScript,
and
Rust
style guides. In case you are using a language not listed above, follow the Rust style guide.
Unit tests have been written where possible.
benchmark run is OK

test/Benchmarks/src/Jvms/Execute_Generic_JDBC_Tests.enso

JaroslavTulach · 2025-08-15T07:56:43Z

lib/java/persistance/src/main/java/org/enso/persist/PerGenerator.java

  static byte[] writeObject(PerMap map, Object obj, Function<Object, Object> writeReplace)
      throws IOException {
-    var histogram = PerUtils.LOG.isLoggable(System.Logger.Level.DEBUG) ? new Histogram() : null;
+    var histogram = PerUtils.LOG.isLoggable(System.Logger.Level.TRACE) ? new Histogram() : null;


this change suppresses histogram (of transfered bytes) printing in the "dual JVM"

by printing less, the message exchange shall get faster: benchmark run

the big question for @hubertp: How to configure logging in the "dual JVM"?

test/Benchmarks/src/Jvms/Execute_Generic_JDBC_Tests.enso

JaroslavTulach · 2025-08-15T16:11:45Z

Time to reduce the histogram of sent messages...

JaroslavTulach · 2025-08-16T05:50:31Z

lib/java/jvm-interop/src/main/java/org/enso/jvm/interop/impl/OtherJvmPool.java

+   * runEngineDistribution
+   *    --vm.D=org.enso.jvm.interop.limit=100000
+   *    --vm.D=polyglot.enso.classLoading=guest
+   *    --run test/Generic_JDBC_Tests


Since f0ded99 use:

runEngineDistribution --vm.D=org.enso.jvm.interop.limit=100000 --vm.D=polyglot.enso.classLoading=guest --run test/Generic_JDBC_Tests

to dump the top 10 of most frequent messages being sent.

JaroslavTulach · 2025-08-16T09:33:39Z

lib/java/jvm-interop/src/main/java/org/enso/jvm/interop/impl/OtherJvmObject.java

-        yield new OtherJvmObject(null, id);
+        var other = new OtherJvmObject(null, id);
+        other.isMetaObject = iop.isMetaObject(foreign);
+        other.isNull = iop.isNull(foreign);


Prefilling isMetaObject and isNull before leaving the other JVM should speed things up: benchmark run scheduled to verify the hypothesis.

JaroslavTulach · 2025-08-16T10:16:03Z

test/Benchmarks/src/Jvms/Execute_Generic_JDBC_Tests.enso

+            data.bench_tests 1 [ "--vm.D=polyglot.enso.classLoading=guest", single_test_filter ]
+        group_builder.specify "Single_Dual_JVM_Tests" <|
+            data.bench_tests 1 jvm=True [ "--vm.D=polyglot.enso.classLoading=guest", single_test_filter ]
+        group_builder.specify "Real_JVM_Tests" <|


This is the "real" test that occupies most of the Generic_JDBC_Tests execution. It used to be quite slow. Now it is just six times slower than the one in --jvm mode. Time to generate the initial benchmark data.

…ave parent meta objects

JaroslavTulach · 2025-08-18T07:59:22Z

lib/java/jvm-interop/src/main/java/org/enso/jvm/interop/impl/OtherJvmObject.java

      }
      case TruffleObject foreign -> {
        var iop = InteropLibrary.getUncached();
+        if (iop.isString(foreign)) {


Transferring strings directly shall allow us to eliminate isString messages in fc4ff25 - benchmark run to confirm.

JaroslavTulach · 2025-08-18T13:00:46Z

lib/java/jvm-interop/src/main/java/org/enso/jvm/interop/impl/OtherJvmObject.java

-  private Boolean isNull;
-  private Boolean hasArrayElements;
+  private final short mask;
  private String metaQualifiedName;


Replacing all the Boolean fields by a single short mask in 4c8ef7c. Benchmarking in this run.

JaroslavTulach · 2025-08-19T08:24:45Z

the last benchmark run shows acceptable state and also some progress
the most important set of benchmarks is the Real test execution
it shows improvement - from 50-60s to 20-30s

that's still way slower than 11s when executed with --jvm
but it is "bearable"
- it is not hideously slow
- we have infrastructure to track progress
I think we can integrate

Bechmark various JVM modes on execution of Generic_JDBC_Tests

ee08f82

JaroslavTulach requested a review from Akirathan August 14, 2025 12:59

JaroslavTulach self-assigned this Aug 14, 2025

JaroslavTulach requested review from AdRiley, GregoryTravis, hubertp and jdunkerley as code owners August 14, 2025 12:59

JaroslavTulach added the CI: No changelog needed Do not require a changelog entry for this PR. label Aug 14, 2025

JaroslavTulach commented Aug 14, 2025

View reviewed changes

test/Benchmarks/src/Jvms/Execute_Generic_JDBC_Tests.enso Show resolved Hide resolved

JaroslavTulach added 2 commits August 14, 2025 18:56

Print out the corrected yaml

e340923

Check the expected number of successful tests

1399d42

enso-bot bot mentioned this pull request Aug 15, 2025

Unable to run individual runtime-integration-tests #13776

Closed

JaroslavTulach added 2 commits August 15, 2025 07:49

Remove ENSO_TEST_JUNIT_DIR env variable before running benchmarks

83a00dd

Log persitable histogram only when tracing

4c998f4

JaroslavTulach requested a review from 4e6 as a code owner August 15, 2025 07:31

JaroslavTulach commented Aug 15, 2025

View reviewed changes

Akirathan approved these changes Aug 15, 2025

View reviewed changes

test/Benchmarks/src/Jvms/Execute_Generic_JDBC_Tests.enso Show resolved Hide resolved

enso-bot bot mentioned this pull request Aug 16, 2025

Autoscope constructors do not work with warnings #13295

Closed

2 tasks

JaroslavTulach added 2 commits August 16, 2025 06:58

Only need host language

bdf4e1d

Support for profiling interop JVM messages

f0ded99

JaroslavTulach commented Aug 16, 2025

View reviewed changes

JaroslavTulach added 3 commits August 16, 2025 08:47

Moving serde logic into OtherJvmObject

81dc1dd

Only profile really sent messages

05c0218

Pre-fill isNull and isMetaObject

5a8e760

JaroslavTulach commented Aug 16, 2025

View reviewed changes

JaroslavTulach added 3 commits August 16, 2025 11:45

Fill in meta qualified name to speed things up

d2b6213

Include few lines of stacktrace with each topten item

cd4760e

Adding real test performing quite a lot of JVM calls

0c30444

JaroslavTulach commented Aug 16, 2025

View reviewed changes

JaroslavTulach added 5 commits August 18, 2025 08:47

java.lang.Class objects are cached on the other JVM side and always h…

5fa2f31

…ave parent meta objects

Caching GET_META_PARENTS results for future queries

c40da85

Pre-compute hasArrayElements

552b9cc

Always transfer string like objects asString

fc4ff25

Encoding InteropLibrary state into a short mask

4c8ef7c

JaroslavTulach commented Aug 18, 2025

View reviewed changes

JaroslavTulach added the CI: Keep up to date Automatically update this PR to the latest develop. label Aug 19, 2025

Merge branch 'develop' into wip/jtulach/BenchmarkJvmModes

472f29e

JaroslavTulach changed the title ~~Bechmark various JVM modes on execution of Generic_JDBC_Tests~~ Bechmark and speed various JVM modes up Aug 19, 2025

JaroslavTulach added this to Issues Board Aug 19, 2025

JaroslavTulach moved this to 🔧 Implementation in Issues Board Aug 19, 2025

JaroslavTulach removed this from Issues Board Aug 19, 2025

JaroslavTulach added this to Issues Board Aug 19, 2025

JaroslavTulach moved this to 🔧 Implementation in Issues Board Aug 19, 2025

JaroslavTulach added this to the 2025.3 Release milestone Aug 19, 2025

JaroslavTulach added -compiler and removed CI: Keep up to date Automatically update this PR to the latest develop. labels Aug 19, 2025

JaroslavTulach changed the title ~~Bechmark and speed various JVM modes up~~ Bechmark and speed dual JVM mode up Aug 19, 2025

JaroslavTulach mentioned this pull request Aug 19, 2025

Turn Standard.Microsoft into "dual JVM" mode library #13804

Open

AdRiley approved these changes Aug 19, 2025

View reviewed changes

github-project-automation bot moved this from 🔧 Implementation to 🌟 Q/A review in Issues Board Aug 19, 2025

jdunkerley approved these changes Aug 19, 2025

View reviewed changes

JaroslavTulach changed the title ~~Bechmark and speed dual JVM mode up~~ Benchmark and speed dual JVM mode up Aug 19, 2025

JaroslavTulach merged commit 1d702ef into develop Aug 19, 2025
87 checks passed

JaroslavTulach deleted the wip/jtulach/BenchmarkJvmModes branch August 19, 2025 12:22

github-project-automation bot moved this from 🌟 Q/A review to 🟢 Accepted in Issues Board Aug 19, 2025

unfurl-links bot mentioned this pull request Aug 25, 2025

Remove duplicate find_enso_bin methods in tests #13847

Merged

5 tasks

This was referenced Aug 26, 2025

Distributed GC between the dual JVMs #13855

Merged

Dual JVM benchmarks are failing #13880

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Benchmark and speed dual JVM mode up #13780

Benchmark and speed dual JVM mode up #13780

Uh oh!

JaroslavTulach commented Aug 14, 2025 •

edited

Loading

Uh oh!

Uh oh!

JaroslavTulach Aug 15, 2025 •

edited

Loading

Uh oh!

Uh oh!

JaroslavTulach commented Aug 15, 2025

Uh oh!

JaroslavTulach Aug 16, 2025

Uh oh!

JaroslavTulach Aug 16, 2025

Uh oh!

JaroslavTulach Aug 16, 2025

Uh oh!

JaroslavTulach Aug 18, 2025

Uh oh!

JaroslavTulach Aug 18, 2025

Uh oh!

JaroslavTulach commented Aug 19, 2025 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Benchmark and speed dual JVM mode up #13780

Benchmark and speed dual JVM mode up #13780

Uh oh!

Conversation

JaroslavTulach commented Aug 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Pull Request Description

Checklist

Uh oh!

Uh oh!

JaroslavTulach Aug 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

JaroslavTulach commented Aug 15, 2025

Uh oh!

JaroslavTulach Aug 16, 2025

Choose a reason for hiding this comment

Uh oh!

JaroslavTulach Aug 16, 2025

Choose a reason for hiding this comment

Uh oh!

JaroslavTulach Aug 16, 2025

Choose a reason for hiding this comment

Uh oh!

JaroslavTulach Aug 18, 2025

Choose a reason for hiding this comment

Uh oh!

JaroslavTulach Aug 18, 2025

Choose a reason for hiding this comment

Uh oh!

JaroslavTulach commented Aug 19, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

JaroslavTulach commented Aug 14, 2025 •

edited

Loading

JaroslavTulach Aug 15, 2025 •

edited

Loading

JaroslavTulach commented Aug 19, 2025 •

edited

Loading