Skip to content

Commit 5724c71

Browse files
LuciferYangLuciferYang
committed
[SPARK-52814][BUILD] Upgrade zstd-jni to 1.5.7-4
### What changes were proposed in this pull request? This pr aims to upgrade zstd-jni 1.5.7-3 to 1.5.7-4. ### Why are the changes needed? The new version brings a bug fix: - luben/zstd-jni#360 The full changes as follows: - luben/zstd-jni@v1.5.7-3...v1.5.7-4 ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? - Pass Github Actions ### Was this patch authored or co-authored using generative AI tooling? No Closes #51492 from LuciferYang/zstd-jni-1.5.7-4. Authored-by: yangjie01 <[email protected]> Signed-off-by: yangjie01 <[email protected]>
1 parent b777498 commit 5724c71

6 files changed

+114
-114
lines changed

‎core/benchmarks/ZStandardBenchmark-jdk21-results.txt

Lines changed: 28 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -2,48 +2,48 @@
22
Benchmark ZStandardCompressionCodec
33
================================================================================================
44

5-
OpenJDK 64-Bit Server VM 21.0.7+6-LTS on Linux 6.11.0-1014-azure
5+
OpenJDK 64-Bit Server VM 21.0.7+6-LTS on Linux 6.11.0-1018-azure
66
AMD EPYC 7763 64-Core Processor
77
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
88
--------------------------------------------------------------------------------------------------------------------------------------
9-
Compression 10000 times at level 1 without buffer pool 657 673 15 0.0 65664.9 1.0X
10-
Compression 10000 times at level 2 without buffer pool 718 726 13 0.0 71830.9 0.9X
11-
Compression 10000 times at level 3 without buffer pool 815 819 7 0.0 81453.1 0.8X
12-
Compression 10000 times at level 1 with buffer pool 598 600 1 0.0 59809.3 1.1X
13-
Compression 10000 times at level 2 with buffer pool 637 639 2 0.0 63710.0 1.0X
14-
Compression 10000 times at level 3 with buffer pool 754 757 3 0.0 75403.8 0.9X
9+
Compression 10000 times at level 1 without buffer pool 646 668 20 0.0 64639.2 1.0X
10+
Compression 10000 times at level 2 without buffer pool 715 716 2 0.0 71496.2 0.9X
11+
Compression 10000 times at level 3 without buffer pool 810 818 7 0.0 81013.5 0.8X
12+
Compression 10000 times at level 1 with buffer pool 603 604 0 0.0 60335.0 1.1X
13+
Compression 10000 times at level 2 with buffer pool 638 641 3 0.0 63817.7 1.0X
14+
Compression 10000 times at level 3 with buffer pool 739 740 1 0.0 73912.1 0.9X
1515

16-
OpenJDK 64-Bit Server VM 21.0.7+6-LTS on Linux 6.11.0-1014-azure
16+
OpenJDK 64-Bit Server VM 21.0.7+6-LTS on Linux 6.11.0-1018-azure
1717
AMD EPYC 7763 64-Core Processor
1818
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
1919
------------------------------------------------------------------------------------------------------------------------------------------
20-
Decompression 10000 times from level 1 without buffer pool 832 835 2 0.0 83247.0 1.0X
21-
Decompression 10000 times from level 2 without buffer pool 833 840 8 0.0 83277.8 1.0X
22-
Decompression 10000 times from level 3 without buffer pool 833 833 0 0.0 83280.6 1.0X
23-
Decompression 10000 times from level 1 with buffer pool 753 755 2 0.0 75333.7 1.1X
24-
Decompression 10000 times from level 2 with buffer pool 751 752 1 0.0 75115.3 1.1X
25-
Decompression 10000 times from level 3 with buffer pool 753 754 2 0.0 75254.0 1.1X
20+
Decompression 10000 times from level 1 without buffer pool 830 833 4 0.0 83030.7 1.0X
21+
Decompression 10000 times from level 2 without buffer pool 832 833 1 0.0 83236.0 1.0X
22+
Decompression 10000 times from level 3 without buffer pool 832 833 1 0.0 83183.1 1.0X
23+
Decompression 10000 times from level 1 with buffer pool 758 759 1 0.0 75813.5 1.1X
24+
Decompression 10000 times from level 2 with buffer pool 758 758 1 0.0 75767.1 1.1X
25+
Decompression 10000 times from level 3 with buffer pool 757 758 1 0.0 75652.4 1.1X
2626

27-
OpenJDK 64-Bit Server VM 21.0.7+6-LTS on Linux 6.11.0-1014-azure
27+
OpenJDK 64-Bit Server VM 21.0.7+6-LTS on Linux 6.11.0-1018-azure
2828
AMD EPYC 7763 64-Core Processor
2929
Parallel Compression at level 3: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
3030
------------------------------------------------------------------------------------------------------------------------
31-
Parallel Compression with 0 workers 77 78 1 0.0 601317.6 1.0X
32-
Parallel Compression with 1 workers 64 70 4 0.0 499456.2 1.2X
33-
Parallel Compression with 2 workers 53 56 3 0.0 410610.6 1.5X
34-
Parallel Compression with 4 workers 45 47 1 0.0 350847.8 1.7X
35-
Parallel Compression with 8 workers 47 49 1 0.0 370647.8 1.6X
36-
Parallel Compression with 16 workers 50 52 1 0.0 390524.8 1.5X
31+
Parallel Compression with 0 workers 66 66 0 0.0 512667.9 1.0X
32+
Parallel Compression with 1 workers 56 58 2 0.0 435183.0 1.2X
33+
Parallel Compression with 2 workers 46 47 1 0.0 356034.8 1.4X
34+
Parallel Compression with 4 workers 41 43 1 0.0 318331.7 1.6X
35+
Parallel Compression with 8 workers 44 46 1 0.0 342564.5 1.5X
36+
Parallel Compression with 16 workers 48 51 2 0.0 371266.4 1.4X
3737

38-
OpenJDK 64-Bit Server VM 21.0.7+6-LTS on Linux 6.11.0-1014-azure
38+
OpenJDK 64-Bit Server VM 21.0.7+6-LTS on Linux 6.11.0-1018-azure
3939
AMD EPYC 7763 64-Core Processor
4040
Parallel Compression at level 9: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
4141
------------------------------------------------------------------------------------------------------------------------
42-
Parallel Compression with 0 workers 243 244 2 0.0 1894990.4 1.0X
43-
Parallel Compression with 1 workers 299 300 2 0.0 2335128.6 0.8X
44-
Parallel Compression with 2 workers 167 177 11 0.0 1308212.2 1.4X
45-
Parallel Compression with 4 workers 161 163 3 0.0 1254638.0 1.5X
46-
Parallel Compression with 8 workers 166 170 4 0.0 1299104.0 1.5X
47-
Parallel Compression with 16 workers 167 170 2 0.0 1301666.4 1.5X
42+
Parallel Compression with 0 workers 236 237 1 0.0 1847245.2 1.0X
43+
Parallel Compression with 1 workers 251 252 2 0.0 1961753.5 0.9X
44+
Parallel Compression with 2 workers 141 148 4 0.0 1100274.2 1.7X
45+
Parallel Compression with 4 workers 129 133 3 0.0 1009465.5 1.8X
46+
Parallel Compression with 8 workers 135 139 3 0.0 1054496.8 1.8X
47+
Parallel Compression with 16 workers 135 139 6 0.0 1051577.1 1.8X
4848

4949

‎core/benchmarks/ZStandardBenchmark-results.txt

Lines changed: 28 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -2,48 +2,48 @@
22
Benchmark ZStandardCompressionCodec
33
================================================================================================
44

5-
OpenJDK 64-Bit Server VM 17.0.15+6-LTS on Linux 6.11.0-1014-azure
5+
OpenJDK 64-Bit Server VM 17.0.15+6-LTS on Linux 6.11.0-1018-azure
66
AMD EPYC 7763 64-Core Processor
77
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
88
--------------------------------------------------------------------------------------------------------------------------------------
9-
Compression 10000 times at level 1 without buffer pool 651 654 3 0.0 65120.6 1.0X
10-
Compression 10000 times at level 2 without buffer pool 701 702 1 0.0 70069.5 0.9X
11-
Compression 10000 times at level 3 without buffer pool 788 790 2 0.0 78845.5 0.8X
12-
Compression 10000 times at level 1 with buffer pool 577 578 2 0.0 57688.1 1.1X
13-
Compression 10000 times at level 2 with buffer pool 607 608 1 0.0 60653.3 1.1X
14-
Compression 10000 times at level 3 with buffer pool 716 717 0 0.0 71634.8 0.9X
9+
Compression 10000 times at level 1 without buffer pool 664 665 1 0.0 66403.7 1.0X
10+
Compression 10000 times at level 2 without buffer pool 699 700 2 0.0 69853.1 1.0X
11+
Compression 10000 times at level 3 without buffer pool 788 793 5 0.0 78810.6 0.8X
12+
Compression 10000 times at level 1 with buffer pool 582 583 1 0.0 58212.7 1.1X
13+
Compression 10000 times at level 2 with buffer pool 612 614 2 0.0 61216.1 1.1X
14+
Compression 10000 times at level 3 with buffer pool 718 719 1 0.0 71825.7 0.9X
1515

16-
OpenJDK 64-Bit Server VM 17.0.15+6-LTS on Linux 6.11.0-1014-azure
16+
OpenJDK 64-Bit Server VM 17.0.15+6-LTS on Linux 6.11.0-1018-azure
1717
AMD EPYC 7763 64-Core Processor
1818
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
1919
------------------------------------------------------------------------------------------------------------------------------------------
20-
Decompression 10000 times from level 1 without buffer pool 621 621 0 0.0 62063.9 1.0X
21-
Decompression 10000 times from level 2 without buffer pool 620 621 1 0.0 62003.0 1.0X
22-
Decompression 10000 times from level 3 without buffer pool 620 622 1 0.0 62017.4 1.0X
23-
Decompression 10000 times from level 1 with buffer pool 544 544 0 0.0 54377.6 1.1X
24-
Decompression 10000 times from level 2 with buffer pool 544 544 1 0.0 54404.3 1.1X
25-
Decompression 10000 times from level 3 with buffer pool 543 544 1 0.0 54310.2 1.1X
20+
Decompression 10000 times from level 1 without buffer pool 601 602 1 0.0 60084.3 1.0X
21+
Decompression 10000 times from level 2 without buffer pool 600 602 2 0.0 59976.6 1.0X
22+
Decompression 10000 times from level 3 without buffer pool 600 610 19 0.0 59982.0 1.0X
23+
Decompression 10000 times from level 1 with buffer pool 543 544 1 0.0 54315.8 1.1X
24+
Decompression 10000 times from level 2 with buffer pool 542 543 0 0.0 54239.8 1.1X
25+
Decompression 10000 times from level 3 with buffer pool 543 544 1 0.0 54283.7 1.1X
2626

27-
OpenJDK 64-Bit Server VM 17.0.15+6-LTS on Linux 6.11.0-1014-azure
27+
OpenJDK 64-Bit Server VM 17.0.15+6-LTS on Linux 6.11.0-1018-azure
2828
AMD EPYC 7763 64-Core Processor
2929
Parallel Compression at level 3: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
3030
------------------------------------------------------------------------------------------------------------------------
31-
Parallel Compression with 0 workers 77 79 1 0.0 603481.7 1.0X
32-
Parallel Compression with 1 workers 65 68 3 0.0 504835.7 1.2X
33-
Parallel Compression with 2 workers 50 55 3 0.0 393366.7 1.5X
34-
Parallel Compression with 4 workers 45 48 2 0.0 352491.0 1.7X
35-
Parallel Compression with 8 workers 46 49 1 0.0 362934.5 1.7X
36-
Parallel Compression with 16 workers 50 53 1 0.0 393219.4 1.5X
31+
Parallel Compression with 0 workers 66 68 1 0.0 518331.5 1.0X
32+
Parallel Compression with 1 workers 54 58 3 0.0 423384.3 1.2X
33+
Parallel Compression with 2 workers 45 47 1 0.0 353024.7 1.5X
34+
Parallel Compression with 4 workers 42 43 1 0.0 325797.6 1.6X
35+
Parallel Compression with 8 workers 44 46 1 0.0 345601.8 1.5X
36+
Parallel Compression with 16 workers 47 49 1 0.0 365954.9 1.4X
3737

38-
OpenJDK 64-Bit Server VM 17.0.15+6-LTS on Linux 6.11.0-1014-azure
38+
OpenJDK 64-Bit Server VM 17.0.15+6-LTS on Linux 6.11.0-1018-azure
3939
AMD EPYC 7763 64-Core Processor
4040
Parallel Compression at level 9: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
4141
------------------------------------------------------------------------------------------------------------------------
42-
Parallel Compression with 0 workers 237 239 1 0.0 1852985.0 1.0X
43-
Parallel Compression with 1 workers 299 301 2 0.0 2339270.2 0.8X
44-
Parallel Compression with 2 workers 167 174 6 0.0 1303651.0 1.4X
45-
Parallel Compression with 4 workers 160 165 3 0.0 1248593.3 1.5X
46-
Parallel Compression with 8 workers 166 170 3 0.0 1295084.3 1.4X
47-
Parallel Compression with 16 workers 165 169 3 0.0 1288571.2 1.4X
42+
Parallel Compression with 0 workers 235 236 1 0.0 1834259.5 1.0X
43+
Parallel Compression with 1 workers 258 261 3 0.0 2017482.6 0.9X
44+
Parallel Compression with 2 workers 142 150 7 0.0 1110600.9 1.7X
45+
Parallel Compression with 4 workers 131 134 2 0.0 1025190.7 1.8X
46+
Parallel Compression with 8 workers 137 140 3 0.0 1072618.8 1.7X
47+
Parallel Compression with 16 workers 137 140 3 0.0 1066912.9 1.7X
4848

4949

0 commit comments

Comments
 (0)