Add Scala benchmarks to CI (#95)

* Add Scala benchmarks to CI and fix chart x-axis labels

Modernize the Scala benchmarks from Scala 2.11/Breeze 0.10 to
Scala 3.3/Breeze 2.1, fix benchmark names to match the current
conventions, and add Scala to the CI pipeline.

- Rewrite perf.scala: use correct benchmark names, match iteration
  counts to Java/C, use while loops for hot paths, inline complex
  arithmetic in mandelbrot
- Update build.sbt to Scala 3.3.4 and Breeze 2.1.0
- Add bench-scala CI job with sbt/setup-sbt action
- Move Scala from "Additional languages" to "Languages in CI" in README
- Add Scala to Makefile, versions.sh, docs/make.jl, docs/notes.md
- Fix chart x-axis: add autoSkip:false so language names always display

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* Fix Breeze Scala 3 compatibility in randmatstat

- Import RandBasis for Gaussian distribution
- Use explicit [Double] type parameter for DenseMatrix.rand
- Replace horzcat/vertcat with manual slice assignment to avoid
  ambiguous implicit resolution in Scala 3

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* Filter sbt output in Makefile and remove deprecated showSuccess

- Pipe sbt output through grep '^scala,' to avoid sbt launcher
  messages and netlib warnings polluting the CSV
- Redirect sbt stderr to /dev/null
- Remove deprecated showSuccess setting that caused lint warning

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

Author: ViralBShah

.github/workflows/benchmarks.yml

@@ -314,6 +314,38 @@ jobs:
             benchmarks/rust.csv
             version.csv
 
+  bench-scala:
+    runs-on: ubuntu-latest
+    defaults:
+      run:
+        shell: bash
+    steps:
+      - uses: actions/checkout@v6
+        with:
+          persist-credentials: false
+      - name: "Set up Java"
+        uses: actions/setup-java@v4
+        with:
+          distribution: 'temurin'
+          java-version: '21'
+      - name: "Set up sbt"
+        uses: sbt/setup-sbt@v1
+      - name: "Set up OpenBLAS"
+        run: sudo apt-get install -y libopenblas-dev
+      - name: "Download dependencies and compile"
+        run: cd scala && sbt --batch compile
+      - name: "Run benchmark"
+        run: make benchmarks/scala.csv
+      - name: "Capture version"
+        run: bash bin/versions.sh scala > version.csv
+      - name: "Upload results"
+        uses: actions/upload-artifact@v4
+        with:
+          name: bench-scala
+          path: |
+            benchmarks/scala.csv
+            version.csv
+
   bench-swift:
     runs-on: ubuntu-latest
     defaults:
@@ -361,6 +393,7 @@ jobs:
       - bench-python
       - bench-r
       - bench-rust
+      - bench-scala
       - bench-swift
     defaults:
       run:

Makefile

@@ -98,7 +98,7 @@ benchmarks/java.csv: java/src/main/java/PerfBLAS.java
 
 benchmarks/scala.csv: scala/src/main/scala/perf.scala scala/build.sbt
 	cd scala
-	@for t in $(ITERATIONS); do sbt run; done >../$@
+	@for t in $(ITERATIONS); do sbt --batch run 2>/dev/null | grep '^scala,'; done >../$@
 
 benchmarks/rust.csv: rust/src/main.rs rust/src/util.rs rust/Cargo.toml
 	cd rust
@@ -109,8 +109,8 @@ benchmarks/swift.csv: swift/Sources/perf/main.swift swift/Package.swift
 	swift build -c release -Xlinker -lopenblas
 	@for t in $(ITERATIONS); do .build/release/perf; done >../$@
 
-LANGUAGES = c fortran go java javascript julia lua mathematica matlab octave python r rust swift
-GH_ACTION_LANGUAGES = c fortran go java javascript julia lua octave python r rust swift
+LANGUAGES = c fortran go java javascript julia lua mathematica matlab octave python r rust scala swift
+GH_ACTION_LANGUAGES = c fortran go java javascript julia lua octave python r rust scala swift
 
 BENCHMARKS = $(foreach lang,$(LANGUAGES),benchmarks/$(lang).csv)
 GH_ACTION_BENCHMARKS = $(foreach lang,$(GH_ACTION_LANGUAGES),benchmarks/$(lang).csv)

README.md

@@ -37,7 +37,7 @@ Running the full suite locally requires:
 
 * GCC and GFortran
 * OpenBLAS development libraries (`libopenblas-dev` on Debian/Ubuntu)
-* Go, Java (Maven), Node.js, Python 3 (NumPy), R, Rust, Swift, LuaJIT, Octave
+* Go, Java (Maven), Node.js, Python 3 (NumPy), R, Rust, Scala (sbt), Swift, LuaJIT, Octave
 
 Individual language benchmarks can be run with, e.g., `make benchmarks/julia.csv`.
 
@@ -54,10 +54,10 @@ Individual language benchmarks can be run with, e.g., `make benchmarks/julia.csv
 * [Python](python/perf.py)
 * [R](r/perf.R)
 * [Rust](rust/src/main.rs)
+* [Scala](scala/src/main/scala/perf.scala)
 * [Swift](swift/Sources/perf/main.swift)
 
 ## Additional languages (local only)
 
 * [Mathematica](mathematica/perf.nb)
 * [Matlab](octave/perf.m)
-* [Scala](scala/src/main/scala/perf.scala)

bin/versions.sh

@@ -1,7 +1,7 @@
 #!/usr/bin/env bash
 
 # User argument declaring what languages to query:
-DEFAULT_LANGUAGES="c:fortran:go:java:javascript:julia:lua:mathematica:matlab:octave:python:r:rust"
+DEFAULT_LANGUAGES="c:fortran:go:java:javascript:julia:lua:mathematica:matlab:octave:python:r:rust:scala"
 LANGUAGES=${1:-$DEFAULT_LANGUAGES}
 
 LANGUAGES=":${LANGUAGES}:"
@@ -72,6 +72,11 @@ if [[ $LANGUAGES == *":rust:"* ]]; then
     rustc --version | cut -c 7- | sed 's/ ([0-9a-f]* /<br>(/g'
 fi
 
+if [[ $LANGUAGES == *":scala:"* ]]; then
+    echo -n "scala,"
+    grep 'scalaVersion' scala/build.sbt | grep -oP '\d+\.\d+\.\d+'
+fi
+
 if [[ $LANGUAGES == *":swift:"* ]]; then
     echo -n "swift,"
     swift --version 2>&1 | head -1 | sed 's/Swift version //' | cut -f1 -d" "

docs/make.jl

@@ -16,6 +16,7 @@ const LANG_LABELS = Dict(
     "r"           => "R",
     "go"          => "Go",
     "rust"        => "Rust",
+    "scala"       => "Scala",
     "swift"       => "Swift",
 )
 
@@ -182,6 +183,8 @@ function make_chart(benchfile::String)
                         max: $(length(langs) - 1).5,
                         ticks: {
                             stepSize: 1,
+                            autoSkip: false,
+                            maxRotation: 45,
                             callback: function(value) {
                                 var labels = $labels_json;
                                 return labels[value] || "";

docs/src/notes.md

@@ -30,7 +30,7 @@ matrix multiplication routine for each language. For most compiled
 languages this means calling BLAS (via OpenBLAS):
 
 **Using BLAS/optimized libraries:** C, Fortran, Julia, Python (NumPy),
-Go (Gonum), Java (jBLAS), Rust (ndarray), R, Octave, Swift (Accelerate)
+Go (Gonum), Java (jBLAS), Rust (ndarray), Scala (Breeze), R, Octave, Swift (Accelerate)
 
 **Pure implementation:** JavaScript, LuaJIT
 

scala/.gitignore

@@ -11,6 +11,7 @@ lib_managed/
 src_managed/
 project/boot/
 project/plugins/project/
+project/target/
 
 # Scala-IDE specific
 .scala_dependencies

scala/build.sbt

@@ -1,17 +1,8 @@
 // This file was formerly a part of Julia. License is MIT: https://julialang.org/license
 
-libraryDependencies ++= Seq(
-    "org.scalanlp" %% "breeze" % "0.10",
-    "org.scalanlp" %% "breeze-natives" % "0.10"
-)
+scalaVersion := "3.3.4"
 
-resolvers ++= Seq(
-    "Sonatype Releases" at "https://oss.sonatype.org/content/repositories/releases/"
-)
-
-scalaVersion := "2.11.1"
-
-showSuccess := false
+libraryDependencies += "org.scalanlp" %% "breeze" % "2.1.0"
 
 onLoadMessage := ""
 

scala/project/build.properties

@@ -0,0 +1 @@
+sbt.version=1.10.7