-
Notifications
You must be signed in to change notification settings - Fork 245
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Describe the bug
Take from GitHub CI of #1987
TestSparkDataWrite > testPartitionedCreateWithTargetFileSizeViaOption() > format = PARQUET, branch = null FAILED
org.opentest4j.AssertionFailedError: [Result rows should match]
TestSparkDataWrite > testPartitionedFanoutCreateWithTargetFileSizeViaOption2() > format = PARQUET, branch = main FAILED
org.opentest4j.AssertionFailedError: [Result rows should match]
Steps to reproduce
SparkSession configs used:
.config("spark.plugins", "org.apache.spark.CometPlugin")
.config("spark.shuffle.manager", "org.apache.spark.sql.comet.execution.shuffle.CometShuffleManager")
.config("spark.comet.explainFallback.enabled", "true")
.config("spark.sql.iceberg.parquet.reader-type", "COMET")
.config("spark.memory.offHeap.enabled", "true")
.config("spark.memory.offHeap.size", "10g")
.config("spark.comet.use.lazyMaterialization", "false")
.config("spark.comet.schemaEvolution.enabled", "true")
Expected behavior
No response
Additional context
No response
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working