Skip to content

Commit d442a93

Browse files
committed
improve desc
1 parent 7dc4ea4 commit d442a93

File tree

3 files changed

+3
-3
lines changed

3 files changed

+3
-3
lines changed

common/src/main/scala/org/apache/comet/CometConf.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -654,7 +654,7 @@ object CometConf extends ShimCometConf {
654654
conf(s"spark.hadoop.$COMET_LIBHDFS_SCHEMES_KEY")
655655
.doc(
656656
"Defines filesystem schemes (e.g., hdfs, webhdfs) that the native side accesses " +
657-
"via libhdfs, separated by commas.")
657+
"via libhdfs, separated by commas. Valid only when built with hdfs feature enabled.")
658658
.stringConf
659659
.createOptional
660660

docs/source/user-guide/compatibility.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -75,7 +75,7 @@ The `native_datafusion` scan has some additional limitations:
7575

7676
### S3 Support with `native_iceberg_compat`
7777

78-
- When using the default AWS S3 endpoint (no custom endpoint configured), a valid region is required. Comet
78+
- When using the default AWS S3 endpoint (no custom endpoint configured), a valid region is required. Comet
7979
will attempt to resolve the region if it is not provided.
8080

8181
## ANSI Mode

docs/source/user-guide/configs.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -91,5 +91,5 @@ Comet provides the following configuration settings.
9191
| spark.comet.shuffle.preferDictionary.ratio | The ratio of total values to distinct values in a string column to decide whether to prefer dictionary encoding when shuffling the column. If the ratio is higher than this config, dictionary encoding will be used on shuffling string column. This config is effective if it is higher than 1.0. Note that this config is only used when `spark.comet.exec.shuffle.mode` is `jvm`. | 10.0 |
9292
| spark.comet.shuffle.sizeInBytesMultiplier | Comet reports smaller sizes for shuffle due to using Arrow's columnar memory format and this can result in Spark choosing a different join strategy due to the estimated size of the exchange being smaller. Comet will multiple sizeInBytes by this amount to avoid regressions in join strategy. | 1.0 |
9393
| spark.comet.sparkToColumnar.supportedOperatorList | A comma-separated list of operators that will be converted to Arrow columnar format when 'spark.comet.sparkToColumnar.enabled' is true | Range,InMemoryTableScan |
94-
| spark.hadoop.fs.comet.libhdfs.schemes | Defines filesystem schemes (e.g., hdfs, webhdfs) that the native side accesses via libhdfs, separated by commas. | |
94+
| spark.hadoop.fs.comet.libhdfs.schemes | Defines filesystem schemes (e.g., hdfs, webhdfs) that the native side accesses via libhdfs, separated by commas. Valid only when built with hdfs feature enabled. | |
9595
<!--END:CONFIG_TABLE-->

0 commit comments

Comments
 (0)