Skip to content

Add Trino 479 release notes #27153

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
chenjian2664 wants to merge 10 commits into
base: master
Choose a base branch
from
+177 −0
Open

Add Trino 479 release notes #27153

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
84c834e
Add Trino 479 release notes
chenjian2664 Oct 30, 2025
b284492
Add 12-09 release notes
chenjian2664 Dec 10, 2025
88437f2
Reorder and format
chenjian2664 Dec 11, 2025
e4b6369
fixup! Add Trino 479 release notes
chenjian2664 Dec 11, 2025
afbe087
fixup! Add Trino 479 release notes
chenjian2664 Dec 11, 2025
a8785c9
fixup! Add Trino 479 release notes
chenjian2664 Dec 11, 2025
59cdd66
fixup! Add Trino 479 release notes
chenjian2664 Dec 11, 2025
71b2c33
fixup! Add Trino 479 release notes
chenjian2664 Dec 12, 2025
4506cd8
Add 12-11 release notes
chenjian2664 Dec 12, 2025
02e19d5
fixup! Add Trino 479 release notes
chenjian2664 Dec 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions docs/src/main/sphinx/release.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@
```{toctree}
:maxdepth: 1

release/release-479
release/release-478
release/release-477
release/release-476
Expand Down
176 changes: 176 additions & 0 deletions docs/src/main/sphinx/release/release-479.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,176 @@
# Release 479 (TBD 2025)

## General

* Generate TLS certificates for internal cluster communications automatically when node discovery type is set to `ANNOUNCE`. ({issue}`27030`)
* Add support for specifying the location of the Exchange Manager configuration file. ({issue}`26611`)
* Publish time taken by query in `FINISHING` state to event listener. ({issue}`27202`)
* Add lineage support for output columns of `SELECT` queries. ({issue}`26241`)
* Add support for setting and dropping column defaults via `ALTER TABLE ... ALTER COLUMN` statement. ({issue}`26162`)
* Add {func}`array_first` and {func}`array_last` functions. ({issue}`27295`)
* Add `GRACE PERIOD` to `SHOW CREATE MATERIALIZED VIEW` output. ({issue}`27529`)
* Allow field name declaration in row literals. For example, `row(1 as a, 2 as b)` is now legal. ({issue}`25261`)
* Add `queryText` as a regular expression in resource group selector. ({issue}`27129`)
* Require JDK 25 to build and run Trino. ({issue}`27153`)
* {{breaking}} The configuration property `task.statistics-cpu-timer-enabled` is now defunct and must be removed. ({issue}`27504`)
* Deprecate `EXPLAIN (TYPE LOGICAL)`. `EXPLAIN (TYPE DISTRIBUTED)` should be used instead. ({issue}`27434`)
Copy link
Member

@martint martint Dec 3, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No need for the second sentence. That is the default behavior.

Copy link
Member

@raunaqmorarka raunaqmorarka Dec 3, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Deprecate EXPLAIN (TYPE LOGICAL)" is way too terse. There are type TYPE VALIDATE and TYPE IO as well, so it should be explicitly mentioned what someone running EXPLAIN (TYPE LOGICAL) should migrate to. The users running the default with no TYPE specified would not care about this change.

Copy link
Member

@martint martint Dec 3, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't want users to use TYPE DISTRIBUTED. They should just use EXPLAIN <query>

Copy link
Member

@raunaqmorarka raunaqmorarka Dec 3, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If using TYPE DISTRIBUTED is undesirable, then that should be deprecated as well.
If we want users to use just EXPLAIN, then that's what the second line should say.

Copy link
Contributor Author

@chenjian2664 chenjian2664 Dec 9, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@martint could you help to confirm this?

Copy link
Contributor Author

@chenjian2664 chenjian2664 Dec 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for the release note we can't say we deprecated both since the later one isn't changed in code.
Does the "Deprecate EXPLAIN (TYPE LOGICAL). EXPLAIN <query> should be used instead" make sense?

Copy link
Member

@martint martint Dec 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Deprecation of functionality doesn’t necessarily need any code changes. Code changes can help, but at the end of the day, it’s just a policy decision.

Copy link
Contributor Author

@chenjian2664 chenjian2664 Dec 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@martint
What do you mean about this release note entry, just remove the second line?
or I suspect you are answering #27153 (comment) ?

Copy link
Member

@martint martint Dec 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can rephrase as:

Deprecate EXPLAIN type LOGICAL and DISTRIBUTED. Use EXPLAIN without a type clause, instead. ({issue}27434)

Copy link
Contributor Author

@chenjian2664 chenjian2664 Dec 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@martint we don't deprecate the DISTRIBUTED in #27434 , so I sent #27626

* Remove `prefer_streaming_operators` session property. ({issue}`27506`)
* Add experimental performance improvements for remote data exchanges on newer CPU architectures, such as `Graviton 3`, `Skylake`,
`Icelake`, or `Zen 4+`. This can be disabled by setting `exchange.experimental.vectorized-serde.enabled=false`. ({issue}`27426`, {issue}`26919`)
* Improve performance of {func}`array_sort` function. ({issue}`27272`)
* Improve performance of {func}`repeat` function. ({issue}`27369`)
* Improve performance of data exchanges involving variable width data. ({issue}`27377`)
* Improve performance of queries referencing fresh materialized views. ({issue}`27551`)
* Fix query failure when one of the branches of a `UNION` is known to produce zero rows during query planning. ({issue}`21506`)
* Fix configuring partitioned layout for spooling protocol. ({issue}`27247`)
* Fix `EXPLAIN (TYPE IO)` failure when the `WHERE` clause involves a type which cannot be cast to `varchar`. ({issue}`27433`)

## Security

## Web UI

* Render long single-line query string correctly in preview UI query details page. ({issue}`27328`)
* Render catalog properties correctly in preview UI. ({issue}`27327`)

## JDBC driver

* Add a `extraHeaders` option to support sending arbitrary HTTP headers. ({issue}`15826`)

## Docker image

* Update JDK to 25.0.1. ({issue}`27117`)

## CLI

* Add a `--extra-header` option to support sending arbitrary HTTP headers. ({issue}`15826`)
* Fix TLS connection failures when using unqualified (single-label, without ".") hostnames. ({issue} `27478`)

## BigQuery connector

* Fix query failure when reusing {func}`query` table function result. ({issue}`27573`)

## Blackhole connector

## Cassandra connector

## ClickHouse connector

## Delta Lake connector

* Add `APPLICATION_DEFAULT` authentication type for GCS. ({issue}`26984`)
* {{breaking}} Remove support for unauthenticated access when GCS authentication type is set to `SERVICE_ACCOUNT`. ({issue}`26984`)
* Rename `s3.exclusive-create` config to `delta.s3.transaction-log-conditional-writes.enabled`. ({issue}`27372`)
* Fix incorrect results for queries involving `IS NOT DISTINCT FROM`. ({issue}`27213`)
* Fix failure when writing to tables created by Databricks 17.3. ({issue}`27100`)
* Fix failure when checking Azure hierarchical namespaces. ({issue}`27278`)
* Avoid worker crashes by failing queries attempting to read columns with huge values in parquet files. ({issue}`27148`)
* Fix potential `FileAlreadyExistsException` failure when network failures occur during writes to S3. ({issue}`27330`, {issue}`27388`)
* Fix potential failure when reading [cloned tables](https://docs.databricks.com/aws/en/delta/clone). ({issue}`27098`)

## Druid connector

## DuckDB connector

## Elasticsearch connector

## Exasol connector

## Faker connector

## Google Sheets connector

## Hive connector

* Add `APPLICATION_DEFAULT` authentication type for GCS. ({issue}`26984`)
* {{breaking}} Remove support for unauthenticated access when GCS authentication type is set to `SERVICE_ACCOUNT`. ({issue}`26984`)
* Remove `s3.exclusive-create` config. ({issue}`27372`)
* Improve accuracy of table statistics written by INSERT queries with OVERWRITE behaviour. ({issue}`26517`)
* Fix failure when checking Azure hierarchical namespaces. ({issue}`27278`)
* Avoid worker crashes by failing queries attempting to read columns with huge values in parquet files. ({issue}`27148`)
* Fix potential `FileAlreadyExistsException` failure when network failures occur during writes to S3. ({issue}`27330`)
* Fix failure when listing tables with invalid table metadata in AWS Glue. ({issue}`27525`)

## Hudi connector

* Add `APPLICATION_DEFAULT` authentication type for GCS. ({issue}`26984`)
* {{breaking}} Remove support for unauthenticated access when GCS authentication type is set to `SERVICE_ACCOUNT`. ({issue}`26984`)
* Fix failure when checking Azure hierarchical namespaces. ({issue}`27278`)
* Avoid worker crashes by failing queries attempting to read columns with huge values in parquet files. ({issue}`27148`)
* Fix potential `FileAlreadyExistsException` failure when network failures occur during writes to S3. ({issue}`27330`)
* Fix failure when querying HDFS that includes empty directories. ({issue}`26897`)

## Iceberg connector

* Add support for updating [token-exchange-enabled](https://iceberg.apache.org/docs/nightly/configuration/#oauth2-auth-properties) via the `iceberg.rest-catalog.oauth2.token-exchange-enabled` config property. ({issue}`27174`)
* Add `retain_last` and `clean_expired_metadata` options to `expire_snapshots` command. ({issue}`27357`)
* Add `APPLICATION_DEFAULT` authentication type for GCS. ({issue}`26984`)
* Remove `s3.exclusive-create` config. ({issue}`27372`)
Copy link
Member

@martint martint Dec 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did the config option do anything? If so, what functionality is being removed? If not, there's no point in mentioning it.

Copy link
Contributor Author

@chenjian2664 chenjian2664 Dec 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The functionality isn't removed, but user needs to use another new named config, since it is a actual rename

* {{breaking}} Remove support for unauthenticated access when GCS authentication type is set to `SERVICE_ACCOUNT`. ({issue}`26984`)
* Fix failures when querying `$files` table after changes to table partitioning. ({issue}`26746`)
* Fix incorrect results for queries involving `IS NOT DISTINCT FROM`. ({issue}`27213`)
* Fix failure when checking Azure hierarchical namespaces. ({issue}`27278`)
* Avoid worker crashes by failing queries attempting to read columns with huge values in parquet files. ({issue}`27148`)
* Fix potential `FileAlreadyExistsException` failure when network failures occur during writes to S3. ({issue}`27330`)
* Fix potential failure when dropping a schema with `CASCADE` option. ({issue}`27361`)
* Fix failure when handling of dropped base tables for materialized views. ({issue}`27606`)

## Ignite connector

## JMX connector

## Kafka connector

## Loki connector

* Fix failure when initializing the connector. ({issue}`27180`)

## MariaDB connector

## Memory connector

* Add support for setting and dropping column defaults via `ALTER TABLE ... ALTER COLUMN`. ({issue}`26162`)
* Fix failure in `RENAME SCHEMA` when there is more than one table in the schema. ({issue}`27205`)

## MongoDB connector

## MySQL connector

* Fix incorrect results for queries involving `IS NOT DISTINCT FROM`. ({issue}`27213`)

## OpenSearch connector

## Oracle connector

## Pinot connector

## PostgreSQL connector

* Fix incorrect results for queries involving `IS NOT DISTINCT FROM`. ({issue}`27213`)

## Prometheus connector

## Redis connector

## Redshift connector

* Fix failure when reading Redshift `character varying` type. ({issue}`27224`)

## SingleStore connector

## Snowflake connector

## SQL Server connector

* Fix potential failure when listing tables and columns. ({issue}`10846`)

## TPC-H connector

## TPC-DS connector

## Vertica connector

## SPI

* Add non-callback based entry builder to RowBlockBuilder. ({issue}`27198`)
* Add non-callback based entry builder to ArrayBlockBuilder. ({issue}`27198`)
* Fix `ColumnMetadata.builderFrom` to retain column default value. ({issue}`27503`)