v0.51.0-public.rc0

Changelog

[0.51.0-public.rc0] - 2024-11-18

Features

• GenerateExpression added support for generating expression lists for partition columns, along with the first generated expression TruncTime. For usage, please refer to Example
• UpsertStream supports writing values with primary keys of type TIMESTAMP_NTZ
• Table added new methods for querying CDC-related data: getCdcSize(), getCdcRecordNum(), getCdcLatestVersion(), getCdcLatestTimestamp()
• SQLExecutor MCQA 2.0 job supports retrieving InstanceProgress information

Changes

• Quote added backticks for quoting names in Struct type TypeInfo and other methods that assemble SQL
• AutoClosable to remind users to properly close resources, added corresponding close() methods to the following resource classes to prompt users to close resources correctly:
  • UpsertStream in the odps-sdk-core package,
  • LocalOutputStreamSet, ReduceDriver.ReduceContextImpl, MapDriver.DirectMapContextImpl, LocalRecordWriter in the odps-sdk-impl package
  • VectorizedOutputer, VectorizedExtractor, RecordWriter, RecordReader, Outputer, Extractor in the odps-sdk-udf package

---

更新日志

[0.51.0-public.rc0] - 2024-11-18

功能

• GenerateExpression 增加对分区列的生成列表达式功能的支持，和第一个生成列表达式TruncTime，使用方式请参考Example
• UpsertStream 支持写入主键为 TIMESTAMP_NTZ 类型的值
• Table 新增对 cdc 相关数据的查询，getCdcSize()，getCdcRecordNum()，getCdcLatestVersion()，getCdcLatestTimestamp()
• SQLExecutor MCQA 2.0 作业支持获取 InstanceProgress 信息

变更

• Quote 对 Struct 类型的 TypeInfo，和其他拼装 SQL 的方法，使用反引号对名字进行 quote
• AutoClosable 为了提醒用户正确关闭资源，对下列资源类，增加了相应的 close() 方法，以提醒用户正确关闭资源。
  • odps-sdk-core 包下的 UpsertStream，
  • odps-sdk-impl 包下的 LocalOutputStreamSet，ReduceDriver.ReduceContextImpl，MapDriver.DirectMapContextImpl，LocalRecordWriter
  • odps-sdk-udf 包下的 VectorizedOutputer，VectorizedExtractor，RecordWriter，RecordReader，Outputer，Extractor