v0.50.0-rc0

Changelog

[0.50.0-rc0] - 2024-09-18

Features

• SQLExecutor supports submitting MCQA 2.0 jobs
  • SQLExecutorBuilder adds method enableMcqaV2
  • SQLExecutorBuilder adds getter methods for fields
• SQLExecutor adds getQueryId method:
  • For offline jobs and MCQA 2.0 jobs, it returns the currently executing job's InstanceId
  • For MCQA 1.0 jobs, it returns the InstanceId and SubQueryId
• TableAPI adds SharingQuotaToken parameter in EnvironmentSettings to support sharing quota resources during job submission
• Quotas introduces getWlmQuota method:
  • Allows retrieval of detailed quota information based on projectName and quotaNickName, including whether it belongs to interactive quotas
• Quota class adds isInteractiveQuota method to determine if a quota belongs to interactive quotas (suitable for MCQA 2.0)
• Adds getResultByInstanceTunnel(Instance instance, String taskName, Long limit, boolean limitEnabled) method:
  • Allows unlimited retrieval of results via instanceTunnel (lifting restrictions requires higher permissions)
• UpsertSession.Builder adds setLifecycle method to configure the session lifecycle

Fixes

• Fixed the issue where using SQLExecutor to execute offline jobs with limitEnabled specified resulted in no effect
• Modified the SQLExecutor so that getQueryId method returns the job's instanceID instead of null when executing offline jobs
• Fixed the issue where using instanceTunnel to retrieve results on encountering non-select statements no longer throws exceptions, instead falling back to non-tunnel logic
• Fixed the problem of missing one data entry when using DownloadSession to download data and an error occurred while the read count equaled the number of records to be read minus one
• The clone method of the Odps class now correctly clones other fields, including tunnelEndpoint
• The Instance's getRawTaskResults method now does not make multiple requests when processing synchronous jobs

---

更新日志

[0.50.0-rc0] - 2024-09-18

功能

• SQLExecutor 支持提交 MCQA 2.0 作业
  • SQLExecutorBuilder 新增方法 enableMcqaV2
  • SQLExecutorBuilder 新增对字段的 getter 方法
• SQLExecutor 新增 getQueryId 方法：
  • 对于离线作业和 MCQA 2.0 作业，会返回当前执行的作业 InstanceId
  • 对于 MCQA 1.0 作业，会返回 InstanceId 和 SubQueryId
• TableAPI EnvironmentSettings 新增 SharingQuotaToken 参数，以支持提交作业时携带Quota资源共享临时凭证
• Quotas 新增 getWlmQuota 方法：
  • 能够根据 projectName 和 quotaNickName 获取到 quota 的详细信息，比如是否属于交互式 quota
• Quota 类新增 isInteractiveQuota 方法，用来判断 quota 是否属于交互式 quota（适用于 MCQA 2.0）
• 新增 getResultByInstanceTunnel(Instance instance, String taskName, Long limit, boolean limitEnabled) 方法：
  • 用来无限制地通过 instanceTunnel 获取结果（解除限制需要更高的权限）
• UpsertSession.Builder 新增 setLifecycle 方法，用来配置 Session 生命周期

修复

• 修复了使用 SQLExecutor 执行离线作业时，指定 limitEnabled 取结果但不生效的问题
• 修改了 SQLExecutor 执行离线作业时，getQueryId 方法会返回作业的 instanceID 而非 null
• 修复了 SQLExecutor 执行离线作业时，当遇到非 select 语句时，使用 instanceTunnel 取结果不再抛出异常，而是回退到非 tunnel 逻辑
• 修复了使用 DownloadSession 下载数据时，发生错误且读取数量刚好等于要读取记录的数量 - 1 时重建漏掉一条数据的问题
• Odps 类的 clone 方法现在能正确克隆包括 tunnelEndpoint 等其他字段
• Instance 的 getRawTaskResults 方法现在在处理同步作业时不会多次发起请求