All pull requests

Pull requests

• [SPARK-61495][SQL] Use modeled DSv2 expressions for generated column writes

  ai-review-requested
  #60368·szehon-ho opened Nov 12, 2026Member·

  ·

• [SPARK-61494][SQL] Support optional column, field, variable, and named parameter references

  ai-review-requested
  #60367·dtenedor opened Nov 12, 2026Contributor·

  ·

• [SPARK-61482][SQL] Evaluate only aggregate functions on zero rows when DecorrelateInnerQuery handles the COUNT bug

  ai-review-requested
  #60366·sarutak opened Nov 12, 2026Member·

  ·

• [SPARK-61486][INFRA] Add a generated visualization of the scheduled CI workflows

  ai-review-requested
  #60365·gaogaotiantian opened Nov 12, 2026Contributor·

  ·

• [SPARK-61489][SQL] Pull out struct and variant members of an outer column in PullOutNestedDataOuterRefExpressions

  #60364·AveryQi115 opened Nov 11, 2026Contributor·

  ·

• [SPARK-61377][SQL] Compute each input column just before the first condition reading it in FilterExec's subexpression elimination path

  ai-review-requested
  #60363·sarutak opened Nov 11, 2026Member·

  ·

• [MINOR][PYTHON][TEST] Print complete DataFrame golden diffs

  PYTHONSQL
  #60362·funrollloops opened Nov 11, 2026Contributor·

  ·

• [SPARK-61484][SQL] Re-point correlated subquery outer references at the post-Expand grouping key under ROLLUP/CUBE/GROUPING SETS

  SQL
  #60361·AveryQi115 opened Nov 11, 2026Contributor·

  ·

• [SPARK-61480][SQL] Fix wrong results by runtime group filtering in group-based DELETE when the condition uses a CHAR column

  ai-review-requestedSQL
  #60360·dongjoon-hyun opened Nov 11, 2026Member·

  ·

• [SPARK-61479][SQL] Fix wrong results by DSv2 UPDATE and MERGE when CHAR values are stored without padding

  ai-review-requestedSQL
  #60359·dongjoon-hyun opened Nov 11, 2026Member·

  ·

• [SQL] Reject NULL elements in KLL getter array arguments

  SQL
  #60358·yyanyy opened Nov 11, 2026Contributor·

  ·

• [WIP][SQL] Retain write-side CHAR/VARCHAR values in column defaults

  SQL
  #60357·yyanyy opened Nov 11, 2026Contributor·

  ·

• [WIP][SQL] Fix arrays_zip field naming for map lookups

  SQL
  #60356·yyanyy opened Nov 11, 2026Contributor·

  ·

• [SPARK-61296][SQL][CORE] Return CollectLimitExec gather results in partition order

  BLOCK MANAGERCORESHUFFLESQL
  #60355·utkarshbajaj opened Nov 11, 2026·

  ·

• [SPARK-61419][SQL] Copy stateful options before evaluating from_avro/schema_of_avro

  AVROSQL
  #60354·charlhhhh opened Nov 11, 2026·

  ·

• [SPARK-61276][SQL] Add GAP FILL syntax, parser node and feature gate

  CONNECTDOCSSQL
  #60353·ZdravDim opened Nov 11, 2026·

  ·

• [SPARK-61468][INFRA] Reduce PR labeler delays

  INFRA
  #60352·nchammas opened Nov 11, 2026Contributor·

  ·
  3

• [SPARK-60731][SQL] Place filter conditions in written order when splitting a projection

  ai-review-requestedSQL
  #60351·sarutak opened Nov 11, 2026Member·

  ·

• [SPARK-59613][CORE][SQL] Fix intermittent 404s on SparkSQL ExecutionPage - V2

  BUILDCORESQLSTRUCTURED STREAMINGWEB UI
  #60350·samra-h opened Nov 11, 2026·

  ·

• [SPARK-61466][SQL] Add native scalar functions: the C interface spark_udf.h and USING PACKAGE

  BUILDCONNECTSQLUDF
  #60349·tdcmeehan opened Nov 11, 2026Contributor·

  ·

• [SQL] Reject writing nanosecond timestamps into VARIANT at analysis

  SQL
  #60348·stevomitric opened Nov 11, 2026Contributor·

  ·

• [SQL] Support special datetime values in casts to nanosecond timestamps

  SQL
  #60347·stevomitric opened Nov 11, 2026Contributor·

  ·

• [SPARK-61462][SQL] Fix silent under-delete in DELETE-only MERGE and metadata-only DELETE when CHAR values are stored without padding

  ai-review-requestedSQL
  #60345·dongjoon-hyun opened Nov 11, 2026Member·

  ·
  16

• [MINOR][SQL] Handle null elements in ColumnarArray.get()

  SQL
  #60341·wecharyu opened Nov 11, 2026Contributor·

  ·
  3

• [SPARK-61458][INFRA] Reuse post-merge documentation artifacts for GitHub Pages

  DOCSINFRA
  #60339·zhengruifeng opened Nov 11, 2026Contributor·

  ·
  2