Skip to content

Conversation

@Pajaraja
Copy link
Contributor

@Pajaraja Pajaraja commented Dec 1, 2025

What changes were proposed in this pull request?

Set the number of partitions in recursive CTEs to be at least 1.

Why are the changes needed?

Defensive programming to avoid zero-partition RDDs, which could cause potential issues in downstream operations like coalesce.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Existing CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions bot added the SQL label Dec 1, 2025
Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you think you can add a test case to protect your contribution from any future regression, @Pajaraja ?

@cloud-fan
Copy link
Contributor

Is it possible to add a unit test by building physical plans directly? e.g. RDDScanExec can host a 0-partition RDD.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants