Database policy support for PUT/PATCH operations - PostgreSQL by ArjunNarendra · Pull Request #3694 · Azure/data-api-builder

Arjun Narendra (ArjunNarendra) · 2026-07-05T03:15:39Z

Why make this change?

As per the behaviour expected from PUT/PATCH operations with database policies discussed in #1430, implement db policy support for PostgreSQL to fix #1372.

What is this change?

Prior to this change, there was only one database policy for each operation. Since now database policies will be supported for both insert (or create)/update actions via PUT/PATCH operations, these 2 operations can have 2 database policies defined for them, one for each action.
The query generated by PostgresQueryBuilder.Build(SqlUpsertQueryStructure structure) is modified to accommodate create/update policies while also keeping intact the normal upsert behavior expected (try update, then insert).
The method IQueryExecutor.GetMultipleResultSetsIfAnyAsync has been provided another implementation specific to PostgreSql in PostgreSqlExecutor. The DbDataReader instance for the query being executed for the PUT/PATCH operation will always contain two result sets.
Different scenarios are added to the method PostgreSqlExecutor.GetMultipleResultSetsIfAnyAsync to throw appropriate exceptions (Forbidden/Authorization failure - 403 and NotFound - 404). Appropriate comments are added within the code to demonstrate each case.

How was this tested?

Integration Tests - Done

…ate error/success message is returned

…t processing

…te/update policies

Copilot

Pull request overview

This PR extends PostgreSQL PUT/PATCH (upsert) behavior to correctly apply database policies for both the update and insert branches, aligning Postgres behavior with the expected policy semantics for REST upserts.

Changes:

Updated PostgreSQL upsert SQL generation to evaluate update-policy vs create-policy depending on which branch executes, while preserving “try update then insert” semantics.
Added a PostgreSQL-specific GetMultipleResultSetsIfAnyAsync implementation to interpret multi-result-set upsert outcomes and return 403/404 appropriately.
Updated PostgreSQL REST integration tests and test config to exercise create-policy behavior for PUT/PATCH insert cases.

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
src/Service.Tests/SqlTests/RestApiTests/Put/PostgreSqlPutApiTests.cs	Adds expected SQL for PUT insert-with-policy and removes ignored overrides so tests run.
src/Service.Tests/SqlTests/RestApiTests/Patch/PostgreSqlPatchApiTests.cs	Adds expected SQL for PATCH insert-with-policy and removes ignored overrides so tests run.
src/Service.Tests/dab-config.PostgreSql.json	Adds a PostgreSQL create-action database policy used by the new PUT/PATCH scenarios.
src/Core/Resolvers/SqlMutationEngine.cs	Passes additional context into the result-set handler for upsert result interpretation.
src/Core/Resolvers/PostgresQueryBuilder.cs	Reworks PostgreSQL upsert SQL to support separate create/update policies and emit a PK-existence count result set.
src/Core/Resolvers/PostgreSqlExecutor.cs	Implements PostgreSQL-specific multi-result-set handling to map policy failures vs not-found.
src/Core/Configurations/RuntimeConfigValidator.cs	Allows PostgreSQL to define create-action database policies in config validation.
config-generators/postgresql-commands.txt	Updates generator commands to set separate create/read permissions and the new create policy.

…er a PostgreSQL upsert operation performed an update or not. Reliance on this flag could potentially lead to incorrect HTTP response code being sent in certain race scenarios.

… whether an upsert operation performed an update or not because it is required by other database providers and does not apply for PostgreSQL

Arjun Narendra (ArjunNarendra) · 2026-07-14T18:10:27Z

So it looks like all the automated tests in Azure pipelines are passing now but at one point one of the Cosmos tests was failing. Specifically, one of the tests in the TestTimePartitionedSampler test method in the SamplerTests.cs test class was failing with the following error: Assert.IsTrue failed. Expected result count is 10 and Actual result count is 8. The specific data row that was causing this failure was [DataRow(null, 1, 0, 10, DisplayName = "Retrieve 10 records, if 1 item is allowed to fetch from each group and number of groups is 10 (i.e default)")]. So it was passing before until I merged the main upstream branch into my feature branch which is odd because it would suggest that the changes pushed to main were breaking the test or some weird interaction between the changes in the feature branch and the new changes in main were breaking the test. I tried to rerun the failing test suites but that particular test was still failing. Then, I converted this PR to a draft and then reconverted it back to a 'ready for review' state. That seemed to have done the trick and now all the test suites are passing. Therefore, I am not even sure what caused that one Cosmos test to fail in the first place; I think it can be chalked up to some flakiness in the environment or inconsistencies in the Azure Pipelines environment.

Arjun Narendra (ArjunNarendra) · 2026-07-15T19:47:13Z

/azp run

azure-pipelines · 2026-07-15T19:47:39Z

Azure Pipelines: Successfully started running 6 pipeline(s).

RubenCerna2079

I don't think the use of the isFallbackToUpdate is correct. Please remove it if possible from the PostgreSqlExecutor.cs file.

…via the query result instead

…or insert, update, and update incremental operations

Souvik Ghosh (souvikghosh04)

LGTM

RubenCerna2079 · 2026-07-23T16:22:23Z

/azp run

RubenCerna2079

LGTM

azure-pipelines · 2026-07-23T16:22:47Z

Azure Pipelines: Successfully started running 6 pipeline(s).

## Why make this change? As per the behaviour expected from PUT/PATCH operations with database policies discussed in #1430, implement db policy support for PostgreSQL to fix #1372. ## What is this change? 1. Prior to this change, there was only one database policy for each operation. Since now database policies will be supported for both insert (or create)/update actions via PUT/PATCH operations, these 2 operations can have 2 database policies defined for them, one for each action. 2. The query generated by `PostgresQueryBuilder.Build(SqlUpsertQueryStructure structure)` is modified to accommodate create/update policies while also keeping intact the normal upsert behavior expected (try update, then insert). 3. The method `IQueryExecutor.GetMultipleResultSetsIfAnyAsync` has been provided another implementation specific to PostgreSql in `PostgreSqlExecutor`. The `DbDataReader` instance for the query being executed for the PUT/PATCH operation will always contain two result sets. 4. Different scenarios are added to the method `PostgreSqlExecutor.GetMultipleResultSetsIfAnyAsync` to throw appropriate exceptions (Forbidden/Authorization failure - 403 and NotFound - 404). Appropriate comments are added within the code to demonstrate each case. ## How was this tested? Integration Tests - Done --------- Co-authored-by: RubenCerna2079 <32799214+RubenCerna2079@users.noreply.github.com> (cherry picked from commit 57a195c)

…ease/2.0 (#3767) Ports the PostgreSQL GraphQL groupby/aggregation and related feature commits from `main` (released in v2.1.0-rc) to `release/2.0` via cherry-pick. ## Commits ported (chronological) | PR | Title | |----|-------| | #3450 | Fix GraphQL aggregation features disabled when runtime.graphql config section is absent | | #3694 | Database policy support for PUT/PATCH operations - PostgreSQL | | #3728 | Add support for DateTime filters in PostgreSQL | | #3750 | Fix column mapping in GroupBy and aggregation queries | | #3741 | Add groupby/aggregation support for PostgreSQL in GraphQL | | #3753 | Enhance test coverage for GraphQL queries by adding orderBy clause | ## Notes - All six cherry-picks applied cleanly. - One manual adjustment in `SqlMutationEngine.cs` (part of #3694 port): the original referenced `effectiveOperationType` (a local introduced by the unrelated refactor #3287, which is not in `release/2.0`). Substituted `context.OperationType`, which is functionally equivalent in that non-upsert branch and matches the `release/2.0` convention. Folded into the #3694 commit. - Solution builds clean (0 warnings, 0 errors). - Integration tests (PostgreSql/MsSql) require live databases and were not run locally. --------- Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com> Co-authored-by: Aniruddh25 <3513779+Aniruddh25@users.noreply.github.com> Co-authored-by: Aniruddh Munde <anmunde@microsoft.com> Co-authored-by: Souvik Ghosh <souvikofficial04@gmail.com> Co-authored-by: Arjun Narendra <arjunnarendra1@gmail.com> Co-authored-by: RubenCerna2079 <32799214+RubenCerna2079@users.noreply.github.com> Co-authored-by: Arpit Gupta <106474712+ar-guptaar@users.noreply.github.com> Co-authored-by: ARPIT GUPTA <guptaar@microsoft.com> Co-authored-by: Anusha Kolan <anushakolan10@gmail.com>

Arjun Narendra (ArjunNarendra) added 6 commits July 4, 2026 19:37

Build upsert queries appropriately with insert/create policies

626d6f0

Change logic to determine how to process result sets so that appropri…

3c9b908

…ate error/success message is returned

Provide another parameter when executing the query to help with resul…

73d536c

…t processing

Add (unignore) relevant tests

b5f3734

Add create policy config and permissions for PostgreSQL tests

000ec1b

Modify policy updates when generating the config file to reflect crea…

4e06b23

…te/update policies

Copilot AI review requested due to automatic review settings July 5, 2026 03:15

Copilot started reviewing on behalf of Arjun Narendra (ArjunNarendra) July 5, 2026 03:16 View session

Copilot AI reviewed Jul 5, 2026

View reviewed changes

Comment thread src/Core/Resolvers/SqlMutationEngine.cs Outdated

Comment thread src/Core/Configurations/RuntimeConfigValidator.cs

Arjun Narendra (ArjunNarendra) added 6 commits July 5, 2026 12:00

Remove unnecessary using statements

2333d8e

Update PostgreSQL verified snapshot policies

e744cae

Only pass in isFallbackToUpdate parameter for PostgreSQL

849b32f

Update PostgreSQL insert query builder to account for create policy

fa64d55

Update unit test to reflect support for create policy for PostgreSQL

ddde125

Merge branch 'main' into user/an/db-policy-for-put-patch-postgresql

b96b0c6

Mihir M (unattendedfaxmachine) reviewed Jul 7, 2026

View reviewed changes

Comment thread src/Core/Resolvers/PostgresQueryBuilder.cs Outdated

Arjun Narendra (ArjunNarendra) added 3 commits July 13, 2026 17:05

Remove dependency on IS_UPDATE_RESULT_SET flag when determining wheth…

af1f7b2

…er a PostgreSQL upsert operation performed an update or not. Reliance on this flag could potentially lead to incorrect HTTP response code being sent in certain race scenarios.

Add back the dependency on IS_UPDATE_RESULT_SET flag when determining…

a2a1de1

… whether an upsert operation performed an update or not because it is required by other database providers and does not apply for PostgreSQL

Merge branch 'main' into user/an/db-policy-for-put-patch-postgresql

fa30fcd

Arjun Narendra (ArjunNarendra) marked this pull request as draft July 14, 2026 05:11

Arjun Narendra (ArjunNarendra) marked this pull request as ready for review July 14, 2026 05:11

Merge branch 'main' into user/an/db-policy-for-put-patch-postgresql

56723d6

Mihir M (unattendedfaxmachine) approved these changes Jul 15, 2026

View reviewed changes

Arjun Narendra (ArjunNarendra) added the assign-for-review label Jul 15, 2026

github-actions Bot assigned RubenCerna2079 and Souvik Ghosh (souvikghosh04) Jul 15, 2026

github-actions Bot removed the assign-for-review label Jul 15, 2026

RubenCerna2079 requested changes Jul 16, 2026

View reviewed changes

Comment thread src/Core/Resolvers/PostgreSqlExecutor.cs

Comment thread src/Core/Resolvers/PostgreSqlExecutor.cs

Comment thread src/Core/Resolvers/SqlMutationEngine.cs Outdated

RubenCerna2079 reviewed Jul 16, 2026

View reviewed changes

Comment thread src/Core/Resolvers/PostgreSqlExecutor.cs

Arjun Narendra (ArjunNarendra) linked an issue Jul 20, 2026 that may be closed by this pull request

[Known Issue] Database policy support for Create action in PostgreSQL #1334

Closed

Remove isFallbackToUpdate flag from argument list and pass this flag …

02b8411

…via the query result instead

Mihir M (unattendedfaxmachine) requested a review from RubenCerna2079 July 20, 2026 23:27

Simplify if-else structure when determining what exception to throw f…

3fddd8f

…or insert, update, and update incremental operations

Souvik Ghosh (souvikghosh04) approved these changes Jul 22, 2026

View reviewed changes

Comment thread src/Core/Resolvers/SqlMutationEngine.cs Outdated

Comment thread src/Core/Resolvers/PostgresQueryBuilder.cs

Remove seperate argument list for PostgreSQL when performing an upsert

74854a8

Souvik Ghosh (souvikghosh04) approved these changes Jul 23, 2026

View reviewed changes

Merge branch 'main' into user/an/db-policy-for-put-patch-postgresql

23e4375

RubenCerna2079 approved these changes Jul 23, 2026

View reviewed changes

RubenCerna2079 enabled auto-merge (squash) July 23, 2026 16:24

RubenCerna2079 merged commit 57a195c into Azure:main Jul 23, 2026
14 checks passed

naxing123 mentioned this pull request Aug 11, 2026

Port PostgreSQL GraphQL groupby/aggregation + related features to release/2.0 #3767

Merged

Uh oh!

Conversation

Arjun Narendra (ArjunNarendra) commented Jul 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Why make this change?

What is this change?

How was this tested?

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Arjun Narendra (ArjunNarendra) commented Jul 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Arjun Narendra (ArjunNarendra) commented Jul 15, 2026

Uh oh!

azure-pipelines Bot commented Jul 15, 2026

Uh oh!

RubenCerna2079 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Souvik Ghosh (souvikghosh04) left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

RubenCerna2079 commented Jul 23, 2026

Uh oh!

RubenCerna2079 left a comment

Choose a reason for hiding this comment

Uh oh!

azure-pipelines Bot commented Jul 23, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Arjun Narendra (ArjunNarendra) commented Jul 5, 2026 •

edited

Loading

Arjun Narendra (ArjunNarendra) commented Jul 14, 2026 •

edited

Loading