feat(provider/amazon-bedrock): Support citations in amazon-bedrock-provider #8861

horita-yuya · 2025-09-24T06:07:09Z

Background

Summary

I added "citations" option as bedrock part provider options

We need this to analyze PDF using anthropic model through bedrock converse api.
https://docs.claude.com/en/docs/build-with-claude/pdf-support#amazon-bedrock-pdf-support

Reference:
Official type definition - https://github.com/aws/aws-sdk-js-v3/blob/281c666796e62691a6af521d21a87ad788b54c68/clients/client-bedrock-runtime/src/commands/ConverseCommand.ts#L80

Manual Verification

I prepared pdf whose contents is only image, no text.
I called bedrock anthropic model to extract information from it with citations: true and citations: false
I checked if citations is enabled I could extract information, but not with citations disabled.

Checklist

Tests have been added / updated (for bug fixes / features)
Documentation has been added / updated (for bug fixes / features)
A patch changeset for relevant packages has been added (for bug fixes / features - run pnpm changeset in the project root)
Formatting issues have been fixed (run pnpm prettier-fix in the project root)
I have reviewed this pull request (self-review)

Future Work

Related Issues

horita-yuya · 2025-09-24T06:47:33Z

This change helps some people using claude on bedrock.

Could you review it?

horita-yuya · 2025-09-24T08:55:04Z

packages/amazon-bedrock/src/convert-to-bedrock-chat-messages.ts

+async function shouldEnableCitations(
+  providerMetadata: SharedV2ProviderMetadata | undefined,
+): Promise<boolean> {
+  const bedrockOptions = await parseProviderOptions({


I followed anthropic's implementation.

horita-yuya · 2025-09-25T00:33:07Z

@gr2m

Hi, I'm in trouble right now. I need this feature or I have to strip out ai-sdk...

gr2m · 2025-09-25T02:32:58Z

Hi, I'm in trouble right now. I need this feature or I have to strip out ai-sdk...

preassure like this will never work, if anything it will achieve the opposite. If you need a patch urgently, you can release your own fork to npm

gr2m

Can you please add an example (like this one) and update the documentation for the bedrock provider at content/providers/01-ai-sdk-providers/08-amazon-bedrock.mdx

horita-yuya · 2025-09-25T04:11:07Z

content/providers/01-ai-sdk-providers/08-amazon-bedrock.mdx

+import fs from 'fs';
+
+const result = await generateObject({
+  model: bedrock('apac.anthropic.claude-sonnet-4-20250514-v1:0'),


https://docs.claude.com/en/docs/build-with-claude/pdf-support#supported-platforms-and-models

horita-yuya · 2025-09-25T04:12:20Z

content/providers/01-ai-sdk-providers/08-amazon-bedrock.mdx

+
+Amazon Bedrock supports citations for document-based inputs across compatible models. When enabled:
+- Some models can read documents with visual understanding, not just extracting text
+- Models can cite specific parts of documents you provide, making it easier to trace information back to its source (Not Supported Yet)


Accessing citation parameters in response is not supported yet. May be another PR.

visual understanding reference:
https://docs.claude.com/en/docs/build-with-claude/pdf-support#amazon-bedrock-pdf-support

horita-yuya · 2025-09-25T04:13:19Z

@gr2m

preassure like this will never work

I'm really sorry.

gr2m

Does the example that you added work for you?

You can run it with

cd examples/ai-core
pnpm tsx src/generate-object/amazon-bedrock-document-citations.ts

You might need to update/create examples/ai-core/.env and set ANTHROPIC_API_KEY

examples/ai-core/src/generate-object/amazon-bedrock-document-citations.ts

gr2m · 2025-09-25T20:37:27Z

examples/ai-core/src/generate-object/amazon-bedrock-document-citations.ts

+
+async function main() {
+  const result = await generateObject({
+    model: bedrock('apac.anthropic.claude-sonnet-4-20250514-v1:0'),


that model didn't work for me. I tried anthropic.claude-sonnet-4-20250514-v1:0 but got the error

APICallError [AI_APICallError]: Invocation of model ID anthropic.claude-sonnet-4-20250514-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.

Does the example that you added work for you?

Yes, I tried and it worked. I tried with old document.pdf then I deleted it not to commit it.
I changed it to ./data/ai.pdf following your review, #8861 (comment), it also worked.

is it possible that the apac.anthropic.claude-sonnet-4-20250514-v1:0 model id you set is bound to the API key you are using?

I tried setting AWS_BEARER_TOKEN_BEDROCK key for easy.
But it should work setting AWS_ACCESS_KEY_ID="" , AWS_SECRET_ACCESS_KEY="" , AWS_REGION="" . These variables are already defined in .env.example.

Not directly related, but just as a note I used sonnet 4 because pdf functionality of sonnet 3.5 is deprecated.

https://docs.claude.com/en/docs/build-with-claude/pdf-support#supported-platforms-and-models

ah I got it now. us.anthropic.claude-sonnet-4-20250514-v1:0 works for you, apac. stands for Asia-Pacific which probably correlates with your AWS region. I'll change it to us. since it will work for us, and we need these examples primarily for our own testing, cheers!

…itations.ts Co-authored-by: Gregor Martynus <[email protected]>

examples/ai-core/src/generate-object/amazon-bedrock-document-citations.ts

gr2m · 2025-09-25T22:42:46Z

examples/ai-core/src/generate-object/amazon-bedrock-document-citations.ts

+            providerOptions: {
+              bedrock: {
+                citations: { enabled: true },
+              },
+            },


the example behaves the same to me when I remove the providerOptions. What effect should it have? Does it need a PDF with certain content for it to work?

Yes.
PDF documents whose content is mainly texts works without this option.
But contents like graphs or images, you need this option to analyze correctly.

Do you have such a pdf that we could use for this example?

Of course. Try this one.

vercel-graph.pdf

citations: true

citations: false

@gr2m
Sorry for rushing you.
Could you try with this pdf?

examples/ai-core/src/generate-object/amazon-bedrock-document-citations.ts

gr2m

That worked, thanks!

…ovider (#8861) ## Summary I added "citations" option as bedrock part provider options We need this to analyze PDF using anthropic model through bedrock converse api. https://docs.claude.com/en/docs/build-with-claude/pdf-support#amazon-bedrock-pdf-support Reference: Official type definition - https://github.com/aws/aws-sdk-js-v3/blob/281c666796e62691a6af521d21a87ad788b54c68/clients/client-bedrock-runtime/src/commands/ConverseCommand.ts#L80 ## Manual Verification 1. I prepared pdf whose contents is only image, no text. 2. I called bedrock anthropic model to extract information from it with citations: true and citations: false 3. I checked if citations is enabled I could extract information, but not with citations disabled. ## Related Issues close #8511 --------- Co-authored-by: Gregor Martynus <[email protected]>

vercel-ai-sdk · 2025-09-30T04:09:05Z

✅ Backport PR created: #9062

horita-yuya · 2025-09-30T04:24:23Z

Thank you very, very, very much

…bedrock-provider (#9062) This is an automated backport of #8861 to the release-v5.0 branch. Co-authored-by: horita-yuya <[email protected]> Co-authored-by: Gregor Martynus <[email protected]>

horita-yuya force-pushed the main branch from 5d24c13 to b594ee3 Compare September 24, 2025 06:20

Support citations in amazon-bedrock-provider

8fcd870

horita-yuya force-pushed the main branch from b594ee3 to 8fcd870 Compare September 24, 2025 06:39

horita-yuya changed the title ~~Support citations in amazon-bedrock-provider~~ [I’m in trouble right now] Support citations in amazon-bedrock-provider Sep 24, 2025

horita-yuya changed the title ~~[I’m in trouble right now] Support citations in amazon-bedrock-provider~~ feat(@ai-sdk/amazon-bedrock): Support citations in amazon-bedrock-provider Sep 24, 2025

horita-yuya commented Sep 24, 2025

View reviewed changes

gr2m reviewed Sep 25, 2025

View reviewed changes

Add examples of citations for amazon bedrock

fa7c366

horita-yuya commented Sep 25, 2025

View reviewed changes

gr2m reviewed Sep 25, 2025

View reviewed changes

Update examples/ai-core/src/generate-object/amazon-bedrock-document-c…

4668992

…itations.ts Co-authored-by: Gregor Martynus <[email protected]>

gr2m reviewed Sep 25, 2025

View reviewed changes

examples/ai-core/src/generate-object/amazon-bedrock-document-citations.ts Outdated Show resolved Hide resolved

gr2m added 2 commits September 25, 2025 15:34

Apply suggestion from @gr2m

47e5cc0

style: prettier

42723a6

gr2m reviewed Sep 25, 2025

View reviewed changes

vercel bot reviewed Sep 25, 2025

View reviewed changes

examples/ai-core/src/generate-object/amazon-bedrock-document-citations.ts Outdated Show resolved Hide resolved

Enable citations in Bedrock provider options

3f42708

horita-yuya changed the title ~~feat(@ai-sdk/amazon-bedrock): Support citations in amazon-bedrock-provider~~ feat(provider/amazon-bedrock): Support citations in amazon-bedrock-provider Sep 30, 2025

gr2m approved these changes Sep 30, 2025

View reviewed changes

gr2m added feature request New feature or request provider/bedrock backport labels Sep 30, 2025

Merge branch 'main' into main

b3bf98a

gr2m enabled auto-merge (squash) September 30, 2025 04:01

gr2m merged commit c5e2a7c into vercel:main Sep 30, 2025
10 of 11 checks passed

vercel-ai-sdk bot removed the backport label Sep 30, 2025

vercel-ai-sdk bot mentioned this pull request Sep 30, 2025

Backport: feat(provider/amazon-bedrock): Support citations in amazon-bedrock-provider #9062

Merged

gr2m added ai/provider provider/amazon-bedrock Issues related to the @ai-sdk/amazon-bedrock provider labels Oct 28, 2025

feat(provider/amazon-bedrock): Support citations in amazon-bedrock-provider #8861

feat(provider/amazon-bedrock): Support citations in amazon-bedrock-provider #8861

Uh oh!

Conversation

horita-yuya commented Sep 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Background

Summary

Manual Verification

Checklist

Future Work

Related Issues

Uh oh!

horita-yuya commented Sep 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

horita-yuya commented Sep 25, 2025

Uh oh!

gr2m commented Sep 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

gr2m left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

horita-yuya Sep 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

horita-yuya commented Sep 25, 2025

Uh oh!

gr2m left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

horita-yuya Sep 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

horita-yuya Sep 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

gr2m left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

vercel-ai-sdk bot commented Sep 30, 2025

Uh oh!

horita-yuya commented Sep 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

horita-yuya commented Sep 24, 2025 •

edited

Loading

horita-yuya commented Sep 24, 2025 •

edited

Loading

gr2m commented Sep 25, 2025 •

edited

Loading

horita-yuya Sep 25, 2025 •

edited

Loading

horita-yuya Sep 25, 2025 •

edited

Loading

horita-yuya Sep 25, 2025 •

edited

Loading

horita-yuya commented Sep 30, 2025 •

edited

Loading