Skip to content

Commit 07e98c9

Browse files
committed
Upgrade to Nemotron RC NIMs and NV-Ingest 26.1.2
Signed-off-by: Swapnil Masurekar <smasurekar@nvidia.com>
1 parent 9d411e4 commit 07e98c9

45 files changed

Lines changed: 243 additions & 243 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎README.md‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -105,9 +105,9 @@ This modular design ensures efficient query processing, accurate retrieval of in
105105

106106
- [NVIDIA NIM llama-3_2-nv-embedqa-1b-v2](https://build.nvidia.com/nvidia/llama-3_2-nv-embedqa-1b-v2)
107107
- [NVIDIA NIM llama-3_2-nv-rerankqa-1b-v2](https://build.nvidia.com/nvidia/llama-3_2-nv-rerankqa-1b-v2)
108-
- [NeMo Retriever Page Elements NIM](https://build.nvidia.com/nvidia/nemoretriever-page-elements-v3)
109-
- [NeMo Retriever Table Structure NIM](https://build.nvidia.com/nvidia/nemoretriever-table-structure-v1)
110-
- [NeMo Retriever Graphic Elements NIM](https://build.nvidia.com/nvidia/nemoretriever-graphic-elements-v1)
108+
- [NeMo Retriever Page Elements NIM](https://build.nvidia.com/nvidia/nemotron-page-elements-v3)
109+
- [NeMo Retriever Table Structure NIM](https://build.nvidia.com/nvidia/nemotron-table-structure-v1)
110+
- [NeMo Retriever Graphic Elements NIM](https://build.nvidia.com/nvidia/nemotron-graphic-elements-v1)
111111
- [NeMo Retriever OCR NIM](https://build.nvidia.com/nvidia/nemoretriever-ocr)
112112

113113
- Optional NIMs
@@ -202,9 +202,9 @@ Use of the models in this blueprint is governed by the [NVIDIA AI Foundation Mod
202202

203203
## Terms of Use
204204
This blueprint is governed by the [NVIDIA Agreements | Enterprise Software | NVIDIA Software License Agreement](https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/) and the [NVIDIA Agreements | Enterprise Software | Product Specific Terms for AI Product](https://www.nvidia.com/en-us/agreements/enterprise-software/product-specific-terms-for-ai-products/). The models are governed by the [NVIDIA Agreements | Enterprise Software | NVIDIA Community Model License](https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-community-models-license/) and the [NVIDIA RAG dataset](./data/multimodal/) which is governed by the [NVIDIA Asset License Agreement](https://github.com/NVIDIA-AI-Blueprints/rag/blob/main/data/LICENSE.DATA).
205-
The following models that are built with Llama are governed by the Llama 3.2 Community License Agreement: nvidia/llama-3.2-nv-embedqa-1b-v2 and nvidia/llama-3.2-nv-rerankqa-1b-v2 and llama-3.2-nemoretriever-1b-vlm-embed-v1.
205+
The following models that are built with Llama are governed by the Llama 3.2 Community License Agreement: nvidia/llama-nemotron-embed-1b-v2 and nvidia/llama-nemotron-rerank-1b-v2 and llama-3.2-nemoretriever-1b-vlm-embed-v1.
206206

207207
## Additional Information
208208

209-
The [Llama 3.1 Community License Agreement](https://www.llama.com/llama3_1/license/) for the llama-3.1-nemotron-nano-vl-8b-v1, llama-3.1-nemoguard-8b-content-safety and llama-3.1-nemoguard-8b-topic-control models. The [Llama 3.2 Community License Agreement](https://www.llama.com/llama3_2/license/) for the nvidia/llama-3.2-nv-embedqa-1b-v2, nvidia/llama-3.2-nv-rerankqa-1b-v2 and llama-3.2-nemoretriever-1b-vlm-embed-v1 models. The [Llama 3.3 Community License Agreement](https://github.com/meta-llama/llama-models/blob/main/models/llama3_3/LICENSE) for the llama-3.3-nemotron-super-49b-v1.5 models. Built with Llama. Apache 2.0 for NVIDIA Ingest and for the nemoretriever-page-elements-v2, nemoretriever-table-structure-v1, nemoretriever-graphic-elements-v1, paddleocr and nemoretriever-ocr-v1 models.
209+
The [Llama 3.1 Community License Agreement](https://www.llama.com/llama3_1/license/) for the llama-3.1-nemotron-nano-vl-8b-v1, llama-3.1-nemoguard-8b-content-safety and llama-3.1-nemoguard-8b-topic-control models. The [Llama 3.2 Community License Agreement](https://www.llama.com/llama3_2/license/) for the nvidia/llama-nemotron-embed-1b-v2, nvidia/llama-nemotron-rerank-1b-v2 and llama-3.2-nemoretriever-1b-vlm-embed-v1 models. The [Llama 3.3 Community License Agreement](https://github.com/meta-llama/llama-models/blob/main/models/llama3_3/LICENSE) for the llama-3.3-nemotron-super-49b-v1.5 models. Built with Llama. Apache 2.0 for NVIDIA Ingest and for the nemoretriever-page-elements-v2, nemotron-table-structure-v1, nemotron-graphic-elements-v1, paddleocr and nemoretriever-ocr-v1 models.
210210

‎deploy/compose/.env‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -22,8 +22,8 @@ export NVIDIA_API_KEY=${NGC_API_KEY}
2222
export APP_LLM_SERVERURL=nim-llm:8000
2323
export APP_FILTEREXPRESSIONGENERATOR_SERVERURL=nim-llm:8000
2424
export SUMMARY_LLM_SERVERURL=nim-llm:8000
25-
export APP_EMBEDDINGS_SERVERURL=nemoretriever-embedding-ms:8000/v1
26-
export APP_RANKING_SERVERURL=nemoretriever-ranking-ms:8000
25+
export APP_EMBEDDINGS_SERVERURL=nemotron-embedding-ms:8000/v1
26+
export APP_RANKING_SERVERURL=nemotron-ranking-ms:8000
2727
export OCR_GRPC_ENDPOINT=nemoretriever-ocr:8001
2828
export OCR_HTTP_ENDPOINT=http://nemoretriever-ocr:8000/v1/infer
2929
export OCR_INFER_PROTOCOL=grpc
@@ -50,11 +50,11 @@ export YOLOX_TABLE_STRUCTURE_INFER_PROTOCOL=grpc
5050
# export OCR_HTTP_ENDPOINT=https://ai.api.nvidia.com/v1/cv/nvidia/nemoretriever-ocr
5151
# export OCR_INFER_PROTOCOL=http
5252
# export OCR_MODEL_NAME=scene_text_ensemble
53-
# export YOLOX_HTTP_ENDPOINT=https://ai.api.nvidia.com/v1/cv/nvidia/nemoretriever-page-elements-v3
53+
# export YOLOX_HTTP_ENDPOINT=https://ai.api.nvidia.com/v1/cv/nvidia/nemotron-page-elements-v3
5454
# export YOLOX_INFER_PROTOCOL=http
55-
# export YOLOX_GRAPHIC_ELEMENTS_HTTP_ENDPOINT=https://ai.api.nvidia.com/v1/cv/nvidia/nemoretriever-graphic-elements-v1
55+
# export YOLOX_GRAPHIC_ELEMENTS_HTTP_ENDPOINT=https://ai.api.nvidia.com/v1/cv/nvidia/nemotron-graphic-elements-v1
5656
# export YOLOX_GRAPHIC_ELEMENTS_INFER_PROTOCOL=http
57-
# export YOLOX_TABLE_STRUCTURE_HTTP_ENDPOINT=https://ai.api.nvidia.com/v1/cv/nvidia/nemoretriever-table-structure-v1
57+
# export YOLOX_TABLE_STRUCTURE_HTTP_ENDPOINT=https://ai.api.nvidia.com/v1/cv/nvidia/nemotron-table-structure-v1
5858
# export YOLOX_TABLE_STRUCTURE_INFER_PROTOCOL=http
5959
# export APP_QUERYREWRITER_SERVERURL=""
6060
# export APP_QUERYREWRITER_MODELNAME="nvidia/llama-3.3-nemotron-super-49b-v1.5"

‎deploy/compose/docker-compose-ingestor-server.yaml‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -75,8 +75,8 @@ services:
7575

7676
##===Embedding Model specific configurations===
7777
# url on which embedding model is hosted. If "", Nvidia hosted API is used
78-
APP_EMBEDDINGS_SERVERURL: ${APP_EMBEDDINGS_SERVERURL-"nemoretriever-embedding-ms:8000/v1"}
79-
APP_EMBEDDINGS_MODELNAME: ${APP_EMBEDDINGS_MODELNAME:-nvidia/llama-3.2-nv-embedqa-1b-v2}
78+
APP_EMBEDDINGS_SERVERURL: ${APP_EMBEDDINGS_SERVERURL-"nemotron-embedding-ms:8000/v1"}
79+
APP_EMBEDDINGS_MODELNAME: ${APP_EMBEDDINGS_MODELNAME:-nvidia/llama-nemotron-embed-1b-v2}
8080
# For VLM Embedding Model (Nemoretriever-1b-vlm-embed-v1)
8181
# APP_EMBEDDINGS_SERVERURL: ${APP_EMBEDDINGS_SERVERURL-"nemotron-vlm-embedding-ms:8000/v1"}
8282
# APP_EMBEDDINGS_MODELNAME: ${APP_EMBEDDINGS_MODELNAME:-nvidia/llama-nemotron-embed-vl-1b-v2}
@@ -168,7 +168,7 @@ services:
168168
- "6379:6379"
169169

170170
nv-ingest-ms-runtime:
171-
image: nvcr.io/nvidia/nemo-microservices/nv-ingest:26.1.1
171+
image: nvcr.io/nvidia/nemo-microservices/nv-ingest:26.1.2
172172
# cpuset: "0-15" # Uncomment to restrict this container to CPU cores 0–15
173173
shm_size: 40gb # Should be at minimum 30% of assigned memory per Ray documentation
174174
volumes:
@@ -234,13 +234,13 @@ services:
234234
- YOLOX_HTTP_ENDPOINT=${YOLOX_HTTP_ENDPOINT:-http://page-elements:8000/v1/infer}
235235
- YOLOX_INFER_PROTOCOL=${YOLOX_INFER_PROTOCOL:-grpc}
236236
# build.nvidia.com hosted yolox-graphics-elements endpoints.
237-
#- YOLOX_GRAPHIC_ELEMENTS_HTTP_ENDPOINT=https://ai.api.nvidia.com/v1/cv/nvidia/nemoretriever-graphic-elements-v1
237+
#- YOLOX_GRAPHIC_ELEMENTS_HTTP_ENDPOINT=https://ai.api.nvidia.com/v1/cv/nvidia/nemotron-graphic-elements-v1
238238
#- YOLOX_GRAPHIC_ELEMENTS_INFER_PROTOCOL=http
239239
- YOLOX_GRAPHIC_ELEMENTS_GRPC_ENDPOINT=${YOLOX_GRAPHIC_ELEMENTS_GRPC_ENDPOINT:-graphic-elements:8001}
240240
- YOLOX_GRAPHIC_ELEMENTS_HTTP_ENDPOINT=${YOLOX_GRAPHIC_ELEMENTS_HTTP_ENDPOINT:-http://graphic-elements:8000/v1/infer}
241241
- YOLOX_GRAPHIC_ELEMENTS_INFER_PROTOCOL=${YOLOX_GRAPHIC_ELEMENTS_INFER_PROTOCOL:-grpc}
242242
# build.nvidia.com hosted yolox-table-elements endpoints.
243-
#- YOLOX_TABLE_STRUCTURE_HTTP_ENDPOINT=https://ai.api.nvidia.com/v1/cv/nvidia/nemoretriever-table-structure-v1
243+
#- YOLOX_TABLE_STRUCTURE_HTTP_ENDPOINT=https://ai.api.nvidia.com/v1/cv/nvidia/nemotron-table-structure-v1
244244
#- YOLOX_TABLE_STRUCTURE_INFER_PROTOCOL=http
245245
- YOLOX_TABLE_STRUCTURE_GRPC_ENDPOINT=${YOLOX_TABLE_STRUCTURE_GRPC_ENDPOINT:-table-structure:8001}
246246
- YOLOX_TABLE_STRUCTURE_HTTP_ENDPOINT=${YOLOX_TABLE_STRUCTURE_HTTP_ENDPOINT:-http://table-structure:8000/v1/infer}

‎deploy/compose/docker-compose-rag-server.yaml‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -94,17 +94,17 @@ services:
9494

9595
##===Embedding Model specific configurations===
9696
# url on which embedding model is hosted. If "", Nvidia hosted API is used
97-
APP_EMBEDDINGS_SERVERURL: ${APP_EMBEDDINGS_SERVERURL-"nemoretriever-embedding-ms:8000/v1"}
98-
APP_EMBEDDINGS_MODELNAME: ${APP_EMBEDDINGS_MODELNAME:-nvidia/llama-3.2-nv-embedqa-1b-v2}
97+
APP_EMBEDDINGS_SERVERURL: ${APP_EMBEDDINGS_SERVERURL-"nemotron-embedding-ms:8000/v1"}
98+
APP_EMBEDDINGS_MODELNAME: ${APP_EMBEDDINGS_MODELNAME:-nvidia/llama-nemotron-embed-1b-v2}
9999
APP_EMBEDDINGS_DIMENSIONS: ${APP_EMBEDDINGS_DIMENSIONS:-2048}
100100
# For VLM Embedding Model (Nemoretriever-1b-vlm-embed-v1)
101101
# APP_EMBEDDINGS_SERVERURL: ${APP_EMBEDDINGS_SERVERURL-"nemotron-vlm-embedding-ms:8000/v1"}
102102
# APP_EMBEDDINGS_MODELNAME: ${APP_EMBEDDINGS_MODELNAME:-nvidia/llama-nemotron-embed-vl-1b-v2}
103103

104104
##===Reranking Model specific configurations===
105105
# url on which ranking model is hosted. If "", Nvidia hosted API is used
106-
APP_RANKING_SERVERURL: ${APP_RANKING_SERVERURL-"nemoretriever-ranking-ms:8000"}
107-
APP_RANKING_MODELNAME: ${APP_RANKING_MODELNAME:-"nvidia/llama-3.2-nv-rerankqa-1b-v2"}
106+
APP_RANKING_SERVERURL: ${APP_RANKING_SERVERURL-"nemotron-ranking-ms:8000"}
107+
APP_RANKING_MODELNAME: ${APP_RANKING_MODELNAME:-"nvidia/llama-nemotron-rerank-1b-v2"}
108108
ENABLE_RERANKER: ${ENABLE_RERANKER:-True}
109109
# Default score threshold for filtering documents by reranker relevance (0.0 to 1.0)
110110
RERANKER_SCORE_THRESHOLD: ${RERANKER_SCORE_THRESHOLD:-${RERANKER_CONFIDENCE_THRESHOLD:-0.0}}

‎deploy/compose/nims.yaml‎

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -31,9 +31,9 @@ services:
3131
retries: 100
3232
profiles: ["", "rag"]
3333

34-
nemoretriever-embedding-ms:
35-
container_name: nemoretriever-embedding-ms
36-
image: nvcr.io/nim/nvidia/llama-3.2-nv-embedqa-1b-v2:1.10.1
34+
nemotron-embedding-ms:
35+
container_name: nemotron-embedding-ms
36+
image: nvcr.io/nvstaging/nim/llama-nemotron-embed-1b-v2:1.12.0-rc.20260216115852-6fba925dcb63c190
3737
volumes:
3838
- ${MODEL_DIRECTORY:-./}:/opt/nim/.cache
3939
ports:
@@ -91,9 +91,9 @@ services:
9191
start_period: 10m
9292
profiles: ["vlm-embed", "vlm-ingest"]
9393

94-
nemoretriever-ranking-ms:
95-
container_name: nemoretriever-ranking-ms
96-
image: nvcr.io/nim/nvidia/llama-3.2-nv-rerankqa-1b-v2:1.8.0
94+
nemotron-ranking-ms:
95+
container_name: nemotron-ranking-ms
96+
image: nvcr.io/nvstaging/nim/llama-nemotron-rerank-1b-v2:1.10.0-rc.20260219005237-7e2370934c6f9b9c
9797
volumes:
9898
- ${MODEL_DIRECTORY:-./}:/opt/nim/.cache
9999
ports:
@@ -119,7 +119,7 @@ services:
119119
profiles: ["", "rag", "vlm-generation"]
120120

121121
page-elements:
122-
image: ${YOLOX_IMAGE:-nvcr.io/nim/nvidia/nemoretriever-page-elements-v3}:${YOLOX_TAG:-1.7.0}
122+
image: ${YOLOX_IMAGE:-nvcr.io/nvstaging/nim/nemotron-page-elements-v3}:${YOLOX_TAG:-1.8.0-rc.20260218170155-6b1b2aa9dfefc9c3}
123123
shm_size: 16gb
124124
ports:
125125
- "8000:8000"
@@ -157,7 +157,7 @@ services:
157157
profiles: ["", "ingest", "vlm-ingest"]
158158

159159
graphic-elements:
160-
image: ${YOLOX_GRAPHIC_ELEMENTS_IMAGE:-nvcr.io/nim/nvidia/nemoretriever-graphic-elements-v1}:${YOLOX_GRAPHIC_ELEMENTS_TAG:-1.6.0}
160+
image: ${YOLOX_GRAPHIC_ELEMENTS_IMAGE:-nvcr.io/nvstaging/nim/nemotron-graphic-elements-v1}:${YOLOX_GRAPHIC_ELEMENTS_TAG:-1.8.0-rc.20260218170144-35d5a3f270662864}
161161
shm_size: 16gb
162162
ports:
163163
- "8003:8000"
@@ -183,7 +183,7 @@ services:
183183
profiles: ["", "ingest", "vlm-ingest"]
184184

185185
table-structure:
186-
image: ${YOLOX_TABLE_STRUCTURE_IMAGE:-nvcr.io/nim/nvidia/nemoretriever-table-structure-v1}:${YOLOX_TABLE_STRUCTURE_TAG:-1.6.0}
186+
image: ${YOLOX_TABLE_STRUCTURE_IMAGE:-nvcr.io/nvstaging/nim/nemotron-table-structure-v1}:${YOLOX_TABLE_STRUCTURE_TAG:-1.8.0-rc.20260218170204-cca5cb850146dbbc}
187187
shm_size: 16gb
188188
ports:
189189
- "8006:8000"

‎deploy/helm/nvidia-blueprint-rag/Chart.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ dependencies:
44
- condition: nv-ingest.enabled
55
name: nv-ingest
66
repository: https://helm.ngc.nvidia.com/nvidia/nemo-microservices
7-
version: 26.1.1
7+
version: 26.1.2
88
- condition: eck-elasticsearch.enabled
99
name: eck-elasticsearch
1010
repository: https://helm.elastic.co

‎deploy/helm/nvidia-blueprint-rag/endpoints.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -24,11 +24,11 @@ This document describes the configurable endpoints used by the RAG server and it
2424

2525
### Embedding Model
2626
- **APP_EMBEDDINGS_SERVERURL**: URL for the embedding model service (default: "nemo-retriever-embedding-ms:8000")
27-
- **APP_EMBEDDINGS_MODELNAME**: Name of the embedding model (default: "nvidia/llama-3.2-nv-embedqa-1b-v2")
27+
- **APP_EMBEDDINGS_MODELNAME**: Name of the embedding model (default: "nvidia/llama-nemotron-embed-1b-v2")
2828

2929
### Reranking Model
3030
- **APP_RANKING_SERVERURL**: URL for the ranking model service (default: "nemo-retriever-reranking-ms:8000")
31-
- **APP_RANKING_MODELNAME**: Name of the ranking model (default: "nvidia/llama-3.2-nv-rerankqa-1b-v2")
31+
- **APP_RANKING_MODELNAME**: Name of the ranking model (default: "nvidia/llama-nemotron-rerank-1b-v2")
3232

3333
### Reflection Model
3434
- **REFLECTION_LLM_SERVERURL**: URL for the reflection LLM service (default: "nim-llm:8000")
@@ -42,8 +42,8 @@ This document describes the configurable endpoints used by the RAG server and it
4242

4343
### Model Configuration
4444
- **NEXT_PUBLIC_MODEL_NAME**: Name of the LLM model used in the frontend (default: "nvidia/llama-3.3-nemotron-super-49b-v1.5")
45-
- **VITE_EMBEDDING_MODEL**: Name of the embedding model used in the frontend (default: "nvidia/llama-3.2-nv-embedqa-1b-v2")
46-
- **VITE_RERANKER_MODEL**: Name of the reranker model used in the frontend (default: "nvidia/llama-3.2-nv-rerankqa-1b-v2")
45+
- **VITE_EMBEDDING_MODEL**: Name of the embedding model used in the frontend (default: "nvidia/llama-nemotron-embed-1b-v2")
46+
- **VITE_RERANKER_MODEL**: Name of the reranker model used in the frontend (default: "nvidia/llama-nemotron-rerank-1b-v2")
4747

4848
## Monitoring and Tracing Endpoints
4949

‎deploy/helm/nvidia-blueprint-rag/values.yaml‎

Lines changed: 21 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -183,14 +183,14 @@ envVars:
183183

184184
##===Embedding Model specific configurations===
185185
# URL on which embedding model is hosted. If "", Nvidia hosted API is used
186-
APP_EMBEDDINGS_SERVERURL: "nemoretriever-embedding-ms:8000/v1"
187-
APP_EMBEDDINGS_MODELNAME: "nvidia/llama-3.2-nv-embedqa-1b-v2"
186+
APP_EMBEDDINGS_SERVERURL: "nemotron-embedding-ms:8000/v1"
187+
APP_EMBEDDINGS_MODELNAME: "nvidia/llama-nemotron-embed-1b-v2"
188188
APP_EMBEDDINGS_DIMENSIONS: "2048"
189189

190190
##===Reranking Model specific configurations===
191191
# URL on which ranking model is hosted. If "", Nvidia hosted API is used
192-
APP_RANKING_SERVERURL: "nemoretriever-ranking-ms:8000"
193-
APP_RANKING_MODELNAME: "nvidia/llama-3.2-nv-rerankqa-1b-v2"
192+
APP_RANKING_SERVERURL: "nemotron-ranking-ms:8000"
193+
APP_RANKING_MODELNAME: "nvidia/llama-nemotron-rerank-1b-v2"
194194
ENABLE_RERANKER: "True"
195195
# Default score threshold for filtering documents by reranker relevance (0.0 to 1.0)
196196
RERANKER_SCORE_THRESHOLD: "0.0"
@@ -349,8 +349,8 @@ ingestor-server:
349349
## APP_EMBEDDINGS_APIKEY and SUMMARY_LLM_APIKEY are loaded from secrets automatically.
350350

351351
# === Embeddings Configurations ===
352-
APP_EMBEDDINGS_SERVERURL: "nemoretriever-embedding-ms:8000/v1"
353-
APP_EMBEDDINGS_MODELNAME: "nvidia/llama-3.2-nv-embedqa-1b-v2"
352+
APP_EMBEDDINGS_SERVERURL: "nemotron-embedding-ms:8000/v1"
353+
APP_EMBEDDINGS_MODELNAME: "nvidia/llama-nemotron-embed-1b-v2"
354354
APP_EMBEDDINGS_DIMENSIONS: "2048"
355355

356356
# === NV-Ingest Configurations ===
@@ -716,10 +716,10 @@ nimOperator:
716716
enabled: true
717717
replicas: 1
718718
service:
719-
name: "nemoretriever-embedding-ms"
719+
name: "nemotron-embedding-ms"
720720
image:
721-
repository: nvcr.io/nim/nvidia/llama-3.2-nv-embedqa-1b-v2
722-
tag: "1.10.1"
721+
repository: nvcr.io/nvstaging/nim/llama-nemotron-embed-1b-v2
722+
tag: "1.12.0-rc.20260216115852-6fba925dcb63c190"
723723
pullPolicy: IfNotPresent
724724
resources:
725725
limits:
@@ -795,10 +795,10 @@ nimOperator:
795795
enabled: true
796796
replicas: 1
797797
service:
798-
name: "nemoretriever-ranking-ms"
798+
name: "nemotron-ranking-ms"
799799
image:
800-
repository: nvcr.io/nim/nvidia/llama-3.2-nv-rerankqa-1b-v2
801-
tag: "1.8.0"
800+
repository: nvcr.io/nvstaging/nim/llama-nemotron-rerank-1b-v2
801+
tag: "1.10.0-rc.20260219005237-7e2370934c6f9b9c"
802802
pullPolicy: IfNotPresent
803803
resources:
804804
limits:
@@ -870,7 +870,7 @@ nv-ingest:
870870
create: false
871871
image:
872872
repository: "nvcr.io/nvidia/nemo-microservices/nv-ingest"
873-
tag: "26.1.1"
873+
tag: "26.1.2"
874874
resources:
875875
limits:
876876
nvidia.com/gpu: 0
@@ -896,8 +896,8 @@ nv-ingest:
896896
RAY_num_server_call_thread: "1"
897897
RAY_worker_num_grpc_internal_threads: "1"
898898

899-
EMBEDDING_NIM_ENDPOINT: "http://nemoretriever-embedding-ms:8000/v1"
900-
EMBEDDING_NIM_MODEL_NAME: "nvidia/llama-3.2-nv-embedqa-1b-v2"
899+
EMBEDDING_NIM_ENDPOINT: "http://nemotron-embedding-ms:8000/v1"
900+
EMBEDDING_NIM_MODEL_NAME: "nvidia/llama-nemotron-embed-1b-v2"
901901
MESSAGE_CLIENT_HOST: "rag-redis-master"
902902
MESSAGE_CLIENT_PORT: 6379
903903
MESSAGE_CLIENT_TYPE: "redis"
@@ -1049,8 +1049,8 @@ nv-ingest:
10491049
tolerations: []
10501050
replicaCount: 1
10511051
image:
1052-
repository: nvcr.io/nim/nvidia/nemoretriever-graphic-elements-v1
1053-
tag: "1.6.0"
1052+
repository: nvcr.io/nvstaging/nim/nemotron-graphic-elements-v1
1053+
tag: "1.8.0-rc.20260218170144-35d5a3f270662864"
10541054
env:
10551055
- name: NIM_HTTP_API_PORT
10561056
value: "8000"
@@ -1082,8 +1082,8 @@ nv-ingest:
10821082
tolerations: []
10831083
replicaCount: 1
10841084
image:
1085-
repository: nvcr.io/nim/nvidia/nemoretriever-page-elements-v3
1086-
tag: "1.7.0"
1085+
repository: nvcr.io/nvstaging/nim/nemotron-page-elements-v3
1086+
tag: "1.8.0-rc.20260218170155-6b1b2aa9dfefc9c3"
10871087
env:
10881088
- name: NIM_HTTP_API_PORT
10891089
value: "8000"
@@ -1133,8 +1133,8 @@ nv-ingest:
11331133
tolerations: []
11341134
replicaCount: 1
11351135
image:
1136-
repository: nvcr.io/nim/nvidia/nemoretriever-table-structure-v1
1137-
tag: "1.6.0"
1136+
repository: nvcr.io/nvstaging/nim/nemotron-table-structure-v1
1137+
tag: "1.8.0-rc.20260218170204-cca5cb850146dbbc"
11381138
env:
11391139
- name: NIM_HTTP_API_PORT
11401140
value: "8000"

‎deploy/workbench/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -75,4 +75,4 @@ Use of the models in this blueprint is governed by the [NVIDIA AI Foundation Mod
7575
## Terms of Use
7676
This blueprint is governed by the [NVIDIA Agreements | Enterprise Software | NVIDIA Software License Agreement](https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/) and the [NVIDIA Agreements | Enterprise Software | Product Specific Terms for AI Product](https://www.nvidia.com/en-us/agreements/enterprise-software/product-specific-terms-for-ai-products/). The models are governed by the [NVIDIA Agreements | Enterprise Software | NVIDIA Community Model License](https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-community-models-license/) and the [NVIDIA RAG dataset](https://github.com/NVIDIA-AI-Blueprints/rag/tree/v2.0.0/data/multimodal) which is governed by the [NVIDIA Asset License Agreement](https://github.com/NVIDIA-AI-Blueprints/rag/blob/main/data/LICENSE.DATA).
7777

78-
The following models that are built with Llama are governed by the [Llama 3.2 Community License Agreement](https://www.llama.com/llama3_2/license/): nvidia/llama-3.3-nemotron-super-49b-v1, nvidia/llama-3.2-nv-embedqa-1b-v2, and nvidia/llama-3.2-nv-rerankqa-1b-v2.
78+
The following models that are built with Llama are governed by the [Llama 3.2 Community License Agreement](https://www.llama.com/llama3_2/license/): nvidia/llama-3.3-nemotron-super-49b-v1, nvidia/llama-nemotron-embed-1b-v2, and nvidia/llama-nemotron-rerank-1b-v2.

0 commit comments

Comments
 (0)