docs(cli): use hosted VL embed model in hosted NIM examples (NVBug 6657245) - #2610
Draft
kheiss-uwzoo wants to merge 1 commit into
Draft
docs(cli): use hosted VL embed model in hosted NIM examples (NVBug 6657245)#2610kheiss-uwzoo wants to merge 1 commit into
kheiss-uwzoo wants to merge 1 commit into
Conversation
…57245) The text embed-1b-v2 model now returns HTTP 410 on integrate.api.nvidia.com. Point the hosted ingest and rerank examples at llama-nemotron-embed-vl-1b-v2 so the section is runnable.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
nvidia/llama-nemotron-embed-1b-v2now returns HTTP 410 onintegrate.api.nvidia.com(EOL 2026-08-25), so the hosted ingest example fails before the rerank example can run.--embed-model-nametonvidia/llama-nemotron-embed-vl-1b-v2in the hosted ingest and rerank examples only. Leave local Hugging Face checkpoint mentions unchanged.Fixes the remaining runnable-example gap on NVBug 6657245.
Test plan
nemo_retriever/docs/cli/README.md(2 token replacements)nvidia/llama-nemotron-embed-vl-1b-v2llama-nemotron-embed-1b-v2are unchangedNVIDIA_API_KEYpre-draft: leakage, mkdocs --strict, ::a, ::p, ::r on the diff vs main
Base: upstream/main (
afbddc61)Files: nemo_retriever/docs/cli/README.md
see [CTAs)VL_EMBED_MODELand the Default NVCF endpoints tableCode drift (not in this docs PR):
operators/rerank.py:207still namesinference-api.nvidia.comin a docstring. QA marked that optional and not a closure blocker.PR: this draft (follow-up to #2576)