Skip to content

[Transformers v5] ColBERTJinaRobertaModel #38737

@hmellor

Description

@hmellor

This is a sub-issue forming part of the work in #38379, please read the description of this issue before beginning to work on this one.

Which test is failing?

$ pytest tests/models/language/pooling/test_colbert.py::test_colbert_hf_comparison[jina]
...
AssertionError: Embedding mismatch for text 0

How to configure my environment?

It's very important that you install both vLLM and Transformers from source so that your test results reflect the current state of both libraries.

# Or your fork
git clone https://github.com/huggingface/transformers.git
git clone https://github.com/vllm-project/vllm.git

cd vllm
VLLM_USE_PRECOMPILED=1 uv pip install -e .
uv pip install -e ../transformers

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions