Skip to content

Ovis 2 5 #2010

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 16 commits into
base: spalne/ovis2.5_integ
Choose a base branch
from
Open

Ovis 2 5 #2010

wants to merge 16 commits into from

Conversation

SupreetSinghPalne
Copy link

@SupreetSinghPalne SupreetSinghPalne commented Oct 9, 2025 •
edited by github-actions bot
Loading

Essential Elements of an Effective PR Description Checklist

  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results

Purpose

Test Plan

Test Result

Chris-Sigopt and others added 16 commits August 22, 2025 11:52
@Chris-Sigopt
Initial import of ovis_2_5 work
271086d
@Chris-Sigopt
Remove rocm backend
0cd6eac
@Chris-Sigopt
remove tok_kwargs
778a41f 
Fix the error for cpu fallback
@Chris-Sigopt
Clean up code, add tests
416045a 
Change ovis min/max prompt bucket
@Chris-Sigopt
Merge branch 'habana_main' into ovis_2_5
73f7094
@Chris-Sigopt
Fix precommit
f64bd9c
@Chris-Sigopt
Merge branch 'ovis_2_5' of https://github.com/Chris-Sigopt/vllm-fork …
8fc5041 
…into ovis_2_5
@Chris-Sigopt
Update pre-commit
b45ba98
@Chris-Sigopt
Update pre-commit
a95fdbe
@Chris-Sigopt
Update pre-commit
c4ef4b6
@Chris-Sigopt
Fix up vision test
e806a32
@Chris-Sigopt
Mark that model is not loaded yet explicitly
2dfb33a
@Chris-Sigopt
Update path to model on weka for CI
bdd6f7c
@SupreetSinghPalne
Fixes HPU graph run for Gemma3 vision inputs (HabanaAI#1865)
36eb2cf 
Fixes HPU graph issues for gemma3 vision inputs

Text warmup to include attn_mask info, so vision+text data can reuse the
graph for language model that's warmed up already.
Changing slicing to index_select for multimodal bucketing for HPU.
Slicing doesn't produce the same hash for the HPU graph with same input
shape.
Use buckets for the vision tower as well to reduce GC recompile
Accuracy bug fix by clone output data of the multimodal-projector.
Validated with Muirbench datasets.
@afierka-intel
Update common.txt (HabanaAI#1956)
ee517a2 
Add missing modelscope package - `VLLM_USE_MODELSCOPE` env doesn't work
without it.
@libinta
Merge branch 'habana_main' into ovis_2_5
c4888b9
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@kzawora-intel kzawora-intel Awaiting requested review from kzawora-intel kzawora-intel is a code owner

@madamczyk-intel madamczyk-intel Awaiting requested review from madamczyk-intel madamczyk-intel is a code owner

@michalkuligowski michalkuligowski Awaiting requested review from michalkuligowski michalkuligowski is a code owner

@mgawarkiewicz-intel mgawarkiewicz-intel Awaiting requested review from mgawarkiewicz-intel mgawarkiewicz-intel is a code owner

@vivekgoe vivekgoe Awaiting requested review from vivekgoe vivekgoe is a code owner

@afierka-intel afierka-intel Awaiting requested review from afierka-intel afierka-intel is a code owner

@xuechendi xuechendi Awaiting requested review from xuechendi xuechendi is a code owner

@jikunshang jikunshang Awaiting requested review from jikunshang jikunshang is a code owner

@mswiniarsk mswiniarsk Awaiting requested review from mswiniarsk mswiniarsk is a code owner

@PatrykWo PatrykWo Awaiting requested review from PatrykWo PatrykWo is a code owner

@wpyszka wpyszka Awaiting requested review from wpyszka wpyszka is a code owner

@deepvars deepvars Awaiting requested review from deepvars deepvars is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@SupreetSinghPalne @Chris-Sigopt @afierka-intel @libinta