-
Couldn't load subscription status.
- Fork 291
Base LLM pipeline testing refactoring and optimization #2779
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Base LLM pipeline testing refactoring and optimization #2779
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ov_pipe should not be created inside the test if possible - it incurs significant overhead. You should pass initialized pipelines to the tests, not models_path.
Yes, in LLM pipeline tests it's done. I'm currently looking on how to make it work properly for LLL static pipeline. |
8c2c779 to
1f12a03
Compare
85d9db9 to
1e323b2
Compare
1e323b2 to
7820744
Compare
ab9bc74 to
6933c81
Compare
| from pathlib import Path | ||
| media_path = (Path(download_test_content) / media_file).as_posix() |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we make download_test_content to return a Path object? And/or move the import to the top?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can do it, but most use-cases for this fixture as a string parameter, so it'll just add more conversions.
ffd8269 to
c4bfe29
Compare
0a51896 to
af1ab81
Compare
84eaa49 to
e4da07a
Compare
9659639 to
0b7fca0
Compare
0b7fca0 to
3a08460
Compare
Description
Ticket:
Part of CVS-173285