-
Notifications
You must be signed in to change notification settings - Fork 287
Base LLM pipeline testing refactoring and optimization #2779
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Base LLM pipeline testing refactoring and optimization #2779
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ov_pipe
should not be created inside the test if possible - it incurs significant overhead. You should pass initialized pipelines to the tests, not models_path
.
Yes, in LLM pipeline tests it's done. I'm currently looking on how to make it work properly for LLL static pipeline. |
8c2c779
to
1f12a03
Compare
85d9db9
to
1e323b2
Compare
1e323b2
to
7820744
Compare
ab9bc74
to
6933c81
Compare
from pathlib import Path | ||
media_path = (Path(download_test_content) / media_file).as_posix() |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we make download_test_content
to return a Path
object? And/or move the import to the top?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can do it, but most use-cases for this fixture as a string parameter, so it'll just add more conversions.
ffd8269
to
c4bfe29
Compare
2d04bc3
to
0a51896
Compare
0a51896
to
af1ab81
Compare
Description
Ticket:
Part of CVS-173285