Skip to content

Commit 55cb441

Browse files
Preload HF base for owlv2 in modal
1 parent d7ab4dd commit 55cb441

File tree

1 file changed

+3
-0
lines changed
  • inference/core/interfaces/webrtc_worker

1 file changed

+3
-0
lines changed

inference/core/interfaces/webrtc_worker/modal.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -227,6 +227,9 @@ def send_answer(obj: WebRTCWorkerResult):
227227
def start(self):
228228
# TODO: pre-load models
229229
logger.info("Starting container")
230+
if PRELOAD_HF_IDS:
231+
# Kick off pre-loading of models (owlv2 preloading is based on module-level singleton)
232+
import inference.models.owlv2.owlv2
230233

231234
@modal.exit()
232235
def stop(self):

0 commit comments

Comments
 (0)