Skip to content

Latest commit

 

History

1 Commit

Folders and files

NameName
Last commit message
Last commit date
 
 

Repository files navigation

Cornfigurator: Automatic Deployment Planning for Multimodal AI

Cornserve Paper


Cornfigurator is a deployment planner for generic Any-to-Any model inference serving. Given a model and workload, it explores the full spectrum of deployment strategies — from colocation to disaggregation and mixes of the two — and uses coarse-to-fine statistical evaluation to navigate the large plan space efficiently.

The current c11r planner works directly with Cornserve as its profiling and execution backend, and upcoming work will add support for vLLM-Omni and SGLang-Omni.

Status

Source code is still under construction and will be released here soon.


For the full design and evaluation, see our paper: "Cornfigurator: Automated Planning for Any-to-Any Multimodal Model Serving".

About

Automatic Deployment Planning for Multimodal AI

Resources

Stars

4 stars

Watchers

2 watching

Forks

Releases

Packages

Contributors