Model Provider Integration Request

Foundry-Local is Microsoft's take on an Ollama-styled local model execution. It would be interesting to support another form of running local models.

They also have a specific rust sdk that we can hook into, thought it looks like it's just a http wrapper on localhost urls which we could do the same.

Resources

• https://learn.microsoft.com/en-us/azure/ai-foundry/foundry-local/
• I also have talked with the PM on this project so can get direct support if needed.