0.9.4.1 Release

A lot of work on the backend-handling side (especially llama.cpp), added dll plugin support for tools and tasks, and many bug fixes.

General Improvements

• Added runtime plugin DLL support for agentic tasks and actions
• Massively simplified image logic: only need to have an image path in submitted SingleMessage for images to be processed
• Images are now collected from user messages during prompt construction, encoded, resized by new ImageResolution settings
• Code safety and optimization pass

Tool-calling Support

• Toolsets can be toggled on and off individually
• Added setting to always manually confirm tool calls independently of toolsets' directives
• Toolsets can be loaded from external DLL files
• Can set limit of max Tool call chains remembered in prompt to save tokens.

Backends

• Backend adapters/clients can handle both text and chat completion modes (user gets to select)
• Added DefaultCompletionType to Settings to set default mode. Can also be set in LLMEngine.Setup()
• Added text completion mode to Llama.cpp backend, so it can handle absolutely all use cases
• Llama.cpp backend can properly toggle thinking mode on and off

Libraries

• OpenAI-DotNet has been integrated into Lethe's code directly: the library couldn't be extended, so it had to be assimilated

Fixed

• Tool calls were not accurately logged in chatlogs
• Sampling settings not applied to all logic paths in the llama.cpp backend
• TextPromptBuilder would still process images even if vision is not supported
• Fixed remaining issues with initial prefill / token emission
• Fixed last remaining streaming issue in tool calling mode

Full Changelog: 0.9.2...0.9.4.1