Feat/cheick/speculative sampling#424

Open

Bouscout wants to merge 2 commits intoanarchy-ai:mainfrom

Bouscout:feat/cheick/speculative_sampling

Commits on Dec 21, 2023

adding geneation_algorithm file with speculative sampling and injecting it in on_site_llm
Bouscout
committed
added an optional variable to baseOnSite_llm to get generation_aalgorithm parameters and implemented the generation in the complete method when conditions are met
Bouscout
committed