Error compiling: splintr::from_pretrained and splintr::eos_token_id_by_name doesn't exist.

[hndrbrm]

When i compile cargo build --release theres error:

error[E0425]: cannot find function `from_pretrained` in crate `splintr`
  --> src/tokenizer/mod.rs:71:30
   |
71 |         let inner = splintr::from_pretrained(name)
   |                              ^^^^^^^^^^^^^^^ not found in `splintr`

error[E0425]: cannot find function `eos_token_id_by_name` in crate `splintr`
  --> src/tokenizer/mod.rs:73:37
   |
73 |         let eos_token_id = splintr::eos_token_id_by_name(name);
   |

The problem lay on the splintr.
I think the implementation are not yet implemented 😁

I read theres some implementation on the python bindings.
I make a naive implementation based on that, and its seems worked.

Maybe you forgot to push the latest commit on splintr?

[farhan-syah]

Thats's true, this is not the updated blazr, I just share it first, in case someone is interested to look at the source code. I thought nobody will be interested in using it since it is still under development, and wasn't tested against normal LLM model yet. It is built only for oxidzr trained model. But I'll push the updated blazr soon, that will be able to run standard Huggingface model / GGUF etc.

I am still working on moving the engine part out of blazr and oxidzr, so blazr will be just the inference server layer. It will be easier to mantain in the future.