Creating a library out of this project

[fmatosqg]

I found this project is the best starting point to where I want to use LLMs inside my favourite Lemmy client. I'm keen to fork it and create a library out of this project, preferrably keeping the maven coordinates where appropriate.

I have a commit with a minimally working version on a draft PR from the forked repo to the forked repo: fmatosqg#1 . See rough outline of the steps on the file https://github.com/fmatosqg/SmolChat-Android-Lib/blob/7d71db71398f7e66d0be30571807afa9026651a7/Library_Conversion.md.

[fmatosqg]

Alright I'm starting my repo from scratch using the original sample Android app from llama.cpp: https://github.com/1opp0-org/llama.android

No animosity, I just hope to preserve your rights to your work.

Your project and forking it was a valuable way to learn and explore what is feasible technically.

[shubham0204]

@fmatosqg Just curious, why did you decide to start from scratch from the llama.android sample app, and not from the SmolLM module included in this project?

[fmatosqg]

I wanted to do major cleanup this week, and there could be 2 reasons for not having feedback from you - busy/didn't see msg, or you didn't approve of the plan. Both were blockers.

I plan to put it in jitpack somewhere this week with the code that is already in. After that I'd be keen to look at yours and llama s jni side of the code and understand it before I make more jni APIs. It would be cool to bring in yours, and even more cool to test jitpack lib consumed by your code as testing grounds.

Not to mention the hugging face module, sounds super useful for what I'm planning within a few months.