Feature request: Openai APIs

[andrea-tomassi]

Adding an http server with openai compliant /v1/chat/completion endpoin would unlock tons of scenarios.

[shubham0204]

I was planning to implement this feature, also started working on it in #56

• Android does not allow apps to listen on a specific port when they are not running. When the app is in foreground, the server works correctly by responding to incoming requests. When the app is in background, it remains alive for some time, during which the server works, but after that time period, the OS kills the app process thus killing the server.

• Also, where should we have this 'Start a Server' feature? I wanted to add 'Start a Server' in the 'Chat Options' which would host the model (taking the settings from that chat) with the server.

[rons4]

I like this feature. It would allow third-party apps like Tasker or OpenClaw to access the local models running on Android.
I think there is an option for letting the HTTP server run in the background. Tasker does this for example. I think there are some background and battery optimization settings for an app.
As for the "Start Server", that might in in the settings or a separate menu option.