-
-
Notifications
You must be signed in to change notification settings - Fork 7.1k
Open
Labels
✨ enhancementNew feature or requestNew feature or request
Description
What features would you like to see added?
Return a pre-signed URL instead of proxying file content (seen in File Citation). The client would then download directly from S3/CloudFront.
Benefits:
- Reduced API server bandwidth and CPU/memory usage
- Leverage CDN edge caching (CloudFront) when the feature comes to Librechat
- Faster downloads (direct connection)
More details
Currently, file downloads for citations (S3/CloudFront) are proxied through the LibreChat API server:
- Client requests file download from LibreChat API
- API fetches file content from S3/CloudFront (
GetObjectCommand) - API pipes the stream back to client
This adds unnecessary load on the API server, especially for large files or high traffic.
Which components are impacted by your request?
Endpoints, General
Pictures
No response
Code of Conduct
- I agree to follow this project's Code of Conduct
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
✨ enhancementNew feature or requestNew feature or request