feat: add MinIO file storage service with upload and download capabilities by sd0ric4 · Pull Request #11 · labring/fastgpt-plugin

sd0ric4 · 2025-06-24T14:01:34Z

Updated package.json to include MinIO and UUID dependencies.
Created config.ts for file storage configuration, including max file size, retention days, and MinIO credentials.
Implemented service.ts to handle file uploads, downloads, and metadata management using MinIO.
Added upload.ts to support various file input types (network, local, base64, buffer) for uploading files.
Introduced Zod schemas for input validation and structured response handling.
Implemented logging for connection tests, bucket initialization, and error handling.

…ities - Updated package.json to include MinIO and UUID dependencies. - Created config.ts for file storage configuration, including max file size, retention days, and MinIO credentials. - Implemented service.ts to handle file uploads, downloads, and metadata management using MinIO. - Added upload.ts to support various file input types (network, local, base64, buffer) for uploading files. - Introduced Zod schemas for input validation and structured response handling. - Implemented logging for connection tests, bucket initialization, and error handling.

packages/file/upload.ts

packages/file/service.ts

packages/file/config.ts

packages/file/upload.ts

- Removed legacy upload.ts file and migrated its logic to a new S3-based implementation. - Introduced new configuration and controller files for S3 integration. - Implemented file upload service with support for multiple input types (network, local, base64, buffer). - Added validation schemas using Zod for input and output. - Created worker support for file service initialization and upload handling. - Enhanced logging for better traceability during file operations.

src/s3/worker.ts

src/s3/controller.ts

c121914yu · 2025-06-25T10:40:30Z

src/s3/controller.ts

+    await this.ensureInitialized();
+
+    if (fileBuffer.length > this.config.maxFileSize) {
+      throw new Error(`File size ${fileBuffer.length} exceeds limit ${this.config.maxFileSize}`);


return Promise.reject

c121914yu · 2025-06-25T10:43:38Z

src/s3/controller.ts

+        fileBuffer,
+        fileBuffer.length,
+        {
+          'Content-Type': 'application/octet-stream', // 强制下载，不预览


这个会导致覆盖原来的 content type 么

好像有 attachment 就好了吧

c121914yu · 2025-06-25T10:45:18Z

src/s3/controller.ts

+
+      const metadata = await this.uploadFile(buffer, filename);
+      const inputType = validatedInput.url
+        ? 'network'


去掉去掉，这些log 都啥用呢

还不如每个 function 里 log 呢

src/s3/controller.ts

c121914yu · 2025-06-25T10:59:42Z

src/s3/controller.ts

+      }
+      await this.setBucketDownloadOnly();
+    } catch (error) {
+      addLog.error('Failed to initialize bucket:', error);


addlog.error(xxx,error)

c121914yu · 2025-06-25T11:00:47Z

src/s3/controller.ts

+      addLog.error('Failed to initialize bucket:', error);
+      if (error instanceof Error && error.message.includes('Method Not Allowed')) {
+        addLog.warn('Method Not Allowed - bucket may exist with different permissions');
+        return;


c121914yu · 2025-06-25T11:01:30Z

src/s3/controller.ts

+// ================================
+
+// 创建默认的文件服务实例
+export const fileService = new FileService();


全局存一个实例。
worker 里传实例进去看能不能用

系统初始化就增加 minio 实例化流程：
const file = new Fileserver()
await file.initBucket()

抽个 init.ts。

src/s3/config.ts

pull-request-size bot added the size/XL label Jun 24, 2025

Merge remote-tracking branch 'origin/main' into s3

0935b6c