[Bug]: Persistent cache cause panic when running Rsbuild E2E cases

[chenjiahan]

System Info

Rspack v1.2.2

Details

Persistemt cache panics:

Reproduce link

web-infra-dev/rsbuild#4508

Reproduce Steps

Steps:

1. pnpm i
2. pnpm e2e:rspack (cold build)
3. pnpm e2e:rspack (hot build)

[chenjiahan]

All panic has been fixed