cannot restore session correctly.

[luuckiest]

Hello:

I have saved the session and I am trying to restore it. However, I think the reply buffer is referenced before it is defined.

Thanks

[VanillaWhey]

I have the same issue. I've trained the agent for 500,000 steps but can't load it, so I firstly cannot confirm that the agent learned anything, nor can I use the stored session for anything else.

[marctuscher]

Hi,

I uploaded a pretrained model to pretrained_models. I didn't test this model since 2018 and I unfortunately don't have the time to take I closer look at this error.

If you are able to fix the error, I'd love to merge a Pull Request containing the fix.

[marctuscher]

Still uploading... 😅