Tracking related fixes in other open-source projects

### TRL
* https://github.com/huggingface/trl/pull/3256: add Dr. GRPO loss, and also support different variants as discussed in https://x.com/zzlccc/status/1904907968417497202

### VeRL
* https://github.com/volcengine/verl/issues/742 
* https://github.com/volcengine/verl/pull/990