Skip to content

Pull requests: pytorch/rl

New pull request New
101 Open 3,190 Closed
101 Open 3,190 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Algorithm] Add backend-neutral MicroDuck task and notebook ci/optdeps Run the full tests-optdeps suite on this PR CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Environments Adds or modifies an environment wrapper Examples new algo New algorithm request or PR
#4191 opened Aug 31, 2026 by vmoens Collaborator Loading…
1
[Feature] Add DreamerV3MLPConfig CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature Integrations/torch_geometric Integrations Modules Trainers
#4187 opened Aug 29, 2026 by bsprenger Contributor Loading…
4 of 6 tasks
1
3
[Algorithm] Add MicroDuck PPO MJLab example ci/optdeps Run the full tests-optdeps suite on this PR CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Examples new algo New algorithm request or PR
#4183 opened Aug 28, 2026 by vmoens Collaborator Loading…
1
[Feature] Support fragmented trajectory slices Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Feature New feature ReplayBuffers Trainers
#4180 opened Aug 28, 2026 by vmoens Collaborator Loading…
2
[Doc] Add end-to-end tutorial for TRL reward model interoperability CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation tutorials/
#4161 opened Aug 26, 2026 by coder-jayp Contributor Loading…
4 of 6 tasks
1
9
[CI] Retry flaky-test artifact downloads CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#4153 opened Aug 24, 2026 by CoffeeDrivenCoder Loading…
3 tasks done
1
7
[Feature] Add COMA multi-agent objective CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature Objectives sota-implementations/ tutorials/
#4151 opened Aug 24, 2026 by Iliamsou Loading…
8
[Deprecation] Make DreamerV3 defaults canonical Benchmarks rl/benchmark changes CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Deprecation Documentation Improvements or additions to documentation Integrations/torch_geometric Integrations Modules Objectives sota-implementations/
#4134 opened Aug 20, 2026 by vmoens Collaborator • Draft
5
[Performance] Improve geometric window sampling Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Performance Performance issue or suggestion for improvement ReplayBuffers
#4131 opened Aug 19, 2026 by theap06 Contributor Loading…
3
[Feature] Add geometric trajectory window sampler Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Examples Feature New feature ReplayBuffers
#4130 opened Aug 19, 2026 by vmoens Collaborator • Draft
2
[Feature] Add FixedBatchedInference helper (AsyncEnvPool v2 item 3) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature tutorials/ user-facing User-facing changes - only include in major releases
#4110 opened Aug 15, 2026 by coder-jayp Contributor Loading…
5 of 6 tasks
21
[Feature] WS1: Add stable component boundary Protocols for external-l… CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests tutorials/ user-facing User-facing changes - only include in major releases
#4103 opened Aug 13, 2026 by coder-jayp Contributor Loading…
7 tasks done
1
15
[Feature] Wire value transforms into actor-critic losses Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature Integrations/torch_geometric Integrations Modules Objectives Trainers user-facing User-facing changes - only include in major releases
#4100 opened Aug 13, 2026 by vmoens Collaborator Loading…
2
Bump torch from 2.12.0 to 2.13.0 in /sota-implementations/expert-iteration CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Dependencies Pull requests that update a dependency file python Pull requests that update python code sota-implementations/
#4037 opened Jul 17, 2026 by dependabot Bot Loading…
5
[Test] Add off-policy data-parallel learning suite CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. sota-implementations/ Tests Incomplete or broken unit tests Trainers
#4026 opened Jul 16, 2026 by vmoens Collaborator • Draft
2
[Feature] Add reliable VLA-GRPO LIBERO recipe CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Feature New feature llm/ LLM-related PR, triggers LLM CI tests Objectives sota-implementations/ Transforms
#4024 opened Jul 16, 2026 by vmoens Collaborator • Draft
2
[Feature] Add flat replay writes to collectors Benchmarks rl/benchmark changes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Documentation Improvements or additions to documentation Feature New feature Integrations/torch_geometric Integrations Trainers
#4020 opened Jul 16, 2026 by vmoens Collaborator Loading…
1
[BugFix] Bound direct off-policy replay collection BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Integrations/torch_geometric Integrations ReplayBuffers Trainers
#4018 opened Jul 16, 2026 by vmoens Collaborator Loading…
1
[LLM] WS4 Post-Training Observability: Implement PostTrainingLogger CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation llm/ LLM-related PR, triggers LLM CI tests Objectives Record sota-implementations/
#3950 opened Jul 7, 2026 by coder-jayp Contributor Loading…
7 of 8 tasks
1
15
[Feature] Add Learner primitive (LocalLearner, FSDP2Learner) ci/olddeps Run the tests-olddeps suite (oldest supported torch) on this PR CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Documentation Improvements or additions to documentation Feature New feature Integrations/torch_geometric Integrations llm/ LLM-related PR, triggers LLM CI tests sota-implementations/ Trainers user-facing User-facing changes - only include in major releases
#3926 opened Jul 2, 2026 by theap06 Contributor Loading…
12
[Algorithm] Add RLHF reward-model training recipe CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Integrations/torch_geometric Integrations llm/ LLM-related PR, triggers LLM CI tests Modules new algo New algorithm request or PR Objectives sota-implementations/ user-facing User-facing changes - only include in major releases
#3923 opened Jun 30, 2026 by theap06 Contributor Loading…
17
[Feature] Add RewardModelLoss objective for RLHF reward-model training CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Documentation Improvements or additions to documentation Feature New feature llm/ LLM-related PR, triggers LLM CI tests Objectives user-facing User-facing changes - only include in major releases
#3922 opened Jun 30, 2026 by theap06 Contributor Loading…
9
[Feature] Tensorclass support for IQLLoss CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Feature New feature Objectives
#3864 opened Jun 13, 2026 by aehebald Loading…
4 of 6 tasks
5
[BugFix] Set "next" obs to current if native_autoreset BugFix CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments/gym Environments Adds or modifies an environment wrapper Transforms
#3786 opened May 21, 2026 by lin-erica Contributor Loading…
3 of 10 tasks
3
[Feature] Collector final_obs: store true boundary next-obs for shifted-GAE CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Collectors Feature New feature Integrations/torch_geometric Integrations Objectives ReplayBuffers
#3758 opened May 15, 2026 by vmoens Collaborator Loading…
3
ProTip! Type g i on any issue or pull request to go back to the issue listing page.