Issues

• Discounted reward calculation in PPO.py breaks when trajectory reaches max_ep_len in train.py

  nikhilbarhate99/PPO-PyTorch#73 · Filter by author CaoAnda opened on Nov 5, 2025

• Environment setting about python version, gym and roboschool

  nikhilbarhate99/PPO-PyTorch#70 · Filter by author vickychen928 opened on Jun 5, 2024

• 为什么新的版本在k epochs更新时不重新计算advantages？

  nikhilbarhate99/PPO-PyTorch#68 · Filter by author 31CFDC30 opened on May 25, 2024

• (Solved) No env.reset() at the end of each training epoch.

  nikhilbarhate99/PPO-PyTorch#67 · Filter by author slDeng1003 opened on Mar 11, 2024
  2

• the version problem about gym and roboschool

  nikhilbarhate99/PPO-PyTorch#66 · Filter by author ShunZuo-AI opened on Feb 8, 2024
  2

• policy_old完全看不出作用

  nikhilbarhate99/PPO-PyTorch#65 · Filter by author haduoken opened on Jan 25, 2024
  6

• ValueError: expected sequence of length 8 at dim 1 (got 0)

  nikhilbarhate99/PPO-PyTorch#64 · Filter by author kavinwkp opened on Nov 11, 2023
  1

• question

  nikhilbarhate99/PPO-PyTorch#63 · Filter by author yinshuangshuang621671 opened on Jun 27, 2023
  1

• optimize the existing Chinese generation model

  nikhilbarhate99/PPO-PyTorch#62 · Filter by author ARES3366 opened on Apr 25, 2023

• Continuous action space should use Independent Normal instead of MultivariateNormal

  nikhilbarhate99/PPO-PyTorch#60 · Filter by author imathg opened on Nov 23, 2022
  1

• Test results are not good

  nikhilbarhate99/PPO-PyTorch#59 · Filter by author 295885025 opened on Oct 13, 2022
  1

• Would a shared network work ?

  nikhilbarhate99/PPO-PyTorch#58 · Filter by author Miguel-s-Amaral opened on Sep 11, 2022

• Setting Model to eval() mode in test.py

  nikhilbarhate99/PPO-PyTorch#57 · Filter by author rllyryan opened on Sep 8, 2022

• error

  nikhilbarhate99/PPO-PyTorch#56 · Filter by author deperado007 opened on Jun 30, 2022
  5

• Discounted Reward Calulcation (Generalized Advantage Estimation)

  help wantedquestion
  nikhilbarhate99/PPO-PyTorch#38 · Filter by author artest08 opened on Jan 4, 2021
  5