openrl.algorithms package

Submodules

openrl.algorithms.base_algorithm module

class openrl.algorithms.base_algorithm.BaseAlgorithm(cfg, init_module, agent_num: int, device=device(type='cpu'))

基类：abc.ABC

prep_rollout()

prep_training()

abstract train(buffer, turn_on=True)

openrl.algorithms.ppo module

class openrl.algorithms.ppo.PPOAlgorithm(cfg, init_module, agent_num: int = 1, device: Union[str, torch.device] = 'cpu')

基类：openrl.algorithms.base_algorithm.BaseAlgorithm

cal_value_loss(value_normalizer, values, value_preds_batch, return_batch, active_masks_batch)

ppo_update(sample, turn_on=True)

prepare_loss(critic_obs_batch, obs_batch, rnn_states_batch, rnn_states_critic_batch, actions_batch, masks_batch, available_actions_batch, old_action_log_probs_batch, adv_targ, value_preds_batch, return_batch, active_masks_batch, turn_on)

to_single_np(input)

train(buffer, turn_on=True)

Module contents