ray.rllib.utils.replay_buffers.replay_buffer.StorageUnit#

class ray.rllib.utils.replay_buffers.replay_buffer.StorageUnit(value)[source]#

Bases: Enum

Specifies how batches are structured in a ReplayBuffer.

timesteps: One buffer slot per timestep. sequences: One buffer slot per sequence. episodes: One buffer slot per episode. fragemts: One buffer slot per incoming batch.

DeveloperAPI: This API may change across minor Ray releases.

Attributes

TIMESTEPS

SEQUENCES

EPISODES

FRAGMENTS