Skip to main navigation Skip to search Skip to main content

PowerGridworld: A Framework for Multi-Agent Reinforcement Learning in Power Systems [SWR-22-07]

Research output: Non-textual form › Software

Abstract

NREL's PowerGridworld provides a modular simulation environment for training heterogenous, grid-aware, multi-agent reinforcement learning (RL) policies at scale. The package enables the user to create component gym environments that can be composed into more complex agents. For example, a grid interactive building environment can be created by composing together component environments each encapsulating the building, PV, and battery physics. These multi-component environments can then be combined into multi-agent simulation where each agent's power consumption/injection becomes an input for solving the optimal power flow on a distribution feeder modeled in OpenDSS. Information from OpenDSS, such as bus voltages and line flows, can be included in the agents' observation spaces to enable grid-aware rewards. The default API for the PowerGridworld simulator conforms to RLLib's MultiAgent API and thus enables distributed training using HPC and cloud resources.
Original languageAmerican English
PublisherNational Laboratory of the Rockies (NLR)
DOIs
StatePublished - 2021

Other Report Number

  • SWR-22-07
  • 66827

License

  • BSD 3-clause "New" or "Revised" License

Fingerprint

Dive into the research topics of 'PowerGridworld: A Framework for Multi-Agent Reinforcement Learning in Power Systems [SWR-22-07]'. Together they form a unique fingerprint.

Cite this