Distributed Management of Fluctuating Energy Resources in Dynamic Networked Systems

Xiaotong Cheng, Ioannis Tsetis, Setareh Maghsudi

TL;DR

This paper introduces a new distributed framework for managing renewable energy sharing in smart grids where energy production is highly unpredictable. By modeling the problem as Bandit Convex Optimization (BCO), the researchers developed algorithms that optimize energy distribution without needing direct access to complex system gradients or compromising user privacy, achieving state-of-the-art performance in non-stationary (ever-changing) environments.

What Problem Does This Paper Address?

As we move toward greener power grids, we rely heavily on Distributed Energy Resources (DERs) like local solar panels and wind turbines. However, these sources are notoriously "fickle"—clouds block the sun and wind speeds drop without warning.

Existing management systems often struggle with three major hurdles:

  1. Uncertainty: Most traditional models assume we know exactly how much energy will be generated or needed in advance. In reality, these are moving targets.
  2. Information Gaps: In many real-world scenarios, we don't have a "map" (gradient) of how a small change in distribution will affect the whole system; we only see the final result (the "bandit" feedback).
  3. Privacy: Users often don't want to share their exact consumption or generation data with a central authority or even their neighbors.

The authors tackle the challenge of coordinating these "prosumers" (nodes that both produce and consume energy) to minimize waste and shortages while respecting local constraints and privacy.

Methods

The authors propose two primary algorithms:

  • Distributed Resource Sharing (DRS): This is a gradient-free approach. Instead of knowing the exact mathematical slope of the loss function, each node "probes" the environment by adding a small random perturbation to its actions. It uses a regularized Lagrangian function to handle the hard constraint that a node cannot give away more energy than it actually has.
  • Meta-Algorithm for Non-Stationary DRS (MA-NSDRS): Real-world environments are "non-stationary"—patterns change over seasons or even hours. This meta-algorithm maintains a "pool of experts," each running a DRS instance with a different learning rate. It then uses an exponentially weighted average to track and favor the expert performing best at any given moment.

A key innovation is the adjustment step. Standard optimization algorithms might suggest an action that is physically impossible (e.g., distributing 10kWh when you only have 5kWh). The authors include a projection step that ensures physical feasibility without ruining the algorithm's theoretical performance.

Datasets

The researchers validated their approach using a real-world dataset from the New York State (NYSERDA) DER facilities.

  • The data includes energy production records and geographical positions for various facilities in Staten Island.
  • Specifically, they focused on Solar Photovoltaic (PV) systems, simulating networks of 6 nodes (small scale) and 20 nodes (medium scale) to test scalability and efficiency.

Key Insights and Ideas

  • The "Bandit" Advantage: By using bandit feedback, the system only needs to know the "satisfaction level" of neighbors, not their private internal states. This naturally preserves privacy while still allowing for effective coordination.
  • Dynamic Regret vs. Static Regret: Most algorithms try to perform as well as the single best fixed strategy. This paper aims for dynamic regret, meaning the algorithm tries to keep up with the best changing strategy, which is much more realistic for weather-dependent energy.
  • The Feasibility Trade-off: There is a fascinating trade-off between theoretical "regret" (how much better you could have done) and "constraint violation" (breaking the rules of physics). The authors show that while their "adjustment step" slightly increases regret, it is essential for ensuring the grid doesn't collapse from over-promising energy.

Key Results

  • Theoretical Efficiency: The proposed algorithms achieve a dynamic regret bound of $\tilde{O}(T^{3/4})$, which is a strong theoretical guarantee for how quickly the algorithm learns in a changing environment.
  • Superior Performance: In simulations, MA-NSDRS significantly outperformed BanSaP (a state-of-the-art benchmark for IoT task allocation). It achieved lower cumulative loss and faster convergence.
  • Waste Reduction: The algorithm successfully reallocated energy from surplus nodes (like nodes 6, 11, and 14 in their 20-node test) to shortage nodes, even when those nodes weren't directly connected, effectively optimizing the entire network's efficiency.

Limitations and Future Work

The authors identify a few areas where the model could be expanded:

  • Scalability: The Meta-Algorithm (MA-NSDRS) has a computational complexity of $O(T^2)$, which might become a bottleneck for extremely large networks or very long time horizons.
  • Network Physics: The current model assumes a simplified "undirected graph" for energy transfer. Future work could incorporate more complex power flow models that account for voltage drops and line impedance.
  • Correlated Generation: Currently, the model assumes each node's generation is independent. In reality, if it's cloudy for one solar panel, it's likely cloudy for its neighbor. Accounting for these correlations could lead to even smarter distribution strategies.

Summary updated

Abstract

Modern power systems integrate renewable distributed energy resources (DERs) as an environment-friendly enhancement to meet the ever-increasing demands. However, the inherent unreliability of renewable energy renders developing DER management algorithms imperative. We study the energy-sharing problem in a system consisting of several DERs. Each agent harvests and distributes renewable energy in its neighborhood to optimize the network's performance while minimizing energy waste. We model this problem as a bandit convex optimization problem with constraints that correspond to each node's limitations for energy production. We propose distributed decision-making policies to solve the formulated problem, where we utilize the notion of dynamic regret as the performance metric. We also include an adjustment strategy in our developed algorithm to reduce the constraint violations. Besides, we design a policy that deals with the non-stationary environment. Theoretical analysis shows the effectiveness of our proposed algorithm. Numerical experiments using a real-world dataset show superior performance of our proposal compared to state-of-the-art methods.
BibTeX
@article{cheng2025distributed,
  author = {Xiaotong Cheng and Ioannis Tsetis and Setareh Maghsudi},
  title = {{Distributed Management of Fluctuating Energy Resources in Dynamic Networked Systems}},
  journal = {IEEE Trans. Network Science \& Engineering},
  year = {2025},
  url = {https://openreview.net/forum?id=kuRxQCvchJ},
}

Loading related content...

Figure