Traditionally, energy storage assets like batteries or flexible building loads have been viewed through a single lens: either they shift energy to save money (arbitrage) or they help stabilize the grid (ancillary services). However, a growing body of research suggests that the true value of these assets is unlocked only when they participate in both markets simultaneously.
By treating distributed energy resources (DERs) as "virtual batteries" and using sophisticated optimization to bid into multiple markets at once, operators can achieve a synergy where the total profit exceeds the sum of individual market returns.
The Synergy of Dual Market Participation
The core intuition behind joint bidding is that energy arbitrage and frequency regulation have complementary physical requirements. Energy arbitrage involves buying low and selling high over several hours, which significantly changes a battery's State-of-Charge (SoC). Frequency regulation, conversely, requires rapid, short-duration injections or withdrawals of power to keep the grid at 60Hz (or 50Hz).
Muhammad Tuoqeer Anwar, Changlong Wang, and colleagues demonstrate in Proximal Policy Optimization Based Reinforcement Learning for Joint Bidding in Energy and Frequency Regulation Markets that this isn't just a marginal improvement. Using Deep Reinforcement Learning, they show that a single battery state can be strategically managed to satisfy multiple grid requirements, creating a "synergistic effect" where the combined revenue is greater than if the asset were dedicated to just one task.
Arbitrage as a Maintenance Tool
One of the most counterintuitive findings in this field is that the energy market can serve as a secondary objective to support the primary, high-value regulation market.
In Optimal operation strategy for distributed battery aggregator providing energy and ancillary services, Kangning Liu and Chongqing Kang explain that frequency regulation is often more lucrative but requires the battery to stay within a specific SoC range to remain "ready." An aggregator might actually accept a nominal loss in the day-ahead energy market simply to move the battery's charge level to an optimal starting point for the next day's regulation services. In this framing, arbitrage is the "steering wheel" that keeps the battery in the "sweet spot" where it can provide the most valuable stability services.
Expanding the Definition of a Battery
This logic extends far beyond lithium-ion packs. Any system with inherent flexibility can be modeled as a "virtual battery."
- Residential Heating: Lars Herre and Lennart Söder show in A bottom-up quantification of flexibility potential from the thermal energy storage in electric space heating that the thermal inertia of millions of homes can act as a massive aggregate storage resource. By shifting when heaters turn on, these buildings can provide gigawatts of peak flexibility while simultaneously lowering consumer costs through multi-market participation.
- Data Centers: Even digital workloads can be shifted. Monireh Mohebbi Moghaddam and Walid Saad explore how cloud providers can coordinate workload management with grid pricing in On Coordination of Smart Grid and Cooperative Cloud Providers. This coordination creates a non-zero-sum game where both the grid and the provider increase profits by nearly 30%.
Navigating Uncertainty with Advanced Modeling
The challenge of joint bidding lies in the complexity of the decision-making. An operator must predict energy prices, frequency deviation events, and consumer behavior all at once.
To handle this, researchers like Chatum Sankalpa and Maria Vrakopoulou emphasize "context-aware" stochastic modeling. As detailed in Context-Aware Stochastic Modeling of Consumer Energy Resource Aggregators in Electricity Markets, these models allow Virtual Power Plants (VPPs) to navigate the trade-offs between different markets under uncertainty. Whether using Proximal Policy Optimization (PPO) or game-theoretic frameworks, the goal remains the same: maximizing the utility of limited storage capacity by being everywhere in the market at once.