scispace - formally typeset
Search or ask a question
Journal ArticleDOI

A Battery Energy Management Strategy for U.K. Enhanced Frequency Response and Triad Avoidance

22 Mar 2018-IEEE Transactions on Industrial Electronics (IEEE)-Vol. 65, Iss: 12, pp 9509-9517
TL;DR: This paper describes a control algorithm to deliver a charge/discharge power output in response to changes in the grid frequency constrained by the National Grid Electricity Transmission while managing the state of charge of the BESS to optimize the availability of the system.
Abstract: This paper describes a control algorithm for a battery energy storage system (BESS) to deliver a charge/discharge power output in response to changes in the grid frequency constrained by the National Grid Electricity Transmission (NGET)—the primary electricity transmission network operator in the U.K.—while managing the state of charge of the BESS to optimize the availability of the system. Furthermore, this paper investigates using the BESS in order to maximize triad avoidance benefit revenues while layering other services. Simulation using a 2 MW/1 MWh lithium–titanate BESS validated model is carried out to explore possible scenarios using the proposed algorithms. Finally, experimental results of the 2 MW/1 MWh Willenhall Energy Storage System verify the performance of the proposed algorithms.

Summary (1 min read)

Introduction

  • Battery energy storage; enhanced frequency response; frequency stability; grid support; lithium-titanate; triad avoidance; Willenhall energy storage.
  • BESSs using various battery chemistries are installed around the world for grid support [4].
  • Maintaining the grid at a nominal frequency (i.e. 50 Hz for the UK) requires the management of many disparate generation sources against varying loads.
  • In Section III, three different EFR service models are developed to evaluate control strategies for delivering a real-time response to deviations in the grid frequency.
  • Finally, the change in power output per time step (1 second) for each zone is determined using the given ramp-rate limits given in [4].

A. Simulation results of EFR Model-1

  • In order to show the performance of the reported EFR algorithm in Section III, the real grid frequency data for the 21st of October of 2015 [23] is employed herein, as this particular day is known to have a large period of under frequency.
  • Calculated power dictated by EFR specification, also known as *CPower.
  • Because of the SOC reaching 0% and therefore there is no power available for delivery to the grid.
  • This non-conformance would cause a penalty in the SPM and hence it is necessary to improve the EFR control algorithm to minimise such occurrences.

A. Simulation Results of EFR Model-2

  • Model-2 introduces the extended grid frequency event timer and cuts the EFR power output after 15 minutes (Fig. 3).
  • The same frequency data is injected into Model-2 capturing 13 15- minute extended frequency events (Fig. 5(d)).
  • Therefore, the BESS is 100% available for providing power according to the EFR specification.

B. Simulation Results for EFR Model-3

  • The EFR algorithm implemented in Model-3 allows for the charge/discharge of the battery during the 30-minute rest period (Fig. 3).
  • The model is simulated with the 21st October 2015 grid frequency data [23] as shown in Fig.
  • This is a substantial achievement in terms of maximising the utilisation of the BESS stored energy.

C. Results Analysis

  • It was shown that, for the historical dataset considered, the basic EFR algorithm, Model-1, would not be able to manage the extended 15-minute grid frequency events, thus, causing the battery’s SOC to drop to 0%, which would incur a service performance penalty charge.
  • T. Feehally et al., "Battery energy storage systems for the electricity grid: UK research facilities," in IET Int. Conf. Power Electron., Mach.
  • He is a Senior Lecturer in the Department of Electrical and Electronic Engineering, the University of Sheffield, with particular interest for research into energy storage and management, power electronics, and intelligent systems.

Did you find this useful? Give us your feedback

Content maybe subject to copyright    Report

This is a repository copy of A Battery Energy Management Strategy for UK Enhanced
Frequency Response and Triad Avoidance.
White Rose Research Online URL for this paper:
http://eprints.whiterose.ac.uk/129204/
Version: Accepted Version
Article:
Mantar Gundogdu, B., Nejad, S., Gladwin, D.T. orcid.org/0000-0001-7195-5435 et al. (2
more authors) (2018) A Battery Energy Management Strategy for UK Enhanced Frequency
Response and Triad Avoidance. IEEE Transactions on Industrial Electronics, 65 (12). pp.
9509-9517. ISSN 0278-0046
https://doi.org/10.1109/TIE.2018.2818642
© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be
obtained for all other users, including reprinting/ republishing this material for advertising or
promotional purposes, creating new collective works for resale or redistribution to servers
or lists, or reuse of any copyrighted components of this work in other works. Reproduced
in accordance with the publisher's self-archiving policy.
eprints@whiterose.ac.uk
https://eprints.whiterose.ac.uk/
Reuse
Items deposited in White Rose Research Online are protected by copyright, with all rights reserved unless
indicated otherwise. They may be downloaded and/or printed for private study, or other acts as permitted by
national copyright laws. The publisher or other rights holders may allow further reproduction and re-use of
the full text version. This is indicated by the licence information on the White Rose Research Online record
for the item.
Takedown
If you consider content in White Rose Research Online to be in breach of UK law, please notify us by
emailing eprints@whiterose.ac.uk including the URL of the record and the reason for the withdrawal request.

IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS
Abstract This paper describes a control algorithm for a
battery energy storage system (BESS) to deliver a
charge/discharge power output in response to changes in
the grid frequency constrained by the National Grid
Electricity Transmission (NGET) the primary electricity
transmission network operator in the UK whilst managing
the state-of-charge (SOC) of the BESS to optimise the
availability of the system. Furthermore, this paper
investigates using the BESS in order to maximise Triad
avoidance benefit revenues whilst layering other services.
Simulation using a 2 MW/1 MWh lithium-titanate BESS
validated model are carried out to explore possible
scenarios using the proposed algorithms. Finally,
experimental results of the 2MW/1MWh Willenhall Energy
Storage System (WESS) verify the performance of the
proposed algorithms.
Index Terms Battery energy storage; enhanced
frequency response; frequency stability; grid support;
lithium-titanate; triad avoidance; Willenhall energy storage.
I. INTRODUCTION
ITH increasing environmental concerns about climate
change and burning fossil fuels, and the requirement for
a more sustainable grid, renewable energy sources (RES) play
an essential role in energy continuity for today’s electricity
supply grid [1],[2]. Increased penetration of uncertain and
intermittent RES on power grids causes many challenges for
grid operators including increased frequency fluctuations,
power quality reduction, reduced reliability and voltage
transients [3]. Energy storage systems (ESSs) are one of the
efficient ways to deal with such issues by decoupling energy
generation from demand. Moreover, ESSs can be used to tackle
the power quality concerns, especially in the UK, by providing
ancillary services such as 15-minute fast frequency response,
frequency regulation, Triad avoidance, load levelling and peak
shaving [4], [5].
There are various types of existing ESSs such as pumped
hydro, hydrogen, fuel cells, cryogenic, compressed air,
flywheel and superconducting magnetic storage [6]. In
comparison to such ESSs, the battery energy storage system
(BESS) has numerous advantages including faster response
time compared to conventional energy generation sources,
energy efficiency, storage size, long cycle life, low self-
discharge rate, high charging/discharging rate capability, and
low maintenance requirements [7], [8]. The cost of batteries has
been decreasing in recent years and therefore there is now
potential for profitable large-scale grid application. BESSs
mostly participate in balancing demand and supply through
frequency response services, voltage support and peak power
lopping [9], [10] BESSs using various battery chemistries are
installed around the world for grid support [4].
In power distribution networks, the frequency changes
continuously due to the imbalance between total generation and
demand; if demand surpasses generation, a decrease in the
frequency will occur and vice versa [4], [11] Maintaining the
grid at a nominal frequency (i.e. 50 Hz for the UK) requires the
management of many disparate generation sources against
varying loads. The National Grid Electricity Transmission
(NGET) the primary electricity transmission network operator
in the UK has introduced a new faster frequency response
service, called Enhanced Frequency Response (EFR), to assist
with maintaining the grid frequency closer to 50 Hz under
normal operation [12]. A BESS is an ideal choice for delivering
such a service to the power system due to its rapid response and
its capability to import/export [4]. In the UK, there are limited
numbers of installed BESS facilities which are suitable for
providing grid support. In 2013, The UK’s first grid-tie lithium-
titanate BESS, the Willenhall Energy Storage System (WESS),
was installed by the University of Sheffield to enable research
on large scale batteries and to create a platform for research into
grid ancillary services [4], [8], [13].
In the UK, the “Triadrefers to the three half-hour settlement
periods with the highest system demand between the months of
November and February, separated by at least ten clear days.
The timing of these peaks is typically one period between
1600hrs to 1800hrs. These three periods are not known in
advance and therefore are determined from the measured data
analysed in March of every year. Half-hourly metered (HHM)
Post Conference Paper
A Battery Energy Management Strategy for
UK Enhanced Frequency Response and
Triad Avoidance
B. Gundogdu, S. Nejad, D. T. Gladwin, M. P. Foster, and D. A. Stone
W
Manuscript received Month xx, 2xxx; revised Month xx, xxxx;
accepted Month x, xxxx.
This work was supported in part by the UK Engineering and
Physical Sciences Research Council under Grant EP/N032888/1.
Authors are with the department of Electronic and Electrical
Engineering at the University of Sheffield, U.K. (emails:
bmantar1@sheffield.ac.uk; shahab.nejad@sheffield.ac.uk;
d.gladwin@sheffield.ac.uk; m.p.foster@sheffield.ac.uk;
d.a.stone@sheffield.ac.uk)

IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS
electricity customers in the UK pay charges proportional to
their consumption during the Triad; this is called the
Transmission Network Use of Service (TNUoS). The HHM
customers can minimise their TNUoS charges by reducing their
demand during Triad periods. Many commercial customers
have an energy storage device or back-up generators to ensure
the maintenance of critical supplies in case of a failure that can
also be engaged to decrease Triad demand; this is known as
‘Triad avoidance’ [14]-[19]. It is also possible for generating
assets such as BESSs to export power to the grid during the
Triad, this results in a payment from the electricity supplier
known as the Triad Avoidance Benefit (TAB). It is a complex
task to predict the Triad periods in advance, however, many
electricity suppliers offer Triad prediction services based on
insufficient system margin (NISM) provided by NG and other
factors such as the weather forecast [16].
Since the EFR is introduced as a new UK grid balancing
service published in the late of 2016, in literature there are only
a few papers about EFR service delivery for grid support. In
[20], a new EFR control algorithm implemented in the DC/AC
converter of a BESS was developed to fulfil the NGET EFR
service requirements, however in this paper EFR control is
achieved with battery energy management system rather than
controlling the energy storage converter. The study [20]
compares the performance of the EFR Sevice-1 (wide
deadband) and Service-2 (narrow dead-band), and it was stated
that the narrow service is technically more challenging, likely
requiring four time the storage capacity of the wide service.
That control algorithm does not cover the 15-mins frequency
event control to be able to increase the availability of the BESS,
especially with the narrow dead-band. However, this paper
extends the basic EFR control algorithm with the two different
extended 15-mins frequency event controls to achieve a
maximum BESS availability for delivering EFR service. In
addition, in [20], the algorithm manages the SOC of the BESS,
maintaining at 49-51%. But, the SOC band should not be kept
at less than 5% SOC band in order to reduce battery degradation
and hence prolong its lifetime.
In [21], Cooke et al. present a method of providing the new
EFR service to avoid the necessity of holding more FFR in
reserve when system inertia falls. That study also introduced
several alternative response curves which indicate that if
arresting the fall in grid frequency in the event of a drop in
generation is an important aspect of the control design, then a
stepped response may provide a better service. An energy
storage strategy based on PI control can help with restoration
and damping of frequency. However, that response time will be
slower than a stepped response so that stability can be ensured.
In [22], the authors investigate the possible performance of a
BESS in EFR provision, by simulating its response to grid
frequency according to the EFR service requirements, and this
evaluating its ability to exchange energy for the service, a
service performance indicator, and the possible aging related to
battery cycling. Different EFR power versus frequency
characteristics, BESS technologies and BESS energy capacities
are considered in [22]. It was also assumed that the BESS are
connected to the UK or to the Continental Europe (CE)
synchronous area; therefore, for the CE system those
requirements are adjusted according to the CE frequency
behaviour. However, a major specification of the EFR service
is to consider ramp-rate limits in the UK requirements, it was
not considered in [22] for simplicity; power exchange rate
limits internal to the batteries was also neglected. In addition,
that study did not cover an extended 15-min frequency event
control in order to increase the batteries availability.
In contrast to other recent works in the field; the main
contribution of this paper is to present a novel control algorithm
that enables BESSs to provide a bi-directional power in
response to changes in the grid frequency, whilst managing the
SOC of the BESS to optimise availability of the system.
Moreover, this study introduces a strategy to generate
additional revenues from ancillary services such as Triad
Avoidance only available during the winter season.
Moreover, this paper considers layering the new UK grid
frequency balancing service, EFR, with Triad Avoidance in
order to maximise the system’s availability and profitability. It
should be noted that the previous basic study [4] presented
initial three EFR control methodologies with their simulation
results; and this paper extends to show how this can be used to
maximise profits from other services such as Triad Avoidance.
This paper also includes experimental validation with a
2MW/1MWh lithium-titanate BESS, commissioned and
operated by the University of Sheffield, which is the largest
research only platform for grid-tie energy storage applications.
This paper is organised as follows. In Section II, the technical
specification of the new UK EFR service is described. In
Section III, three different EFR service models are developed
to evaluate control strategies for delivering a real-time response
to deviations in the grid frequency. The first model introduces
a control algorithm designed to meet the technical requirements
of NGET specifications [12]. The second model addresses the
EFR service design with an extended 15-minute frequency
event control, in order to optimise the use of the available stored
energy. The third model extends the EFR control algorithm to
include a dynamic SOC target to maximise the energy stored on
predicted Triad days. In Section IV the simulation results based
on the 2 MW / 1 MWh BESS are analysed to verify the transient
performance of the proposed control strategy. In Section V, the
performance of the EFR service delivery through TAB is
quantified and the performance of the proposed EFR control
algorithm is verified experimentally with the 2MW / 1MWh
WESS in Section VI.
II. EFR SERVICE TECHNICAL SPECIFICATIONS
EFR is introduced as a new fast frequency response service
for grid balancing that can deliver full-scale active power within
one second of registering a grid frequency deviation. NGET
prepared an EFR specification to facilitate a tender competition
for 200 MW of support provision to be distributed amongst
potential energy storage providers in 2016 [12], which is
described as follows.

IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS
Fig. 1. NGET specifications (a) EFR envelope and (b) power zones [12].
TABLE I
EFR ENVELOPE FREQUENCY AND POWER BOUNDARIES [12]
Power (%)
Ref.
Point
Service-1
Service-2
Ref.
Point
Service-1
Service-2
A
B
C
D
E
F
49.5
49.75
49.95
50.05
50.25
50.5
49.5
49.75
49.985
50.015
50.25
50.5
t
u
v
w
x
y
z
100
44.44444
9
0
-9
-44.44444
-100
100
48.4536
9
0
-9
-48.4536
-100
Energy storage providers must respond to deviations in
nominal frequency (50 Hz) by decreasing or increasing their
power output. Specifically, energy storage devices must
provide power to the grid to respond to deviations in frequency
outside of a dead band (DB). Providers must deliver continuous
power to the grid as described in one of the two EFR service
envelopes (Service-1, Service-2) of Table I [12]. As seen in
Error! Reference source not found.(a), the power level must
remain within the upper and lower envelopes at all times; power
provided outside the envelope will decrease the service
performance measurement (SPM), and thus reduce the income
revenue [12]. In DB, the reference power profile is at zero MW
output and hence providers do not have to respond to changes
in the grid frequency. The BESS can be freely operated to
charge/discharge in DB, however, the maximum export/import
power must not exceed 9% of the BESS’s full-scale range [12].
Providers may operate anywhere within the upper and lower
envelopes to deliver a continuous service to the power system,
with respect to the specified limitations on ramp rates as given
in [4],[12]. For a BESS, this effectively provides some control
over state-of-charge (SOC) of the battery. For the zones A, C, D
in Error! Reference source not found.(b), the ramp rate must
obey the specified values in [4], [12]. Operation in zones C and
D will result in payments at a lower SPM. Hence, in such cases,
EFR power output has to return to the specified envelope with
respect to the ramp-rate limits given in [4]. Ramp-rate zone B is
described as being the area between the upper and lower
envelopes, excluding the DB, and extends to achieve the full
power capability at ±0.5 Hz [12]. The allowable ramp rates
within zone B depend on the rate of change of frequency. For
EFR Service-1 and Service-2, the ramp rate limitations for all
frequencies in zone B are shown in [4]. With these ramp limits,
output power changes proportionally to changes in grid
frequency, whilst allowing the energy storage providers some
flexibility [12] to manage the battery SOC.
III. EFR DESIGN ALGORITHM
A BESS model is developed in MATLAB/Simulink and
verified against experimental operation of the WESS. An EFR
control algorithm is then implemented on the model to deliver
a grid frequency response service to the NGET specification.
Fig. 2 presents the EFR control scheme implemented in EFR
Model-1 [4], where the inputs are real-time grid frequency ()
and battery SOC, and the output is the required EFR power.
Fig. 2. EFR control scheme implemented in EFR Model-1 [4].
The algorithm starts by detecting the position of the
measured grid frequency with respect to the zones bounded by
vertical lines A’ to ‘F’ in Fig. 1 (a). This is achieved by the
‘EFR Power Calculation’ block (labelled ‘1’), where the
required EFR response envelopes are calculated. In the 2 MW
BESS model, the frequency and power bounds are calculated as
a function of the limits denoted in Fig. 1 (a), with their values
declared in Table I. The power output is restricted to ±180 kW
(i.e. 9% of 2 MW) within the DB and both services include an
upper, base line and lower power line denoted, and ,
respectively. Block 2 selects the required power line with the
decision being based on the measured SOC. For example, if the
current SOC is below the desired SOC range, the demanded
power is calculated using the equations derived for the upper
line (). This has the effect of either importing energy to charge
the battery or minimising the exported energy to maintain a
desired SOC range. ‘Zone Assignment’ (Block 3) is responsible
for identifying the current operating zone (refer to Fig. 1(b)) for
the calculation of the power-output levels.
t
u
v
w
x
y
z
A
B
C
D
E
F
Upper
limit
Lower
limit
Base line
Output power
Frequency
DB
(a)
(b)
EFR Power
Calculation
f (Hz)
U, Z, L
Ramp-
Rate
Limiter
SOC
Power Setpoint
- +
Measured
Power
Zone
df / dt
f (Hz)
f (Hz)
SOC
error
State
Power
Output
State
Assignment
&
EFR Power
Set Point
Zone
Assignment
1
2
3
4

IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS
Finally, the change in power output per time step (1 second)
for each zone is determined using the given ramp-rate limits
given in [4]. In this study, battery SOC is calculated using (1)
[4], where SOC

, and

represent initial SOC, Watt-hour
capacity and instantaneous battery power, respectively.
SOC
out
SOC
init
batt


(1)
Fig. 3. Flow chart showing the structure of the two proposed battery energy
management strategies for enhanced frequency response in the UK [4].
The EFR specification defines frequency outside DB for
longer than 15 minutes as an extended event, whereby after the
15 minutes, it is optional to deliver power for up to 30 minutes
post the grid frequency returning to DB. In order to increase the
availability of the BESS in Model-1, by avoiding SOC limits,
an extended 15-minute frequency event control algorithm is
implemented in EFR Model-2 and Model-3, as given in Fig. 3.
EFR Model-2 introduces a timed control block, which measures
the length of time that the grid frequency is continuously
outside of the DB. If this block measures a value higher than 15
minutes, then the BESS’s output power is set to zero. The BESS
remains in this state until the system frequency returns within
DB, at which point a second timer starts timing for 30 minutes
and the output power stays at zero until the timer expires, at
which point, the EFR control is reset back to operating as EFR
Model-1. EFR Model-3 allows the BESS to manage its SOC
between its upper (SOC

) and lower limits (SOC

) during the
30-minute rest period by charging and discharging the battery
within the ±9% power limits.
IV. SIMULATION RESULTS OF EFR MODELS
Using a real-time frequency data set obtained from NGET
[23], the three EFR models are simulated in
MATLAB/Simulink. The simulation results presented in this
paper are all based on a 1 MWh BESS model, which has been
experimentally validated on the WESS plant in the UK, with a
maximum EFR power of ±2 MW. Table V shows the
parameters used in the EFR models.
A. Simulation results of EFR Model-1
In order to show the performance of the reported EFR algorithm
in Section III, the real grid frequency data for the 21
st
of October
of 2015 [23] is employed herein, as this particular day is known
to have a large period of under frequency.
TABLE I
SYSTEM PARAMETERS [12]
Parameter
Value
Nominal frequency
Low/high DB
Max/min EFR power limit
Battery rated power/capacity
Battery initial SOC (SOC

)
SOC band (SOC

- SOC

)
Inverter efficiency (

)
Battery charge/discharge efficiency (
/
)
50 Hz
±0.015 Hz (Service-2)
±2 MW
2 MW/1 MWh
50%
45-55%
97%
94%
Fig. 4 shows the simulation results of Model-1 for a ‘Service-
2’ EFR with a target SOC band of 45-55%. On the frequency
plot, the DB (±0.015 Hz) is shown by the green lines. It is clear
that the SOC sharply drops, reaching 0% at 11:00, and stays
there for ~30mins due to the grid frequency demands at that
time. As the frequency stabilises, the EFR algorithm charges
the battery when it is permissible (frequency in DB) and returns
the SOC to within the specified band of 45-55%. The power
response versus frequency plot of EFR Model-1 for 21
st
October 2015 is shown in Fig. 7(a). The red lines represent the
upper, reference and lower EFR power lines. It can be seen that
the EFR power (blue circles) does not remain within the
required zones of ‘A’ and ‘B’. As outlined in Fig. 1, this is
*CPower: Calculated
power dictated by
EFR specification.
Start
Measure frequency
Frequency in
DB?
PowerOut = CPower
Event Counter=0
Timer1=0
Timer2=0
End
Yes
No
Start/Continue Timer1
Timer1≥15 mins
No
PowerOut = CPower
Yes
M2/M3
M2
Start/Continue Timer2
Timer2≥30 mins
PowerOut=0
No
Yes
PowerOut = CPower
End
Model 2
Event Counter=1
Stop Timer1 & Timer2
M3
Start/Continue Timer2
Timer2≥30 mins
PowerOut = CPower
Yes
End
No
Frequency in
DB?
Yes
SOC<SOClow?
No
SOC>SOCup?
Yes
Yes
No
PowerOut=0
PowerOut = CPower
(charging battery)
PowerOut=0
No
Model 3
PowerOut = CPower
(discharging battery)
Event Counter=1
Stop Timer1 & Timer2

Citations
More filters
Journal ArticleDOI
TL;DR: An optimization process with nondominated sorting genetic algorithm II (NSGA-II) is proposed to establish a more efficient SOH estimator with support vector regression (SVR) and the short-term features from the current pulse test and the degradation features in this article are the knee points at the transfer instants of the voltage.
Abstract: As a favorable energy storage component, lithium-ion (Li-ion) battery has been widely used in the battery energy storage systems (BESS) and electric vehicles (EV). Data driven methods estimate the battery state-of-health (SOH) with the features extracted from the measurement. However, excessive features may reduce the estimation accuracy and also increases the human labor in the lab. By proposing an optimization process with nondominated sorting genetic algorithm II (NSGA-II), this article is able to establish a more efficient SOH estimator with support vector regression (SVR) and the short-term features from the current pulse test. NSGA-II optimizes the entire process of establishing a SOH estimator considering both the measurement cost of the feature and the estimation accuracy. A series of nondominated solutions are obtained by solving the multiobjective optimization problem, which also provides more flexibility to establish the SOH estimator at various conditions. The degradation features in this article are the knee points at the transfer instants of the voltage in the short-term current pulse test, which is fairly convenient and easy to be obtained in real applications. The proposed method is validated on the measurement from two LiFePO4/C batteries aged with the mission profile providing the primary frequency regulation (PFR) service to the grid.

85 citations

Journal ArticleDOI
TL;DR: The results demonstrate that the proposed control scheme can ensure the stable operation of the system under a larger sampling period so as to reduce the communication network burden and show that the controller designed by a large exponential decay rate can provide a fast frequency response to alleviate the impact of thesystem’s frequency response due to the high penetration of wind power.

77 citations

Journal ArticleDOI
TL;DR: A deep reinforcement learning (DRL) based controller to manage the state of charge (SOC) of a Multi-EESS, providing frequency response services to the power grid, is proposed and results show the effectiveness of the proposed approach.
Abstract: The ongoing reduction of the total rotational inertia in modern power systems brings about faster frequency dynamics that must be limited to maintain a secure and economical operation. Electrical energy storage systems (EESSs) have become increasingly attractive to provide fast frequency response services due to their response times. However, proper management of their finite energy reserves is required to ensure timely and secure operation. This paper proposes a deep reinforcement learning (DRL) based controller to manage the state of charge (SOC) of a Multi-EESS (M-EESS), providing frequency response services to the power grid. The proposed DRL agent is trained using an actor-critic method called Deep Deterministic Policy Gradients (DDPG) that allows for continuous action and smoother SOC control of the M-EESS. Deep neural networks (DNNs) are used to represent the actor and critic policies. The proposed strategy comprises granting the agent a constant reward for each time step that the SOC is within a specific band of its target value combined with a substantial penalty if the SOC reaches its minimum or maximum allowable values. The proposed controller is compared to benchmark DRL methods and other control techniques, i.e., Fuzzy Logic and a traditional PID control. Simulation results show the effectiveness of the proposed approach.

48 citations


Cites methods from "A Battery Energy Management Strateg..."

  • ...Diverse strategies for SOC management of EESSs can be found in the literature in the form of control techniques such as linear control [5], PID [6], model predictive con-...

    [...]

Journal ArticleDOI
TL;DR: The proposed framework uses a dynamic regret based on the last available information up to the current point in time of renewable generation and demand, which are uncertainty sources to provide more accurate control than the currently employed prediction-based algorithms.
Abstract: In this paper a distributed control strategy for coordinating multiple battery energy storage systems to support frequency regulation in power systems with high penetration of renewable generation is proposed. The approach is based on an online convex optimisation framework that considers both the operating costs of storage systems and the frequency regulation requirements. The proposed framework uses a dynamic regret based on the last available information up to the current point in time of renewable generation and demand, which are uncertainty sources. The approach provides more accurate control than the currently employed prediction-based algorithms and it can be implemented in a distributed manner using a multi-agent system framework that facilitates plug-and-play functionality. The effectiveness and scalability of the proposed strategy is assessed through several case studies.

48 citations


Cites background from "A Battery Energy Management Strateg..."

  • ...parameters α and β, which depends on changes in the system frequency [34]....

    [...]

Journal ArticleDOI
TL;DR: This paper assesses whether synergies exist between two of the most significant of these services, fast frequency response and energy arbitrage, if a battery energy storage system is used to deliver both, and develops an innovative state-of-charge management strategy to exploit this synergy.

42 citations

References
More filters
Journal ArticleDOI
TL;DR: A set of new BESS models is presented that are configured and parameterized for use in system impact studies as well as transmission planning studies and useful guidelines in the use of new models to represent a BESS for power system analysis are provided.
Abstract: This paper presents engineering experiences from battery energy storage system (BESS) projects that require design and implementation of specialized power conversion systems (a fast-response, automatic power converter and controller). These projects concern areas of generation, transmission, and distribution of electric energy, as well as end-energy user benefits, such as grid frequency regulation, renewable energy smoothing and leveling, energy dispatching and arbitrage, power quality and reliability improvements for connected customers, islanding operations, and smart microgrid applications. In general, a grid level BESS project sends an interconnect request to utility power grids in the project development stage. Simulation models of equipment are then sent for a system impact study (e.g., power flow and/or stability analysis), based on utility grid code requirements. The system study then determines the connection's technical feasibility and impact of the project on the power grid. In this paper, a set of new BESS models is presented that are configured and parameterized for use in system impact studies as well as transmission planning studies. The models, which have been recently approved and released by the U.S. Western Electricity Coordinating Council (WECC), represent the steady state and dynamic performance of the BESS in several software platforms for power system studies based on operating project performance experience. Model benchmarking results as well as a real system case study are also included in the paper to show that the parameterized and tuned models respond correctly and as expected when system operating conditions change following contingency events. Finally, this paper provides useful guidelines in the use of new models to represent a BESS for power system analysis.

116 citations


Additional excerpts

  • ...BESSs mostly participate in balancing demand and supply through frequency response services, voltage support, and peak power lopping [9], [10] BESSs using various battery chemistries are installed around the world for grid support [4]....

    [...]

Journal ArticleDOI
TL;DR: In this paper, a new Smart Energy Management Algorithm (SEMA) is proposed for hybrid energy storage system (HESS) supplied from 3-phase 4-wire grid connected photovoltaic (PV) power system.

110 citations


"A Battery Energy Management Strateg..." refers background in this paper

  • ...W ITH increasing environmental concerns about climate change and burning fossil fuels, and the requirement for a more sustainable grid, renewable energy sources (RES) play an essential role in energy continuity for today’s electricity supply grid [1], [2]....

    [...]

Journal ArticleDOI
TL;DR: In this article, the economic viability of combined heat and power with district heating (CHP-DH) networks depends on several principles, namely (1) the optimisation of engineering and design principles; (2) organisational and regulatory frameworks; (3) financial and economic factors.

91 citations

Proceedings ArticleDOI
19 Apr 2016
TL;DR: In this article, two battery energy storage research facilities connected to the UK electricity grid are described, along with hardware results, and a number of grid support services are demonstrated, again with results presented.
Abstract: Grid-connected battery energy storage systems with fast acting control are a key technology for improving power network stability and increasing the penetration of renewable generation. This paper describes two battery energy storage research facilities connected to the UK electricity grid. Their performance is detailed, along with hardware results, and a number of grid support services are demonstrated, again with results presented. The facility operated by The University of Manchester is rated at 236kVA, 180kWh, and connected to the 400V campus power network, The University of Sheffield operates a 2MVA, 1MWh facility connected to an 11kV distribution network.

60 citations


"A Battery Energy Management Strateg..." refers background or methods in this paper

  • ...It aims to investigate the characteristics of a lithium–titanate type battery, as well as different battery chemistries, for providing grid support functions at scale [8], [13], [25]–[27]....

    [...]

  • ...More technical details on the WESS can be found in [8] and [13]....

    [...]

  • ...In comparison to such ESSs, the battery energy storage system (BESS) has numerous advantages including faster response time compared to conventional energy generation sources, energy efficiency, storage size, long cycle life, low self-discharge rate, high charging/discharging rate capability, and low maintenance requirements [7], [8]....

    [...]

  • ...was installed by the University of Sheffield (UoS) to enable research on large-scale batteries and to create a platform for research into grid ancillary services [4], [8], [13]....

    [...]

Journal ArticleDOI
TL;DR: In this paper, the battery duty cycle was characterized based on five parameters: pulses duration, pulses intensity (current), SOC swing range, SOC event ramp rate, and temperature, which represents more than 5000 equivalent full cycles on the cells.

58 citations


"A Battery Energy Management Strateg..." refers background in this paper

  • ...Increased penetration of uncertain and intermittent RES on power grids causes many challenges for grid operators including increased frequency fluctuations, power quality reduction, reduced reliability, and voltage transients [3]....

    [...]

Frequently Asked Questions (1)
Q1. What are the contributions in this paper?

This paper describes a control algorithm for a battery energy storage system ( BESS ) to deliver a charge/discharge power output in response to changes in the grid frequency constrained by the National Grid Electricity Transmission ( NGET ) – the primary electricity transmission network operator in the UK – whilst managing the state-of-charge ( SOC ) of the BESS to optimise the availability of the system. Furthermore, this paper investigates using the BESS in order to maximise Triad avoidance benefit revenues whilst layering other services.