In mathematical optimization, the perturbation function is any function which relates to primal and dual problems. The name comes from the fact that any such function defines a perturbation of the initial problem. In many cases this takes the form of shifting the constraints.
In some texts the value function is called the perturbation function, and the perturbation function is called the bifunction.
Given two dual pairs separated locally convex spaces
(
X
,
X
∗
)
and
(
Y
,
Y
∗
)
. Then given the function
f
:
X
→
R
∪
{
+
∞
}
, we can define the primal problem by
inf
x
∈
X
f
(
x
)
.
If there are constraint conditions, these can be built into the function
f
by letting
f
←
f
+
I
c
o
n
s
t
r
a
i
n
t
s
where
I
is the indicator function. Then
F
:
X
×
Y
→
R
∪
{
+
∞
}
is a perturbation function if and only if
F
(
x
,
0
)
=
f
(
x
)
.
The duality gap is the difference of the right and left hand side of the inequality
sup
y
∗
∈
Y
∗
−
F
∗
(
0
,
y
∗
)
≤
inf
x
∈
X
F
(
x
,
0
)
,
where
F
∗
is the convex conjugate in both variables.
For any choice of perturbation function F weak duality holds. There are a number of conditions which if satisfied imply strong duality. For instance, if F is proper, jointly convex, lower semi-continuous with
0
∈
core
(
Pr
Y
(
dom
F
)
)
(where
core
is the algebraic interior and
Pr
Y
is the projection onto Y defined by
Pr
Y
(
x
,
y
)
=
y
) and X, Y are Fréchet spaces then strong duality holds.
Let
(
X
,
X
∗
)
and
(
Y
,
Y
∗
)
be dual pairs. Given a primal problem (minimize f(x)) and a related perturbation function (F(x,y)) then the Lagrangian
L
:
X
×
Y
∗
→
R
∪
{
+
∞
}
is the negative conjugate of F with respect to y (i.e. the concave conjugate). That is the Lagrangian is defined by
L
(
x
,
y
∗
)
=
inf
y
∈
Y
{
F
(
x
,
y
)
−
y
∗
(
y
)
}
.
In particular the weak duality minmax equation can be shown to be
sup
y
∗
∈
Y
∗
−
F
∗
(
0
,
y
∗
)
=
sup
y
∗
∈
Y
∗
inf
x
∈
X
L
(
x
,
y
∗
)
≤
inf
x
∈
X
sup
y
∗
∈
Y
∗
L
(
x
,
y
∗
)
=
inf
x
∈
X
F
(
x
,
0
)
.
If the primal problem is given by
inf
x
:
g
(
x
)
≤
0
f
(
x
)
=
inf
x
∈
X
f
~
(
x
)
where
f
~
(
x
)
=
f
(
x
)
+
I
R
+
d
(
−
g
(
x
)
)
. Then if the perturbation is given by
inf
x
:
g
(
x
)
≤
y
f
(
x
)
then the perturbation function is
F
(
x
,
y
)
=
f
(
x
)
+
I
R
+
d
(
y
−
g
(
x
)
)
.
Thus the connection to Lagrangian duality can be seen, as L can be trivially seen to be
L
(
x
,
y
∗
)
=
{
f
(
x
)
+
y
∗
(
g
(
x
)
)
if
y
∗
∈
R
+
d
−
∞
else
.
Let
(
X
,
X
∗
)
and
(
Y
,
Y
∗
)
be dual pairs. Assume there exists a linear map
T
:
X
→
Y
with adjoint operator
T
∗
:
Y
∗
→
X
∗
. Assume the primal objective function
f
(
x
)
(including the constraints by way of the indicator function) can be written as
f
(
x
)
=
J
(
x
,
T
x
)
such that
J
:
X
×
Y
→
R
∪
{
+
∞
}
. Then the perturbation function is given by
F
(
x
,
y
)
=
J
(
x
,
T
x
−
y
)
.
In particular if the primal objective is
f
(
x
)
+
g
(
T
x
)
then the perturbation function is given by
F
(
x
,
y
)
=
f
(
x
)
+
g
(
T
x
−
y
)
, which is the traditional definition of Fenchel duality.
