# Closedness Type Regularity Conditions in Convex Optimization and Beyond

- Faculty of Mathematics, Chemnitz University of Technology, Chemnitz, Germany

The closedness type regularity conditions have proven during the last decade to be viable alternatives to their more restrictive interiority type counterparts, in both convex optimization and different areas where it was successfully applied. In this review article we de- and reconstruct some closedness type regularity conditions formulated by means of epigraphs and subdifferentials, respectively, for general optimization problems in order to stress that they arise naturally when dealing with such problems. The results are then specialized for constrained and unconstrained convex optimization problems. We also hint toward other classes of optimization problems where closedness type regularity conditions were successfully employed and discuss other possible applications of them.

## 1. Introduction and Preliminaries

Regularity conditions play a key role in optimization and nonsmooth analysis, as additional hypotheses that guarantee the fulfillment of strong or converse duality, necessary and/or optimality conditions and various formulae, respectively. In convex optimization there have been proposed a number of regularity conditions (also called constraint qualification when they involve only the constraints of the considered problem), depending on the initial assumptions. For instance, in the differentiable case one employs the regularity conditions due to Abadie, Guignard, or Mangasarian-Fromowitz, while for nondifferentiable constrained optimization problems one has the Slater constraint qualification. However, the latter is a priori violated for many classes of problems where the constraint cone has an empty interior, and several generalizations were proposed for it, the so-called interiority type regularity conditions, that involve notions of generalized interior of a set. But even these fail for large classes of problems and, inspired by Precupanu's pioneering work [1], Burachik, Jeyakumar and their coauthors, and on the other hand Boţ, Wanka and their coauthors have proposed in [2–9] a new class of regularity conditions, the closedness type ones. They have proven first to be sufficient conditions for guaranteeing duality statements in optimization and subdifferential formulae in convex analysis, delivering in the meantime results and formulae in some related research fields as well. They have proven thus to be viable alternatives to their more restrictive interiority type counterparts. In this review paper, that enhances and completes a similar study provided in the book [10], we provide a general look on the usage of the closedness type regularity conditions in the literature until now, showing that they arise naturally while dealing with optimization problems and pointing toward different assertions from the literature that can be rediscovered as special cases of the mentioned general results. To this end we deconstruct and then reconstruct closedness type regularity conditions formulated by means of epigraphs and subdifferentials, respectively, for general optimization problems, showing afterwards how to particularize them for constrained and unconstrained optimization problems.

As mentioned above, the first papers dealing with closedness type regularity conditions for convex optimization problems were [2–7], having as a starting point earlier statements from Precupanu [1]. Afterwards, it was noticed that other regularity conditions from the literature such as the *Basic Constraint Qualification* (see for instance, [11–13]) or the *Farkas-Minkowski Constraint Qualification* (cf. [14–16]) can be recovered as special cases of some general closedness type regularity conditions.

Let *X* and *Y* be locally convex Hausdorff vector spaces, whose topological *dual spaces* are denoted by *X** and *Y**, respectively. The dual spaces can be endowed with different topologies among which the weak* ones, denoted by ω(·*, ·) or shortly ω*, will be considered for formulating closedness type regularity conditions. The natural topology on ℝ is denoted by ${R}$. By 〈*x**, *x*〉 = *x**(*x*) we denote the value at *x* ∈ *X* of the linear continuous functional *x** ∈ *X**. A *cone K* ⊆ *X* is a nonempty subset of *X* which fulfills α*K* ⊆ *K* for all α ≥ 0. A convex cone *K* ⊆ *X* induces on *X* the *partial ordering* “≦_{K}” defined by *x* ≦_{K} *y* whenever *y* − *x* ∈ *K*, where *x*, *y* ∈ *X*. If *x* ≦_{K} *y* and *x* ≠ *y* we write *x* ≤_{K} *y*. To *X* a *greatest element* with respect to “≦_{K}” denoted ∞_{K} ∉ *X* can be attached and we define ${X}^{\u2022}=X\cup \left\{{\infty}_{K}\right\}$. Then for any *x* ∈ *X* one has *x* ≤_{K} ∞_{K} and we consider on *X*^{•} the operations *x* + ∞_{K} = ∞_{K} + *x* = ∞_{K} for all *x* ∈ *X* and α · ∞_{K} = ∞_{K} for all α ≥ 0. The *dual cone* of *K* is *K** = {*x** ∈ *X** : 〈*x**, *x*〉 ≥ 0 ∀*x* ∈ *K*}. By convention, $\langle {x}^{*},{\infty}_{K}\rangle =+\infty $ for all *x** ∈ *K**.

Given a subset *U* of *X*, by cl *U*, int *U* and cone *U* we denote its *closure, interior* and *conical hull*, respectively. Moreover, if *U* is convex, by sqri $\text{sqri\hspace{0.17em}}U=\{x\in U:\text{\hspace{0.17em}\hspace{0.17em}cone}(U-x)\text{isaclosedlinearsubspace}\}$ we denote its *strong quasi-relative interior*. When *U* ⊆ ℝ^{n} we denote by ri *U* its *relative interior*, which coincides in this case with sqri *U*. The *indicator function* of *U* is ${\delta}_{U}:X\to \overline{\mathbb{R}}=\mathbb{R}\cup \left\{\pm \infty \right\}$, defined as δ_{U}(*x*) = 0 if *x* ∈ *U* and δ_{U}(*x*) = +∞ otherwise, while its *support function* ${\sigma}_{U}:{X}^{*}\to \overline{\mathbb{R}}$ is given by ${\sigma}_{U}({x}^{*})={\mathrm{sup}}_{x\in U}\langle {x}^{*},x\rangle $. The *normal cone* associated to the set *U* at *x* ∈ *U* is ${N}_{U}(x)=\{{x}^{\ast}\in {X}^{\ast}:\langle {x}^{\ast},y-x\rangle \le 0\text{\hspace{0.17em}}\forall y\in U\}$ and, for ε ≥ 0, the ε*-normal set* of *U* at *x* ∈ *U* is ${N}_{U}^{\epsilon}(x)=\{{x}^{\ast}\in {X}^{\ast}:\langle {x}^{\ast},y-x\rangle \le -\epsilon \text{\hspace{0.17em}}\forall y\in U\}$. The *projection function* of *X* is Pr_{X} : *X* × *Y* → *X*, defined by Pr_{X}(*x*, *y*) = *x* for (*x*, *y*) ∈ *X* × *Y*, the *identity function* of *X* is id : *X* → *X*, id(*x*) = *x* for *x* ∈ *X* and, for *n* ∈ ℕ, we use the notation ${\Delta}_{{X}^{n}}=\left\{(x,\dots ,x):x\in X\right\}\subseteq {X}^{n}$.

For being able to deliver by means of duality very general regularity conditions for the problem of guaranteeing the maximal monotonicity of the sum of two maximal monotone operators defined in reflexive Banach spaces, we introduced in Boţ et al. [17] the notion of a set closed regarding a subspace (see also [18–20]). For the investigations in this study even more general closedness notions are necessary, that were first proposed in Boncea and Grad [21] (and when *Z* = *X* × ℝ, in [22]; see also [10]).

**Definition 1.1.** Given ε ≥ 0, a set *U* ⊆ *X* × ℝ is said to be (0, ε)-*vertically closed regarding the set Z* ⊆ *X* × ℝ if (cl *U*) ∩ *Z* ⊆ (*U* ∩ *Z*) − (0, ε), while when *Z* = *X* × ℝ, *U* is called simply (0, ε)-*vertically closed*. Moreover, a set *U* ⊆ *X* that fulfills (cl *U*) ∩ *W* = *U* ∩ *W*, where *W* ⊆ *X*, is said to be *closed regarding the set W*.

**Remark 1.** A set *U* ⊆ *X* is closed if and only if it is closed regarding the whole space *X*. Each closed set *U* ⊆ *X* is closed regarding any other set *W* ⊆ *X*, but a set *U* ⊆ *X* that is closed regarding some *W* ⊆ *X* is not necessarily closed, as shown below in Example 1.

**Example 1.** The interval [0, 1) ⊆ ℝ is closed regarding the set {0}, but not closed.

**Example 2.** The set {0} × (0, +∞) ⊆ ℝ^{2} is (0, ε)-vertically closed regarding the set [−1, 1] × (−1, +∞) for all ε > 0, but there is no ε ≥ 0 for it to be (0, ε)-vertically closed regarding the set [−1, 1] × (−∞, 0]. On the other hand, the set [0, 1] × (0, +∞) ⊆ ℝ^{2} is (0, ε)-vertically closed for all ε > 0, while the set [0, 1] × (0, 1) ⊆ ℝ^{2} is not (0, ε)-vertically closed for any ε ≥ 0.

**Remark 2.** In the literature one can find other definitions of ε-*closed* (see for instance [23, 24]) and *vertically closed* (see [25]) sets, respectively, introduced for purposes that have basically nothing in common with our present investigations.

Let us present now some preliminary notions and results involving functions. Given a function $f:X\to \overline{\mathbb{R}}$, its *domain* is dom *f* = {*x* ∈ *X* : *f*(*x*) < +∞}, its *epigraph* epi *f* = {(*x, r*) ∈ *X* × ℝ : *f*(*x*) ≤ *r*} and *conjugate function* ${f}^{*}:{X}^{*}\to \overline{\mathbb{R}}$, *f**(*x**) = sup{〈*x**, *x*〉 − *f*(*x*) : *x* ∈ *X*}. If *U* ⊆ *X*, the *conjugate function of f regarding U* ⊆ *X* is ${f}_{U}^{*}:X\to \overline{\mathbb{R}}$, ${f}_{U}^{*}={(f+{\delta}_{U})}^{*}$. We call *f proper* when *f*(*x*) > − ∞ for all *x* ∈ *X* and dom *f* ≠ ∅. When *f* is proper and ε ≥ 0, if *f*(*x*) ∈ ℝ the *(convex)* ε*-subdifferential* of *f* at *x* is ${\partial}_{\epsilon}f(x)=\{{x}^{\ast}\in {X}^{\ast}:f(y)-f(x)\ge \langle {x}^{\ast},y-x\rangle -\epsilon \text{\hspace{0.17em}}\forall y\in X\}$ ∀*y* ∈ *X*}, while if *f*(*x*) = +∞ we take by convention ∂_{ε}*f*(*x*) = ∅. The ε-subdifferential of *f* becomes in case ε = 0 its classical *(convex) subdifferential* denoted by ∂*f*. When *U* ⊆ *X* and ε ≥ 0 one has ${\partial}_{\epsilon}{\delta}_{U}={N}_{U}^{\epsilon}$. The *Young-Fenchel inequality* says that ${f}_{U}^{*}({x}^{*})+f(x)\ge \langle {x}^{*},x\rangle $ for all *x* ∈ *U* and *x** ∈ *X**. If *U* = *X*, this inequality is fulfilled as equality if and only if *x** ∈ ∂*f*(*x*) and in general one has *f**(*x**) + *f*(*x*) ≤ 〈*x**, *x*〉 + ε if and only if ${x}^{*}\in {\partial}_{\epsilon}f(x)$. When $f,g:X\to \overline{\mathbb{R}}$ are proper, their *infimal convolution* is $f\square g:X\to \overline{\mathbb{R}}$, $f\square g(a)={\mathrm{inf}}_{x\in X}\left[f(x)+g(a-x)\right]$, that is called *exact* at *a* ∈ *X* when there exists an *x* ∈ *X* such that *f*□*g*(*a*) = *f*(*x*) + *g*(*a* − *x*). For α ∈ ℝ, defining the function $\alpha f:X\to \overline{\mathbb{R}}$, (α*f*)(*x*) = α*f*(*x*) for *x* ∈ *X*, we take 0*f* = δ_{dom f} when α = 0. Given a linear continuous mapping *A* : *X* → *Y*, its *adjoint* is *A** : *Y** → *X**, 〈*A***y**, *x*〉 = 〈*y**, *Ax*〉 for any (*x*, *y**) ∈ *X* × *Y**, while Im*A* = {*Ax* : *x* ∈ *X*} denotes its *image*.

Let *K* ⊆ *X* be a convex cone $f:X\to \overline{\mathbb{R}}$ is said to be *K*-*increasing* if *f*(*x*) ≤ *f*(*y*) for all *x*, *y* ∈ *X* such that *x* ≦_{K} *y*. A vector function *F* : *Y* → *X*^{•} is said to be *proper* if its *domain* dom *F* = {*y* ∈ *Y* : *F*(*y*) ∈ *X*} is nonempty and *K*-*convex* if *F*(*tx* + (1 − *t*)*y*) ≦_{K} *tF*(*x*) + (1 − *t*)*F*(*y*) for all *x*, *y* ∈ *Y* and all *t* ∈ [0, 1]. When *K* is closed, it is called *K*-epi-*closed* if its *K*-*epigraph* epi_{K} *F* = {(*y, x*) ∈ *Y* × *X* : *x* ∈ *F*(*y*) + *K*} is closed. For *x** ∈ *K** the function $({x}^{*}F):Y\to \overline{\mathbb{R}}$ is defined by (*x***F*)(*y*) = 〈*x**, *F*(*y*)〉, *y* ∈ *Y*.

For an attained infimum (supremum) instead of inf (sup) we write min (max), while the optimal objective value of the optimization problem (*P*) is denoted by *v*(*P*).

## 2. General Perturbed Scalar Optimization Problems

The two main classical duality approaches in convex optimization, the *Lagrange* type for the constrained optimization problems and the *Fenchel* type for the unconstrained ones, have been unified in the general theory of conjugate duality by means of perturbations that can be found, for instance, in Rockafellar [26], Zălinescu [27], Ekeland and Temam [28], and Boţ et al. [29]. Note that also other duality concepts from the literature can be reconsidered in the framework of this general theory, as we have done for the Wolfe and Mond-Weir duality concepts in Boţ et al. [29], Boţ and Grad [30, 31], and Grad and Pop [32] and the geometric duality in Boţ et al. [33]. In the following we present briefly this general duality scheme before proceeding with the ε-duality investigations that lead to constructing closedness type regularity conditions for guaranteeing strong and stable duality, respectively.

Consider two locally convex Hausdorff vector spaces *X* and *Y* and the proper function $F:X\to \overline{\mathbb{R}}$. Let the general optimization problem

Using a proper *perturbation function* $\Phi :X\times Y\to \overline{\mathbb{R}}$, fulfilling Φ(*x*, 0) = *F*(*x*) for all *x* ∈ *X*, a hypothesis that guarantees that 0 ∈ Pr_{Y}domΦ, the problem (*PG*) can be rewritten as

We call *Y* the *perturbation space* and its elements *perturbation variables*. Note that the way Φ is defined guarantees that 0 ∈ Pr_{Y}(domΦ). To (*PG*) one attaches the following *conjugate dual* problem (cf., for instance, [19, 26, 27, 29])

and for this primal-dual pair of optimization problems *weak duality* always holds, i.e., *v*(*DG*) ≤ *v*(*PG*). In order to investigate further duality properties of these optimization problems, for each *x** ∈ *X** we consider the following problem

obtained by linearly perturbing the objective function of (*PG*). Thus (*PG*) is embedded in the family of optimization problems $\left\{(P{G}_{{x}^{*}}):{x}^{*}\in {X}^{*}\right\}$, where it coincides with (*PG*_{0}). To each problem in the mentioned family one can attach the corresponding conjugate dual problem, namely, for *x** ∈ *X**,

By construction, whenever *x** ∈ *X** one has $v(D{G}_{{x}^{*}})\le v(P{G}_{{x}^{*}})$, but more important is to find out when the optimal objective values of the primal and its corresponding dual problem coincide or they are different with less than a given small ε ≥ 0.

**Definition 2.1.** Let ε ≥ 0. We say that there is ε*-duality gap* for the problems (*PG*) and (*DG*) if *v*(*PG*) − *v*(*DG*) ≤ ε. If $v(P{G}_{{x}^{*}})-v(D{G}_{{x}^{*}})\le \epsilon $ for all *x** ∈ *X**, we say that for (*PG*) and (*DG*) one has *stable* ε*-duality gap*.

**Definition 2.2.** We say that there is *strong duality* for the problems (*PG*) and (*DG*) if *v*(*PG*) = *v*(*DG*) and (*DG*) has an optimal solution. When there is strong duality for (*PG*) and (*DG*) and (*PG*) has an optimal solution, too, one speaks about *total duality*. If $v(P{G}_{{x}^{*}})=v(D{G}_{{x}^{*}})$ and $(D{G}_{{x}^{*}})$ has an optimal solution for all *x** ∈ *X**, we say that for (*PG*) and (*DG*) one has *stable strong duality*.

**Definition 2.3.** Let ε ≥ 0. An element *x* ∈ *X* is said to be an ε*-optimal solution* to (*PG*) if 0 ∈ ∂_{ε} Φ (·, 0)(*x*).

In order to ensure strong duality for (*PG*) and (*DG*) one usually assumes that Φ is convex and a certain regularity condition is fulfilled. Various such additional hypotheses were considered in the literature (some of which are mentioned later in Remark 8), the most relevant being the interiority type ones (mentioned in [19, 27]) and the closedness type ones (cf. [3, 4, 6, 7, 10, 19, 29]). Moreover, the situation of total duality is closely related to some subdifferential formulae and the regularity conditions can be used to guarantee these, too. However, in some situations one can only show that the difference between the optimal objective values of the primal and dual problem is less than an ε ≥ 0, situation coined in Boncea and Grad [21, 22] as ε-duality gap. Using as a basis our investigations in these articles, where the ε-duality gap for composed and constrained optimization problems, respectively, were characterized via epigraph and subdifferential inclusions, we provide in the following section characterizations via epigraph inclusions of stable ε-duality gap (for an ε ≥ 0) for very general optimization problems, with the involved functions not necessary convex, only proper. Endowing then the functions with the classical convexity and topological properties, we derive new important equivalences as well as sufficient conditions, from which when ε = 0 *closedness type regularity conditions* are derived. These can then be employed, for instance, for subdifferential formulae, as done in Boţ et al. [18], Hiriart-Urruty [34], and Boţ and Grad [35] or, like in Boţ and Grad [36] and Grad and Wanka [37], for providing formulae for biconjugates of combinations of functions.

After presenting these investigations for general optimization problems, we deal with both *constrained* and *unconstrained optimization problems*, showing how the mentioned results can be specialized for them, too, by means of the perturbation theory (cf. [26, 27]). In this way some of our results from Grad [10], Boţ et al. [18, 20, 29, 38, 39], Boncea and Grad [21, 22], and Boţ and Grad [35] as well as different others from the literature (e.g., from [2–4, 6, 7, 19]) can be obtained as special cases of the general statements presented below.

Before proceeding, we recall a statement that will play an important role later in our investigations when additional convexity and topological hypotheses will be considered on the function Φ in order to derive closedness type regularity conditions for various duality situations.

**Lemma 2.1.** *(cf. [40, Theorem 2.2 and Theorem 2.3], see also [19, Theorem 5.1 and Theorem 5.2] and [1]) Let the function Φ be also convex and lower semicontinuous. Then one has* ${(\Phi (\xb7,0))}^{*}={\text{cl}}_{{\omega}^{*}}{\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}(\xb7,{y}^{*})$ *and*

To make this review paper as self-contained as possible, we recall the definition of the Lagrangian function for the pair of primal-dual problems $(P{G}_{{x}^{*}})-(D{G}_{{x}^{*}})$, where *x** ∈ *X**, and a nice connection between it and the optimal objective values of the mentioned problems (cf. [26, 27, 29]).

**Definition 2.4.** Let *x** ∈ *X**. The function ${L}^{(P{G}_{{x}^{*}})}:X\times {Y}^{*}\to \overline{\mathbb{R}}$ defined by

is called the *Lagrangian function* of the pair of primal-dual problems $(P{G}_{{x}^{*}})-(D{G}_{{x}^{*}})$ relative to the perturbation function Φ.

**Remark 3.** Given *x** ∈ *X**, one can rewrite the primal-dual pair of problems $(P{G}_{{x}^{*}})-(D{G}_{{x}^{*}})$ by means of the Lagrangian ${L}^{(P{G}_{{x}^{*}})}$ as follows. The dual problem $(D{G}_{{x}^{*}})$ is equivalent to ${\mathrm{sup}}_{y*\in Y*}{\mathrm{inf}}_{x\in X}{L}^{(P{G}_{{x}^{*}})}$, while if for any *x* ∈ *X* the function Φ(*x*, ·) is convex, lower semicontinuous and nowhere equal to −∞, $(P{G}_{{x}^{*}})$ actually means ${\mathrm{inf}}_{x\in X}{\mathrm{sup}}_{y*\in Y*}{L}^{(P{G}_{{x}^{*}})}$. Note that even without the additional hypotheses, $v(P{G}_{{x}^{*}})\ge {\mathrm{inf}}_{x\in X}{\mathrm{sup}}_{y*\in Y*}{L}^{(P{G}_{{x}^{*}})}$.

## 3. Characterizations Involving Epigraphs

Most of the closedness type regularity conditions that can be found in the literature are constructed by means of epigraphs and this section is dedicated to them.

Let ε ≥ 0. We begin our presentation with a characterization via epigraph inclusions of a situation of partial stable ε-duality gap for the problems (*PG*) and (*DG*) that holds for very general proper functions, no convexity or topological assumptions being necessary in order to derive it. Despite its simple formulation and proof, this statement is a key result for the following presentation and one shall see that using it virtually all the statements involving closedness type regularity conditions from the literature on duality for convex optimization problems, some of which have quite involved proofs in the original sources, can be rediscovered.

**Theorem 3.1.** *Given a subset W of X*, one has*

*if and only if for each x* ∈ W there exists a ȳ* ∈ Y* such that*

*PROOF*. If *W* is empty or for *x** ∈ *W* it holds (Φ(·, 0))*(*x**) = +∞, there is nothing to prove, since subtracting anything from an empty set gives again the empty set and ${(\Phi (\xb7,0))}^{*}\le {\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}(\xb7,{y}^{*})$, respectively.

Let *x** ∈ *W* such that (Φ(·, 0))*(*x**) ∈ ℝ. Then (*x**, (Φ(·, 0))*(*x**)) ∈ epi(Φ(·, 0))*. For ȳ* ∈ *Y** one has (*x**, ȳ*, (Φ(·, 0))*(*x**)) ∈ epi Φ* − (0, 0, ε) if and only if Φ*(*x**, ȳ*) ≤ (Φ(·, 0))*(*x**) + ε, hence the desired equivalence. □

**Remark 4.** One can rewrite the inequality (Equation 2) as −(Φ(·, 0))*(*x**) ≤ −Φ*(*x**, ȳ*) + ε, where in the left-hand side there is actually $v(P{G}_{{x}^{*}})$. However, in the right-hand side one does not necessarily have $v(D{G}_{{x}^{*}})+\epsilon $, since there is no guarantee that the supremum in $(D{G}_{{x}^{*}})$ is attained at ȳ*. Consequently, Equation (2) implies $v(P{G}_{{x}^{*}})\le v(D{G}_{{x}^{*}})+\epsilon $, i.e., condition (1) implies that there is a partial (because *x** ∈ *W* ⊆ *X**) stable ε-duality gap for the problems (*PG*) and (*DG*). Note also that employing (Equation 2), one can characterize the stable ε-duality gap for the primal-dual pair (*PG*) − −(*DG*) via the epigraph inclusion

When ε = 0 the epigraph inclusion and the inequality from Theorem 3.1 collapse both into equalities.

**Corollary 3.2.** *Given a subset W of X*, one has*

*if and only if for each x* ∈ W there exists a ȳ* ∈ Y* such that*

Taking *W* = *X**, one obtains an epigraph inclusion that ensures the stable ε-duality gap for (*PG*) and (*DG*), that (taking into consideration Corollary 3.2) becomes stable strong duality when ε = 0.

**Corollary 3.3.** *It holds*

*if and only if for each x* ∈ X* there exists a ȳ* ∈ Y* such that*

**Corollary 3.4.** *It holds*

*if and only if for each x* ∈ X* there exists a ȳ* ∈ Y* such that*

Using Theorem 3.1, one can derive necessary and sufficient ε-optimality conditions for primal-dual pairs $(P{G}_{{x}^{*}})-(D{G}_{{x}^{*}})$, where *x** ∈ *X**.

**Theorem 3.5.** *Let W be a subset of X* and x* ∈ W*.

*(a) If $\overline{x}\in X$ is an optimal solution to $(P{G}_{{x}^{*}})$ and Equation (1) is satisfied, then there exists an ε-optimal solution ȳ* ∈ Y* to $(D{G}_{{x}^{*}})$, such that*

*or, equivalently,*

*(b) Assume that $\overline{x}\in X$ and ȳ* ∈ Y* fulfill (Equations 6 or 7). Then $\overline{x}$ is an ε-optimal solution to $(P{G}_{{x}^{*}})$, ȳ* is an ε-optimal solution to $(D{G}_{{x}^{*}})$ and $v(P{G}_{{x}^{*}})\le v(D{G}_{{x}^{*}})+\epsilon $*.

*PROOF*. (a) From Theorem 3.1 and Remark 4 one obtains $\Phi (\overline{x},0)+{\Phi}^{*}({x}^{*},{\u0233}^{*})\le \langle {x}^{*},\overline{x}\rangle +\epsilon $. The weak duality for $(P{G}_{{x}^{*}})$ and $(D{G}_{{x}^{*}})$ yields $v(D{G}_{{x}^{*}})\le -{\Phi}^{*}({x}^{*},{\u0233}^{*})+\epsilon $, i.e., ȳ is an ε-optimal solution to $(D{G}_{{x}^{*}})$.

(b) From Equation (6) one gets $\Phi (\overline{x},0)-\langle {x}^{*},\overline{x}\rangle \le \epsilon -{\Phi}^{*}(0,{\u0233}^{*})$, that, employing also the weak duality, implies $v(D{G}_{{x}^{*}})\le v(P{G}_{{x}^{*}})\le \Phi (\overline{x},0)-\langle {x}^{*},\overline{x}\rangle \le \epsilon -{\Phi}^{*}(0,{\u0233}^{*})\le v(D{G}_{{x}^{*}})+\epsilon \le v(P{G}_{{x}^{*}})+\epsilon $. Then $\overline{x}$ is an ε-optimal solution to $(P{G}_{{x}^{*}})$ and ȳ* one to $(D{G}_{{x}^{*}})$.

□

**Remark 5.** Note that in Theorem 3.5 one does not obtain the kind of equivalence usually delivered in optimality conditions statements as in *a*) one assumes $\overline{x}$ to be an optimal solution to $(P{G}_{{x}^{*}})$, while in *b*) $\overline{x}$ turns out to be only an ε-optimal solution to $(P{G}_{{x}^{*}})$.

When ε = 0, relations (Equations 6 and 7) become *optimality conditions* for $(P{G}_{{x}^{*}})$ and $(D{G}_{{x}^{*}})$.

**Corollary 3.6.** *Let W be a subset of X* and x* ∈ W*.

*(a) If $\overline{x}\in X$ is an optimal solution to $(P{G}_{{x}^{*}})$ and the condition (4) is satisfied, then there exists an optimal solution ȳ* ∈ Y* to $(D{G}_{{x}^{*}})$, such that*

*or, equivalently,*

*(b) Assume that $\overline{x}\in X$ and ȳ* ∈ Y* fulfill (Equations 8 or 9). Then $\overline{x}$ is an optimal solution to $(P{G}_{{x}^{*}})$, ȳ* is an optimal solution to $(D{G}_{{x}^{*}})$ and $v(P{G}_{{x}^{*}})=v(D{G}_{{x}^{*}})$.*

**Remark 6.** When *W* = *X**, Corollary 3.6 delivers *stable optimality conditions* for (*PG*) and (*DG*).

**Remark 7.** Taking *x** = 0 in Theorem 3.5 one obtains ε-optimality conditions for the primal-dual pair of optimization problems (*PG*) − (*DG*) and, moreover, (or, alternatively, directly from Corollary 3.3) that the satisfaction of the condition (5) guarantees that there is ε-duality gap for these problems.

So far we have *deconstructed* the closedness type regularity conditions formulated by means of epigraph inclusions, showing that such inclusions are intimately connected to ε-duality gap statements. In the following we will *reconstruct* them and for this we add convexity and topological properties to the function Φ.

We begin with an characterization of Equation (2) by means of the notion of the (0, ε)-vertical closedness of the conjugate of Φ regarding a product set that can be obtained via Lemma 2.1 and Theorem 3.1.

**Theorem 3.7.** *Let W be a subset of X* and take the function Φ also convex and lower semicontinuous. Then the set* ${\text{Pr}}_{{X}^{*}\times \mathbb{R}}\text{epi}{\Phi}^{*}$

*is (0, ε)-vertically closed regarding*

*W*× ℝ in the topology ω(*X**,*X*) × ${R}$ if and only if for every*x** ∈*W*there exists a ȳ* ∈*Y** such that Equation (2) holds.When ε = 0 Theorem 3.7 collapses to Boţ [19, Theorem 9.1].

**Corollary 3.8.** *Let W be a subset of X* and the function Φ be also convex and lower semicontinuous. Then the set* ${\text{Pr}}_{{X}^{*}\times \mathbb{R}}\text{epi}{\Phi}^{*}$

*is closed regarding the set*

*W*×ℝ in the topology ω(*X**,*X*) × ${R}$ if and only if for each*x** ∈*W*there exists a ȳ* ∈*Y** such thatTaking in Theorem 3.7 *W* = *X** one gets the following statement.

**Corollary 3.9.** *Let the function Φ be also convex and lower semicontinuous. Then the set* ${\text{Pr}}_{{X}^{*}\times \mathbb{R}}\text{epi}{\Phi}^{*}$ *is (0, ε)-vertically closed in the topology ω( X*, X) × ${R}$ if and only if for each x* ∈ X* there exists a ȳ* ∈ Y* such that*

Taking in Corollary 3.8 moreover *W* = *X** (or ε = 0 in Corollary 3.9, noticing also the comment preceding Corollary 3.1), one obtains a characterization of the stable strong duality for (*PG*) and (*DG*), rediscovering thus [29, Theorem 3.2.2] and [4, Theorem 3.1].

**Corollary 3.10.** *Let the function Φ be also convex and lower semicontinuous. Then the set* ${\text{Pr}}_{{X}^{*}\times \mathbb{R}}\text{epi}{\Phi}^{*}$ *is closed in the topology ω( X*, X) × ${R}$ if and only if for each x* ∈ X* there exists a ȳ* ∈ Y* such that*

A crucial consequence of Theorem 3.7, via Corollary 3.10, is the strong duality statement for (*PG*) and (*DG*) that follows (see also [1, 3, 4, 19, 29]) and contains the weakest hypotheses that guarantee this outcome.

**Corollary 3.11.** *Assume that Φ is convex and lower semicontinuous. If* ${\text{Pr}}_{{X}^{*}\times \mathbb{R}}$ *epi Φ* is a closed set in the topology ω( X*, X) × ${R}$, then v(PG) = v(DG) and the dual problem (DG) has an optimal solution ȳ* ∈ Y*.*

**Remark 8.** Several regularity conditions were proposed in the literature in order to achieve strong duality for (*PG*) and (*DG*). We list in the following the most important of those considered when the function Φ is convex (cf. [19, 27, 29]), namely the one involving continuity

a weak generalized interiority type one,

another one applicable when the dimension of the linear hull of Pr_{Y}(dom Φ) is finite,

and finally the closedness type regularity condition already mentioned in Corollary 3.11,

Worth noticing is that that all these four regularity conditions ensure actually stable strong duality for the primal-dual pair of optimization problems (*PG*) − −(*DG*). One can thus notice that $(R{C}_{i}^{G})$, *i* = 1, 2, 3, imply $(R{C}_{4}^{G})$, which is equivalent to the stable strong duality for (*PG*) and (*DG*). An example to show that the closedness type regularity condition $(R{C}_{4}^{G})$ is indeed weaker than its counterparts of continuity or interiority type follows, others being available for instance in Boţ et al. [18, 20].

**Example 3.** (cf. [6]) Let *X* = *Y* = ℝ and $\Phi :\mathbb{R}\times \mathbb{R}\to \overline{\mathbb{R}}$, Φ(*x*, *y*) = δ_{ℝ+}(*x*)+δ_{ℝ−}(*x* + *y*). Then ${\text{Pr}}_{{X}^{*}\times \mathbb{R}}\text{epi}{\Phi}^{*}=\mathbb{R}\times {\mathbb{R}}_{+}$ is closed, thus $(R{C}_{4}^{G})$ is satisfied, while neither is Φ(0, ·) continuous at 0 nor is 0 ∈ ri Pr_{Y}(dom Φ) = (−∞, 0) fulfilled, hence $(R{C}_{i}^{G})$, *i* = 1, 2, 3, fail in this case.

Necessary and sufficient *optimality conditions* for $(P{G}_{{x}^{*}})$ and $(D{G}_{{x}^{*}})$, where *x** ∈ *W* ⊆ *X** follow by means of Theorem 3.5 via Corollary 3.10 (see also [19, 27, 29]).

**Corollary 3.12.** *Let W be a subset of X* and x* ∈ W.*

*(a) Assume that Φ is convex. Let* $\overline{x}\in X$ *be an optimal solution to* $(P{G}_{{x}^{*}})$ *and assume that one of the regularity conditions* $(R{C}_{i}^{G})$, *i ∈* {1, 2, 3, 4}, *is fulfilled. Then there exists a ȳ* ∈ Y*, an optimal solution to* $(D{G}_{{x}^{*}})$,

*such that one has*

*or, equivalently,*

*(b) Assume that* $\overline{x}\in X$ *and ȳ* ∈ Y* fulfill (Equation 10) or (Equation 11). Then* $\overline{x}$

*is an optimal solution to*$(P{G}_{{x}^{*}})$,

*ȳ* is an optimal solution to*$(D{G}_{{x}^{*}})$

*and*$v(P{G}_{{x}^{*}})=v(D{G}_{{x}^{*}})$.

**Remark 9.** When *W* = *X**, Corollary 3.12 delivers what may be called *stable optimality conditions* for (*PG*) and (*DG*). Taking there *x** = 0 one obtains necessary and sufficient optimality conditions for (*PG*) and (*DG*) (see also [19, 27, 29]).

As byproducts of the duality investigations presented in this subsection one can also derive ε*-Farkas statements* and results involving (η, ε)*-saddle points*, inspired for instance by Boţ and Wanka [41], as follows. We begin with the ε*-Farkas type* results for $(P{G}_{{x}^{*}})$ and $(D{G}_{{x}^{*}})$, where *x** ∈ *W* ⊆ *X**. They extend some recent Farkas type statements from the literature that generalize the classical *Farkas Lemma*. For more on the latest developments in the literature on Farkas type statements we refer the reader to the survey [42] together with the references therein and the additional discussion from the same issue of the journal.

**Theorem 3.13.** *Let W be a subset of X*.*

*(a) Suppose the validity of Equation (1). For x* ∈ W, if one has Φ*(

*x,*0)

*− 〈*2

*x**,*x*〉 ≥ ε/*for all*2.

*x*∈*X*, then there exists a ȳ* ∈*Y** such that Φ*(*x**, ȳ*) ≤ ε/*(b) For x* ∈ W, if there exists a ȳ* ∈ Y* such that Φ*(x*, ȳ*) ≤ − ε/*2,

*then Φ*(

*x*, 0)

*− 〈*2

*x**,*x*〉 ≥ ε/*for all*

*x*∈*X*.*PROOF*. (a) The existence of ȳ* ∈ *Y** such that −(Φ(·, 0))* (*x**) ≤ ε − Φ*(*x**, ȳ*) is guaranteed by Theorem 3.1. Then ε/2 ≤ ε − Φ*(*x**, ȳ*) and the conclusion follows.

(b) The weak duality for $(P{G}_{{x}^{*}})$ and $(D{G}_{{x}^{*}})$ yields Φ(*x*, 0) − 〈*x**, *x*〉 ≥ −Φ*(*x**, ȳ*) ≥ ε/2.

□

Using Equation (3) as a regularity condition other ε-Farkas type results for $(P{G}_{{x}^{*}})$ and $(D{G}_{{x}^{*}})$, where *x** ∈ *W* ⊆ *X**, can be formulated and proven analogously to the ones in Theorem 3.13.

**Theorem 3.14.** *Let W be a subset of X*.*

*(a) Suppose that Equation (3) holds. For x* ∈ W, if Φ*(

*x*, 0)

*− 〈*2

*x**,*x*〉 ≥ ε/*for all*

*x*∈*X*then ${\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}({x}^{*},{y}^{*})\le \epsilon /2$.*(b) Given x* ∈ W, if ${\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}({x}^{*},{y}^{*})\le -\epsilon /2$, then Φ*(

*x*, 0)

*− 〈*2

*x**,*x*〉 ≥ ε/*for all*

*x*∈*X*.If ε = 0, the ε-Farkas type results become equivalences, as follows.

**Corollary 3.15.** *Let W be a subset of X* and suppose that Equation (4) holds. Given x* ∈ W, one has Φ*(

*x*, 0)

*− 〈*0

*x**,*x*〉 ≥*for all*0.

*x*∈*X*if and only if there exists a ȳ* ∈*Y** such that Φ*(*x**, ȳ*) ≤In the following statement we assume that Equation (3) holds as an equality for ε = 0.

**Corollary 3.16.** *Let W be a subset of X* and suppose that* $\text{epi}{(\Phi (\xb7,0))}^{*}=\text{epi}{\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}(\xb7,{y}^{*})$.

*Given*(

*x** ∈*W*, one has Φ*x*, 0) − 〈

*x**,

*x*〉 ≥ 0

*for all*${\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}({x}^{*},{y}^{*})\le 0$.

*x*∈*X*if and only ifIn order to deal with statements involving (η, ε)-saddle points, we generalize the classical notion of a saddle point (cf. [10, 21]).

**Definition 3.1.** Let η ≥ 0 and *x** ∈ *X**. We say that $(\overline{x},{\u0233}^{*})\in X\times {Y}^{*}$ is an (η, ε)-*saddle point* of the Lagrangian ${L}^{(P{G}_{{x}^{*}})}$ if

**Remark 10.** The notion of an ε-saddle point of a function with two variables was already considered in the literature, see for instance [43, 44].

Slightly weakening the properness hypothesis imposed on Φ and adding to it convexity and topological assumptions, one obtains the following statement connecting the (η, ε)-saddle points of ${L}^{(P{G}_{{x}^{*}})}$ with the (ε+η)-duality gap for the problems $(P{G}_{{x}^{*}})$ and $(D{G}_{{x}^{*}})$, and the existence of some (ε+η)-optimal solutions to them.

**Theorem 3.17.** *Let η* ≥ 0 *and x** ∈ *X**.

*(a) If $(\overline{x},{\u0233}^{*})\in X\times {Y}^{*}$ is an (η, ε)-saddle point of ${L}^{(P{G}_{{x}^{*}})}$ and $\Phi (\overline{x},\xb7)$ is convex, lower semicontinuous and nowhere equal to −∞, then $\overline{x}$ is an (ε + η)-optimal solution to $(P{G}_{{x}^{*}})$, ȳ* is an (ε + η)-optimal solution to $(D{G}_{{x}^{*}})$ and there is (ε+η)-duality gap for the primal-dual pair of problems $(P{G}_{{x}^{*}})-(D{G}_{{x}^{*}})$.*

*(b) If ν ≥ 0, $\overline{x}\in X$ is an ε-optimal solution to $(P{G}_{{x}^{*}})$, ȳ* ∈ Y* is an η-optimal solution to $(D{G}_{{x}^{*}})$ and $v(P{G}_{{x}^{*}})\le v(D{G}_{{x}^{*}})+\nu $, then $(\overline{x},{\u0233}^{*})\in X\times {Y}^{*}$ is an (η+ε+ν, η+ε+ν)-saddle point of ${L}^{(P{G}_{{x}^{*}})}$.*

*PROOF*. (a) From Definition 3.1 one gets via Remark 3 that

Using the weak duality for the problems $(P{G}_{{x}^{*}})$ and $(D{G}_{{x}^{*}})$, Equation (12) yields $v(D{G}_{{x}^{*}})-\eta \le \epsilon -{\Phi}^{*}({x}^{*},{\u0233}^{*})$ and $\Phi (\overline{x},0)-\langle {x}^{*},\overline{x}\rangle -\eta \le \epsilon -v(P{G}_{{x}^{*}})$, hence $\overline{x}$ is an (ε + η)-optimal solution to $(P{G}_{{x}^{*}})$ and ȳ* is an (ε + η)-optimal solution to $(D{G}_{{x}^{*}})$. Relation Equation (12) implies also that $\Phi (\overline{x},0)-\langle {x}^{*},\overline{x}\rangle -\eta \le \epsilon -{\Phi}^{*}({x}^{*},{\u0233}^{*})$, consequently $v(P{G}_{{x}^{*}})\le v(D{G}_{{x}^{*}})+\eta +\epsilon $.

(b) Using again Remark 3, one obtains that $\Phi (\overline{x},0)-\langle {x}^{\ast},\overline{x}\rangle \ge {\mathrm{sup}}_{{y}^{\ast}\in {Y}^{\ast}}{L}^{(P{G}_{{x}^{\ast}})}(\overline{x},{y}^{\ast})\ge {L}^{(P{G}_{{x}^{\ast}})}(\overline{x},{\overline{y}}^{\ast})$ and $-{\Phi}^{\ast}(0,{\overline{y}}^{\ast})={\mathrm{inf}}_{x\in X}{L}^{(P{G}_{{x}^{\ast}})}(x,{\overline{y}}^{\ast})\le {L}^{(P{G}_{{x}^{\ast}})}(\overline{x},{\overline{y}}^{\ast})$. But $\overline{x}$ is an ε-optimal solution to $(P{G}_{{x}^{*}})$ and ȳ* is an η-optimal solution to $(D{G}_{{x}^{*}})$, consequently

Recalling that $v(P{G}_{{x}^{*}})\le v(D{G}_{{x}^{*}})+\nu $, one obtains from here

followed by

Employing again the formulae derived above via Remark 3 one obtains that $(\overline{x},{\u0233}^{*})\in X\times {Y}^{*}$ is an (η + ε + ν, η + ε + ν)-saddle point of ${L}^{(P{G}_{{x}^{*}})}$.

□

If one takes in Theorem 3.17 η = ε = ν = 0, the two assertions become equivalent, rediscovering [29, Theorem 3.3.2].

**Corollary 3.18.** *Let x* ∈ X* and assume that Φ is a convex and lower semicontinuous function taking nowhere the value −∞. Then $(\overline{x},{\u0233}^{*})\in X\times {Y}^{*}$ is a saddle point of ${L}^{(P{G}_{{x}^{*}})}$ if and only if $\overline{x}$ is an optimal solution to $(P{G}_{{x}^{*}})$, ȳ* is an optimal solution to $(D{G}_{{x}^{*}})$ and $v(P{G}_{{x}^{*}})=v(D{G}_{{x}^{*}})$.*

The general scalar optimization problem (*PG*) encompasses as special cases different classes of scalar optimization problems. We dedicate the next subsections to writing constrained and unconstrained optimization problems as special cases of (*PG*) and dual problems will be assigned to them by employing carefully chosen perturbation functions (see [19, 29] for more details).

### 3.1. Constrained Scalar Optimization Problems

Consider the nonempty set *S* ⊆ *X* and let the convex cone *C* ⊆ *Y* induce a partial ordering on *Y*. Take the proper functions $f:X\to \overline{\mathbb{R}}$ and *h* : *X* → *Y*^{•}, fulfilling the *feasibility condition* dom *f* ∩ *S* ∩ *h*^{−1}(−*C*) ≠ ∅. The general primal *constrained* scalar optimization problem is

whose *feasible set* is

One can find several perturbation functions for which (*PC*) turns out to be a special case of (*PG*). We consider in our presentation two of them, each assigning another dual problem to (*PC*) that arises from (*DG*) (cf. [19, 29]).

The *classical Lagrange dual problem* to (*PC*),

can be seen as a special case of (*DG*) via the perturbation function

that is proper as *f* and *h* are proper and the feasibility condition is satisfied, and whose conjugate is

We begin with a characterization via epigraph inclusions of a situation of stable ε-duality gap for the problems (*PC*) and (*DC*^{L}) that is a special case of Theorem 3.1.

**Theorem 3.19.** *Let W be a subset of X*. Then it holds*

*if and only if for each x* ∈ W there exists a ${\overline{z}}^{*}\in {C}^{*}$ such that*

**Remark 11.** Analogously, one can particularize the other statements regarding pairs of primal-dual problems $(P{G}_{{x}^{*}})-(D{G}_{{x}^{*}})$, *x** ∈ *X**, for constrained optimization problems and their Lagrange duals, rediscovering or improving different statements from Boţ et al. [20, 39], Boncea and Grad [22], and Jeyakumar and Li [45, 46]. Under additional assumptions which guarantee the convexity of the perturbation function Φ^{L} (e.g., take *S* and *f* convex and *h C*-convex), the strong duality statement for the problems (*PC*) and (*DC*^{L}) can be derived directly from Corollary 3.11 or Remark 8 by particularizing $(R{C}_{i}^{G})$, *i* ∈ {1, 2, 3, 4} to (cf. [19, 29])

that is actually the classical *Slater constraint qualification*,

then, when the linear hull of *h*(dom *f* ∩ *S* ∩ dom *h*) + *C* is finitely dimensional,

and

Another perturbation function employed to assign a conjugate dual problem to (*PC*) as a special case of (*DG*) is (cf. [19, 29])

that is proper as well because *f* and *h* are proper and due to the fulfillment of the mentioned feasibility condition, and has as conjugate the function ${({\Phi}^{FL})}^{*}:{X}^{*}\times {X}^{*}\times {Y}^{*}\to \overline{\mathbb{R}}$,

The dual problem it assigns to (*PC*) is the *Fenchel-Lagrange dual problem*

For reader's convenience we give the characterization via epigraph inclusions of a situation of stable ε-duality gap for the problems (*PC*) and (*DC*^{FL}), that is a special case of Theorem 3.1.

**Theorem 3.20.** *Let W be a subset of X*. Then it holds*

*if and only if for each x* ∈ W there exist ȳ* ∈ X* and ${\overline{z}}^{*}\in {C}^{*}$ such that*

**Remark 12.** Analogously, one can particularize the other statements regarding pairs of primal-dual problems $(P{G}_{{x}^{*}})-(D{G}_{{x}^{*}})$, *x** ∈ *X**, for constrained optimization problems and their Fenchel-Lagrange duals, rediscovering or improving different statements from Grad [10], Boţ et al. [20, 38], and Boncea and Grad [22]. Under additional assumptions which guarantee the convexity of the perturbation function Φ^{L} (e.g., take *S* and *f* convex and *h C*-convex), the strong duality statement for the problems (*PC*) and (*DC*^{FL}) can be derived directly from Corollary 3.11 or Remark 8 by particularizing $(R{C}_{i}^{G})$, *i* ∈ {1, 2, 3, 4} to (cf. [19, 29])

then, when dom $\text{dom\hspace{0.17em}}f\times C\text{\hspace{0.17em}}-\text{\hspace{0.17em}}{\text{epi}}_{\text{\hspace{0.17em}}-C}(-h)\cap (S\times Z$ if finitely dimensional,

and

One can employ other perturbation functions for proposing conjugate dual problems to (*PC*) as special cases of (*DG*), too. For instance, using the perturbation function Φ^{EFL} : *X* × *X* × *X* × *Y* → ℝ,

that is proper as well because *f* and *h* are proper and due to the fulfillment of the mentioned feasibility condition and has as conjugate the function ${({\Phi}^{EFL})}^{*}:{X}^{*}\times {X}^{*}\times {X}^{*}\times {Y}^{*}\to \overline{\mathbb{R}}$,

one can attach to (*PC*) is the *extended Fenchel-Lagrange dual problem* (cf. [22, 38])

which will not be mentioned further (see [22, 38] for similar statements regarding this dual problem to (*PC*) that can be rediscovered as special cases of the main ones from this paper).

**Remark 13.** To give stable ε-duality statements for (*PC*) and the dual problems we assigned to it within this subsection one can introduce like in Boncea and Grad [22] and Jeyakumar and Li [45, 46] the functions *h*^{◇}, ${h}_{S}^{\u25c7}:{X}^{*}\to \overline{\mathbb{R}}$, defined by ${h}^{\u25c7}={\text{inf}}_{{z}^{*}\in {C}^{*}}{({z}^{*}h)}^{*}$ and ${h}_{S}^{\u25c7}={\text{inf}}_{{z}^{*}\in {C}^{*}}{({z}^{*}h)}_{S}^{*}$, respectively. Then, for instance, the stable ε-duality gap for the problems (*PC*) and (*DC*^{FL}) is characterized by the epigraph inclusion

**Remark 14.** One can obtain other significant results from the statements presented in this subsection by taking the function *f* to be identically zero, when characterizations via epigraph inclusions of relations involving the (indicator function of the) feasible set ${A}$ and, on the other hand, the constraint function *h* and the constraint set *S* can be derived, as done in Jeyakumar et al. [8, 9], Grad [10], Boncea and Grad [22], and Boţ et al. [38, 39].

### 3.2. Unconstrained Scalar Optimization Problems

Let the primal *unconstrained* optimization problem

where *A* : *X* → *Y* is a linear continuous mapping and $f:X\to \overline{\mathbb{R}}$ and $g:Y\to \overline{\mathbb{R}}$ are proper functions fulfilling the feasibility condition dom *f* ∩ *A*^{−1}(dom *g*)≠∅. The perturbation function considered for assigning to (*PU*) the classical *Fenchel dual problem*

which is proper because *f* and *g* are proper and due to the fulfillment of the mentioned feasibility condition, and has as conjugate the function

Like in the previous subsection, we give only a characterization via epigraph inclusions of a situation of stable ε-duality gap for the problems (*PU*) and (*DU*), that is a special case of Theorem 3.1, where the notation $({A}^{\ast}\times {\text{id}}_{\mathbb{R}})(\text{epi\hspace{0.17em}}{g}^{\ast})=\{({x}^{\ast},r)\in {X}^{\ast}\times \mathbb{R}:\exists {y}^{\ast}\in {Y}^{\ast}$ such that *A***y** = *x** and (*y**, *r*) ∈ epi *g**} is used.

**Theorem 3.21.** *Let W be a subset of X*. Then it holds*

*if and only if for each x* ∈ W there exists a ȳ* ∈ Y* such that*

**Remark 15.** Analogously, one can particularize the other statements regarding pairs of primal-dual problems $(P{G}_{{x}^{*}})-(D{G}_{{x}^{*}})$, *x** ∈ *X**, for unconstrained optimization problems and their Fenchel duals, rediscovering or improving different statements from Boţ and Wanka [6, 7], Grad [10], Boţ et al. [18, 20], and Boncea and Grad [21]. Under additional assumptions which guarantee the convexity of the perturbation function Φ^{U} (e.g., take *f* and *g* convex), the strong duality statement for the problems (*PU*) and (*DU*) can be derived directly from Corollary 3.11 or Remark 8 by particularizing $(R{C}_{i}^{G})$, *i* ∈ {1, 2, 3, 4} to (cf. [19, 29])

then, when the linear hull of dom *g* − *A*(dom *f*) is finitely dimensional,

condition employed also in the framework of generalized convex optimization, for instance in [47, 48] and

**Remark 16.** Significant particular instances of (*PU*) can be derived by taking *X* = *Y* and *A* to be the identity mapping on *X* or *f* to be identically zero, respectively. The dual problem (*DU*) and the corresponding duality and optimality conditions statements can be then specialized for these problems, too.

**Remark 17.** One can alternatively write (*PC*) as an unconstrained optimization problem

where the notations are consistent with the ones in the previous subsection. Taking *A*: = id_{X}, *f*: = *f* and *g*: = δ_{${A}$}, a *Fenchel dual problem* can be attached to (*PC*) and different duality statements can be obtained for this primal-dual pair of optimization problems as special cases of the ones regarding pairs of primal-dual problems $(P{G}_{{x}^{*}})-(D{G}_{{x}^{*}})$, *x** ∈ *X**. When necessary, the convexity of the feasible set ${A}$ is ensured by taking *S* convex and *h C*-convex, while when *S* is a closed set and *h* a *C*-epi-closed vector function, the set ${A}$ is closed, too.

**Remark 18.** The investigations on ε-duality regarding unconstrained problems can be extended for problems consisting in the minimization of a sum of a function with a cone-increasing function composed with a vector function. Considering a convex cone *C* ⊆ *Y*, a proper function $f:X\to \overline{\mathbb{R}}$, a proper and *C*-increasing function $g:Y\to \overline{\mathbb{R}}$ and a proper vector function *h* : *X* → *Y*^{•} fulfilling the feasibility condition dom *g* ∩ (*h*(dom *f*) + *C*) ≠ ∅, to the unconstrained composed optimization problem

different dual problems that are special cases of (*DG*) can be attached via perturbation theory. The statements regarding the pairs of primal-dual problems $(P{G}_{{x}^{*}})-(D{G}_{{x}^{*}})$, *x** ∈ *X**, can be adapted for (*PO*) and its duals, too, in some instances results from Grad [10], Boţ et al. [18], Boţ [19], and Boncea and Grad [21] being rediscovered. Alternatively, the assertions for (*PU*) and (*DU*) can be used for the same purpose by carefully constructing two functions of two variables, say *F* and *G*, such that (*F* + *G*)*(·, 0) = (*f* + *g* ∘ *h*)*, as done in Boţ et al. [18] and Boţ [19].

## 4. Characterizations Involving Subdifferentials

A second large class of closedness type regularity conditions makes use of (ε-)subdifferential inclusions instead of epigraphs. They were initially developed in connection to the notion of total duality for convex optimization problems (see for instance, [8, 38, 39] and some references therein) and in the following we present the most important issues concerning them available up to this moment.

Like in the previous section, we take an ε ≥ 0. The first statement we give presents connections between situations of stable ε-duality gap for the problems (*PG*) and (*DG*) and ε-subdifferential inclusions. Note that in this case there is no equivalence.

**Theorem 4.1.** *Let x ∈ X and ν ≥ 0. If*

*holds for all ${x}^{*}\in {\partial}_{\nu}\Phi (\xb7,0)(x)$, one has*

*Viceversa, Equation (14) yields for any ${x}^{*}\in {\partial}_{\nu}\Phi (\xb7,0)(x)$ that*

*PROOF*. When ∂_{ν}Φ(·, 0)(*x*) = ∅ there is nothing to prove.

Assume Equation (13) valid for an ${x}^{*}\in {\partial}_{\nu}\Phi (\xb7,0)(x)$. This means that for each η > 0 there exists a ${y}_{\eta}^{*}\in {Y}^{*}$ such that ${(\Phi (\xb7,0))}^{*}({x}^{*})\ge {\Phi}^{*}({x}^{*},{y}_{\eta}^{*})-\eta -\nu -\epsilon $, which, using that ${x}^{*}\in {\partial}_{\nu}\Phi (\xb7,0)(x)$, yields $\langle {x}^{*},x\rangle +\eta +\epsilon +\nu \ge \Phi (x,0)+{\Phi}^{*}({x}^{*},{y}_{\eta}^{*})$, i.e., $({x}^{*},{y}_{\eta}^{*})\in {\partial}_{\epsilon +\eta +\nu}\Phi (x,0)$. Therefore ${x}^{*}\in {\bigcap}_{\eta >0}{\text{Pr}}_{{X}^{*}}{\partial}_{\epsilon +\eta +\nu}\Phi (x,0)$, and because *x** was arbitrarily chosen in ∂Φ_{ν}(·, 0)(*x*), (14) follows.

Assume Equation (14) true and let ${x}^{*}\in {\partial}_{\nu}\Phi (\xb7,0)(x)$. Then for each η > 0 there exists a ${y}_{\eta}^{*}\in {Y}^{*}$ such that $({x}^{*},{y}_{\eta}^{*})\in {\partial}_{\epsilon +\eta +\nu}\Phi (x,0)$. Fixing an ${x}^{*}\in {\partial}_{\nu}\Phi (\xb7,0)(x)$ and η > 0, it follows that $\Phi (x,0)+{\Phi}^{*}({x}^{*},{y}_{\eta}^{*})\le \langle {x}^{*},x\rangle +\epsilon +\eta +\nu $, that is equivalent to ${\Phi}^{*}({x}^{*},{y}_{\eta}^{*})-\epsilon -\nu \le \langle {x}^{*},x\rangle -\Phi (x,0)+\eta $, which yields ${\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}({x}^{*},{y}^{*})-\epsilon -\nu \le {(\Phi (\xb7,0))}^{*}({x}^{*})+\eta $. The latter inequality holds for any η > 0, so letting η tend toward 0 we obtain Equation (15) because *x** was arbitrarily chosen in ∂_{ν}Φ(·, 0)(*x*). □

In case ν = 0, Theorem 4.1 turns into an equivalence, providing a characterization via subdifferential inclusions of a situation of stable ε-duality gap for the problems (*PG*) and (*DG*).

**Corollary 4.2.** *Let x ∈ X. Then*

*holds if and only if Equation (13) is valid for all x* ∈ ∂ Φ(·, 0)(x).*

**Remark 19.** Let *x* ∈ *X*. Employing the weak duality statements for $(P{G}_{{x}^{*}})$ and $(D{G}_{{x}^{*}})$, *x** ∈ *X**, one can show that for any ν ≥ 0 it holds ${\partial}_{\epsilon +\nu}\Phi (\xb7,0)(x)\supseteq {\bigcap}_{\eta >0}{\text{Pr}}_{{X}^{*}}$ ∂_{ν+ε+η}Φ(*x*, 0). Thus, when ε = 0 Equations (14) and (16) turn into equalities and so does also Equation (13), while Theorem 4.1 yields that if for all ν > 0 one has

then whenever μ > 0 one has ${(\Phi (\xb7,0))}^{*}({x}^{*})\ge {\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}({x}^{*},{y}^{*})-\mu $ for all ${x}^{*}\in {\partial}_{\mu}\Phi (\xb7,0)(x)$. Consequently, for all ${x}^{*}\in {\cap}_{\mu >0}{\partial}_{\mu}\Phi (\xb7,0)(x)=\partial \Phi (\xb7,0)(x)$ (here we have used the fact that the intersection regarding μ > 0 of the ε + μ-subdifferentials of a function at a point coincides with its ε-subdifferential at that point) it holds ${(\Phi (\xb7,0))}^{*}({x}^{*})\ge {\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}({x}^{*},{y}^{*})$, which actually turns into an equality since the opposite inequality holds in general and, via Theorem 4.1, yields Equation (17) for all ν > 0. Note also that in Theorem 4.1 and Corollary 4.2 we correct [10, Theorem 2.11 and Theorem 2.12] where Equations (14) and (16) were given as equalities, respectively.

**Remark 20.** The inequality (Equation 13) can be rewritten as $v(P{G}_{{x}^{*}})\le v(D{G}_{{x}^{*}})+\epsilon $, i.e., in Corollary 4.2 an equivalent characterization via subdifferential inclusions of the ε-duality gap for $(P{G}_{{x}^{*}})$ and $(D{G}_{{x}^{*}})$, when *x** ∈ ∂ Φ(·, 0)(*x*), i.e., *x* is an optimal solution to the problem $(P{G}_{{x}^{*}})$, is provided.

One can develop Remark 19 even further as follows.

**Theorem 4.3.** *One has*

*for all x ∈ X and all ν > 0 if and only if for all x* ∈ X* it holds ${(\Phi (\xb7,0))}^{*}({x}^{*})={\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}({x}^{*},{y}^{*})$.*

*PROOF*. Let *x* ∈ *X*. If (*x*, 0) ∉ dom Φ, there is nothing to prove, so we consider the case Φ(*x*, 0) ∈ ℝ. Take now *x** ∈ *X**. If (Φ(·, 0))*(*x**) = +∞ there is nothing to prove, as *x** ∉ ∂ Φ(·, 0)(*x*), otherwise ${x}^{*}\in {\partial}_{\mu}\Phi (\xb7,0)(x)$ for all μ ≥ Φ(*x*, 0)+(Φ(·, 0))*(*x**) − 〈*x**, *x*〉.

The validity of Equation (17) for ν = Φ(*x*, 0) + (Φ(·, 0))*(*x**) − 〈*x**, *x*〉 implies like in the proof of Theorem 4.1 that ${\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}({x}^{*},{y}^{*})-\nu \le \langle {x}^{*},x\rangle -\Phi (x,0)+\eta $ for all η > 0. Letting η tend toward 0 and replacing ν with its value, it follows ${\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}({x}^{*},{y}^{*})\le {(\Phi (\xb7,0))}^{*}({x}^{*})$, which, due to the general validity of the opposite inequality proves the sufficiency.

To show the necessity, let ν > 0 and ${x}^{*}\in {\partial}_{\nu}\Phi (\xb7,0)(x)$. Then the hypothesis yields $\Phi (x,0)+{\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}({x}^{*},{y}^{*})\le \langle {x}^{*},x\rangle +\nu $. If η > 0, there exists a ${y}_{\eta}^{*}\in {Y}^{*}$ such that $\Phi (x,0)+{\Phi}^{*}({x}^{*},{y}_{\eta}^{*})\le \langle {x}^{*},x\rangle +\nu +\eta $, i.e., ${x}^{*}\in {\text{Pr}}_{{X}^{*}}{\partial}_{\eta +\nu}\Phi (x,0)$. As η, *x* and ν were arbitrarily chosen, the conclusion follows via Remark 19. □

A characterization via subdifferential inclusions of a situation of ε-duality gap for (*PG*) and (*DG*) follows.

**Theorem 4.4.** *Let x ∈ X. Then*

*holds if and only if for each ${x}^{*}\in {\partial}_{\epsilon}\Phi (\xb7,0)(x)$ one has*

*PROOF*. Let *x* ∈ *X*. If (*x*, 0) ∉ dom Φ, there is nothing to prove, so we consider the case Φ(*x*, 0) ∈ ℝ.

To show the necessity, let ${x}^{*}\in {\partial}_{\epsilon}\Phi (\xb7,0)(x)$. Then for each η > 0 there exists a ${y}_{\eta}^{*}\in {Y}^{*}$ such that $({x}^{*},{y}_{\eta}^{*})\in {\partial}_{\epsilon +\eta}\Phi (x,0)$, i.e., $\Phi (x,0)+{\Phi}^{*}({x}^{*},{y}_{\eta}^{*})\le \langle {x}^{*},x\rangle +\epsilon +\eta $. This yields $\Phi (x,0)+{\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}({x}^{*},{y}^{*})\le \langle {x}^{*},x\rangle +\epsilon +\eta $ for any η > 0. Letting η tend toward 0, Equation (18) follows.

To show the opposite implication let ${x}^{*}\in {\partial}_{\epsilon}\Phi (\xb7,0)(x)$. By Equation (18), for each η > 0 there exists a ${y}_{\eta}^{*}\in {Y}^{*}$ such that $\Phi (x,0)+{\Phi}^{*}({x}^{*},{y}_{\eta}^{*})\le \langle {x}^{*},x\rangle +\epsilon +\eta $, i.e., $({x}^{*},{y}_{\eta}^{*})\in {\partial}_{\epsilon +\eta}\Phi (x,0)$. Therefore ${x}^{*}\in {\bigcap}_{\eta >0}{\text{Pr}}_{{X}^{*}}{\partial}_{\epsilon +\eta}\Phi (x,0)$. The reverse inclusion follows by Remark 19. □

**Remark 21.** For an ${x}^{*}\in {\partial}_{\epsilon}\Phi (\xb7,0)(x)$, the right-hand side of Equation (18) is actually $v(D{G}_{{x}^{*}})+\epsilon $, while in the left-hand side we have a quantity that can be larger than or equal to $(P{G}_{{x}^{*}})$. Thus, Equation (18) guarantees ε-duality gap for $(P{G}_{{x}^{*}})$ and $(D{G}_{{x}^{*}})$ and Theorem 4.4 provides a sufficient condition based on ε-subdifferential inclusions that guarantees it.

Other characterizations via subdifferential inclusions of ε-duality gap situations for (*PG*) and (*DG*) follow.

**Theorem 4.5.** *Let x ∈ X. Then*

*holds if and only if for each x* ∈ ∂ Φ(·, 0)(x) there exists a y* ∈ Y* such that*

*PROOF*. Inclusion Equation (19) holds if and only if for each *x** ∈ ∂ Φ(·, 0)(*x*) there exists a *y** ∈ *Y** such that $({x}^{*},{y}^{*})\in {\partial}_{\epsilon}\Phi (x,0)$, i.e., Φ(*x*, 0) + Φ*(*x**, *y**) ≤ 〈*x**, *x*〉 + ε. But *x** ∈ ∂ Φ(·, 0)(*x*) if and only if (Φ(·, 0))*(*x**) = 〈*x**, *x*〉 − Φ(*x*, 0) and the desired equivalence follows.

**Theorem 4.6.** *One has*

*for all x ∈ X and all ν > 0 if and only if for all x* ∈ X* it holds ${(\Phi (\xb7,0))}^{*}({x}^{*})=\underset{{y}^{*}\in {Y}^{*}}{\text{min}}{\Phi}^{*}({x}^{*},{y}^{*})$.*

*PROOF*. Let *x* ∈ *X*. If (*x*, 0) ∉ dom Φ, there is nothing to prove, so we consider the case Φ(*x*, 0) ∈ ℝ. Take now *x** ∈ *X**. If (Φ(·, 0))*(*x**) = +∞ there is nothing to prove, so we consider further that (Φ(·, 0))*(*x**) ∈ ℝ.

The validity of Equation (21) for ν = Φ(*x*, 0) + (Φ(·, 0))*(*x**) − 〈*x**, *x*〉 implies the existence of a ȳ* ∈ *Y** such that Φ*(*x**, ȳ*) ≤ 〈*x**, *x*〉 − Φ(*x*, 0) + ν, which actually means Φ*(*x**, ȳ*) ≤ 〈*x**, *x*〉 − Φ(*x*, 0) + Φ(*x*, 0) + (Φ(·, 0))*(*x**) − 〈*x**, *x*〉. Consequently, Φ*(*x**, ȳ*) ≤ (Φ(·, 0))*(*x**), which, combined with the always valid inequality ${\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}({x}^{*},{y}^{*})\ge {(\Phi (\xb7,0))}^{*}({x}^{*})$, yields the sufficiency.

To show the necessity, let ν > 0 and ${x}^{*}\in {\partial}_{\nu}\Phi (\xb7,0)(x)$. This yields Φ(*x*, 0) + (Φ(·, 0))*(*x**) ≤ 〈*x**, *x*〉 + ν. The hypothesis guarantees the existence of a ȳ* ∈ *Y** such that Φ*(*x**, ȳ*) = (Φ(·, 0))*(*x**), consequently Φ(*x*, 0) + Φ*(*x**, ȳ*) ≤ 〈*x**, *x*〉 + ν, i.e., ${x}^{*}\in {\text{Pr}}_{{X}^{*}}{\partial}_{\nu}\Phi (x,0)$. Since one always has ${\partial}_{\nu}\Phi (\xb7,0)(x)\supseteq {\text{Pr}}_{{X}^{*}}{\partial}_{\nu}\Phi (x,0)$, Equation (21) follows. □

The following statement can be shown in a similar manner.

**Theorem 4.7.** *Let x ∈ X. Then*

*holds if and only if for each ${x}^{*}\in {\partial}_{\epsilon}\Phi (\xb7,0)(x)$ there exists a ȳ* ∈ Y* such that*

Adding to the function Φ also the classical convexity and topological properties, another characterization of Equation (17) (for an alternative proof by means of epigraph inclusions consult [35, Theorem 3.1]) as well as a consequence of Corollary 4.2 can be delivered.

**Theorem 4.8.** *Let the function Φ be also convex and lower semicontinuous. The formula (17) is valid for all x ∈ X and all ν > 0 if and only if the function ${\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}(\xb7,{y}^{*})$ is ω(X*, X)-lower semicontinuous.*

*PROOF*. By Lemma 2.1, the hypotheses yield that the function (Φ(·, 0))* is actually the ω(*X**, *X*)-lower semicontinuous hull of ${\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}(\xb7,{y}^{*})$. The conclusion is then a consequence of Theorem 4.3. □

**Corollary 4.9.** *If the function Φ is also convex and lower semicontinuous and the function ${\mathrm{inf}}_{y*\in Y*}{\Phi}^{*}(\xb7,{y}^{*})$ is ω( X*, X)-lower semicontinuous, then for all x ∈ X it holds*

Under the same additional assumptions for the function Φ, one can deliver another characterization of Equation (21) that follows via Corollary 3.11 (see also [35]), by means of a closedness type regularity condition this time.

**Theorem 4.10.** *Let the function Φ be also convex and lower semicontinuous. The formula (21) is valid for all x ∈ X and all ν > 0 if and only if the set ${\text{Pr}}_{{X}^{*}\times \mathbb{R}}\text{epi}{\Phi}^{*}$ is closed in the topology ω(X*, X) × ${R}$.*

Using Theorem 4.5 and Corollary 3.11 one can provide the following statement (see also [35]).

**Corollary 4.11.** *If Φ is also convex and lower semicontinuous and the set ${\text{Pr}}_{{X}^{*}\times \mathbb{R}}\text{epi}{\Phi}^{*}$ is closed in the topology ω( X*, X) × ${R}$, then for all x ∈ X one has*

**Remark 22.** One can clearer notice the differences between the closedness type regularity conditions considered in Corollary 4.9 and Corollary 4.11 when comparing the way these can be equivalently written as formulae for the conjugate of Φ(·, 0). The first of them consists of an infimum, thus it characterizes the stable zero duality gap for (*PG*) and (*DG*), while the other one means that the same infimum is also attained, i.e., there is stable strong duality for (*PG*) and (*DG*), being thus obviously stronger than its counterpart. An example to underline this fact can be found in Boţ and Wanka [6]. The difference between these two conditions can be seen also when we equivalently characterize them as formulae for the ε-subdifferential of Φ(·, 0) in Theorem 4.8 and Theorem 4.10, respectively.

One can employ the results from this subsection for providing ε-optimality conditions for the primal-dual pair (*PG*) − − (*DG*), too. We begin with a consequence of Theorem 4.1.

**Theorem 4.12**. *(a) If Equation (3) holds and $\overline{x}\in X$ is an ε-optimal solution to ( PG), for each η > 0 there exists a ${\u0233}_{\eta}^{*}\in {Y}^{*}$ such that $(0,{\u0233}_{\eta}^{*})\in {\partial}_{\eta +\epsilon}\Phi (\overline{x},0)$, i.e., $\Phi (\overline{x},0)+{\Phi}^{*}(0,{\u0233}_{\eta}^{*})\le \eta +\epsilon $. Moreover, ${\u0233}_{\eta}^{*}$ is an η + ε-optimal solution to (DG).*

*(b) If $\overline{x}\in X$ and for each η > 0 there exists a ${\u0233}_{\eta}^{*}\in {Y}^{*}$ such that $(0,{\u0233}_{\eta}^{*})\in {\partial}_{\eta +\epsilon}\Phi (\overline{x},0)$, then $\overline{x}$ is an ε-optimal solution to ( PG), each ${\u0233}_{\eta}^{*}$ is an η+ε-optimal solution to (DG) and there is η+ε-duality gap for (PG) and (DG).*

Analogously one can employ Theorem 4.7 in order to achieve ε-optimality conditions for (*PG*) and (*DG*), as follows.

**Theorem 4.13.** *(a) Assuming that the regularity condition (21) is fulfilled and that $\overline{x}\in X$ is an ε-optimal solution to ( PG), there exists a ȳ* ∈ Y* such that $(0,{\u0233}^{*})\in {\partial}_{\epsilon}\Phi (\overline{x},0)$, i.e., $\Phi (\overline{x},0)+{\Phi}^{*}(0,{\u0233}^{*})\le \epsilon $. Moreover, ȳ* is an ε-optimal solution to (DG).*

*(b) If $\overline{x}\in X$ and ȳ* ∈ Y* fulfill $(0,{\u0233}^{*})\in {\partial}_{\epsilon}\Phi (\overline{x},0)$, then $\overline{x}$ is an ε-optimal solution to (PG), ȳ* an ε-optimal solution to (DG) and there is ε-duality gap for (PG) and (DG).*

**Remark 23.** The other statements given in this subsection can be employed for delivering ε-optimality conditions for (*PG*) and (*DG*), too. Taking ε = 0 in Theorem 4.13 or in the corresponding statements following from Theorem 4.5, Theorem 4.6 or Theorem 4.10 one rediscovers the optimality condition given in Corollary 3.6.

In the following we particularize the primal problem to be constrained and unconstrained, respectively, as done in the previous section, too.

### 4.1. Constrained Scalar Optimization Problems

Consider again the framework of Section 3.1. Using first the Lagrange perturbation function Φ^{L}, one obtains from Theorem 4.4 the following statement where a subdifferential inclusion characterizes a situation of ε-duality gap for (*PC*) and (*DC*^{L}).

**Theorem 4.14.** *Let x ∈ X. Then*

*if and only if for each ${x}^{*}\in {\partial}_{\epsilon}(f+{\delta}_{{A}})(x)$ one has*

Analogously one can particularize the other statements involving the (ε-)subdifferential of Φ(·, 0)(*x*) to the present framework, too. For instance, Theorem 4.7 turns into the following assertion.

**Theorem 4.15.** *Let x ∈ X. Then*

*if and only if for each ${x}^{*}\in {\partial}_{\epsilon}(f+{\delta}_{{A}})(x)$ there exists a z* ∈ C* such that*

Adding convexity and topological hypotheses to the functions and sets involved, one obtains the following consequences of Theorem 4.8 and Theorem 4.10, respectively.

**Theorem 4.16.** *Let S be a closed and convex set, f a convex and lower semicontinuous function and h a C-convex and C-epi-closed vector function. The formula*

*is valid for all x ∈ X and all ν > 0 if and only if the function ${\text{inf}}_{{z}^{*}\in {C}^{*}}{(f+({\overline{z}}^{*}h))}_{S}^{*}$ is ω(X*, X)-lower semicontinuous.*

**Theorem 4.17.** *Let S be a closed and convex set, f a convex and lower semicontinuous function and h a C-convex and C-epi-closed vector function. The formula*

*is valid for all x ∈ X and all ν > 0 if and only if the set ${\cup}_{{z}^{*}\in {C}^{*}}\text{epi}{(f+({z}^{*}h)+{\delta}_{S})}^{*}$ is closed in the topology ω(X*, X) × ${R}$.*

The other perturbation function we employed to assign a conjugate dual problem to (*PC*) as a special case of (*DG*) is Φ^{FL}. The statements particularized above for Φ^{L} become in this case the following ones.

**Theorem 4.18.** *Let x ∈ X. Then*

*if and only if for each ${x}^{*}\in {\partial}_{\epsilon}(f+{\delta}_{{A}})(x)$ one has*

**Theorem 4.19.** *Let x ∈ X. Then*

*if and only if for each ${x}^{*}\in {\partial}_{\epsilon}(f+{\delta}_{{A}})(x)$ there exist z* ∈ C* and y* ∈ X* such that*

**Theorem 4.20.** *Let S be a closed and convex set, f a convex and lower semicontinuous function and h a C-convex and C-epi-closed vector function. The formula*

*is valid for all x ∈ X and all ν > 0 if and only if the function ${\text{inf}}_{{z}^{*}\in {C}^{*}}f\square {({\overline{z}}^{*}h)}_{S}^{*}$ is ω(X*, X)-lower semicontinuous.*

**Theorem 4.21.** *S* be a closed and convex set, *f* a convex and lower semicontinuous function and *h* a *C*-convex and *C*-epi-closed vector function. The formula

*is valid for all x ∈ X and all ν > 0 if and only if the set $\text{epi}{f}^{*}+{\cup}_{{z}^{*}\in {C}^{*}}\text{epi}{({z}^{*}h)}_{S}^{*}$ is closed in the topology ω(X*, X) × ${R}$.*

Analogously one can particularize the other statements involving the (ε-)subdifferential of Φ(·, 0)(*x*) for Φ^{FL}, too.

### 4.2. Unconstrained Scalar Optimization Problems

Consider now the framework of Section 3.2. From Theorem 4.4 one obtains the following statement where a subdifferential inclusion characterizes a situation of ε-duality gap for (*PU*) and (*DU*).

**Theorem 4.22.** *Let x ∈ X. Then*

*if and only if for each ${x}^{*}\in {\partial}_{\epsilon}(f+g\circ A)(x)$ one has*

Further, Theorem 4.7 turns into the following assertion.

**Theorem 4.23.** *Let x ∈ X. Then*

*if and only if for each ${x}^{*}\in {\partial}_{\epsilon}(f+g\circ A)(x)$ there exists a y* ∈ X* such that*

Adding convexity and topological hypotheses to the functions and sets involved, one obtains the following consequences of Theorem 4.8 and Theorem 4.10, respectively.

**Theorem 4.24.** *Let the functions f and g be also convex and lower semicontinuous. The formula*

*is valid for all x ∈ X and all ν > 0 if and only if the function ${\mathrm{inf}}_{{y}^{*}\in {C}^{*}}\text{\hspace{0.17em}}\left[{f}^{*}({A}^{*}{y}^{*})+{g}^{*}(\xb7-{y}^{*})\right]$ is ω(X*, X)-lower semicontinuous.*

**Theorem 4.25.** *Let the functions f and g be also convex and lower semicontinuous. The formula*

*is valid for all x ∈ X and all ν > 0 if and only if the set $\text{epi}{f}^{*}+({A}^{*}\times {\text{id}}_{\mathbb{R}})(\text{epi}{g}^{*})$ is closed in the topology ω(X*, X) × ${R}$.*

Analogously one can particularize the other statements involving the (ε-)subdifferential of Φ(·, 0)(*x*) to the present framework, too. Moreover, one can see (*PC*) as an unconstrained optimization problem like in Remark 17 and the corresponding counterparts of the statements given above can be formulated for it, too.

**Remark 24.** Particularizing the results provided in this section for constrained and unconstrained convex optimization problems (and adding where necessary additional hypotheses) one can rediscover various statements from Jeyakumar et al. [8], Boţ et al. [38, 39]. Moreover, the classical *Basic Constraint Qualification* (see for instance, [11–13]) and the *Farkas-Minkowski Constraint Qualification* (cf. [14–16]) prove to be special instances of the regularity conditions presented in this section.

**Remark 25.** From the statements provided in Sections 3.1 and 3.2 one can derive ε-optimality conditions for (*PC*) and (*PU*) and their dual problems, as done in the general case in Theorem 4.12 and Theorem 4.13.

**Remark 26.** More characterizations of (stable) ε-duality gap and strong/total duality statements via epigraph and/or subdifferential inclusions similar to the ones provided within this chapter for constrained optimization problems can be found in Boncea and Grad [22], while in Boncea and Grad [21] the same kind of assertions are delivered for unconstrained composed optimization problems (see also [49]). Moreover, in Boţ and Grad [35] we have provided equivalent characterizations of zero duality gap and stable strong duality via epigraph inclusions for both constrained and unconstrained, as well for composed optimization problems with the involved functions taken convex.

## 5. Conclusions, Remarks and Further Directions of Research

The closedness type regularity conditions have proven during the last decade to be viable alternatives to their more restrictive interiority type counterparts, in both convex optimization and different areas where it was successfully applied. In this survey paper we have deconstructed and reconstructed some closedness type regularity conditions formulated by means of epigraphs and (ε-)subdifferentials, respectively, for general optimization problems, showing thus that they arise naturally when dealing with such problems. Some of the general results were particularized for constrained and unconstrained convex optimization problems, respectively.

Closedness type regularity conditions were employed by different authors in other related research fields, too, like subdifferential calculus (e.g., by [10, 18, 29, 50–52]), *DC* programming (e.g., by [51, 53–57]), generalized convex optimization (e.g., by [58–60]), semiinfinite programming (e.g., by [15, 16, 50, 53, 61–64]), semidefinite programming (e.g., by [43, 45, 46, 65]), robust optimization (e.g., by [63, 66, 67]), location optimization (e.g., by [68]), vector optimization (e.g., by [10, 29, 63, 64, 69]), monotone operators ([17, 70–78]), machine learning ([79]) or variational inequalities ([80–83]), and the list is far from being complete.

Other possible immediate research fields where we believe that the the closedness type regularity conditions may prove to be useful are bilevel optimization (possibly via the Fenchel-Lagrange approach of [84]), error bounds (maybe via the approach of [85]), equilibrium problems (possibly via variational inequalities, inspired by [80, 82, 83]) and even numerical optimization (e.g., for primal-dual algorithms, by guaranteeing strong duality).

## Author Contributions

The author S-MG worked alone on this review paper containing also results obtained with/by other authors, that have been properly cited.

## Funding

Research partially supported by DFG (German Research Foundation), projects WA 922/8-1 and GR3367/4-1.

## Conflict of Interest Statement

The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

## Acknowledgments

The author is thankful to two referees for comments and suggestions that have contributed to an improved presentation of the paper.

## References

1. Precupanu T. Closedness conditions for the optimality of a family of nonconvex optimization problems. *Math Operationsforsch Stat Ser Optim.* (1984) **15**:339–46.

2. Burachik RS, Jeyakumar V. A simple closure condition for the normal cone intersection formula. *Proc Am Math Soc*. (2005) **133**:1741–8. doi: 10.1090/S0002-9939-04-07844-X

3. Burachik RS, Jeyakumar V. A dual condition for the convex subdifferential sum formula with applications. *J Convex Anal.* (2005) **12**:279–90.

4. Burachik RS, Jeyakumar V, Wu ZY. Necessary and sufficient conditions for stable conjugate duality. *Nonlinear Anal Theory Methods Appl.* (2006) **64**:1998–2006. doi: 10.1016/j.na.2005.07.034

5. Burachik RS, Jeyakumar V. A new geometric condition for Fenchel's duality in infinite dimensional spaces. *Math Progr.* (2005) **104**:229–33. doi: 10.1007/s10107-005-0614-3

6. Boţ RI, Wanka G. A weaker regularity condition for subdifferential calculus and Fenchel duality in infinite dimensional spaces. *Nonlinear Anal Theory Methods Appl.* (2006) **64**:2787–804. doi: 10.1016/j.na.2005.09.017

7. Boţ RI, Wanka G. An alternative formulation for a new closed cone constraint qualification. *Nonlinear Anal. Theory Methods Appl.* (2006) **64**:1367–81. doi: 10.1016/j.na.2005.06.041

8. Jeyakumar V, Dinh N, Lee GM. *A New Closed Cone Constraint Qualification for Convex Optimization*. Applied Mathematics Report **04/8**, University of New South Wales (2004).

9. Jeyakumar V, Song W, Dinh N, Lee GM. *Stable Strong Duality in Convex Optimization*. Applied Mathematics Report **05/22**, University of New South Wales (2005).

10. Grad SM. *Vector Optimization and Monotone Operators via Convex Duality*. Berlin; Heidelberg: Springer-Verlag (2015).

11. Hiriart-Urruty JB, Lemaréchal C. *Convex Analysis and Minimization Algorithms I: Fundamentals. Grundlehren Math. Wiss.* Vol. **305**. Berlin: Springer (1993).

12. Tiba D, Zălinescu C. On the necessity of some constraint qualification conditions in convex programming. *J Convex Anal.* (2004) **11**:95–110.

13. Hu H. Characterizations of the strong basic constraint qualifications. *Math Oper Res.* (2005) **30**:956–65. doi: 10.1287/moor.1050.0154

14. Goberna MA, López MA, Pastor J. Farkas-Minkowski systems in semi-infinite programming. *Appl Math Optim.* (1981) **7**:295–308.

15. Dinh N, Goberna MA, López MA, Son TQ. New Farkas-type constraint qualifications in convex infinite programming. *ESAIM Control Optim Calc Var.* (2007) **13**:580–97. doi: 10.1051/cocv:2007027

16. Goberna MA, Jeyakumar V, López MA. Necessary and sufficient constraint qualifications for solvability of systems of infinite convex inequalities. *Nonlinear Anal Theory Methods Appl.* (2008) **68**:1184–194. doi: 10.1016/j.na.2006.12.014

17. Boţ RI, Grad SM, Wanka G. Maximal monotonicity for the precomposition with a linear operator. *SIAM J Optim.* (2007) **17**:1239–52. doi: 10.1137/050641491

18. Boţ RI, Grad SM, Wanka G. A new constraint qualification for the formula of the subdifferential of composed convex functions in infinite dimensional spaces. *Math Nachr.* (2008) **281**:1088–107. doi: 10.1002/mana.200510662

19. Boţ RI. *Conjugate Duality in Convex Optimization. Lecture Notes in Economics and Mathematical Systems*, Vol. **637**. Berlin; Heidelberg: Springer (2010). doi: 10.1007/978-3-642-04900-2

20. Boţ RI, Grad SM, Wanka G. New regularity conditions for Lagrange and Fenchel-Lagrange duality in infinite dimensional spaces. *Math Inequal Appl.* (2009) **12**:171–89.

21. Boncea HV, Grad SM. Characterizations of ε-duality gap statements for composed optimization problems. *Nonlinear Anal. Theory Methods Appl.* (2013) **92**:96–107. doi: 10.1016/j.na.2013.07.004

22. Boncea HV, Grad SM. Characterizations of ε-duality gap statements for constrained optimization problems. *Cent Eur J Math.* (2013) **11**:2020–33. doi: 10.2478/s11533-013-0294-9

23. Anbo Y. Nonstandard arguments and the characterization of independence in generic structures. *RIMS Kôkyûroku* (2009) **1646**:4–17. Available online at: http://hdl.handle.net/2433/140691

24. Friedman HM. A way out. In: Link G, editor. *One Hundred Years of Russell's Paradox*. Berlin; New York, NY: Walter de Gruyter (2004). p. 49–86.

25. Rubinov AM, Glover BM. Quasiconvexity via two step functions. In: Crouzeix JP, Martínez Legaz JE, Volle M, editors. *Generalized Convexity, Generalized Monotonicity: Recent Results, Nonconvex Optimization and Its Applications*. Vol. **27**. Dordrecht: Kluwer (1998). p. 159–183.

28. Ekeland I, Temam RM. *Convex Analysis and Variational Problems*. Amsterdam: North-Holland Publishing Company (1976).

30. Boţ RI, Grad SM. Wolfe duality and Mond-Weir duality via perturbations. *Nonlinear Anal Theory Methods Appl.* (2010) **73**:374–84. doi: 10.1016/j.na.2010.03.026

31. Grad SM, Pop EL. Alternative generalized Wolfe type and Mond-Weir type vector duality. *J Nonlinear Convex Anal.* (2014) **15**:867–84.

32. Boţ RI, Grad SM. Extending the classical vector Wolfe and Mond-Weir duality concepts via perturbations. *J Nonlinear Convex Anal.* (2011) **12**:81–101.

33. Boţ RI, Grad SM, Wanka G. Fenchel-Lagrange versus geometric programming in convex optimization. *J Optim Theory Appl.* (2006) **129**:33–54. doi: 10.1007/s10957-006-9047-2

34. Hiriart-Urruty JB. ε-subdifferential calculus. In: Aubin JP, Vinter RB, editors. *Convex Analysis and Optimization, Pitman Research Notes in Mathematics Series*, Vol. **57**. Boston, MA: Pitman (1982). p. 43–92.

35. Boţ RI, Grad SM. Lower semicontinuous type regularity conditions for subdifferential calculus. *Optim Methods Softw.* (2010) **25**:37–48. doi: 10.1080/10556780903208977

36. Boţ RI, Grad SM. Regularity conditions for formulae of biconjugate functions. *Taiwanese J Math.* (2008) **12**:1921–42.

37. Grad SM, Wanka G. On biconjugates of infimal functions. *Optimization* (2015) **64**:1759–75. doi: 10.1080/02331934.2015.1046873

38. Boţ RI, Grad SM, Wanka G. New regularity conditions for strong and total Fenchel-Lagrange duality in infinite dimensional spaces. *Nonlinear Anal Theory Methods Appl.* (2008) **69**:323–36. doi: 10.1016/j.na.2007.05.021

39. Boţ RI, Grad SM, Wanka G. On strong and total Lagrange duality for convex optimization problems. *J Math Anal Appl.* (2008) **337**:1315–25. doi: 10.1016/j.jmaa.2007.04.071

40. Boţ RI, Grad SM, Wanka G. Generalized Moreau-Rockafellar results for composed convex functions. *Optimization* (2009) **58**:917–33. doi: 10.1080/02331930902945082

41. Boţ RI, Wanka G. Farkas-type results with conjugate functions. *SIAM J Optim.* (2005) **15**:540–54. doi: 10.1137/030602332

42. Dinh N, Jeyakumar V. Farkas' lemma: three decades of generalizations for mathematical optimization. *TOP* (2014) **22**:1–22. doi: 10.1007/s11750-014-0319-y

43. Kim GS, Lee GM. On ε-approximate solutions for convex semidefinite optimization problems. *Taiwanese J Math.* (2007) **11**:765–84.

44. Tidball MM, Pourtallier O, Altman E. Approximations in dynamic zero-sum games. *SIAM J Optim.* (2006) **35**:2101–17. doi: 10.1137/S0363012994272460

45. Jeyakumar V, Li GY. New dual constraint qualifications characterizing zero duality gaps of convex programs and semidefinite programs. *Nonlinear Anal Theory Methods Appl.* (2009) **71**:2239–49. doi: 10.1016/j.na.2009.05.009

46. Jeyakumar V, Li GY. Stable zero duality gaps in convex programming: complete dual characterizations with applications to semidefinite programs. *J Math Anal Appl.* (2009) **360**:156–67. doi: 10.1016/j.jmaa.2009.06.043

47. Boţ RI, Grad SM, Wanka G. Fenchel's duality theorem for nearly convex functions. *J Optim Theory Appl.* (2007) **132**:509–15. doi: 10.1007/s10957-007-9234-9

48. Boţ RI, Grad SM, Wanka G. Almost convex functions: conjugacy and duality. In: Konnov IV, Luc DT, Rubinov AM, editors. *Generalized Convexity and Related Topics, Lecture Notes in Economics and Mathematical Systems*, Vol. **583**. Berlin: Springer (2007). p. 101–114. doi: 10.1007/978-3-540-37007-9_5

49. Boţ RI, Grad SM, Wanka G. New constraint qualification and conjugate duality for composed convex optimization problems. *J Optim Theory Appl.* (2007) **135**:241–55. doi: 10.1007/s10957-007-9247-4

50. Mordukhovich BS, Nghia TTA. Constraint qualifications and optimality conditions for nonconvex semi-infinite and infinite programs. *Math Program* (2013) **139**:271–300. doi: 10.1007/s10107-013-0672-x

51. Dinh N, Mordukhovich BS, Nghia TTA. Subdifferentials of value functions and optimality conditions for DC and bilevel infinite and semi-infinite programs. *Math Program* (2010) **123**:101–38. doi: 10.1007/s10107-009-0323-4

52. Correa R, Hantoute A, Jourani A. Characterizations of convex approximate subdifferential calculus in Banach spaces. *Trans Am Math Soc.* (2016) **368**:4831–54. doi: 10.1090/tran/6589

53. Dinh N, Mordukhovich BS, Nghia TTA. Qualification and optimality conditions for DC programs with infinite constraints. *Acta Math Vietnam* (2009) **34**:125–55.

54. Dinh N, Nghia TTA, Vallet G. A closedness condition and its applications to DC programs with convex constraints. *Optimization* (2010) **59**:541–60. doi: 10.1080/02331930801951348

55. Dinh N, Nghia TTA, Vallet G. Farkas-type results and duality for DC programs with convex constraints. *J Convex Anal.* (2008) **15**:235–62.

56. Sun XK, Guo XL, Zeng J. Necessary optimality conditions for DC infinite programs with inequality constraints. *J Nonlinear Sci Appl.* (2016) **9**:617–26.

57. Fang DH, Li C, Yang XQ. Stable and total Fenchel duality for DC optimization problems in locally convex spaces. *SIAM J Optim.* (2011) **21**:730–60. doi: 10.1137/100789749

58. Fajardo MD, Vidal J. Stable strong Fenchel and Lagrange duality for evenly convex optimization problems. *Optimization* (2016) **65**:1675–91. doi: 10.1080/02331934.2016.1167207

59. Volle M, Martínez-Legaz JE, Vicente-Pérez J. Duality for closed convex functions and evenly convex functions. *J Optim Theory Appl.* (2015) **167**:985–97. doi: 10.1007/s10957-013-0395-4

60. Martínez-Legaz JE, Vicente-Pérez J. The *e*-support function of an *e*-convex set and conjugacy for *e*-convex functions. *J Math Anal Appl.* (2011) **376**:602–12. doi: 10.1016/j.jmaa.2010.10.058

61. Fang DH, Li C, Ng KF. Constraint qualifications for extended Farkas's lemmas and Lagrangian dualities in convex infinite programming. *SIAM J Optim.* (2009) **20**:1311–32. doi: 10.1137/080739124

62. Fang DH, Li C, Ng KF. Constraint qualifications for optimality conditions and total Lagrange dualities in convex infinite programming. *Nonlin Anal.* (2010) **73**:1143–59. doi: 10.1016/j.na.2010.04.020

63. Goberna MA, Jeyakumar V, Li G, Vicente-Pérez J. Robust solutions of multiobjective linear semi-infinite programs under constraint data uncertainty. *SIAM J Optim.* (2014) **24**:1402–19. doi: 10.1137/130939596

64. Goberna MA, Guerra-Vazquez F, Todorov MI. Constraint qualifications in linear vector semi-infinite optimization. *Eur J Oper Res.* (2013) **227**:12–21. doi: 10.1016/j.ejor.2012.09.006

65. Jeyakumar V. A note on strong duality in convex semidefinite optimization: necessary and sufficient conditions. *Optim Lett.* (2008) **2**:15–25. doi: 10.1007/s11590-006-0038-x

66. Boţ RI, Jeyakumar V, Li G. Robust duality in parametric convex optimization. *Set Valued Var Anal.* (2013) **21**:177–89. doi: 10.1007/s11228-012-0219-y

67. Wang M, Fang D, Chen Z. Strong and total Fenchel dualities for robust convex optimization problems. *J Inequal Appl.* (2015) **2015**:70. doi: 10.1186/s13660-015-0592-9

68. Wanka G, Wilfer O. *Duality Results for Extended Multifacility Location Problems*. Preprint, 2016–05. Chemnitz: Chemnitz University of Technology (2016).

69. Goberna MA, Guerra-Vazquez F, Todorov MI. Constraint qualifications in convex vector semi-infinite optimization. *Eur J Oper Res.* (2016) **249**:32–40. doi: 10.1016/j.ejor.2015.08.062

70. Boţ RI, Grad SM, Wanka G. Weaker constraint qualifications in maximal monotonicity. *Numer Funct Anal Optim.* (2007) **28**:27–41. doi: 10.1080/01630560701190224

71. Boţ RI, Grad SM, Wanka G. A new regularity condition for subdifferential calculus and Fenchel duality in infinite dimensional spaces. Applications for maximal monotone operators. In: Castellani G, editor. *Seminario Mario Volpato*, **3**. Venice: Ca'Foscari University of Venice (2007). p. 16–30.

72. Boţ RI, Csetnek ER, Wanka G. A new condition for maximal monotonicity via representative functions. *Nonlinear Anal Theory Methods Appl.* (2007) **67**:2390–402. doi: 10.1016/j.na.2006.09.006

73. Boţ RI, László SC. On the generalized parallel sum of two maximal monotone operators of Gossez type (*D*). *J Math Anal Appl.* (2012) **391**:82–98. doi: 10.1016/j.jmaa.2012.02.030

74. Jeyakumar V, Wu ZY. A dual criterion for maximal monotonicity of composition operators. *Set Valued Var Anal.* (2007) **15**:265–73. doi: 10.1007/s11228-006-0025-5

75. Csetnek ER. *Overcoming the Failure of the Classical Generalized Interior-point Regularity Conditions in Convex Optimization. Applications of the Duality Theory to Enlargements of Maximal Monotone Operators*. Berlin: Logos-Verlag (2010).

76. Boţ RI, Grad SM. Closedness type regularity conditions for surjectivity results involving the sum of two maximal monotone operators. *Cent Eur J Math.* (2011) **9**:162–72. doi: 10.2478/s11533-010-0083-7

77. Boţ RI, Grad SM, Wanka G. Brézis-Haraux-type approximation in nonreflexive Banach spaces. In: Allevi E, Bertocchi M, Gnudi A, Konnov IV, editors. *Nonlinear Analysis with Applications in Economics, Energy and Transportation* Bergamo: Bergamo University Press (2007). p. 155–170.

78. Boţ RI, Grad SM, Wanka G. Brézis-Haraux-type approximation of the range of a monotone operator composed with a linear mapping. In: Kása Z, Kassay G, Kolumbán J, editors. *Proceedings of the International Conference In Memoriam Gyula Farkas*. Cluj-Napoca: Cluj University Press (2006). p. 36–49.

79. Boţ RI, Heinrich A. Regression tasks in machine learning via Fenchel duality. *Ann Oper Res.* (2014) **222**:197–211. doi: 10.1007/s10479-012-1304-1

80. Altangerel L, Boţ RI, Wanka G. On gap functions for equilibrium problems via Fenchel duality. *Pac J Optim.* (2006) **2**:667–78.

81. Altangerel L, Battur G. Perturbation approach to generalized Nash equilibrium problems with shared constraints. *Optim Lett.* (2012) **6**:1379–91. doi: 10.1007/s11590-012-0510-8

82. Cioban L, Csetnek ER. Duality for ε-variational inequalities via the subdifferential calculus. *Nonlinear Anal.* (2012) **75**:3142–56. doi: 10.1016/j.na.2011.12.012

83. Cioban L, Csetnek ER. Revisiting the construction of gap functions for variational inequalities and equilibrium problems via conjugate duality. *Cent Eur J Math.* (2013) **11**:829–50. doi: 10.2478/s11533-012-0151-2

84. Aboussoror A, Adly S. A Fenchel-Lagrange duality approach for a bilevel programming problem with extremal-value function. *J Optim Theory Appl.* (2011) **149**:254–68. doi: 10.1007/s10957-011-9831-5

Keywords: convex optimization, duality, closedness type regularity conditions, conjugate functions, epigraphs, subdifferentials

AMS mathematics subject classification. 90C25, 26A51, 90C46.

Citation: Grad S-M (2016) Closedness Type Regularity Conditions in Convex Optimization and Beyond. *Front. Appl. Math. Stat*. 2:14. doi: 10.3389/fams.2016.00014

Received: 25 June 2016; Accepted: 31 August 2016;

Published: 16 September 2016.

Edited by:

Daniel Toader Onofrei, University of Houston, USAReviewed by:

Vladimir Shikhman, Université Catholique de Louvain, BelgiumWim Van Ackooij, EDF, France

Copyright © 2016 Grad. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Sorin-Mihai Grad, grad@mathematik.tu-chemnitz.de