In this paper, we introduce the notion of adaptive strong monotonicity and establish a linear convergence of the recently proposed Generalized Proximal Point Algorithm (GPPA) for computing approximate solutions to nonmonotone inclusion problems in Hilbert spaces. We also investigate the Inexact Generalized Proximal Point Algorithm (IGPPA) in the presence of nondiminishing errors.

In this paper, we investigate the concepts of generalized twice differentiability and quadratic bundles of nonsmooth functions that have been very recently proposed by Rockafellar in the framework of second-order variational analysis. These constructions, in contrast to second-order subdifferentials, are defined in primal spaces. We develop new techniques to study generalized twice differentiability for a broad class of prox-regular functions, establish their novel characterizations. Subsequently, quadratic bundles of prox-regular functions are shown to be nonempty, which provides the ground of potential applications in variational analysis and optimization.

The paper is devoted to the study of a new class of optimal control problems for nonsmooth dynamical systems governed by nonconvex discontinuous differential inclusions of the sweeping type with irregular mixed pointwise state-control constraints and involving variable time in optimization. We develop a novel version of the method of discrete approximations of its own qualitative and numerical importance, establishing its well-posedness and strong convergence to optimal solutions of the controlled sweeping process. Using advanced tools of variational analysis and generalized differentiation leads us to deriving new necessary conditions for optimal solutions to discrete approximation problems, which serve as suboptimality conditions for the original continuous-time controlled sweeping process. The obtained results are applied to a class of motion models of practical interest, where the established necessary conditions are used to investigate the agents' interactions and to develop an algorithm for calculating optimal solutions.

This paper pursues a twofold goal. First, we introduce and study in detail a new notion of variational analysis called generalized metric subregularity, which is a far-going extension of the conventional metric subregularity conditions. Our primary focus is on examining this concept concerning first-order and second-order stationary points. We develop an extended convergence framework that enables us to derive superlinear and quadratic convergence under the generalized metric subregularity condition, broadening the widely used KL convergence analysis framework. We present verifiable sufficient conditions to ensure the proposed generalized metric subregularity condition and provide examples demonstrating that the derived convergence rates are sharp. Second, we design a new high-order regularized Newton method with momentum steps, and apply the generalized metric subregularity to establish its superlinear convergence. Quadratic convergence is obtained under additional assumptions. Specifically, when applying the proposed method to solve the (nonconvex) over-parameterized compressed sensing model, we achieve global convergence with a quadratic local convergence rate towards a global minimizer under a strict complementarity condition.

This paper investigates the notion of compact R-continuity and its specifications for set-valued mappings between Banach spaces. We establish several important properties of compact R-continuity in general settings and show that in finite dimensions, this notion is supported by the classical Łojasiewicz inequality for analytic functions. Applications of compact R-continuity and the results obtained herein are provided through the convergence analysis for a broad class of descent algorithms in nonsmooth optimization. Moreover, we demonstrate that compact R-continuity plays a key role in the design and theoretical justification of a novel R-class of algorithms for solving general inclusion problems.

In this paper, we establish, for the first time in the literature, the convergence of the practical versions of the Inexact Proximal Point Algorithm (IPPA) and the Inexact Tseng Algorithm (ITA) for computing approximate solutions to monotone inclusions in Hilbert spaces under the the presence of nonsummable errors. Our ap- proach relies on Tikhonov regularization, the contraction property of the associated monotone operators, and the recently developed R-continuity theory. The proposed techniques and results can be extended to analyze various important inexact algorithms in optimization-related problems with nonsummable errors.

This paper explores a new class of constrained difference programming problems, where the objective and constraints are formulated as differences of functions, without requiring their convexity. To investigate such problems, novel variants of the extended sequential quadratic method are introduced. These algorithms iteratively solve strongly convex quadratic subproblems constructed via linear approximations of the given data by using their gradients and subgradients. The convergence of the proposed methods is rigorously analyzed by employing, in particular, the Polyak-Łojasiewicz-Kurdyka property that ensures global convergence for various classes of functions in the problem formulation, e.g., semialgebraic ones. The original framework is further extended to address difference programming problems with variational inequality (VI) constraints. By reformulating VI constraints via regularized gap functions, such problems are naturally embedded into constrained difference programming that leads us to direct applications of the proposed algorithms. Numerical experiments for the class of continuous network design problems demonstrate the efficiency of the new methods.

This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and generalized differentiation. The objective functions belong to a broad class of prox-regular functions with specification to constrained optimization of nonconvex structured sums. We also develop a novel line search method, which is an extension of the proximal gradient algorithm while allowing us to globalize the proposed coderivative-based Newton methods by incorporating the machinery of forward-backward envelopes. Applications and numerical experiments, which are provided for nonconvex least squares regression models, Student's t-regression with an ℓ^0-penalty, and image restoration problems, demonstrate the efficiency of the proposed algorithms.

This paper investigates a recently introduced notion of strong variational sufficiency in optimization problems whose importance has been highly recognized in optimization theory, numerical methods, and applications. We address a general class of composite optimization problems and establish complete characterizations of strong variational sufficiency for their local minimizers in terms of a generalized version of the strong second-order sufficient condition (SSOSC) and the positive-definiteness of an appropriate generalized Hessian of the augmented Lagrangian calculated at the point in question. The generalized SSOSC is expressed via a novel second-order variational function, which reflects specific features of nonconvex composite models. The imposed assumptions describe the spectrum of composite optimization problems covered by our approach while being constructively implemented for nonpolyhedral problems that involve the nuclear norm function and the indicator function of the positive-semidefinite cone without any constraint qualifications.

This paper is devoted to developing the alternating minimization algorithm for problems of structured nonconvex optimization proposed by Attouch, Bolté, Redont, and Soubeyran in 2010. Our main result provides significant improvements of the convergence rate of the algorithm, especially under the low exponent Polyak-Łojasiewicz-Kurdyka condition when we establish either finite termination of this algorithm or its superlinear convergence rate instead of the previously known linear convergence. We also investigate the PLK exponent calculus and discuss applications to noncooperative games and behavioral science.

This paper primarily focuses on the practical applications of optimal control theory for perturbed sweeping processes within the realm of robotics dynamics. By describing these models as controlled sweeping processes with pointwise control and state constraints and by employing necessary optimality conditions for such systems, we formulate optimal control problems suitable to these models and develop numerical algorithms for their solving. Subsequently, we use the Python Dynamic Optimization library GEKKO to simulate solutions to the posed robotics problems in the case of any fixed number of robots under different initial conditions.

This paper addresses a new class of generalized Bolza problems governed by nonconvex integro-differential inclusions with endpoint constraints on trajectories, where the integral terms are given in the general (with time-dependent integrands in the dynamics) Volterra form. We pursue here a threefold goal. First we construct well-posed approximations of continuous-time integro-differential systems by their discrete-time counterparts with showing that any feasible solution to the original system can be strongly approximated in the W^1,2-norm topology by piecewise-linear extensions of feasible discrete trajectories. This allows us to verify in turn the strong convergence of discrete optimal solutions to a prescribed local minimizer for the original problem. Facing intrinsic nonsmoothness of original integro-differential problem and its discrete approximations, we employ appropriate tools of generalized differentiation in variational analysis to derive necessary optimality conditions for discrete-time problems (which is our second goal) and finally accomplish our third goal to obtain necessary conditions for the original continuous-time problems by passing to the limit from discrete approximations. In this way we establish, in particular, a novel necessary optimality condition of the Volterra type, which is the crucial result for dynamic optimization of integro-differential inclusions.

This paper develops a comprehensive convergence analysis for generic classes of descent algorithms in nonsmooth and nonconvex optimization under several conditions of the Polyak-Łojasiewicz-Kurdyka (PLK) type. Along other results, we prove the finite termination of generic algorithms under the PLK conditions with lower exponents. Specifications are given to establish new convergence rates for inexact reduced gradient methods and some versions of the boosted algorithm in DC programming. It is revealed, e.g., that the lower exponent PLK conditions for a broad class of difference programs are incompatible with the gradient Lipschitz continuity for the plus function around a local minimizer. On the other hand, we show that the above inconsistency observation may fail if the Lipschitz continuity is replaced by merely the gradient continuity.

This paper addresses optimal control problems for dynamical systems governed by a novel class of sweeping processes with time delay. We establish the well-posedness of such processes in the sense of the existence and uniqueness of feasible trajectories corresponding to feasible controls under fairly unrestrictive assumptions. We then construct a well-posed family of discrete approximations and find efficient conditions ensuring the stability of the discretized time-delayed sweeping process with respect to strong convergence of feasible and optimal solutions. This creates a bridge between the optimization of continuous-time and discrete-time sweeping control systems and justifies the effective use of discrete approximations in deriving optimality conditions and numerical techniques to solve the original time-delayed sweeping control problems via discrete approximations.

This paper proposes and develops inexact proximal methods for finding stationary points of the sum of a smooth function and a nonsmooth weakly convex one, where an error is present in the calculation of the proximal mapping of the nonsmooth term. A general framework for finding zeros of a continuous mapping is derived from our previous paper on this subject to establish convergence properties of the inexact proximal point method when the smooth term is vanished and of the inexact proximal gradient method when the smooth term satisfies a descent condition. The inexact proximal point method achieves global convergence with constructive convergence rates when the Moreau envelope of the objective function satisfies the Kurdyka-Lojasiewicz (KL) property. Meanwhile, when the smooth term is twice continuously differentiable with a Lipschitz continuous gradient and a differentiable approximation of the objective function satisfies the KL property, the inexact proximal gradient method achieves the global convergence of iterates with constructive convergence rates.

The paper addresses the study and applications of a broad class of extended-real-valued functions, known as optimal value or marginal functions, which are frequently appeared in variational analysis, parametric optimization, and a variety of applications. Functions of this type are intrinsically nonsmooth and require the usage of tools of generalized differentiation. The main results of this paper provide novel evaluations and exact calculations of regular/Fréchet subgradients and their singular counterparts for general classes of marginal functions via their given data. The obtained results are applied to establishing new calculus rules for such subgradients and necessary optimality conditions in bilevel programming

In this paper, we introduce an inexact approach to the Boosted Difference of Convex Functions Algorithm (BDCA) for solving nonconvex and nondifferentiable problems involving the difference of two convex functions (DC functions). Specifically, when the first DC component is differentiable and the second may be nondifferentiable, BDCA utilizes the solution from the subproblem of the DC Algorithm (DCA) to define a descent direction for the objective function. A monotone linesearch is then performed to find a new point that improves the objective function relative to the solution of the subproblem. This approach enhances the performance of DCA. However, if the first DC component is nondifferentiable, the BDCA direction may become an ascent direction, rendering the monotone linesearch ineffective. To address this, we propose an Inexact nonmonotone Boosted Difference of Convex Algorithm (InmBDCA). This algorithm incorporates two main features of inexactness: First, the subproblem therein is solved approximately, allowing us to a controlled relative error tolerance in defining the linesearch direction. Second, an inexact nonmonotone linesearch scheme is used to determine the step size for the next iteration. Due to the difficulty in computing the subdifferential of certain nondifferentiable functions, InmBDCA can, however, become conceptual when the first DC component g is nondifferentiable and its subdifferential is challenging to compute. Under suitable assumptions, we demonstrate that InmBDCA is well-defined, with any accumulation point of the sequence generated by InmBDCA being a critical point of the problem. We also provide iteration-complexity bounds for the algorithm. To complement the theoretical development, we include numerical illustrations aimed at verifying that the inexact solutions obtained by the BDCA and Nonmonotone Boosted DC Algorithm (nmBDCA) satisfy the conditions required by InmBDCA.

This paper investigates the preservation of local minimizers and strong minimizers of extended-real-valued lower semicontinuous functions under taking their Moreau envelopes. We address a general setting of Banach spaces, while all the obtained results are new even for functions in finite dimensions. Our main motivation came from applications to numerical methods in nonsmooth optimization dealing with broad classes of nondifferentiable and nonconvex functions. The paper also formulates and discusses some open questions stemming from this study.

Metric regularity is among the central concepts of nonlinear and variational analysis, constrained optimization, and their numerous applications. However, met- ric regularity can be elusive for some important ill-posed classes of problems includ- ing polynomial equations, parametric variational systems, smooth reformulations of complementarity systems with degenerate solutions, etc. The study of stability issues for such problems can often not rely on the machinery of first-order variational anal- ysis, and so higher-order regularity concepts have been proposed in recent years. In this paper, we investigate some notions of mixed-order regularity by using advanced tools of first-order and second-order variational analysis and generalized differenti- ation of both primal and dual types. Efficient characterizations of such mixed-order regularity concepts are established by employing a fresh notion of the least singular value function. The obtained conditions are applied to deriving constructive criteria for mixed-order regularity in coupled constraint and variational systems.