BILEVEL PROBLEMS AND TWO-STAGE PROXIMAL ALGORITHM
Abstract
In this paper, we consider bilevel problem: variational inequality problem over the set of solutions the equilibrium problems. To solve this problem, an iterative algorithm is proposed that combines the ideas of a two-stage proximal method and iterative regularization. In addition, an adaptive version of the algorithm with a rule for updating parameters without using the values of the Lipschitz constants of the bifunction was studied. For monotone bifunctions of Lipschitz type and strongly monotone Lipschitz continuous operators, the theorem on strong convergence of sequences generated by the algorithms is proved.
References
Eremin I. I. Problems in sequential programming. Siberian Mathematical Journal. 1973. Vol. 14. P. 36–43. https://doi.org/10.1007/BF00967264
Podinovskii V. V., Gavrilov V. M. Optimization with respect to successively applied criteria. Moscow: Sovetskoe Radio, 1975. 192 p.
Kalashnikov V. V., Kalashnikova N. I. Solution of two-level variational inequality. Cybernetics and Systems Analysis. 1994. Vol. 30. Issue 4. P. 623–625.
Konnov I. V. On systems of variational inequalities. Izv. Vuzov, Matematika. 1997. No. 12. P. 79–88. (In Russian)
Popov L. D. Lexicographic variational inequalities and some applications. Mathematical Programming. Regularization and Approximation. A Collection of Papers, Tr. IMM. Vol. 8, No. 1. 2002. P. 103–115. (In Russian)
Semenov V. V. Strongly Convergent Algorithms for Variational Inequality Problem Over the Set of Solutions the Equilibrium Problems. In: Zgurovsky M.Z. and Sadovnichiy V.A. (eds.) Continuous and Distributed Systems. Solid Mechanics and Its Applications, vol. 211, Springer International Publishing Switzerland, 2014. P. 131–146.
Vedel Y. I., Denisov S. V., Semenov V. V. Algorithm for Variational Inequality Problem Over the Set of Solutions the Equilibrium Problems. J. Num. Appl. Math. 2020. No 1 (133). С. 18–30.
Denisov S., Semenov V., Vedel Y. Adaptive Algorithm for Variational Inequality Problem Over the Set of Solutions the Equilibrium Problem. 2020 IEEE 2nd International Conference on Advanced Trends in Information Theory (ATIT), Kyiv, Ukraine, 2020. P. 325–329.
Vedel Y. I., Denisov S. V., Semenov V. V. An Adaptive Algorithm for the Variational Inequality Over the Set of Solutions of the Equilibrium Problem. Cybernetics and Systems Analysis. 2021. Vol. 57. Issue 1. P. 91–100.
Combettes P. L., Hirstoaga S. A. Equilibrium Programming in Hilbert Spaces. J. Nonlinear Convex Anal. 2005. Vol. 6. P. 117–136.
Kinderlehrer D. Stampacchia G. An introduction to variational inequalities and their applications. New York: Academic Press, 1980. Russian transl., Moscow: Mir, 1983. 256 p.
Bakushinskii A. B., Goncharskii A. V. Iterative Methods for Solving Ill-Posed Problems. Moscow: Nauka, 1989. 126 p.
Browder F. Existence and approximation of solutions of nonlinear variational inequalities. Proc. Nat. Acad. Sci. USA. 1966. Vol. 56. No. 4. P. 1080–1086.
Browder F. E. Convergence of approximants of fixed points of nonexpansive nonlinear mappings in Banach spaces. Arch. Rational Mech. Anal. 1967. Vol. 24. P. 82–90.
Lyashko S. I., Semenov V. V. A New Two-Step Proximal Algorithm of Solving the Problem of Equilibrium Programming. In: B. Goldengorin (ed.) Optimization and Its Applications in Control and Data Sciences. Springer Optimization and Its Applications, vol. 115. Springer, Cham, 2016. P. 315–325.
Popov L. D. On schemes for the formation of a master sequence in a regularized extragradient method for solving variational inequalities. Russian Mathematics. 2004. Vol. 48. Issue 1. P. 67–76.
Popov L. D. A modification of the Arrow-Hurwicz method for search of saddle points. Mathematical notes of the Academy of Sciences of the USSR. 1980. Vol. 28. Issue 5. P. 845–848.
Malitsky Yu. V., Semenov V. V. An extragradient algorithm for monotone variational inequalities. Cybernetics and Systems Analysis. 2014. Vol. 50. P. 271–277.
Denisov S. V., Dudar V. V., Semenov V. V., Vedel Y. I. A New Mirror-prox Algorithm For Variational Inequalities. Журнал обчисл. та прикл. матем. 2017. No 1 (124). С. 15–29.
Semenov V. V. A Version of the Mirror descent Method to Solve Variational Inequalities. Cybernetics and Systems Analysis. 2017. Vol. 53. P. 234–243.
Semenov V. V. A variant of mirror descent method for solving variational inequalities. In: Polyakova, L. N. (ed.) Constructive Nonsmooth Analysis and Related Topics (dedicated to the memory of V. F. Demyanov). IEEE, 2017. P. 281–284. https://doi.org/10.1109/CNSA.2017.7974011
Nomirovskii D. A., Rublyov V. V., Semenov V. V. Convergence of Two-Stage Method with Bregman Divergence for Solving Variational Inequalities. Cybernetics and Systems Analysis. 2019. Vol. 55. P. 359–368.
Apostol R. Ya., Grynenko A. A., Semenov V. V. Iterative algorithms for monotone bilevel variational inequalities. J. Num. Appl. Math. 2012. No. 1 (107). P. 3–14. (In Ukrainian)
