In this paper, a new augmented Lagrangian penalty function for constrained optimization problems is studied. The dual properties of the augmented Lagrangian objective penalty function for constrained optimization problems are proved. Under some conditions, the saddle point of the augmented Lagrangian objective penalty function satisfies the first-order Karush-Kuhn-Tucker (KKT) condition. Especially, when the KKT condition holds for convex programming its saddle point exists. Based on the augmented Lagrangian objective penalty function, an algorithm is developed for finding a global solution to an inequality constrained optimization problem and its global convergence is also proved under some conditions.
References
[1]
Du, D.Z., Pardalos, P.M. and Wu, W. (2001) Mathematical Theory of Optimization. Kluwer Academic Publishers, Location. https://doi.org/10.1007/978-1-4757-5795-8
[2]
Miele, A., Cragg, E.E., Iyer, R.R. and Levy, A.V. (1971) Use of the Augmented Penalty Function in Mathematical Programming. Part I and II. Journal of Optimization Theory and Applications, 8, 115-153. https://doi.org/10.1007/BF00928472
[3]
Miele, A., Moseley, P., Levy, A. V. and Coggins, G.H. (1972) On the Method of Multipliers for Mathematical Programming Problems. Journal of optimization Theory and Applications, 10, 1-33. https://doi.org/10.1007/BF00934960
[4]
Pillo, G.D. and Grippo, L. (1982) A New Augmented Lagrangian Function for Inequality Constraints in Nonlinear Programming Problems. Journal of Optimization Theory and Applications, 36, 495-519. https://doi.org/10.1007/BF00940544
[5]
Goldfarb, D., Polyak, R., Scheinberg, K. and Yuzefobvicha, I. (1999) A Modified Barrier-Augmented Lagrangian Method for Constrained Minimization. Computational Optimization and Applications, 14, 55-74. https://doi.org/10.1023/A:1008705028512
[6]
Lucidi, S. (1990) Recursive Quadratic Programming Algorithm That Uses an Exact Augmented Lagrangian Function. Journal of Optimization Theory and Applications, 67, 227-245. https://doi.org/10.1007/BF00940474
[7]
Pillo, G.D., Liuzzi, G., Lucidi, S. and Palagi, L. (2003) An Exact Augmented Lagrangian Function for Nonlinear Programming with Two-Sided Constraints. Computational Optimization and Applications, 25, 57-83. https://doi.org/10.1023/A:1022948903451
[8]
Burachik, R.S. and Kaya, C.Y. (2012) An Augmented Penalty Function Method with Penalty Parameter Updates for Nonconvex Optimization. Nonlinear Analysis, 75, 1158-1167. https://doi.org/10.1016/j.na.2011.03.013
[9]
Morrison, D.D. (1968) Optimization by Least Squares. SIAM Journal on Numerical Analysis, 5, 83-88. https://doi.org/10.1137/0705006
[10]
Fletcher, R. (1981) Practical Method of Optimization. A Wiley-Interscience Publication, New York.
[11]
Fletcher, R. (1983) Penalty Functions. In: Bachem, A., Grotschel, M. and Korte, B., Eds., Mathematical Programming: The State of the Art, Springer, Berlin, 87-114. https://doi.org/10.1007/978-3-642-68874-4_5
[12]
Burke, J.V. (1991) An Exact Penalization Viewpoint of Constrained Optimization. SIAM Journal on Control and Optimization, 29, 968-998. https://doi.org/10.1137/0329054
[13]
Fiacco, A.V. and McCormick, G.P. (1968) Nonlinear Programming: Sequential Unconstrained Minimization Techniques. Wiley, New York.
[14]
Mauricio, D. and Maculan, N. (2000) A Boolean Penalty Method for Zero-One Nonlinear Programming. Journal of Global Optimaization, 16, 343-354. https://doi.org/10.1023/A:1008329405026
[15]
Meng, Z.Q., Hu, Q.Y. and Dang, C.Y. (2009) A Penalty Function Algorithm with Objective Parameters for Nonlinear Mathematical Programming. Journal of Industrial and Management Optimization, 5, 585-601. https://doi.org/10.3934/jimo.2009.5.585
[16]
Meng, Z.Q., Shen, R., Dang, C.Y. and Jiang, M. (2015) Augmented Lagrangian Objective Penalty Function. Numerical Functional Analysis and Optimization, 36, 1471-1492. https://doi.org/10.1080/01630563.2015.1070864
