Adaptive multi-gradient methods for quasiconvex vector optimization and applications to multi-task learning
원문 초록
We present an adaptive step-size method, which does not include line-search techniques, for solving a wide class of nonconvex multiobjective programming problems on an unbounded constraint set. We also prove convergence of a general approach under modest assumptions. More specifically, the convexity criterion might not be satisfied by the objective function. Unlike descent line-search algorithms, it does not require an initial step-size to be determined by a previously determined Lipschitz constant. The process's primary characteristic is its gradual step-size reduction up until a predetermined condition is met. It can be specifically applied to offer an innovative multi-gradient projection method for unbounded constrained optimization issues. Preliminary findings from a few computational examples confirm the accuracy of the strategy. We apply the proposed technique to some multi-task learning experiments to show its efficacy for large-scale challenges.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Robust-Multi-Task Gradient Boosting
SAMO: A Lightweight Sharpness-Aware Approach for Multi-Task Optimization with Joint Global-Local Perturbation
SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning
CALM: Consensus-Aware Localized Merging for Multi-Task Learning
Training-free LLM Merging for Multi-task Learning
Non-Contact Health Monitoring During Daily Personal Care Routines
토론
이 논문과 연결된 포럼 글이 아직 없습니다.