Papers with Code 아카이브
Second-order methods
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 0
- 보존된 평가 기록
- 0
Use second-order statistics to process data.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Adaptive Optimization Algorithms for Machine Learning
AdaSub: Stochastic Optimization Using Second-Order Information in Low-Dimensional Subspaces
Studying K-FAC Heuristics by Viewing Adam through a Second-Order Lens
Stochastic Optimization for Non-convex Problem with Inexact Hessian Matrix, Gradient, and Function
Jorge: Approximate Preconditioning for GPU-efficient Second-order Optimization
Decentralized Riemannian Conjugate Gradient Method on the Stiefel Manifold
A Homogenization Approach for Gradient-Dominated Stochastic Optimization
Convolutions and More as Einsum: A Tensor Network Perspective with Advances for Second-Order Methods
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles
Error Feedback Can Accurately Compress Preconditioners
MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 Updates
Sharpened Lazy Incremental Quasi-Newton Method
Minibatching Offers Improved Generalization Performance for Second Order Optimizers
Faster Differentially Private Convex Optimization via Second-Order Methods
ISAAC Newton: Input-based Approximate Curvature for Newton's Method
Adaptive Consensus Optimization Method for GANs
Automatic Gradient Descent: Deep Learning without Hyperparameters
Gradient-Boosted Based Structured and Unstructured Learning
FOSI: Hybrid First and Second Order Optimization
Stochastic Dimension-reduced Second-order Methods for Policy Optimization
On backpropagating Hessians through ODEs
A survey of deep learning optimizers -- first and second order methods
Differentially Private Image Classification from Features
The Hypervolume Indicator Hessian Matrix: Analytical Expression, Computational Time Complexity, and Sparsity
Extra-Newton: A First Approach to Noise-Adaptive Accelerated Second-Order Methods
Explicit Second-Order Min-Max Optimization Methods with Optimal Convergence Guarantee
Component-Wise Natural Gradient Descent -- An Efficient Neural Network Optimization
Mirror Prox Algorithm for Large-Scale Cell-Free Massive MIMO Uplink Power Control
Adaptive Second Order Coresets for Data-efficient Machine Learning
SP2: A Second Order Stochastic Polyak Method
A Newton-CG based barrier method for finding a second-order stationary point of nonconvex conic optimization with complexity guarantees
Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batches
Statistical Inference of Constrained Stochastic Optimization via Sketched Sequential Quadratic Programming
Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function
Symmetry Teleportation for Accelerated Optimization
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.