L2 Regularization
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 0
- 보존된 평가 기록
- 0
See Weight Decay.
$L_{2}$ Regularization or Weight Decay, is a regularization technique applied to the weights of a neural network. We minimize a loss function compromising both the primary loss function and a penalty on the $L\_{2}$ Norm of the weights:
$$L\_{new}\left(w\right) = L\_{original}\left(w\right) + \lambda{w^{T}w}$$
where $\lambda$ is a value determining the strength of the penalty (encouraging smaller weights).
Weight decay can be incorporated directly into the weight update rule, rather than just implicitly by defining it through to objective function. Often weight decay refers to the implementation where we specify it directly in the weight update rule (whereas L2 regularization is usually the implementation which is specified in the objective function).
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
On Regularization Parameter Estimation under Covariate Shift
Feature Representation for ICU Mortality
Towards a Better Understanding of Predict and Count Models
To Drop or Not to Drop: Robustness, Consistency and Differential Privacy Properties of Dropout
A Bayesian encourages dropout
Automatic Discovery and Optimization of Parts for Image Classification
Action Classification with Locality-constrained Linear Coding
An efficient distributed learning algorithm based on effective local functional approximations
Distribution-Dependent Sample Complexity of Large Margin Learning
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.