Model Validation Using Mutated Training Labels: An Exploratory Study
원문 초록
We introduce an exploratory study on Mutation Validation (MV), a model validation method using mutated training labels for supervised learning. MV mutates training data labels, retrains the model against the mutated data, then uses the metamorphic relation that captures the consequent training performance changes to assess model fit. It does not use a validation set or test set. The intuition underpinning MV is that overfitting models tend to fit noise in the training data. We explore 8 different learning algorithms, 18 datasets, and 5 types of hyperparameter tuning tasks. Our results demonstrate that MV is accurate in model selection: the model recommendation hit rate is 92\% for MV and less than 60\% for out-of-sample-validation. MV also provides more stable hyperparameter tuning results than out-of-sample-validation across different runs.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Machine Learning for Dynamic Resource Allocation in Network Function Virtualization
Performing Image Classification for 10 Different Monkey Species using CNN
Statistical characterization and classification of colon microarray gene expression data using multiple machine learning paradigms
Enhanced network anomaly detection based on deep neural networks
ATM: A distributed, collaborative, scalable system for automated machine learning
ExploreKit: Automatic Feature Generation and Selection
토론
이 논문과 연결된 포럼 글이 아직 없습니다.