Impact of Sampling Techniques and Data Leakage on XGBoost Performance in Credit Card Fraud Detection
원문 초록
Credit card fraud detection remains a critical challenge in financial security, with machine learning models like XGBoost(eXtreme gradient boosting) emerging as powerful tools for identifying fraudulent transactions. However, the inherent class imbalance in credit card transaction datasets poses significant challenges for model performance. Although sampling techniques are commonly used to address this imbalance, their implementation sometimes precedes the train-test split, potentially introducing data leakage. This study presents a comparative analysis of XGBoost's performance in credit card fraud detection under three scenarios: Firstly without any imbalance handling techniques, secondly with sampling techniques applied only to the training set after the train-test split, and third with sampling techniques applied before the train-test split. We utilized a dataset from Kaggle of 284,807 credit card transactions, containing 0.172\% fraudulent cases, to evaluate these approaches. Our findings show that although sampling strategies enhance model performance, the reliability of results is greatly impacted by when they are applied. Due to a data leakage issue that frequently occurs in machine learning models during the sampling phase, XGBoost models trained on data where sampling was applied prior to the train-test split may have displayed artificially inflated performance metrics. Surprisingly, models trained with sampling techniques applied solely to the training set demonstrated significantly lower results than those with pre-split sampling, all the while preserving the integrity of the evaluation process.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
EDINET-Bench: Evaluating LLMs on Complex Financial Tasks using Japanese Financial Statements
GARG-AML against Smurfing: A Scalable and Interpretable Graph-Based Framework for Anti-Money Laundering
AD-AGENT: A Multi-agent Framework for End-to-end Anomaly Detection
Cyber Security Data Science: Machine Learning Methods and their Performance on Imbalanced Datasets
Federated Spectral Graph Transformers Meet Neural Ordinary Differential Equations for Non-IID Graphs
FeatInsight: An Online ML Feature Management System on 4Paradigm Sage-Studio Platform
토론
이 논문과 연결된 포럼 글이 아직 없습니다.