It's Time to Consider "Time" when Evaluating Recommender-System Algorithms [Proposal]
원문 초록
In this position paper, we question the current practice of calculating evaluation metrics for recommender systems as single numbers (e.g. precision p=.28 or mean absolute error MAE = 1.21). We argue that single numbers express only average effectiveness over a usually rather long period (e.g. a year or even longer), which provides only a vague and static view of the data. We propose that recommender-system researchers should instead calculate metrics for time-series such as weeks or months, and plot the results in e.g. a line chart. This way, results show how algorithms' effectiveness develops over time, and hence the results allow drawing more meaningful conclusions about how an algorithm will perform in the future. In this paper, we explain our reasoning, provide an example to illustrate our reasoning and present suggestions for what the community should do next.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Review of the Long Horizon Forecasting Problem in Time Series Analysis
The interplay of robustness and generalization in quantum machine learning
A Better Alternative to Piecewise Linear Time Series Segmentation
Journalism-Guided Agentic In-Context Learning for News Stance Detection
Process mining-driven modeling and simulation to enhance fault diagnosis in cyber-physical systems
Time-IMM: A Dataset and Benchmark for Irregular Multimodal Multivariate Time Series
토론
이 논문과 연결된 포럼 글이 아직 없습니다.