BERTrend: Neural Topic Modeling for Emerging Trends Detection
원문 초록
Detecting and tracking emerging trends and weak signals in large, evolving text corpora is vital for applications such as monitoring scientific literature, managing brand reputation, surveilling critical infrastructure and more generally to any kind of text-based event detection. Existing solutions often fail to capture the nuanced context or dynamically track evolving patterns over time. BERTrend, a novel method, addresses these limitations using neural topic modeling in an online setting. It introduces a new metric to quantify topic popularity over time by considering both the number of documents and update frequency. This metric classifies topics as noise, weak, or strong signals, flagging emerging, rapidly growing topics for further investigation. Experimentation on two large real-world datasets demonstrates BERTrend's ability to accurately detect and track meaningful weak signals while filtering out noise, offering a comprehensive solution for monitoring emerging trends in large-scale, evolving text corpora. The method can also be used for retrospective analysis of past events. In addition, the use of Large Language Models together with BERTrend offers efficient means for the interpretability of trends of events.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Hybrid Disagreement-Diversity Active Learning for Bioacoustic Sound Event Detection
CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training
Multimodal Event Detection: Current Approaches and Defining the New Playground through LLMs and VLMs
Temporal Attention Pooling for Frequency Dynamic Convolution in Sound Event Detection
F$^3$Set: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videos
Explainable AI Components for Narrative Map Extraction
토론
이 논문과 연결된 포럼 글이 아직 없습니다.