arXiv:1704.05973

Call Attention to Rumors: Deep Attention Based Recurrent Neural Networks for Early Rumor Detection

Tong Chen, Lin Wu, Xue Li, Jun Zhang, Hongzhi Yin, Yang Wang

제출 2017-04-20

원문 초록

The proliferation of social media in communication and information dissemination has made it an ideal platform for spreading rumors. Automatically debunking rumors at their stage of diffusion is known as \textit{early rumor detection}, which refers to dealing with sequential posts regarding disputed factual claims with certain variations and highly textual duplication over time. Thus, identifying trending rumors demands an efficient yet flexible model that is able to capture long-range dependencies among postings and produce distinct representations for the accurate early detection. However, it is a challenging task to apply conventional classification algorithms to rumor detection in earliness since they rely on hand-crafted features which require intensive manual efforts in the case of large amount of posts. This paper presents a deep attention model on the basis of recurrent neural networks (RNN) to learn \textit{selectively} temporal hidden representations of sequential posts for identifying rumors. The proposed model delves soft-attention into the recurrence to simultaneously pool out distinct features with particular focus and produce hidden representations that capture contextual variations of relevant posts over time. Extensive experiments on real datasets collected from social media websites demonstrate that (1) the deep attention based RNN model outperforms state-of-the-arts that rely on hand-crafted features; (2) the introduction of soft attention mechanism can effectively distill relevant parts to rumors from original posts in advance; (3) the proposed method detects rumors more quickly and accurately than competitors.

함께 살펴볼 논문

공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.

arXiv:2408.17221v3cs.LG공통 태그 Deep Attention공식 코드 · Papers with Code

Lightning Self-Attention의 기하학: 식별 가능성과 차원

Geometry of Lightning Self-Attention: Identifiability and Dimension

정규화가 없는 셀프 어텐션 네트워크가 정의하는 함수 공간을 고려하고, 그 기하학을 이론적으로 분석한다. 이러한 네트워크는 다항식이므로 대수 기하학의 도구를 활용한다. 특히, 임의의 계층 수에 대해 매개화의 일반 섬유에 대한 기술을 제공함으로써 깊은 어텐션의 식별 가능성을 연구하고, 그 결과 함수 공간의 차원을 계산한다. 또한 단일 계층 모델에 대해서는 특이점과 경계점을 특성화한다. 마지막으로, 본 결과를 정규화된 셀프 어텐션 네트워크로 확장하는 추측을 정식화하고, 단일 계층에 대해서는 이를 증명하며, 깊은 경우에는 수치적으로 검증한다.

토론

이 논문과 연결된 포럼 글이 아직 없습니다.