Training Input-Output Recurrent Neural Networks through Spectral Methods
원문 초록
We consider the problem of training input-output recurrent neural networks (RNN) for sequence labeling tasks. We propose a novel spectral approach for learning the network parameters. It is based on decomposition of the cross-moment tensor between the output and a non-linear transformation of the input, based on score functions. We guarantee consistent learning with polynomial sample and computational complexity under transparent conditions such as non-degeneracy of model parameters, polynomial activations for the neurons, and a Markovian evolution of the input sequence. We also extend our results to Bidirectional RNN which uses both previous and future information to output the label at each time point, and is employed in many NLP tasks such as POS tagging.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Comparative Analysis of Static Word Embeddings for Hungarian
POS-tagging to highlight the skeletal structure of sentences
How Does A Text Preprocessing Pipeline Affect Ontology Syntactic Matching?
J2N -- Nominal Adjective Identification and its Application
Nullpointer at CheckThat! 2024: Identifying Subjectivity from Multilingual Text Sequence
Seeing Through AI's Lens: Enhancing Human Skepticism Towards LLM-Generated Fake News
토론
이 논문과 연결된 포럼 글이 아직 없습니다.