Language models and Automated Essay Scoring
원문 초록
In this paper, we present a new comparative study on automatic essay scoring (AES). The current state-of-the-art natural language processing (NLP) neural network architectures are used in this work to achieve above human-level accuracy on the publicly available Kaggle AES dataset. We compare two powerful language models, BERT and XLNet, and describe all the layers and network architectures in these models. We elucidate the network architectures of BERT and XLNet using clear notation and diagrams and explain the advantages of transformer architectures over traditional recurrent neural network architectures. Linear algebra notation is used to clarify the functions of transformers and attention mechanisms. We compare the results with more traditional methods, such as bag of words (BOW) and long short term memory (LSTM) networks.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Beyond Agreement: Diagnosing the Rationale Alignment of Automated Essay Scoring Methods based on Linguistically-informed Counterfactuals
Exploring LLM Prompting Strategies for Joint Essay Scoring and Feedback Generation
Autoregressive Score Generation for Multi-trait Essay Scoring
Can Large Language Models Automatically Score Proficiency of Written Essays?
VerAs: Verify then Assess STEM Lab Reports
Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMs
토론
이 논문과 연결된 포럼 글이 아직 없습니다.