GP: Context-free Grammar Pre-training for Text-to-SQL Parsers
원문 초록
A new method for Text-to-SQL parsing, Grammar Pre-training (GP), is proposed to decode deep relations between question and database. Firstly, to better utilize the information of databases, a random value is added behind a question word which is recognized as a column, and the new sentence serves as the model input. Secondly, initialization of vectors for decoder part is optimized, with reference to the former encoding so that question information can be concerned. Finally, a new approach called flooding level is adopted to get the non-zero training loss which can generalize better results. By encoding the sentence with GRAPPA and RAT-SQL model, we achieve better performance on spider, a cross-DB Text-to-SQL dataset (72.8 dev, 69.8 test). Experiments show that our method is easier to converge during training and has excellent robustness.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Calibrating LLMs for Text-to-SQL Parsing by Leveraging Sub-clause Frequencies
Sentinel: Decoding Context Utilization via Attention Probing for Efficient LLM Context Compression
XiYan-SQL: A Novel Multi-Generator Framework For Text-to-SQL
Schema-R1: A reasoning training approach for schema linking in Text-to-SQL Task
Bridging the Gap Between Open-Source and Proprietary LLMs in Table QA
SEED: Enhancing Text-to-SQL Performance and Practical Usability Through Automatic Evidence Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.