Data-Centric Financial Large Language Models
원문 초록
Large language models (LLMs) show promise for natural language tasks but struggle when applied directly to complex domains like finance. LLMs have difficulty reasoning about and integrating all relevant information. We propose a data-centric approach to enable LLMs to better handle financial tasks. Our key insight is that rather than overloading the LLM with everything at once, it is more effective to preprocess and pre-understand the data. We create a financial LLM (FLLM) using multitask prompt-based finetuning to achieve data pre-processing and pre-understanding. However, labeled data is scarce for each task. To overcome manual annotation costs, we employ abductive augmentation reasoning (AAR) to automatically generate training data by modifying the pseudo labels from FLLM's own outputs. Experiments show our data-centric FLLM with AAR substantially outperforms baseline financial LLMs designed for raw text, achieving state-of-the-art on financial analysis and interpretation tasks. We also open source a new benchmark for financial analysis and interpretation. Our methodology provides a promising path to unlock LLMs' potential for complex real-world domains.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
EDINET-Bench: Evaluating LLMs on Complex Financial Tasks using Japanese Financial Statements
How Explanations Leak the Decision Logic: Stealing Graph Neural Networks via Explanation Alignment
Non-Stationary Time Series Forecasting Based on Fourier Analysis and Cross Attention Mechanism
MiMIC: Multi-Modal Indian Earnings Calls Dataset to Predict Stock Prices
Exploring the Reliability of Self-explanation and its Relationship with Classification in Language Model-driven Financial Analysis
WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecasting
토론
이 논문과 연결된 포럼 글이 아직 없습니다.