CLLMate: A Multimodal Benchmark for Weather and Climate Events Forecasting
원문 초록
Forecasting weather and climate events is crucial for making appropriate measures to mitigate environmental hazards and minimize losses. However, existing environmental forecasting research focuses narrowly on predicting numerical meteorological variables (e.g., temperature), neglecting the translation of these variables into actionable textual narratives of events and their consequences. To bridge this gap, we proposed Weather and Climate Event Forecasting (WCEF), a new task that leverages numerical meteorological raster data and textual event data to predict weather and climate events. This task is challenging to accomplish due to difficulties in aligning multimodal data and the lack of supervised datasets. To address these challenges, we present CLLMate, the first multimodal dataset for WCEF, using 26,156 environmental news articles aligned with ERA5 reanalysis data. We systematically benchmark 23 existing MLLMs on CLLMate, including closed-source, open-source, and our fine-tuned models. Our experiments reveal the advantages and limitations of existing MLLMs and the value of CLLMate for the training and benchmarking of the WCEF task.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
DrafterBench: Benchmarking Large Language Models for Tasks Automation in Civil Engineering
mTSBench: Benchmarking Multivariate Time Series Anomaly Detection and Model Selection at Scale
Narrative Shift Detection: A Hybrid Approach of Dynamic Topic Models and Large Language Models
MLAR: Multi-layer Large Language Model-based Robotic Process Automation Applicant Tracking
AI Generated Text Detection Using Instruction Fine-tuned Large Language and Transformer-Based Models
Inaugural MOASEI Competition at AAMAS'2025: A Technical Report
토론
이 논문과 연결된 포럼 글이 아직 없습니다.