Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 107편

LIMA

LIMA 설명 보기

The LIMA dataset is a valuable resource used in natural language processing (NLP) research. Let me provide you with some details: 1. Origin and Purpose: - The LIMA dataset is derived from the LLaMa language model, which has an impressive 65 billion parameters. - It serves as a fine-tuned version of the LLaMa model, specifically adjusted using approximately 1,000 prompts and responses. 2. Performance and Applications: - LIMA demonstrates remarkable performance by learning to follow specific response formats from just a handful of examples in the training data. - The dataset covers a wide range of tasks, including complex queries such as planning trip itineraries and speculating about alternate history. - Interestingly, the model tends to generalize well to unseen tasks that were not part of the training data. 3. License: - The licensing of the LIMA dataset depends on the source data it was derived from: - If the source data has a stricter license than CC BY-NC-SA, the LIMA dataset follows the same restrictions. - Otherwise, it adheres to the CC BY-NC-SA license. (1) GAIR/lima · Datasets at Hugging Face. https://huggingface.co/datasets/GAIR/lima. (2) GAIR/lima at main - Hugging Face. https://huggingface.co/datasets/GAIR/lima/tree/main. (3) 日本語LIMAデータセットlima-jaを作成したので公開します. https://zanote.net/ai/lima-ja/. (4) Paper page - LIMA: Less Is More for Alignment - Hugging Face. https://huggingface.co/papers/2305.11206. (5) undefined. https://huggingface.co/datasets/GAIR/lima/.

관련 논문 5편

ClimateSet - : A Large-Scale Climate Model Dataset for Machine Learning

ClimateSet
ClimateSet 설명 보기

Climate models are critical tools for analyzing climate change and projecting its future impact. The machine learning (ML) community has taken an increased interest in supporting climate scientists’ efforts on various tasks such as climate model emulation, downscaling, and prediction tasks. However, traditional datasets based on single climate models are limiting. We thus present ClimateSet — a comprehensive collection of inputs and outputs from 36 climate models sourced from the Input4MIPs and CMIP6 archives, designed for large-scale ML applications.

관련 논문 4편

Climate Atmospheric Radiative Transfer

ClimART
ClimART 설명 보기

Numerical simulations of Earth's weather and climate require substantial amounts of computation. This has led to a growing interest in replacing subroutines that explicitly compute physical processes with approximate machine learning (ML) methods that are fast at inference time. Within weather and climate models, atmospheric radiative transfer (RT) calculations are especially expensive. This has made them a popular target for neural network-based emulators. However, prior work is hard to compare due to the lack of a comprehensive dataset and standardized best practices for ML benchmarking. To fill this gap, we build a large dataset, ClimART, with more than \emph{10 million samples from present, pre-industrial, and future climate conditions}, based on the Canadian Earth System Model. ClimART poses several methodological challenges for the ML community, such as multiple out-of-distribution test sets, underlying domain physics, and a trade-off between accuracy and inference speed.

관련 논문 4편

Climabench

Climabench 설명 보기

The topic of Climate Change (CC) has received limited attention in NLP despite its real world urgency. Activists and policy-makers need NLP tools in order to effectively process the vast and rapidly growing textual data produced on CC. Their utility, however, primarily depends on whether the current state-of-the-art models can generalize across various tasks in the CC domain. In order to address this gap, we introduce Climate Change Benchmark (ClimaBench), a benchmark collection of existing disparate datasets for evaluating model performance across a diverse set of CC NLU tasks systematically. Further, we enhance the benchmark by releasing two large-scale labelled text classification and question-answering datasets curated from publicly available environmental disclosures. Lastly, we provide an analysis of several generic and CC-oriented models answering whether fine-tuning on domain text offers any improvements across these tasks. We hope this work provides a standard assessment tool for research on CC text data.

관련 논문 2편

ClimateIQA

ClimateIQA 설명 보기

The dataset was created to address the crucial need for effective Extreme Weather Events Detection (EWED), an increasingly urgent task due to the rising frequency of such events driven by global warming. Traditional methods for EWED rely on numerical threshold setting and the analysis of weather anomaly heatmaps, visualizing data such as temperature, wind speed, and precipitation. However, these methods often involve manual work and can be time-consuming and error-prone. While advances in AI have led to the development of machine learning models like Convolutional Neural Networks (CNNs) for weather prediction and EWED, these models predominantly use numeric data and often yield low accuracy. Moreover, despite the proficiency of Large Language Models (LLMs) in generating textual weather reports, they struggle with interpreting visual data—crucial for EWED. General Vision-Language Models (VLMs) also face challenges in accurately interpreting meteorological heatmaps, commonly misidentifying colors, providing irrelevant responses, and giving incomplete answers. This dataset aims to fill these gaps by providing specialized meteorological data to fine-tune VLMs for more accurate and efficient EWED.

관련 논문 1편

High-resolution 3D urban microclimate simulation in multiple wind directions

CityFFD 3D Urban Wind Simulation - Niigata
CityFFD 3D Urban Wind Simulation - Niigata 설명 보기

This is the full dataset for the paper Fourier neural operator for real-time simulation of 3D dynamic urban microclimate. The dataset of 3D urban wind simulation data of Niigata is generated from CityFFD. A total of 1200 steps of wind simulation were executed. The dataset contains four wind directions of data. Data for the west and north winds include all 1200 simulation steps. Data for the east and south winds include the last 50 steps of the simulation. Each step of the data is a 200 * 200 * 150 array with 32-bit precision and is stored as a numpy file.

관련 논문 1편

Dhoroni: A Multi-Perspective Bengali Climate Change and Environmental News Dataset

Dhoroni
Dhoroni 설명 보기

Climate change poses critical challenges globally, disproportionately affecting low-income countries that often lack resources and linguistic representation on the international stage. Despite Bangladesh's status as one of the most vulnerable nations to climate impacts, research gaps persist in Bengali-language studies related to climate change and NLP. To address this disparity, we introduce ধরণী (Dhoroni), a novel Bengali (Bangla) climate change and environmental news dataset, comprising a 2300 annotated Bangla news articles, offering multiple perspectives such as political influence, scientific/statistical data, authenticity, stance detection, and stakeholder involvement. Furthermore, we present an in-depth exploratory analysis of Dhoroni and introduce BanglaBERT-Dhoroni family, a novel baseline family for climate stance detection in Bangla, fine-tuned on our dataset. This research contributes significantly to enhancing accessibility and analysis of climate discourse in Bengali (Bangla), addressing crucial communication and research gaps in climate-impacted regions like Bangladesh with 180 million people.

관련 논문 1편

Benchmark for 5k raw mineral species recognition

MineralImage5k
MineralImage5k 설명 보기

We present a comprehensive dataset comprising a vast collection of raw mineral samples for the purpose of mineral recognition. The dataset encompasses more than 5,000 distinct mineral species and incorporates subsets for zero-shot and few-shot learning. In addition to the samples themselves, some entries in the dataset are accompanied by supplementary natural language descriptions, size measurements, and segmentation masks. For detailed information on each sample, please refer to the minerals_full.csv file.

관련 논문 1편

NOAA/WDS Paleoclimatology - Barron et al. 2004 High Resolution Guaymas Basin Geochemical, Diatom, and Silicoflagellate Data

NOAA/WDS Guyamas Basin
NOAA/WDS Guyamas Basin 설명 보기

This archived Paleoclimatology Study is available from the NOAA National Centers for Environmental Information (NCEI), under the World Data Service (WDS) for Paleoclimatology. The associated NCEI study type is Paleoceanography. The data include parameters of paleoceanography with a geographic location of Eastern Pacific Ocean. The time period coverage is from 15190 to 1330 in calendar years before present (BP).

관련 논문 1편

NoLiMa: Long-Context Evaluation Beyond Literal Matching

NoLiMa
NoLiMa 설명 보기

A benchmark extending needle-in-a-haystack (NIAH) test with a carefully designed needle set, where questions and needles have minimal lexical overlap, requiring models to infer latent associations to locate the needle within the haystack.

관련 논문 1편

The Reddit Climate Change Dataset

The Reddit Climate Change Dataset 설명 보기

The Reddit Climate Change Dataset is a dataset of 620K Reddit posts and 4.6M comments - all mentions of the terms "climate" and "change" until 2022-09-01 across the entire Reddit social network. Both were procured with SocialGrep's export feature and released as part of SocialGrep Reddit datasets. The posts are labeled with their subreddit, title, creation date, domain, selftext, and score. The comments are labeled with their subreddit, body, creation date, sentiment (calculated for you using a VADER pipeline), and score.

관련 논문 1편

ValiMath

ValiMath 설명 보기

ValiMath is a high-quality benchmark consisting of 2,147 carefully curated mathematical questions designed to evaluate an LLM's ability to verify the correctness of math questions based on multiple logic-based and structural criteria.

관련 논문 1편

wildFireClimateChangeTweets

wildFireClimateChangeTweets 설명 보기

Here I provided the datasets I used for this analysis. It includes the tweets I streamed using the Tweepy package on Python during the peach of the wildfire season in late summer/early fall of 2020. The files include: 1- Public: 39 items of CSV files for the dates (day by day) starting 09/06/2020 to 09/23/2020 1 file combined for all the dates (+185k of tweets with the desired keywords) 2- Government Locals: CA: Counties of Napa, Mendocino, Santa Clara, Sonoma, and Fresno OR: City of Salem, and Counties of Lane, Clackamas, Jackson, and Multnomah CO: County of Larimer and Boulder Cities of Boulder, Grand Junction, Glenwood Springs, and Cortex 15 accounts in total State-level: Governors of three states, California, Colorado, and Oregon Congress representatives: 5 for each state 18 accounts in total Federal: 6 senators, California, Colorado, and Oregon Information Provided for each tweet: Date/Time UserID UserName Tweet's text Number of retweets Number of likes Provide: