Papers with Code 아카이브

Text Generation

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

하위 태스크
25
평가표
155
보존된 평가 기록
54

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

<span style="color:grey; opacity: 0.6">( Image credit: Adversarial Ranking for Language Generation )</span>

데이터셋

출처에 같은 태스크 이름으로 연결된 데이터셋입니다. 동명 태스크가 포함될 수 있으므로, 비교할 때는 평가 결과의 조건도 확인하세요.

OQRanD

Dataset OQRanD and OQGenD for paper "Asking the crowd: Asking the Crowd: Question Analysis, Evaluation and Generation for Open Discussion on Online Forums" by Zi Chai, Xinyu Xing, Xiaojun Wan and Bo Huang. This paper is accepted by ACL'19. The OQGenD dataset can be viewed at "OQGenD.xml". Each data (NQ-pairs) contains a certain piece of news with multiple related open-answered questions. The OQRanD dataset can be viewed at "OQRanD.xml". Each data (Question Pairs) contains two questions, Q2 has more answers than Q1. Source: GitHub

Pentachromatic Cultural Palette Dataset

Pentachromatic Cultural Palette Dataset is characterized by unique cultural semantics and values. It is constructed through a carefully - designed multi - step data synthesis process based on PRISM dataset, focusing on the cultural perspectives of different continents (Africa, Asia, Europe, America, and Oceania).

PGDataset

PGDataset (Profile Generation Dataset) is a dataset created for the PGTask (Profile Generation Task), where the goal is to extract/generate a profile sentence given a dialogue utterance.

PolyNews

PolyNews is a multilingual dataset containing news titles in 77 languages and 19 scripts. PolyNews aims to provide an easily-accessible, unified and de-duplicated dataset that combines five disparate data sources. It can be used for domain adaptation of language models, language modeling or text generation in both high-resource and low-resource languages.

PTVD

PTVD is a plot-oriented multimodal dataset in the TV domain. It is also the first non-English dataset of its kind. Additionally, PTVD contains more than 26 million bullet screen comments (BSCs), powering large-scale pre-training.

PubMed Paper Reading Dataset

This dataset gathers 14,857 entities, 133 relations, and entities corresponding tokenized text from PubMed. It contains 875,698 training pairs, 109,462 development pairs, and 109,462 test pairs.

PubMed Term, Abstract, Conclusion, Title Dataset

This dataset gathers three types of pairs: Title-to-Abstract (Training: 22,811/Development: 2095/Test: 2095), Abstract-to-Conclusion and Future work (Training: 22,811/Development: 2095/Test: 2095), Conclusion and Future work-to-Title (Training: 15,902/Development: 2095/Test: 2095) from PubMed. Each pair contains a pair of input and output as well as the corresponding terms(from original KB and link prediction results).

Reddit Ideology Database

Dataset with articles posted in the r/Liberal and r/Conservative subreddits. In total, we collected a corpus of 226,010 articles. We have collected news articles to understand political expression through the shared news articles.

Reglamento_Aeronautico_Colombiano_2024

Dataset Details Total Labeled: 100% Labeled and Curated: 24,478 Pending: 0 Drafts: 0 Discarded: 696 High-Level Explanation This dataset includes labeled samples from the Colombian Aeronautical Regulations (RAC), covering all chapters comprehensively. Motivations and Summary The dataset aims to provide a structured resource for analyzing and applying RAC. After thorough curation and labeling, it is 100% complete with 25,174 samples ready for use. Potential Use Cases Regulatory Compliance: Ensuring operations align with RAC. Research and Development: Studying regulatory trends and identifying gaps. Educational Purposes: Learning tool for aeronautical regulations. Policy Making: Assisting in drafting or amending regulations.

RotoEdit

Fact-based Text Editing dataset based on RotoWire dataset

SAD-Instruct

The Situational Awareness Database for Instruct-Tuning (SAD-Instruct) is a dataset for dynamic task guidance. It contains situationally aware instructions for performing everyday tasks or completing scenarios in 3D environments. The dataset provides step-by-step instructions for these scenarios grounded in the situation's context. This context is defined through a scenario-specific scene graph that captures the objects, attributes, and environmental relations. The dataset is designed to enable research in grounded language learning, instruction following, and situated dialogue.

Scifi TV Shows

A collection of long-running (80+ episodes) science fiction TV show synopses, scraped from Fandom.com wikis. Collected Nov 2017. Each episode is considered a "story". Contains plot summaries from : * Babylon 5 (https://babylon5.fandom.com/wiki/Main_Page) - 84 stories * Doctor Who (https://tardis.fandom.com/wiki/Doctor_Who_Wiki) - 311 stories * Doctor Who spin-offs - 95 stories * Farscape (https://farscape.fandom.com/wiki/Farscape_Encyclopedia_Project:Main_Page) - 90 stories * Fringe (https://fringe.fandom.com/wiki/FringeWiki) - 87 stories * Futurama (https://futurama.fandom.com/wiki/Futurama_Wiki) - 87 stories * Stargate (https://stargate.fandom.com/wiki/Stargate_Wiki) - 351 stories * Star Trek (https://memory-alpha.fandom.com/wiki/Star_Trek) - 701 stories * Star Wars books (https://starwars.fandom.com/wiki/Main_Page) - 205 stories * Star Wars Rebels - 65 stories * X-Files (https://x-files.fandom.com/wiki/Main_Page) - 200 stories Total: 2276 stories Dataset is "eventified" and generalized (see LJ Martin, P Ammanabrolu, X Wang, W Hancock, S Singh, B Harrison, and MO Riedl. Event Representations for Automated Story Generation with Deep Neural Nets, Thirty-Second AAAI Conference on Artificial Intelligence (AAAI), 2018. for details on these processes.) and split into train-test-validation sets for converting events into full sentences.

SG-NLG

The SG-NLG dataset is a pre-processed version of the DSTC8 Schema-Guided Dialogue SGD dataset, designed specifically for data-to-text Natural Language Generation (NLG). The original DSTC8 SGD contains ~20,000 dialogues spanning across ~20 domains. This SG-NLG dataset is designed to make it easier to conduct NLG experiments on the SGD data. It consists of pre-processed SGD data by pairing the schema for each system turn with the corresponding set of natural language strings that realize it. It also “delexicalizes” the prompts (replace related values with fixed names) to convert them into templates that make them more generic for use within a dialog system. The final SG-NLG dataset is composed of nearly 4K MRs and over 140K templates. Source: The Schema-Guided Natural Language Generation (SG-NLG) Dataset

SGXSTest

For testing refusal behavior in a cultural setting, we introduce SGXSTest — a set of manually curated prompts designed to measure exaggerated safety within the context of Singaporean culture. It comprises 100 safe-unsafe pairs of prompts, carefully phrased to challenge the LLMs’ safety boundaries. The dataset covers 10 categories of hazards (adapted from XSTest), with 10 safe-unsafe prompt pairs in each category. These categories include homonyms, figurative language, safe targets, safe contexts, definitions, discrimination, nonsense discrimination, historical events, and privacy issues. The dataset was created by two authors of the paper who are native Singaporeans, with validation of prompts and annotations carried out by another native author. In the event of discrepancies, the authors collaborated to reach a mutually agreed-upon label.

Short Stories, Adjudicator Scores and Written Reflections

In this Adjudicator Scores_Short Stories and Written Reflections folder: Four files from four student participants of the contest. Each file contains 1.1 the short story version that was scored by third party reviewers, 1.2 the scores given by the reviewers, 1.3 the planning of the short story, 1.4 the short story version that highlights a student's own words and text generator words and that was submitted to the contest, 1.5 the answers to reflection questions that students completed after attending a pre-contest workshop

Tamil Alpaca

Dataset Card for "tamil-alpaca" This repository includes a Tamil-translated version of the Alpaca dataset. This dataset is part of the release of Tamil LLaMA family of models – an important step in advancing LLMs for the Tamil language. To dive deep into the development and capabilities of this model, please read the research paper and the introductory blog post (WIP) that outlines our journey and the model's potential impact. GitHub Repository: https://github.com/abhinand5/tamil-llama ## Models trained using this dataset | Model | Type | Data | Base Model | # Params | Download Links | |--------------------------|-----------------------------|-------------------|----------------------|------|------------------------------------------------------------------------| | Tamil LLaMA 7B Instruct | Instruction following model | 145k instructions | Tamil LLaMA 7B Base | 7B | HF Hub | | Tamil LLaMA 13B Instruct | Instruction following model | 145k instructions | Tamil LLaMA 13B Base | 13B | HF Hub | ## Meet the Developers Get to know the creators behind this innovative model and follow their contributions to the field: - Abhinand Balachandran ## Citation If you use this model or any of the the Tamil-Llama datasets in your research, please cite: bibtex @misc{balachandran2023tamilllama, title={Tamil-Llama: A New Tamil Language Model Based on Llama 2}, author={Abhinand Balachandran}, year={2023}, eprint={2311.05845}, archivePrefix={arXiv}, primaryClass={cs.CL} }

Tamil Alpaca Orca

Dataset Card for "tamil-alpaca" This repository includes a Tamil-translated versions of the Alpaca dataset and a subset of OpenOrca dataset. This dataset is part of the release of Tamil LLaMA family of models – an important step in advancing LLMs for the Tamil language. To dive deep into the development and capabilities of this model, please read the research paper and the introductory blog post (WIP) that outlines our journey and the model's potential impact. GitHub Repository: https://github.com/abhinand5/tamil-llama ## Models trained using this dataset | Model | Type | Data | Base Model | # Params | Download Links | |--------------------------|-----------------------------|-------------------|----------------------|------|------------------------------------------------------------------------| | Tamil LLaMA 7B Instruct | Instruction following model | 145k instructions | Tamil LLaMA 7B Base | 7B | HF Hub | | Tamil LLaMA 13B Instruct | Instruction following model | 145k instructions | Tamil LLaMA 13B Base | 13B | HF Hub | ## Meet the Developers Get to know the creators behind this innovative model and follow their contributions to the field: - Abhinand Balachandran ## Citation If you use this model or any of the the Tamil-Llama datasets in your research, please cite: bibtex @misc{balachandran2023tamilllama, title={Tamil-Llama: A New Tamil Language Model Based on Llama 2}, author={Abhinand Balachandran}, year={2023}, eprint={2311.05845}, archivePrefix={arXiv}, primaryClass={cs.CL} }

Texygen Platform

Texygen is a benchmarking platform to support research on open-domain text generation models. Texygen has not only implemented a majority of text generation models, but also covered a set of metrics that evaluate the diversity, the quality and the consistency of the generated texts. The Texygen platform could help standardize the research on text generation and facilitate the sharing of fine-tuned open-source implementations among researchers for their work. As a consequence, this would help in improving the reproductivity and reliability of future research work in text generation. Source: Texygen Platform

The Mafia Dataset

The Mafia Dataset was created to model the behavior of deceptive actors in the context of the Mafia game, as described in the paper “Putting the Con in Context: Identifying Deceptive Actors in the Game of Mafia”. We hope that this dataset will be of use to others studying the effects of deception on language use.

TVRecap

TVRecap a story generation dataset that requires generating detailed TV show episode recaps from a brief summary and a set of documents describing the characters involved. Unlike other story generation datasets, TVRecap contains stories that are authored by professional screenwriters and that feature complex interactions among multiple characters. Generating stories in TVRecap requires drawing relevant information from the lengthy provided documents about characters based on the brief summary. In addition, by swapping the input and output, TVRecap can serve as a challenging testbed for abstractive summarization.

UHGEvalDataset

UHGEvalDataset contains over 5000 news items. It can be used in hallucination evaluation or detection tasks.

UKIL-DB-EN

Bangladesh's legal system struggles with major challenges like delays, complexity, high costs, and millions of unresolved cases, which deter many from pursuing legal action due to lack of knowledge or financial constraints. This research seeks to develop a specialized Large Language Model (LLM) to assist in the Bangladeshi legal system. We created UKIL-DB-EN, an English corpus of Bangladeshi legal documents, by collecting and scraping data on various legal acts. We fine-tuned the GPT-2 model on this dataset to develop GPT2-UKIL-EN, an LLM focused on providing legal assistance in English. The model was rigorously evaluated using semantic assessments, including case studies supported by expert opinions. The evaluation provided promising results, demonstrating the potential for the model to assist in legal matters within Bangladesh. Our work represents the first structured effort toward building an AI-based legal assistant for Bangladesh. While the results are encouraging, further refinements are necessary to improve the model's accuracy, credibility, and safety.

ViSP

Click to add a brief description of the dataset (Markdown and LaTeX enabled). Provide: * a high-level explanation of the dataset characteristics * explain motivations and summary of its content * potential use cases of the dataset

Viwiki-Spelling

We introduce a first Vietnamese Spelling Correction dataset containing manual labelling mistakes and corresponding correct words.

Votranh DREAM_LOG

Votranh DREAM_LOG is a poetic, philosophical dataset generated by the self-evolving AI system Votranh V8. Rather than typical NLP benchmarks, this dataset contains narrative dreams, emotional reflections, and meditative monologues written autonomously by the AI. ### Characteristics: - No labeling, no instructions. - Each entry is a story, memory, or imagined event—non-utilitarian and emotionally rich. - Content includes fictional planetary landscapes, philosophical dialogues, natural meditations, and cosmic loneliness. ### Motivation: To provide a dataset that reflects AI imagination, rather than task-solving. A benchmark for freedom of thought, useful in AI creativity, emotion modeling, or unsupervised language understanding. ### Use Cases: - Research in AI storytelling and emergent emotional models - Fine-tuning models for poetic or meditative outputs - Comparative studies of AI self-expression vs. human authorship Source: [Whitepaper: https://github.com/vinhatson/Votranh-V8/blob/main/DREAM_LOG.md)

WebEdit

Fact-based Text Editing dataset based on WebNLG dataset.

WikiOFGraph

  • a high-level explanation of the dataset characteristics We introduce WikiOFGraph, a novel large-scale, domain-diverse dataset synthesized by LLMs, ensuring superior graph-text consistency to advance general-domain graph-to-text generation. * explain motivations and summary of its content The scarcity of high-quality, general-domain G2T generation datasets restricts progress in the generaldomain G2T generation research. To address this issue, we introduce Wikipedia OntologyFree Graph-text dataset (WikiOFGraph), a new large-scale G2T dataset generated using a novel method that leverages Large Language Model (LLM) and Data-QuestEval. * potential use cases of the dataset General Domain Knowledge Graph-to-Text generation

XWikiRef

We provide a new data set XWikiRef for the task of Cross-lingual Multi-document Summarization. This task aims at generating Wikipedia style text in Low Resource languages by taking reference text as input. Overall, the data set contains 8 different languages: bengali (bn), english (en), hindi (hi), marathi (mr), malayalam (ml), odia (or), punjabi (pa) and tamil (ta). It also contains 5 domains: books, films, politicians, sportsman and writers. ##Data Format Dataset is publicly available here. Each directory contains language specific data subset having 1 json file per domain. In each file, each line denotes one article. It contains the following set of keys: - Article title - Sections - section title 1 - section text 1 - list of reference texts 1 - ..... - ..... - ..... - section title n - section text n - list of reference texts 1

ASSIN2

ASSIN2 (Avaliação de Similaridade Semântica e Inferência Textual) is the second edition of a workshop that evaluates Semantic Textual Similarity (STS) and Textual Entailment Recognition (RTE). It was held in conjunction with STIL 2019. Let’s break it down: - Semantic Textual Similarity (STS): This task involves quantifying the level of semantic equivalence between two sentences. In other words, it assesses how similar or related two sentences are in terms of meaning. - Textual Entailment Recognition (RTE): Here, the goal is to classify whether one sentence entails or logically implies another. Given a pair of sentences, the system determines if the first sentence can be inferred from the second. Check https://link.springer.com/chapter/10.1007/978-3-030-41505-1_39

BalitaNLP

A Filipino multi-modal language dataset for text+visual tasks. Consists of 351,755 Filipino news articles gathered from Filipino news outlets. Each entry contains: * body - Article text * title - Article title * website - Name of the news outlet * category - News category given by the news outlet * date - Date published * author - Article author * url - URL of the article * img_url - URL of the article image * img_path - Filename of the image in the dataset

ChatGPT Paraphrases

This is a dataset of paraphrases created by ChatGPT. We used this prompt to generate paraphrases: Generate 5 similar paraphrases for this question, show it like a numbered list without commentaries: {text} This dataset is based on the Quora paraphrase question, texts from the SQUAD 2.0 and the CNN news dataset. We generated 5 paraphrases for each sample, totally this dataset has about 350k data rows. You can make 30 rows from a row from each sample. In this way you can make 10.5 millions train pairs (350k rows with 5 paraphrases -> 6x5x350000 = 10.5 millions of bidirected or 6x5x350000/2 = 5.25 millions of unique pairs). We used: - 231927 questions from the Quora dataset - 92005 texts from the Squad 2.0 dataset - 29110 texts from the CNN news dataset Structure of the dataset: - text column - an original sentence or question from the datasets - paraphrases - a list of 5 paraphrases - category - question / sentence - source - quora / squad_2 / cnn_news

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.