https://github.com/huawei-noah/Pretrained-Language-Model
공식 코드PanGu-Bot: Efficient Generative Dialogue Pre-training from Pre-trained Language Model
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.
Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.
Further readings:
<span style="color:grey; opacity: 0.6">( Image credit: Adversarial Ranking for Language Generation )</span>
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
PanGu-Bot: Efficient Generative Dialogue Pre-training from Pre-trained Language Model
Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Order
Automatic Unit Test Data Generation and Actor-Critic Reinforcement Learning for Code Synthesis
What Matters In The Structured Pruning of Generative Language Models?
HuggingFace's Transformers: State-of-the-art Natural Language Processing
OmniMamba: Efficient and Unified Multimodal Understanding and Generation via State Space Models
StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation
UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning
Beyond Single Concept Vector: Modeling Concept Subspace in LLMs with Gaussian Distribution
LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation
Evaluating Personalized Tool-Augmented LLMs from the Perspectives of Personalization and Proactivity
Measuring and Improving Semantic Diversity of Dialogue Generation
ReMoDetect: Reward Models Recognize Aligned LLM's Generations
ReMoDetect: Reward Models Recognize Aligned LLM's Generations
DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
Controllable Text Generation for Large Language Models: A Survey
Controlled Text Generation for Large Language Model with Dynamic Attribute Graphs
UserSimCRS: A User Simulation Toolkit for Evaluating Conversational Recommender Systems
GreekBART: The First Pretrained Greek Sequence-to-Sequence Model
GreekBART: The First Pretrained Greek Sequence-to-Sequence Model
ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing
The Benefits of Bad Advice: Autocontrastive Decoding across Model Layers
Reprogramming Pretrained Language Models for Antibody Sequence Infilling
GLIMPSE: Pragmatically Informative Multi-Document Summarization for Scholarly Reviews
Panoramic Interests: Stylistic-Content Aware Personalized Headline Generation
Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterances
Large Language Models Are Read/Write Policy-Makers for Simultaneous Generation
Improving Multilingual Neural Machine Translation by Utilizing Semantic and Linguistic Features
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.