Representation Learning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 14
- 평가표
- 5
- 보존된 평가 기록
- 11
Representation Learning is a process in machine learning where algorithms extract meaningful patterns from raw data to create representations that are easier to understand and process. These representations can be designed for interpretability, reveal hidden features, or be used for transfer learning. They are valuable across many fundamental machine learning tasks like image classification and retrieval.
Deep neural networks can be considered representation learning models that typically encode information which is projected into a different subspace. These representations are then usually passed on to a linear classifier to, for instance, train a classifier.
Representation learning can be divided into:
- Supervised representation learning: learning representations on task A using annotated data and used to solve task B
- Unsupervised representation learning: learning representations on a task in an unsupervised way (label-free data). These are then used to address downstream tasks and reducing the need for annotated data when learning news tasks. Powerful models like GPT and BERT leverage unsupervised representation learning to tackle language tasks.
More recently, self-supervised learning (SSL) is one of the main drivers behind unsupervised representation learning in fields like computer vision and NLP.
Here are some additional readings to go deeper on the task:
- Representation Learning: A Review and New Perspectives - Bengio et al. (2012)
- A Few Words on Representation Learning - Thalles Silva
<span style="color:grey; opacity: 0.6">( Image credit: Visualizing and Understanding Convolutional Networks )</span>
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/rsn870/VQ-VAE
https://github.com/rucaibox/safe
QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering
https://github.com/ruiliu-ai/DivCo
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/ruiqigao/DeformableGenerator
Deformable Generator Networks: Unsupervised Disentanglement of Appearance and Geometry
https://github.com/rusty1s/pytorch_cluster
https://github.com/rusty1s/pytorch_geometric/blob/master/torch_geometric/nn/conv/gatv2_conv.py
https://github.com/rvoleti89/icaasp-2019-word-subs
Investigating the Effects of Word Substitution Errors on Sentence Embeddings
https://github.com/rvr-account/rvr
Learning Adversarially Fair and Transferable Representations
https://github.com/rvstraalen/doc2vec-workshop
https://github.com/s-a-malik/inorg-synth-graph
https://github.com/s-nlp/russe_detox_2022
https://github.com/saarahasad/Relation-Extraction
Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders
https://github.com/sabadijou/byol_multi_gpu
Bootstrap your own latent: A new approach to self-supervised Learning
https://github.com/safakkbilici/Synthetic-Music-Generation-with-Deep-Neural-Networks
https://github.com/safe-slac/safe-slac
Stochastic Latent Actor-Critic: Deep Reinforcement Learning with a Latent Variable Model
https://github.com/safooray/tensor_factorization_mtl
Deep Multi-task Representation Learning: A Tensor Factorisation Approach
https://github.com/safreita1/malnet-image
https://github.com/safwankdb/Deep-Image-Prior
https://github.com/saghiralfasly/VFL-Vehicle-Re-Id
Variational Representation Learning for Vehicle Re-Identification
https://github.com/sahand68/Deep-Convolutional-GAN
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/sahil02235/DCGAN
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/saic-fi/bayesian-prompt-learning
https://github.com/sakura2233565548/Self-Supervised-Representation-Learning-with-Spatial-Temporal-Consistency-for-SLR
https://github.com/salarim/Semi-Supervised-CL
https://github.com/salesforce/ALBEF
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation
https://github.com/salesforce/DAPC
Representation Learning for Sequence Data with Deep Autoencoding Predictive Components
https://github.com/salesforce/pb-ovd
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation
https://github.com/salwaalkhatib/p2p-net
Fine-Grained Object Classification via Self-Supervised Pose Alignment
https://github.com/samiroid/usr2vec
Quantifying Mental Health from Social Media with Neural User Embeddings
https://github.com/samirsahoo007/Audio-and-Speech-Processing
An Unsupervised Autoregressive Model for Speech Representation Learning
https://github.com/samuelfneumann/GoAtar
MinAtar: An Atari-Inspired Testbed for Thorough and Reproducible Reinforcement Learning Experiments
https://github.com/sanaAyrml/GenerativeSSL_Submission
Can Generative Models Improve Self-Supervised Representation Learning?
https://github.com/sanderwood/clamp3
https://github.com/sangdon/pac-ps-w
https://github.com/sangho-vision/acav100m
ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.