Representation Learning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 14
- 평가표
- 5
- 보존된 평가 기록
- 11
Representation Learning is a process in machine learning where algorithms extract meaningful patterns from raw data to create representations that are easier to understand and process. These representations can be designed for interpretability, reveal hidden features, or be used for transfer learning. They are valuable across many fundamental machine learning tasks like image classification and retrieval.
Deep neural networks can be considered representation learning models that typically encode information which is projected into a different subspace. These representations are then usually passed on to a linear classifier to, for instance, train a classifier.
Representation learning can be divided into:
- Supervised representation learning: learning representations on task A using annotated data and used to solve task B
- Unsupervised representation learning: learning representations on a task in an unsupervised way (label-free data). These are then used to address downstream tasks and reducing the need for annotated data when learning news tasks. Powerful models like GPT and BERT leverage unsupervised representation learning to tackle language tasks.
More recently, self-supervised learning (SSL) is one of the main drivers behind unsupervised representation learning in fields like computer vision and NLP.
Here are some additional readings to go deeper on the task:
- Representation Learning: A Review and New Perspectives - Bengio et al. (2012)
- A Few Words on Representation Learning - Thalles Silva
<span style="color:grey; opacity: 0.6">( Image credit: Visualizing and Understanding Convolutional Networks )</span>
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/somiltg/xquad
https://github.com/songlab-cal/tape-neurips2019
https://github.com/sonnguyen129/deep-feature-rotation
https://github.com/soskek/bookcorpus
https://github.com/soskek/homemade_bookcorpus
https://github.com/soumavaghosh/graph2vec
https://github.com/soumyaumass/umwe
https://github.com/sourabhdattawad/TabNet
https://github.com/sp-uhh/disentangled-vae
Disentanglement Learning for Variational Autoencoders Applied to Audio-Visual Speech Enhancement
https://github.com/sreejukomath/NLPProjects
An Empirical Evaluation of doc2vec with Practical Insights into Document Embedding Generation
https://github.com/srgrace/contextual-compression
In-context Autoencoder for Context Compression in a Large Language Model
https://github.com/srijankr/jodie
Predicting Dynamic Embedding Trajectory in Temporal Interaction Networks
https://github.com/srijith-rkr/kaust-whisper-adapter
Voice2Series: Reprogramming Acoustic Models for Time Series Classification
https://github.com/srinidhiPY/ICCV-CDPATH2021-ID-8
Self-supervised driven consistency training for annotation efficient histopathology image analysis
https://github.com/srvcodes/clap4clip
https://github.com/sschrod/adbcr
https://github.com/sseung0703/GALA_TF2.0
Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learning
https://github.com/sshirahmad/GCRL
Generative Causal Representation Learning for Out-of-Distribution Motion Forecasting
https://github.com/stabuev/d2l-ru
ControlVAE: Tuning, Analytical Properties, and Performance Analysis
https://github.com/stanfordnlp/cocoa
Learning Symmetric Collaborative Dialogue Agents with Dynamic Knowledge Graph Embeddings
https://github.com/stanleyjzheng/ignitionhacks
https://github.com/statisticalbiotechnology/tape
https://github.com/stdereka/egnn
https://github.com/stefkim/stylegan-batik
A Style-Based Generator Architecture for Generative Adversarial Networks
https://github.com/stellargraph/stellargraph
https://github.com/sthalles/PyTorch-BYOL
Bootstrap your own latent: A new approach to self-supervised Learning
https://github.com/strivebo/image_segmentation_dl
Deep High-Resolution Representation Learning for Human Pose Estimation
https://github.com/subinium/Pytorch-GAN-Keynote-KR
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/sugyan/tf-dcgan
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/suinleelab/cfs
https://github.com/sulcantonin/text_icalepcs23
https://github.com/sumedh7/CausalCuriosity
https://github.com/sumitsidana/NERvE
Representation Learning and Pairwise Ranking for Implicit Feedback in Recommendation Systems
https://github.com/sumkumar/hiro_impl
Near-Optimal Representation Learning for Hierarchical Reinforcement Learning
https://github.com/summarization/semantic_summ
Toward Abstractive Summarization Using Semantic Representations
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.