Representation Learning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 14
- 평가표
- 5
- 보존된 평가 기록
- 11
Representation Learning is a process in machine learning where algorithms extract meaningful patterns from raw data to create representations that are easier to understand and process. These representations can be designed for interpretability, reveal hidden features, or be used for transfer learning. They are valuable across many fundamental machine learning tasks like image classification and retrieval.
Deep neural networks can be considered representation learning models that typically encode information which is projected into a different subspace. These representations are then usually passed on to a linear classifier to, for instance, train a classifier.
Representation learning can be divided into:
- Supervised representation learning: learning representations on task A using annotated data and used to solve task B
- Unsupervised representation learning: learning representations on a task in an unsupervised way (label-free data). These are then used to address downstream tasks and reducing the need for annotated data when learning news tasks. Powerful models like GPT and BERT leverage unsupervised representation learning to tackle language tasks.
More recently, self-supervised learning (SSL) is one of the main drivers behind unsupervised representation learning in fields like computer vision and NLP.
Here are some additional readings to go deeper on the task:
- Representation Learning: A Review and New Perspectives - Bengio et al. (2012)
- A Few Words on Representation Learning - Thalles Silva
<span style="color:grey; opacity: 0.6">( Image credit: Visualizing and Understanding Convolutional Networks )</span>
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/santhtadi/AutoEncodersImageCompression
A Style-Based Generator Architecture for Generative Adversarial Networks
https://github.com/santhtadi/Colorize-Images-Pix2Pix-in-TensorflowJS
A Style-Based Generator Architecture for Generative Adversarial Networks
https://github.com/sanyuan-chen/unispeech
UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training
https://github.com/saromanov/godownload
https://github.com/sarus-tech/tf2-published-models/tree/master/vqvae
https://github.com/saulhazelius/transformer-clustering
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
https://github.com/sauradip/stale
Proposal-Free Temporal Action Detection via Global Segmentation Mask Learning
https://github.com/sayakpaul/A-Barebones-Image-Retrieval-System
https://github.com/sayakpaul/FunMatch-Distillation
https://github.com/sayakpaul/SimSiam-TF
https://github.com/sayakpaul/Supervised-Constrastive-Learning-in-TensorFlow-2
https://github.com/sayannag/GraphSSL_HSICVICReg
https://github.com/sayannag/TiCo-pytorch
https://github.com/sb-ai-lab/sketchboost-paper
https://github.com/schzhu/learning-adversarially-robust-representations
Learning deep representations by mutual information estimation and maximization
https://github.com/sclbd/deepfakebench
UCF: Uncovering Common Features for Generalizable Deepfake Detection
https://github.com/scpark20/universal-music-translation
https://github.com/sdamrich/cl-tsne-umap
https://github.com/sdasara95/Nuclei-Segmentation
https://github.com/sdimi/cardiofitness
Learning Generalizable Physiological Representations from Large-scale Wearable Data
https://github.com/sdll/hrnet-pose-estimation
Deep High-Resolution Representation Learning for Human Pose Estimation
https://github.com/sdret/a-solution-to-co-occurrence-bias-attributes-disentanglement-via-mutual-information-minimization-for
https://github.com/sebamenabar/SPACE-Pytorch-Implementation
SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decomposition
https://github.com/securade/hub
https://github.com/sedflix/tripletgan.pytorch
https://github.com/seeyourmind/tkgelib
HittER: Hierarchical Transformers for Knowledge Graph Embeddings
https://github.com/selimseker/logogram-language-generator
https://github.com/seongminp/hdseg
Unsupervised Extractive Dialogue Summarization in Hyperdimensional Space
https://github.com/sergkuzn148/lol3
A Style-Based Generator Architecture for Generative Adversarial Networks
https://github.com/sergkuzn148/stg
A Style-Based Generator Architecture for Generative Adversarial Networks
https://github.com/serre-lab/diffusion_as_artist
Diversity vs. Recognizability: Human-like generalization in one-shot generative models
https://github.com/servicenow/synbols
Synbols: Probing Learning Algorithms with Synthetic Datasets
https://github.com/setu4993/convert-labse-tf-pt
https://github.com/seunghan96/pits
https://github.com/seunghwan1228/ELMO
Evaluation of sentence embeddings in downstream and linguistic probing tasks
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.