Representation Learning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 14
- 평가표
- 5
- 보존된 평가 기록
- 11
Representation Learning is a process in machine learning where algorithms extract meaningful patterns from raw data to create representations that are easier to understand and process. These representations can be designed for interpretability, reveal hidden features, or be used for transfer learning. They are valuable across many fundamental machine learning tasks like image classification and retrieval.
Deep neural networks can be considered representation learning models that typically encode information which is projected into a different subspace. These representations are then usually passed on to a linear classifier to, for instance, train a classifier.
Representation learning can be divided into:
- Supervised representation learning: learning representations on task A using annotated data and used to solve task B
- Unsupervised representation learning: learning representations on a task in an unsupervised way (label-free data). These are then used to address downstream tasks and reducing the need for annotated data when learning news tasks. Powerful models like GPT and BERT leverage unsupervised representation learning to tackle language tasks.
More recently, self-supervised learning (SSL) is one of the main drivers behind unsupervised representation learning in fields like computer vision and NLP.
Here are some additional readings to go deeper on the task:
- Representation Learning: A Review and New Perspectives - Bengio et al. (2012)
- A Few Words on Representation Learning - Thalles Silva
<span style="color:grey; opacity: 0.6">( Image credit: Visualizing and Understanding Convolutional Networks )</span>
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/twjiang/graphSAGE-pytorch
https://github.com/txyugood/Knowledge_Distillation_AD_Paddle
Multiresolution Knowledge Distillation for Anomaly Detection
https://github.com/txyugood/tabnet
https://github.com/tylercroberts/funwithgans
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/tyuxie/vbpi-sibranch
Learnable Topological Features for Phylogenetic Inference via Graph Neural Networks
https://github.com/u7javed/DCGAN_pytorch
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/u7javed/Handwritten-Number-Generator
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/uclnlp/emoji2vec
emoji2vec: Learning Emoji Representations from their Description
https://github.com/ucsd-dsc-arts/dsc160-final-404-not-found-1
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/uma-pi1/dist-kge
Start Small, Think Big: On Hyperparameter Optimization for Large-Scale Knowledge Graph Embeddings
https://github.com/uma-pi1/kge-iclr20
https://github.com/uman95/AMMI_research
https://github.com/unispac/visual-adversarial-examples-jailbreak-large-language-models
https://github.com/unit8co/darts
Probabilistic Forecasting with Temporal Convolutional Neural Network
https://github.com/unitaryai/VTC
https://github.com/universome/stylegan-v
Towards Accurate Generative Models of Video: A New Metric & Challenges
https://github.com/unixpickle/vq-draw
https://github.com/uoe-agents/ksl
Learning Temporally-Consistent Representations for Data-Efficient Reinforcement Learning
https://github.com/urielsinger/ctdne
https://github.com/urielsinger/fairwalk
https://github.com/usc-sail/fed-ser-leakage
https://github.com/usc-sail/fed-ser-semi
https://github.com/ut-vision/simhand
https://github.com/utkarshojha/elastic-infogan
Elastic-InfoGAN: Unsupervised Disentangled Representation Learning in Class-Imbalanced Data
https://github.com/uw-mad-dash/Accordion
https://github.com/uzi0espil/research-papers-implementation/tree/master/Temporal%20Neighborhood%20Coding
Unsupervised Representation Learning for Time Series with Temporal Neighborhood Coding
https://github.com/v-iashin/SpecVQGAN
https://github.com/v1viswan/Domain_adaptation_in_HRNet
Deep High-Resolution Representation Learning for Human Pose Estimation
https://github.com/valdecy/pybibx
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
https://github.com/valentingol/GANJax
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/vandit15/Self-Supervised-Gans-Pytorch
https://github.com/vano1205/efficientcl
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations
https://github.com/vanzytay/KDD2018_MPCN
https://github.com/vanzytay/WSDM2018_HyperQA
Hyperbolic Representation Learning for Fast and Efficient Neural Question Answering
https://github.com/varun-suresh/experiments-with-gpt2/tree/main/language_models
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.