Representation Learning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 14
- 평가표
- 5
- 보존된 평가 기록
- 11
Representation Learning is a process in machine learning where algorithms extract meaningful patterns from raw data to create representations that are easier to understand and process. These representations can be designed for interpretability, reveal hidden features, or be used for transfer learning. They are valuable across many fundamental machine learning tasks like image classification and retrieval.
Deep neural networks can be considered representation learning models that typically encode information which is projected into a different subspace. These representations are then usually passed on to a linear classifier to, for instance, train a classifier.
Representation learning can be divided into:
- Supervised representation learning: learning representations on task A using annotated data and used to solve task B
- Unsupervised representation learning: learning representations on a task in an unsupervised way (label-free data). These are then used to address downstream tasks and reducing the need for annotated data when learning news tasks. Powerful models like GPT and BERT leverage unsupervised representation learning to tackle language tasks.
More recently, self-supervised learning (SSL) is one of the main drivers behind unsupervised representation learning in fields like computer vision and NLP.
Here are some additional readings to go deeper on the task:
- Representation Learning: A Review and New Perspectives - Bengio et al. (2012)
- A Few Words on Representation Learning - Thalles Silva
<span style="color:grey; opacity: 0.6">( Image credit: Visualizing and Understanding Convolutional Networks )</span>
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/isaacschaal/SG_training
A Style-Based Generator Architecture for Generative Adversarial Networks
https://github.com/isotlaboratory/ml4vrp
https://github.com/itsuki8914/stylegan-TensorFlow
A Style-Based Generator Architecture for Generative Adversarial Networks
https://github.com/ivMCL/AttentiveNorm_Detection
AOGNets: Compositional Grammatical Architectures for Deep Learning
https://github.com/ivclab/cvs
https://github.com/ivechan/PVCGN
Physical-Virtual Collaboration Modeling for Intra-and Inter-Station Metro Ridership Prediction
https://github.com/jackaduma/CycleGAN-VC2
Improving Zero-shot Voice Style Transfer via Disentangled Representation Learning
https://github.com/jackson-kang/pytorch-vae-tutorial
https://github.com/jacobgil/keras-dcgan
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/jacquesboitreaud/DeepFRED
https://github.com/jacquesboitreaud/rna_ne
https://github.com/jadore801120/attention-is-all-you-need-pytorch
https://github.com/jaehong31/raccoon
https://github.com/jaemuzzin/plagnn
https://github.com/jaguar-paw33/PREN
Primitive Representation Learning for Scene Text Recognition
https://github.com/jaideepmurkute/Multi-purpose-Disentangling-Variational-Autoencoders-for-ECG-data
Improving Disentangled Representation Learning with the Beta Bernoulli Process
https://github.com/jameschapman19/cca_zoo
https://github.com/jameschapman19/cca_zoo/blob/main/cca_zoo/deepmodels/_discriminative/_dcca_eigengame.py
A Generalized EigenGame with Extensions to Multiview Representation Learning
https://github.com/jamesding000/specgr
Towards Universal Sequence Representation Learning for Recommender Systems
https://github.com/jameszhou-gl/cbre
Cycle-Balanced Representation Learning For Counterfactual Inference
https://github.com/jannine92/supervised_emotion_recognition
Challenges in Representation Learning: A report on three machine learning contests
https://github.com/jarvisWang0903/Paper-Useful
Theory and Evaluation Metrics for Learning Disentangled Representations
https://github.com/jason90330/EdgeFinal
Learning to Amend Facial Expression Representation via De-albino and Affinity
https://github.com/jaywalnut310/Vector-Quantized-Autoencoders
https://github.com/jcaip/quickthoughts
An efficient framework for learning sentence representations
https://github.com/jeanjerome/semisupervised_timeseries_infogan
InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets
https://github.com/jedgusse/collaborative-authorship
Integrated Sequence Tagging for Medieval Latin Using Deep Representation Learning
https://github.com/jefflai108/Contrastive-Predictive-Coding-PyTorch
https://github.com/jelifysh/DCGAN
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/jeongukjae/KR-BERT-SimCSE
https://github.com/jeongukjae/smaller-labse
Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond
https://github.com/jesperhauch/polynomial_deep_learning
https://github.com/jesse1029/Fake-Face-Images-Detection-Tensorflow
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
https://github.com/jessefokkinga/MechanismsOfAction
https://github.com/jessicahuang0163/TMLP
Node Representation Learning in Graph via Node-to-Neighbourhood Mutual Information Maximization
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.