PyTorchKR Papers

최신 논문

총 2편
태그·기간 등 상세 필터

카테고리 탐색

로그인 후 이 태그 구독

논문 ID: document/9827265

Job Title Prediction from Tweets Using Word Embedding and Deep Neural Networks

The more social media take its place in our lives; the more critical their analysis becomes and the more researchers’ attention is drawn to it. Studies contain various topics such as sentiment analysis, trend prediction, bot detection, Etc. Here, for the first time, we propose a novel method to predict the job title of social media users. Twitter, a popular social media, is our target social media. We introduce a dataset consisting of 1314 samples, including users’ tweets and bios. The user’s job title is found using Wikipedia crawling. The challenge of multiple job titles per user is handled using a semantic word embedding and clustering method. Then, a job prediction method is introduced based on a deep neural network and TF-IDF word embedding. We also use hashtags and emojis in the tweets for job prediction. Results show that the job title of users in Twitter could be well predicted with 54% accuracy in nine categories.

arXiv:2203.03759공식 코드 · Papers with Code

IT5: Text-to-text Pretraining for Italian Language Understanding and Generation

We introduce IT5, the first family of encoder-decoder transformer models pretrained specifically on Italian. We document and perform a thorough cleaning procedure for a large Italian corpus and use it to pretrain four IT5 model sizes. We then introduce the ItaGen benchmark, which includes a broad range of natural language understanding and generation tasks for Italian, and use it to evaluate the performance of IT5 models and multilingual baselines. We find monolingual IT5 models to provide the best scale-to-performance ratio across tested models, consistently outperforming their multilingual counterparts and setting a new state-of-the-art for Italian language generation.