Nepali Video Captioning using CNN-RNN Architecture
원문 초록
This article presents a study on Nepali video captioning using deep neural networks. Through the integration of pre-trained CNNs and RNNs, the research focuses on generating precise and contextually relevant captions for Nepali videos. The approach involves dataset collection, data preprocessing, model implementation, and evaluation. By enriching the MSVD dataset with Nepali captions via Google Translate, the study trains various CNN-RNN architectures. The research explores the effectiveness of CNNs (e.g., EfficientNetB0, ResNet101, VGG16) paired with different RNN decoders like LSTM, GRU, and BiLSTM. Evaluation involves BLEU and METEOR metrics, with the best model being EfficientNetB0 + BiLSTM with 1024 hidden dimensions, achieving a BLEU-4 score of 17 and METEOR score of 46. The article also outlines challenges and future directions for advancing Nepali video captioning, offering a crucial resource for further research in this area.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
UGC-VideoCaptioner: An Omni UGC Video Detail Caption Model and New Benchmarks
video-SALMONN 2: Captioning-Enhanced Audio-Visual Large Language Models
FLASH: Latent-Aware Semi-Autoregressive Speculative Decoding for Multimodal Tasks
FocusedAD: Character-centric Movie Audio Description
Caption Anything in Video: Fine-grained Object-centric Captioning via Spatiotemporal Multimodal Prompting
Pretrained Image-Text Models are Secretly Video Captioners
토론
이 논문과 연결된 포럼 글이 아직 없습니다.