Knowledge driven Description Synthesis for Floor Plan Interpretation
원문 초록
Image captioning is a widely known problem in the area of AI. Caption generation from floor plan images has applications in indoor path planning, real estate, and providing architectural solutions. Several methods have been explored in literature for generating captions or semi-structured descriptions from floor plan images. Since only the caption is insufficient to capture fine-grained details, researchers also proposed descriptive paragraphs from images. However, these descriptions have a rigid structure and lack flexibility, making it difficult to use them in real-time scenarios. This paper offers two models, Description Synthesis from Image Cue (DSIC) and Transformer Based Description Generation (TBDG), for the floor plan image to text generation to fill the gaps in existing methods. These two models take advantage of modern deep neural networks for visual feature extraction and text generation. The difference between both models is in the way they take input from the floor plan image. The DSIC model takes only visual features automatically extracted by a deep neural network, while the TBDG model learns textual captions extracted from input floor plan images with paragraphs. The specific keywords generated in TBDG and understanding them with paragraphs make it more robust in a general floor plan image. Experiments were carried out on a large-scale publicly available dataset and compared with state-of-the-art techniques to show the proposed model's superiority.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning
Document-Level Text Generation with Minimum Bayes Risk Decoding using Optimal Transport
Temporally-Grounded Language Generation: A Benchmark for Real-Time Vision-Language Models
FIFA: Unified Faithfulness Evaluation Framework for Text-to-Video and Video-to-Text Generation
ARGUS: Hallucination and Omission Evaluation in Video-LLMs
Attention-based transformer models for image captioning across languages: An in-depth survey and evaluation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.