Text2Struct: A Machine Learning Pipeline for Mining Structured Data from Text
원문 초록
Many analysis and prediction tasks require the extraction of structured data from unstructured texts. However, an annotation scheme and a training dataset have not been available for training machine learning models to mine structured data from text without special templates and patterns. To solve it, this paper presents an end-to-end machine learning pipeline, Text2Struct, including a text annotation scheme, training data processing, and machine learning implementation. We formulated the mining problem as the extraction of metrics and units associated with numerals in the text. Text2Struct was trained and evaluated using an annotated text dataset collected from abstracts of medical publications regarding thrombectomy. In terms of prediction performance, a dice coefficient of 0.82 was achieved on the test dataset. By random sampling, most predicted relations between numerals and entities were well matched to the ground-truth annotations. These results show that Text2Struct is viable for the mining of structured data from text without special templates or patterns. It is anticipated to further improve the pipeline by expanding the dataset and investigating other machine learning models. A code demonstration can be found at: https://github.com/zcc861007/CourseProject
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
EduCoder: An Open-Source Annotation System for Education Transcript Data
Probably Approximately Correct Labels
Comparing LLM Text Annotation Skills: A Study on Human Rights Violations in Social Media Data
It's a (Blind) Match! Towards Vision-Language Correspondence without Parallel Data
GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Models
Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularity
토론
이 논문과 연결된 포럼 글이 아직 없습니다.