Columns Property Annotation

The T2Dv2 dataset consists of 779 tables originating from the English-language subset of the WebTables corpus. 237 tables are annotated for the Table Type Detection task, 236 for the Columns Property Annotation (CPA) task and 235 for the Row Annotation task. The annotations that are used are DBpedia types, properties and entities. A subset of this dataset was annotated by Chen et al. for the Column Type Annotation (CTA) task where they annotate 236 tables with DBpedia types. In the papers it was used the subset was divided into training and testing splits and the evaluation was done on the testing split T2D-Te. This subset is available for download at their official Github repository. Some characteristics for the different tasks are provided in the table below, where "Annotations" refers to the number of cells/rows/columns/tables annotated and "Classes" to the number of unique classes used for annotation. | | Annotations | Classes | |----------------|---------|---------| | Column Property Annotation | 670 | 119 | | Row Annotation | 26,106 | 13,975 | | Table Type | 237 | 41 | | Column Type Annotation | 411 | 37 |

SOTAB V2 features two annotation tasks: Column Type Annotation (CTA) and Columns Property Annotation (CPA). The goal of the Column Type Annotation (CTA) task is to annotate the columns of a table using 82 types from the Schema.org vocabulary, such as telephone, Duration, Mass, or Organization. The goal of the Columns Property Annotation (CPA) task is to annotate pairs of table columns with one out of 108 Schema.org properties, such as gtin, startDate, priceValidUntil, or recipeIngredient. The benchmark consists of 45,834 tables annotated for CTA and 30,220 tables annotated for CPA originating from 55,511 different websites. The tables are split into training-, validation- and test sets for both tasks. The tables cover 17 popular Schema.org types including Product, LocalBusiness, Event, and JobPosting. Some characteristics for the different tasks are provided in the table below, where "Columns" refers to the number of columns/column pairs labeled and "Classes" to the number of unique classes used for annotation. | | Train | | Validation | | Test | | Classes | |-----|--------|---------|------------|---------|--------|---------|---------| | | Tables | Columns | Tables | Columns | Tables | Columns | | | CTA | 44,769 | 116,887 | 456 | 1,769 | 609 | 1,851 | 82 | | CPA | 29,158 | 109,994 | 497 | 2,459 | 565 | 2,340 | 108 |

The WikiTables-TURL dataset was constructed by the authors of TURL and is based on the WikiTable corpus, which is a large collection of Wikipedia tables. The dataset consists of 580,171 tables divided into fixed training, validation and testing splits. Additionally, the dataset contains metadata about each table, such as the table name, table caption and column headers. 406,706 of these tables are annotated for the Column Type Annotation (CTA) task, 55,970 tables for the Columns Property Annotation (CPA) task and 200,744 tables for the Cell Entity Annotation (CEA) task. As classes for the CTA and CPA, Freebase's types and relations were used, whereas for the CEA task entities from Freebase were used. The table below lists the total annotated columns (or cells in the case of CEA) for each split and for each task as well as the number of classes used for annotation. | | Training | Validation | Testing | Classes | |-----|--------|----------|-------|-------| | CTA | 628,254 |13,391| 13,025 | 255 | | CPA | 62,954| 2,175 | 2,072 | 121 | | CEA | 1,264,217 | 76,720 | 225,777 | 1,787,737 | The authors have made the dataset and its variants publicly available for download.

WDC SOTAB is a benchmark that features two annotation tasks: Column Type Annotation and Columns Property Annotation. The goal of the Column Type Annotation (CTA) task is to annotate the columns of a table with 91 Schema.org types, such as telephone, duration, Place, or Organization. The goal of the Columns Property Annotation (CPA) task is to annotate pairs of table columns with one out of 176 Schema.org properties, such as gtin13, startDate, priceValidUntil, or recipeIngredient. The benchmark consists of 59,548 tables annotated for CTA and 48,379 tables annotated for CPA originating from 74,215 different websites. The tables are split into training-, validation- and test sets for both tasks. The tables cover 17 popular Schema.org types including Product, LocalBusiness, Event, and JobPosting. The tables originate from the Schema.org Table Corpus. Some characteristics for the different tasks are provided in the table below, where "Columns" refers to the number of columns/column pairs labeled and "Classes" to the number of unique classes used for annotation. | | Columns| Classes | |----------------|---------|---------| | Column Property Annotation | 174,998 | 176 | | Column Type Annotation | 162,351 | 91 |