Papers with Code 아카이브

Instance Segmentation

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

하위 태스크
17
평가표
36
보존된 평가 기록
338

Instance Segmentation is a computer vision task that involves identifying and separating individual objects within an image, including detecting the boundaries of each object and assigning a unique label to each object. The goal of instance segmentation is to produce a pixel-wise segmentation map of the image, where each pixel is assigned to a specific object instance.

Image Credit: Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayers, CVPR'21

데이터셋

출처에 같은 태스크 이름으로 연결된 데이터셋입니다. 동명 태스크가 포함될 수 있으므로, 비교할 때는 평가 결과의 조건도 확인하세요.

TBBR

The dataset of Thermal Bridges on Building Rooftops (TBBR dataset) consists of annotated combined RGB and thermal drone images with a height map. All images were converted to a uniform format of 3000$\times$4000 pixels, aligned, and cropped to 2400$\times$3400 to remove empty borders. The raw images for our dataset were recorded with a normal (RGB) and a FLIR-XT2 (thermal) camera on a DJI M600 drone. They show six large building blocks of around 20 buildings per block recorded in the city centre of the German city Karlsruhe east of the market square. Because of a high overlap rate of the images, the same buildings are on average recorded from different angles in different images about 20 times. All images were recorded during a drone flight on March 19, 2019 from 7 a.m. to 8 a.m. At this time, temperatures were between 3.78$^{\circ}$ C and 4.97$^{\circ}$ C, humidity between 80% and 98%. There was no rain on the day of the flight, but there was 2.3 $mm/m^2$ 48 hours beforehand. For recording the thermographic images an emissivity of 1.0 was set. The global radiation during this period was between 38.59 $W / m^2$ and 120.86 $W / m^2$. No direct sunlight can be seen visually on any of the recordings. The dataset contains 924 images with a total of 6930 annotations of thermal bridges on rooftops, split into train and test subsets with 722 (5614) and 202 (1313) images (annotations), respectively. The annotations only include thermal bridges that are visually identifiable with the human eye. Because of the aforementioned image overlap, each thermal bridge is annotated multiple times from different angles. For the annotation of the thermal images the image processing program VGG Image Annotator from the Visual Geometry Group, version 2.0.10, was used. The thermal bridge annotations are outlined with polygon shapes. These polygon lines were placed as close as possible but outside the area of significant temperature increase. If a detected thermal bridge was partially covered by another building component located in the foreground, the thermal bridge was also marked across the covering in case of minor coverings. Adjacent thermal bridges, which affect different rooftop components, were annotated separately. For example, a window with poor insulation of the window reveal located in the area of a poorly insulated roof is annotated individually. There is no overlap between annotated areas. While each image contains annotations, they also include thermal bridges present that are not annotated. Usage: Each compressed archive file represents one of the six building blocks. For the related publication the final block (Flug1_105Media) was used as a hold-out test sample. The archives contain Numpy files (one per image) of shape (2400, 3200, 5), where the final dimension is the color channel in the format [B, G, R, Thermal, Height]. Archives were compressed using ZStandard compression. They can be decompressed in a terminal by running e.g. tar -I zstd -xvf Flug1_105Media.tar.zst these will be decompressed into the file structure: images/ └── Flug1_105Media/ └── DJI_0004_R.npy └── DJI_0006_R.npy └── ... Corresponding annotations are provided in the COCO JSON format. There is one file for training (Flug1_100Media - Flug1_104Media blocks) and one for test (Flug1_105Media block). They contain a single class (thermal bridge) and expect the folder structure shown below. Note: The annotation files contain relative paths to numpy files, in case of problems please convert to absolute paths (i.e. insert the containing directory before each file path in the JSON annotation files). We recommend the following folder structure for reproduction of our work with Detectron2: ├── train/ │ ├── Flug1_100-104Media_coco.json │ └── images/ │ ├── Flug1_100Media/ │ │ ├── DJI_XXXX_R.npy │ │ └── ... │ ├── ... │ └── Flug1_104Media/ │ ├── DJI_XXXX_R.npy │ └── ... └── test/ ├── Flug1_105Media_coco.json └── images/ └── Flug1_105Media/ ├── DJI_XXXX_R.npy └── ...

UW Indoor Scenes (UW-IS) Occluded dataset

UW Indoor Scenes (UW-IS) Occluded dataset is curated using commodity hardware (Intel RealSense D435) to reflect real world robotics scenarios. It consists of two completely different indoor environments. The first environment is a lounge where the objects are placed on a tabletop. The second environment is a mock warehouse setup where the objects are placed on a shelf. For each of these environments, we have RGB-D images from 36 videos comprising five to seven objects each, taken from distances up to approximately 2m. The videos cover two different lighting conditions, three different levels of object separation for three different object categories (i.e., kitchen objects, food items, and tools/miscellaneous). The first level of object separation is such that there is no object occlusion. The second level of object separation is such that some occlusion occurs, while the third level is where the objects are placed extremely close together. Overall, the dataset considers 20 object classes and consists of 8,456 images, which have a total of 42,902 object instances. We also provide instance segmentation masks and 6D pose annotations for all the images generated using LabelFusion (Marion et al., 2018)

A2Dre

We obtain A2Dre by selecting only instances that were labeled as non-trivial, which are 433 REs from 190 videos. We do not use the trivial cases as the analysis of such examples is not relevant, as referents can be described by using the category alone. Each annotator was presented with a RE, a video in which the target object was marked by a bounding box, and a set of questions paraphrasing our categories. A2Dre was annotated by 3 authors of the paper. Our final set of category annotations used for analysis was derived by means of majority voting: for each nontrivial RE, we kept all category labels which were assigned to the RE by at least two annotators.

A2Dre+

A2Dre is a subset from the A2D test set including $433$\textit{non-trivial} REs. Due to its highly unbalanced distribution across the $7$semantic categories we select the $4$major categories \textsl{appearance, location, motion and static}. The four categories have in common that in most cases, for a given referent, a RE can be provided that expresses a certain category, and one that does not. We use these categories to augment A2Dre with additional REs, which vary according to the presence or absence of each of them. Specifically, based on our categorization of the original REs, for each RE$re$ and category$C$, we produce an additional RE$re'$ by modifying $re$ slightly such that it does (or does not) express~$C$. For example, for the last RE in Figure~\ref{fig:a2d-images}, i.e. \emph{girl in yellow dress standing near the woman}, which could be categorized as \textit{appearance}, \textit{location}, no \textit{motion} and \textit{static}, we produce new REs for each category: \emph{girl standing near the woman} (no \textit{appearance}), \emph{girl in yellow dress standing} (no \textit{location}), \emph{girl in yellow dress walking} (\textit{motion}) and \emph{girl in yellow dress near the woman} (no \textit{static}). We do not apply this procedure for \textsl{category}, since it is expressed in almost all REs, and its removal may be difficult in many cases. We name this extended dataset as A2Dre+.

Box-IS

RGB-D instance segmentation box dataset. The Box-IS dataset was created to support research on human-robot collaboration with a focus on robotic manipulation tasks. It was captured using the Intel® RealSense™ Depth Camera D455, a high-performance sensor designed for depth imaging. To ensure precise depth measurements, we bypassed the default depth data processing of the sensor and performed accurate stereo matching directly from the captured left and right IR images. Employing the UniMatch technique, we derived a high-quality depth map from these stereo IR images, which was then aligned with the corresponding RGB image for a comprehensive output. The dataset was intentionally designed to encompass a broad range of scene complexities, from simple box arrangements to highly irregular configurations. This diversity ensures that it can effectively benchmark algorithms across varying levels of difficulty.

BPCIS

BPCIS is collection of 364 bacterial phase contrast images and corresponding label matrices for instance segmentation. Labels were made according to fluorescence channels where possible. Prior to manual annotation, images were automatically cropped into microcolonies and tiled into ensemble images to reduce the empty (non-cell) image regions for training and testing. Subsequent to annotation, we performed non-rigid registration of phase contrast to cell masks. Species include Escherichia coli, Shigella flexneri, Francisella tularensis subsp. novicida, Acinetobacter baylyi, Burkholderia thailandensis, Helicobacter pylori, Caulobacter crescentus , Streptomyces pristinaespiralis, Vibrio cholerae, Serratia proteamaculans, Pseudomonas aeruginosa, Staphylococcus aureus, and Bacillus subtilis. E. coli mutant CS703-1 and H. pylori were treated with Aztreonam. Included are independent treatments of S. flexneri with cephalexin and A22. Also included are mixtures of E. coli and S. protreamaculans, mixtures of P. aeruginosa and S. aureus, and P. aeruginosa, S. aureus, V. cholerae, and B. subtilis. This dataset represents a wide range of morphological and optical phenotypes both common and uncommon to bacterial microscopy. All manual annotaton was performed by Kevin J. Cutler. Micrographs were captured by Kevin J. Cutler, Teresa Lo, Paul A. Wiggins, and Maxime Jacq.

COCO-N Medium

COCO-N Medium introduces a stochastic benchmark that simulates common real-world scenarios with noticeable label inaccuracies in the COCO dataset. This benchmark combines class and spatial noises to create a challenging yet realistic evaluation framework for instance segmentation models. It mimics datasets manually annotated by crowd workers, where a moderate level of label noise is expected. By incorporating both class and spatial inaccuracies, COCO-N Medium allows researchers to assess their models' basic robustness to label noise, providing insights into performance in typical real-world applications where perfect annotations are rare. This medium-level benchmark serves as a crucial middle ground, offering a more rigorous test than minimally noisy datasets while remaining within the bounds of commonly encountered data quality issues. COCO-N Medium enables a nuanced evaluation of model performance under realistic conditions, helping identify areas for improvement in handling noisy labels and guiding the development of more robust instance segmentation algorithms.

COCO-WAN (Medium noise)

The COCO-WAN benchmark is designed to assess the impact of weakly annotations (combined with auto-annotation tools) noise on instance segmentation models. This benchmark is built upon the COCO dataset and incorporates noise generated through weak annotations, simulating real-world scenarios where annotations might be imperfect due to semi-automated tools. It includes various levels of noise to challenge the robustness and generalization capabilities of segmentation models. Accurately labeling instance segmentation datasets is a complex and error-prone task, often leading to noisy labels. The COCO-WAN benchmark aims to provide a realistic testing ground for models to handle such noisy annotations. By utilizing foundation models and weak annotations, COCO-WAN simulates semi-automated annotation tools, helping researchers understand how well their models can perform under less-than-ideal labeling conditions. This benchmark includes multiple noise levels (easy, medium, and hard) to reflect varying degrees of annotation imperfections. Potential Use Cases of the Dataset: Model Robustness Testing: Researchers can use COCO-WAN to evaluate how different instance segmentation models cope with noisy annotations, allowing for the development of more resilient algorithms. Annotation Tool Improvement: By analyzing model performance on COCO-WAN, developers of annotation tools can identify common pitfalls and work on reducing noise in their outputs. Semi-Automated Annotation Systems: The benchmark provides insights into how models trained with semi-automated annotations perform, guiding improvements in such systems for better accuracy and efficiency in labeling tasks. The COCO-WAN benchmark offers a crucial resource for advancing the field of instance segmentation by highlighting the challenges posed by noisy labels and fostering the creation of more robust and reliable models. Model Robustness Testing: Researchers can use COCO-WAN to evaluate how different instance segmentation models cope with spatial, real noisy annotations, allowing for the development of more resilient algorithms. Semi-Automated Annotation Systems: The benchmark provides insights into how models trained with semi-automated annotations perform, guiding improvements in such systems for better accuracy and efficiency in labeling tasks. The COCO-WAN benchmark offers a crucial resource for advancing the field of instance segmentation by highlighting the challenges posed by noisy labels and fostering the creation of more robust and reliable models.

DLO Instance Segmentation dataset

Contains ~60000 HD images of Deformable Linear Objects (DLOs) generated using blender. The dataset contains a variety of industrial-looking backgrounds and contains instance segmentation masks. The main task for this dataset is DLO instance segmentation.

ENSeg

ENSeg Dataset Overview This dataset represents an enhanced subset of the ENS dataset. The ENS dataset comprises image samples extracted from the enteric nervous system (ENS) of male adult Wistar rats (Rattus norvegicus, albius variety), specifically from the jejunum, the second segment of the small intestine. The original dataset consists of two classes: - Control (C): Healthy animals. - Walker-256 Tumor (WT): Animals with cancer induced by the Walker-256 Tumor. Image acquisition involved 13 different animals, with 7 belonging to the C class and 6 to the WT class. Each animal contributed 32 image samples obtained from the myenteric plexus. All images were captured using the same setup and configuration, stored in PNG format, with a spatial resolution of 1384 × 1036 pixels. The overall process of obtaining the images and performing the morphometric and quantitative analyses takes approximately 5 months. ### Dataset Annotations Our dataset version includes expert-annotated labels for 6 animals, tagged as 2C, 4C, 5C, 22WT, 23WT, and 28WT. The image labels were created by members of the same laboratory where the images originated: researchers from the Enteric Neural Plasticity Laboratory of the State University of Maringá (UEM). Annotations were generated using LabelMe and consist of polygons marking each neuron cell. To maintain labeling quality according to laboratory standards, only neuron cells with well-defined borders were included in the final label masks. The labeling process lasted 9 months (from November 2023 to July 2024) and was iteratively reviewed by the lead researcher of the lab. ### Dataset Statistics After processing, the full dataset contains: - 187 images - 9,709 annotated neuron cells The table below summarizes the number of images and annotated neurons per animal tag. | Animal Tag | # of Images | # of Neurons | |------------|------------|--------------| | 2C | 32 | 1590 | | 4C | 31 | 1513 | | 5C | 31 | 2211 | | 22WT | 31 | 1386 | | 23WT | 31 | 1520 | | 28WT | 31 | 1489 | | Total | 187 | 9709 | ### Recommended Training Methodology Due to the limited number of animal samples and the natural split of images, we recommend using a leave-one-out cross-validation (LOO-CV) method for training. This ensures more reliable results by performing six training sessions per experiment, where: - In each session, images from one subject are isolated for testing. - The remaining images are used for training. Although cross-validation is recommended, it is not mandatory. Future works may introduce new training methodologies as the number of annotated subjects increases. However, it is crucial to maintain images from the same source (animal) within the same data split to prevent biased results. Even though samples are randomly selected from the animals' original tissues, this approach enhances the credibility of the findings. This dataset provides a valuable resource for instance segmentation and biomedical image analysis, supporting research on ENS morphology and cancer effects. Contributions and feedback are welcome! ## Project Citation If you want to cite our article, the dataset, or the source codes contained in this repository, please used the citation (bibtex format): @Article{felipe25enseg, AUTHOR = { Felipe, Gustavo Zanoni and Nanni, Loris and Garcia, Isadora Goulart and Zanoni, Jacqueline Nelisis and Costa, Yandre Maldonado e Gomes da}, TITLE = {ENSeg: A Novel Dataset and Method for the Segmentation of Enteric Neuron Cells on Microscopy Images}, JOURNAL = {Applied Sciences}, VOLUME = {15}, YEAR = {2025}, NUMBER = {3}, ARTICLE-NUMBER = {1046}, URL = {https://www.mdpi.com/2076-3417/15/3/1046}, ISSN = {2076-3417}, DOI = {10.3390/app15031046} } ## Additional Notes Please check out our previous datasets if you are interest into developing projects with Enteric Nervous System images: 1. EGC-Z: three datasets of Enteric Glial cells images, composed of three different chronic degenerative diseases: Cancer, Diabetes Mellitus, and Rheumatoid Arthritis. Each dataset represent binary classification task, with the classes: control (healthy) and sick; 2. ENS: the ENS image datasets comprises 1248 images taken from thirteen rats distributed in two classes: control/healthy or sick. The images were created with three distinct contrast settings targeting different Enteric Nervous System cells: Enteric Neuron cells, Enteric Glial cells, or both. For more details, please contact the main author of this project or create an issue on the project.

FashionFail

The FashionFail dataset comprises 2,495 high-resolution images (2400x2400 pixels) of products found on e-commerce websites. It is designed to address the limitations of existing state-of-the-art fashion parsing models. FashionFail consists of a diverse set of online shopping images with categories that are compatible with the established Fashionpedia dataset. The dataset is divided into training, validation, and test sets, consisting of 1,344, 150, and 1,001 images, respectively.

Fraunhofer EZRT XXL-CT Instance Segmentation Me163

The 'Me 163' was a Second World War fighter airplane and a result of the German air force secret developments. One of these airplanes is currently owned and displayed in the historic aircraft exhibition of the 'Deutsches Museum' in Munich, Germany. To gain insights with respect to its history, design and state of preservation, a complete CT scan was obtained using an industrial XXL-computer tomography scanner at Fraunhofer EZRT . Using the CT data from the Me 163, all its details can visually be examined at various levels, ranging from the complete hull down to single sprockets and rivets. However, while a trained human observer can identify and interpret the volumetric data with all its parts and connections, a virtual dissection of the airplane and all its different parts would be quite desirable. Nevertheless, this means, that an instance segmentation of all components and objects of interest into disjoint entities from the CT data is necessary. As of currently, no adequate computer-assisted tools for automated or semi-automated segmentation of such XXL-airplane data are available, in a first step, an interactive data annotation and object labelling process has been established. So far, seven $512 \times 512 \times 512$ voxel sub-volumes from the Me 163 airplane have been annotated and labelled, whose results can potentially be used for various new applications in the field of digital heritage, non-destructive testing, or machine-learning.

GraspClutter6D

GraspClutter6D is a large-scale real-world dataset for robust object perception and robotic grasping in cluttered environments. It features 1,000 highly cluttered scenes with dense arrangements (average 14.1 objects/scene with 62.6% occlusion), 200 household, industrial, and warehouse objects captured in 75 diverse environment configurations (bins, shelves, and tables), multi-view data from 4 RGB-D cameras (RealSense D415, D435, Azure Kinect, and Zivid One+), and comprehensive annotations including 736K 6D object poses and 9.3 billion feasible robotic grasps for 52K RGB-D images. The dataset provides a challenging testbed for segmentation, 6D pose estimation, and grasp detection algorithms in realistic cluttered scenarios.

GUISS dataset

We provide all the expected data inputs to GUISS such as meshes, texture images, and blend files. Generated datasets used in our experiments along with the stereo depth estimations can be downloaded. We have defined seven dataset types: scene_reconstructions, texture_variation, gaea_texture_variation, generative_texture, terrain_variation, rocks, and generative_texture_snow. Each dataset type contains renderings with varying values of different parameters such as lighting angle, texture imgs, albedo, etc. Position each dataset type folder under data/dataset/. Details and links at: https://github.com/nasa-jpl/guiss

HePIC 🏛️

Heritage Pointcloud Instance Collection dataset, acquired from two large buildings and annotated at a point-wise semantic level based on existent BIM models. Devid Campagnolo, Elena Camuffo, Umberto Michieli, Paolo Borin, Simone Milani and Andrea Giordano, "Fully Automated Scan-to-BIM via Point Cloud Instance Segmentation", In Proceedings of the International Conference on Image Processing (ICIP) 2023.

HT1080WT cells - 3D collagen type I matrices

Human fibrosarcoma HT1080WT (ATCC) cells at low cell densities embedded in 3D collagen type I matrices [1]. The time-lapse videos were recorded every 2 minutes for 16.7 hours and covered a field of view of 1002 pixels × 1004 pixels with a pixel size of 0.802 μm/pixel The videos were pre-processed to correct frame-to-frame drift artifacts, resulting in a final size of 983 pixels × 985 pixels pixels. [1] Hasini Jayatilaka, Anjil Giri, Michelle Karl, Ivie Aifuwa, Nicholaus J Trenton, Jude M Phillip, Shyam Khatau, and Denis Wirtz. EB1 and cytoplasmic dynein mediate protrusion dynamics for efficient 3-dimensional cell migration. FASEB J., 32(3):1207–1221, 2018. ISSN 0892-6638. doi: 10.1096/fj.201700444RR.

ICDAR 2021

  • Revision: v1.0.0-full-20210527a - DOI: 10.5281/zenodo.4817662 - Authors: J. Chazalon, E. Carlinet, Y. Chen, J. Perret, C. Mallet, B. Duménieu and T. Géraud - Official competition website: https://icdar21-mapseg.github.io/ This is the dataset of the ICDAR 2021 Competition on Historical Map Segmentation (“MapSeg”). This competition ran from November 2020 to April 2021. ## Motivation This competition aims as encouraging research in the digitization of historical maps. In order to be usable in historical studies, information contained in such images need to be extracted. The general pipeline involves multiples stages; we list some essential ones here: - segment map content: locate the area of the image which contains map content; - extract map object from different layers: detect objects like roads, buildings, building blocks, rivers, etc. to create geometric data; - georeference the map: by detecting objects at known geographic coordinate, compute the transformation to turn geometric objects into geographic ones (which can be overlaid on current maps). ## Tasks The tasks we propose simulate the three essential digitization steps we just mentioned. ### Task 1: “Detect Building Blocks” This task is the flagship of this competition. Given a fragment of map sheet image focused on map content, you need to detect the building blocks. Building blocks are symbolized by a thick line. They do not overlap between themselves, but many other elements can perturb their detection: - special buildings (hatched areas) can be included in building blocks (sometimes they cover the building block completely); - text can be overlaid on lines; - those maps contain many lines which need to be filtered out (internal building structures, railways, rivers, gardens…). Expected output for this task is a binary mask indicating for each pixel whether it belongs to a building block or not. Evaluation tools also tolerate a label map in TIFF format, where each pixel is labelled with the identifier of the shape it belongs to, using an INT16. To extract shapes from the binary mask, 4-connectivity is used (hence the background has 8-connectivity). ### Task 2: “Segment Map Area” This tasks is the equivalent of text area detection for OCR: given the image of a complete map sheet, you need to segment the area which contains map content. This area is usually well separated from the other elements (title, legend, scale…) by several frames but sometimes map contents exceeds the frame for some large objects. While most of the area is delineated by straight lines, some objects were drawn outside the frame on several sheets. We decided to segment each of those regions as closely as possible. Expected output for this task is a binary mask indicating for each pixel whether it belongs to the map area or not. ### Task 3: “Locate Graticule Lines Intersections” This task is essential to the georeferencing of the map: graticule lines are lines which indicate the North/South/East/West coordinates relative to the reference point. Their intersection points are very useful to provide key points for the registration of the map image. Given the image of a complete map sheet, you need to locate the intersection points of such lines. These lines usually cover the map content from left to right or from top to bottom but beware: - due to document aging paper sheets are not flat anymore and lines are not straight; - lines may be in diagonal for some areas; - lines can be overlaid with many other objects. Expected output for this task is a list of coordinates (in image referential, i.e. 0,0 at top left, x-axis pointing to the right and y-axis pointing downward).

Image-based size estimation of broccoli heads under varying degrees of occlusion

This publicly available dataset contains 1613 RGB-D images of field-grown broccoli plants. The dataset also includes the polygon and circle annotations of the broccoli heads. The broccoli heads in the images were subject to various degrees of natural and man-made leaf occlusion. The images were acquired in July and August 2020 on a broccoli field in Sexbierum (The Netherlands). The broccoli cultivar was Ironman. The dataset belongs to the paper “Image-based size estimation of broccoli heads under varying degrees of occlusion”. This paper has been published at Biosystems Engineering journal: https://doi.org/10.1016/j.biosystemseng.2021.06.001Click to add a brief description of the dataset (Markdown and LaTeX enabled). Provide: * a high-level explanation of the dataset characteristics * explain motivations and summary of its content * potential use cases of the dataset

LDD

The Instance Segmentation task, an extension of the well-known Object Detection task, is of great help in many areas, such as precision agriculture: being able to automatically identify plant organs and the possible diseases associated with them, allows to effectively scale and automate crop monitoring and its diseases control. To address the problem related to early disease detection and diagnosis on vines plants, a new dataset has been created with the goal of advancing the state-of-the-art of diseases recognition via instance segmentation approa ches. This was achieved by gathering images of leaves and clusters of grapes affected by diseases in their natural context. The dataset contains photos of 10 object types which include leaves and grapes with and without symptoms of the eight more common grape diseases, with a total of 17,706 labeled instances in 1,092 images. Multiple statistical measures are proposed in order to offer a complete view on the characteristics of the dataset. Preliminary results for the object detection and instance segmentation tasks reached by the models Mask R-CNN and R^3-CNN are provided as baseline, demonstrating that the procedure is able to reach promising results about th e objective of automatic diseases’ symptoms recognition.

MEIS

MEIS comprises a total of 2,639 images in the size of 1024 × 768 toward two recording views (Aortic Valve (AV) and Left Ventricle (LV)) with 1,521 (747 in AV + 774 in LV) images for training and 1,118 (559 in AV + 559 in LV) for testing, respectively. Each view must be detected with two objects to calculate the measurement indicators. That is in total with four object classes (two objects in each view): aortic root (AoR) and left atrium (LA) in AV; interventricular septum (IVS) and left ventricular posterior wall (LVPW) in LV. The medical meaning and purpose of each indicator are listed in the following: • AV: LA-Dimension and AoR-Dimension can be measured for calculating different indicators, such as AoR/LA ratio, to examine the state of the aortic valve. • LV: 6 measurements include IVSs, IVSd, LVIDs, LVIDd, LVPWs, and LVPWd. These concerned thicknesses and dimensions in LV recording are used to estimate other cardiac functions through specific medical formulas, including LV mass, LV ejection fraction, end-diastolic volume, end-systolic volume, and more.

MiSCS

Microscopy images of shrub cross sections for instance segmentation of tree rings. Tree rings are used in dendroecology to reconstruct past climate. Shrubs are of special importance for climate reconstruction in the Arctic as they are the only plants with tree rings that can grow there. From a computer vision point of view, the task of detecting of shrub tree rings in microscopy images is a special case of the instance segmentation problem with several unique challenges such as the concentric ring shape of the objects. This dataset provides 213 high resolution microscopy images split into 3 subsets according to species for further advancements in this area.

MOViD-Amodal

MOViD-A is a video-based synthesized dataset. We create it from MOVi dataset for amodal segmentation. The virtual camera is set to go around the scene, capturing about 24 consecutive frames. We randomly place 10 ∼ 20 static objects that heavily occlude each other in the scene. Finally, we collect 630 and 208 videos for training and testing.

NYUDv2-IS

A RGB-D dataset converted from NYUDv2 into COCO-style instance segmentation format. To construct NYUDv2-IS, specifically tailored for instance segmentation, we generated instance masks that delineate individual objects in each image. These masks were labeled using the object class annotations provided in the original NYUDv2 dataset, which is distributed in MATLAB format. The process involved several key steps: (1) extracting binary instance masks, (2) converting these masks into polygon representations, and (3) generating COCO-style annotations. Each annotation includes essential attributes such as category ID, segmentation masks, bounding boxes, object areas, and image metadata. During this conversion, we focused on 9 categories out of the original 13 classes, excluding non-instance categories such as walls and floors. To ensure dataset quality, images without any object annotations were systematically removed.

PWISeg

Overview The Surgical Instruments Recognition Dataset is a groundbreaking collection of high-resolution images (1280x960 pixels) specifically designed for the recognition and categorization of surgical instruments. This dataset captures the intricate details and complexity of surgical tools, particularly when arranged in scenarios reminiscent of an operating room. ## Data Acquisition Our data collection approach was multifaceted to encompass a wide range of scenarios in which surgical instruments are typically viewed. We utilized: 1. Ceiling-mounted, program-controlled camera: This camera systematically rotated to capture the instruments from various angles. 2. Handheld camera: It was employed to take pictures of instruments in trays on the floor, creating images with natural shadows and lighting. 3. Real-world operating room imagery: We included close-up shots of instruments in use, offering a view akin to that of the surgical team, and capturing the tools in motion. ## Annotations The dataset adheres to the COCO results format, supporting object and keypoint detection tasks. For object detection, bounding boxes and class labels are provided for each instrument. Key point annotations identify precise instrument points, with over 10,000 instruments annotated throughout the dataset. ## Dataset Structure The dataset is divided into three parts: - Training set: 1788 images with annotations - Validation set: 200 images with annotations - Testing set: 185 images with annotations

RadioGalaxyNET

A multimodal dataset of radio galaxies and their corresponding infrared hosts.

RadioGalaxyNET Dataset

Automating the creation of catalogues for radio galaxies in next-generation deep surveys necessitates the identification of components within extended sources and their respective infrared hosts. We present RadioGalaxyNET, a multimodal dataset, tailored for machine learning tasks to streamline the automated detection and localization of multi-component extended radio galaxies and their associated infrared hosts. The dataset encompasses 4,155 instances of galaxies across 2,800 images, incorporating both radio and infrared channels. Each instance furnishes details about the extended radio galaxy class, a bounding box covering all components, a pixel-level segmentation mask, and the keypoint position of the corresponding infrared host galaxy. RadioGalaxyNET is the first dataset to include images from the highly sensitive Australian Square Kilometre Array Pathfinder (ASKAP) radio telescope, corresponding infrared images, and instance-level annotations for galaxy detection.

SemanticSugarBeets

SemanticSugarBeets, a novel and high-quality dataset containing 953 monocular RGB images and 2920 annotations of sugar beets, enables a wide range of learning tasks including object detection, semantic segmentation, instance segmentation and mass estimation for post-harvest and post-storage analysis.

SUN-RGBD-IS

A RGB-D dataset converted from SUN-RGBD into COCO-style instance segmentation format. To transform SUN-RGBD into an instance segmentation benchmark (i.e., SUN-RGBDIS), we employed a pipeline similar to that of NYUDv2-IS. We selected 17 categories from the original 37 classes, carefully omitting non-instance categories like ceilings and walls. Images lacking any identifiable object instances were filtered out to maintain dataset relevance for instance segmentation tasks. We systematically convert segmentation annotations into COCO format, generating precise bounding boxes, instance masks, and object attributes.

TAMPAR

TAMPAR is a real-world dataset of parcel photos for tampering detection with annotations in COCO format. For details see the paper and for visual samples the project page. Features are: - >900 annotated real-world images with >2,700 visible parcel side surfaces - 6 different tampering types - 6 different distortion strengths

TimberVision

The TimberVision dataset consists of more than 2k annotated RGB images and contains a total of 51k trunk components including cut and lateral surfaces, thereby surpassing any existing dataset in this domain in terms of both quantity and detail by a large margin. The dataset can be used to train oriented object detection and instance segmentation and evaluate the influence of multiple scene parameters on model performance. Additionally, a generic framework is provided to fuse the components detected by the models for both tasks into unified trunk representations. Furthermore, geometric properties are derived automatically and multi-object tracking is applied to further enhance robustness.

TYC Dataset

We introduce the trapped yeast cell (TYC) dataset, a novel dataset for understanding instance-level semantics and motions of cells in microstructures. We release $105$ dense annotated high-resolution brightfield microscopy images, including about $19$k instance masks. We also release $261$ curated video clips composed of $1293$ high-resolution microscopy images to facilitate unsupervised understanding of cell motions and morphology.

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.