Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 81편

INTERACTION Dataset

INTERACTION Dataset 설명 보기

The INTERACTION dataset contains naturalistic motions of various traffic participants in a variety of highly interactive driving scenarios from different countries. The dataset can serve for many behavior-related research areas, such as - 1) intention/behavior/motion prediction, - 2) behavior cloning and imitation learning, - 3) behavior analysis and modeling, - 4) motion pattern and representation learning, - 5) interactive behavior extraction and categorization, - 6) social and human-like behavior generation, - 7) decision-making and planning algorithm development and verification, - 8) driving scenario/case generation, etc. Source: https://interaction-dataset.com/ Image Source: https://interaction-dataset.com/

관련 논문 34편

Biological General Repository for Interaction Datasets

BioGRID
BioGRID 설명 보기

BioGRID is a biomedical interaction repository with data compiled through comprehensive curation efforts. The current index is version 4.2.192 and searches 75,868 publications for 1,997,840 protein and genetic interactions, 29,093 chemical interactions and 959,750 post translational modifications from major model organism species. Source: https://thebiogrid.org/

관련 논문 28편

SBU-Kinect-Interaction dataset v2.0

SBU / SBU-Refine
SBU / SBU-Refine 설명 보기

SBU-Kinect-Interaction dataset version 2.0 comprises of RGB-D video sequences of humans performing interaction activities that are recording using the Microsoft Kinect sensor. This dataset was originally recorded for a class project, and it must be used only for the purposes of research. If you use this dataset in your work, please cite the following paper. Kiwon Yun, Jean Honorio, Debaleena Chattopadhyay, Tamara L. Berg, and Dimitris Samaras, The 2nd International Workshop on Human Activity Understanding from 3D Data at Conference on Computer Vision and Pattern Recognition (HAU3D-CVPRW), CVPR 2012 SBU-Refine: SBU-Refine relabels the test set manually and refines the noise labels in training set by algorithm. H. Yang, T. Wang, X. Hu, and C.-W. Fu, “SILT: Shadow-aware iterative label tuning for learning to detect shadows from noisy labels,” in ICCV, 2023, pp. 12 687–12 698.

관련 논문 7편

YCB-Slide: A tactile interaction dataset

YCB-Slide
YCB-Slide 설명 보기

The YCB-Slide dataset comprises of DIGIT sliding interactions on YCB objects. We envision this can contribute towards efforts in tactile localization, mapping, object understanding, and learning dynamics models. We provide access to DIGIT images, sensor poses, RGB video feed, ground-truth mesh models, and ground-truth heightmaps + contact masks (simulation only). This dataset is supplementary to the MidasTouch paper, a CoRL 2022 submission.

관련 논문 2편

Multi-person Human-object Interaction Dataset 72

MPHOI-72
MPHOI-72 설명 보기

MPHOI-72 is a multi-person human-object interaction dataset that can be used for a wide variety of HOI/activity recognition and pose estimation/object tracking tasks. The dataset is challenging due to many body occlusions among the humans and objects. It consists of 72 videos captured from 3 different angles at 30 fps, with totally 26,383 frames and an average length of 12 seconds. It involves 5 humans performing in pairs, 6 object types, 3 activities and 13 sub-activities. The dataset includes color video, depth video, human skeletons, human and object bounding boxes.

관련 논문 1편

Interaction dataset of automated vehicles and human-driven vehicles at unsignalized intersections

AV-HV interaction at Intersections
AV-HV interaction at Intersections 설명 보기

This is a processed dataset comprising the interactions of automated vehicles and human-driven vehicles at unsignalized intersections, extracted from the Waymo Open Motion Dataset and Lyft Level 5 Dataset.

관련 논문 1편

EEG data recorded during spoken and imagined speech interaction with a simulated robot

EEG Speech-Robot Interaction Dataset
EEG Speech-Robot Interaction Dataset 설명 보기

Dataset Description This dataset consists of Electroencephalography (EEG) data recorded from 15 healthy subjects using a 64-channel EEG headset during spoken and imagined speech interaction with a simulated robot. ## Citation The dataset recording and study setup are described in detail in the following publications: 1. Rekrut, M., Selim, A. M., & Krüger, A. (2022, October). Improving Silent Speech BCI Training Procedures Through Transfer from Overt to Silent Speech. In 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2650–2656. IEEE. https://doi.org/10.1109/SMC53654.2022.9945447 2. Selim, A. M., Rekrut, M., Barz, M., & Sonntag, D. (2024, June). Speech Imagery BCI Training Using Game with a Purpose. In Proceedings of the 2024 International Conference on Advanced Visual Interfaces (AVI ’24). Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3656650.3656654 If you use this dataset, please consider citing these works. --- # Study Design Participants controlled a simulated robot on a screen in a game-like setup through a maze while EEG data was recorded. Below are the key details: ## Experimental Setup - Interaction Modes: - Overt Speech: Speaking command words aloud. - Imagined Speech: Silently imagining the command words without any articulatory muscle movement. - Command Words: - Movement: “Left”, “Right”, “Up” - Actions: “Pick”, “Push” - Interaction Process: 1. Participants pressed the spacebar to indicate readiness. 2. The screen turned black for 2 seconds to prepare input. 3. A fixation cross appeared, signalling participants to speak or imagine the desired command. 4. The fixation cross disappeared, and the robot’s position updated accordingly. 5. The robot always performed the correct action, ensuring participants were stress-free. - Session Organisation: - Four parts: Overt Speech, Imagined Speech, Overt Speech, Imagined Speech. - 80 repetitions per word and paradigm (400 imagined, 400 spoken per participant). - Task divided into levels of 25 interactions to reduce cognitive load. - Breaks between sessions allowed for rest and EEG headset impedance checks. ## Participants - Subjects: 15 healthy individuals (11 male, 4 female), average age 26.8 years. - Attributes: Right-handed, fluent in English (non-native). - Ethics: Informed consent obtained; approved by the ethical review board of the Faculty of Mathematics and Computer Science, Saarland University. --- # Recording Conditions - Environment: Dimly lit room with minimal distractions. - EEG Equipment: Wireless 64-channel Brain Products Live Amp 64 system. - Sampling rate: 500 Hz. - Electrode placement: 10-20 International System. - Synchronisation: The robot game and EEG recording software were executed on the same computer. --- # Data Format - File Format: .fif format, containing a continuous raw data stream with event markers. - Event Dictionary: ```json { "Event_Dictionary": { "Empty": 1, "EndOfEvent": 2, "EndOfLevel": 3, "EndOfParadigm": 4, "space_bar": 5, "Overt_Up": 11, "Overt_Left": 12, "Overt_Right": 13, "Overt_Pick": 14, "Overt_Push": 15, "Silent_Up": 21, "Silent_Left": 22, "Silent_Right": 23, "Silent_Pick": 24, "Silent_Push": 25 } }

관련 논문 1편

Interaction Data of Autonomous Vehicles with Traffic Lights and Signs Based on Waymo Motion Open Dataset

Interaction Dataset of Autonomous Vehicles with Traffic Lights and Signs
Interaction Dataset of Autonomous Vehicles with Traffic Lights and Signs 설명 보기

This dataset is derived from the Waymo Motion dataset and focuses on capturing the interactions between autonomous vehicles (AVs) and traffic control devices such as traffic lights and stop signs. It addresses a critical gap by providing real-world trajectory data that reflects how AVs interpret and respond to traffic control signals, supporting research in AV behavior modeling, traffic simulation, and the design of intelligent transportation systems. # Dataset Overview - Data Source: Waymo Motion dataset - Interaction Scenarios: - Traffic Light Interactions: Includes stopping, left turns, right turns, and proceeding straight. Over 37,000 trajectory segments are provided. - Stop Sign Interactions: Includes four-way stops, right turns, one-step left turns, and two-step left turns. Over 44,000 trajectory segments are available. - Data Content: - Each segment represents a 9.1-second interval sampled at 0.1-second intervals. - Contains AV positions, speeds, and accelerations. - Includes the position and state information of traffic lights or stop signs (e.g., red, yellow, green; arrow or circle). # Data Processing Pipeline - Data Extraction - Segments are selected from the Waymo Motion dataset based on predefined rules (e.g., presence of traffic control devices, non-stationary vehicle movement, and trajectory intersection with the control device). - Trajectory Organization - Original data in tfrecord format is converted into CSV format. In the CSV files, each column represents a time-series variable (e.g., position, speed, acceleration), and each row corresponds to a time step. - Quality Assessment and Enhancement - Trajectories are evaluated using metrics such as anomalous acceleration, jerk, and jerk sign inversion ratios. - A wavelet-based denoising method (using the db6 wavelet) is applied to reduce noise and anomalies, resulting in smoother and more reliable trajectories. # Repository Structure The directory structure of this repository is as follows: . ├── interactions_with_stop_sign │ ├── four_way_stops │ │ ├── left_turns │ │ ├── right_turns │ │ └── straight_proceeds │ ├── one_step_left_turns_at_stop_sign │ └── two_step_left_turns_at_stop_sign ├── interactions_with_traffic_light │ ├── left_turns_at_traffic_light │ ├── right_turns_at_traffic_light │ ├── stops_at_traffic_light │ └── straight_proceeds_at_traffic_light └── README.md # Data Structure The structure of the AV-traffic light interaction data is as follows: | Attribute | Unit | Description | | -------------------- | ----- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | AV_speed | m/s | The raw speed of the AV. | | AV_x | m | The x-coordinate of the AV in the coordinate system defined by the Waymo dataset. | | AV_y | m | The y-coordinate of the AV in the coordinate system defined by the Waymo dataset. | | AV_acc | m/s^2 | The raw acceleration of the AV. | | AV_distance_to_light | m | The Euclidean distance between the current position of the AV and the controlling traffic light (stop line). | | nearest_light_x | m | The x-coordinate of the controlling traffic light in the same coordinate system. | | nearest_light_y | m | The y-coordinate of the controlling traffic light in the same coordinate system. | | nearest_light_state | - | The state of the controlling traffic light, encoded as follows:<br><br>0: unknown<br>1: arrow red<br>2: arrow yellow<br>3: arrow green<br>4: circle red<br>5: circle yellow<br>6: circle green<br>7: flashing red<br>8: flashing yellow | | AV_speed_enhanced | m/s | The denoised speed of the AV, which helps reduce measurement noise. | | AV_acc_enhanced | m/s^2 | The denoised acceleration of the AV, which helps reduce the effects of noise and discrete differentiation. | The structure of the AV-stop sign interaction data is as follows: | Attribute | Unit | Description | | ------------------------ | ----- | ---------------------------------------------------------------------------------------------------------- | | AV_speed | m/s | The raw speed of the AV. | | AV_x | m | The x-coordinate of the AV in the coordinate system defined by Waymo dataset. | | AV_y | m | The y-coordinate of the AV in the coordinate system defined by Waymo dataset. | | AV_acc | m/s^2 | The raw acceleration of the AV. | | AV_distance_to_stop_sign | m | The Euclidean distance between the current position of the AV and the nearest stop sign. | | nearest_stop_sign_x | m | The x-coordinate of the nearest stop sign in the same coordinate system. | | nearest_stop_sign_y | m | The y-coordinate of the nearest stop sign in the same coordinate system. | | AV_speed_enhanced | m/s | The denoised speed of the AV, which helps reduce measurement noise. | | AV_acc_enhanced | m/s^2 | The denoised acceleration of the AV, which helps reduce the effects of noise and discrete differentiation. | # Note Due to GitHub repository size limitations, only ten sample data files are provided in each directory of this repository. The full dataset is hosted on Google Drive: https://drive.google.com/drive/folders/1bJa62v7YHbsfcZ4yItmFxoIxhrVZvOLW If you would like to use the complete dataset, please email us to request access. Contact: Zheng Li, zli2674@wisc.edu # Citation If you use this dataset in your research, please cite the following paper: > Li, Z., Bao, Z., Meng, H., Shi, H., Li, Q., Yao, H., & Li, X. (2025). Interaction Dataset of Autonomous Vehicles with Traffic Lights and Signs. arXiv preprint arXiv:2501.12536.

관련 논문 1편

Nuitrack Skeleton Interaction Dataset

NuiSI Dataset
NuiSI Dataset 설명 보기

The NuiSI dataset contains skeleton tracking trajectories of Human Interaction Partners performing a variety of physically interactive behaviors (waving, handshaking, rocket fistbump, parachute fistbump) with each other. This is inspired by the dataset in Bütepage et al. "Imitating by generating: Deep generative models for imitation of interactive tasks." Frontiers in Robotics and AI (2020) wherein they capture a dataset with rokoko motion capture suits. Instead we track the skeletons of the interaction partner with Intel Realsense cameras using Nuitrack, for a more realistic scenario, with noise coming from the depth sensor, the skeleton tracking and some partial occlusions. This makes it more representative of real world interactions with a Robot equipped with an RGBD camera. T This dataset is used in our papers for training Interaction models for Human-Robot Interaction with a humanoid social robot. If you find the dataset useful in your work, please cite our paper: Prasad, V., Heitlinger, L., Koert, D., Stock-Homburg, R., Peters, J., & Chalvatzaki, G. (2023). Learning multimodal latent dynamics for human-robot interaction. arXiv preprint arXiv:2311.16380. @article{prasad2023learning, title={Learning multimodal latent dynamics for human-robot interaction}, author={Prasad, Vignesh and Heitlinger, Lea and Koert, Dorothea and Stock-Homburg, Ruth and Peters, Jan and Chalvatzaki, Georgia}, journal={arXiv preprint arXiv:2311.16380}, year={2023} }

관련 논문 1편

Visuomotor affordance learning (VAL) robot interaction dataset

Visuomotor affordance learning (VAL) robot interaction dataset 설명 보기

This data contains about 2500 trajectories (with images and actions) of a Sawyer robot interacting with various objects. Examples from the dataset are shown in the adjacent video. We provide two versions of the VAL dataset - one with low-res images (1.4 GB) and one with high-res images (162 GB). The data quantity and format is the same between these two versions; the difference is only the image observation quality. The smaller dataset, with 48x48x3 images which can be used for eg. offline RL, is available for direct download: https://drive.google.com/file/d/1UuWANkVtWLg4egIK2LB_YCKuF87rMQ1H/view?usp=sharing The larger dataset, with 480x640x3 which might be preferred for eg. representation learning, is available at this Google drive folder: https://drive.google.com/drive/folders/1kD9kyP7-RlIrSnuN7rpEASAGWp5qnNov?usp=sharing To download the larger dataset, we suggest using https://rclone.org/ The data is sorted into several folders. There are a total of 300 files and 2500 trajectories. - fixed_drawer - Human-controlled demonstration data opening and closing drawers. (~10%) - fixed_pnp - Human-controlled demonstration data picking up objects. (~10%) - fixed_pot - Human-controlled demonstration data interacting with a pot and a lid. (~10%) - fixed_tray - Human-controlled demonstration data picking up objects and placing it in a tray. (~10%) - general - Further human-controlled demonstration data collected with the most diversity and variation. (~40%) - onpolicy_eval - Evaluation data collected by an RL policy. (~10%) - onpolicy_expl - Exploration data collected by an RL policy. (~10%)

관련 논문 0편

Multimodal Human-Robot Interaction dataset

MHRI dataset
MHRI dataset 설명 보기

The dataset includes recordings from 10 different users teaching the robot different common kitchen objects, that consists of synchronized recordings from three cameras and a microphone mounted on the robot: An RGB-d camera covers the user manipulation and interaction with the robot An RGB-d camera mounted on the top of the robot provides a top view of the whole scenario A HD-RGB camera points to the user head to capture face and expressions