Papers with Code 아카이브

3D Face Modelling

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

하위 태스크
2
평가표
2
보존된 평가 기록
3

데이터셋

출처에 같은 태스크 이름으로 연결된 데이터셋입니다. 동명 태스크가 포함될 수 있으므로, 비교할 때는 평가 결과의 조건도 확인하세요.

inaGVAD

InaGVAD is a Voice Activity Detection (VAD) and Speaker Gender Segmentation (SGS) dataset designed for representing the acoustic diversity of French TV and Radio programs. InaGVAD detailed description, together with a benchmark of 6 freely available VAD systems and 3 SGS systems, is provided in a paper presented in LREC-COLING 2024. InaGVAD contains 277 1-minute-long annotated recordings, partitioned into a 1h development and 3h37 test subset, allowing fair and reproducible system evaluation. Evaluation scripts provided with the corpus provide performance estimates in the same conditions as the 6 VAD and 3 SGS systems presented in the associated paper. Recordings were collected from 10 French radio and 18 TV channels categorized into 4 groups associated to diverse acoustic conditions : generalist radio, music radio, news TV, and generalist TV. InaGVAD provides an extended VAD and SGS annotation scheme, allowing to describe systems diverse abilities based on : * Speaker Traits categories ** 3 Genders : Female, Male, I Don't Know (IDK) ** 3 Age groups : Young (prepubescent), Adult, Ederly (Senior) ** 3 Speech Qualities : standard, interjections (ah, oh, eg, aie), atypical (crying, laughing or shouted speech, ill person voice, artificially distorted voices, vocal performance, monster voice...) *10 Non-Speech event categories : Applause, environmental noise, hubbub, jingle, foreground music, background music, respiration, non-intelligible laughers, other, empty The entire inaGVAD package; including corpus, annotations, evaluation scripts, and baseline training code; is made freely accessible, fostering future advancement in the domain.

international faces

"The Chicago Face Database was developed at the University of Chicago by Debbie S. Ma, Joshua Correll, and Bernd Wittenbrink. The CFD is intended for use in scientific research. It provides high-resolution, standardized photographs of male and female faces of varying ethnicity between the ages of 17-65. Extensive norming data are available for each individual model. These data include both physical attributes (e.g., face size) as well as subjective ratings by independent judges (e.g., attractiveness). Detailed information about the construction of the database and the available norming data can be found in Ma, Correll, & Wittenbrink (2015)."

LAOFIW Dataset

An ancestral origin database of 14,000 images of individuals from East Asia, the Indian subcontinent, sub-Saharan Africa, and Western Europe. Source: Turning a Blind Eye: Explicit Removal of Biases and Variation from Deep Neural Network Embeddings

LSLF

Consists of a large number of unconstrained multi-view and partially occluded faces. Source: Large-scale Datasets: Faces with Partial Occlusions and Pose Variations in the Wild

LTFT

Dataset originally conceived for multi-face tracking/detection for highly crowded scenarios. In these scenarios, the face is the only part that can be used to track the individuals. All our videos present novel crowd scenes recorded at near-eye level, where faces are visible enough to be analysed at the microscopic level, while also benefiting from a macroscopic view of the crowd. It includes: - Face detections of 715 unique subjects along with instructions to download the synchronized video. - More than 75k face detections annotated. - A density ranging from 3 to 13 people/frame. - 6 indoor and 4 outdoor videos. 8/10 videos are totally unconstrained, 2/10 feature 3 re-appearances per subject. Our dataset may be useful for: - Face tracking, especially relevant for crowded scenarios (typically from video-surveillance cameras). - Heavily occluded body tracking (in many videos, only the face is mostly visible). - Face recognition. - Face detection for partially occluded faces.

MFSD

During the covid-19 era wearing face masks posed new challenges to face-related tasks, including facial recognition, face inpainting, expression recognition, and object removal. Mask region segmentation is a preliminary stage to tackle the occlusion issue corresponding to the face-related tasks. Existing masked face datasets are not procedure binary segmentation maps because Segmenting mask regions manually is a time-consuming operation. As a result, existing unmasking methods; synthesize training data by overlaying masks on existing face datasets. However, since these techniques rely on an artificially generated mask, their effects tend to seem unnatural. To address this issue, the masked face segmentation dataset(MFSD) provides the first public training dataset for the mask segmentation task.

MFW+ (M-M)

MFW+ is a benchmark dataset for masked face recognition and an extended version of MFW. The original MFW, published as a benchmark for masked face recognition, is composed of 300 IDs and 3,000 images. However, with two duplicate IDs found in MFW, the dataset actually contains 298 unique IDs and 2,980 images. To evaluate models under various mask conditions and environments, we manually gathered additional data from the web. The refined and extended MFW, which we named MFW+, contains 606 IDs, 2,911 unmasked face images, and 2,838 masked face images. Paper: https://bmvc2022.mpi-inf.mpg.de/0723.pdf

MH-FED

This dataset provides a collection of 162K images and 70 Videos of Meta-Humans. There are 10 Highly realistic Meta-Humans expressing 7 facial expressions.

MobiFace

MobiFace is the first dataset for single face tracking in mobile situations. It consists of 80 unedited live-streaming mobile videos captured by 70 different smartphone users in fully unconstrained environments. Over 95K bounding boxes are manually labelled. The videos are carefully selected to cover typical smartphone usage. The videos are also annotated with 14 attributes, including 6 newly proposed attributes and 8 commonly seen in object tracking. Source: MobiFace

NTIC Screening Dataset

In the last two years, millions of lives have been lost due to COVID-19. Despite the vaccination programmes for a year, hospitalization rates and deaths are still high due to the new variants of COVID-19. Stringent guidelines and COVID-19 screening measures such as temperature check and mask check at all public places are helping reduce the spread of COVID-19. Visual inspections to ensure these screening measures can be taxing and erroneous. Automated inspection ensures an effective and accurate screening. To perform automated screening, thermal based screening is effective as it is illumination independent and can work even under no lighting conditions. This NTIC screening dataset consists of thermal images of persons walking into public premises like offices, malls and railway stations. The ground truth consists of annotations of human faces and whether they are masks or not. Broadly, this dataset is divided into 3 sub-datasets: Thermal Surveillance Dataset: 902 thermal images with 1354 people wearing masks and 213 people without masks Augmented Surveillance Dataset: 543 images with 434 people wearing masks and 109 people without masks Lighting Dataset: 420 thermal images and their corresponding visual images.

OCFR-LFW

A occluded version of the LFW dataset for occluded face recognition verification. Uses structured occlusions generated to seem more realistic.

Procedural Human Action Videos

Procedural Human Action Videos contains a total of 39,982 videos, with more than 1,000 examples for each action of 35 categories. Source: Procedural Generation of Videos to Train Deep Action Recognition Networks

RLLab Framework

A benchmark suite of continuous control tasks, including classic tasks like cart-pole swing-up, tasks with very high state and action dimensionality such as 3D humanoid locomotion, tasks with partial observations, and tasks with hierarchical structure. Source: Benchmarking Deep Reinforcement Learning for Continuous Control

The RoboCup Rescue Dataset

In this paper, we introduce a victim dataset for the RoboCup Rescue competitions. The RoboCup Rescue robots have to collect points within several disciplines, e.g. a search task within an area to survey simulated baby doll (victim). When a robot comes across a victim, a heat detector does not completely proof if this is a living being and not just a heat emitting somewhat else. Further investigations are necessary so that a face detection could prove the existence of a victim. Lots of face detection approaches can be found in literature, which manly are used for human face recognition. These cannot be straightforward used for victim faces which are, in case of the RoboCup Rescue competitions, typically dolls. Thus we present the results of standard approaches and developed an own approach via bag-of-visual-words (BoVW).

Thermal Face Database

High-resolution thermal infrared face database with extensive manual annotations, introduced by Kopaczka et al, 2018. Useful for training algoeithms for image processing tasks as well as facial expression recognition. The full database itself, all annotations and the complete source code are freely available from the authors for research purposes at https://github.com/marcinkopaczka/thermalfaceproject. Please cite following papers for the dataset: [1] M. Kopaczka, R. Kolk and D. Merhof, "A fully annotated thermal face database and its application for thermal facial expression recognition," 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), 2018, pp. 1-6, doi: 10.1109/I2MTC.2018.8409768. [2] Kopaczka, M., Kolk, R., Schock, J., Burkhard, F., & Merhof, D. (2018). A thermal infrared face database with facial landmarks and emotion labels. IEEE Transactions on Instrumentation and Measurement, 68(5), 1389-1401.

UCCS

Unconstrained Face Detection and Open-Set Face Recognition Challenge * Paper: https://arxiv.org/abs/1708.02337 * Official website: https://vast.uccs.edu/Opensetface * UnOfficial website: https://exposing.ai/uccs Face detection and recognition benchmarks have shifted toward more difficult environments. The challenge presented in this paper addresses the next step in the direction of automatic detection and identification of people from outdoor surveillance cameras. While face detection has shown remarkable success in images collected from the web, surveillance cameras include more diverse occlusions, poses, weather conditions and image blur. Although face verification or closed-set face identification have surpassed human capabilities on some datasets, open-set identification is much more complex as it needs to reject both unknown identities and false accepts from the face detector. We show that unconstrained face detection can approach high detection rates albeit with moderate false accept rates. By contrast, open-set face recognition is currently weak and requires much more attention.

UIT-ViNames

This dataset comprises over 26,000 full names annotated with genders. Source: Gender Prediction Based on Vietnamese Names with Machine Learning Techniques

VGGFace2 HQ

A high-resolution version of VGGFace2 for academic face editing purposes. This project uses GFPGAN for image restoration and insightface for data preprocessing (crop and align).

Voxceleb-3D

A dataset for voice and 3D face structure study. It contains about 1.4K identities with their 3D face models and voice data. 3D face models are fitted from VGGFace using BFM 3D models, and voice data are processed from Voxceleb

YFCC-CelebA

The scales of the data accessible through internet search engines can reach hundreds of millions, or even billions. The existence of such large weak-labeled databases has gained importance in the training of face recognition algorithms. Starting with the publicly available YFCC100M, we propose a weakly-labeled subset for multi-label face recognition for self-supervised methods. A 392K image subset of YFCC100M of 128x128 images was obtained by querying for the 40 facial attributes. We made this dataset publicly available.

4,458 People - 3D Facial Expressions Recognition Data

Description: 4,458 People - 3D Facial Expressions Recognition Data. The collection scenes include indoor scenes and outdoor scenes. The dataset includes males and females. The age distribution ranges from juvenile to the elderly, the young people and the middle aged are the majorities. The device includes iPhone X, iPhone XR. The data diversity includes different expressions, different ages, different races, different collecting scenes. This data can be used for tasks such as 3D facial expression recognition. Data size: 4,458 people, 7 kinds of 3D expressions were collected for each person Population distribution: race distribution: Asian (Chinese), Black, Caucasian; gender distribution: male, female; age distribution: ranging from teenager to the elderly, the middle-aged and young people are the majorities

DREAMING Inpainting Dataset

Dataset for the DREAMING - Diminished Reality for Emerging Applications in Medicine through Inpainting Challenge! The DREAMING Challenge is part of ISBI 2024. Participate for Awards, Money Prices, Proceedings Paper, Top-Tier Challenge Summary Paper! More information about the challenge and registration can be found on the challenge platform! The DREAMING training dataset contains 100 diverse, photorealistic surgery scenes with unique patients, surroundings and obstructions from dynamically moving and static surgical instruments and hands holding them. We also provide the masks defining the area to be inpainted for each image.

Face dataset by Generated Photos

The free Face dataset made for students and teachers. It contains 10,000 photos with equal distribution of race and gender parameters, along with metadata and facial landmarks. Free to use for research with citation Photos by Generated.Photos. Photos All the photos are 100% synthetic. Based on model-released photos. Royalty-free. Can be used for any research purpose except for the ones violating the law. Worldwide. No time limitations. Quantity 10,000 Quality 256x256px Diversity Ethnicity, gender Metadata The JSON files contain the metadata for each image in a machine-readable format, including: (1) FaceLandmarks: mouth, right_eyebrow, left_eyebrow, right_eye, left_eye, nose, jaw. (2) FaceAttributes: headPose, gender, makeup, emotion, facialHair, hair (hairColor, hairLength, bald), occlusion, ethnicity, eye_color, smile, age

FacesInThings

We introduce an annotated dataset of five thousand human labeled pareidolic face images, called ``Faces in Things''. Faces in Things is derived from the LAION-5B dataset and annotated for key face attributes and bounding boxes

HEADSET

The volumetric representation of human interactions is one of the fundamental domains in the development of immersive media productions and telecommunication applications. Particularly in the context of the rapid advancement of Extended Reality (XR) applications, this volumetric data has proven to be an essential technology for future XR elaboration. In this work, we present a new multimodal database to help advance the development of immersive technologies. Our proposed database provides ethically compliant and diverse volumetric data, in particular 27 participants displaying posed facial expressions and subtle body movements while speaking, plus 11 participants wearing head-mounted displays (HMDs). The recording system consists of a volumetric capture (VoCap) studio, including 31 synchronized modules with 62 RGB cameras and 31 depth cameras. In addition to textured meshes, point clouds, and multi-view RGB-D data, we use one Lytro Illum camera for providing light field (LF) data simultaneously. Finally, we also provide an evaluation of our dataset employment with regard to the tasks of facial expression classification, HMDs removal, and point cloud reconstruction. The dataset can be helpful in the evaluation and performance testing of various XR algorithms, including but not limited to facial expression recognition and reconstruction, facial reenactment, and volumetric video. HEADSET and its all associated raw data and license agreement will be publicly available for research purposes.

Human faces with mixed-race & various emotions

This dataset consists of 600+ items of faces with different emotions and mixed races that are ready to use for optimizing the accuracy of computer vision models. Human age range from 20 to 60 years old, balance in gender, no occlusion, with head direction (<45 degree up-down and left-right). All of the contents is sourced from PIXTA's stock library of 100M+ Asian-featured images and videos. PIXTA is the largest platform of visual materials in the Asia Pacific region offering fully-managed services, high quality contents and data, and powerful tools for businesses & organizations to enable their creative and machine learning projects. For more details, please refer to the link: https://www.pixta.ai/ Or send your inquiries to contact@pixta.ai

ICT-3DHP

ICT-3DHP is collected using the Microsoft Kinect sensor and contains RGB images and depth maps of about 14k frames, divided in 10 sequences. The image resolution is 640 × 480 pixels. An hardware sensor (Polhemus Fastrack) is exploited to generate the ground truth annotation. The device is placed on a white cap worn by each subject, visible in both RGB and depth frames. Source: POSEidon: Face-from-Depth for Driver Pose Estimation

KID-F

Description K-pop Idol Dataset - Female (KID-F) is the first dataset of K-pop idol high quality face images. It consists of about 6,000 high quality face images at 512x512 resolution and identity labels for each image. We collected about 90,000 K-pop female idol images and crop the face from each image. And we classified high quality face images. As a result, there are about 6,000 high quality face images in this dataset. There are 300 test datasets for a benchmark. There are no duplicate images between test and train images. Some identities in test images are not duplicated with train images. (It means some test images is new identity to the trained model) Each test images have its degraded pair. You can use these degraded test images for testing face super resolution performance. We also provide identity labels for each image. You can download the csv file from our github # Download You can download dataset from here. Google Drive # Agreement - The use of this software is RESTRICTED to non-commercial research and educational purposes. - All images of the KID-F dataset are obtained from the internet which are not property of EDA(PCEO-AI-CLUB). EDA is not responsible for the content nor the meaning of these images. - You agree not to reproduce, duplicate, copy, sell, trade, resell or exploit for any commercial purposes, any portion of the images and any portion of derived data. - You agree not to further copy, publish or distribute any portion of the KID-F dataset. Except, for internal use at a single site within the same organization it is allowed to make copies of the dataset. - EDA reserves the right to terminate your access to the CelebA dataset at any time.

MS-EVS Dataset

The MS-EVS Dataset is the first large-scale event-based dataset for face detection. - Regular images (APS) and simulated events (EVS) - Multispectral data (RGB and/or near IR) - Very diverse faces and data quality (for robust face detection) It is divided in four subsets: - N-YoutubeFaces, 3k+ celebrity faces from Youtube videos, in color (simulated events). - N-MobiFace, 80 unedited mobile live color videos (simulated events). - N-SpectralFace, 69 multispectral videos captured in-house (simulated events). - Real-SpectralFace, a few sequences with real multispectral events (Grayscale and Infrared). | Dataset | APS | Simulated EVS | Real EVS | Data | |:---------------------:|:-------:|:-----------------:|:------------:|:--------------------------------------:| | N-YoutubeFaces | x | x | | Color (RGB) | | N-MobiFace | x | x | | Color (RGB) | | N-SpectralFace | x | x | | Multispectral (9 visible + 1 infrared) | | Real-SpectralFace | x | | x | Multispectral (1 visible + 1 infrared) |

SF-TL54: A Thermal Facial Landmark Dataset with Visual Pairs

Facial landmark detection is a cornerstone in many facial analysis tasks such as face recognition, drowsiness detection, and facial expression recognition. Numerous methodologies were introduced to achieve accurate and efficient facial landmark localization in visual images. However, there are only several works that address facial landmark detection in thermal images. The main challenge is the limited number of annotated datasets. In this work, we present a thermal face dataset with annotated face bounding boxes and facial landmarks. The dataset contains 2,556 thermal images of 142 individuals, where each thermal image is paired with the corresponding visual image. To the best of our knowledge, our dataset is the largest in terms of the number of individuals. In addition, our dataset can be employed for tasks such as thermal-to-visual image translation, thermal-visual face recognition, and others. We trained two models for the facial landmark detection task to show the efficacy of our dataset. The first model is a classic machine learning model based on an ensemble of regression trees. The second model is a deep learning model based on the U-net architecture. The dataset, annotations, source code, and pre-trained models are publicly available to advance research in thermal face analysis.

TFW: Annotated Thermal Faces in the Wild Dataset

Face detection and subsequent localization of facial landmarks are the primary steps in many face applications. Numerous algorithms and benchmark datasets have been introduced to develop robust models for the visible domain. However, varying conditions of illumination still pose challenging problems. In this regard, thermal cameras are employed to address this problem, because they operate on longer wavelengths. However, thermal face and facial landmark detection in the wild is an open research problem because most of the existing thermal datasets were collected in controlled environments. In addition, many of them were not annotated with face bounding boxes and facial landmarks. In this work, we present a thermal face dataset with manually labeled bounding boxes and facial landmarks to address these problems. The dataset contains 9,982 images of 147 subjects collected under controlled and uncontrolled conditions. As a baseline, we trained the YOLOv5 object detection model and its adaptation for face detection, YOLO5Face, on our dataset. In addition to our test set, we evaluated the models on the external RWTH-Aachen thermal face dataset to show the efficacy of our dataset. We have made the dataset, source code, and pre-trained models publicly available at https://github.com/IS2AI/TFW to bolster research in thermal face analysis.

THVD

About We provide a comprehensive talking-head video dataset with over 50,000 videos, totaling more than 500+ hours of footage and featuring 20,841 unique identities from around the world. Distribution Detailing the format, size, and structure of the dataset: -Total Size: 2.7TB -Total Videos: 47,547 -Identities Covered: 20,841 -Resolution: 60% 4k(1980), 33% fullHD(1080) -Formats: MP4 -Full-length videos with visible mouth movements in every frame. -Minimum face size of 400 pixels. -Video durations range from 20 seconds to 5 minutes. -Faces have not been cut out, full screen videos including backgrounds. Usage This dataset is ideal for a variety of applications: Face Recognition & Verification: Training and benchmarking facial recognition models. Action Recognition: Identifying human activities and behaviors. Re-Identification (Re-ID): Tracking identities across different videos and environments. Deepfake Detection: Developing methods to detect manipulated videos. Generative AI: Training high-resolution video generation models. Lip Syncing Applications: Enhancing AI-driven lip-syncing models for dubbing and virtual avatars. Background AI Applications: Developing AI models for automated background replacement, segmentation, and enhancement. Coverage Explaining the scope and coverage of the dataset: Geographic Coverage: Worldwide Time Range: Time range and size of the videos have been noted in the CSV file. Demographics: Includes information about age, gender, ethnicity, format, resolution, and file size. Languages Covered (Videos): English: 23,038 videos Portuguese: 1,346 videos Spanish: 677 videos Norwegian: 1,266 videos Swedish: 1,056 videos Korean: 848 videos Polish: 1,807 videos Indonesian: 1,163 videos French: 1,102 videos German: 1,276 videos Japanese: 1,433 videos Dutch: 1,666 videos Indian: 1,163 videos Czech: 590 videos Chinese: 685 videos Italian: 975 videos Philipeans: 920 videos Bulgaria: 340 videos Romanian: 1144 videos Arabic: 1691 videos image/png image/png image/png image/png Who Can Use It List examples of intended users and their use cases: Data Scientists: Training machine learning models for video-based AI applications. Researchers: Studying human behavior, facial analysis, or video AI advancements. Businesses: Developing facial recognition systems, video analytics, or AI-driven media applications. Additional Notes Ensure ethical usage and compliance with privacy regulations. The dataset’s quality and scale make it valuable for high-performance AI training. Potential preprocessing (cropping, down sampling) may be needed for different use cases. Dataset has not been completed yet and expands daily, please contact for most up to date CSV file. The dataset has been divided into 100GB zipped files and is hosted on a private server (with the option to upload to the cloud if needed). To verify the dataset's quality, please contact me for the full CSV file. I’d be happy to provide example videos selected by the potential buyer. https://lipsynthesis.com/dataset

Toronto NeuroFace Dataset

Toronto NeuroFace Dataset: A New Dataset for Facial Motion Analysis in Individuals with Neurological Disorders Toronto NeuroFace Dataset is a public dataset with videos of oro-facial gestures performed by individuals with oro-facial impairment due to neurological disorders, such as amyotrophic lateral sclerosis (ALS) and stroke. Perceptual clinical scores from trained clinicians are provided as metadata. Manual annotation of facial landmarks is also provided for a subset of over 3300 frames.

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.