Papers with Code 아카이브

Facial Recognition and Modelling

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

하위 태스크
25
평가표
0
보존된 평가 기록
0

Facial tasks in machine learning operate based on images or video frames (or other datasets) focussed on human faces.

데이터셋

출처에 같은 태스크 이름으로 연결된 데이터셋입니다. 동명 태스크가 포함될 수 있으므로, 비교할 때는 평가 결과의 조건도 확인하세요.

Curated AFD

The Curated AFD dataset is a curated version of the Asian Face Dataset (AFD) for face recognition research. The original AFD dataset has been curated to remove wrong identity labels, duplicate images and duplicate subjects. Source: https://arxiv.org/abs/2004.03074

Extended YouTube Faces (E-YTF)

The proposed Extended-YouTube Faces (E-YTF) is an extension of the famous YouTube Faces (YTF) dataset and is specifically designed to further push the challenges of face recognition by addressing the problem of open-set face identification from heterogeneous data i.e. still images vs video.

Facial Skeletal angles

Facial Skeletal Angles (Glabella and Maxilla Angle and Length and Width of Piriformis)

FER2013 Blendshapes

Tables of the blendshapes from a group of the images of the FER2013 dataset, generated using MediaPipe library, based on the ARKit face blendshapes. with classes of the images in a separate column, describing the categories Happy, Unknown, Sad.

FLUXSynID

The FLUXSynID Dataset comprises 14,889 high-resolution synthetic face identities, each uniquely represented with paired images: document-style images and trusted live-capture images. The document-style images are designed to simulate ID photos, while the live-capture images are generated to reflect real-world conditions, including variations in lighting, facial expressions, and camera angles. This dual representation facilitates robust benchmarking for face recognition, morphing attack detection, and cross-domain identity verification tasks. FLUXSynID leverages cutting-edge generative models to ensure high fidelity and diversity across identities, enabling comprehensive analysis of biometric systems under varied conditions. For more information and to generate your own custom datasets using the FLUXSynID framework, visit the FLUXSynID GitHub repository.

IMFW

Indian Masked faces in the wild Database is collected into three sets:(i) Indian Celebrity, (ii) Instagram and (iii) Indian Crowd. The Indian Celebrity contains 40 Indian celebrities with 435 images, including Bollywood actors/actresses, television stars, sports personalities, and politicians. The Instagram set contains 377 images of 40 subjects downloaded from Instagram. We collected masked and non-masked images of Indian people with a public profile. The Indian Crowd set is collected from the common people who volunteered to contribute to the dataset. This set contains 120 subjects with 562 images. All the Images are collected in both constrained and unconstrained environments with variation in pose, illumination, background and masks worn by the people.

inaGVAD

InaGVAD is a Voice Activity Detection (VAD) and Speaker Gender Segmentation (SGS) dataset designed for representing the acoustic diversity of French TV and Radio programs. InaGVAD detailed description, together with a benchmark of 6 freely available VAD systems and 3 SGS systems, is provided in a paper presented in LREC-COLING 2024. InaGVAD contains 277 1-minute-long annotated recordings, partitioned into a 1h development and 3h37 test subset, allowing fair and reproducible system evaluation. Evaluation scripts provided with the corpus provide performance estimates in the same conditions as the 6 VAD and 3 SGS systems presented in the associated paper. Recordings were collected from 10 French radio and 18 TV channels categorized into 4 groups associated to diverse acoustic conditions : generalist radio, music radio, news TV, and generalist TV. InaGVAD provides an extended VAD and SGS annotation scheme, allowing to describe systems diverse abilities based on : * Speaker Traits categories ** 3 Genders : Female, Male, I Don't Know (IDK) ** 3 Age groups : Young (prepubescent), Adult, Ederly (Senior) ** 3 Speech Qualities : standard, interjections (ah, oh, eg, aie), atypical (crying, laughing or shouted speech, ill person voice, artificially distorted voices, vocal performance, monster voice...) *10 Non-Speech event categories : Applause, environmental noise, hubbub, jingle, foreground music, background music, respiration, non-intelligible laughers, other, empty The entire inaGVAD package; including corpus, annotations, evaluation scripts, and baseline training code; is made freely accessible, fostering future advancement in the domain.

international faces

"The Chicago Face Database was developed at the University of Chicago by Debbie S. Ma, Joshua Correll, and Bernd Wittenbrink. The CFD is intended for use in scientific research. It provides high-resolution, standardized photographs of male and female faces of varying ethnicity between the ages of 17-65. Extensive norming data are available for each individual model. These data include both physical attributes (e.g., face size) as well as subjective ratings by independent judges (e.g., attractiveness). Detailed information about the construction of the database and the available norming data can be found in Ma, Correll, & Wittenbrink (2015)."

LAOFIW Dataset

An ancestral origin database of 14,000 images of individuals from East Asia, the Indian subcontinent, sub-Saharan Africa, and Western Europe. Source: Turning a Blind Eye: Explicit Removal of Biases and Variation from Deep Neural Network Embeddings

LSLF

Consists of a large number of unconstrained multi-view and partially occluded faces. Source: Large-scale Datasets: Faces with Partial Occlusions and Pose Variations in the Wild

LTFT

Dataset originally conceived for multi-face tracking/detection for highly crowded scenarios. In these scenarios, the face is the only part that can be used to track the individuals. All our videos present novel crowd scenes recorded at near-eye level, where faces are visible enough to be analysed at the microscopic level, while also benefiting from a macroscopic view of the crowd. It includes: - Face detections of 715 unique subjects along with instructions to download the synchronized video. - More than 75k face detections annotated. - A density ranging from 3 to 13 people/frame. - 6 indoor and 4 outdoor videos. 8/10 videos are totally unconstrained, 2/10 feature 3 re-appearances per subject. Our dataset may be useful for: - Face tracking, especially relevant for crowded scenarios (typically from video-surveillance cameras). - Heavily occluded body tracking (in many videos, only the face is mostly visible). - Face recognition. - Face detection for partially occluded faces.

MFSD

During the covid-19 era wearing face masks posed new challenges to face-related tasks, including facial recognition, face inpainting, expression recognition, and object removal. Mask region segmentation is a preliminary stage to tackle the occlusion issue corresponding to the face-related tasks. Existing masked face datasets are not procedure binary segmentation maps because Segmenting mask regions manually is a time-consuming operation. As a result, existing unmasking methods; synthesize training data by overlaying masks on existing face datasets. However, since these techniques rely on an artificially generated mask, their effects tend to seem unnatural. To address this issue, the masked face segmentation dataset(MFSD) provides the first public training dataset for the mask segmentation task.

MFW+ (M-M)

MFW+ is a benchmark dataset for masked face recognition and an extended version of MFW. The original MFW, published as a benchmark for masked face recognition, is composed of 300 IDs and 3,000 images. However, with two duplicate IDs found in MFW, the dataset actually contains 298 unique IDs and 2,980 images. To evaluate models under various mask conditions and environments, we manually gathered additional data from the web. The refined and extended MFW, which we named MFW+, contains 606 IDs, 2,911 unmasked face images, and 2,838 masked face images. Paper: https://bmvc2022.mpi-inf.mpg.de/0723.pdf

MH-FED

This dataset provides a collection of 162K images and 70 Videos of Meta-Humans. There are 10 Highly realistic Meta-Humans expressing 7 facial expressions.

MobiFace

MobiFace is the first dataset for single face tracking in mobile situations. It consists of 80 unedited live-streaming mobile videos captured by 70 different smartphone users in fully unconstrained environments. Over 95K bounding boxes are manually labelled. The videos are carefully selected to cover typical smartphone usage. The videos are also annotated with 14 attributes, including 6 newly proposed attributes and 8 commonly seen in object tracking. Source: MobiFace

NTIC Screening Dataset

In the last two years, millions of lives have been lost due to COVID-19. Despite the vaccination programmes for a year, hospitalization rates and deaths are still high due to the new variants of COVID-19. Stringent guidelines and COVID-19 screening measures such as temperature check and mask check at all public places are helping reduce the spread of COVID-19. Visual inspections to ensure these screening measures can be taxing and erroneous. Automated inspection ensures an effective and accurate screening. To perform automated screening, thermal based screening is effective as it is illumination independent and can work even under no lighting conditions. This NTIC screening dataset consists of thermal images of persons walking into public premises like offices, malls and railway stations. The ground truth consists of annotations of human faces and whether they are masks or not. Broadly, this dataset is divided into 3 sub-datasets: Thermal Surveillance Dataset: 902 thermal images with 1354 people wearing masks and 213 people without masks Augmented Surveillance Dataset: 543 images with 434 people wearing masks and 109 people without masks Lighting Dataset: 420 thermal images and their corresponding visual images.

OCFR-LFW

A occluded version of the LFW dataset for occluded face recognition verification. Uses structured occlusions generated to seem more realistic.

Procedural Human Action Videos

Procedural Human Action Videos contains a total of 39,982 videos, with more than 1,000 examples for each action of 35 categories. Source: Procedural Generation of Videos to Train Deep Action Recognition Networks

The RoboCup Rescue Dataset

In this paper, we introduce a victim dataset for the RoboCup Rescue competitions. The RoboCup Rescue robots have to collect points within several disciplines, e.g. a search task within an area to survey simulated baby doll (victim). When a robot comes across a victim, a heat detector does not completely proof if this is a living being and not just a heat emitting somewhat else. Further investigations are necessary so that a face detection could prove the existence of a victim. Lots of face detection approaches can be found in literature, which manly are used for human face recognition. These cannot be straightforward used for victim faces which are, in case of the RoboCup Rescue competitions, typically dolls. Thus we present the results of standard approaches and developed an own approach via bag-of-visual-words (BoVW).

Thermal Face Database

High-resolution thermal infrared face database with extensive manual annotations, introduced by Kopaczka et al, 2018. Useful for training algoeithms for image processing tasks as well as facial expression recognition. The full database itself, all annotations and the complete source code are freely available from the authors for research purposes at https://github.com/marcinkopaczka/thermalfaceproject. Please cite following papers for the dataset: [1] M. Kopaczka, R. Kolk and D. Merhof, "A fully annotated thermal face database and its application for thermal facial expression recognition," 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), 2018, pp. 1-6, doi: 10.1109/I2MTC.2018.8409768. [2] Kopaczka, M., Kolk, R., Schock, J., Burkhard, F., & Merhof, D. (2018). A thermal infrared face database with facial landmarks and emotion labels. IEEE Transactions on Instrumentation and Measurement, 68(5), 1389-1401.

UCCS

Unconstrained Face Detection and Open-Set Face Recognition Challenge * Paper: https://arxiv.org/abs/1708.02337 * Official website: https://vast.uccs.edu/Opensetface * UnOfficial website: https://exposing.ai/uccs Face detection and recognition benchmarks have shifted toward more difficult environments. The challenge presented in this paper addresses the next step in the direction of automatic detection and identification of people from outdoor surveillance cameras. While face detection has shown remarkable success in images collected from the web, surveillance cameras include more diverse occlusions, poses, weather conditions and image blur. Although face verification or closed-set face identification have surpassed human capabilities on some datasets, open-set identification is much more complex as it needs to reject both unknown identities and false accepts from the face detector. We show that unconstrained face detection can approach high detection rates albeit with moderate false accept rates. By contrast, open-set face recognition is currently weak and requires much more attention.

UIT-ViNames

This dataset comprises over 26,000 full names annotated with genders. Source: Gender Prediction Based on Vietnamese Names with Machine Learning Techniques

VGGFace2 HQ

A high-resolution version of VGGFace2 for academic face editing purposes. This project uses GFPGAN for image restoration and insightface for data preprocessing (crop and align).

YFCC-CelebA

The scales of the data accessible through internet search engines can reach hundreds of millions, or even billions. The existence of such large weak-labeled databases has gained importance in the training of face recognition algorithms. Starting with the publicly available YFCC100M, we propose a weakly-labeled subset for multi-label face recognition for self-supervised methods. A 392K image subset of YFCC100M of 128x128 images was obtained by querying for the 40 facial attributes. We made this dataset publicly available.

4,458 People - 3D Facial Expressions Recognition Data

Description: 4,458 People - 3D Facial Expressions Recognition Data. The collection scenes include indoor scenes and outdoor scenes. The dataset includes males and females. The age distribution ranges from juvenile to the elderly, the young people and the middle aged are the majorities. The device includes iPhone X, iPhone XR. The data diversity includes different expressions, different ages, different races, different collecting scenes. This data can be used for tasks such as 3D facial expression recognition. Data size: 4,458 people, 7 kinds of 3D expressions were collected for each person Population distribution: race distribution: Asian (Chinese), Black, Caucasian; gender distribution: male, female; age distribution: ranging from teenager to the elderly, the middle-aged and young people are the majorities

DREAMING Inpainting Dataset

Dataset for the DREAMING - Diminished Reality for Emerging Applications in Medicine through Inpainting Challenge! The DREAMING Challenge is part of ISBI 2024. Participate for Awards, Money Prices, Proceedings Paper, Top-Tier Challenge Summary Paper! More information about the challenge and registration can be found on the challenge platform! The DREAMING training dataset contains 100 diverse, photorealistic surgery scenes with unique patients, surroundings and obstructions from dynamically moving and static surgical instruments and hands holding them. We also provide the masks defining the area to be inpainted for each image.

Face dataset by Generated Photos

The free Face dataset made for students and teachers. It contains 10,000 photos with equal distribution of race and gender parameters, along with metadata and facial landmarks. Free to use for research with citation Photos by Generated.Photos. Photos All the photos are 100% synthetic. Based on model-released photos. Royalty-free. Can be used for any research purpose except for the ones violating the law. Worldwide. No time limitations. Quantity 10,000 Quality 256x256px Diversity Ethnicity, gender Metadata The JSON files contain the metadata for each image in a machine-readable format, including: (1) FaceLandmarks: mouth, right_eyebrow, left_eyebrow, right_eye, left_eye, nose, jaw. (2) FaceAttributes: headPose, gender, makeup, emotion, facialHair, hair (hairColor, hairLength, bald), occlusion, ethnicity, eye_color, smile, age

FacesInThings

We introduce an annotated dataset of five thousand human labeled pareidolic face images, called ``Faces in Things''. Faces in Things is derived from the LAION-5B dataset and annotated for key face attributes and bounding boxes

HEADSET

The volumetric representation of human interactions is one of the fundamental domains in the development of immersive media productions and telecommunication applications. Particularly in the context of the rapid advancement of Extended Reality (XR) applications, this volumetric data has proven to be an essential technology for future XR elaboration. In this work, we present a new multimodal database to help advance the development of immersive technologies. Our proposed database provides ethically compliant and diverse volumetric data, in particular 27 participants displaying posed facial expressions and subtle body movements while speaking, plus 11 participants wearing head-mounted displays (HMDs). The recording system consists of a volumetric capture (VoCap) studio, including 31 synchronized modules with 62 RGB cameras and 31 depth cameras. In addition to textured meshes, point clouds, and multi-view RGB-D data, we use one Lytro Illum camera for providing light field (LF) data simultaneously. Finally, we also provide an evaluation of our dataset employment with regard to the tasks of facial expression classification, HMDs removal, and point cloud reconstruction. The dataset can be helpful in the evaluation and performance testing of various XR algorithms, including but not limited to facial expression recognition and reconstruction, facial reenactment, and volumetric video. HEADSET and its all associated raw data and license agreement will be publicly available for research purposes.

Human faces with mixed-race & various emotions

This dataset consists of 600+ items of faces with different emotions and mixed races that are ready to use for optimizing the accuracy of computer vision models. Human age range from 20 to 60 years old, balance in gender, no occlusion, with head direction (<45 degree up-down and left-right). All of the contents is sourced from PIXTA's stock library of 100M+ Asian-featured images and videos. PIXTA is the largest platform of visual materials in the Asia Pacific region offering fully-managed services, high quality contents and data, and powerful tools for businesses & organizations to enable their creative and machine learning projects. For more details, please refer to the link: https://www.pixta.ai/ Or send your inquiries to contact@pixta.ai

ICT-3DHP

ICT-3DHP is collected using the Microsoft Kinect sensor and contains RGB images and depth maps of about 14k frames, divided in 10 sequences. The image resolution is 640 × 480 pixels. An hardware sensor (Polhemus Fastrack) is exploited to generate the ground truth annotation. The device is placed on a white cap worn by each subject, visible in both RGB and depth frames. Source: POSEidon: Face-from-Depth for Driver Pose Estimation

KID-F

Description K-pop Idol Dataset - Female (KID-F) is the first dataset of K-pop idol high quality face images. It consists of about 6,000 high quality face images at 512x512 resolution and identity labels for each image. We collected about 90,000 K-pop female idol images and crop the face from each image. And we classified high quality face images. As a result, there are about 6,000 high quality face images in this dataset. There are 300 test datasets for a benchmark. There are no duplicate images between test and train images. Some identities in test images are not duplicated with train images. (It means some test images is new identity to the trained model) Each test images have its degraded pair. You can use these degraded test images for testing face super resolution performance. We also provide identity labels for each image. You can download the csv file from our github # Download You can download dataset from here. Google Drive # Agreement - The use of this software is RESTRICTED to non-commercial research and educational purposes. - All images of the KID-F dataset are obtained from the internet which are not property of EDA(PCEO-AI-CLUB). EDA is not responsible for the content nor the meaning of these images. - You agree not to reproduce, duplicate, copy, sell, trade, resell or exploit for any commercial purposes, any portion of the images and any portion of derived data. - You agree not to further copy, publish or distribute any portion of the KID-F dataset. Except, for internal use at a single site within the same organization it is allowed to make copies of the dataset. - EDA reserves the right to terminate your access to the CelebA dataset at any time.

MS-EVS Dataset

The MS-EVS Dataset is the first large-scale event-based dataset for face detection. - Regular images (APS) and simulated events (EVS) - Multispectral data (RGB and/or near IR) - Very diverse faces and data quality (for robust face detection) It is divided in four subsets: - N-YoutubeFaces, 3k+ celebrity faces from Youtube videos, in color (simulated events). - N-MobiFace, 80 unedited mobile live color videos (simulated events). - N-SpectralFace, 69 multispectral videos captured in-house (simulated events). - Real-SpectralFace, a few sequences with real multispectral events (Grayscale and Infrared). | Dataset | APS | Simulated EVS | Real EVS | Data | |:---------------------:|:-------:|:-----------------:|:------------:|:--------------------------------------:| | N-YoutubeFaces | x | x | | Color (RGB) | | N-MobiFace | x | x | | Color (RGB) | | N-SpectralFace | x | x | | Multispectral (9 visible + 1 infrared) | | Real-SpectralFace | x | | x | Multispectral (1 visible + 1 infrared) |

SF-TL54: A Thermal Facial Landmark Dataset with Visual Pairs

Facial landmark detection is a cornerstone in many facial analysis tasks such as face recognition, drowsiness detection, and facial expression recognition. Numerous methodologies were introduced to achieve accurate and efficient facial landmark localization in visual images. However, there are only several works that address facial landmark detection in thermal images. The main challenge is the limited number of annotated datasets. In this work, we present a thermal face dataset with annotated face bounding boxes and facial landmarks. The dataset contains 2,556 thermal images of 142 individuals, where each thermal image is paired with the corresponding visual image. To the best of our knowledge, our dataset is the largest in terms of the number of individuals. In addition, our dataset can be employed for tasks such as thermal-to-visual image translation, thermal-visual face recognition, and others. We trained two models for the facial landmark detection task to show the efficacy of our dataset. The first model is a classic machine learning model based on an ensemble of regression trees. The second model is a deep learning model based on the U-net architecture. The dataset, annotations, source code, and pre-trained models are publicly available to advance research in thermal face analysis.

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.