GitHub

2023-07-29 17:59| 来源: 网络整理| 查看: 265

VGGFace2 Dataset for Face Recognition (website)

The dataset contains 3.31 million images of 9131 subjects (identities), with an average of 362.6 images for each subject. Images are downloaded from Google Image Search and have large variations in pose, age, illumination, ethnicity and profession (e.g. actors, athletes, politicians). The whole dataset is split to a training set (including 8631 identites) and a test set (including 500 identites).

VGGFace2: A dataset for recognising faces across pose and age, Q. Cao, L. Shen, W. Xie, O. M. Parkhi, A. Zisserman, In FG 2018.

News Date Update 2018-10-01 Models imported to PyTorch. Example scripts for cropping faces and evaluating on IJB-B can be found in the folder 'standard_evaluation'. 2018-09-18 Models with lower-dimensional embedding layers for feature representation. 2018-04-10 New models trained on VGGFace2 (see below). Training details can be found in the paper. Trained models

We report 1:1 verification performance (center 224x224 crop from resized image with shorter side = 256) on IJB-B [1] for reference (ROC. Higher is better). More evaluation results can be found in the paper. Models in pretrain setting are trained on MS-Celeb-1M [2] dataset and then fine-tuned on VGGFace2 dataset. ResNet-50 models follow the architectural configuration in [3] and SE-ResNet-50 models follow the one in [4]. "" means that a lower-dimensional embedding layer is stacked on the top of the original final feature layer adjacent to classifier. The models are trained with standard softmax loss.

TF Model (Keras): Please check this repo.

Architecture Feat dim Pretrain TAR@FAR = 0.001 TAR@FAR = 0.01 Model Link ResNet-50 2048 N 0.878 0.938 Caffe, MatConvNet, PyTorch ResNet-50 2048 Y 0.891 0.947 Caffe, MatConvNet, PyTorch SE-ResNet-50 2048 N 0.888 0.949 Caffe, MatConvNet, PyTorch SE-ResNet-50 2048 Y 0.908 0.956 Caffe, MatConvNet, PyTorch ResNet-50-256D 256 Y 0.898 0.956 Caffe, MatConvNet, PyTorch ResNet-50-128D 128 Y 0.904 0.956 Caffe, MatConvNet, PyTorch SE-ResNet-50-256D 256 Y 0.912 0.965 Caffe, MatConvNet, PyTorch SE-ResNet-50-128D 128 Y 0.910 0.959 Caffe, MatConvNet, PyTorch Compatibility

Caffe: SE models use the "Axpy" layer which is a combination of two consecutive operations channel-wise scale and element-wise summation (More information can be found here.) Please note that the input mean vector is in BGR order as opencv is used for loading images.

MatConvNet: This code uses the following three modules:

autonn - a wrapper for MatConvNet mcnExtraLayers - some useful additional layers mcnSENets - supporting layers for SE models

All of these can be setup directly with vl_contrib (i.e. run vl_contrib install then vl_contrib setup ).

import imp import torch # 'senet50_256_pytorch' is the model name MainModel = imp.load_source('MainModel', 'senet50_256_pytorch.py') model = torch.load('senet50_256_pytorch.pth') Pre-processing:

We use MTCNN for face detection. This bounding box is then extended by a factor 0.3 (except the extension outside image) to include the whole head, which is used as network input (Please note that the released faces are based on a larger extension ratio 1.0. The coordinates of bounding boxes and 5 facial keypoints referring to the loosely cropped faces can be found here.

Reference

[1] C. Whitelam, E. Taborsky, A. Blanton, B. Maze, J. Adams, T. Miller, N. Kalka, A. K. Jain, J. A. Duncan, K. Allen, J. Cheney and P. Grother. IARIA Janus Benchmark-B Face Dataset. In CVPR Workshop on Biometrics 2017.

[2] Y. Guo, L. Zhang, Y. Hu, X. He, and J. Gao. MS-Celeb-1M: A Dataset and Benchmark for Large Scale Face Recognition. In ECCV 2016.

[3] K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In CVPR 2016.

[4] J. Hu, L. Shen and G. Sun. Squeeze-and-Excitation Networks. In CVPR 2018.

[5] C. Chen, J. Yao, R. Zhang, Y. Zhou, T. Qin, T. Zhan and Q. Wang. MMdnn:http://github.com/Microsoft/MMdnn

Acknowledgements

This research is based upon work supported by the Office of the Director of National Intelligence (ODNI), Intel- ligence Advanced Research Projects Activity (IARPA), via contract number 2014-14071600010. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of ODNI, IARPA, or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purpose notwithstanding any copyright annotation thereon.

We would like to thank Samuel Albanie for his help in model converting.

【本文地址】

公司简介

联系我们