Unconstrained Kinect video face database

•A novel RGB-DI database of 108 subjects with videos captured using both Kinect v1 and Kinect v2.•It comprises the covariates of pose, illumination, expression, quality and distance.•The database contains videos in visible and near-infrared spectrums along with depth information.•Experimental protocols and baseline results are provided to promote database usage.