Pedestrian detection with unsupervised multispectral feature learning using deep neural networks.

•We propose a unified framework which combines auto-annotation with TS-RPN.•Pedestrian instances are iteratively labeling using multimodal information.•Temporal tracking and label fusion improve the quality of auto-annotated labels.•TS-RPN efficiently fuses the semantic features on both visible and thermal images.