A baseline regularization scheme for transfer learning with convolutional neural networks.

•The standard L2 regularization is not adequate for transfer learning problems.•We recommend regularizers that drive parameters towards the pre-trained model.•Experimental results in image classification and segmentation favor this scheme.•Analyses and some theoretical insights are proposed.