Application of deep learning models in nonlinear detail map prediction in pansharpening

•Nonlinear estimation of detail maps in multispectral image fusion.•Modeling the nonlinear relationship between the detail maps with the multispectral channel with deep neural networks.•Better injection of spatial details to the multispectral channels.•Improvement in spectral and spatial consistency in the fused results comparing the state-of-the art methods.