Neural Image Compression with Text-guided Encoding for both Pixel-level and Perceptual Fidelity
CoRR(2024)
摘要
Recent advances in text-guided image compression have shown great potential
to enhance the perceptual quality of reconstructed images. These methods,
however, tend to have significantly degraded pixel-wise fidelity, limiting
their practicality. To fill this gap, we develop a new text-guided image
compression algorithm that achieves both high perceptual and pixel-wise
fidelity. In particular, we propose a compression framework that leverages text
information mainly by text-adaptive encoding and training with joint image-text
loss. By doing so, we avoid decoding based on text-guided generative models –
known for high generative diversity – and effectively utilize the semantic
information of text at a global level. Experimental results on various datasets
show that our method can achieve high pixel-level and perceptual quality, with
either human- or machine-generated captions. In particular, our method
outperforms all baselines in terms of LPIPS, with some room for even more
improvements when we use more carefully generated captions.
更多查看译文
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要