CMT: Cross Modulation Transformer with Hybrid Loss for Pansharpening

Jul 1, 2024·
Wenjie Shu
Wenjie Shu
,
Hong-Xia Dou
,
Rui Wen
,
Xiao Wu
,
Liang-Jian Deng
· 1 min read
Abstract
We propose a Cross Modulation Transformer (CMT) for pansharpening that integrates modulation techniques from signal processing into attention to effectively fuse panchromatic and multispectral images. A hybrid loss combining wavelet and Fourier transforms further improves fusion quality.
Type
Publication
IEEE GRSL 2024

This work introduces CMT and a hybrid frequency-domain loss to advance pansharpening quality.

Can't display the PDF inline. Click to view/download: modulation.pdf

Figure: CMT modulation overview.

Peer-Reviewed Pansharpening Remote Sensing Transformer
Wenjie Shu
Authors
Wenjie Shu (he/him)
Researcher