一种红外与可见光图像信息交换融合网络Infrared and Visible Image Information Exchange-fusion Algorithm
曹金亮,薛伟民,蔡雨含,王安红
摘要(Abstract)：
采用深度神经网络提出了一种交叉融合算法(CrossFusion-Net)以整合红外和可见光信息生成融合图像。首先设计了一个具有交叉连接结构的信息交换自编码网络，用于特征提取和图像融合，其次设计了信息补偿支路传递边缘信息和光照信息，最终将红外与可见光信息整合到一张图像中。实验结果表明，所提算法有效提升了融合图像的视觉感知效果，与其他优秀算法相比，本算法在主观和客观评测中都取得了更好的结果，并可应用到电力图像融合中。
关键词(KeyWords)： 图像融合;电力图像融合;红外图像;图像处理
基金项目(Foundation): 国家自然科学基金(62072325);; 山西省科技重大专项(20191102010);; 山西省关键核心技术和共性技术研发攻关(20201102011);; 山西省高校科技成果转化培育项目(20191042);; 山西省科技成果转化引导专项(201804D131035)
作者(Author): 曹金亮,薛伟民,蔡雨含,王安红
参考文献(References)：
- [1] LI S,KANG X,FANG L,et al.Pixel-level image fusion:A survey of the state of the art[J].information Fusion,2017,33:100-112.
- [2] 沈英，黄春红，黄峰，等.[J].红外与激光工程，2021,50(9):20200467-1-20200467-18.
- [3] GERHART G,MARTIN G,GONDA T.Thermal image modeling[C]//Infrared Sensors and Sensor Fusion.SPIE,1987,782:3-9.
- [4] LIU Y,CHEN X,WARD R K,et al.Image fusion with convolutional sparse representation[J].IEEE signal processing letters,2016,23(12):1882-1886.
- [5] LIU Y,CHEN X,PENG H,et al.Multi-focus image fusion with a deep convolutional neural network[J].Information Fusion,2017,36:191-207.
- [6] RAM PRABHAKAR K,SAI SRIKAR V,VENKATESH BABU R.Deepfuse:A deep unsupervised approach for exposure fusion with extreme exposure image pairs[C]//Proceedings of the IEEE international conference on computer vision.2017:4714-4722.
- [7] MA J,YU W,LIANG P,et al.FusionGAN:A generative adversarial network for infrared and visible image fusion[J].Information Fusion,2019,48:11-26.
- [8] LI H,WU X J .DenseFuse:A Fusion Approach to Infrared and Visible Images[J].IEEE Transactions on Image Processing,2019,28(5):2614-2623.
- [9] 王娟，柯聪，刘敏，等.神经网络框架下的红外与可见光图像融合算法综述[J].激光杂志，2020,41(7):7-12.
- [10] BROWN M,SüSSTRUNK S.Multi-spectral SIFT for scene category recognition[C]//CVPR 2011.IEEE,2011:177-184.
- [11] LIU Y,CHEN X,PENG H,et al.Multi-focus image fusion with a deep convolutional neural network[J].Information Fusion,2017,36:191-207.
- [12] WANG Z,BOVIK A C,SHEIKH H R,et al.Image quality assessment:from error visibility to structural similarity[J].IEEE transactions on image processing,2004,13(4):600-612.
- [13] WANG Z,SIMONCELLI E P,BOVIK A C.Multiscale structural similarity for image quality assessment[C]//The Thrity-Seventh Asilomar Conference on Signals,Systems & Computers,2003.Ieee,2003,2:1398-1402.
- [14] XYDEAS C S,PETROVIC V.Objective image fusion performance measure[J].Electronics letters,2000,36(4):308-309.