Exploring the Use of Fractional Calculus in Image Fusion via Dynamical Systems

Gargi J. Trivedi, Rajesh Sanghavi

doi:https://doi.org/10.59232/MS-V2I3P101

Research Article | Open Access | Download Full Text

Volume 2 | Issue 3 | Year 2024 | Article Id: MS-V2I3P101 DOI: https://doi.org/10.59232/MS-V2I3P101

Exploring the Use of Fractional Calculus in Image Fusion via Dynamical Systems

Gargi J. Trivedi, Rajesh Sanghavi

Received	Revised	Accepted	Published
09 Jul 2024	10 Aug 2024	08 Sep 2024	30 Sep 2024

Citation

Gargi J. Trivedi, Rajesh Sanghavi. “Exploring the Use of Fractional Calculus in Image Fusion via Dynamical Systems.” DS Journal of Modeling and Simulation, vol. 2, no. 3, pp. 1-12, 2024.

Abstract

This paper presents a novel method for multi-modal image fusion using a non-instantaneous impulsive Hilfer fractional integro-differential evolution system. The method introduces a two-step approach, where input images undergo fractional diffusion for initial smoothing, followed by fusion through an impulsive mechanism. The non-linear integro-differential equations combine fractional diffusion and impulsive fusion within a unified framework, enabling enhanced feature preservation. The proposed technique is evaluated using objective metrics, including peak signal-to-noise ratio, structural similarity index, and mutual information, along with subjective visual quality assessments. Results demonstrate that this approach outperforms current state-of-the-art techniques in both performance metrics and visual quality. This method has significant potential for advancing multi-modal image fusion applications, particularly in fields such as medical imaging, surveillance, and remote sensing.

Keywords

Dynamical systems, Image fusion, Multimodal data, Performance evaluation.

References

[1] D. Sunderlin Shibu, and S. Suja Priyadharsini, “Multi-Scale Decomposition Based Medical Image Fusion Using Convolutional Neural Network and Sparse Representation,” Biomedical Signal Processing and Control, vol. 69, 2021.

[CrossRef] [Google Scholar] [Publisher Link]

[2] Kunpeng Wang et al., “Multi-Modality Medical Image Fusion Using Convolutional Neural Network and Contrast Pyramid,” Sensors, vol. 20, no. 8, 2020.

[CrossRef] [Google Scholar] [Publisher Link]

[3] Lei Wu et al., “Multi-Band Remote Sensing Image Fusion Based on Collaborative Representation,” Information Fusion, vol. 90, pp. 23-35, 2023.

[CrossRef] [Google Scholar] [Publisher Link]

[4] Jameel Ahmed Bhutto et al., “CT and MRI Medical Image Fusion Using Noise-Removal and Contrast Enhancement Scheme with Convolutional Neural Network,” Entropy, vol. 24, no. 3, 2022.

[CrossRef] [Google Scholar] [Publisher Link]

[5] Hao Zhang et al., “Image Fusion Meets Deep Learning: A Survey and Perspective,” Information Fusion, vol. 76, pp. 323-336, 2021.

[CrossRef] [Google Scholar] [Publisher Link]

[6] J. Sliz, and J. Mikulka, “Advanced Image Segmentation Methods Using Partial Differential Equations: A Concise Comparison,” Progress in Electromagnetic Research Symposium (PIERS), Shanghai, China, pp. 1809-1812, 2016.

[CrossRef] [Google Scholar] [Publisher Link]

[7] Wei Tang et al., “MATR: Multimodal Medical Image Fusion via Multiscale Adaptive Transformer,” IEEE Transactions on Image Processing, vol. 31, pp. 5134-5149, 2022.

[CrossRef] [Google Scholar] [Publisher Link]

[8] K. Vanitha, D. Satyanarayana, and M.N.G. Prasad, “Multi-Modal Medical Image Fusion Algorithm Based on Spatial Frequency Motivated PA-PCNN in the NSST Domain,” Current Medical Imaging, vol. 17, no. 5, pp. 634-643, 2021.

[CrossRef] [Google Scholar] [Publisher Link]

[9] Han Xu, and Jiayi Ma, “EMFusion: An Unsupervised Enhanced Medical Image Fusion Network,” Information Fusion, vol. 76, pp. 177-186, 2021.

[CrossRef] [Google Scholar] [Publisher Link]

[10] P. Perona, and J. Malik, “Scale-Space and Edge Detection Using Anisotropic Diffusion,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629-639, 1990.

[CrossRef] [Google Scholar] [Publisher Link]

[11] Leonid I. Rudin, Stanley Osher, and Emad Fatemi, “Nonlinear Total Variation Based Noise Removal Algorithms,” Physica D: Nonlinear Phenomena, vol. 60, no. 1-4, pp. 259-268, 1992.

[CrossRef] [Google Scholar] [Publisher Link]

[12] Rafael C. Gonzalez, Richard E. Woods, and Steven L. Eddins, Digital Image Processing Using MATLAB, Tata McGraw-Hill, 2010.

[Google Scholar] [Publisher Link]

[13] Y.L. You, and M. Kaveh, “Fourth-Order Partial Differential Equation 0s for Noise Removal,” IEEE Transactions on Image Processing, vol. 9, no. 10, pp. 1723-1730, 2000.

[CrossRef] [Google Scholar] [Publisher Link]

[14] Gargi Trivedi, and Rajesh Sanghvi,”Infrared and Visible Image Fusion Using Multi-scale Decomposition and Partial Differential Equations”, International Journal of Applied and Computational Mathematics, vol. 10, 2024.

[CrossRef] [Google Scholar] [Publisher Link]

[15] Keith A. Johnson, and J. Alex Becker, The Whole Brain Atlas. [Online]. Available: https://www.med.harvard.edu/aanlib/home.html

[16] Alexander Toet, “The TNO Multiband Image Data Collection,” Data in Brief, vol. 15, pp. 249-251, 2017.

[CrossRef] [Google Scholar] [Publisher Link]