To address the challenges of hyperparameter tuning and reliance on manual experience in dual-channel pulse-coupled neural networks (DCPCNN) for image fusion tasks, the paper proposes a data-driven Bayesian maximum entropy (DBME) multi-objective optimization method to enhance image fusion performance. Firstly, the source images are transformed into the NSST domain with low-frequency bands and high-frequency bands. Secondly, we design a DCPCNN model based on DBME optimization to fuse the high-frequency subbands. For the low-frequency subbands, a method based on weighted local energy and multi-scale morphological gradient fusion rule is proposed. Finally, the fused image is reconstructed by the NSST inverse transform. The results demonstrate that, compared to other fusion methods, this approach outperforms in the fusion of infrared and visible light images, as well as multi-focus images, with significant advantages in metrics such as AG, SD, SCD, and VIFF.

Data-Driven Bayesian Maximum Entropy Multi-Objective Hyperparameter Optimization for PCNN Image Fusion

Pace, Pasquale;Li, Qimeng;Fortino, Giancarlo
2025-01-01

Abstract

To address the challenges of hyperparameter tuning and reliance on manual experience in dual-channel pulse-coupled neural networks (DCPCNN) for image fusion tasks, the paper proposes a data-driven Bayesian maximum entropy (DBME) multi-objective optimization method to enhance image fusion performance. Firstly, the source images are transformed into the NSST domain with low-frequency bands and high-frequency bands. Secondly, we design a DCPCNN model based on DBME optimization to fuse the high-frequency subbands. For the low-frequency subbands, a method based on weighted local energy and multi-scale morphological gradient fusion rule is proposed. Finally, the fused image is reconstructed by the NSST inverse transform. The results demonstrate that, compared to other fusion methods, this approach outperforms in the fusion of infrared and visible light images, as well as multi-focus images, with significant advantages in metrics such as AG, SD, SCD, and VIFF.
2025
Bayesian maximum entropy
data driven
image fusion
multi-objective optimization
Pulse coupled neural network
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11770/399622
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact