Deep Nonnegative Matrix Factorization with Joint Global and Local Structure Preservation

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Farid Saberi-Movahed - , Graduate University of Advanced Technology, Institute for Applied Computer Science (InfAI) (Author)
  • Bitasta Biswas - , RWTH Aachen University (Author)
  • Prayag Tiwari - , Halmstad University (Author)
  • Jens Lehmann - , Amazon Development Center Germany GmbH, Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI) Dresden/Leipzig (Author)
  • Sahar Vahdati - , Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI Dresden), Institute for Applied Computer Science (InfAI) (Author)

Abstract

Deep Non-Negative Matrix Factorization (DNMF) methods provide an efficient low-dimensional representation of given data through their layered architecture. A limitation of such methods is that they cannot effectively preserve the local and global geometric structures of the data in each layer. Consequently, a significant amount of the geometrical information within the data, present in each layer of the employed deep framework, can be overlooked by the model. This can lead to an information loss and a subsequent drop in performance. In this paper, we propose a novel deep non-negative matrix factorization method, Deep Non-Negative Matrix Factorization with Joint Global and Local Structure Preservation (dubbed Dn2MFGL), that ensures the preservation of both global and local structures within the data space. Dn2MFGL performs representation learning through a sequential embedding procedure which involves both the global data structure by accounting for the data variance, and the local data relationships by utilizing information from neighboring data points. Moreover, a regularization term that promotes sparsity by utilizing the concept of the inner product is applied to the matrices representing the lower dimensions. This aims to retain the fundamental data structure while discarding less crucial features. Simultaneously, the residual matrix of Dn2MFGL is subjected to the L2,1 norm, which ensures the robustness of the model against noisy data samples. An effective and multiplicative updating process also facilitates Dn2MFGL in solving the employed objective function. The clustering performance of the proposed deep NMF method is explored across various benchmarks of face datasets. The results point to Dn2MFGL outperforming several existing classical and state-of-the-art NMF methods. The source code is available at https://github.com/FaridSaberi/Dn2MFGO.git.

Details

Original languageEnglish
Article number123645
JournalExpert Systems with Applications
Volume249
Publication statusPublished - 1 Sept 2024
Peer-reviewedYes

External IDs

ORCID /0000-0001-7047-3813/work/191041792

Keywords

Keywords

  • Deep Non-negative Matrix Factorization, Global structure, Local structure, Non-negative Matrix Factorization, Sparsity