Skip to main navigation Skip to search Skip to main content

Multimodal knowledge graph completion method for addressing imbalance of modal information

  • Ronghua Tian
  • , Hong Yu*
  • , Yaogang Geng
  • , Xiaoling Wang
  • *Corresponding author for this work
  • Chongqing University of Posts and Telecommunications

Research output: Contribution to journal › Article › peer-review

Abstract

Multimodal Knowledge Graph Completion (MMKGC) focuses on predicting missing triples in multimodal knowledge graphs by effectively leveraging both relational triples and multimodal information. However, existing MMKGC methods often overlook the imbalance of modal information among entities, resulting in an overreliance on the dominant modalities and degrading the performance of completion. To address the problem caused by the modality imbalance, a novel Multimodal Knowledge Graph Completion method (shorted by MI-MKGC) is proposed in this paper. It addresses the problem from two aspects: (1) the relation knowledge-guided dynamic modal fusion module dynamically adjusts the weights of each modality by using the relational types between entities as prior knowledge, and (2) the joint modality adversarial training module generates negative samples to enhance weak modality information. The extensive experimental results on three public datasets with 16 state-of-the-art baselines have verified the advancement of the proposed method. Specially, the metric Hit@1 of MI-MKGC increases by up to 5.2% than that of the best exiting compared method. The implementation code is available at https://github.com/yuhongcqupt/MI-MKGC.

Original languageEnglish
Article number106
JournalData Mining and Knowledge Discovery
Volume40
Issue number6
DOIs
StatePublished - Dec 2026

Keywords

  • Adversarial training
  • Imbalanced modality information
  • Knowledge graph completion
  • Multi-modal knowledge graph

Fingerprint

Dive into the research topics of 'Multimodal knowledge graph completion method for addressing imbalance of modal information'. Together they form a unique fingerprint.

Cite this